JP2018163321A - Multi display system, video display system, display, and video display control controller - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology, in constructing a multi display system, for relaxing a complicated setting of an installation condition for the multi display and suppressing an increase in display delay and power consumption.SOLUTION: A multi display system specifies, from a first video displayed on a first display, a partial video necessary for image processing on a second video displayed on a second display, on the basis of the relative position of the first display among a plurality of displays, and transmits the specified partial video to a transmission path; transfers the partial video received through the transmission path to the transmission path; and performs image processing on the first video on the basis of the first video and some of the partial video received through the transmission path according to the positional relationship between the first display and second display, and displays the first video subjected to the image processing.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for processing video with a plurality of devices.

  In recent years, the resolution of video source devices has been increasing, and in order to display high-resolution images, a display or projector device itself is equipped with a high-resolution panel to create a product that realizes high-resolution display. On the other hand, a system has been realized in which a plurality of displays and projectors (hereinafter referred to as display devices) are connected to form a high-resolution one-screen image. In a system that displays video by connecting a plurality of display devices (hereinafter referred to as a multi-display system), video data is supplied from a video source device to each display device. In each display device, high resolution display by a plurality of display devices is possible by displaying an area displayed by the display device. In a multi-display system, it is possible to display a high-resolution video exceeding the panel resolution without being restricted by the panel resolution of each display device, and is expected to be used for commercial purposes such as digital signage. .

  In such a multi-display system, a configuration in which a single video is divided into regions to be displayed on each display device on the video source device side and supplied to each display device is general. In such a multi-display system, displaying a single video on a plurality of display devices is a main use case, and divided video is input to each display device. At this time, since each display device displays one region obtained by dividing a single video, the end region of the display region of each display device is displayed on the display device that controls display of other adjacent regions. The video is continuous with the video. In general, a display device performs arbitrary image processing on an input video to improve the quality of the video. Various types of image processing are conceivable, and mainly image processing is performed on a pixel basis and “image processing that refers to peripheral pixels” (hereinafter referred to as peripheral pixel reference image processing) called filter processing. It can be classified into things.

  When considering image processing in a multi-display system, image processing in units of pixels is image processing that is completed only with video input to each display device, but peripheral pixel reference image processing is input to each display device. This is image processing that cannot be completed with video alone. The peripheral pixel reference image processing will be specifically described with reference to FIG. 4B which is an example of a multi-display system.

  FIG. 4B is a diagram showing a 3 × 3 display screen configured using nine displays as display devices. From the video source device, the video divided into nine parts is input to each display device, subjected to image processing in each display device, and finally output as a video. As a result, a large screen display using nine display devices Can be realized. Here, the end area of the display area of each display device needs to be handled as a continuous video area with other adjacent display devices. Normally, in the peripheral pixel reference image processing, the boundary of the display region, that is, the end region is realized by performing end processing suitable for the image processing.

  However, in the configuration shown in FIG. 4B, since a single image is displayed on a plurality of display devices, the end region of each display device is only the end region of the divided image, and the entire image is displayed. However, since it is not an end region, it is not appropriate to perform end processing. Therefore, in the multi-display system, it is necessary for each display device to perform peripheral pixel reference image processing with reference to the edge video included in the display area of the other display device.

  As one method for realizing the peripheral pixel reference image processing for such an end region, there is a method of mutually transmitting data of a reference region necessary for image processing between the display devices. In this method, each display device receives edge video data necessary for image processing of its end region from other display devices, and transmits the end video data of its display region to other display devices. Will be sent out. FIG. 6A shows the area required for the peripheral pixel reference image processing of the edge area by the display device in charge of the display area of (2.2) by hatching, and FIG. As shown, the data of the end region of the adjacent display device is received. FIG. 6B shows a region necessary for peripheral pixel reference image processing of a display device other than the display device in charge of the display region in (2.2) by hatching. . The end regions located on the upper side, the lower side, the right side, and the left side need to be transferred to a single adjacent display device, and the end regions located at the four corners of the display region are for four adjacent display devices. Transfer is required. Here, the display device in charge of the display area (2.2) is described, but the number of adjacent areas is different, but the display apparatus in charge of other display areas is also in charge of the adjacent display apparatus. It is necessary to receive the edge image data to be transmitted and to transmit the edge image data of itself.

JP 2012-124759 A

  Therefore, in order to realize such a multi-display system, data communication between a plurality of display devices is required, and transmission from a single display device to a plurality of display devices is required depending on the data. There was something to be done. As a method for realizing this, there is a method using a general-purpose chip / device connection bus or the like. For example, when the multi-display system shown in FIG. 4B is realized using a general-purpose bus such as PCI Express, it is necessary to adopt a star-type connection topology as shown in FIG. There was a need to connect via switch equipment. In this case, each display device needs to designate the target display device to which the edge video data should be transmitted and transfer the data. You need to know if it is connected to a node. Since connection to a dedicated switch device is generally left to the installation user, it is difficult to ensure that each display device is always connected to a fixed node. Therefore, it is necessary to explicitly set the node to which the display device in charge of the adjacent display region is connected as well as the display region of the display device for each display device. There was a problem that the setting of was necessary.

  Furthermore, since it is necessary to transfer the same edge video data to a plurality of display devices depending on the coordinates of the edge video data, it is necessary to transfer the same data to a display device that is a different target multiple times. There is. The transfer time is extended by transferring the same data multiple times, and the start time of image processing is delayed due to the extension of the transfer time. In the multi-display system, since the output frames of the respective display devices need to be synchronized, there arises a problem that the display time delay from the input to the display becomes long due to the delay of the start time of the image processing. Further, since the same data is transmitted a plurality of times on the bus, there is a problem that it is not preferable from the viewpoint of power consumption.

  Further, for example, when a multi-display configuration is realized with a 4 × 3 configuration, it is necessary to adopt a star topology different from 3 × 3 as shown in FIG. 9, and the configuration of the switch device is also different. The advantage of multi-display is that a plurality of display devices are combined to realize a high resolution, a large screen, and a free aspect independent of the panel resolution. However, since it is necessary to prepare a switch device according to the configuration, it is necessary to change the device for realizing the configuration according to the system configuration, and there is a problem of raising the system cost. Furthermore, there has been a problem that it is necessary to construct a complicated system as the system configuration changes.

  The present invention has been made in view of such problems, and in constructing a multi-display system, it is possible to ease the setting of complicated installation conditions of the multi-display and to reduce the increase in display delay and power consumption. Provide technology.

  One embodiment of the present invention is a multi-display system including a plurality of display devices connected in a ring shape via a transmission line, wherein the first display device in the plurality of display devices is the first display. From the first video displayed on the device, a partial video necessary for image processing on the second video displayed on the second display device adjacent to the first display device is displayed on the plurality of display devices. Sending means for specifying the relative position of the first display device and sending the specified partial video to the transmission path; and transfer means for transferring the partial video received via the transmission path to the transmission path; , Based on the partial video received through the transmission path, the partial video according to the positional relationship between the first display device and the second display device, and the first video, Perform image processing for the first video Characterized by comprising a display control means for displaying a first image subjected to the image processing.

  According to the configuration of the present invention, in constructing a multi-display system, it is possible to alleviate the setting of complicated installation conditions of the multi-display and reduce the increase in display delay and power consumption.

The block diagram which shows the structural example of a multi-display system. FIG. 3 is a block diagram showing an example of a functional configuration of the video display device 100. The figure which shows the tile group in a division | segmentation image | video. (A) is a figure which shows the structural example of the transmission data of a packet format, (b) is a figure which shows a 3 * 3 display screen. 5 is a flowchart showing the operation of the video display apparatus 100. It is a figure which shows a 3x3 display screen. The flowchart of the process which the determination part 207 for own apparatuses performs. The figure which shows a star type connection topology. The figure which shows a star type topology. The block diagram which shows the structural example of a multi-display system. FIG. 3 is a block diagram showing an example of a functional configuration of the video display device 100.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. The embodiment described below shows an example when the present invention is specifically implemented, and is one of the specific examples of the configurations described in the claims.

[First Embodiment]
In the present embodiment, a multi-display having a plurality of display devices connected in a ring shape via a transmission line and displaying each divided video obtained by dividing an input video on a corresponding display device in the plurality of display devices An example of the system will be described. Hereinafter, as shown in FIG. 4B, a multi-display system in which a 3 × 3 display screen is formed by three horizontal display devices × three vertical display devices will be described as an example.

  First, a configuration example of the multi-display system according to the present embodiment will be described with reference to the block diagram of FIG. As shown in FIG. 1, the multi-display system according to the present embodiment includes a video source device 102 and video display devices 100a to 100i.

  The video source device 102 is connected to the video display devices 100a to 100i via video transmission paths 103a to 103i, respectively. The video source device 102 divides the input video into nine divided videos by dividing the input video into three parts in the horizontal direction and three parts in the vertical direction, and divides the divided areas into the video display devices 100a to 100a. 100i is transmitted to the corresponding video display device. In this embodiment, the video source device 102 is assumed to be a single device, but may be composed of a plurality of devices.

  As the video transmission paths 103a to 103i, in addition to general video transmission paths such as DVI, HDMI (registered trademark), and VGA cables, any video transmission path capable of transmitting an arbitrary video such as a network may be used. .

  Each of the video display devices 100a to 100i is connected to the video display devices 100b, 100c,..., 100i, 100a via inter-display device transmission paths 101a to 101i. The video display apparatuses 100a to 100i receive the divided video from the video source device 102 via the video transmission paths 103a to 103i, and transmit transmission data described later to the inter-display apparatus transmission paths 101a to 101i.

  As the video transmission paths 103a to 103i, any video transmission path may be used for the inter-display apparatus transmission paths 101a to 101i. In FIG. 1, as the transmission lines 101a to 101i between the display devices, transmission is performed in one direction from the transmission side to the reception side as in the case of video transmission lines such as DVI or HDMI, or in one direction through a half duplex transmission path. The form is illustrated.

  The video display device has inputs and outputs of a transmission path between the display devices in a single direction from the transmission side to the reception side, and nine video display devices are connected as shown in FIG. As the inter-transmission path, a transmission path in a single direction can be connected in a ring shape.

  Hereinafter, in the description common to the video display devices 100a to 100i, the video display devices 100a to 100i are collectively referred to as the video display device 100. That is, in the following description, the description relating to the video display device 100 is a description applicable to each of the video display devices 100a to 100i.

  Hereinafter, in the description common to the video transmission paths 103a to 103i, the video transmission paths 103a to 103i are collectively referred to as the video transmission path 103. That is, in the following description, the description relating to the video transmission path 103 is an explanation applicable to each of the video transmission paths 103a to 103i.

  Hereinafter, in the description common to the inter-display apparatus transmission paths 101a to 101i, the inter-display apparatus transmission paths 101a to 101i are collectively referred to as the inter-display apparatus transmission path 101. That is, in the following description, the description relating to the inter-display apparatus transmission path 101 is an explanation applicable to each of the inter-display apparatus transmission paths 101a to 101i.

  Next, a functional configuration example of the video display apparatus 100 will be described with reference to the block diagram of FIG.

  The control unit 299 includes a processor such as a CPU and a memory device such as a RAM and a nonvolatile memory. The control unit 299 functions when the processor executes processing using a computer program or data stored in a memory device. The control unit 299 performs operation control of the entire video display device 100 and executes or controls each process described later as what the video display device 100 performs.

  The video input I / F (interface) 200 receives the divided video transmitted from the video source device 102 via the video transmission path 103, and converts the received divided video into a data format that can be processed by the video display device 100. Convert. The video input I / F 200 may have a general baseband video interface function, or may have a video interface function transmitted via a network or the like.

  The arrangement information holding unit 201 includes configuration information of a plurality of video display devices 100 included in the multi-display system and position information indicating the position of the own device (first display device) in the plurality of video display devices 100. Hold. Here, the “configuration information of the plurality of video display devices 100” means the number of video display devices 100 in the horizontal direction (“3” in the present embodiment) and the number of video display devices 100 in the vertical direction (in the present embodiment). “3”). Further, “position information indicating the position of its own device in the plurality of video display devices 100” is described by taking, for example, FIG. 4B as an example, the position (1.3) in the 3 × 3 video display device 100. The position information of the video display device 100 at (1.3) is (1.3). In other words, the “position information indicating the position of the own apparatus in the plurality of video display apparatuses 100” in this case is position information indicating that the horizontal coordinate is “1” and the vertical coordinate is “3”. Further, in the 3 × 3 video display device 100, the position information of the video display device 100 at the position (2.2) is (2.2), that is, the position information indicating that the horizontal coordinate is “2” and the vertical coordinate is “2”. It becomes. Thus, the position information of the video display device 100 represents the relative position of the video display device 100 in a plurality of video display devices.

  The information held by the arrangement information holding unit 201 is set by a user operation via a UI (user interface) or the like at the time of configuring the multi-display system, for example, and the setting information is the arrangement information holding unit 201 as the above-described configuration information and position information. Will be stored.

  The other device determination unit 202 uses the information held by the arrangement information holding unit 201 to use the other video display device 100 (second display device) as a peripheral pixel in the divided video received by the video input I / F 200. The video of the partial area (partial video) used when performing the reference image processing is specified. Here, the operation of the other apparatus determination unit 202 will be described with reference to FIG.

  As shown in FIG. 3A, the video input I / F 200 divides the divided video into a plurality of rectangles (tiles) by dividing the divided video into 8 by dividing it into 8 in the horizontal direction and 10 in the vertical direction. Output in units. The video input I / F 200 outputs the tile position information attached to the tile. The tile position information is information indicating the position of the tile in the divided video. For example, as shown in FIG. 3A, the position information of the upper-left corner tile in the divided video is (0.0), and the position information of the lower-right corner tile is (7.9).

  However, the other device determination unit 202 refers to the information held by the arrangement information holding unit 201 and each tile output from the video input I / F 200 is processed by the other video display device 100 in the peripheral pixel reference image processing. It is determined whether or not the tile is used when performing. In the divided video of the video display device 100, the adjacent part of the video display device 100 adjacent to the divided video of the other video display device 100 is necessary for the peripheral pixel reference image processing in the other video display device 100. In the present embodiment, as shown in FIG. 3A, peripheral tiles (tiles filled in gray) in the divided video of the own device are used in peripheral pixel reference image processing in the video display device 100 other than the own device. Suppose that the tile has a possibility of being. Here, the tiles used in the peripheral pixel reference image processing in the video display device 100 other than the own device among the tile groups in the divided video of the own device are the upper end tile group 300, the lower end tile group 301, and the left end tile group. 302 and the tile group 303 at the right end are determined according to the position of the own device in the arrangement of the video display devices 100.

  When there is another video display device 100 on the upper end side of the own device in the arrangement of the video display devices 100, the upper end tile group 300 in the divided video of the own device is the peripheral pixel reference image processing in the other video display device 100. The tiles used in That is, when the vertical coordinate indicated by the position information held by the arrangement information holding unit 201 is not “1”, the other device determination unit 202 uses the upper end tile group 300 as the peripheral pixel in the other video display device 100. It is determined as a tile to be used for reference image processing.

  When another video display device 100 exists on the lower end side of the own device in the arrangement of the video display devices 100, the lower end tile group 301 in the divided video of the own device is the peripheral pixel reference image processing in the other video display device 100. The tiles used in That is, when the vertical coordinate indicated by the position information held by the arrangement information holding unit 201 is not “the number in the vertical direction indicated by the configuration information”, the other device determination unit 202 sets the lower tile group 301 to the other video display device 100. Are determined as tiles used in peripheral pixel reference image processing. In the case of FIG. 4B, “the number in the vertical direction indicated by the configuration information” is “3”.

  When another video display device 100 exists on the left end side of the own device in the arrangement of the video display devices 100, the leftmost tile group 302 in the divided video of the own device is a peripheral pixel reference image process in the other video display device 100. The tiles used in That is, when the horizontal coordinate indicated by the position information held by the arrangement information holding unit 201 is not “1”, the other device determination unit 202 uses the leftmost tile group 302 in the peripheral pixel reference image processing in the other video display device 100. Decide which tile to use.

  When another video display device 100 exists on the right end side of the own device in the arrangement of the video display devices 100, the rightmost tile group 303 in the divided video of the own device is the peripheral pixel reference image processing in the other video display device 100. The tiles used in That is, when the horizontal coordinate indicated by the position information held by the arrangement information holding unit 201 is not “the number in the horizontal direction indicated by the configuration information”, the other device determination unit 202 uses the rightmost tile group 303 as the other video display device 100. Are determined as tiles used in peripheral pixel reference image processing. In the case of FIG. 4B, “the number in the horizontal direction indicated by the configuration information” is “3”.

  Taking FIG. 4B as an example, the divided video of the video display device 100 corresponding to the position (3, 2) is divided into gray tiles (the uppermost tile group 300, as shown in FIG. 3B). The tile group 301 at the lower end and the tile group 302 at the left end are determined as tiles used in the peripheral pixel reference image processing in the other video display device 100.

  The tiles determined as “tiles used in the peripheral pixel reference image processing in the other video display device 100” by the other device determination unit 202 are transmitted to the transmission data generation unit 203 together with the position information of the tiles. To do. The other device determination unit 202 does not perform processing on tiles that have not been determined as “tiles used in the peripheral pixel reference image processing in the other video display device 100”.

  The transmission data generation unit 203 generates transmission data including the tile received from the other device determination unit 202, position information of the tile, and identification information of the video display device 100. The data format of the transmission data is not limited to a specific data format, but in the present embodiment, transmission data in the packet format is generated. A configuration example of packet format transmission data is shown in FIG. The packet-format transmission data includes a header part 400 and a payload part 401.

  The payload portion 401 includes each tile received from the other device determination portion 202. The header section 400 includes at least an issuing apparatus identifier 402 and coordinate information 403 that is position information of each tile received from the other apparatus determination section 202. The issuing device identifier 402 is “position information indicating the position of its own device in the plurality of video display devices 100” acquired from the arrangement information holding unit 201, but is information that can uniquely identify the video display device 100. Any information may be adopted as long as it exists.

  With the issuing device identifier 402 and the coordinate information 403, position information within the display surface of the entire multi-display system for each tile included in the payload section 401 can be uniquely defined. In the present embodiment, as described above, the position information in the display surface of the video display device 100 is used. However, instead of the issuing device identifier 402 and the coordinate information 403, the coordinate information of the entire display surface is defined. It doesn't matter.

  In addition, the header part 400 may include time information 404. The time information 404 can specify the position in the time direction of the video exchanged between the video display devices 100, and can be used for frame synchronization between a plurality of video display devices. Also, by including packet type information and the like in the header section 400, information other than video can be exchanged.

  The inter-display device I / F 204 receives transmission data from another video display device 100 via the inter-display device transmission path 101, and converts the received transmission data into a data format that can be processed internally (into a packet format). Rebuild). The inter-display device I / F 204 is an interface circuit including a physical layer / link layer and a transaction layer necessary for data transfer, and may be configured by a general device or an interchip connection interface circuit. The transmission data reconstructed in the packet format by the inter-display device I / F 204 is transferred in parallel to the own device issuance determination unit 205 and the own device determination unit 207.

  The own device issuance determination unit 205 includes the issuance device identifier 402 in the header portion 400 of the transmission data received from the inter-display device I / F 204, and the “location information holding unit 201 holds” It is determined whether or not the “position information indicating the position” is the same. If the result of this determination is the same, the own device issuance determination unit 205 determines that the transmission data received from the inter-display device I / F 204 has been issued by the own device, and discards the transmission data. On the other hand, if they are not the same, the self-device issuance determination unit 205 determines that the transmission data received from the inter-display device I / F 204 is issued by another device, and sends the transmission data to the inter-display device I / F 206. Send to

  In such a system in which the own device issuance determination unit 205 is connected in a ring shape between the video display devices 100 by the inter-display device transmission path 101, the transmission data is sequentially transmitted until the video display device 100 of the issue source is reached. A transmission configuration can be realized. That is, it is possible to transmit the transmission data to all the video display devices 100 connected in a ring shape via the transmission path.

  The inter-display device I / F 206 transmits the transmission data generated by the transmission data generation unit 203 or the transmission data transferred from the own device issuance determination unit 205 to another video display device 100 (others) via the inter-display device transmission path 101. To the inter-display-device I / F 204) of the video display device 100. The inter-display device I / F 206 is an interface circuit including a physical layer, a link layer, and a transaction layer necessary for data transfer, and may be configured by a general device or an inter-chip connection interface circuit. That is, the inter-display device I / F 206 has a function of converting an internal data format into a data format transmitted via the inter-display device transmission path 101. In this embodiment, since it is transmitted as data in the packet format described with reference to FIG. 4A, the data in the packet format is input and converted to the transmission format in the inter-display apparatus transmission path 101.

  Note that the inter-display device I / F 206 has an input of transmission data generated by the transmission data generation unit 203 and an input of transmission data transferred from the own device issuance determination unit 205. The inter-display-device I / F 206 has a mechanism for arbitrating transmission data input from two paths using an arbitrary arbitration mechanism and outputting the transmission data to the inter-display-device transmission path 101.

  The own device determination unit 207 determines whether or not the transmission data received from the inter-display device I / F 204 includes a tile to be referred to when performing peripheral pixel reference image processing in the own device. For example, as shown in FIG. 6B, among the divided videos of the video display apparatus 100 at the position (2.2), the area necessary for performing the peripheral pixel reference image processing in the video display apparatus 100 at the peripheral position. Is an area (adjacent area) indicated by hatching. However, in this case, the own device determining unit 207 determines whether or not the transmission data received from the inter-display device I / F 204 includes a tile corresponding to the area indicated by the hatched portion. The processing performed by the own device determination unit 207 will be described with reference to the flowchart of FIG.

  In step S <b> 700, the own device determination unit 207 acquires transmission data from the inter-display device I / F 204. Here, “position information indicating the position of the own apparatus in the plurality of video display apparatuses 100” (horizontal coordinates.vertical coordinates) stored in the arrangement information holding unit 201 is (XY). Further, “position information indicating the position of the own device in the plurality of video display devices 100” (horizontal coordinates.vertical coordinates) indicated by the issuing device identifier 402 included in the header part 400 in the transmission data (Xin.Yin) And Further, “position information (horizontal coordinates.vertical coordinates) of each tile represented by the coordinate information 403 included in the header part 400 in the transmission data” is (MN).

  In step S <b> 701, the own device determination unit 207 determines whether Xin = X. As a result of this determination, if Xin = X, the process proceeds to step S702, and if Xin ≠ X, the process proceeds to step S708.

  In step S <b> 702, the own apparatus determination unit 207 determines whether Yin = Y + 1. If Yin = Y + 1 as a result of this determination, the process proceeds to step S704. If Yin ≠ Y + 1, the process proceeds to step S705.

  In step S704, the own device determination unit 207 selects a tile (video data) whose position information is (M.1) from the tile group included in the payload portion 401 in the transmission data, as a peripheral pixel in the own device. Acquired as a tile required for reference image processing. In the case of FIG. 3A, the top tile group 300 is acquired in step S704.

  On the other hand, in step S705, the own device determination unit 207 determines whether Yin = Y−1. If Yin = Y−1 as a result of this determination, the process proceeds to step S707. If Yin ≠ Y−1, the process according to the flowchart of FIG. 7 ends.

  In step S <b> 707, the own device determination unit 207 selects a tile (video data) whose position information is (MQ) from the tile group included in the payload portion 401 in the transmission data. Acquired as a tile required for reference image processing. Here, Q is the number of tiles in the vertical direction in the divided video. In the case of FIG. 3A, the bottom tile group 301 is acquired in step S707.

  On the other hand, in step S708, the own device determination unit 207 determines whether or not Xin = X-1. If Xin = X−1 as a result of this determination, the process proceeds to step S709, and if Xin ≠ X−1, the process proceeds to step S718.

  In step S709, the own apparatus determination unit 207 determines whether or not Yin = Y + 1. If Yin = Y + 1 as a result of this determination, the process proceeds to step S711. If Yin ≠ Y + 1, the process proceeds to step S712.

  In step S711, the own device determination unit 207 selects a tile (video data) whose position information is (P.1) from the tile group included in the payload portion 401 in the transmission data, as a peripheral pixel in the own device. Acquired as a tile required for reference image processing. Here, P is the number of tiles in the horizontal direction in the divided video. In the case of FIG. 3A, in step S711, a common tile (a tile in the upper right corner of the divided video) is acquired by the tile group 300 at the upper end and the tile group 303 at the right end.

  On the other hand, in step S712, the own device determination unit 207 determines whether Yin = Y−1. If Yin = Y−1 as a result of this determination, the process proceeds to step S714. If Yin ≠ Y−1, the process proceeds to step S715.

  In step S <b> 714, the own device determination unit 207 selects a tile (video data) having position information (PQ) from the tile group included in the payload portion 401 in the transmission data, as a peripheral pixel in the own device. Acquired as a tile required for reference image processing. In the case of FIG. 3A, in step S714, a tile common to the lowermost tile group 301 and the rightmost tile group 303 (the tile at the lower right corner of the divided video) is acquired.

  On the other hand, in step S715, the own device determination unit 207 determines whether or not Yin = Y. If Yin = Y as a result of this determination, the process proceeds to step S717. If Yin ≠ Y, the process according to the flowchart of FIG.

  In step S717, the own device determination unit 207 selects a tile (video data) whose position information is (PN) from the tile group included in the payload portion 401 in the transmission data, as a peripheral pixel in the own device. Acquired as a tile required for reference image processing. In the case of FIG. 3A, in step S717, the rightmost tile group 303 is acquired.

  On the other hand, in step S718, the own device determination unit 207 determines whether Xin = X + 1. If Xin = X + 1 as a result of this determination, the process proceeds to step S719. If Xin ≠ X + 1, the process according to the flowchart of FIG. 7 ends.

  In step S719, the own device determination unit 207 determines whether or not Yin = Y + 1. If it is determined that Yin = Y + 1, the process proceeds to step S721. If Yin ≠ Y + 1, the process proceeds to step S722.

  In step S721, the own device determination unit 207 selects a tile (video data) having position information (1.1) from the tile group included in the payload portion 401 in the transmission data as a peripheral pixel in the own device. Acquired as a tile required for reference image processing. In the case of FIG. 3A, in step S721, a tile common to the uppermost tile group 300 and the leftmost tile group 302 (the upper left corner tile of the divided video) is acquired.

  On the other hand, in step S722, the own device determination unit 207 determines whether Yin = Y−1. If Yin = Y−1 as a result of this determination, the process proceeds to step S723. If Yin ≠ Y−1, the process proceeds to step S724.

  In step S723, the own device determination unit 207 selects a tile (video data) having position information (1.Q) from the tile group included in the payload portion 401 in the transmission data, as a peripheral pixel in the own device. Acquired as a tile required for reference image processing. In the case of FIG. 3A, in step S723, a tile common to the lower end tile group 301 and the left end tile group 302 (the tile at the lower left corner of the divided video) is acquired.

  On the other hand, in step S724, the own device determination unit 207 determines whether or not Yin = Y. If Yin = Y as a result of this determination, the process proceeds to step S725. If Yin ≠ Y, the process according to the flowchart of FIG.

  In step S725, the own device determination unit 207 selects a tile (video data) whose position information is (1.N) from the tile group included in the payload portion 401 in the transmission data, as a peripheral pixel in the own device. Acquired as a tile required for reference image processing. In the case of FIG. 3A, in step S725, the leftmost tile group 302 is acquired.

  As described above, the determination unit 207 for the own device responds to the positional relationship between the position information of the own device and the position information of the device adjacent to the own device from the tile group included in the payload portion 401 in the transmission data. Get the tile group.

  The own device determination unit 207 sends the tile acquired from the transmission data to the subsequent combining unit 208 as a “tile necessary for the peripheral pixel reference image processing in the own device” by the above processing.

  The combining unit 208 combines the tile group output from the video input I / F 200 and the tile group output from the own device determination unit 207. For example, as illustrated in FIG. 6A, the own device determination unit 207 determines that “a tile necessary for peripheral pixel reference image processing in the own device (the video display device 100 at the position (2.2))” It is assumed that the tile group in the shaded part is acquired in the divided video of the video display device 100. At this time, the combining unit 208 combines the divided image of the image display device 100 at the position (2.2) with the shaded tile group.

  Since the video display device 100 at the position (1.1) is adjacent to the upper left of its own device, the hatched tile in the divided video of the video display device 100 at the position (1.1) Join to the upper left. Since the video display device 100 at the position (1.2) is adjacent to the left side of the own device, the tile group in the shaded portion in the divided video of the video display device 100 at the position (1.2) is the divided video of the own device. Join to the left of Since the video display device 100 at the position (1.3) is adjacent to the lower left of the own device, the hatched tile in the divided video of the video display device 100 at the position (1.3) Join the lower left. Since the video display device 100 at the position (2.1) is adjacent to the own device, the shaded tile group in the divided video of the video display device 100 at the position (2.1) is the divided video of the device. Join on top of. Since the video display device 100 at the position (2.3) is adjacent to the lower side of the own device, the tile group in the hatched portion in the divided video of the video display device 100 at the position (2.3) is the divided video of the own device. Join below. Since the video display device 100 at the position (3.1) is adjacent to the upper right of its own device, the hatched tile in the divided video of the video display device 100 at the position (3.1) Join to the upper right. Since the video display device 100 at the position (3.2) is adjacent to the right side of its own device, the shaded tile group in the divided video of the video display device 100 at the position (3.2) is the divided video of its own device. Join to the right of. Since the video display device 100 at the position (3.3) is adjacent to the lower right side of its own device, the tiles in the hatched portion in the divided video of the video display device 100 at the position (3.3) are the divided video of the own device. Join the bottom right of In this way, by comparing the position information of the own device and the position information of the other video display device 100, which tile (group) is combined with which position of the divided video in the divided video of the other video display device 100. Confirm.

  The image processing unit 209 performs peripheral pixel reference image processing on the combined image obtained by combining the tile group from the apparatus determination unit 207 with the tile group from the video input I / F 200 by the combining unit 208. Note that the type of image processing is not limited to peripheral pixel reference image processing. Then, the image processing unit 209 sends the remaining video obtained by removing the tile group from the self-device determination unit 207 from the video that has been subjected to the peripheral pixel reference image processing to the subsequent video output unit 210.

  The video output unit 210 displays the video received from the image processing unit 209 on the display panel 211. Instead of the display panel 211, a projector that projects the video received from the image processing unit 209 may be used.

  The operation of the video display apparatus 100 described above will be described using the flowchart of FIG. Note that the details of the processing in each step shown in FIG. 5 are as described above, and thus detailed description thereof is omitted.

  In step S501, the video input I / F 200 receives the divided video transmitted from the video source device 102 via the video transmission path 103, divides the received divided video into a plurality of tiles, and divides the divided video into tile units. To output.

  In step S <b> 502, the other device determination unit 202 uses the information held by the arrangement information holding unit 201, and the other video display device 100 uses the peripheral pixel reference image in the divided video received by the video input I / F 200. Specify the tile to be used when processing. Then, the other device determination unit 202 sends the tiles determined as “tiles used in the peripheral pixel reference image processing in the other video display device 100” together with the position information of the tiles to the transmission data generation unit 203. And send it out.

  In step S503, the transmission data generation unit 203 generates transmission data including the tile received from the other device determination unit 202, the position information of the tile, and the identification information of the video display device 100, and the generated transmission Data is transmitted via the inter-display device I / F 206.

  In step S504, the inter-display-device I / F 204 receives transmission data from the other video display device 100 via the inter-display-device transmission path 101, and converts the received transmission data into a data format that can be processed internally. (Rebuild to packet format).

  In step S 505, the own device issuance determination unit 205 issues the issuing device identifier 402 in the header portion 400 of the transmission data received in step S 504, and the “location of the own device in the plurality of video display devices 100 held by the arrangement information holding unit 201. It is determined whether the “positional information to be shown” is the same. If the result of this determination is the same, the own device issuance determination unit 205 determines that the transmission data received from the inter-display device I / F 204 has been issued by the own device, and the process proceeds to step S506. On the other hand, if they are not the same, the own device issuance determination unit 205 determines that the transmission data received from the inter-display device I / F 204 is issued by another device, and the process proceeds to step S507.

  In step S506, the own device issuance determination unit 205 discards the transmission data received in step S504. On the other hand, in step S507, the own device issuance determination unit 205 transfers the transmission data received in step S504 via the inter-display device I / F 206.

  In step S508, the own device determination unit 207 determines whether or not the tile in the transmission data received in step S504 is a tile to be referred to when performing peripheral pixel reference image processing in the own device. In step S508, processing according to the flowchart of FIG. 7 is performed.

  In step S509, the combining unit 208 combines the tile group output from the video input I / F 200 and the tile group output from the own device determination unit 207. In step S <b> 510, the image processing unit 209 performs peripheral pixel reference image processing on the combined video in which the tile group from the own device determination unit 207 is combined with the tile group from the video input I / F 200. Then, the image processing unit 209 sends the remaining video obtained by removing the tile group from the self-device determination unit 207 from the video that has been subjected to the peripheral pixel reference image processing to the subsequent video output unit 210. In step S <b> 511, the video output unit 210 displays the video received from the image processing unit 209 on the display panel 211.

[Second Embodiment]
In the following, differences from the first embodiment will be mainly described, and unless otherwise noted, the same as the first embodiment. The inter-display apparatus transmission path 101 may be configured with a full-duplex transmission path that includes transmission / reception transmission paths and can be bidirectionally connected. A configuration example of a multi-display system in which the inter-display device transmission path 101 is constructed with a full-duplex transmission path will be described with reference to the block diagram of FIG. As shown in FIG. 10, each video display apparatus 100 has input / output of a full-duplex inter-display transmission path 101, and the transmission path is connected in a ring shape via a bidirectional inter-display transmission path 101. It has a possible configuration.

  Next, a functional configuration example of the video display apparatus 100 according to the present embodiment will be described with reference to the block diagram of FIG. FIG. 11 illustrates a case where the inter-display device transmission path 101 is configured by a full-duplex transmission path.

  The video display device 100 includes inter-display device I / Fs 1101 and 1102 as an interface to the inter-display device transmission path 101. The inter-display device I / F 1101 is for performing data communication with one of the other two video display devices 100 connected to the video display device 100. The inter-display device I / F 1101 includes an inter-display device I / F 204a similar to the inter-display device I / F 204 and an inter-display device I / F 206a similar to the inter-display device I / F 206. Similarly, the inter-display device I / F 1102 is for performing data communication with the other of the other two video display devices 100 connected to the video display device 100. The inter-display device I / F 1102 includes an inter-display device I / F 204 b similar to the inter-display device I / F 204 and an inter-display device I / F 206 b similar to the inter-display device I / F 206.

  That is, each of the inter-display device I / Fs 1101 and 1102 is for performing mutual communication with one video display device 100 and mutual communication with the other video display device 100.

  The inter-display device I / F 204a converts the received transmission data into a data format that can be processed internally (reconstructed into a packet format), and then sends the data to the own device issuance determination unit 205a and the own device determination unit 207a. To do. Similarly, the inter-display-device I / F 204b converts the received transmission data into a data format that can be processed internally (reconstructed into a packet format), and then sends it to the own device issue determination unit 205b and the own device determination unit 207b. Send to

  If the own device issuance determination unit 205a determines that the transmission data received from the inter-display device I / F 204a is not issued by the own device, the own device issuance determination unit 205a sends the transmission data to the inter-display device I / F 206b. . On the other hand, if the own device issuance determination unit 205b determines that the transmission data received from the inter-display device I / F 204b is not issued by the own device, the own device issuance determination unit 205b Send it out.

  In FIG. 11, the own device issuance determination unit 205a and the own device issuance determination unit 205b are provided separately. However, these function units may be combined into a single device issuance determination unit 205. Similarly, the own device determination unit 207a and the own device determination unit 207b may be combined into a single device determination unit 207. In that case, a selection unit is required for selectively switching transmission data from each of the inter-display device I / Fs 204a and 204b and inputting the transmission data to the own device issue determination unit 205 and the own device determination unit 207. For example, the selection unit alternately inputs an input from the inter-display device I / F 204 a and an input from the inter-display device I / F 204 b to the own device issue determination unit 205 and the own device determination unit 207. Further, as a result of the determination by the own device issuance determination unit 205, a switching unit is also required for switching whether transmission data is output to the inter-display device I / F 206a or the inter-display device I / F 206b. The selection of the output destination of the transmission data according to the determination result by the own device issuance determination unit 205 is as described above.

  The transmission data generated by the transmission data generation unit 203 is sent to the selection unit 1103. The selection unit 1103 sends the transmission data received from the transmission data generation unit 203 to any of the inter-display device I / Fs 1101 and 1102. There are various methods for determining which to send. For example, the output destination of the transmission data is determined as one of the I / Fs 1101 and 1102 between the display devices so that the transmission direction of the transmission data between the nine video display devices 100 shown in FIG. In that case, it can be realized by initializing each video display device 100 individually by software or the like that controls the entire system (not shown) or by manually setting each video display device 100 manually. is there. The band of the transmission direction of the inter-display apparatus transmission path 101 can be leveled by the operation of the transmission data output destination switching mechanism by the selection unit 1103.

  Further, the operation of the other switching mechanism is set so that the path to the data transmission destination becomes small for the video display device 100 at a position other than the position (2.2) shown in FIG. Configuration is conceivable. In that case, it can be realized by initializing each video display device 100 individually by software or the like that controls the entire system (not shown) or by manually setting each video display device 100 manually. is there. By such an operation of the switching mechanism, a delay during transmission of the transmission line 101 between the display devices can be suppressed, and a system with a reduced display delay can be realized.

  The combining unit 208 uses the transmission data as “tiles required for peripheral pixel reference image processing in the own device” for each of the own device determination unit 207a and the own device determination unit 207b for the divided video from the video input I / F 200. Combine the acquired tiles.

  Here, the inter-display device transmission path 101 will be supplemented below. A part of the following description corresponds to the first embodiment. When the inter-display device transmission path 101 is constructed with a unidirectional transmission path, the data transmission interface is single for both input and output, so the number of terminals of the video display apparatus 100 can be reduced. On the other hand, when the inter-display device transmission path 101 is constructed with a full-duplex transmission path, each data transmission interface must have both input and output. In comparison, the corresponding terminals of the video display device 100 increase.

  However, when the inter-display device transmission path 101 is constructed with a unidirectional transmission path, the transmission through the ring-shaped transmission path is always unidirectional, so the transmission delay cannot be reduced, and transmission is performed. The band of the road becomes large. On the other hand, when the inter-display device transmission path 101 is constructed with a full-duplex transmission path, the transmission via the ring-shaped transmission path can be used in both directions. It is possible to level the bandwidth of the transmission path.

  By configuring a multi-display system using a plurality of the video display devices 100 described above, it is possible to configure a system with simple connection even if video exchange between the video display devices 100 is necessary. This eliminates the need for complicated installation condition settings and provides a user merit of realizing a multi-display system with simple settings. Furthermore, since the number of times of video transmission / reception is reduced, it is possible to configure a multi-display system that is advantageous in terms of display delay and power consumption of the system.

  Specifically, by configuring a transmission path for data exchange between display devices constituting a multi-display system in a ring shape, a dedicated switch device is not required and a system can be constructed by a simple method. . In addition, since each display device adopts a configuration that selects necessary images by itself, each display device transmits data without explicitly specifying the display device adjacent to the display area. Setting can be simplified. Furthermore, since data can be transmitted to a plurality of display devices in one data transmission, it is possible to construct a multi-display system with reduced display delay and power consumption.

<Modification>
Various modifications / changes are possible for the first embodiment and the second embodiment. For example, in the above multi-display system, a video display control controller LSI that realizes control of the display device may be employed instead of the video display device 100. In this case, it is necessary to change the inter-display device I / F to the inter-controller I / F in the above description and drawings. In constructing a high-resolution video display system using a plurality of video display control controller LSIs, each video display control controller LSI has the configuration shown in FIGS. 2 and 11, thereby simplifying the connection configuration between the LSIs. It becomes possible. In this case, the video display controller LSI does not need to have the display panel 211, and there are various modified examples of what processing is performed using data necessary for the device itself. Such a high-resolution video display system can simplify board mounting, reduce the number of components, and reduce power consumption.

  In the above description, the specific numerical values given in the above description such as the number of video display devices 100, the number of divided video images, the number of video display devices 100 in the horizontal direction, and the number in the vertical direction are used for the description. These numerical values can be changed as appropriate.

(Other examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in the computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

200: Video input I / F 201: Arrangement information holding unit 202: Determining unit for other device 203: Transmission data generating unit 204: I / F between display devices 205: Own device issuance determining unit 206: I / F between display devices 207 : Determination unit for own device 208: Coupling unit 209: Image processing unit 210: Video output unit 211: Display panel

Claims (10)

A multi-display system having a plurality of display devices connected in a ring shape via a transmission line,
A first display device in the plurality of display devices,
From the first video displayed on the first display device, a plurality of partial videos required for image processing on the second video displayed on the second display device adjacent to the first display device are displayed. Sending means for specifying the relative position of the first display device in the display device, and sending the specified partial video to the transmission path;
Transfer means for transferring the partial video received via the transmission path to the transmission path;
Based on the first video and a part of the partial video received via the transmission path, according to the positional relationship between the first display device and the second display device. A display control means for performing image processing on one video and displaying the first video subjected to the image processing.   If the issuer of the partial video received via the transmission path is not the first display device, the transfer means transfers the partial video to the transmission path and receives the partial video received via the transmission path. The multi-display system according to claim 1, wherein the partial video is discarded if the issuer is the first display device.   In the first video, the display control means combines the part of the video on the side corresponding to the positional relationship between the first display device and the second display device, and then the first video. The multi-display system according to claim 1, wherein image processing is performed on the video. The multi-display system further includes
4. The apparatus according to claim 1, further comprising a device that divides the input video into a plurality of divided videos and transmits the divided videos to the corresponding display devices in the plurality of display devices. 5. Multi-display system.   The multi-display system according to claim 1, wherein the image processing is image processing using peripheral pixels.   The multi-display system according to claim 1, wherein the transmission path performs transmission in one direction.   The multi-display system according to claim 1, wherein the transmission path performs bidirectional transmission. A video display system having a plurality of video display control controllers connected in a ring shape via a transmission line,
A first video display controller in the plurality of video display controllers;
Partial video necessary for image processing on the second video corresponding to the second video display control controller adjacent to the first video display control controller from the first video corresponding to the first video display control controller Is specified based on the relative position of the first video display controller in the plurality of video display controllers, and sending means for sending the specified partial video to the transmission path;
Transfer means for transferring the partial video received via the transmission path to the transmission path;
Of the partial video received via the transmission path, a portion of the video corresponding to the positional relationship between the first video display control controller and the second video display control controller, and the first video, Means for performing image processing on the first video based on the video display system. A display device,
From the first video displayed on the display device, a partial video necessary for image processing on the second video displayed on another display device adjacent to the display device is displayed as the display device and the other display device. Sending means for sending the specified partial video to a transmission path, based on the relative position of the display device in a plurality of display devices including,
Transfer means for transferring the partial video received via the transmission path to the transmission path;
Of the partial video received via the transmission path, a part of the video corresponding to the positional relationship between the display device and the other display device, and the first video based on the first video Display control means for performing image processing and displaying the first video subjected to the image processing;
The plurality of display devices are connected in a ring shape through a transmission line. A video display controller,
From the first video corresponding to the video display control controller, a partial video necessary for image processing for the second video corresponding to another video display control controller adjacent to the video display control controller is obtained. And a sending means for sending the specified partial video to the transmission path, based on the relative position of the video display control controller in a plurality of video display control controllers including the video display control controller and the other video display control controller;
Transfer means for transferring the partial video received via the transmission path to the transmission path;
Of the partial video received via the transmission path, a part of the video according to the positional relationship between the video display control controller and the other video display control controller, and the first video, the first video Means for performing image processing on one video,
The plurality of video display control controllers are connected in a ring shape via a transmission line.