JP6381310B2 - Image display apparatus, image display apparatus control method, and program - Google Patents

Description

  The present invention relates to an image display device, an image display device control method, and a program.

  Conventionally, there has been proposed an image display system that displays a single image in a combined display area obtained by combining a plurality of display areas arranged in a tile shape (Patent Document 1). In this image display device, a plurality of image display devices respectively corresponding to a plurality of display areas are used. Image data representing an image to be displayed in a display area (self-display area) corresponding to the image display apparatus is stream-transmitted from the image output apparatus to the image display apparatus. Then, the image display device displays an image in its own display area. Such an image display system is also called a “multi-display system”.

  In a standardization organization VESA (Video Electronics Standards Association) relating to image display devices, a tiled display is proposed as a standard for the above-described multi-display system. In addition, VESA has proposed Display ID v1.3 (Display Identification Data Standard Version 1.3) as a data standard that facilitates the construction of a tiled display.

In the tiled display, image data is output from the image output device (source device) to the image display device (sink device).
Display ID v1.3 is a standard for data output from a sink device to a source device. The data of Display ID v1.3 has Tiled Display Topology Data Block. The tiled display topology data block can store tile information representing the connection configuration of the sink device, the position of the screen of the sink device, and the like. By using the tile information, the source device can easily grasp information necessary for the tiled display (the connection configuration of the sink device, the position of the display area of the sink device, etc.). The source device can easily generate and output image data representing an image to be displayed in the display area of each sink device for each of the plurality of sink devices.
In the tiled display, a plurality of screens may be arranged in a tile shape, and the screen area may be used as a display area. In such a case, there may be a frame member surrounding the display area of the sink device (the area of the screen of the sink device). And as tile information, the information which further represents the size of a frame member (bezel) can also be used. If such tile information is used, the source device can easily grasp the size of the frame member. The source device can easily adjust the image data to be output to the sink device so that the image is not extended by the frame member between the display areas.

In the tiled display, image data representing an image to be displayed in the display area is subjected to image processing without considering an image to be displayed in another display area. For this reason, when an image based on the image data after image processing is displayed in each display area, image quality deterioration occurs in which the luminance and color of the displayed image are discontinuous between the display areas.
A technique for suppressing such image quality degradation is disclosed in Patent Document 2, for example. In the technique disclosed in Patent Literature 2, when image processing is performed on a divided image obtained by dividing an original image into regions, paste margin image data is acquired, and image processing is executed using the paste margin image data. The margin image data is image data representing the margin image. The margin image is an image to be displayed in the margin area that is an area adjacent to the divided image in the original image. The margin image data can also be referred to as “reference data”.
The technique disclosed in Patent Document 2 is assumed to be used in, for example, an image display device that needs to accurately display image boundaries. Specifically, the above technique disclosed in Patent Document 2 is assumed to be used in graphic production, printed publication production, and product prototyping.

An example of the display target image and the paste margin image will be described with reference to FIG. The display target image is an image to be displayed in the display area.
In the example of FIG. 20, two display target images 1901 and 1902 are obtained by dividing the original image 1900 with broken lines. Specifically, two display target images 1901 and 1902 are obtained by dividing the original image 1900 into left and right regions. The display target image 1902 is adjacent to the right side of the display target image 1901 in the original image 1900.

When the technique disclosed in Patent Document 2 is used, the display target image 1901 and the margin image 1903 are input to the image display apparatus A that displays the display target image 1901. Specifically, the image display device A receives an image in which the paste margin image 1903 is added to the right side of the display target image 1901. The margin image 1903 is an image for a predetermined number of pixels from the left end to the right side of the display target image 1902 that has not been input to the image display apparatus A. In the image display apparatus A, the margin image 1903 is used when image processing is performed on the display target image 1901. Specifically, the paste margin image 1903 is used when image processing is performed on the right end portion of the display target image 1901.
Similarly, the image display apparatus B that displays the display target image 1902 is input with an image in which the margin image 1904 is added to the left side of the display target image 1902. The margin image 1904 is an image of a predetermined number of pixels from the right end to the left side of the display target image 1901 that has not been input to the image display device B. In the image display apparatus B, the paste margin image 1904 is used when image processing is performed on the left end portion of the display target image 1902.

  As a result, an appropriate image processing result can be obtained as the image processing result at the right end of the display target image 1901 and the image processing result at the left end of the display target image 1902, and image quality degradation caused by the image processing can be reduced. be able to. Specifically, it is possible to reduce image quality degradation at the boundary between the two display target images 1901 and 1902.

However, the reference data (glue image data) may not be output from the image output apparatus, or reference data different from the reference data assumed in the image display apparatus may be output from the image output apparatus. Such a malfunction occurs due to, for example, the setting of the image output apparatus, the capability of the image output apparatus, and the like. Such a malfunction may also occur due to noise generated in a signal used by the image output apparatus.
If the image processing using the reference data is executed even though the reference data is not acquired, an inappropriate image processing result is obtained. Similarly, if image processing is executed using reference data different from the assumed reference data, an inappropriate image processing result is obtained. As a result, the image quality deterioration cannot be reduced, or the image quality deterioration increases.

JP 2012-058475 A JP 2013-131042 A

An object of the present invention is to provide a technique that allows an image display device to acquire appropriate reference data more reliably in a multi-display system, and thus to obtain an appropriate image processing result more reliably.

The first aspect of the present invention is:
An image display device that displays an image in a self-display area that is one of a plurality of display areas,
First acquisition means for acquiring display target image data representing an image to be displayed in the self-display area;
A request to request the image output apparatus for first reference data representing an image characteristic to be displayed in the reference area, which is an area referred to when executing image processing and is an area outside the self-display area. Means,
Second acquisition means for acquiring second reference data output from the image output device in response to a request by the request means;
Image processing means for performing the image processing on the display target image data using the second reference data;
Comparison means for comparing the data size of the second reference data with the data size assumed in the image display device as the data size of the first reference data;
Have
The request means re-requests the first reference data from the image output device when the data size of the second reference data is smaller than the assumed data size as a result of the comparison by the comparison means. An image display device characterized by the above.

The second aspect of the present invention is:
A control method for an image display device that displays an image in a self-display area that is one of a plurality of display areas,
A first acquisition step of acquiring display target image data representing an image to be displayed in the self-display area;
A request to request the image output apparatus for first reference data representing an image characteristic to be displayed in the reference area, which is an area referred to when executing image processing and is an area outside the self-display area. Steps,
A second acquisition step of acquiring second reference data output from the image output device in response to the request made in the request step;
An image processing step of performing the image processing on the display target image data using the second reference data;
The data size of the second reference data, the as data size of the first reference data
A comparison step for comparing the data size assumed by the image display device ;
Have
In the requesting step, when the data size of the second reference data is smaller than the assumed data size as a result of the comparison in the comparing step, the first reference data is re-requested from the image output device. This is a control method of an image display device characterized by the above.

A third aspect of the present invention is a program for causing a computer to execute each step of the above-described image display device control method.

  According to the present invention, in a multi-display system, an image display device can acquire appropriate reference data more reliably, and accordingly, an appropriate image processing result can be acquired more reliably.

1 is a diagram illustrating an example of a configuration of an image display system according to a first embodiment. The figure which shows an example of the some display area which concerns on Example 1. FIG. FIG. 1 is a block diagram illustrating an example of a functional configuration of an image display device according to a first embodiment. The figure which shows an example of the image processing which concerns on Example 1, and the size of a margin area FIG. 6 is a diagram illustrating an example of original image data according to the first embodiment. The figure which shows an example of the input data which concern on Example 1. The figure which shows an example of the tile information which concerns on Example 1, and initial glue margin information 7 is a flowchart illustrating an example of a process flow of the image display apparatus according to the first embodiment. FIG. 10 is a diagram illustrating an example of image processing setting information according to the first embodiment. 10 is a flowchart illustrating an example of a flow of error recovery processing according to the first embodiment. FIG. 10 is a diagram illustrating an example of image processing setting information according to the first embodiment. FIG. 10 is a diagram illustrating an example of image processing setting information according to the first embodiment. FIG. 10 is a diagram illustrating an example of a display image during error recovery processing according to the first embodiment. FIG. 10 is a diagram illustrating an example of image processing setting information according to the first embodiment. FIG. 10 is a diagram illustrating an example of a display image after error recovery processing according to the first embodiment. FIG. 7 is a block diagram illustrating an example of a functional configuration of an image display apparatus according to a second embodiment. 10 is a flowchart illustrating an example of a processing flow of the image display apparatus according to the second embodiment. 10 is a flowchart illustrating an example of a flow of error recovery processing according to the second embodiment. FIG. 10 is a diagram illustrating an example of an operation mode and image processing setting information according to the second embodiment. The figure which shows an example of an original image, a display object image, and a paste margin image

<Example 1>
Hereinafter, an image display apparatus and a control method thereof according to Embodiment 1 of the present invention will be described with reference to the drawings.

FIG. 1 is a diagram illustrating an example of a configuration of an image display system (multi-display system) according to the present embodiment. Specifically, FIG. 1 is a diagram illustrating a configuration of a tiled display proposed by a standardization organization VESA (Video Electronics Standards Association) related to an image display device.
As shown in FIG. 1, the tiled display has a source device and a plurality of sink devices. The source device is an image output device that outputs data (image data, additional data related to image data, etc.) to the sink device, and the sink device is an image display device that displays an image in a display area (self-display area). . For example, a personal computer (PC) can be used as the source device. As the sink device, for example, a liquid crystal display device, an organic EL display device, a plasma display device, or the like can be used.
The tiled display has a star type configuration in which a source device and a sink device are connected to each other by a single stream.
For connection between the Source device and the Sink device, a cable of the Display Port standard is used.

In the example of FIG. 1, four sink devices (image display apparatuses A to D) are used, but the number of sink devices may be more or less than four.
Note that the cable used for connection between the source device and the sink device is not limited to the cable of the Display Port standard. Any standard cable may be used as long as it can transmit image data and additional data related to the image data. Further, the source device may be connected to the sink device wirelessly.
Note that the multi-display system according to the present embodiment is not limited to the tiled display.

FIG. 2 is a diagram illustrating an example of a plurality of display areas according to the present embodiment. Specifically, FIG. 2 is a diagram illustrating an example of a plurality of display areas used in the image display system of FIG.
As shown in FIG. 2, in the image display system, a plurality of display areas are arranged in a tile shape. FIG. 2 shows four display areas of 2 rows and 2 columns. Specifically, the image display system has four screens of two rows and two columns (screens of four image display devices A to D), and the screen area is used as the display area. In FIG. 2, the size of the display area (screen) is 1920 pixels in the horizontal direction × 1080 pixels in the vertical direction, and the size of the combined screen combining the four screens is 3840 pixels in the horizontal direction × 2160 pixels in the vertical direction. .
The image display device displays an image in a self-display area that is one of a plurality of display areas. In the example of FIG. 2, the display area in the first row and the first column is the self-display area of the image display apparatus A, the display area in the first row and the second column is the self-display area of the image display apparatus B, The display area of the eyes is the self-display area of the image display apparatus C, and the display area of the second row and the second column is the self-display area of the image display apparatus D.

A frame member (bezel) surrounding the display area may be present.
In this embodiment, an example in which a plurality of screens are arranged in a tile shape and a screen area is used as a display area will be described. However, the present invention is not limited to this. For example, the image display system may have one screen, and a plurality of display areas may constitute the screen area.
The number of display areas may be more or less than four.
The arrangement of the plurality of display areas is not limited to the above arrangement. For example, a plurality of display areas may be arranged in one direction.

  Hereinafter, the configuration and processing of the image display apparatus A included in the above-described image display system will be described. Since the configuration and processing of the image display apparatuses B to D are the same as those of the image display apparatus A, description thereof is omitted.

Conventionally, in an image display system such as a tiled display, image characteristics of areas other than the self-display area are not considered when image processing is performed on display target image data representing an image to be displayed in the self-display area. . For this reason, when an image based on image data after image processing is displayed in each display area, image quality deterioration has occurred in which the luminance and color of the displayed image are discontinuous between the display areas.
Therefore, in this embodiment, the image display apparatus A requests not only display target image data but also first reference data from the image output apparatus. Then, the image display apparatus A performs image processing using the first reference data on the display target image data. The first reference data is data representing the characteristics of the image to be displayed in the reference area. The reference area is an area that is referred to when image processing is executed, and is an area outside the self-display area. In the present embodiment, an example in which the reference area is a margin area will be described. The margin area is a partial area of the display area adjacent to the own display area, and is an area adjacent to the own display area. Note that the reference area is not limited to the margin area. For example, the reference area may be the entire display area adjacent to the self display area, or may be an area away from the self display area.

FIG. 3 is a block diagram illustrating an example of a functional configuration of the image display device 301 (image display device A).
As shown in FIG. 3, the image display device 301 includes a data input unit 302, an initial margin information storage unit 303, a tile information storage unit 304, a format notification unit 305, a margin comparison unit 306, an image processing setting unit 307, an error A processing unit 308, a changed margin information storage unit 309, an error notification unit 310, an image processing unit 311, an adhesive margin removal unit 312, a display unit 313, a control unit 314, and the like are included.

The data input unit 302 acquires data (input data) output from the image output device,
The acquired input data is output to the glue margin comparison unit 306. The input data is data including display target image data and second reference data output in response to a request for the first reference data. Since the first reference data is data representing the characteristics of an image to be displayed in the margin area assumed by the image display device 301, it can also be referred to as “assumed margin margin data”. Since the second reference data is data acquired from the image output device as the first margin data, it can also be referred to as “acquired margin data”. Here, “image characteristics” are the image itself, the brightness of the image, the color of the image, and the like. The brightness of the image is a histogram, an average value, a maximum value, a minimum value, an intermediate value, a mode value, etc. of the brightness value. The brightness of the image may be the brightness value of each pixel. The color of the image is a histogram, average value, maximum value, minimum value, intermediate value, mode value, etc. of chromaticity. The color of the image may be the chromaticity of each pixel.
Note that the process of acquiring display target image data (first acquisition process) and the process of acquiring second reference data (second acquisition process) may be executed by different functional units.

The initial margin information storage unit 303 stores initial information (initial value) of margin information, which is information related to the reference area (glue area), as initial margin information. In this embodiment, the initial margin information is one of the elements of Display ID, Tiled Display Topology.
This is information “Tile Paste Information” newly added to the Data Block. The margin information includes, for example, information on the position of the margin area, information on the size of the margin area, and the like. The position of the margin area is automatically determined based on the tile information stored in the tile information storage unit 304. In other words, which side (upper side / lower side / left side / right side) of the self-display region should be set automatically is determined based on the tile information.
Note that the initial value of the size of the margin area may be a fixed value determined in advance by a manufacturer or the like, or a value that can be changed by the user.
Note that the margin information may further include information on the type of features used in image processing (features of the image to be displayed in the margin area). The types of features are, for example, luminance values, chromaticity values, pixel values, and the like.

  The tile information storage unit 304 stores tile information. The tile information includes unit information and system information. The single information is information related to the image display apparatus 301 (self apparatus), and the system information is information related to the entire image display system. The single information includes information on the size of the self-display area, information on the size (width) of the bezel surrounding the self-display area, and the like. The system information includes information on the arrangement of a plurality of display areas. In the present embodiment, the tile information is included in a tiled display topology data block that is one of the elements of the display ID.

The format notification unit 305 notifies (outputs) the initial margin information and tile information to the image output apparatus. In this embodiment, the display ID is notified to the image output apparatus via the cable of the Display Port standard. Thereby, the initial margin information and tile information are notified to the image output apparatus. When the initial margin information and tile information are notified, the image output device generates input data based on the initial margin information and tile information, and outputs the input data to the image display device 301. Therefore, the process for notifying the image output apparatus of the initial margin information and tile information can also be referred to as “a process for requesting the image output apparatus for display target image data and assumed margin data”.
Note that the processing for requesting display target image data and the processing for requesting assumed margin data may be executed by different functional units.

The margin margin comparison unit 306 determines whether or not the acquired margin margin data included in the input data output from the data input unit 302 is assumed margin margin data. Specifically, the margin margin comparison unit 306 compares the data size of the acquired margin margin data with the data size of the assumed margin margin data. The data size of the assumed margin data is automatically determined based on the size of the margin area, for example. Then, when the data size of the obtained margin data matches the data size of the assumed margin data, the margin comparison unit 306 determines that the obtained margin data is the assumed margin data. In addition, when the data size of the acquired margin data is different from the data size of the assumed margin data, the margin comparison unit 306 determines that the acquired margin data is not the expected margin data. Subsequently, the margin comparison unit 306 outputs a determination result as to whether or not the acquired margin margin data is assumed margin margin data to the image processing setting unit 307. Further, the margin comparison unit 306 outputs the input data to the image processing unit 311.
The method for determining the data size of the assumed margin data is not limited to the above method. For example, the data size of the assumed margin data may be determined in consideration of the size of the margin area and the type of image feature to be displayed in the margin area.

  In this embodiment, when it is determined that the obtained margin data is not assumed margin data, the expected margin data is re-requested from the image output apparatus. In this embodiment, when it is determined that the obtained margin data is not assumed margin data, the size of the margin area may be changed.

The image processing setting unit 307 sets image processing setting information in the image processing unit 311. The image processing setting information includes, for example, information on whether or not to execute image processing, information on image processing operation, and the like.
The image processing setting unit 307 may update (change) the image processing setting information in accordance with the determination result of the adhesive margin comparison unit 306 when it is determined that the acquired margin data is not assumed margin data. . Thereby, although details will be described later, the size of the margin area is changed by changing the image processing setting information.

The error processing unit 308 generates changed margin information when it is determined that the obtained margin data is not assumed margin data. The changed margin information is margin information used when re-requesting the assumed margin data, and is generated based on the image processing setting information. Then, the error processing unit 308 outputs the changed margin information to the changed margin information storage unit 309 and the error notification unit 310.
In addition, the error processing unit 308 counts the number of times that the same expected margin data is re-requested. Specifically, the error processing unit 308 counts the number of times the same margin information as the previous time is re-notified to the image output apparatus.
Note that the process of generating the change margin information and the process of counting the number of re-requests (re-notifications) may be executed by different functional units.

  The changed margin information storage unit 309 stores the changed margin information output from the error processing unit 308.

The error notification unit 310 notifies the image output device of the changed margin information output from the error processing unit 308 (re-notification of margin information). In this embodiment, the change margin information is notified to the image output device using the Auxiliary channel (AUX) of the cable of the Display Port standard. When the change margin information is notified, the image output device generates input data based on the change margin information and tile information, and outputs the input data to the image display device 301. For this reason, the process of notifying the image output apparatus of the changed margin information can also be referred to as “a process for requesting the image output apparatus for display target image data and assumed margin data”.
When the image display device 301 stores the display target image data output from the image output device in response to the notification of the display ID (initial glue margin information), the image output device displays the changed margin margin information. The display target image data may not be output in response to the notification. For example, when the changed margin information is notified, the image output apparatus may generate acquired margin data based on the changed margin information and tile information, and output the acquired margin data.
The process for notifying the initial margin information and the process for notifying the changed margin information may be executed by the same function unit.

The image processing unit 311 generates processing data by performing image processing on the input data output from the glue margin comparison unit 306. Specifically, the image processing unit 311 performs image processing on the display target image data included in the input data, using the acquired margin data included in the input data. Thereby, processing data is generated. The processing data is data including display target image data after image processing and acquired paste margin data.
Then, the image processing unit 311 outputs the processing data (input data after the image processing) to the margin removal unit 312.
Note that image processing may be performed only on the display target image data, or image processing may be performed on both the display target image data and the acquired margin data.

The margin removal unit 312 obtains processed image data that is display target image data after image processing by removing the obtained margin data from the processing data output from the image processing unit 311. Then, the margin removal unit 312 outputs the processed image data to the display unit 313.
Note that when the display target image data and the acquired margin data are acquired separately, the processed image data is generated as the processing data, so the margin removal unit 312 is not necessary.

The display unit 313 displays an image based on the processed image data output from the margin removal unit 312 in its own display area. As the display unit 313, for example, a liquid crystal display panel, an organic EL display panel, a plasma display panel, or the like can be used.
The control unit 314 performs overall control of the image display device 301. That is, the control unit 314 controls each functional unit described above.
The bus line 320 is a bus line used for data transmission / reception between the functional units described above.

FIG. 4 is a diagram illustrating an example of image processing executed by the image processing unit 311 and the size of the margin area.
In the present embodiment, the image processing unit 311 performs a plurality of image processes on the display target data using the acquired margin data.
In the example of FIG. 4, the image processing unit 311 can execute seven image processes A to G.
Image processing A to F is, for example, color conversion processing, luminance conversion processing, interpolation pixel generation processing, edge enhancement processing, blurring processing, and the like.
Image processing G is image processing (mute processing) for obtaining image data representing a black image as corrected image data.
In the present embodiment, as the initial information of the image processing setting information, information in which the execution flag of the image processing A to F is “valid” and the execution flag of the image processing G is “invalid” is prepared. The execution flag is information indicating whether or not to execute image processing. “Valid” indicates that image processing is performed, and “invalid” indicates that image processing is not performed.

In the image processing A, it is assumed that the feature of the image to be displayed in the margin area corresponding to the size of 4 pixels in the adjacent direction is used. The adjacent direction is a direction in which the margin area is adjacent to the area of the image represented by the display target image data.
In the image processing B, it is assumed that the feature of the image to be displayed in the margin area corresponding to the size of 4 pixels in the adjacent direction is used.
In the image processing C, it is assumed that the feature of the image to be displayed in the margin area corresponding to the size of 3 pixels in the adjacent direction is used.
In the image processing D, it is assumed that the feature of the image to be displayed in the margin area of 95 pixels in the adjacent direction is used.
In the image processing E, it is assumed that the feature of the image to be displayed in the margin area corresponding to the size of 5 pixels in the adjacent direction is used.
In the image processing F, it is assumed that the feature of the image to be displayed in the margin area corresponding to the size of 4 pixels in the adjacent direction is used.
In the image processing G, the feature of the image to be displayed in the margin area is not used.

  In the present embodiment, the image processing unit 311 executes image generation processing for generating various image data, composition processing for combining various image data and display target image data (or processed image data), and the like. You can also. For example, the image processing unit 311 can generate information image data representing an information image. Then, the image processing unit 311 can generate composite image data representing a composite image in which the information image is superimposed on the image represented by the display target image data by combining the information image data and the display target image data. The information image is, for example, an image representing information on the operation state (display state) of the image display device 301.

In the image processing A to F, the same type of features may be used, or different types of features may be used.
Note that the number of image processes that can be executed by the image processing unit 311 may be more or less than seven. The image processing that can be executed by the image processing unit 311 may be one image processing (for example, one of the image processing A to F).
The initial information of the image processing setting information is not limited to the above information. For example, the initial information of the image processing setting information may be information in which all image processing execution flags are “invalid”.

FIG. 5 is a diagram illustrating an example of original image data representing an original image.
In the example of FIG. 5, the size of the original image is 3840 pixels in the horizontal direction × 2160 pixels in the vertical direction, which is equal to the size of the composite screen of the image display system shown in FIG.
The image output device generates display target image data from the original image data based on the tile information. In this embodiment, as shown in FIG. 2, the image display system has four display areas of 2 rows and 2 columns. Therefore, the image output apparatus divides the original image data into four image data so that the area of the original image is divided into four image areas of 2 rows and 2 columns. The size of each of the four image data is 1920 pixels in the horizontal direction × 1080 pixels in the vertical direction. The display area of the image display apparatus 301 (image display apparatus A) is the display area in the first row and the first column. Therefore, the image output device selects image data corresponding to the image region in the first row and first column as the display target image data of the image display device 301 among the four image data.

  When the image output apparatus operates as expected by the image display apparatus 301, the image output apparatus displays each of the image processes A to F in the margin area based on the initial margin information and tile information. Acquire margin data representing the characteristics of the power image is generated. In this embodiment, acquired margin data having feature values in pixel units is generated, and image processing is executed using the feature values in pixel units. The feature value is a luminance value, a chromaticity value, a pixel value, or the like.

Therefore, when the execution flags of the image processes A to F are “valid” and the size of the margin area of the image processes A to F is the value shown in FIG. 4, the size in the adjacent direction is 115 pixels. Is generated as acquired margin data of the image display device 301.
Specifically, as shown in FIG. 6, data including first data, second data, and dummy data is generated as acquired margin data of the image display device 301.
The first data is data representing the characteristics of the image to be displayed in the margin area adjacent to the lower side of the display target image data of horizontal 1920 pixels × vertical 1080 pixels, and is horizontal 1920 pixels × vertical 115 pixels. Minute data.
The second data is data representing the characteristics of the image to be displayed in the margin area adjacent to the right side of the display target image data, and is data for 115 pixels in the horizontal direction × 1080 pixels in the vertical direction.
The dummy data is data prepared so that an area composed of all pixels of the input data becomes a rectangular area, and is data for 115 pixels in the horizontal direction × 115 pixels in the vertical direction.

  Thereafter, the image output apparatus generates input data by adding the acquired margin data to the display target image data. When the image output device operates as expected by the image display device 301, as shown in FIG. 6, input data for horizontal 2035 pixels × vertical 1195 pixels is generated.

  Similarly to the image display device A, input data is generated for the image display devices B to D as well.

Note that a margin area adjacent to the display target image data in an oblique direction may be set. In this case, a part of the dummy data represents the characteristics of the image to be displayed in the margin area adjacent to the display target image data in an oblique direction (lower right direction in the example of FIG. 6).
In this embodiment, an example in which the size of the original image is equal to the size of the composite screen of the image display system will be described. However, the size of the original image may be different from the size of the composite screen of the image display system. In that case, a scaling process for changing the size of the image may be executed as appropriate.
In the present embodiment, an example has been described in which the acquired margin data has feature values in units of pixels, and the feature values in units of pixels are used in image processing. However, the present invention is not limited to this. For example, in image processing, feature values in units of pixel groups including a plurality of pixels (an average value, a mode value, a maximum value, a minimum value, an intermediate value, etc. of feature values of a plurality of pixels) may be used. The acquired margin data may have a feature value for each pixel group. The acquired image data has a feature value for each pixel as a feature value for image processing using a feature value for each pixel, and a feature value for each pixel group as a feature value for image processing that uses the feature value for each pixel group. You may have.
In this embodiment, an example in which the acquired margin data is data that individually represents features used in a plurality of image processes has been described. However, the present invention is not limited to this. For example, when the same type of feature is used in a plurality of image processes, acquired margin data representing the feature used in the image processing having the largest margin area size may be generated. Features used in image processing other than image processing with the largest margin area size can be acquired from features used in image processing with the largest margin area size.

FIG. 7 is a diagram illustrating an example of a tiled display topology data block of the image display device 301.
As shown in FIG. 7, the tiled display topology data block 701 includes tile information 702 and initial margin information 703.

The tile information 702 includes tiled display capability, tile.
Includes Topology, Tile Location, and Tile Size, Tile Bezel Information.

The tiled display capability includes connection type information of the tiled display and bezel presence / absence information.
The connection type information is information indicating whether the connection type of the tiled display is “non-independent type” or “independent type”. The “non-independent type” Tiled Display is an image display system having a single screen and a plurality of display areas arranged in a tile shape. The “stand-alone” tiled display is an image display system in which a plurality of screens are arranged in a tile shape. In the present embodiment, as shown in FIG. 1, an “independent type” tiled display in which a plurality of image display devices are physically separated from each other is used. Therefore, in FIG. 7, “independent type” is set as the connection type information.
The bezel presence / absence information is information indicating whether or not there is a bezel surrounding the display area. In this embodiment, as shown in FIG. 2, there is no bezel. Therefore, in FIG. 7, “no bezel” is set as the bezel presence / absence information.

  Tile Topology is information that represents the arrangement of a plurality of display areas that the Tile Display has. In the present embodiment, as shown in FIG. 2, the tiled display has four display areas of 2 rows and 2 columns. Therefore, in FIG. 7, (the number of display areas in the horizontal direction, the number of display areas in the vertical direction) = (2, 2) is set as Tile Topology.

  Tile Location is information representing the relative position of the display area of the image display device 301. The image display apparatus 301 is the image display apparatus A, and the display area of the image display apparatus 301 is the display area in the first row and the first column. For this reason, in FIG. 7, (relative position in the horizontal direction, relative position in the vertical direction) = (0, 0) is set as the Tile Location. For the leftmost display area, 0 is set as the value of the relative position in the horizontal direction. As the relative position of the display area advances to the right, the value of the relative position in the horizontal direction increases by one. For the upper display area, 0 is set as the value of the relative position in the vertical direction. Then, as the relative position of the display area advances downward, the value of the relative position in the vertical direction increases by one.

  Tile Size is information indicating the size of the self-display area. In the present embodiment, as shown in FIG. 2, the size of the self-display area is 1920 pixels in the horizontal direction × 1080 pixels in the vertical direction. Therefore, in FIG. 7, 1920 pixels × vertical 1080 pixels are set as Tile Size.

  Tile Bezel Information is information indicating the width of the bezel of the image display device 301. In this embodiment, as shown in FIG. 2, there is no bezel. Therefore, in FIG. 7, (Tile Bezel Information) (horizontal bezel width, vertical bezel width) = (0, 0) is set.

The initial margin information 703 includes a Top margin size, a Bottom margin size, a Right margin size, and a Left margin size.
The Top margin size is information indicating the size (number of pixels in the vertical direction) of the feature data of the image to be displayed in the margin region adjacent to the upper side of the self-display region. In this embodiment, as shown in FIG. 2, there is no display area adjacent to the upper side of the self-display area. For this reason, in the example of FIG. 7, 0 is set as the Top margin size.
Bottom margin size is information indicating the size (number of pixels in the vertical direction) of feature data of an image to be displayed in the margin region adjacent to the lower side of the self-display region. In this embodiment, as shown in FIG. 2, there is a display area adjacent to the lower side of the self-display area. In the initial information of the image processing setting information, the execution flags for the image processing A to F are “valid”. Therefore, in the example of FIG. 7, 115 is set as the bottom paste size.
Right paste margin Size is information representing the size (number of pixels in the horizontal direction) of image feature data to be displayed in the paste margin region adjacent to the right side of the self-display region. In this embodiment, as shown in FIG. 2, there is a display area adjacent to the right side of the self-display area. In the initial information of the image processing setting information, the execution flags for the image processing A to F are “valid”. Therefore, in the example of FIG. 7, 115 is set as the Right paste allowance Size.
Left paste margin Size is information representing the size (number of pixels in the horizontal direction) of image feature data to be displayed in the paste margin area adjacent to the left side of the self-display area. In the present embodiment, as shown in FIG. 2, there is no display area adjacent to the left side of the self-display area. For this reason, in the example of FIG. 7, 0 is set as the Left paste size.

FIG. 8 is a flowchart illustrating an example of the processing flow of the image display apparatus 301.
An example in which the same acquired margin data as the assumed margin data is acquired will be described with reference to FIG.

  First, when the image display device 301 is connected to the image output device using a cable of the Display Port standard, the format notification unit 305 notifies the image output device of the display ID (S801). Through this process, a tiled display topology data block including tile information and initial margin information is notified to the image output apparatus.

  Next, the data input unit 302 determines whether or not the input data output from the image output device has been input to the image display device 301 (data input unit 302) (S802). When input data is input to the data input unit 302 (S802: Yes), the process proceeds to S803. If the input data is not input to the data input unit 302 (S802: No), the process returns to S802. Then, the data input unit 302 repeatedly executes the process of S802 until input data is input to the data input unit 302.

  In S803, the control unit 314 controls the adhesive margin comparison unit 306, and the adhesive margin comparison unit 306 determines whether or not the obtained margin data included in the input data acquired in S802 is assumed margin data. to decide. Specifically, the glue margin comparison unit 306 has a rectangular area (assumed area) in which the size of a rectangular area (acquisition area) composed of all pixels of the input data is added to the margin area for all image processing in the self-display area. It is determined whether or not it matches the size of. The size of the acquisition area is the total number of pixels represented by the Data Enable signal (DE signal) of the input data. The size of the assumed area is the total number of pixels in a rectangular area obtained by enlarging the self-display area represented by Tile Size by the size of the feature data represented by the margin information. When the Tile Size and the margin information are the information shown in FIG. 7, an area obtained by expanding the self-display area of horizontal 1920 pixels × vertical 1080 pixels to the right and lower by 115 pixels is used as an assumed area. .

When the size of the acquired area matches the size of the assumed area, the glue margin comparison unit 306 determines that the obtained glue margin data is the assumed margin data (S803: Yes). Then, the process proceeds to S804.
Further, when the size of the acquired area is different from the size of the assumed area, the glue margin comparison unit 306 determines that the obtained glue margin data is not the assumed margin data (S803: No). Then, the process proceeds to S805.
Here, since the same acquired margin data as the expected margin data is acquired, the process proceeds to S804.

It should be noted that the margin area indicated by the initial margin information is used in the processing of S803 before error recovery processing (processing for re-requesting assumed margin margin data) described later is performed. In the processing of S803 after the error recovery processing is performed, the margin area represented by the changed margin information is used.
In this embodiment, the example in which the data size of the obtained margin data and the data size of the assumed margin data is indirectly compared has been described. However, the present invention is not limited to this. For example, when the display target image data and the acquired margin data are acquired separately, the data size of the acquired margin data and the data size of the assumed margin data may be directly compared.

In step S <b> 804, the control unit 314 controls the image processing setting unit 307, and the image processing setting unit 307 sets image processing setting information for the image processing unit 311. Here, initial information of the image processing setting information is set.
FIG. 9 is a diagram illustrating an example of initial information of the image processing setting information.
In the example of FIG. 9, the image processing setting information includes an execution flag and a processing mode. The execution flag is information indicating whether or not to execute image processing. The processing mode is information on an image processing operation.
As shown in FIG. 9, in the initial information of the image processing setting information, the execution flags for the image processing A to F are “valid” and the execution flag for the image processing G is “invalid”.
In the initial information of the image processing setting information, the processing mode of the image processing A to F is “glue usage mode”. The “adhesive margin usage mode” is a processing mode in which the acquired margin margin data is used.
Therefore, when the initial information of the image processing setting information is set, the image processing A to F is executed using the acquired paste margin data.

  Next, the control unit 314 controls the image processing unit 311, and the image processing unit 311 performs image processing according to the image processing setting information set in S804 on the input data acquired in S802 (S806). ). Thereby, processing data is generated.

  Then, the control unit 314 controls the margin removal unit 312 and the margin removal unit 312 removes the acquired margin data from the processing data generated in S806 (S807). Accordingly, processed image data having a size of 1920 pixels in the horizontal direction × 1080 pixels in the vertical direction is generated.

  Next, the control unit 314 controls the display unit 313, and the display unit 313 displays the processed image data generated in S807 in its own display area (S808). Then, the process returns to S802.

  By executing the above processing, image processing using the same acquired margin data as the assumed margin data is executed, and an image based on the display target image data after the image processing can be displayed on the screen. Acquired margin data (characteristics of the image to be displayed in the margin area) is, for example, subjected to image processing on image data to be displayed at the end of the own display area (the end on the side adjacent to the other display area) Used when.

Next, an example in which acquired margin data different from the assumed margin data is acquired will be described with reference to FIGS.
FIG. 10 is a flowchart showing an example of the flow of error recovery processing in S805 of FIG.
In the following, an example will be described in which the Top adhesive margin Size represented by the initial adhesive margin information is 0, the Bottom adhesive margin Size is 115, the Right adhesive margin Size is 115, and the Left adhesive margin Size is 0. That is, the area composed of all the pixels of the input data that the image display device 301 expects first is an area of 1920 pixels × 1080 pixels in the horizontal direction, expanded by 115 pixels on the right side and the lower side, 2035 pixels × 1195 pixels. An example in the case of an area having a size of will be described. In the following, an example will be described in which the size of the area composed of all the pixels of the first acquired input data is 2031 pixels × 1191 pixels (<2035 pixels × 1195 pixels).
Such a situation occurs, for example, when the maximum image output size (maximum number of pixels of data that can be output) of the graphic card for image output included in the image output apparatus is smaller than the size of the assumed area.

First, the process of S801-S803 is performed.
The processing of S801 to S803 is as described above.
However, here, the size of the acquisition area is smaller than the size of the assumed area. That is, the data size of the acquired margin data is smaller than the data size of the assumed margin data. Therefore, the paste margin comparison unit 306 determines that the acquired paste margin data is not assumed paste margin data (S803: No). Then, the process proceeds to S805.

In step S805, the control unit 314 controls the error processing unit 308 and the image processing setting unit 307 to perform error recovery processing.
The error recovery process in S805 will be described in detail with reference to FIG.

First, the control unit 314 controls the image processing setting unit 307, and the image processing setting unit 307 sets image processing setting information in which the operation flag of the image processing G is rewritten to “valid” for the image processing unit 311. (S1001).
FIG. 11 shows an example of the image processing setting information set in S1001.
Despite the fact that the acquired margin data is different from the assumed margin data, if image processing using the acquired margin data is executed, image processing using the expected margin data cannot be performed and is inappropriate. An image processing result is obtained. As a result, an image with degraded image quality is displayed in the self-display area.
Therefore, in S1001, as shown in FIG. 11, the image processing setting information is set by rewriting the operation flag of the image processing G to “valid”. As a result, a black image can be displayed during a period in which re-request of the assumed margin data is performed, and display of an image with degraded image quality can be suppressed.

  In the period when error recovery processing (processing for re-requesting assumed margin data) is performed, a black image is used instead of an image based on image data after image processing using acquired margin data. Different predetermined images may be displayed. For example, a predetermined illustration or logo image may be displayed. Since the image quality degradation during the error recovery process is temporary, it is not necessary to display a predetermined image.

  Also, as shown in FIG. 12, there is image processing setting information obtained by rewriting the processing mode of the image processing A to F to “alternative glue use mode” without rewriting the operation flag of the image processing G to “valid”. It may be set. The “alternative margin usage mode” is a processing mode in which a feature (substitution feature) based on display target image data is used as a feature of an image to be displayed in the margin area. For example, in the “alternative margin use mode”, the feature of the mirror image obtained by inverting the edge of the image represented by the display target image data (end on the margin area) to the margin area is displayed in the margin area. Used as a feature of the image to be. When image processing setting information is set in which the processing mode of image processing A to F is rewritten to “alternative margin use mode”, image processing A to F using alternative features instead of acquired paste margin data is performed. Executed. As a result, it is possible to display an image in which deterioration in image quality due to the obtained margin data being different from the assumed margin data is reduced.

  Further, the image processing setting information may be set in which the processing mode of the image processing A to F is rewritten to the “glue free mode” without rewriting the operation flag of the image processing G to “valid”. The “paste margin non-use mode” is a processing mode in which the feature of the image to be displayed in the paste margin area is not used. When the image processing setting information is set in which the processing mode of the image processing A to F is rewritten to the “adhesive margin non-use mode”, the image processing A to F is executed without using the acquired margin margin data. As a result, it is possible to display an image in which deterioration in image quality due to the obtained margin data being different from the assumed margin data is reduced.

Next, the control unit 314 controls the error processing unit 308, and the error processing unit 308 determines whether or not the count value Cnt is greater than or equal to a threshold value (S1002). The count value Cnt is the number of times that the same expected margin data as before is re-requested. In this embodiment, an example in which the threshold value to be compared with the count value Cnt is 1 will be described. If the count value Cnt is greater than or equal to the threshold (S1002: Yes), the process proceeds to S1005. If the count value Cnt is less than the threshold (S1002: No), the process proceeds to S1003.
Here, since the count value Cnt is the initial value 0, the process proceeds to S1003.

The threshold value to be compared with the count value Cnt may be larger than 1. The threshold value may be a fixed value determined in advance by a manufacturer or the like, or may be a value that can be changed by the user.
Further, the threshold value to be compared with the count value Cnt may be zero. That is, in the error recovery process, the process may always proceed to S1005 after S1001. The process may always proceed to S1003 after S1001.

In step S1003, the control unit 314 controls the error processing unit 308, and the error processing unit 308 generates change margin information based on the currently set image processing setting information. Then, the control unit 314 controls the error notification unit 310, and the error notification unit 310 notifies the image output apparatus of the changed adhesive margin information.
Here, as shown in FIG. 11, the execution flags of the image processes A to F are “valid”, and the processing mode of the image processes A to F is “glue use mode”. Therefore, the same information as the initial margin information is generated as the changed margin information.

  In this embodiment, for some reason, acquired margin data different from the assumed margin data may be acquired, or acquired margin data may not be acquired. For example, when noise occurs in a signal used in the image output apparatus, acquired margin data different from the assumed margin data may be acquired or acquired margin data may not be acquired. In such a case, by performing the processing of S1003 (re-notification of paste margin information; re-request of assumed paste allowance data), it is sometimes possible to acquire the obtained paste allowance data as the assumed paste allowance data.

  Next, the control unit 314 controls the error processing unit 308, and the error processing unit 308 increments the count value Cnt by 1 (S1004).

Then, the control unit 314 controls the image processing unit 311 and the image processing unit 311 generates composite data (S1009). Specifically, the image processing unit 311 generates information image data representing an information image, and synthesizes the information image data with the input data acquired in S802. Thereby, composite data including the composite image data representing the composite image in which the information image is superimposed on the image represented by the display target image data and the acquired margin data is generated.
Here, information image data indicating that a re-request of assumed margin data has been performed is generated. For example, information image data representing an information image in which a comment such as “acquiring paste margin data is being acquired” is generated. When a re-request for assumed margin data is performed, the information image is displayed in the self-display area, so that the user can be notified that the re-request for assumed margin data has been performed.
The method for notifying the user is not limited to the above method. For example, notification to the user may be performed using light from a light emitting element provided separately from the self-display area, or notification to the user may be performed using sound from a speaker or the like.
Note that the user need not be notified.

Following S1009, the processes of S806 to S808 are performed.
The processing of S806 to S808 is as described above.
However, here, processing data is generated by performing image processing corresponding to the image processing setting information set in S1001 on the composite data generated in S1009 (S806). Further, the image processing G is not performed on the region where the information image is superimposed. Then, by removing the acquired margin data from the processing data, processed image data representing a composite image in which an information image is superimposed on an image representing a black image is generated (S807). Thereafter, as shown in FIG. 13, a composite image in which an information image is superimposed on an image representing a black image is displayed in the self-display area (S808).

Then, the process returns to S802, and the processes of S802 and S803 are performed.
The processes in S802 and S803 are as described above.
However, again, the size of the acquisition area is smaller than the size of the assumed area, and S805 (S1
Suppose that the process has proceeded to (001).

Then, the processes of S1001 and S1002 are performed.
The processing of S1001 and S1002 is as described above.
However, since the count value Cnt is 1 (= threshold value) here, the process proceeds to S1005.

In step S1005, the control unit 314 controls the image processing setting unit 307, and the image processing setting unit 307 changes (updates) the image processing setting information. As a result, the size of the margin area is changed. Specifically, the size of at least one of the plurality of margin areas corresponding to the plurality of image processes is changed. Then, the image processing setting unit 307 sets the updated image processing setting information in the image processing unit 311.
Here, since the data size of the acquired margin data is smaller than the data size of the assumed margin data, the size of the margin area is reduced. As a result, the data size of the assumed margin data is reduced. Specifically, the size of at least one of the plurality of margin areas corresponding to the plurality of image processes is reduced to zero. In the present embodiment, the processing modes of the image processing A to F are sequentially changed to the “alternative margin use mode”. By changing the processing mode to “alternative margin use mode”, the size of the margin area is changed to zero. FIG. 14 shows an example of the changed image processing setting information.
As described above, when the count value Cnt is less than the threshold value, the process proceeds to S1003. That is, if the count value Cnt is less than the threshold value, the process of S1005 is omitted.

Note that the processing mode change order is not limited to the above order. For example, the processing mode of image processing selected by the user may be changed. The processing mode may be changed in order from the image processing with the smallest size of the margin area. Two or more image processing modes may be changed simultaneously.
In addition, although the example which changes a process mode to "alternative glue margin use mode" was demonstrated, it is not restricted to this. For example, the size of the margin area may be changed to 0 by changing the processing mode to “adhesive margin non-use mode”. As a processing mode for changing the size of the margin area to 0, a processing mode different from the “alternative margin usage mode” and the “no margin usage mode” may be set. Then, the size of the margin area may be changed to 0 by changing the processing mode to a processing mode other than “alternative margin usage mode” and “no margin usage mode”. In this case, the settable processing modes may not include the “alternative margin use mode” and the “adhesive margin nonuse mode”. The size of the margin area may be changed to 0 by changing the execution flag to “invalid”.
When a plurality of processing modes for changing the size of the margin area to 0 can be set, any one of the plurality of processing modes may be set as the changed processing mode. The method for selecting the processing mode after the change is not particularly limited. For example, the changed processing mode may be selected by the user. A priority may be set in advance for each processing mode, and the processing mode with the highest priority may be selected as the changed processing mode.
The size of the margin area after reduction may be larger than zero. In addition, the size of the margin area may be changed without changing the processing mode.

Next, the control unit 314 controls the error processing unit 308, and the error processing unit 308 generates changed margin information based on the currently set image processing setting information (S1006; update of changed margin information). .
Here, since the size of the margin area of the image processing A is reduced to 0, the Top margin size is 0, the Bottom margin size is 111 (= 115-4), the Right margin size is 111, and the Left margin size. The change margin information whose is is 0 is generated.

  Then, the control unit 314 controls the error processing unit 308, and the error processing unit 308 resets the count value Cnt to 0 (S1007).

Next, the control unit 314 controls the error notification unit 310, and the error notification unit 310 notifies the image output apparatus of the change margin information generated in S1006 (S1008).
As a result of this processing, when the size of the margin area is changed, expected margin data representing the characteristics of the image to be displayed in the margin area after the size change is re-requested from the image output apparatus.

And the process of S1009 and S806-S808 is performed.
The processes of S1009 and S806 to S808 are as described above.

Next, the process returns to S802, and the processes of S802 and S803 are performed.
The processes in S802 and S803 are as described above.
The error recovery process of S805 is repeatedly executed until the size of the acquisition area matches the size of the assumed area.
Here, it is assumed that the size of the acquisition area matches the size of the assumed area, and the process proceeds to S804.

  In step S <b> 804, the control unit 314 controls the image processing setting unit 307, and the image processing setting unit 307 sets image processing setting information for the image processing unit 311. Here, the image processing setting information is set by rewriting the execution flag of the image processing G represented by the image processing setting information set in S1005 to “invalid”.

And the process of S806-S808 is performed.
The processing of S806 to S808 is as described above.
FIG. 15 shows an example of a display image (image displayed in the self-display area) obtained when the same acquired margin data as the assumed margin data is acquired after the error recovery process is performed.
Here, processed image data obtained by performing image processing A using alternative features and image processing B to F using acquired margin data on display target image data is displayed. The feature of the image to be displayed in the margin area is used, for example, when image processing is performed on the image data to be displayed at the end of the own display area (the end on the side adjacent to the other display area). The shaded area in FIG. 15 indicates an area (edge) on which image processing using the characteristics of the image to be displayed in the glue area is performed.

  In addition, as shown in FIG. 15, an information image may be superimposed and displayed. In the example of FIG. 15, it is indicated that the image processing A for which the acquired margin data is not used is the image processing A. Further, it is shown that the processing mode of the image processing A has been changed to “alternative glue margin usage mode”. In addition, the initial size, final size, and acquisition size of the margin area are shown. The initial size is an initial value of the size of the margin area (the total value of the margin areas of a plurality of image processes). The final size is the size of the margin area that is finally set. The acquisition size is the size of the margin area whose characteristics are represented by the obtained margin data. The user can grasp the various information described above by confirming the information image.

As described above, according to the present embodiment, when the acquired margin data different from the estimated margin data is acquired (including the case where the acquired margin data is not acquired), the estimated margin data is regenerated. Required. As a result, in the multi-display system, the image display apparatus can more reliably acquire appropriate acquired margin data, and thus more appropriate image processing results.
Further, according to the present embodiment, when the data size of the obtained margin data is smaller than the data size of the assumed margin data, the size of the margin area is reduced, and the data size of the assumed margin data is reduced. . As a result, when the data size of the assumed margin data exceeds the maximum size of the obtained margin data that can be output by the image output device, the image display device more reliably acquires the appropriate margin data. can do.

  In the present embodiment, an example has been described in which the expected margin data is re-requested when the data size of the acquired margin data is different from the data size of the assumed margin data, but the present invention is not limited to this. For example, when the data size of the acquired margin data is larger than the data size of the assumed margin data, the process for re-requesting the assumed margin data may not be performed. That is, when the data size of the obtained margin data is larger than the data size of the assumed margin data, the process may proceed from S803 to S804.

  The image output size of the graphic card for image output included in the image output device (the size of data to be output may be changed only at intervals of a predetermined number of pixels (for example, intervals of 5 pixels). The acquired margin data having the same data size as the data size of the margin data cannot be output by the image output device, and the acquired margin margin data having a data size larger than the data size of the expected margin data is output from the image output device. If the data size of the obtained margin data is larger than the data size of the assumed margin data, there is a high possibility that the obtained margin data includes the expected margin data and dummy data. If the expected margin data is included in the margin data, use the expected margin data included in the acquired margin data to obtain an appropriate image processing result. Can be obtained. Therefore, when the acquisition margin data contains assumed margin data, the process of reclaiming the assumed margin data may be omitted.

In the present embodiment, only the example of reducing the size of the margin area has been described, but the process for changing the size of the margin area is not limited to this.
As a process of changing the size of the margin area, if the size of the margin area is always reduced, if the data size of the obtained margin data is larger than the assumed margin data, The size of all the margin areas is reduced to zero.
When the data size of the acquired margin data is larger than the data size of the assumed margin data, appropriate acquired margin data can be acquired even if a larger margin area is set.
Therefore, when the data size of the acquired margin data is larger than the data size of the assumed margin data, it is preferable to increase the size of the margin area. For example, it is preferable to enlarge the size of at least one of a plurality of margin areas respectively corresponding to a plurality of image processes. As a result, image processing using the features of the image to be displayed in a larger margin area can be executed, so that the accuracy of the image processing can be improved.
In addition, when the data size of the obtained margin data is larger than the data size of the assumed margin data, and at least one of the plurality of margin areas is 0, one or more whose size is 0 It is preferable to enlarge the size of the margin area to a value larger than zero. Specifically, it is preferable to change the processing mode of one or more image processing in which the processing mode not using the acquired margin data is set to “adhesive margin usage mode”. Rather than increasing the accuracy of image processing using acquired margin data, increasing the number of image processing using acquired margin data can be expected to have a higher effect as an image quality improvement effect.

<Example 2>
Hereinafter, an image display apparatus and a control method thereof according to Embodiment 2 of the present invention will be described with reference to the drawings.
In the first embodiment, the example in which the initial margin information is notified using the display ID has been described. In the present embodiment, an example will be described in which initial margin information is notified without using a display ID. Specifically, an example in which the initial margin information and tile information are notified using AUX will be described.
In the first embodiment, the example in which the initial value of the size of the margin area (initial information of the image processing setting information) is determined in advance has been described. In this embodiment, an example in which the initial value of the size of the margin area is determined according to the state of the image display apparatus will be described. Specifically, an example will be described in which a plurality of operation modes can be set as the operation mode of the image display apparatus, and the initial value of the size of the margin area is determined according to the set operation mode.
In the first embodiment, the example in which the size of the margin area is changed in accordance with the comparison result between the data size of the obtained margin data and the data size of the assumed margin data is described. In the present embodiment, an example will be described in which the size of the margin area is changed in consideration of the acquired margin data that can be output by the image output apparatus.
Hereinafter, points (functions and configurations) different from those in the first embodiment will be described in detail, and description of the same points as those in the first embodiment will be omitted.

The configuration of the image display system (multi-display system) according to the present embodiment is the same as that of the first embodiment.
The configuration and processing of the image display device A included in the image display system according to the present embodiment will be described below. Since the configuration and processing of the image display apparatuses B to D are the same as those of the image display apparatus A, description thereof is omitted.
FIG. 16 is a block diagram illustrating an example of a functional configuration of the image display device 1601 (image display device A) according to the present embodiment.
As illustrated in FIG. 16, the image display device 1601 includes a data input unit 302, a tile information storage unit 304, an adhesive margin comparison unit 306, an image processing unit 311, an adhesive margin removal unit 312, a display unit 313, and the like. Further, the image display device 1601 includes a format notification unit 1602, an output performance information acquisition unit 1603, an adhesive margin information storage unit 1604, an image processing setting unit 1605, an operation mode setting unit 1606, a control unit 1607, and the like.
In FIG. 16, the same functional parts as those in the first embodiment (FIG. 3) are denoted by the same reference numerals as those in the first embodiment, and the description thereof is omitted.

  The format notification unit 1602 notifies the image output apparatus of initial margin information and tile information. Also, the format notification unit 1602 notifies the image output device of the changed margin information. In this embodiment, the tile information, the initial margin information, and the changed margin information are all notified to the image output apparatus using AUX.

The output performance information acquisition unit 1603 acquires output performance information, which is information related to acquired margin data that can be output by the image output apparatus, from the image output apparatus (third acquisition process). In this embodiment, information on the maximum value of the data size of the obtained margin data that can be output by the image output apparatus is acquired as output performance information.
The output performance information is not limited to information on the maximum value of the data size of the obtained margin data that can be output by the image output apparatus. For example, the output performance information may be information on the maximum value of the data size of input data that can be output by the image output apparatus.

  The margin information storage unit 1604 stores margin information (initial margin information and changed margin information) generated by the control unit 1607, which will be described later.

The image processing setting unit 1605 generates initial information of the image processing setting information according to the operation mode set (selected) by the operation mode setting unit 1606 described later.
Also, the image processing setting unit 1605 changes the image processing setting information based on the output performance information acquired by the output performance information acquisition unit 1603 when it is determined that the acquired margin data is not assumed margin data.
Then, the image processing setting unit 1605 sets the generated or changed image processing setting information in the image processing unit 311.

The operation mode setting unit 1606 selects one of a plurality of operation modes of the image display device 1601 and sets the selected operation mode.
The plurality of operation modes are, for example, a plurality of operation modes in which displayed images have different image quality. In the present embodiment, three image quality modes of a high image quality mode, a medium image quality mode, and a low image quality mode are used as a plurality of operation modes.

A control unit 1607 performs overall control of the image display device 1601. That is, the control unit 1607 controls each functional unit described above.
Further, the control unit 1607 generates margin information (initial margin information and changed margin information) based on the image processing setting information set by the image processing setting unit 1605.

FIG. 17 is a flowchart illustrating an example of a processing flow of the image display device 1601.
The processing flow of the image display device 1601 will be described with reference to FIG.
In the following description, it is assumed that the image display device 1601 is already connected to the image output device using a Display Port standard cable.

  First, the operation mode setting unit 1606 selects one of a plurality of operation modes of the image display device 1601 and sets the selected operation mode (S1701). For example, the operation mode setting unit 1606 selects an operation mode according to a user operation, an installation environment of the image display device 1601, and the like.

  Then, the control unit 1607 controls the image processing setting unit 1605, and the image processing setting unit 1605 generates initial information of the image processing setting information according to the operation mode set in S1701 (S1702).

An example of the correspondence between the operation mode and the initial information of the image processing setting information is shown in FIG.
In the example of FIG. 19, regardless of the operation mode, the execution flag of the image processing A to F is “valid” and the execution flag of the image processing G is “invalid” as the initial information of the image processing setting information. Information is generated.

  In the example of FIG. 19, when the high image quality mode is set, as the initial information of the image processing setting information, the margin area for image processing A is an area for four pixels, and the margin area for image processing B Is an area for 4 pixels, the margin area for image processing C is an area for 3 pixels, the margin area for image processing D is an area for 95 pixels, and the margin area for image processing E is 5 pixels. Information is generated that is an area for pixels, and a margin area for image processing F is an area for four pixels.

  When the medium image quality mode is set, as the initial information of the image processing setting information, the margin area for image processing A is an area for four pixels, and the margin area for image processing B is an area for two pixels. Yes, the margin area for image processing C is an area for 3 pixels, the margin area for image processing D is an area for 95 pixels, and the margin area for image processing E is an area for 5 pixels, Information that the margin area of the image processing F is an area for one pixel is generated.

  When the low image quality mode is set, as the initial information of the image processing setting information, the margin area for image processing A is an area for four pixels, and the margin area for image processing B is an area for four pixels. Yes, the margin area for image processing C is an area for 3 pixels, the margin area for image processing D is an area for 0 pixels, and the margin area for image processing E is an area for 5 pixels, Information indicating that the margin area of the image processing F is an area corresponding to four pixels is generated.

  Next, the control unit 1607 generates initial margin information based on the image processing setting information (initial information of the image processing setting information) generated in S1702 (S1703).

  Then, the format notification unit 1602 notifies the image output apparatus of the tile information stored in the tile information storage unit 304 and the initial margin information generated in S1703 using AUX (S1704). As a result of this processing, expected margin data corresponding to the set operation mode is requested from the image output apparatus.

  Next, the data input unit 302 determines whether or not the input data output from the image output device has been input to the image display device 1601 (data input unit 302) (S1705). When input data is input to the data input unit 302 (S1705: Yes), the process proceeds to S1706. If input data has not been input to the data input unit 302 (S1705: No), the process returns to S1705. Then, the data input unit 302 repeatedly executes the process of S1705 until input data is input to the data input unit 302.

In S1706, the control unit 1607 controls the adhesive margin comparison unit 306, and the adhesive margin comparison unit 306 determines whether or not the acquired margin data included in the input data acquired in S1705 is assumed margin data. to decide. The method for determining whether or not the acquired margin data is assumed margin data is the same as in the first embodiment. If it is determined that the obtained margin data is assumed margin data (S1706: Yes), the process proceeds to S1707. If it is determined that the acquired margin data is not assumed margin data (S1706: No), the process proceeds to S1708.
Note that, as described in the first embodiment, in S1706, it may be determined whether the data size of the acquired margin data is smaller than the data size of the assumed margin data.

In S1708, error recovery processing is performed. Then, the process proceeds to S1709. Although details of the error recovery processing according to the present embodiment will be described later, the image processing setting information is changed in the error recovery processing according to the present embodiment. That is, the size of the margin area is changed in the error recovery process according to the present embodiment.
In step S <b> 1707, the control unit 1607 controls the image processing setting unit 1605, and the image processing setting unit 1605 sets image processing setting information for the image processing unit 311. If the error recovery process of S1708 has not been performed, the image processing setting information (initial information of the image processing setting information) generated in S1702 is set. If the error recovery process of S1708 has not been performed, the image processing setting information changed by the error recovery process is set. Then, the process proceeds to S1709.

In step S1709, the control unit 1607 controls the image processing unit 311, and the image processing unit 311 performs image processing according to the image processing setting information set in step S1707 on the input data acquired in step S1705. Thereby, processing data is generated.
In the present embodiment, image processing is not performed during the period in which error recovery processing is performed, and input data is used as processing data.

  Next, the control unit 1607 controls the margin removal unit 312 and the margin removal unit 312 removes the acquired margin data from the processing data generated in S1709 (S1710). Thereby, processed image data is generated.

Then, the control unit 1607 controls the display unit 313, and the display unit 313 displays the processed image data generated in S1710 in the own display area (S1711). Then, the process returns to S1705.
If a user operation for changing the operation mode is performed or the installation environment of the image display device 1601 is changed during the execution of the processes of S1702 to S1711, the process may be returned to S1701.

FIG. 18 is a flowchart illustrating an example of the flow of error recovery processing (processing in S1708) according to the present embodiment.
The flow of error recovery processing according to the present embodiment will be described with reference to FIG.

  First, the control unit 1607 controls the output performance information acquisition unit 1603, and the output performance information acquisition unit 1603 acquires the output performance information from the image output apparatus (S1801).

Then, the control unit 1607 controls the image processing setting unit 1605, and the image processing setting unit 1605 changes the image processing setting information based on the output performance information acquired in S1801 (S1802).
By this process, the size of the margin area is changed based on the output performance information.
For example, when the data size of the obtained margin data included in the input data acquired in S1705 is smaller than the data size of the assumed margin data, the size of the margin area is reduced based on the output performance information. The If the data size of the obtained margin data included in the input data acquired in S1705 is larger than the data size of the assumed margin data, the size of the margin area is enlarged based on the output performance information. Is done.

  It is preferable that the margin area is reduced or enlarged so that the performance of the image output apparatus can be used to the maximum. For example, the paste margin data is set so that the data size of the assumed margin data is the same value as the maximum value of the obtained margin data that can be output by the image output device or a value slightly smaller than the maximum value. It is preferable that the area is reduced or enlarged. Thereby, acquired margin data representing the characteristics of the image to be displayed in the larger margin area can be acquired. As a result, it is possible to execute image processing using the features of the image to be displayed in the larger size margin area, and to improve the accuracy of the image processing.

  Next, the control unit 1607 generates changed margin information based on the image processing setting information (changed image processing setting information) obtained in S1802 (S1803).

  Then, the control unit 1607 controls the format notification unit 1602, and the format notification unit 1602 notifies the image output apparatus of the changed margin information generated in S1803 using AUX (S1804).

  Then, the control unit 1607 controls the image processing unit 311 and the image processing unit 311 generates composite data (S1805). Specifically, the image processing unit 311 generates information image data representing an information image, and synthesizes the information image data with the input data acquired in S1705. Thereby, composite data including the composite image data representing the composite image in which the information image is superimposed on the image represented by the display target image data and the acquired margin data is generated.

As described above, according to the present embodiment, tile information, initial margin information, and changed margin information are notified to the image output apparatus without using the display ID. As a result, the same processing as in the first embodiment can be executed without using the display ID.
The same effect as in the first embodiment can be obtained without using ID.
Further, according to the present embodiment, the initial value of the size of the margin area is set according to the operation mode of the image display apparatus. Thereby, an image processing result corresponding to the operation mode can be obtained.
Further, according to the present embodiment, the size of the margin area is changed based on the output performance information. Accordingly, the size of the margin area can be set reliably and at high speed so that the data size of the assumed margin data matches the data size of the obtained margin data that can be output by the image output apparatus.

Note that at least a part of the configuration of the present embodiment may be combined with the configuration of the first embodiment. For example, at least one of the following three configurations may be combined with the configuration of the first embodiment.
(1) Configuration that does not use Display ID for notification of tile information, initial margin information, and changed margin information (2) Configuration that determines the initial size of the margin area according to the operation mode of the image display device (3) Configuration for changing the size of the margin area based on the output performance information

<Other examples>
The present invention can also be implemented by a system (or a device such as a CPU or MPU) of a system or apparatus that implements the functions of the above-described embodiments by reading and executing a program recorded in a storage device. The present invention can also be implemented by a method comprising steps executed by a computer of a system or apparatus that implements the functions of the above-described embodiments by reading and executing a program recorded in a storage device, for example. . For this purpose, the program is stored in the computer from, for example, various types of recording media that can serve as the storage device (ie, computer-readable recording media that holds data non-temporarily). Provided to. Therefore, the computer (including devices such as CPU and MPU), the method, the program (including program code and program product), and the computer-readable recording medium that holds the program non-temporarily are all present. It is included in the category of the invention.

301, 1601: Image display device 302: Data input unit 305, 1602: Format notification unit 306: Paste margin comparison unit 310: Error notification unit 311: Image processing unit

Claims (21)

An image display device that displays an image in a self-display area that is one of a plurality of display areas,
First acquisition means for acquiring display target image data representing an image to be displayed in the self-display area;
A request to request the image output apparatus for first reference data representing an image characteristic to be displayed in the reference area, which is an area referred to when executing image processing and is an area outside the self-display area. Means,
Second acquisition means for acquiring second reference data output from the image output device in response to a request by the request means;
Image processing means for performing the image processing on the display target image data using the second reference data;
Comparison means for comparing the data size of the second reference data with the data size assumed in the image display device as the data size of the first reference data;
Have
The request means re-requests the first reference data from the image output device when the data size of the second reference data is smaller than the assumed data size as a result of the comparison by the comparison means. An image display device characterized by the above. The image display device according to claim 1, wherein the reference area is a part of a display area adjacent to the self-display area and is adjacent to the self-display area. The request unit re-requests the first reference data from the image output device when the data size of the second reference data is different from the assumed data size. The image display device described in 1. When the data size of the second reference data is smaller than the assumed data size, it further includes changing means for reducing the size of the reference area,
When the size of the reference area is changed by the changing means, the request means re-transmits the first reference data representing the characteristics of the image to be displayed in the reference area after the size change to the image output apparatus. The image display apparatus according to claim 1, wherein the image display apparatus is requested. The image display device according to claim 4, wherein the changing unit enlarges the size of the reference area when the data size of the second reference data is larger than the assumed data size. The image processing means performs a plurality of image processing on the display target image data using the second reference data,
The first reference data represents a feature of an image to be displayed in a reference area referred to when executing the image processing for each of the plurality of image processing,
The changing unit reduces the size of at least one of a plurality of reference areas respectively corresponding to the plurality of image processes when the data size of the second reference data is smaller than the assumed data size. The image display device according to claim 4, wherein: The changing means enlarges the size of at least one of a plurality of reference areas respectively corresponding to the plurality of image processes when the data size of the second reference data is larger than the assumed data size. The image display device according to claim 6. The change means reduces the size of at least one of the plurality of reference areas to 0 when the data size of the second reference data is smaller than the assumed data size. 8. The image display device according to 6 or 7. The changing means has a size of 0 when the data size of the second reference data is larger than the assumed data size and at least one of the plurality of reference areas is 0. The image display device according to claim 6, wherein the size of the one or more reference regions is enlarged to a value larger than zero. The counter further includes a counting unit that counts the number of times the first reference data is re-requested as in the previous time,
The image according to any one of claims 4 to 9, wherein the changing unit omits changing the size of the reference region when the number of times counted by the counting unit is smaller than a threshold value. Display device. The changing unit changes the processing mode of the image processing to one of a plurality of processing modes including a processing mode in which a feature of an image to be displayed in the reference region is not used, thereby reducing the size of the reference region to zero. The image display device according to claim 4, wherein the image display device is changed. The changing means changes the processing mode of the image processing to one of a plurality of processing modes including a processing mode in which a feature based on the display target image data is used as a feature of an image to be displayed in the reference area. The image display device according to claim 4, wherein the size of the reference area is changed to 0. Further comprising third acquisition means for acquiring information on the second reference data that can be output by the image output device from the image output device;
The changing unit reduces the size of the reference area based on the information acquired by the third acquiring unit when the data size of the second reference data is smaller than the assumed data size. The image display apparatus according to any one of claims 4 to 12, wherein The changing unit expands the size of the reference area based on the information acquired by the third acquisition unit when the data size of the second reference data is larger than the assumed data size. The image display device according to claim 13. 15. The image display device according to claim 13, wherein the third acquisition unit acquires information on a maximum value of the data size of the second reference data that can be output by the image output device. 16. The information processing apparatus according to claim 1, further comprising notifying means for notifying a user that the re-request for the first reference data has been performed when the re-request for the first reference data has been performed. The image display device according to claim 1. A selection means for selecting one of a plurality of operation modes of the image display device;
The said request | requirement means further has request | requires the said 1st reference data according to the operation mode selected by the said selection means to the said image output apparatus, The any one of Claims 1-16 characterized by the above-mentioned. Image display device. A display means for displaying an image based on the image data subjected to the image processing in the self-display area;
The display means displays a predetermined image instead of an image based on the image data subjected to the image processing during a period when the re-request of the first reference data is performed. 18. The image display device according to any one of -17. The image display device according to claim 18, wherein the predetermined image is a black image. A control method for an image display device that displays an image in a self-display area that is one of a plurality of display areas,
A first acquisition step of acquiring display target image data representing an image to be displayed in the self-display area;
A request to request the image output apparatus for first reference data representing an image characteristic to be displayed in the reference area, which is an area referred to when executing image processing and is an area outside the self-display area. Steps,
A second acquisition step of acquiring second reference data output from the image output device in response to the request made in the request step;
An image processing step of performing the image processing on the display target image data using the second reference data;
A comparison step of comparing the data size of the second reference data with the data size assumed in the image display device as the data size of the first reference data;
Have
In the requesting step, when the data size of the second reference data is smaller than the assumed data size as a result of the comparison in the comparing step, the first reference data is re-requested from the image output device. A control method for an image display device. A program for causing a computer to execute each step of the control method for an image display device according to claim 20 .

Images