JP2019211519A - Display device - Google Patents

Abstract

To provide a device that can automatically replace an image based on a plurality of image signals input to display the image at an appropriate position.SOLUTION: An image signal input unit 110 comprises: a first image signal input unit 1102 through an n-th image signal input unit 1109. And, a display device 10 having a display unit 160 that includes a plurality of display areas which can respectively display an input image, comprises: an image composition unit that composes a plurality of input images into one image; a comparison unit that compares between pixel values which are in boundary areas being adjacent to each other in a composite image composed by the image composition unit; and a display control unit 150 that performs control to display the image on the display area such that the pixel values of the boundary area approach, as a result compared by the comparison unit.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a display device.

  Recently, attention has been focused on LCD TVs and monitors using high-resolution panels. HDMI (High-Definition Multimedia Interface) (registered trademark) and display ports are mainly used as standards capable of outputting high-resolution digital signals such as 4K. New standards have been established year by year, and support for new products is being promoted. However, it takes time to establish standards to support new resolutions. For example, the next generation 8K (4K × 4) output has not yet reached the point where it can be processed with one input.

  As a method for inputting this 8K with the current technology, a method of combining images based on 4K image (video) signals and outputting them as one 8K image is used. In this case, in order to output one high-resolution image to the display device, first, a source device that is an apparatus that outputs an image signal divides the high-resolution image into a plurality of images, and each image is converted into an image signal. Output as. In addition, the display device side that inputs the image signal applies an image based on the image signal to an appropriate position and outputs the image as a single image.

  At this time, since the source device and the display device are connected by a plurality of cables, an image based on the image signal may not be displayed at an appropriate position depending on the cable connection method. In view of this, there has been proposed a display device including a rearrangement unit that rearranges so that the video indicated by each video signal transmitted through a plurality of cables is arranged in a predetermined manner on the display panel (for example, a patent). Reference 1).

JP2013-153410A

  However, when the display device described in Patent Document 1 rearranges the images so that the images are displayed at appropriate positions, test images having different colors in the respective regions obtained by dividing the display region of the display device. It was necessary to display. Therefore, there is a problem in that it requires an operation on the source device side such as transmitting an image signal of a test image from the source device to the display device, which is troublesome.

  In view of the problems described above, an object of the present application is to provide an apparatus that can automatically replace images based on a plurality of input image signals and display an image at an appropriate position.

In order to solve the above-described problems, the display device of the present invention includes:
In a display device having a plurality of terminals for inputting an image and having a display unit including a plurality of display areas each capable of displaying the input image,
An image composition unit for compositing a plurality of images input from the terminal into one image;
A comparison unit that compares pixel values in a boundary region of images adjacent to each other in the synthesized image synthesized by the image synthesis unit;
As a result of comparison by the comparison unit, a display control unit that performs control to display the image in the display region so that the pixel value of the boundary region approximates,
It is characterized by providing.

  According to the present invention, when an input image is combined as a single image, the pixel values in the boundary region are compared, and the image can be displayed so that the pixel values in the boundary region are approximated. . Therefore, the user does not have to worry about the combination of the terminals on the source device side and the display device side, and does not take the trouble of operating the source device, and the composite image in which the image is arranged at an appropriate position. Can be displayed on the display device.

It is a figure for demonstrating the whole structure in 1st Embodiment. It is a figure for demonstrating the function structure of the display apparatus in 1st Embodiment. It is an operation | movement flowchart for demonstrating the main process in 1st Embodiment. It is a figure for demonstrating the Example in 1st Embodiment. It is an operation | movement flowchart for demonstrating the main process in 2nd Embodiment. It is an operation | movement flowchart for demonstrating the main process in 3rd Embodiment. It is a figure for demonstrating the operation example in 3rd Embodiment. It is an operation | movement flowchart for demonstrating the main process in 4th Embodiment. It is a figure for demonstrating the operation example in 4th Embodiment. It is a figure for demonstrating the operation example in 4th Embodiment. It is a figure for demonstrating the operation example in 4th Embodiment. It is an operation | movement flowchart for demonstrating the main process in 5th Embodiment. It is a figure for demonstrating the operation example in 5th Embodiment. It is an operation | movement flowchart for demonstrating the main process in 6th Embodiment. It is a figure for demonstrating the operation example in 6th Embodiment. It is an operation | movement flowchart for demonstrating the main process in 7th Embodiment. It is a figure for demonstrating the operation example in 7th Embodiment. It is an operation | movement flowchart for demonstrating the main process in 8th Embodiment.

  Embodiments of the present invention will be described below with reference to the drawings. In the present embodiment, a display device to which the present invention is applied will be described as an example.

[1. First Embodiment]
[1.1 Overall configuration]
The overall configuration of the first embodiment will be described. FIG. 1 is a diagram showing a state in which a display device 10 to which the present invention is applied and a source device 20 are connected by a plurality of cables. The display device 10 and the source device 20 are connected by, for example, an HDMI cable, and a video frame image and an audio signal are transmitted from the source device 20 to the display device 10.

  The display device 10 is, for example, an 8K television. Further, an 8K monitor may be used. Note that the resolution of the display device 10 is not limited to 8K, and may be 4K, 16K, or 32K. The source device 20 is a content reproduction device that can divide and output a high-resolution image signal, for example. The source device 20 may be an 8K broadcast compatible tuner or an information processing apparatus such as a PC (Personal Computer).

[1.2 Functional configuration]
Next, the functional configuration of the display device 10 will be described with reference to FIG. As shown in FIG. 2, the display device 10 includes a control unit 100, an image signal input unit 110, an image processing unit 120, a memory 130, an FPGA (Field Programmable Gate Array) 140, a display control unit 150, And a display unit 160.

  The control unit 100 is a functional unit for controlling the entire display device 10. In the present embodiment, the control unit 100 is described as being configured using SoC (System on a Chip), but is configured using SiP (System In Package) or one or a plurality of CPUs (Central Processing Units). May be.

  The image signal input unit 110 is a functional unit that inputs an image signal output from the source device 20. Further, the image signal input unit 110 decodes the input image signal into one or a plurality of image data in accordance with a frame rate (for example, 60 frames per second), and outputs the decoded image signal at a predetermined timing. For example, the image signal input unit 110 includes an HDMI terminal and a TMDS (Transition Minimized Differential Signaling) decoder that decodes an image signal input from the HDMI terminal and converts it into image data. Note that when HDMI is used, audio data, command data, and the like are decoded and output by TMDS, but in the present embodiment, description will be focused on image data.

  Further, in the present embodiment, for the sake of explanation, the display device 10 includes four image signal input units 110, and each image signal input unit 110 includes a first image signal input unit 1102 and a second image signal input unit. 1104, a third image signal input unit 1106, and a fourth image signal input unit 1108. The image signals input to each image signal input unit 110 are referred to as input 1, input 2, input 3, and input 4. Further, the image data based on the input 1 is the first image data, the image data based on the input 2 is the second image data, the image data based on the input 3 is the third image data, and the image data based on the input 4 is the fourth image data. Describe.

  The display device 10 includes a plurality of image signal input units 110 in accordance with the resolution of an image displayed on the display unit 160. When n image signals need to be input in order to display a high-resolution image, the display device 10 can input image signals from input 1 to input n, respectively. To n-th image signal input unit 1109. Further, the number of image data output from the image signal input unit 110 may output continuous image data every several frames. In this case, a plurality of continuous image data (indicated by arrows A to N in FIG. 2) are output to the image processing unit 120 at one output timing.

  Further, the image signal input unit 110 may down-convert the input image signal under the control of the control unit 100 and output image data with a reduced resolution. Note that down-conversion may be performed on the entire image signal or only on a signal corresponding to a partial region of the image signal.

  The image processing unit 120 is a functional unit that executes processing for image data output from the image signal input unit 110. Predetermined processing refers to, for example, investigation of image data such as extraction of pixel values at specific pixels of image data, or arrangement of a plurality of image data based on a predetermined arrangement pattern, so that one high-resolution image This is processing for generating and outputting image data synthesized as data (hereinafter referred to as “composite image data”).

  The arrangement pattern is data indicating a combination of the image data and the arrangement position when a plurality of pieces of image data are combined and displayed on the display area of the display unit 160. In the present embodiment, since image data is output from the four image signal input units 110, the display area of the display unit 160 is divided into four square shapes, and a plurality of display areas of upper left, upper right, lower left, and lower right are displayed. The image data is displayed on each of the screens. An arrangement pattern representing the correspondence between the display area and the image data displayed in the display area is referred to as an arrangement pattern. For example, if the arrangement pattern is data having an arrangement of (first image data, second image data, third image data, fourth image data), the image processing unit 120 displays the first image data on the upper left and the first image data on the upper right. Two image data, third image data in the lower left, and fourth image data in the lower right are arranged to generate combined image data as one image data. The arrangement pattern may be stored in the image processing unit 120, or a storage unit that stores the arrangement pattern may be provided in the display device 10, and may be stored in the storage unit. It is assumed that a pattern is stored.

  The memory 130 is a frame buffer that temporarily stores an image output from the image signal input unit 110. The memory 130 is configured by, for example, an SRAM (Static RAM) that is a semiconductor memory or an SSD (Solid State Drive).

  The FPGA 140 is an LSI (Large Scale Integration) capable of configuring an arbitrary logic circuit. In the present embodiment, it is used as a functional unit that generates a control signal to be input to the display control unit 150 based on the composite image data output from the image processing unit 120.

  The display control unit 150 is a functional unit that controls driving and output of the display unit 160, and the display unit 160 is a functional unit that outputs composite image data. For example, the display control unit 150 is an LCD (Liquid Crystal Display) controller, and the display unit 160 is an LCD. In this case, the display control unit 150 reads the composite image data, controls the transmission amount for each sub-pixel of each dot of the display unit 160, and controls the brightness of the backlight. The display unit 160 may be configured by a display device such as an organic EL display (OLED) or an organic EL (Electro-Luminescence) display.

[1.3 Process flow]
Next, the main processing of this embodiment will be described with reference to FIG. First, the image processing unit 120 determines whether or not four image signals are input from the image signal input unit 110 (step S102). In the present embodiment, the image signal input unit 110 decodes the input image signal and outputs image data. Therefore, the image processing unit 120 may determine whether or not four image signals are input depending on whether or not image data is output from the four image signal input units 110. The image data output from the image signal input unit 110 is stored in the memory 130.

  Subsequently, the image processing unit 120 reads the image data stored in the memory 130, and generates composite image data obtained by arranging and synthesizing the image data based on the arrangement pattern (step S104). Then, the image processing unit 120 reads the RGB value that is the pixel value of the central portion of the composite image data (step S106).

  The central part of the composite image data is a boundary region composed of four pieces of image data. Here, the boundary area refers to an area where boundaries of a plurality of image data are adjacent. In the present embodiment, one lower right pixel of image data arranged at the upper left, one lower left pixel of image data arranged at the upper right, one upper right pixel of image data arranged at the lower left, and lower right An area constituted by one pixel at the upper left of the image data arranged in is defined as a boundary area. Therefore, in step S106, the image processing unit 120 reads the RGB values of the four pixels constituting the central portion of the composite image data that is the boundary region.

  The RGB value is a value representing a color (pixel value) output in a specific pixel of image data by a combination of output amounts of red, green, and blue which are the three primary colors of light. In the RGB values, the output amount of red light is R value, the output amount of green light is G value, and the output amount of blue light is B value. For example, when the R value, G value, and B value each take any value from 0 to 255, if the RGB value is R value = 0, G value = 0, and B value = 0, The pixel is black, and if the RGB value is R value = 255, G value = 255, and B value = 255, the pixel is white. For the purpose of explanation, in the present embodiment, the R value, the G value, and the B value of the RGB value are described as taking any one of 256 levels from 0 to 255, but other than 256 levels (for example, 1024) Stage, 4096 stage).

  Subsequently, the image processing unit 120 determines whether or not the RGB values of the pixels included in the central portion of the composite image data, that is, the boundary region are approximate (step S108). In this embodiment, since the boundary region is composed of four pixels, it is determined whether the pixel values of two different pixels are approximated from the four pixels, and based on the determination result, the central portion of the composite image data is determined. What is necessary is just to determine whether an RGB value approximates. For example, when the RGB values of two selected pixels are approximated for all six combinations that are combinations of selecting two different pixels from four pixels, it is determined that the RGB values of the central portion are approximated. Also, the RGB values of the three pixels, the lower left pixel of the image data arranged at the upper right, the upper right pixel of the image data arranged at the lower left, and the upper left pixel of the image data arranged at the lower right, In comparison with the RGB value of the lower right pixel of the image data arranged in the upper left, it may be determined that the RGB value of the central portion approximates when the RGB value is similar.

  Here, the approximation of the RGB value is when the difference between the R value, the G value, and the B value falls within a predetermined range (hereinafter referred to as “approximate determination range”) when the RGB values in two pixels are compared. Say. For example, when the approximate determination range is “−5 to +5”, when two pixels are compared, if the difference between the R value, the G value, and the B value is within the range of −5 to +5, The RGB values of the two compared pixels are approximated. Note that the approximate determination range may be preset in the display device 10 or may be changeable by the user.

  The approximate determination range may be a different range for each of the R value, the G value, and the B value. For example, since human eyes are sensitive to green, the approximate determination range for the G value may be narrower than the approximate determination range for the R value and the B value. Further, the approximate determination range may be determined based on the display characteristics of the display unit 160.

  Further, the approximation of the pixel value may be determined based on the change amount of the pixel value. For example, if the amount of change between one pixel value and the other pixel value is within a range (for example, 2%) that the user feels the same color according to Weber's law, it is determined that the two pixel values are approximate. To do.

  In addition, as described above, instead of determining whether or not the pixel value is approximated by expressing the RGB value, whether or not the pixel value is approximated after expressing the pixel value in another color system. You may judge. For example, the pixel value may be expressed as a Lab value expressed by lightness, red and green chromaticity, and yellow and blue chromaticity, or expressed as an XYZ value expressed by a value in the XYZ color space. May be. Moreover, you may determine whether a pixel value approximates using the value of some pixel values.

  If the RGB value of the central portion of the composite image data is not approximated (step S108; No), the image processing unit 120 rearranges the image data at random, assuming that the composite image data is generated based on an incorrect arrangement pattern. Then, another arrangement pattern in which the arrangement of the image data is replaced is generated (step S110). And the process of step S104-step S108 is performed. The image processing unit 120 executes the processing from step S104 to step S110 until an arrangement pattern that approximates RGB values can be identified.

  When the RGB value of the central portion of the composite image data is approximate (step S108; Yes), the composite image data is stored as an appropriate layout pattern, assuming that the composite image data is a correct image. Then, with respect to the image data output from the image signal input unit 110, composite image data generated by arranging image data along an appropriate arrangement pattern is output to the FPGA 140. The FPGA 140 transmits a control signal to the display control unit 150 based on the composite image data output from the image processing unit 120. Then, under the control of the display control unit 150 based on the control signal, the composite image data is output as a video by the display unit 160 (step S112).

  In any of the arrangement patterns, when the RGB value of the central portion is not approximated, a predetermined time is set (for example, time for 10 frames), and the main process is executed again. If the image signal input to the display device 10 is an image signal of a frame image based on a video, the image data changes with the passage of time. Therefore, by executing the main processing based on the changed image data, a composite image It is possible to specify an arrangement pattern that approximates the RGB value of the central portion of the data.

[1.4 Operation example]
Subsequently, an operation example of the present embodiment will be described with reference to FIG. FIG. 4A is a diagram showing the composite image data and the position of the central portion of the composite image data, and FIG. 4B is a diagram showing the boundary region constituting the central portion of the composite image data. FIG. 4C and FIG. 4D are diagrams showing combinations for comparing pixel values.

  FIG. 4A shows a composition in which image data is arranged and synthesized along the arrangement pattern when the arrangement pattern is (first image data, second image data, third image data, fourth image data). It is an example of image data. As shown in FIG. 4A, the first image data based on the input 1 is based on the upper left, the second image data based on the input 2 is on the upper right, the third image data based on the input 3 is on the lower left, and based on the input 4. The fourth image data is arranged at the lower right.

  The boundary area E100, which is the central part of the composite image data, is an area where four pieces of image data are in contact. Here, the boundary area E100 is configured by pixels facing any one of the pixels at the four corners of the other three images among the pixels at the four corners of each image data, and has two vertical pixels as shown in FIG. 4B. This is an area of two horizontal pixels. Here, the lower right pixel of the first image data is P1, the lower left pixel of the second image data is P2, the upper right pixel of the third image data is P3, and the upper left pixel of the fourth image data is P4.

  Then, the image processing unit 120 determines whether or not the pixel values of the four pixels P1, P2, P3, and P4 are approximate. Here, the image processing unit 120 selects two of the four pixels and determines whether or not the RGB values of the two selected pixels are approximate.

  There are six combinations for selecting two of the four pixels as indicated by arrows in FIG. Therefore, the image processing unit 120 determines that the RGB value of the central portion is approximated when the RGB value is approximated in the six combinations of pixels.

  Note that the image processing unit 120 may determine whether or not the RGB values are approximate in some of the six combinations. For example, as shown in FIG. 4D, when the pixel values of the pixels P2, P3, and P4 are compared with the pixel value of P1, the number of combinations is three. When the RGB values approximate in these three combinations of pixels, the image processing unit 120 may determine that the RGB values of the central portion are approximate.

  In the present embodiment, the composite image data is generated in step S104 and it is determined whether or not the RGB value of the central portion of the composite image data is approximate. However, the composite image data is not generated, and each image data is generated. The RGB values of the pixels constituting the boundary area may be read and compared. By doing so, the arrangement pattern can be determined without performing the process of generating the composite image data, so that the processing time can be reduced.

  In the present embodiment, the boundary area is described as being configured by one pixel in the corner area on the side facing the other image data in each image data. However, the boundary area may be configured by two or more pixels. Good. In this case, the number of combinations of pixel values to be compared may be increased, or the average value of the pixel values of the pixels constituting the boundary region may be compared. Further, the boundary region may be configured in a circular shape or a diamond shape.

  In step S110, the arrangement pattern may be generated completely at random, or the order of the arrangement pattern to be generated may be determined in advance. Note that when the arrangement patterns are generated in order, the arrangement patterns corresponding to the order of the cables that are easy for the user to connect may be preferentially generated. By doing in this way, compared with the case where an arrangement pattern is generated completely at random, the possibility that an appropriate arrangement pattern can be specified earlier can be increased.

  Even in the case of 4K, 16K, 32K, it is possible to specify an appropriate arrangement pattern by the above-described processing. Further, the case where there are four image data has been described, but the present invention can be applied to the case where more image data is used. For example, in the case of displaying a horizontally long image composed of a total of 8 image data, 4 horizontally and 2 vertically, the four image data should be adjacent in the upper left, upper right, lower left, and lower right. There are three boundary regions constituted by Therefore, the image processing unit 120 may determine whether or not the RGB values of the pixels constituting the boundary area are approximated for each of the three boundary areas when the eight pieces of image data are randomly arranged. . If the image processing unit 120 determines that the RGB values of the pixels constituting the boundary area are approximate for each of the three boundary areas, the arrangement pattern may be an appropriate arrangement pattern.

  The above-described arrangement pattern specification may be performed when the user gives an instruction, or may be performed at startup (when the display device 10 is powered on). Moreover, you may perform regularly.

  According to the present embodiment, the display device 10 can arrange the image data at an appropriate position based on the input image signal. Therefore, it is not necessary for the user to check whether the source device 20 and the display device 10 are connected to the correct terminals, and a high-resolution image (video) can be obtained without operating the source device 20. Can be easily experienced.

  Moreover, since an appropriate arrangement pattern is specified based on the comparison of pixel values, it is possible to specify an appropriate arrangement pattern with high accuracy.

[2. Second Embodiment]
Next, the second embodiment will be described. Unlike the first embodiment, the second embodiment is an embodiment in which composite image data based on all arrangement patterns is generated in advance, and an arrangement pattern in which the RGB value of the central portion is closest is specified. This embodiment is obtained by replacing FIG. 3 of the first embodiment with FIG. 5, and the same functional units and processes are denoted by the same reference numerals and description thereof is omitted.

  The main processing of this embodiment will be described with reference to FIG. If the image processing unit 120 determines that an image signal has been input, the image processing unit 120 subsequently generates composite image data based on all the arrangement patterns and reads the RGB values of the central portion (step S202). For example, when four image signals are input, four image data are output from the image signal input unit 110 based on each input. There are 24 combinations in which the four pieces of image data are arranged at different positions. Therefore, the image processing unit 120 generates 24 composite image data. Then, for each composite image data, the RGB values for the four pixels constituting the boundary region are read from the central portion.

  Subsequently, the image processing unit 120 specifies an arrangement pattern with the closest RGB value based on the RGB value read in step S202 (step S204). For example, the image processing unit 120 sets the arrangement pattern that minimizes the difference between the RGB values of four pixels constituting the boundary region as the arrangement pattern that approximates the RGB value most. In this case, among the six combinations in which two pixels are selected from four pixels, the arrangement pattern having the largest number of combinations of pixels having similar RGB values is set as the arrangement pattern having the most approximate RGB values. Alternatively, an arrangement pattern that minimizes the variation in the difference or an arrangement pattern that has the smallest amount of change in pixel value may be used as the arrangement pattern that approximates the RGB value most closely. In this way, a comparable value (amount) based on the RGB values of the four pixels constituting the boundary region is calculated, and an arrangement pattern that most closely approximates the RGB value is specified based on the calculated value.

  Then, the image processing unit 120 outputs the composite image data to the FPGA 140, thereby outputting the composite image data based on the arrangement pattern specified in step S204 as a video (step S112).

  In step S204, even if the arrangement pattern has the closest RGB value, if the number of combinations of pixels to which the RGB value approximates is small or the value such as variation or variation is large, the specified arrangement pattern is It is unlikely to be appropriate. Specifically, for the value calculated in step S204, a threshold value or a range that is determined to be approximate is determined. When the value calculated in step S204 is not an appropriate value based on the threshold value, When it does not fit, it is determined that there is a low possibility of an appropriate arrangement pattern. For example, the number of combinations whose pixel values are approximated is set as the value calculated in step S204 for six combinations that select two of the four pixels that form the boundary region. The threshold is set to 6 for this value. In this case, among all the arrangement patterns, even if the arrangement pattern has the largest number of combinations of pixels that approximate RGB values, when the combination of pixels that approximate RGB values is 5 or less, the image processing unit 120. Is determined to be less likely to be an appropriate arrangement pattern. In such a case, after a predetermined time has elapsed (for example, time for 10 frames), the processing may be performed again from step S202.

  As in the first embodiment, in step S202, the composite image data may not be generated, and the RGB values of the pixels constituting the boundary area may be read from each image data and compared.

  According to this embodiment, since the arrangement pattern with the closest RGB value is specified from all the arrangement patterns, it is possible to specify an appropriate arrangement pattern with high accuracy.

[3. Third Embodiment]
Next, a third embodiment will be described. The third embodiment is an embodiment in which the arrangement pattern in the second embodiment is specified a plurality of times. In this embodiment, FIG. 5 is replaced with FIG. 6 in the second embodiment, and the same functional units and processes are denoted by the same reference numerals, and description thereof is omitted.

  The main processing of this embodiment will be described with reference to FIG. When the image signal is input, the image processing unit 120 reads the RGB values in the central portion of all the arrangement patterns, and determines whether or not the arrangement pattern that approximates the RGB values can be identified (step S302). The fact that the arrangement pattern with the closest RGB value can be specified is, for example, when the arrangement pattern with the closest RGB value is highly likely to be an appropriate arrangement pattern. More specifically, when a comparable value (amount) based on the RGB values of the four pixels constituting the boundary area is calculated, and an arrangement pattern that most closely approximates the RGB values is obtained, the value is a threshold value. This is a case where the value is an appropriate value based on the above or a case where the value falls within a range determined to be approximate. In step S302, when the arrangement pattern with the closest RGB value can be identified, the image processing unit 120 stores the arrangement pattern with the closest RGB value as the first arrangement pattern (step S304). Here, the first arrangement pattern is an appropriate arrangement pattern candidate.

  In step S302, when the arrangement pattern with the closest RGB value cannot be specified (step S302; No), step S202 and step S302 are executed based on another image data. At this time, when the image data changes, the process returns to step S202 so that the arrangement pattern with the closest RGB value can be specified. At this time, the image processing unit 120 stands by until there is a change in the APL (Average Picture Level) value (step S306). As the APL, for example, an average pixel value or average luminance value of image data is used. Thus, by waiting for the image data to change, for example, even if the input image is a single color, it is possible to avoid repeatedly executing the process of specifying the arrangement pattern.

  After storing the first arrangement pattern, the image processing unit 120 determines whether or not a predetermined time (for example, time for 10 frames) has elapsed (step S308). Then, after a predetermined time has elapsed (step S308; Yes), the image processing unit 120 can read the RGB values at the central portion of all the arrangement patterns again (step S310), and can specify the arrangement pattern with the most approximate RGB values. Is determined (step S312). If it is not possible to specify the arrangement pattern that approximates the RGB value most closely, the process waits until the APL value changes, and then returns to Step S310 (Step S312; No → Step S314 → Step S310). Note that step S310 performs the same processing as step S202, step S312 performs step S302, and step S314 performs the same processing as step S306.

  If it is possible to specify the arrangement pattern that approximates the RGB value most closely, the image processing unit 120 sets the arrangement pattern that has the smallest total difference value as the second arrangement pattern, and whether or not the first arrangement pattern matches the arrangement pattern. Is determined (step S314). If the first arrangement pattern matches the second arrangement pattern, the first arrangement pattern (or the second arrangement pattern) is specified as an appropriate arrangement pattern (step S316). Then, the image processing unit 120 synthesizes the image data based on the arrangement pattern specified in step S316, and outputs it as a video from the display unit 160 (step S112).

  If the first arrangement pattern is different from the second arrangement pattern, the process returns to step S202 (step S314; No → step S202).

  FIG. 7 illustrates an operation example in the present embodiment. In the present embodiment, the first arrangement pattern and the second arrangement pattern are specified at different timings. In particular, when an image signal based on a moving image is input, the image data (frame image) differs between the timing for specifying the first arrangement pattern and the timing for specifying the second arrangement pattern. Therefore, an appropriate arrangement pattern is specified based on different image data.

  In addition, although this embodiment demonstrated as performing the process which pinpoints an arrangement | positioning pattern twice, you may carry out 3 times or more. Further, the process of specifying the arrangement pattern may be executed in a blacked-out state before outputting the video to the display unit 160.

  According to this embodiment, the process of specifying the arrangement pattern can be repeatedly performed based on different image data, and the accuracy of specifying an appropriate arrangement pattern can be improved.

[4. Fourth Embodiment]
Next, a fourth embodiment will be described. Unlike the first embodiment, the fourth embodiment is an embodiment that generates composite image data after down-converting an image signal. In the present embodiment, FIG. 3 in the first embodiment is replaced with FIG. 8, and the same functional units and processes are denoted by the same reference numerals and description thereof is omitted.

  For example, when the display device 10 displays an 8K resolution video, the image signal input unit 110 normally receives a 4K image signal. However, if an image signal of an image having a different pixel value for each stripe or pixel is input at 4K resolution, or an image signal of an image close to noise such as a forest image is input, Even if the pixel values of the pixels to be compared are compared, the RGB values may not approximate. In such a case, the display device 10 down-converts the input image signal and outputs the image data as an image signal having a 2K resolution. By down-converting, the resolution of the image data is lowered and the pixel values are averaged. Then, based on the 2K resolution image data, composite image data is generated and the RGB values are compared. Therefore, even in an image including a stripe or an image close to noise, the pixel value for each pixel is averaged, and the change in the pixel value is reduced. For this reason, the difference of the pixel value of the pixel which comprises a boundary area | region can be made small, and the specific precision of an arrangement pattern can be improved.

  The main process in this embodiment will be described with reference to FIG. When an image signal is input to the display device 10, the image processing unit 120 determines whether or not a down-conversion condition is satisfied (step S402). Here, the down-conversion condition is a condition when the image signal input unit 110 down-converts the image signal. For example, it is determined that the down-conversion condition is satisfied in the following cases.

(1) When it is set to perform down-conversion For example, when it is instructed by the user setting to specify the arrangement pattern with priority on accuracy, it is determined that the down-conversion is satisfied, and Down-conversion will be performed.

(2) When image data has a lot of noise components When image data based on an image signal is considered to have a lot of noise, down-conversion is performed. For example, when a pixel value histogram is taken and there is a certain number of pixels included in a specific pixel value range, it is determined that there is a lot of noise.

  When the down-conversion condition is satisfied, the image signal input unit 110 performs down-conversion of the image signal (Step S402; Yes → Step S404). For example, the down conversion of the image signal is realized by the image processing unit 120 transmitting a control signal to the image signal input unit 110 so as to perform the down conversion.

  Subsequently, an arrangement pattern is specified based on the image signal. For example, steps S104 to S110 in the first embodiment are executed.

  Subsequently, when the arrangement pattern can be identified, the image processing unit 120 determines whether or not the image signal input unit 110 has down-converted (step S406). If the image signal input unit 110 has down-converted, the image signal input unit 110 returns the image signal to the original state (step S408). For example, the image processing unit 120 transmits the control signal to the image signal input unit 110 so as not to perform down-conversion. Then, the image processing unit 120 outputs the synthesized image data synthesized based on the arrangement pattern to the FPGA 140 and outputs it as a video to the display unit 160 (step S112).

  An operation example in the present embodiment will be described with reference to the drawings. FIG. 9A is a diagram showing a boundary region E400 that is a central portion of the composite image data, and FIG. 9B shows a pixel value of the boundary region E402 before down-conversion. 9 (c) shows the pixel value of the boundary area E404 before down-conversion. For the sake of simplicity, the pixel values are assumed to be R, G, and B values shown in a rectangle.

  As shown in FIG. 9B, the four pixels constituting the boundary region E402 and the surrounding pixels include a pixel having an RGB value of R value = 0, a G value = 0, and a B value = 0, and an RGB value. Are configured like a checkerboard pattern with pixels having an R value = 10, a G value = 10, and a B value = 10, RGB values adjacent vertically or horizontally are not approximated.

  Therefore, the RGB values are averaged by down-conversion. For example, by down-converting a 4K image signal into a 2K image signal, a pixel composed of 2 vertical pixels and 2 horizontal pixels in 4K becomes one pixel in 2K. The RGB value of one pixel is an average of the RGB values of pixels formed by 2 vertical pixels and 2 horizontal pixels at 4K. Therefore, in 4K, a pixel having R value = 0, G value = 0, and B value = 0 and a pixel having R value = 10, G value = 10, and B value = 10 are configured in a checkered pattern. If the value is 2K, the RGB values are averaged, and the RGB values of the pixels constituting the checkered pattern are R value = 5, G value = 5, and B value = 5.

  For example, the RGB values of the vertical 2 pixels and horizontal 2 pixels in the lower right corner of the first image data shown in the area E403 in FIG. 9B are converted into the RGB values shown in the area E405 in FIG. 9C by down-conversion. , RGB values are pixels of R value = 5, G value = 5, and B value = 5. The same applies to the second image data, the third image data, and the fourth image data. Therefore, the RGB values of the pixels constituting the boundary region E404 are all R value = 5, G value = 5, and B value = 5, and the image processing unit 120 can determine that the RGB values are approximate. .

  Note that the resolution may be lowered only in the region including the pixels constituting the boundary region. As shown in FIG. 10A, the areas including the pixels constituting the boundary area are the four corner areas of each image data. FIG. 10B is an enlarged view of the boundary region E410 shown in FIG. As shown in FIG. 10B, the boundary region E410 in the central portion of the composite image data includes a region E421, a region E422, a region E423, and a region E424 that include pixels constituting the boundary region. In the present embodiment, for the sake of explanation, the region E421, the region E422, the region E423, and the region E424 are regions of 2 pixels in the vertical direction and 2 pixels in the horizontal direction that are configured by the pixels in the boundary region and the three pixels around the pixels in the boundary region. And Note that the region including the pixels constituting the boundary region may have a shape in which the pixels in the boundary region are enclosed in a fan shape, or may have a shape in which the pixels in the boundary region are surrounded in a triangular shape. Moreover, it is good also as an area | region larger than 2 vertical pixels and 2 horizontal pixels.

  As shown in FIG. 10B, the lower right area E421 of the first image data, the lower left area E422 of the second image data, the upper left area E423 of the third image data, and the upper right area E424 of the fourth image data. The RGB values are averaged by reducing the resolution. Therefore, the boundary area E420 is configured by pixels in which RGB values are averaged, and the image processing unit 120 determines whether or not the RGB values are approximated based on the averaged pixels.

  The image signal input unit 110 may perform the process of reducing the resolution of a part of the image data, or the image processing unit 120 may perform the process on the image data output from the image signal input unit 110. In this way, by adding the area for lowering the resolution to a part of the image data, the processing addition of the display device 10 is reduced.

  Note that although the display device 10 has been described as performing the down-conversion, it may be performed on the source device 20 side. In addition, when the display device 10 transmits a control signal for down-conversion (for example, CEC (Consumer Electronics Control)) from the source device 20 to the display device 10 and receives the control signal for down-conversion, the display device 10 Down-conversion may be performed. Further, EDID (Extended Display Identification Data) on the display device 10 side may be changed so that a low-resolution image signal is transmitted from the source device 20. Note that down-conversion on the source device 20 side saves processing for down-conversion on the display device 10, so that processing for specifying an appropriate arrangement pattern can be shortened.

  As shown in FIG. 11, the display device 10 may display a setting screen W400 for setting whether to perform down-conversion. In addition, the user is allowed to select from the region B400 whether the image data is rearranged by the display device 10 with accuracy priority, speed priority, or automatic determination. Note that when the OK button B402 is selected, the setting selected by the user is enabled, and when the cancel button B404 is selected, the original state is restored. When accuracy priority is selected, it is assumed that the down-conversion condition is always satisfied, and when speed priority is selected, the down-conversion condition is not always satisfied. If automatic is selected, the image processing unit 120 determines whether to down-convert based on the image data. When down-conversion is performed, it takes more time than when down-conversion is not performed, and thus the convenience of the user can be improved by selecting whether or not to perform down-conversion by the user.

  According to this embodiment, when determining an arrangement pattern based on an 8K or higher-resolution image, even if the boundary area image is a stripe image or an image including noise, the determination accuracy is reduced. Can be prevented.

[5. Fifth Embodiment]
Next, a fifth embodiment will be described. Unlike the first embodiment, the fifth embodiment is an embodiment that combines (combines) image data one by one. In the present embodiment, FIG. 3 in the first embodiment is replaced with FIG. 12, and the same functional units and processes are denoted by the same reference numerals and description thereof is omitted.

  The main process in this embodiment will be described with reference to FIG. First, when an image signal is input, the image processing unit 120 reads the RGB values at the four corners of each image data (step S502). Then, the image processing unit 120 determines that the RGB value of the lower right pixel of the first image data is the RGB value of the lower left pixel of the second image data, the RGB value of the lower left pixel of the third image data, and the fourth image data. It is determined whether or not it approximates to any of the RGB values of the lower left pixel (step S504). The RGB value of the lower right pixel of the first image data is the RGB value of the lower left pixel of the second image data, the RGB value of the lower left pixel of the third image data, and the RGB value of the lower left pixel of the fourth image data. If approximated to either, the image data with the approximate RGB values is combined on the right side of the first image data (step S504; Yes → step S506).

  The RGB value of the lower right pixel of the first image data, the RGB value of the lower left pixel of the second image data, the RGB value of the lower left pixel of the third image data, and the RGB value of the lower left pixel of the fourth image data If it is not approximated, the image processing unit 120 continues the RGB value of the lower left pixel of the first image data, the RGB value of the lower right pixel of the second image data, and the lower right of the third image data. It is determined whether or not the RGB value of the pixel and the RGB value of the lower right pixel of the fourth image data are approximated (step S504; No → step S508). The RGB value of the lower left pixel of the first image data is the RGB value of the lower right pixel of the second image data, the RGB value of the lower right pixel of the third image data, and the lower right RGB value of the fourth image data. When approximated to any of the pixels, the image data with the approximate RGB values is combined on the left side of the first image data (step S508; Yes → step S5010).

  The RGB value of the lower left pixel of the first image data, the RGB value of the lower right pixel of the second image data, the RGB value of the lower right pixel of the third image data, and the lower right pixel of the fourth image data If it is not approximated with any of the RGB values, the arrangement pattern cannot be determined based on the current image data, and therefore the processing of step S504 is performed again after a predetermined time has elapsed (step S508; No → step S504).

  Subsequently, the image processing unit 120 selects one of the RGB value of the lower right pixel of the first image data and the image data that has not been combined in step S506 and step S510 (hereinafter referred to as “uncombined image data”). It is determined whether or not the RGB value of the upper right pixel is approximate (step S512). Then, when the RGB value of the lower right pixel of the first image data approximates the RGB value of any upper right pixel of the uncombined image data, the image data with the approximate RGB value is represented by the first image data. The lower side is coupled (step S512; Yes → step S514).

  When the RGB value of the lower right pixel of the first image data and the RGB value of the upper right pixel of the unbound image data are not approximated, the image processing unit 120 then continues to the upper right pixel of the first image data. It is determined whether or not the RGB value of each of the uncombined image data is approximate to the RGB value of any lower right pixel (step S512; No → step S516). If the RGB value of the upper right pixel of the first image data approximates the RGB value of any lower right pixel of the unbound image data, the image data with the approximate RGB value is represented by the first image data. It couple | bonds with an upper side (step S516; Yes-> step S518).

  Note that if the RGB value of the upper right of the first image data and the RGB value of any of the lower right pixels of the unbound image data are not approximate, the arrangement pattern cannot be determined based on the current image data, so a predetermined time After the elapse of time, the process of step S512 is performed again.

  Subsequently, the image processing unit 120 specifies an arrangement pattern from the combined image data. For example, when the third image data is combined on the right side of the first image data and the fourth image data is combined on the upper side of the first image data, the arrangement pattern is (fourth image data, second image data, second image data, 1 image data, 3rd image data). Then, the image processing unit 120 outputs the synthesized image data synthesized based on the arrangement pattern to the FPGA 140 and outputs it as a video to the display unit 160 (step S112).

  With reference to FIG. 13, a pixel for comparing RGB values will be described. FIG. 13 is a diagram in which the upper left pixel of the first image data is C11, the upper right pixel is C12, the lower right pixel is C13, and the lower left pixel is C14. Similarly, for the second image data, the third image data, and the fourth image data, the numbers of the image data are the tens place and the corner positions are the first place. Represent.

  In step S504 of the main process, the RGB values of C14 and C23, C33, and C43 are compared. Here, for example, when the RGB values of C14 and C33 are approximated, the third image data is arranged on the right side of the first image data so that the pixels of C14 and C33 are continuously arranged horizontally. .

  In this state, the RGB values of C14, C22, and C42 are compared in step S512 of the main process. Here, for example, when the RGB values of C14 and C22 are approximate, the second image data is arranged below the first image data so that the pixels of C14 and C22 are continuously arranged vertically. To do.

  In this case, the third image data is combined to the right of the first image data, and the second image data is combined below the first image data. And it can specify that 4th image data is arrange | positioned at the lower right of 1st image data. Therefore, the arrangement pattern in this case is (first image data, third image data, second image data, fourth image data).

  According to the present embodiment, since the composite image data is generated while comparing the pixel values of the boundary region, it is effective particularly when there is a lot of image data to be combined. For example, when combining 16 pieces of image data, the number of combinations of image data is considered to be the number of factorials of 16. It is not realistic to compare the RGB values by randomly arranging such an enormous arrangement pattern or to generate composite image data in advance. Even in such a case, the pixel value of the boundary region on the one end side of the lower side of the image data is compared with the pixel value of the boundary region on the other end side of the lower side of the uncombined image data on the basis of one piece of image data. In addition, image data with approximate pixel values can be combined. Similarly, the pixel value of the boundary region on one end side of the upper side of the image data is compared with the pixel value of the boundary region on one end side of the lower side corresponding to the one end side of the unbound image data, and the pixel value approximates the pixel value Can be combined. In this way, it is possible to combine image data and specify an appropriate arrangement pattern based on the combined image data. As described above, according to the present embodiment, an appropriate arrangement pattern can be obtained even when there is a large amount of image data.

[6. Sixth Embodiment]
Subsequently, the sixth embodiment will be described. Unlike the fifth embodiment, the sixth embodiment is an embodiment that compares the pixel values of the pixels constituting the sides, not the pixels at the corners of the image data. That is, this is an embodiment in which the boundary region is constituted by the peripheral region on the side facing the image, and the pixel values of the pixels in the peripheral region are compared. This embodiment is obtained by replacing FIG. 12 of the fifth embodiment with FIG. 14, and the same functional units and processes are denoted by the same reference numerals and description thereof is omitted.

  The main process in this embodiment will be described with reference to FIG. Note that the description of the same processing as in the fifth embodiment is omitted.

  First, when an image signal is input, the image processing unit 120 reads the RGB values of the pixels constituting the four sides of each image data (step S602). At this time, the image processing unit 120 may read the RGB values of all pixels constituting the side (if the input image signal is 4K, the horizontal side is 3840 pixels and the vertical side is 2160 pixels). The RGB values of the pixels may be read at a predetermined interval (for example, every 100 pixels) or at a predetermined ratio (for example, 100 pixels for each line).

  Subsequently, the image processing unit 120 determines that the RGB values of the pixels constituting the right side of the first image data are the RGB values of the pixels constituting the left side of the second image data, the left side of the third image data, and the left side of the fourth image data. It is determined whether to approximate the value (step S604). For example, the image processing unit 120 selects one pixel from among the pixels constituting the right side of the first image data and having read out the RGB values in step S604, and from the pixels constituting the left side of the second image data. Select a pixel in the same vertical position as the selected pixel. Then, the image processing unit 120 determines whether or not the RGB values of the two selected pixels are approximate. As described above, the RGB values of the corresponding pixels are compared for the pixels constituting the sides to be compared. Then, such a comparison is performed on the pixels whose RGB values are read in step S602 among the pixels constituting the right side of the first image data. At this time, when the RGB values of all the compared pixels are approximated, the image processing unit 120 determines that the right side of the first image data and the left side of the second image data are approximated. Even if the RGB values of all the compared pixels are not approximated, the right side of the first image data is determined if the number of pixels to be approximated is a predetermined number or ratio among the RGB values of the compared pixels. It may be determined that the left side of the second image data is approximate.

  When the right side of the first image data and the left side of the second image data are not approximated, the image processing unit 120 determines the RGB values of the pixels that constitute the right side of the first image data and the left side of the third image data. Are compared with the RGB values of the pixels constituting the. At this time, if the right side of the first image data and the left side of the third image data are not approximated, the right side of the first image data and the left side of the third image data are not approximated, the image processing unit 120 The RGB values of the pixels constituting the right side of the first image data are compared with the RGB values of the pixels constituting the left side of the fourth image data.

  If the RGB values of the pixels constituting the right side of the first image data and the RGB values of the pixels constituting the left side of the second image data, the left side of the third image data, and the left side of the fourth image data are not approximate, The processing unit 120 approximates the RGB values of the pixels constituting the left side of the first image data to the RGB values of the pixels constituting the right side of the second image data, the right side of the third image data, and the right side of the fourth image data. It is determined whether or not (Step S604; No → Step S608). When the RGB values of the pixels constituting the left side of the first image data are not approximate to the RGB values of the pixels constituting the right side of the second image data, the right side of the third image data, and the right side of the fourth image data After a predetermined time has elapsed (for example, time for 10 frames), the process returns to step S604 (step S608; No → step S604).

  In step S604, if the right side of the first image data approximates the left side of any one of the second image data, the third image data, and the fourth image data, the second image data is displayed on the right side of the first image data. , The approximate image data of the third image data and the fourth image data are combined (step S604; Yes → step S506). In step S608, if the left side of the first image data approximates the right side of any one of the second image data, the third image data, and the fourth image data, the second image data is displayed on the left side of the first image data. The approximate image data among the image data, the third image data, and the fourth image data are combined (step S608; Yes → step S510).

  In step S612, the image processing unit 120 determines whether the RGB values of the pixels constituting the respective sides of the lower side of the first image data and the upper side of the unbound image data are approximate (step S612). When the RGB value of the pixel constituting the lower side of the first image data approximates the RGB value of the pixel constituting the upper side of any of the unbound image data, the image processing unit 120 displays the lower side of the first image data. The image data in which the RGB value of the pixel constituting the upper side approximates the RGB value of the pixel constituting the lower side of the first image data is combined (step S612; Yes → step S514).

  If the image data is not combined with the lower side of the first image data in step S612, the image processing unit 120 continues with the upper side of the first image data and the upper and lower sides of the unconnected image data. It is determined whether or not the RGB values of the pixels constituting the pixel are approximate (step S612; No → step S616). When the RGB value of the pixel constituting the upper side of the first image data approximates the RGB value of the pixel constituting the lower side of any of the unbound image data, the image processing unit 120 is placed above the first image data. Then, the image data in which the RGB value of the pixel constituting the lower side approximates the RGB value of the pixel constituting the upper side of the first image data is combined (step S616; Yes → step S518).

  When the RGB value of the pixel constituting the upper side of the first image data and the RGB value of the pixel constituting the lower side of any uncombined image data do not approximate, for example, after a predetermined time has passed (for example, The process returns to step S612 (time for 10 frames) (step S616; No-> step S612).

  Then, the image processing unit 120 specifies an arrangement pattern from the combined image data (step S520), and outputs the image data combined along the arrangement pattern as a video from the display unit 160 (step S112).

  With reference to FIG. 15, sides for comparing RGB values will be described. FIG. 15 is a diagram in which the upper side of the first image data is L11, the right side is L12, the lower side is L13, and the left side is L14. Similarly, the second image data, the third image data, and the fourth image data are also represented by codes having the image data number as the tens place and the side position as the first place, respectively.

  In step S604 of the main process, the RGB values of L12 and L24, L34, and L44 are compared. Here, for example, when the RGB values of L12 and L34 are approximated, the third image data is arranged on the right side of the first image data so that L12 and L34 are arranged horizontally and continuously.

  In this state, in step S612 of the main process, the RGB values of L13, L21, and L41 are compared. Here, for example, when the RGB values of L13 and L21 are approximated, the second image data is arranged below the first image data so that L13 and L21 are arranged vertically continuously.

  In this case, the third image data is combined to the right of the first image data, and the second image data is combined below the first image data. And it can specify that 4th image data is arrange | positioned at the lower right of 1st image data. Therefore, the arrangement pattern in this case is (first image data, third image data, second image data, fourth image data).

  According to the present embodiment, compared with the fifth embodiment, since the pixel values of a plurality of pixels are compared, an image to be combined can be determined with high accuracy. In particular, when there is a lot of image data, it takes time to rework when an erroneous search is performed. As in this embodiment, it is possible to reduce the time for specifying an appropriate arrangement pattern by accurately determining the images to be combined.

[7. Seventh Embodiment]
Next, a seventh embodiment will be described. Unlike the first embodiment, the seventh embodiment is an embodiment that compares the RGB values of pixels constituting a line (line) penetrating the image data constituting the composite image data, not the corner pixels of each image data. . That is, this is an embodiment in which the boundary region is constituted by the peripheral region on the side facing the image, and the pixel values of the pixels in the peripheral region are compared across a plurality of image data. In the present embodiment, FIG. 3 is replaced with FIG. 16 in the first embodiment, and the same functional units and processes are denoted by the same reference numerals and description thereof is omitted.

  In the present embodiment, as shown in FIG. 17, a line that penetrates the boundary region of the composite image data in the horizontal direction is referred to as an A line, and a line that penetrates in the vertical direction is referred to as a B line. There are two A lines, an upper A line positioned above the image data combining position and a lower A line positioned below the image data combining position. There are two B lines: a left B line located to the left of the image data combining position and a right B line positioned to the right of the image data combining position.

  With reference to FIG. 16, the flow of processing of the present embodiment will be described. Note that description of the same processing as in the first embodiment is omitted.

  After generating the composite image data (step S104), the image processing unit 120 reads the RGB values of the pixels constituting the A line and the B line (step S702). Note that the image processing unit 120 may read the RGB values of all the pixels constituting the A line and the B line, or may have a predetermined interval (for example, every 100 pixels) or a predetermined ratio (for example, each line). The RGB values of the pixels may be read at 100 pixels).

  Subsequently, the image processing unit 120 determines whether the RGB values of the pixels read in step S702 are approximate for the upper A line, the lower A line, the left B line, and the right B line (step S704). . When all the compared RGB values are approximated, the image processing unit 120 determines that the RGB values are approximated (step S704; Yes), and outputs the composite image data to the FPGA 140 based on the arrangement pattern at this time. Then, it is displayed as a video on the display unit 160 (step S112). When all the compared RGB values are not approximated, the image processing unit 120 generates an arrangement pattern in which image data is rearranged at random (step S110), and performs the processes of steps S104 to S704.

  Since this embodiment compares pixel values of a plurality of pixels, it is possible to specify an appropriate arrangement pattern with high accuracy.

[8. Eighth Embodiment]
Next, an eighth embodiment will be described. Unlike the seventh embodiment, the eighth embodiment is an embodiment in which composite image data based on all arrangement patterns is generated in advance, and an arrangement pattern in which the RGB values of the A line and the B line are closest is specified. is there. In this embodiment, FIG. 3 is replaced with FIG. 18 in the first embodiment, and the same functional units and processes are denoted by the same reference numerals and description thereof is omitted. The A line and the B line are the same as in the seventh embodiment.

  With reference to FIG. 18, the flow of processing of the present embodiment will be described. Note that description of the same processing as in the first embodiment is omitted. When the image signal is input, the image processing unit 120 generates composite image data based on all the arrangement patterns, and reads the RGB values of the pixels constituting the A line and the B line (step S802).

  Subsequently, the image processing unit 120 calculates the R value difference, the G value difference, and the B value difference of the RGB values of the corresponding pixels in the RGB values read in step S802, and sums all the differences. Calculate the total difference value. Then, the arrangement pattern having the smallest total difference value is specified (step S804).

  The image processing unit 120 outputs the composite image data to the FPGA 140 based on the arrangement pattern identified in step S804 and displays it as a video on the display unit 160 (step S112). As described in the second embodiment, a threshold value for the total difference value may be provided.

[9. Modified example]
The present invention is not limited to the above-described embodiments, and various modifications can be made. That is, embodiments obtained by combining technical means appropriately changed within the scope not departing from the gist of the present invention are also included in the technical scope of the present invention. Even if it is not described above, the order of steps may be changed or some steps may be omitted within a consistent range.

  Further, although the above-described embodiments have portions described separately for convenience of description, it is needless to say that the embodiments may be combined and executed within a technically possible range. For example, the third embodiment and the fourth embodiment may be combined. Since both the third embodiment and the fourth embodiment are embodiments that increase the accuracy of specifying an appropriate arrangement pattern, it is possible to specify an appropriate arrangement pattern with higher accuracy.

  In addition, the program that operates in each device in the embodiment is a program that controls a CPU or the like (a program that causes a computer to function) so as to realize the functions of the above-described embodiments. Information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) at the time of processing, and then stored in various storage devices such as ROM (Read Only Memory) and HDD, as necessary. The CPU reads and corrects / writes.

  Here, as a recording medium for storing the program, a semiconductor medium (for example, ROM, a non-volatile memory card, etc.), an optical recording medium / a magneto-optical recording medium (for example, a DVD (Digital Versatile Disc), an MO (Magneto Optical), etc. Disc), MD (Mini Disc), CD (Compact Disc), BD (Blu-ray Disk, etc.), magnetic recording medium (for example, magnetic tape, flexible disk, etc.), etc. In addition, by executing the loaded program, not only the functions of the above-described embodiment are realized, but also based on the instructions of the program, the processing is performed in cooperation with the operating system or other application programs. The function of the invention may be realized.

  In addition, when distributing to the market, the program can be stored and distributed in a portable recording medium, or transferred to a server computer connected via a network such as the Internet. In this case, it goes without saying that the storage device of the server computer is also included in the present invention.

DESCRIPTION OF SYMBOLS 10 Display apparatus 100 Control part 110 Image signal input part 120 Image processing part 130 Memory 140 FPGA
150 Display control unit 160 Display unit

Claims (7)

In a display device having a plurality of terminals for inputting an image and having a display unit including a plurality of display areas each capable of displaying the input image,
An image composition unit for compositing a plurality of images input from the terminal into one image;
A comparison unit that compares pixel values in a boundary region of images adjacent to each other in the synthesized image synthesized by the image synthesis unit;
As a result of comparison by the comparison unit, a display control unit that performs control to display the image in the display region so that the pixel value of the boundary region approximates,
A display device comprising: The comparison unit compares pixel values in the boundary region of the synthesized image synthesized by the image synthesis unit;
As a result of the comparison by the comparison unit, when the pixel value of the boundary region is not approximated, the image composition unit replaces the arrangement of the plurality of input images and synthesizes another composite image.
The display device according to claim 1. The comparison unit compares the pixel value of the boundary region on one side of the lower side of one image with the pixel value of the boundary region on the other side of the lower side of another image,
As a result of the comparison by the comparison unit, the display control unit obtains an image in which the pixel value of the boundary region on the one end side of the lower side and the pixel value of the boundary region on the other end side of the lower side are most similar to each other. The display device according to claim 1, wherein the display is controlled in a display area next to the one end side.   The display device according to claim 1, wherein the comparison unit compares pixel values of corner regions on the opposite side of the image as the boundary region.   4. The display device according to claim 1, wherein the comparison unit compares pixel values of a peripheral region on the opposite side of the image as the boundary region. 5.   The display device according to claim 1, wherein the comparison unit performs comparison using an image having a resolution lower than that of the display unit.   The display device according to claim 6, wherein comparison is performed using an image having at least a resolution of the boundary region.

Images