JP7329746B2 - image display system - Google Patents

Description

The present disclosure relates to image display systems.

2. Description of the Related Art A multi-display capable of displaying a large-screen, high-resolution image by configuring one screen using a plurality of display devices is known (Patent Document 1, etc.). For example, by arranging four display devices each having a resolution of 1920×1080 horizontally and four display devices vertically, a multi-display device having a resolution of 8K can be constructed. In recent years, the number of display devices that constitute a multi-display is increasing, and the multi-display is becoming larger and higher definition.

A video signal is supplied from a video output device to each display device that constitutes such a multi-display. Each display device has an input terminal (for example, an HDMI (registered trademark) terminal) for receiving a video signal from the video output device, and displays video based on the video signal received from the input terminal.

JP 2008-281717 A JP 2013-153410 A

When installing each display device that constitutes a multi-display, it is necessary to connect appropriately while confirming which display device's input terminal the output terminal of the video output device should be connected to.

In addition, a network technology (VoIP (Voice over Internet Protocol)) that superimposes and transmits a plurality of video signals on a single network cable is used to transfer video signals from a video output device to each display device that constitutes a multi-display. It may also be sent to In that case, when installing each display device, it is necessary to check the network setting (IP address) of each display device and connect appropriately.

However, with an increase in the number of display devices that make up the multi-display, mistakes in physical connection between the output terminal of the video output device and the input terminal of the display device tend to occur. Also, in VoIP in which a plurality of pieces of video data are superimposed and transmitted over a network cable, mistakes in network settings between display devices and video output devices are likely to occur. Due to such a mistake, an unintended image is displayed on an unintended display device in a multi-display. Therefore, it is necessary to modify the connections and settings in order to achieve the desired display state.

The present disclosure provides an image display system that configures a display screen with a plurality of display devices and that facilitates initial setting.

The image display system of the present disclosure receives a plurality of display devices arranged in an arbitrary layout and a plurality of input video signals, and generates an output video signal according to the layout from the plurality of input video signals for each display device. a pattern signal generating unit for generating pattern signals representing a plurality of different test pattern images; an output video signal and a pattern signal; A selector, an imaging device that captures test pattern images displayed on a plurality of display devices, an image captured by the imaging device is analyzed, and control information for controlling an image processing unit is generated based on the analysis result. and a controller for generating.

According to the image display system of the present disclosure, the layout of the display devices is automatically recognized and video signals are assigned to the display devices, so initial setting is facilitated when a plurality of display devices are installed.

FIG. 1 is a block diagram showing the configuration of a multi-display system according to Embodiment 1. FIG. FIG. 2 is a block diagram showing the configuration of the multi-window processor according to Embodiment 1. FIG. 3 is a block diagram showing a configuration of a controller according to Embodiment 1. FIG. FIG. 4 is a diagram showing an example of a test pattern image according to Embodiment 1. FIG. FIG. 5 is a diagram showing a display example of the entire display screen of the multi-display when the test pattern image is displayed on each display according to the first embodiment. 6 is a diagram showing an example of a user interface screen on which display objects are arranged according to Embodiment 1. FIG. 7 is a diagram showing a configuration example of display arrangement information according to Embodiment 1. FIG. 8 is a diagram showing an example of a user interface screen in which an input signal object is superimposed on a display object according to Embodiment 1. FIG. 9 is a diagram showing a configuration example of input signal allocation information according to Embodiment 1. FIG. 10A and 10B are diagrams for explaining a process of assigning an input image to a display (n) according to Embodiment 1. FIG. 11A is a diagram showing an input image based on an input image signal according to Embodiment 1. FIG. 11B is a diagram showing an input image based on the input image signal in Embodiment 1. FIG. 11C is a diagram showing an input image based on the input image signal in Embodiment 1. FIG. FIG. 11D is a diagram showing a display example of a multi-display when input video is assigned to each display. 12 is a block diagram showing the configuration of a multi-display system according to Embodiment 2. FIG. 13 is a block diagram showing a configuration of a multi-window processor according to Embodiment 2. FIG.

Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and redundant descriptions of substantially the same configurations may be omitted. This is to avoid unnecessary verbosity in the following description and to facilitate understanding by those skilled in the art.

It is noted that the inventor(s) provide the accompanying drawings and the following description for a full understanding of the present disclosure by those skilled in the art and are intended to limit the claimed subject matter thereby. not something to do.

(Embodiment 1)
[1-1. composition]
FIG. 1 is a block diagram showing the configuration of a multi-display system 10 according to Embodiment 1. As shown in FIG. The multi-display system 10 includes a plurality of video output devices 100, a multi-display 110, an imaging device 120, a multi-window processor 130 and a controller 140. Note that, in the present embodiment, the multi-display system 10 is an example of an image display system.

The video output device 100 is a video signal source that outputs a video signal for video displayed on the multi-display 110 . In this embodiment, there are a plurality of video output devices 100 . In this embodiment, the video signal output from the video output device 100 is called an input video signal.

A multi-display 110 is composed of a plurality of displays 111 arranged in an arbitrary layout. In this embodiment, the multi-display 110 is composed of ten displays 111 . Each display 111 is a display device with full high definition resolution. In this embodiment, display 111 is a liquid crystal display or an organic EL display.

The multi-window processor 130 performs image processing on multiple input video signals input from multiple video output devices 100 . The multi-window processor 130 generates an output video signal for each display 111 forming the multi-display 110 from a plurality of input video signals. The generated output video signal is output to multi-display 110 . A display 111 in the multi-display 110 displays an image based on the output image signal input from the multi-window processor 130 . Next, the configuration of multi-window processor 130 will be described.

FIG. 2 is a block diagram showing the configuration of multi-window processor 130 according to the first embodiment. Multi-window processor 130 includes input terminal 131 , frame memory 132 , image processing section 133 , control section 134 , test pattern generation section 135 , selector 136 , and output terminal 137 .

There are a plurality of input terminals 131, and as shown in FIG. 2, there are m (m=1, 2, . . . ) input terminals 131 in this embodiment. An input video signal input from the video output device 100 is output to the frame memory 132 via the input terminal 131 .

The frame memory 132 temporarily stores the input video signal input via the input terminal 131 . The input video signal is temporarily stored in the frame memory 132 and then output to the image processing section 133 . The frame memory 132 and the image processing unit 133 are connected by m cables, circuit patterns, or the like.

The image processing unit 133 processes the input video signal. A plurality of input video signals are input to the image processing unit 133 via the frame memory 132 . The image processing unit 133 generates an output video signal for each display 111 according to the layout of the display 111 from a plurality of input video signals. The output video signal generated by the image processing section 133 is output to the selector 136 . In this embodiment, the image processing unit 133 and the selector 136 are connected by n (n=1, 2, . . . ) cables, circuit patterns, or the like. The image processing unit 133 outputs n output video signals to the selector 136 .

The control section 134 controls the image processing section 133 . Details of the control will be described later.

The test pattern generator 135 generates test pattern signals representing a plurality of different test pattern images. The generated test pattern signal is output to selector 136 . In this embodiment, the test pattern generator 135 and the selector 136 are connected by n cables or circuit patterns. The test pattern generator 135 generates n test pattern signals, and the generated n test pattern signals are output to the selector 136 .

The selector 136 receives the output video signal from the image processing unit 133 and the test pattern signal from the test pattern generation unit 135 , and selectively outputs either the output video signal or the test pattern signal to the output terminal 137 . Output.

A plurality of output terminals 137 are provided to output a signal input from the selector 136 to the outside. Each of the multiple output terminals 137 is connected to each of the multiple displays 111 via a cable. Note that there are n output terminals 137 in this embodiment.

In the present embodiment, the test pattern generation unit 135, the image processing unit 133, and the control unit 134 of the multi-window processor 130 are independently or integrally implemented as hardware circuits (FPGA (Field-Programmable Gate Array), ASIC ( Application Specific Integrated Circuit), etc.). Alternatively, they may be composed of CPUs (Central Processing Units) and MPUs (Micro-Processing Units) that execute programs independently or integrally to achieve predetermined functions.

Returning to FIG. 1, the imaging device 120 includes an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and images a subject to generate image data. The imaging device 120 captures an image of the display screen of the multi-display 110, which is a subject, and generates image data. That is, the imaging device 120 captures images based on the output video signal and the test pattern signal displayed on the multiple displays 111 to generate image data.

The controller 140 is a device that receives user's instructions and controls the multi-window processor 130 according to the user's instructions. The controller 140 is composed of, for example, a personal computer. The controller 140 also analyzes the captured image captured by the imaging device 120 and generates control information for controlling the image processing unit 133 based on the analysis result. Next, the configuration of the controller 140 will be described.

FIG. 3 is a block diagram showing the configuration of controller 140 according to the first embodiment. The controller 140 includes a control unit 141 that controls the overall operation of the controller 140, a display unit 143 that displays various information, an operation unit 145 that is operated by a user, a RAM (Random Access Memory) 146, data and programs. and a data storage unit 147 that stores the .

The display unit 143 is composed of, for example, a liquid crystal display or an organic EL display. Operation unit 145 includes a touch panel, keyboard, mouse, buttons, and the like.

The RAM 146 is composed of a semiconductor device such as a DRAM (Dynamic Random Access Memory) or an SRAM (Static Random Access Memory), and functions as a work area for the control unit 141 while temporarily storing data.

The data storage unit 147 is a recording medium that stores parameters, data, control programs, and the like necessary for realizing predetermined functions. The data storage unit 147 is configured by, for example, a hard disk (HDD (Hard Disk Drive)) or a semiconductor storage device (SSD (Solid State Drive)).

The control unit 141 is a CPU and implements predetermined functions by executing a control program (software). The control unit 141 is not limited to a CPU, and can be realized by various electronic circuits such as MPU, GPU (Graphics Processing Unit), FPGA, ASIC, etc., which perform predetermined functions.

[1-2. motion]
The operation of the multi-display system 10 having the above configuration will be described below.

[1-2-1. Video display operation]
First, normal video display operations in the multi-display system 10 will be described with reference to FIGS. 1 and 2. FIG. A plurality of video output devices 100 output input video signals to the multi-window processor 130 . Input video signals are input to the multi-window processor 130 from each of the plurality of video output devices 100 via the plurality of input terminals 131 . Input video signals input from each of the plurality of input terminals 131 are stored in the frame memory 132 .

The image processing unit 133 reads the input video signal input to each input terminal 131 stored in the frame memory 132 . The image processing unit 133 also receives control signals including control parameters from the control unit 134 . A control signal is input from the controller 140 . The control parameters include information such as the display position of the input video signal for each display 111, enlargement/reduction, clipping, arrangement priority in multi-layer processing, and the like. The image processing unit 133 performs image processing based on the input video signal input to each input terminal 131 and the control parameters received from the control unit 134 . The image-processed input video signal is output from the image processing unit 133 to each output terminal 137 via the selector 136 as an output video signal. An output video signal output from each output terminal 137 is input to each display 111 . Each display 111 displays an image based on the output video signal. That is, the image processing unit 133 generates an output video signal for each display 111 , that is, for each output terminal 137 based on the input video signal and the control signal, and outputs the output video signal for each output terminal 137 . Thereby, the desired image is displayed on the entire multi-display 110 .

Here, in the multi-display system 10 , the video output terminal (output terminal 137 ) of the multi-window processor 130 needs to be connected to the input terminal of the predetermined display 111 . If the predetermined output terminal 137 is not connected to the predetermined input terminal of the display 111, the desired image cannot be obtained on the display screen of the multi-display 110. FIG. Also, the output video signal output from the output terminal 137 of the multi-window processor 130 must be generated according to the relative position of each display 111 . However, if there is a mismatch in connection between the output terminal 137 and the input terminals of the individual displays 111 , image shifts occur at the boundaries between the individual displays 111 . The image shift here means that a different image is displayed on the display 111 on which a predetermined image should be displayed.

In other words, if the output terminal 137 of the multi-window processor 130 and the input terminal of each display 111 are not properly connected, the multi-display 110 will not display the desired image. Also, the display 111 may be installed vertically, in which case it is necessary to output an output video signal corresponding to the orientation. In order to correct the above problem, it is necessary to correct the connection between the output terminal 137 and the input terminal of the display 111. However, as the number of installed displays 111 increases, it takes time and labor is increasing. The multi-display system 10 of this embodiment has an initial adjustment function to solve the above problem. The multi-display system 10 according to the present embodiment includes an imaging device 120, and can automatically detect and correct a connection failure location. Therefore, the initial setting of the multi-display system 10 and the detection and correction of the defect occurrence point are facilitated. The operation of executing this initial adjustment function will be described below.

[1-2-2. Initial adjustment operation]
In the multi-display system 10 according to the present disclosure, the initial adjustment operation is performed, for example, when the multi-display 110 is newly installed or when the arrangement of the displays 111 in the multi-display 110 is changed. The procedure for the initial adjustment operation will be described below.

During the initial adjustment operation, first, the controller 140 (that is, the control unit 141) causes each display 111 to display a different initial adjustment test pattern image. Therefore, controller 140 outputs a control signal for displaying a test pattern image to multi-window processor 130 .

Next, upon receiving this control signal, the control section 134 controls the test pattern generation section 135 . The test pattern generator 135 is controlled by the controller 134 to generate the same number of video signals (hereinafter referred to as “test pattern signals”) representing different test pattern images as the number of output terminals 137 . The test pattern signal is a signal independent of an externally input video signal. It should be noted that the video signal input from the outside referred to here is the input video signal input from the video output device 100 in the present embodiment. At this time, the selector 136 switches the path so that the test pattern signal from the test pattern generation section 135 is output to the output terminal 137 according to the control signal from the control section 134 . As a result, a test pattern signal is output from each output terminal 137 to each display 111 during the initial adjustment operation. Each display 111 displays a different test pattern image based on the test pattern signal. The test pattern image will be described below.

FIG. 4 is a diagram showing an example of a test pattern image according to Embodiment 1. FIG. A test pattern image is displayed on each display 111 based on the test pattern signal generated by the test pattern generator 135 . As shown in FIG. 4, the test pattern image has different image patterns for each output terminal 137 . Specifically, in the test pattern image, information 41 indicating the output terminal number is arranged in the center. Also, the test pattern image has a frame 43 for recognizing the edge of the display area of the display 111 . Furthermore, the test pattern image includes an image 45 (a triangular image arranged at the upper left corner of the test pattern in FIG. 4) for indicating the rotation direction (orientation) of the display 111 (image). Note that the test pattern image is not limited to the example shown in FIG. For example, images having different vertical and horizontal frequencies for each display 111 may be used. Alternatively, the same test pattern signal may be sequentially output from different output terminals 137 by switching the output terminals 137 according to a control signal from the controller 140 . In this case, the same test pattern image is displayed on each display 111 in sequence.

FIG. 5 is a diagram showing a display example of the entire display screen of the multi-display 110 when displaying the test pattern image on each display 111 according to the first embodiment. Here, the display connected to the output terminal n is assumed to be display (n). As shown in FIG. 5, a different test pattern image is displayed for each display 111 (that is, for each output terminal 137).

Next, during the initial adjustment operation, the controller 140 outputs a control signal to the imaging device 120 to image the display screen of the multi-display 110 while displaying the test pattern image on each display 111 . . The imaging device 120 captures the display screen of the multi-display 110 displaying the test pattern image (see, for example, FIG. 5) according to the control signal from the controller 140 and transmits data of the captured image to the controller 140 . That is, the imaging device 120 captures the test pattern image displayed on each display 111 by capturing the display screen of the multi-display 110 .

Next, the controller 140 (that is, the control unit 141) analyzes the captured image data received from the imaging device 120, and determines to which display 111 each output terminal 137 is connected and the relative arrangement between the displays 111. Detect relationships. For example, when the controller 140 receives data of a captured image obtained by capturing a display screen as shown in FIG. can be detected to be connected to the display 2 of the In addition, the controller 140 can recognize the relative positional relationship (arrangement) of each display 111 from the captured image data. That is, the controller 140 can recognize the layout of each display 111 by capturing an image of the display screen of the multi-display 110 with the imaging device 120 .

Then, the controller 140 determines control information for controlling the image processing section 133 of the multi-window processor 130 according to the analysis result of the captured image data. Further, the controller 140 sets the display layout information 50 (see FIG. 7) according to the analysis result of the captured image data. The display layout information 50 is information that defines the position of the display 111 on the user interface screen of the controller 140 . The user can set the layout of the video based on the input video signal on the user interface screen.

Here, a user interface screen (hereinafter referred to as "UI screen") will be described. The UI screen is a screen for the user to arrange the video based on the input video signal on each display 111 . The UI screen is displayed on the display unit 143 by the control unit 141 of the controller 140 . The user can arrange the video based on the input video signal on the multi-display 110 while confirming the layout of each display 111 on the UI screen displayed on the display unit 143 (details will be described later).

FIG. 6 is a diagram showing an example of a UI screen on which display objects 310 are arranged according to the first embodiment. As shown in FIG. 6, the UI screen includes a canvas area 300 having a predetermined area and display objects 310 . A display object 310 is an object that represents the display 111 on the UI screen. The display object 310 is arranged on the canvas area 300 based on the analysis result of the captured image data (that is, the display detection result) by the controller 140 (control unit 141). By referring to such a UI screen, the user can easily confirm the layout of each display 111 .

FIG. 7 is a diagram showing a configuration example of the display arrangement information 50 according to Embodiment 1. As shown in FIG. Display layout information 50 defines the layout of display objects 310 on campus area 300 . As shown in FIG. 7, the X coordinate, Y coordinate, and rotation angle on the canvas area 300 for each of the plurality of display objects 310 are detected from captured image data and managed as display layout information 50 . The display layout information 50 is generated by analyzing the data of the captured image of the test pattern image by the controller 140 (control section 141 ) and stored in the data storage section 147 . That is, the controller 140 analyzes the data of the captured image of the test pattern image, detects the position (X, Y coordinates) and rotation angle of each display 111, and stores the information indicating the detection result as the display arrangement information 50 in the data storage unit. 147. The multi-window processor 130 uses this display layout information 50 as a control parameter for arranging the video based on the input video signal on each display 111 . The value of the control parameter, display layout information 50, can also be manually modified by the user. That is, the user can change the value of the control parameter, which is the display layout information 50, by operating the operation unit 145 of the controller 140. FIG.

As shown in FIG. 6, the user can place (assign) a video based on the input video signal to the display 111 using the UI screen on which the display object 310 is placed. The arrangement of video based on the input video signal on the display 111 using the UI screen will be described below.

FIG. 8 is a diagram showing an example of a UI screen in which the input signal object 350 is superimposed on the display object 310 according to the first embodiment. As shown in FIG. 8, images (ie, input images 1 to 3) based on the input image signal can be superimposed on the display object 310 arranged on the canvas area 300 on the UI screen. The input signal objects 350 are the input images 1 to 3 arranged on the canvas area 300 . By arranging the input images 1 to 3, which are the input signal objects 350, on the display object 310 in this way, the display positions of the input images 1 to 3 on the display screen of the multi-display 110 can be set.

The user can place the input signal object 350 on the canvas area 300 by an operation such as drag and drop. Also, the user can arbitrarily change the setting of the position of the input signal object 350 and the size (horizontal width, vertical width) of the input signal object 350 by operating the operation unit 145 on the UI screen. In FIG. 8 , input signal objects 350 for input video 1 , input video 2 , and input video 3 are placed over display objects 310 of each display 111 .

FIG. 9 is a diagram showing a configuration example of the input video layout information 60 according to Embodiment 1. As shown in FIG. The input video placement information 60 indicates the placement position on the UI screen of the input signal object 350 placed on the UI screen. Also, the input video layout information 60 includes X coordinates, Y coordinates, sizes (horizontal width, vertical width) and rotation information on the canvas area 300 regarding the input signal objects 350, that is, the input images 1 to 3. FIG. 9 shows the values of the parameters of the input image arrangement information 60 when the input images 1 to 3 are arranged on the canvas area 300 as shown in FIG. The input image layout information 60 is used as a control parameter for arranging input images in the image processing section 133 of the multi-window processor 130 . The parameter values of the input video layout information 60 can also be manually changed by the user. That is, the user can change the value of the control parameter, which is the input video layout information 60, by operating the operation unit 145 of the controller 140. FIG.

When input images 1 to 3 are arranged for each display object 310 as shown in FIG. A part of each of the input image 1 and the input image 2 is cut out and arranged at a position corresponding to the display 4 . A portion of each of the input video 2 and the input video 3 is cut out and arranged at a position corresponding to the display 6 .

When the display arrangement information 50 and the input image arrangement information 60 are set, the controller 140 sends a control signal including the display arrangement information 50 and the input image arrangement information 60 to the multi-window processor 130 . In the multi-window processor 130 , the control section 134 generates control parameters based on the control signal from the controller 140 and transmits them to the image processing section 133 .

Specifically, the control unit 134 obtains the enlargement ratio or reduction ratio for the input images 1 to 3 from the shape and size of the input signal object 350 . Also, the control unit 134 detects an overlapping area between the display object 310 and the input signal object 350 . FIG. 10 is a diagram for explaining allocation processing of input images 1 and 2 to display (n) according to the first embodiment. For example, as shown in FIG. 10, a case where an input signal object 351 of input image 1 and an input signal object 352 of input image 2 are arranged in the area of display object 310n of display (n) will be described. First, the control unit 134 detects overlapping regions R1 and R2 between the display object 310n and the input signal objects 351 and 352, respectively. Then, the control unit 134 determines the clipping position and clipping size in the input images 1 and 2 from the regions R1 and R2.

The above is the assignment processing of the input images 1 and 2 to the display (n). For each display, the control unit 134 uses information such as enlargement/reduction ratio, cutout position, cutout size, layout position on the display, and rotation angle of the input video for the input video to be laid out on the display, as control parameters. It is transmitted to the processing unit 133 .

The image processing unit 133 internally retains the control parameters received from the control unit 134 . With the above, the adjustment operation in the multi-display system 10 is completed.

The operation thereafter is as described in the normal video display operation in the multi-display system 10. FIG. That is, the image processing unit 133 generates an output video signal to be output to each output terminal 137 (each display 111) based on the input video signals input via the plurality of input terminals 131 and control parameters. The generated output video signal is output to each display 111 via each output terminal 137 . As a result, the images are displayed on the multi-display 110 in the arrangement set on the UI screen.

For example, in the example shown in FIG. 10, the image processing unit 133 enlarges/reduces the input image 1 based on the enlargement/reduction ratio of the input image signal with respect to the input image 1, and the area R1 in the enlarged/reduced input image 1 Cut out the part corresponding to Similarly, the image processing unit 133 enlarges/reduces the input image 2 based on the enlargement/reduction ratio of the input image signal with respect to the input image 2, and cuts out the portion corresponding to the region R2 in the enlarged/reduced input image 2. . Then, the image processing unit 133 synthesizes the clipped video corresponding to the region R1 and the clipped video corresponding to the region R2, and outputs an output video signal (that is, an output video signal) of the video to be output to the display (n). video signal to be output to terminal n).

11A to 11D are diagrams showing examples of video display results on the multi-display 110 when the display layout information 50 and the input video layout information 60 are set as shown in FIGS. 6 to 9.

11A is a diagram showing input video 1 based on input video signal 1 in Embodiment 1. FIG. 11B is a diagram showing input video 2 based on input video signal 2 in Embodiment 1. FIG. 11C is a diagram showing input video 3 based on input video signal 3 in Embodiment 1. FIG. FIG. 11D is a diagram showing a display example of the multi-display 110 when input images 1 to 3 are assigned to each display 111. FIG. The image processing unit 133 of the multi-window processor 130 cuts out, enlarges/reduces, and rotates the input images 1 to 3 based on control parameters input from the control unit 134 . That is, the image processing unit 133 cuts out, enlarges/reduces, and rotates the input images 1 to 3 indicated by the input image signals 1 to 3 based on the control parameters input from the control unit 134, and outputs the output image signals. Generate. The generated output video signal is output to each display 111 . Each display 111 displays an image based on the input output image signal. As a result, as shown in FIG. 11D, an image is displayed on the multi-display 110 in which the connections between the multi-window processor 130 and the input terminals of the respective displays 111 are consistent. In other words, images can be normally displayed on the multi-display 110 as a whole.

[1-3. effects, etc.]
As described above, the multi-display system 10 (an example of an image display system) according to the present embodiment includes a plurality of displays 111 (an example of a display device) arranged in an arbitrary layout and a plurality of input video signals. , an image processing unit 133 that generates an output video signal according to the layout from a plurality of input video signals for each display 111, and a test pattern generation unit 135 that generates a test pattern signal indicating a plurality of different test pattern images (pattern signal a selector 136 (an example of a selector) that receives an output video signal and a test pattern signal and selects and outputs either the output video signal or the test pattern signal; An image capturing device 120 (an example of an image capturing device) that captures a test pattern image captured by the image capturing device 120 analyzes the captured image captured by the image capturing device 120, and based on the analysis result, generates control information for controlling the image processing unit 133. and a controller 140 (an example of a control device).

With the above configuration, the multi-display system 10 in the present embodiment recognizes the arrangement of the multiple displays 111 based on the test pattern image, and generates an output video signal for each display 111 accordingly. That is, the multi-display system 10 automatically recognizes the arrangement of each display 111, controls the input video signal according to the arrangement of each display 111, and generates the output video signal. The generated output video signal is output to each display 111 . According to such a configuration, even if the output terminal 137 of the multi-window processor 130 is not connected to the predetermined display 111, the output video signal is automatically output to the predetermined display 111. FIG. Accordingly, when connecting the cable of the multi-window processor 130 to the display 111, the user does not need to be aware of the connection destination of the output video signal, and does not need to perform work such as replacing the cable. Therefore, it becomes easy to set the connection of each display 111 in the multi-display system 10 .

Also, the controller 140 displays a UI screen on which a display object 310 (an example of a first object) representing the display 111 is displayed based on the analysis result (see FIG. 8). By referring to this UI screen, the user can easily recognize the layout of each display 111 .

The controller 140 also generates display layout information 50 (an example of first layout information) indicating the layout of each display 111 on the UI screen based on the analysis result.

The display layout information 50 also includes information indicating the position and rotation angle of the display object 310 (that is, the display 111) on the UI screen. A user can recognize the position and rotation angle of each display 111 by referring to the display arrangement information 50 .

Also, the display layout information 50 can be changed by the user.

In addition, the controller 140 arranges an input signal object 350 (an example of a second object) representing a video based on the input video signal on the UI screen according to user's operation. Further, based on the layout of the input signal object 350, the controller 140 generates input video layout information 60 (an example of second layout information) indicating the layout of the video based on the input video signal on the UI screen. This allows the user to freely arrange the input signal object 350 on the UI screen.

Also, the input image layout information 60 includes information indicating the position, size and rotation angle of the input signal object 350 on the UI screen. Thereby, the user can recognize the arrangement, size, and rotation angle of the image based on the input image signal by referring to the input image arrangement information 60 .

The image processing unit 133 generates an output video signal for each display 111 based on the relative positional relationship and size between the display object 310 and the input signal object 350 on the UI screen. As a result, the user can easily set the output video for each display 111 simply by arranging the display object 310 and the input signal object 350 at desired positions on the UI screen.

(Embodiment 2)
FIG. 12 is a diagram showing the configuration of a multi-display system 10b according to the second embodiment. The configuration and operation of the multi-display system 10b of this embodiment are basically the same as those of the first embodiment. The multi-display system 10b in Embodiment 2 uses a network technology such as VoIP to superimpose a plurality of output video signals and transmit them to each display 111 via one cable. It differs from the multi-display system 10 . Specifically, as shown in FIG. 12, each display 111 of the multi-display 110 and the multi-window processor 130b are network-connected via the communication device 200. FIG. A communication device 200 is a network device such as a HUB, for example. Also, the multi-window processor 130b is connected to the communication device 200 via one cable on which a plurality of output video signals are superimposed.

FIG. 13 shows a configuration of multi-window processor 130b according to the second embodiment. The multi-window processor 130b includes an image transmission section 138 that superimposes and transmits a plurality of signals (test pattern signals or output video signals) output from the selector 136 on one cable. An IP address is assigned to each of the multiple displays 111 .

During the initial adjustment operation, the test pattern signal from the test pattern generator 135 is selected by the selector 136 and output to the image transmitter 138 . The image transmission unit 138 adds the IP address of each display 111 to the input test pattern signal and outputs the signal to the communication device 200 . The communication device 200 transmits the test pattern signal with the IP address added to each display 111 via the network. Each display 111 receives a test pattern signal having an IP address that matches its own IP address among the test pattern signals transmitted from the communication device 200 . Thereby, each display 111 displays a test pattern image based on the test pattern signal.

The imaging device 120 captures an image of the multi-display 110 displaying the test pattern image according to a control signal from the controller 140 and transmits data of the captured image to the controller 140 . The controller 140 generates the display layout information 50 based on the captured image data of the test pattern image. Also, the controller 140 generates the input video layout information 60 based on the layout of the input signal objects 350 laid out on the UI screen.

Controller 140 then sends a control signal including display layout information 50 and input image layout information 60 to multi-window processor 130b.

During normal video display operation, the image processing unit 133 of the multi-window processor 130b generates an output video signal to be output to each display 111 based on the control signal received from the controller 140. FIG. The generated output video signal is output to the selector 136 . The selector 136 selects an output video signal from the image processing section 133 and outputs it to the image transmission section 138 .

The image transmission unit 138 adds the IP address of each display 111 to the output video signal for each display 111 input from the image processing unit 133 and outputs the signal to the communication device 200 . The communication device 200 transmits the output video signal to which the IP address is added to each display 111 via the network. Each display 111 receives an output video signal having an IP address that matches its own IP address among the output video signals transmitted from the communication device 200 . As a result, each display 111 displays an image based on each output video signal.

As described above, the multi-display system 10b of the present embodiment receives an output video signal and a test pattern signal from the selector 136, adds an IP address to the input output video signal and test pattern signal, and transmits an image. A transmitter 138 is provided. The display 111 receives the output video signal to which the IP address is added and the test pattern signal from the image transmission unit 138 . Display 111 then displays an image based on the received output video signal and test pattern signal having an IP address that matches the IP address of display 111 .

(Other embodiments)
As described above, Embodiments 1 and 2 have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can be applied to embodiments in which modifications, replacements, additions, omissions, etc. are made as appropriate. Also, it is possible to combine the constituent elements described in the first and second embodiments to form a new embodiment. Therefore, other embodiments will be exemplified below.

In the above embodiment, FIGS. 1 and 5 show an example layout of each display 111 in the multi-display 110, and the layout of the display 111 is not limited to this.

In the above embodiment, the functions of the control section 134 may be executed by the image processing section 133 or the controller 140 .

Also, the input video signal may be automatically corrected based on the control information created by the control device.

As described above, the embodiment has been described as an example of the technique of the present disclosure. To that end, the accompanying drawings and detailed description have been provided.

Therefore, among the components described in the attached drawings and detailed description, there are not only components essential for solving the problem, but also components not essential for solving the problem in order to illustrate the above technology. can also be included. Therefore, it should not be immediately recognized that those non-essential components are essential just because they are described in the attached drawings and detailed description.

In addition, the above-described embodiments are intended to illustrate the technology of the present disclosure, and various modifications, replacements, additions, omissions, etc. can be made within the scope of the claims or equivalents thereof.

INDUSTRIAL APPLICABILITY The present disclosure is useful for a multi-display system in which multiple display devices form one screen.

10, 10b Multi-display system (image display system)
50 display layout information 60 input video layout information 100 video output device 110 multi-display 111 display (display device)
120 imaging device 130, 130b multi-window processor 131 input terminal 132 frame memory 133 image processing section 134, 141 control section 135 test pattern generation section 136 selector 137 output terminal 138 image transmission section 140 controller (control device)
200 communication device 300 campus area 310, 310n display object 350, 351, 352 input signal object

Claims (5)

a plurality of display devices arranged in an arbitrary layout;
an image processing device to which a plurality of input video signals are input and which generates an output video signal according to the layout from the plurality of input video signals for each of the display devices;
a test pattern signal generator that generates a test pattern signal representing a plurality of different test pattern images;
a selector that receives the output video signal and the test pattern signal and selects and outputs either the output video signal or the test pattern signal;
an imaging device that captures the test pattern images displayed on the plurality of display devices;
a control device that analyzes a captured image captured by the imaging device and generates control information for controlling the image processing device based on the analysis result,
The control device is
Placement information of a first object indicating the plurality of display devices on a user interface screen based on the analysis result, and placement information including information indicating the position and rotation angle of the first object. generating first placement information;
arranging the images of the second objects on the user interface screen based on the input video signals, based on the layout of the plurality of second objects showing the plurality of images based on the plurality of input signals respectively; generating second layout information, which is layout information indicating the position, size, and rotation angle of the second object on the user interface screen, respectively;
displaying a user interface screen on which the first object and the plurality of second objects are displayed based on the first layout information and the second layout information; and
Receiving a user's operation to arrange the plurality of second objects on one of the display devices on the user interface screen;
The image processing device has a control unit and an image processing unit ,
The image processing unit
generating the output video signal for the plurality of display devices based on the relative positional relationship and size between the first object and the plurality of second objects on the user interface screen; ,
The control unit determines a clipping position in at least one image among the plurality of images based on the user's operation,
The image processing unit outputs a signal of the at least one clipped video to one of the plurality of display devices.
Image display system. 2. The image display system of claim 1, wherein the first placement information is user modifiable. further comprising an image transmission unit that receives the output video signal and the pattern signal from the selector, adds an IP address to the output video signal and the pattern signal, and transmits the output video signal and the pattern signal;
The display device receives the output video signal and the pattern signal to which the IP address is added from the image transmission unit, and receives the output video signal and the pattern signal having an IP address that matches the IP address of the display device. displaying an image based on the pattern signal;
The image display system according to claim 1. 2. The image display system according to claim 1, wherein said control device accepts a change in positional relationship or size of said plurality of second objects with respect to said first object by a user's operation on said user interface screen. . each of the plurality of second objects is cut out from an overlap region of each of the plurality of second objects with respect to the first object;
The image processing unit synthesizes the plurality of cut-out second objects such that the plurality of cut-out second objects are displayed on a corresponding display device.
The image display system according to claim 1.

Images