JP5665597B2 - Multi display system - Google Patents

Description

  The present invention relates to a multi-display system in which one display screen is constituted by a plurality of displays.

  2. Description of the Related Art Conventionally, a multi-display system that allows a plurality of displays to be arranged in a grid and displayed as a single screen has been commercialized, and is widely used in monitoring and control systems in infrastructure fields such as power and traffic. Surveillance control is a field where temporary stagnation is not allowed, and high reliability is required for a multi-display system that displays surveillance video and surveillance information.

  For this reason, some products have a function that allows the display to detect its own failure, and can send a failure notification to the outside using a general-purpose communication interface such as RS-232C or Ethernet (registered trademark). In the supervisory control system, it is possible to detect a failure state by using this function and perform failure control such as degenerate operation.

  For example, in the display method disclosed in Patent Document 1, a display pattern for a degenerate operation corresponding to a display failure state is prepared in advance, the display pattern is called according to the failure state, and the arrangement of displayed windows is changed. By changing, the window displayed on the failed display is displayed on the normal display.

Japanese Patent Publication No.59-30300

  However, in the display method shown in Patent Document 1, since only the pattern registered in advance during the degenerate operation is displayed, the pattern must be registered again when the number or type of windows to be displayed on the screen changes, There was a problem of being unable to respond flexibly.

  The present invention has been made in view of the above problems, and it is possible to rearrange windows displayed on a failed display in a normal display without setting a display pattern at the time of failure. The purpose is to provide a multi-display system.

  A multi-display system according to the present invention includes a multi-display configured as an integral screen by a plurality of displays arranged in a grid pattern, and a multi-screen display computer that outputs video to the multi-display, and the multi-screen display computer Obtains the state of each display and determines whether or not there is a failure, and displays a list of windows displayed on the display that has been determined to be defective by the failure detection unit on the normal display. And window rearranging means for rearranging the window selected by the user from the list in the normal display.

  The multi-display system of the present invention displays a list of windows displayed on the display that is determined to be a failure by the failure detection means on a normal display, and rearranges the windows selected by the user from the list in the normal display. Since the window rearranging means is provided, it is possible to rearrange the window displayed on the failed display in a normal display without setting a display pattern at the time of the failure in advance.

It is a block diagram which shows the structure of the multi-display system which concerns on this invention. It is a figure which shows the screen arrangement | positioning information table which concerns on this invention. It is a figure which shows the upper left coordinate of each display which comprises the multi-display system which concerns on this invention. It is a figure which shows the window information table which concerns on this invention. 3 is a flowchart showing an operation of the multi-display system according to the present invention. It is a flowchart which shows operation | movement of the window extraction means based on this invention. It is a block diagram which shows the structure of the multi-display which concerns on this invention in the state in which one display failed. It is a figure which shows the rearrangement window list which concerns on this invention. It is a flowchart which shows operation | movement of the window rearrangement means based on this invention. It is a figure which shows the rearrangement object window list displayed on the display which concerns on this invention. It is a figure which shows the multi-display which concerns on this invention of the state which rearranged the window.

<Configuration>
FIG. 1 is a block diagram showing the overall configuration of a multi-display system according to the present invention. In FIG. 1, the multi-display system includes a multi-display 5, a multi-screen display computer 6 that controls display on the multi-display 5, and a communication relay device 7 that relays communication between the multi-display 5 and the multi-screen display computer 6. Yes.

  The multi-display 5 is configured by integrally arranging a total of four displays 1 to 4 of two vertical and two horizontal, and has a resolution of 2800 pixels in the horizontal direction and 2100 pixels in the vertical direction. The displays 1 to 4 are equipped with general-purpose communication interfaces such as RS-232C and Ethernet (registered trademark), and can communicate with external devices such as computers via the general-purpose communication interface for various external control and status monitoring. It is a large display device for business use. The displays 1 to 4 are DLP projector or liquid crystal display devices using lamps or LEDs as light sources, and have a resolution of 1400 pixels wide and 1050 pixels long.

  The multi-screen display computer 6 operates a Microsoft Windows (registered trademark) operating system or a Linux (registered trademark) operating system, and has a general-purpose communication interface such as RS-232C or Ethernet (registered trademark). The multi-screen display computer 6 is a personal computer having a plurality of video output terminals and a multi-graphic card that can be connected to a plurality of displays and display an integrated screen (desktop screen).

  The communication relay device 7 is provided between the multi-display 5 and the multi-screen display computer 6, and the plurality of displays 1 to 4 and the multi-screen display computer 6 are connected to each other by an Ethernet (registered trademark) cable or an RS-232C cable. Is possible.

  In FIG. 1, a multi-screen display computer 6 includes a communication unit 8, a failure detection unit 9 that detects a failure of the displays 1 to 4, a screen arrangement information management unit 10 that manages a screen arrangement information table, and a window that manages a window information table. The information management unit 11 further includes a window extraction unit 12 that extracts a window displayed on the failed display, and a window rearrangement unit 13 that rearranges the window on a normal display.

  The communication means 8 communicates with the displays 1 to 4 through the communication relay device 7 to perform state monitoring and various controls of the displays 1 to 4.

  The failure detection unit 9 acquires the state of the displays 1 to 4 from the communication unit 8. As a result, if there is a display incapable of continuing display or a display incapable of acquiring the status itself, it is determined that the display has failed.

  The window extraction unit 12 refers to the screen arrangement information table of the screen arrangement information management unit 10 and the window information table of the window information management unit 11 and extracts windows that are displayed in whole or in part on the failed display. .

  The window rearrangement unit 13 displays a list of windows determined to be displayed on the failed display by the window extraction unit 12 on the multi-display 5, and the window selected by the user using a mouse or a keyboard is displayed. Display on a normal (non-failed) display.

  In FIG. 1, window A and window B are displayed on the display 1, window C is displayed on the display 2, window D and window E are displayed on the display 3, and window F and window G are displayed on the display 4. The window H is displayed across the display 2 and the display 4. These windows are, for example, monitoring information screens such as video images of monitoring cameras and numerical information of the plant being monitored.

  FIG. 2 shows a screen layout information table managed by the screen layout information management means 10. The screen layout information table is composed of screen layout information for each display. Since the multi-display 5 of the present invention is composed of four displays 1 to 4, it has four screen layout information. The screen number 1 row is the display 1, the screen number 2 row is the display 2, the screen number 3 row is the display 3, and the screen number 4 row is the screen arrangement information.

  The screen arrangement information includes an IP address, a screen offset, and a screen size in addition to the screen number. The screen number is a value that is numbered in ascending order from left to right and from top to bottom, with the display at the top left as 0. Display 1 is screen number 1, Display 2 is screen number 2, Display 3 is screen number 3, and Display 4 Becomes screen number 4. The IP address is an identification number of the Ethernet (registered trademark) interface of the display. The display 1 is 192.168.100.1, the display 2 is 192.168.100.2, the display 3 is 192.168.100.3, and the display 4 is 192.168.100.4.

  The screen offset is the coordinates (DX, DY) of the upper left corner of each display in the large screen coordinates representing the coordinates of the screen of the entire multi-display 5, and the unit is a pixel. The screen size is represented by DW in the width direction and DH in the height direction, and the unit is a pixel.

  FIG. 3 is a diagram showing the relationship between the large screen coordinates and the coordinates of the upper left corner of each display. The upper left corner of the screen of the multi-display 5 is (0, 0), the lower right corner is (2799, 2099), the upper left corner of the screen of the display 1 is (0, 0), and the upper left corner of the screen of the display 2 is (1400, 0), the upper left corner of the screen of the display 3 is (0,1050), and the upper left corner of the screen of the display 4 is (1400,1050). The screen size represents the pixel unit size of each display, and the displays 1 to 4 all have the same size (1400, 1050).

  FIG. 4 shows a window information table managed by the window information management means 11. Since eight windows are displayed on the multi-display 5 as shown in FIG. 1, eight window information is stored in the window information table. The window information includes an index, a window title, a window ID, a window position, and a window size. The index is a value representing the order in the window information table. The window ID is a value for identifying a window. If the OS is Microsoft Windows (registered trademark), a window handle is applicable, but the OS is not limited to Microsoft Windows (registered trademark). The window position is the coordinates (WX, WY) of the upper left corner of the window in large screen coordinates, and the unit is a pixel. The window size is represented by DW in the width direction and DH in the height direction, and the unit is a pixel.

<Operation>
FIG. 5 is a flowchart showing the operation of the multi-display system of the present invention. Hereinafter, the operation of the multi-display system will be described with reference to FIG.

  First, the failure detection means 9 periodically acquires the status of the displays 1 to 4 using the communication means 8 (step S601). The state acquisition interval may be determined according to the required failure detection time, for example, 10 seconds. Furthermore, the failure detection means 9 determines whether or not the displays 1 to 4 are in failure according to the result of the state acquisition (step S602). If any of the displays 1 to 4 is normal (NO in step S602), the process returns to step S601 and the state acquisition is continued.

  There are various factors for determining whether or not the display is faulty. Depending on the display, for example, if the lamp is not lit, video display is impossible, so it is determined that there is a fault. In addition, when the cooling fan stops, the temperature is abnormal and the display cannot be continued. Alternatively, even if there is no response to the status inquiry from the display, display control of the display cannot be performed, so that it is determined as a failure. As a result of the state acquisition, there is no abnormality in the displays 1 to 3 and the display 4 is not lit. Therefore, it is determined that the display 4 is out of order, and YES is determined in step S602.

  Next, the window extraction means 12 extracts the window displayed on the failure display 4 (step S603).

  Thereafter, the window extracted by the window extracting unit 12 is rearranged on a normal display (step S604). When the rearrangement process ends, the process returns to step S601 again to repeat the state acquisition.

<Window extraction>
FIG. 6 is a flowchart showing the window extraction operation of the window extraction means 12. First, in step S701, the index I of the window to be determined is initialized to 1. That is, the first window in the window information table is determined. Next, it is determined whether or not the upper left upper end of the index I window is included in the failed display (step S702). Specifically, the screen offset of the failed display is (DX, DY), the screen size is (DW, DH), and the coordinates of the upper left corner of the window are (WX [I], WY [I]). Judgment is made based on whether or not

DX <WX [I] <DX + DW (1)
DY <WY [I] <DY + DH (2)
If both the expressions (1) and (2) are satisfied, it is determined that the upper left corner of the window enters the failed display, and the process proceeds to step S704 to register the window information in the rearrangement window list. If at least one of the expressions (1) and (2) is not satisfied, the process proceeds to step S703, and it is determined whether or not the lower right lower end of the window of index I enters the failed display. When the window size is (WW [I], WH [I]), the coordinates (RIGHT [I], BOTTOM [I]) of the lower right corner of the window of index I are
RIGHT [I] = WX [I] + WW [I] (3)
BOTTOM [I] = WY [I] + WH [I] (4)
It is determined by whether or not the following expression is satisfied.

DX <RIGHT [I] <DX + DW (5)
DY <BOTTOM [I] <DY + DH (6)
When both the expressions (5) and (6) are satisfied, it is determined that the lower right corner of the window enters the failed display, the process proceeds to step S704, and the window information of the window is registered in the rearrangement window list. Thereafter, the process proceeds to step S705. On the other hand, if at least one of Expression (5) and Expression (6) is not satisfied, it is determined that the lower right corner of the window does not enter the failed display, and the process proceeds to Step S705.

  In step S705, the index I of the next window is obtained by adding 1 to the index I.

  Finally, in step S706, it is determined whether or not the index I exceeds the number of displayed windows. If the index I is exceeded, the determination for all displayed windows is completed, and the window extraction operation is terminated. . If not, the process returns to step S702 to determine the next window.

  FIG. 7 is a diagram illustrating a screen of the multi-display system when the display 4 has failed. Hereinafter, the operation of the window extracting means 12 when the display 4 shown in FIG. 7 fails will be described again with reference to FIG.

First, the index I is set to 1 (step S701), and it is determined whether or not the window A is included in the failed display 4 (step S702). Since the screen offset of the display 4 is (1400, 1050), the screen size is (1400, 1050), and the coordinates of the upper left corner of the window A are (30, 30), DX = 1400, DY = 1050, DW = Substituting 1400, DH = 1050, WX [1] = 30, and WY [1] = 30 into Equation (1) and Equation (2), respectively, 1400 <30 <2800 (1 ′)
1050 <30 <2010 (2 ')
Thus, since neither the formula (1 ′) nor the formula (2 ′) is established, it is determined that the upper left corner of the window A is not included in the display 4, and the process proceeds to step S703.

In step S703, it is determined whether or not the coordinates (RIGHT [1], BOTTOM [1]) of the lower right corner of the window A are included in the fault display 4. Since the window size of window A is (WW, WH) = (640, 480), RIGHT [1] = WX [1] + WW [1] = 30 + 640 = 670, BOTTOM [1] = WY [1] + WH [1 ] = 30 + 480 = 510, and substituting these into the equations (5) and (6) results in 1400 <670 <2800 (5 ′), respectively.
1050 <510 <2010 (6 ′)
It becomes. Since neither Expression (5 ′) nor Expression (6 ′) holds, it is determined that the lower right corner of the window A is not included in the display 4. As a result, since neither the upper left corner nor the lower right corner of the window A is included in the display 4, the window information is not registered in the rearrangement window list, and the index I is incremented by 1 to make I = 2 (step S705).

  Next, it is determined whether or not the index I exceeds the number of displayed windows. Now, since the number of displayed windows is 8, it is determined that the number of windows is not exceeded, and the process returns to step S702. Subsequently, it is determined whether or not the window B with the index I = 2 is included in the display 4. As for window B, window C, window D, and window E, as a result of the determination by the window extraction means 12 as in the case of window A, it is determined that these windows are not included in the display 4.

Next, the determination operation for the window F with index I = 6 will be described. In step S702, it is determined whether or not the upper left corner of the window F is included in the fault display 4. Since the coordinates of the upper left corner of the window F are (1450, 1100) from FIG. 4, DX = 1400, DY = 1050, DW = 1400, DH = 1050, WX [6] = 1450, WY [6] = 1100. Substituting into Equation (1) and Equation (2), 1400 <1450 <1400 + 1400 (1 ′)
1050 <1100 <1050 + 1050 (2 ′)
Thus, both the expressions (1 ′) and (2 ′) hold. Therefore, it is determined that the upper left corner of the window F is included in the display 4, and the process proceeds to step S704, where the window information of the window F is registered in the window rearrangement list.

  Next, in step S705, the index I is incremented by 1, resulting in I = 7. Since I = 7 does not exceed the number of displayed windows 8 (step S706), the process returns to step S702 to determine whether or not the window G is included in the display 4. As for the window G and the window H, as a result of the determination by the window extraction means 12 as in the case of the window F, it is determined that the window G and the window H are included in the display 4, and the window information of the window G and the window H is rearranged. Register to the list.

  In step S705 of the determination operation for the window H, the index I is incremented by 1 so that I = 9. Since I = 9 exceeds the number of displayed windows 8 (step S706), it is determined that all windows have been determined to be included in the faulty display 4, and the extraction process in the window extraction unit 12 is performed. Ends.

<Window rearrangement>
FIG. 8 shows a list of windows (rearrangement window list) displayed on the failure display extracted by the window extraction means 12. The rearrangement window list has a configuration in which the window information of the window extracted by the window extraction unit 12 is extracted from the window information table shown in FIG. Here, as shown in FIG. 7, the display 4 has failed, and the window F, the window G, and the window H are displayed on the display 4. Therefore, the window information of these windows is displayed in the rearrangement window list. Has been.

  FIG. 9 is a flowchart of window rearrangement processing performed by the window rearrangement unit 13. The window rearrangement unit 13 displays the rearrangement window list on the normal displays 1 to 3 based on the window information stored in the rearrangement window list (step S901).

  FIG. 10 shows a rearrangement window list displayed based on the rearrangement window shown in FIG. In the rearrangement window list in FIG. 10, a button 30 for selecting the window F, a button 31 for selecting the window G, and a button 32 for selecting the window H are displayed.

  Returning to FIG. 9, the user selects a window to be rearranged from the rearrangement window list with the mouse or the keyboard (step S902). For example, if the window F is selected, the window F is displayed on the display 1 having the youngest display number among the normal displays 1 to 3 (step S903). When the window F overlaps with another window on the display 1, the size of the window F is changed or moved to another display according to a user instruction.

  Then, the window F is deleted from the rearrangement window list (step S904), and it is determined whether the rearrangement window list is empty (step S905). Since window G and window H still remain in the rearrangement window list, the process returns to step S901 to display the rearrangement window list. Here, a button for selecting the window G and a button for selecting the window H are displayed in the rearrangement window list.

  Hereinafter, processing similar to that of the window F is performed for the window G and the window H in response to the user's selection. That is, steps S901 to S905 are repeated until the rearrangement window list becomes empty, and the windows G and H are rearranged on the normal displays 1 to 3.

  The multi-display 5 after the rearrangement is shown in FIG. In FIG. 11, the window F and the window G are rearranged on the display 1 without changing the size. Although the window H is rearranged once on the display 1, it overlaps with other windows on the display 1, and thus is moved to any other normal display by a user operation. In FIG. 11, it has moved to the display 3. Furthermore, the display 3 is appropriately sized and arranged by a user operation so as not to overlap the window D and the window E.

<Effect>
The multi-display system of the present invention has the following effects. That is, the multi-display system of the present invention includes a multi-display 5 configured as an integral screen by a plurality of displays 1 to 4 arranged in a grid, and a multi-screen display computer 6 that outputs video to the multi-display 5. The multi-screen display computer 6 acquires the states of the displays 1 to 4 and determines whether or not there is a failure, and a window displayed on the display that is determined to be a failure by the failure detection unit 9. And a window rearranging unit 13 for rearranging a window selected by the user from the list in the normal display without setting a display pattern at the time of failure. The information displayed on the malfunctioning display can be prevented from being lost.

  In the multi-display system of the present invention, the multi-screen display computer 6 displays screen layout information management means 10 for managing screen layout information including the positions and sizes of the displays 1 to 4 and displays on the displays 1 to 4. Window information management means 11 for managing window information including the position and size of the window to be extracted, and the window displayed on the display 4 determined to be a failure by the failure detection means 9 based on the screen layout information and the window information. Since the window extracting unit 12 is further provided, information displayed on the failed display can be prevented from being lost without previously setting a display pattern at the time of the failure.

  Further, in the multi-display system of the present invention, the window rearrangement means 13 can change the size of the window selected by the user according to the user's instruction and rearrange it. The displayed window can be redisplayed at an appropriate size.

  1-4 display, 5 multi-display, 6 multi-screen display computer, 7 communication relay device, 8 communication means, 9 failure detection means, 10 screen arrangement information management means, 11 window information management means, 12 window extraction means, 13 window re-establishment Arrangement means, 30 window F selection button, 31 window G selection button, 32 window H selection button.

Claims (3)

A multi-display configured as a single screen by a plurality of displays arranged in a lattice pattern;
A multi-screen display computer for outputting video to the multi-display,
The multi-screen display calculator is
Failure detection means for acquiring the state of each display and determining whether or not there is a failure;
Window rearrangement means for displaying a list of windows displayed on the display determined to be faulty by the fault detection means on the normal display, and rearranging a window selected by the user from the list in the normal display With
Multi display system. The multi-screen display calculator is
Screen layout information management means for managing screen layout information including the position and size of each display;
Window information management means for managing window information including the position and size of the window displayed on each display;
Based on the screen arrangement information and the window information, further comprising a window extraction means for extracting a window displayed on the display that has been determined to be a failure by the failure detection means,
The multi-display system according to claim 1. The window rearrangement unit can rearrange the window selected by the user after changing the size according to the user's instruction.
The multi-display system according to claim 1 or 2.

Images