JP6731792B2 - Multi display system - Google Patents

Description

The present invention relates to multi-display systems.

A plurality of displays included in the multi-display are arranged so as to form one display screen. For example, the plurality of displays included in the multi-display are arranged in a grid pattern. The multi-display is widely used as a video display device used for supervisory control in infrastructure fields such as electric power, traffic, and plants.

In a multi-display system including a multi-display, processing such as changing the arrangement of displayed video windows and turning on/off the power of the display is often executed regularly according to a schedule. On the other hand, in an emergency, since the user operates the video windows to change the layout of the video windows, the layout of the video windows will be changed according to the schedule, and the display will be turned off and turned on according to the schedule. It is not desired that the video window displayed on the display that is turned off becomes invisible.

In the technology described in Patent Document 1, when the generated alarm is an alarm for which automatic display prohibition is designated, information regarding the alarm is preferentially displayed, and automatic display of related screens thereafter is prohibited (paragraph 0029). ).

In the technique described in Patent Document 2, the content is reproduced according to the reproduction schedule information, but while the user is touching the summary information of the content is displayed (paragraphs 0041 and 0093).

JP-A-8-305985 JP, 2009-295012, A

As described above, in the multi-display system, the processing is executed according to the schedule, so that the continuous display of the operated video window on the multi-display is obstructed, and the monitoring of the operated video window can be continued. It may disappear. This problem also occurs when the operated object is a display object other than the video window.

This problem is solved by the user manually disabling the schedule function that executes the process according to the schedule. However, in the actually operated multi-display system, there is a possibility that a plurality of users are using the multi-display system, and it is difficult to judge whether or not to disable the scheduling function.

The present invention is made to solve this problem. The problem to be solved by the present invention is to make it possible to continue monitoring the display object being operated regardless of the schedule.

A plurality of displays included in the multi-display are arranged so as to form one display screen. At least one display object is displayed on the multi-display.

The operation for each of the at least one display object is accepted, and the elapsed time from the end of the operation for each of the at least one display object is measured.

Times and processes to be executed at the times are registered in the schedule. The process registered in the schedule is executed according to the schedule at the time registered in the schedule, but the operation target that is the display object whose elapsed time is within the standard is included in at least one display object, and When the inhibition process that inhibits the continuous display on the display is included in the processes registered in the schedule, the inhibition process is not executed at the time registered in the schedule. The arrangement of each of the at least one arrangement restoration is stored.
The time and the processing to be executed at that time are to read each arrangement of at least one arrangement restoration and perform multi-display on each of the at least one arrangement restoration so that each arrangement of the at least one arrangement restoration is restored. This is the restoration process displayed in.
The obstruction process is a process of displaying on the multi-display a placement restoration object included in at least one placement restoration object and overlapping the front surface of the operated object by the restoration process so that the placement of the placement restoration object is restored. Alternatively, the inhibition process is a process of displaying the operated object on the multi-display so that the arrangement of the operated object is restored when at least one arrangement restored object includes the operated object.

If the elapsed time from the end of the operation on the display object is shorter than the reference, the continuous display of the display object on the multi-display is not hindered by the execution of the process registered in the schedule. For this reason, it is possible to continue monitoring the displayed object regardless of the schedule.

It is a block diagram which shows the multi display system of Embodiments 1, 2, and 3. 3 is a schematic diagram showing a GUI screen in the first embodiment. FIG. FIG. 6 is a schematic diagram showing the arrangement of video windows immediately before a restoration process or a control process is executed in the first embodiment. FIG. 6 is a schematic diagram showing a layout of video windows immediately before a restoration process is executed and a layout of video windows immediately after a restoration process is executed according to a schedule in the first embodiment. FIG. 7 is a timing chart showing a timing of ending an operation on a video window and a timing of executing a restoration process in the first embodiment. 6 is a flowchart showing a flow of restoration processing in the first embodiment. FIG. 7 is a timing chart showing a timing of ending an operation on a video window and a timing of executing a control process in the first embodiment. 6 is a flowchart showing a flow of control processing in the first embodiment. FIG. 9 is a schematic diagram showing an arrangement of video windows immediately before a restoration process is executed in the second embodiment. FIG. 9 is a schematic diagram showing a layout of video windows immediately before a restoration process is executed and a layout of video windows immediately after a restoration process is executed according to a schedule in the second embodiment. FIG. 16 is a schematic diagram showing the arrangement of video windows immediately after the restoration processing according to the second embodiment is executed. FIG. 16 is a timing diagram showing the timing of ending the operation on the video window and the timing of executing the restoration process in the second embodiment. 9 is a flowchart showing a flow of restoration processing in the second embodiment. It is a schematic diagram which shows arrangement.

Embodiment 1
1.1 Multi-Display System FIG. 1 is a block diagram showing the multi-display system according to the first embodiment.

The multi-display system 1000 shown in FIG. 1 includes a multi-display 1021, a video display processing device 1022 and an operating device 1023. The multi-display comprises displays 1041, 1042, 1043 and 1044.

The video display processing device 1022 transmits a video signal group to the multi display 1021. The multi display 1021 displays an image represented by the received image signal group. As a result, the video display processing device 1022 displays the video on the multi-display 1021.

The video display processing device 1022 is composed of a computer. An operating system (OS) and an application such as a memo pad are installed in the video display processing device 1022. The video display processing device 1022 displays the desktop on the multi-display 1021 by executing the OS, and displays the video windows 1061 and 1062 on the multi-display 1021 by executing the application. The desktop and video windows 1061 and 1062 make up the video displayed on the multi-display 1021. The display of the desktop may be omitted. Instead of the two video windows 1061 and 1062, one video window or three or more video windows may be displayed.

The desktop is displayed on the entire surface of the multi-display 1021 and is displayed on the bottom surface. Each of the video windows 1061 and 1062 is displayed on at least one display selected from the displays 1041, 1042, 1043 and 1044. Since the desktop is displayed on the entire surface of the multi-display 1021, the video window 1061 appears to the user to be displayed across the displays 1041 and 1043.

The operation device 1023 is configured by a computer different from the computer configuring the video display processing device 1022. A GUI program is installed in the operation device 1023. The operation device 1023 displays the GUI screen by executing the GUI program. The user operates each of the video windows 1061 and 1062 while referring to the displayed GUI screen. Operation device 1023 receives an operation on each of video windows 1061 and 1062. The video display processing device 1022 controls each of the video windows 1061 and 1062 according to the received operation.

1.2 Multi-Display The displays 1041, 1042, 1043 and 1044 are arranged in a grid. This constitutes one display screen. The displays 1041, 1042, 1043 and 1044 may be arranged by another arrangement method. For example, the displays 1041, 1042, 1043 and 1044 may be arranged linearly in the horizontal direction. The four displays 1041, 1042, 1043 and 1044 may be replaced by three or less or five or more displays.

1.3 Video Display Processing Device The video display processing device 1022 includes a video output unit 1081, a video window control unit 1082, a memory 1083, a communication unit 1084, a display control unit 1085, a schedule execution unit 1086, and a time management unit 1087.

Each of the video window control unit 1082, the display control unit 1085, the schedule execution unit 1086, and the time management unit 1087 is realized by the computer executing the program. Each of the video window control unit 1082, the display control unit 1085, the schedule execution unit 1086, and the time management unit 1087 may be realized by hardware that does not execute a program.

The video output unit 1081 is composed of a multi-screen graphic board incorporated in a computer forming the video display processing device 1022 or a graphic circuit standardly mounted in the computer. The video output unit 1081 generates first to fourth video signals that respectively represent the videos displayed on the displays 1041, 1042, 1043, and 1044 in accordance with the given drawing command. The first to fourth video signals form a video signal group transmitted by the video display processing device 1022.

The video output unit 1081 is configured so that first to fourth digital visual interface (DVI) cables for respectively transmitting the first to fourth video signals can be connected. The first to fourth video signals are wire-transmitted to the displays 1041, 1042, 1043, and 1044 via the first to fourth DVI cables, respectively. Each of the first to fourth DVI cables may be replaced with another type of video cable. Each of the first to fourth video signals may be wirelessly transmitted.

The video window control unit 1082 gives a drawing command to the video output unit 1081 to control each video window which is each of the video windows 1061 and 1062. The control of each video window performed by the video window control unit 1082 includes creation of each video window upon activation of an application, change of position of each created video window, change of size of each created video window, and creation of each video window. This includes deleting the video window.

The memory 1083 stores the arrangement of each of the video windows 1061 and 1062. The storage unit including the memory 1083 may be replaced with another type of storage unit. For example, the storage unit including the memory 1083 may be replaced with a storage unit including a hard disk drive.

The display control unit 1085 generates first to fourth control signals expressing the control contents of the displays 1041, 1042, 1043 and 1044, respectively. The first to fourth generated control signals are transmitted to the displays 1041, 1042, 1043 and 1044 by the communication unit 1084. As a result, the display control unit 1085 controls each of the displays 1041, 1042, 1043, and 1044. The control of each display performed by the display control unit 1085 includes turning on or off the power of each display, setting the brightness of each display, setting the speed of the fan provided in each display, and the like.

The communication unit 1084 is a general-purpose communication interface that performs communication according to RS-232C or a general-purpose communication interface that performs communication via a network constructed according to Ethernet (registered trademark). The communication unit 1084 communicates with each of the displays 1041, 1042, 1043 and 1044, and communicates with the communication unit 1101 included in the operation device 1023.

The schedule execution unit 1086 can cause the video window control unit 1082 or the display control unit 1085 to execute the process at the time according to the time and the schedule in which the process to be executed at the time is registered. The video window control unit 1082 and the display control unit 1085 configure a process execution unit 1088 that executes a process related to the multi-display 1021. The video window control unit 1082 is responsible for controlling each of the video windows 1061 and 1062. The display control unit 1085 is responsible for processing to control each of the displays 1041, 1042, 1043 and 1044. The timing for executing the process registered in the schedule is managed by the time management unit 1087.

However, the schedule execution unit 1086 includes a video window in which the elapsed time is within 3 minutes from the end of the operation and is included in the video windows 1061 and 1062, and an elapsed time is within 3 minutes from the end of the operation. When the condition that the inhibition process that inhibits the continuous display of the window on the multi-display 1021 is included in the process registered in the schedule is satisfied at the time registered in the schedule, the inhibition execution process is executed at the time in question. Don't let me do it. The standard of 3 minutes may be replaced with another standard. The continuous display of the video window means continuing the display of the video window without substantially changing the position and size of the video window.

The time management unit 1087 acquires time information used inside the video display processing apparatus 1022, and manages the timing at which the schedule execution unit 1086 causes the process execution unit 1088 to execute the process registered in the schedule. Further, the time management unit 1087 constitutes a measurement unit that measures the elapsed time after the operation on each of the video windows 1061 and 1062 is completed.

1.4 Operating Device The operating device 1023 includes a communication unit 1101, a graphical user interface (GUI) unit 1102, and an input device 1103.

The GUI unit 1102 is realized by the computer executing a GUI program. The GUI unit 1102 may be realized by hardware that does not execute the program.

The communication unit 1101 is a general-purpose communication interface that performs communication according to RS-232C or a general-purpose communication interface that performs communication via a network constructed according to Ethernet (registered trademark). The communication unit 1101 communicates with the communication unit 1084 included in the video display processing device 1022.

The GUI unit 1102 displays a GUI screen.

The input device 1103 includes a keyboard, a mouse, and the like, and constitutes a reception unit that receives an operation performed by a user. The operation performed by the user includes an operation on each video window which is each of the video windows 1061 and 1062. The user can operate each video window by operating the input device 1103 while referring to the GUI screen.

An input device such as a touch panel provided in the video display processing device 1022 may receive an operation performed by the user.

1.5 Coordinate System The video window control unit 1082 uses one coordinate system common to the displays 1041, 1042, 1043 and 1044 in order to control each of the video windows 1061 and 1062. In the coordinate system, the horizontal coordinate value of each pixel is an integer value, and the difference between the horizontal coordinate value of one pixel and the horizontal coordinate value of another pixel horizontally adjacent to the one pixel. Becomes 1, the vertical coordinate value of each pixel becomes an integer value, and the difference between the vertical coordinate value of one pixel and the vertical coordinate value of another pixel vertically adjacent to the one pixel. Is defined to be 1. The coordinate system may be replaced with another coordinate system. For example, when a video divider is installed between each of the displays 1041, 1042, 1043 and 1044 and the video display processing device 1022, the horizontal coordinate value of one pixel and the horizontal direction of the one pixel. The difference between the horizontal coordinate value of another adjacent pixel changes according to the division ratio of the video divider, and the vertical coordinate value of one pixel and the vertical adjacent pixel value of the other pixel. The difference between the pixel and the horizontal coordinate value of the pixel changes according to the division ratio of the video divider.

If each of the displays 1041, 1042, 1043 and 1044 has a screen resolution of 1920 pixels in the vertical direction×1080 pixels in the horizontal direction, and the displays 1041, 1042, 1043 and 1044 are arranged without a gap in the coordinate plane defined by the defined coordinate system, , The display 1041, the display 1042, the display 1043, the display 1044, and the multi-display 1021 have start point coordinates, end point coordinates, and screen resolutions as shown in Table 1. The starting point coordinates are the coordinates of the pixel arranged at the upper left end. The end point coordinates are the coordinates of the pixel arranged at the lower right corner.

Further, each of the displays 1041, 1042, 1043 and 1044 has a screen resolution of 1920 pixels in the vertical direction×1080 pixels in the horizontal direction, and the displays 1041, 1042, 1043 and 1044 are arranged without any space on a coordinate plane defined by a defined coordinate system. In this case, the starting point coordinates, the ending point coordinates, and the sizes of the video windows 1061 and 1062 are as shown in Table 2.

1.6 Restoration Process The video window control unit 1082 displays the coordinates of each video window including the start point coordinates, the end point coordinates, and the size of each video window while each of the video windows 1061 and 1062 is displayed. Layout information can be stored in the memory 1083. Further, the video window control unit 1082 reads the coordinate layout information of each video window stored in the memory 1083 and sets each video window so that the arrangement of each video window specified by the read coordinate layout information is restored. Restoration processing for displaying on the multi-display 1021 can be performed. As a result, even if control is performed on each video window such as changing the position of each video window or changing the size of each video window, the placement of each video window specified by the coordinate layout information is restored. Restored by.

1.7 GUI screen FIG. 2 is a schematic diagram showing a GUI screen.

The GUI screen 1121 shown in FIG. 2 is displayed by the GUI unit 1102 and includes a multi-display view 1141, a video window list 1142, a coordinate layout registration button 1143, and a schedule registration button 1144. A mouse pointer 1161 is displayed on the GUI screen 1121 in an overlapping manner.

A virtual multi-display 1181 is virtually displayed in the multi-display view 1141. Virtual multi-display 1181 includes virtual displays 1201, 1202, 1203 and 1204. Virtual video windows 1221 and 1222 are also virtually displayed in the multi-display view 1141.

The virtual multi-display 1181, the virtual video window 1221 and the virtual video window 1222 have external shapes close to those obtained by reducing the external shapes of the multi-display 1021, video window 1061 and video window 1062, respectively. And the video window 1062, respectively. Virtual displays 1201, 1202, 1203 and 1204 have outer shapes that are close to the outer shapes of displays 1041, 1042, 1043 and 1044, respectively, and correspond to displays 1041, 1042, 1043 and 1044, respectively. Each of the virtual video windows 1221 and 1222 has a rectangular shape.

1.8 Operation on Video Window The user operates the input device 1103 with a mouse while referring to the virtual video windows 1221 and 1222 virtually displayed in the multi-display view 1141, thereby operating the video windows 1061 and 1062. Each operation can be performed. The position where the operation is performed is indicated by the mouse pointer 1161.

The GUI unit 1102 generates an operation signal expressing the content of the operation on the video windows 1061 and 1062. The generated operation signal is transmitted to the video window control unit 1082 by the communication units 1101 and 1084. The contents of the operation include information specifying the operated video window, information indicating the contents of changing the position of the operated video window, information indicating the contents of changing the size of the operated video window, and the like. In transmitting the operation signal, the reduction ratio of the virtual video windows 1221 and 1222 to the video windows 1061 and 1062 is calculated, and the coordinates in the multi-display view 1141 are converted into the coordinates in the multi-display 1021. The video window control unit 1082 controls each video window, which is each of the video windows 1061 and 1062, according to the received operation signal. Accordingly, the video window control unit 1082 controls each video window according to the operation for each video window.

The video window control unit 1082 may control each video window according to the numerical value input operation performed by the user on the input device 1103.

1.9 Example of Execution of Restoration Process and Control Process Registered in Schedule 1.9.1 Schedule An example of execution of restoration process and control process registered in the schedule will be described below.

In the example described below, the schedule execution unit 1086 causes the process execution unit 1088 to execute the process registered in the schedule according to the schedule shown in Table 3 at the time registered in the schedule.

The schedule shown in Table 3 is registered with the time "2016/02/20 15:00:00" and the restoration process "Restore the arrangement of the video windows 1061 and 1062." The control process of "Turning off the power of the displays 1043 and 1044." is registered at the time of "2016/02/20 17:00:00" and at that time.

In the restoration process, the arrangement of each of the video windows 1061 and 1062 specified by the coordinate layout information shown in Table 2 is restored. Instead of the two video windows 1061 and 1062, the arrangement of each of one or three or more video windows may be restored.

In the control process, each of the displays 1043 and 1044 is powered off. Instead of the two displays 1043 and 1044, each of one or more displays may be powered off.

1.9.2 Execution of Restoration Process FIG. 3 is a schematic diagram showing the arrangement of video windows immediately before the restoration process is executed. FIG. 4 is a schematic diagram showing the arrangement of the video windows immediately before the restoration processing is executed and the arrangement of the video windows immediately after the restoration processing is executed according to the schedule. FIG. 5 is a timing diagram showing the timing of ending the operation on the video window and executing the restoration process.

The video window control unit 1082 creates video windows 1063 and 1064, and displays the created video windows 1063 and 1064 on the multi-display 1021. Further, the video window control unit 1082 controls each of the created video windows 1063 and 1064 according to the operation performed by the user. As a result, the video windows 1063 and 1064 shown in FIGS. 3 and 4 are displayed on the multi-display 1021. The starting point coordinates, the ending point coordinates, and the sizes of the video windows 1063 and 1064 are as shown in Table 4.

The time management unit 1087 measures the elapsed time after the operation on each of the video windows 1063 and 1064 is completed.

The schedule execution unit 1086 performs a restoration process of "restoring the arrangement of the video windows 1061 and 1062" registered in the schedule at the time of "2016/02/20 15:00:00" registered in the schedule. The control unit 1082 is made to execute. The video window control unit 1082 reads the arrangement of each of the video windows 1061 and 1062 from the memory 1083 according to the instruction of the schedule execution unit 1086, and restores the arrangement of each of the video windows 1061 and 1062. Each of 1062 is displayed on the multi-display 1021. As a result, the video windows 1061 and 1062 shown in FIG. 4 are displayed on the multi-display 1021.

However, the schedule execution unit 1086 enables the visual confirmation of the video window whose elapsed time is within 3 minutes to continue even when the restoration processing registered in the schedule is executed at the time registered in the schedule.

For example, as shown in FIG. 5, when the operation on the video window 1064 ends at 14:56 on February 20, 2016 and the operation on the video window 1063 ends at 14:58 on February 20, 2016, At 15:00 on February 20, 2016 when the restoration process is executed, the elapsed time from the end of the operation on the video window 1064 is not less than 3 minutes, but the elapsed time from the end of the operation on the video window 1063 is Within 3 minutes. Therefore, the schedule execution unit 1086 enables the visual confirmation of the video window 1063 to continue even when the restoration process registered in the schedule is executed. Therefore, the schedule execution unit 1086 prevents the video window 1061 overlapping the front of the video window 1063 from being displayed on the multi display 1021 by the restoration process.

FIG. 6 is a flowchart showing the flow of restoration processing.

In step S101 shown in FIG. 6, it is determined whether or not there is a video window operated within 3 minutes from the time registered in the schedule. If it is determined that there is a video window operated within 3 minutes from the time registered in the schedule, the process proceeds to step S102. If it is determined that there is no video window operated within 3 minutes from the time registered in the schedule, the process proceeds to step S104.

In step S102, video windows that overlap the video windows operated within 3 minutes from the time registered in the schedule are listed among the video windows 1061 and 1062 whose arrangement is restored.

The timing of ending the operation and executing the restoration process for each of the video windows 1063 and 1064 is shown in FIG. 5, and the restoration is performed according to the arrangement and schedule of each of the video windows 1063 and 1064 immediately before the restoration process is executed. When the arrangement of each of the video windows 1061 and 1062 immediately after the processing is executed is as shown in FIG. 4, the operated video window and the arrangement are restored within 3 minutes from the time registered in the schedule. Table 5 shows a video window and a video window included in the video window whose arrangement is restored and overlapping with a video window operated within 3 minutes from the time registered in the schedule.

Whether the arrangement that is each of the video windows 1061 and 1062 overlaps with the second video window that is each of the video windows 1063 and 1064 depends on the coordinates of the first video window shown in Table 2. It is determined whether or not the range specified by the layout information overlaps the range specified by the coordinate layout information of the second video window shown in Table 4.

In step S103 following step S102, restoration processing is executed except for the video windows listed in step S102. When the listed video window is the video window 1061, the video window 1061 is not displayed and the video window 1062 is displayed so that the arrangement of the video window 1062 is restored. The action for the video window 1064 is optional.

In step S104, the restoration process is executed according to the schedule. As a result, each of the video windows 1061 and 1062 is displayed so that the arrangement of each of the video windows 1061 and 1062 is restored.

According to the restoration processing of the first embodiment, the multi-display 1021 is configured to restore the arrangement of the video window 1061 included in the video windows 1061 and 1062 whose arrangement is restored and overlapping the front of the video window 1063 by the restoration processing. The display processing is not executed, and the obstruction processing that obstructs the continuous display of the video window 1063 on the multi-display 1021 is not executed. Therefore, even if the restoration process registered in the schedule is executed at the time registered in the schedule, the video window 1063 operated within 3 minutes from the time is continuously displayed on the multi-display 1021, and the video window 1063 is displayed. Monitoring can be continued.

When the restoration process of the first embodiment is not executed, when the user operates the video window in an emergency, the restoration process registered in the schedule created for normal time is executed and the user operates it. A new video window may be displayed in front of the video window. For this reason, it may not be possible to continuously view all or part of the video window operated by the user. On the other hand, when the restoration process according to the first embodiment is executed, the arrangement is restored in the video window when the restoration process registered in the schedule created for normal time is executed. Since the video window overlapping the video window operated by the user is not displayed, the video window operated by the user can be continuously viewed.

When the video windows 1063 and 1064 include the video window 1063 operated within 3 minutes from the time registered in the schedule and the restoration process includes the obstruction process of displaying the video window 1061 overlapping with the video window 1063, the schedule execution unit 1086. May cause the video window control unit 1082 to execute a process of displaying the video window 1061 on the back side of the video window 1063. Accordingly, when the video window 1061 is larger than the video window 1063, a part of the video window 1061 can be visually recognized. Further, when it takes a long time to display an image on the image window 1061, it becomes possible to prepare to display an image on the image window 1061 on the back side of the image window 1063.

In addition, when the video windows 1063 and 1064 include the video window 1063 operated within 3 minutes from the time registered in the schedule and the restoration process includes the obstruction process of displaying the video window 1061 overlapping with the video window 1063, the schedule is executed. The unit 1086 may cause the video window control unit 1082 to execute a process of moving and displaying the video window 1061 so as not to overlap the video windows 1063 and 1064, so that the video window 1061 does not overlap the video windows 1063 and 1064. The video window control unit 1082 may be caused to execute the processing of moving to and displaying the reduced image. As a result, the entire video window 1061 can be visually recognized.

Further, when the video windows 1063 and 1064 include the video window 1063 operated within 3 minutes from the time registered in the schedule and the restoration process includes the obstruction process of displaying the video window 1061 overlapping with the video window 1063, the input device The schedule execution unit 1086 may cause the video window control unit 1082 to execute the inhibition process after the permission of execution of the inhibition process is received by the input device 1103. Thereby, the video window 1061 can be visually recognized at an appropriate timing.

In addition, when the video windows 1063 and 1064 include the video window 1063 operated within 3 minutes from the time registered in the schedule and the restoration process includes the obstruction process of displaying the video window 1061 overlapping with the video window 1063, the schedule is executed. The obstruction process may be executed by the video window control unit 1082 after a time when the unit 1086 is registered in the schedule. Thereby, the video window 1061 can be visually recognized without forgetting.

Video that overlaps with the video window operated within 3 minutes from the time registered in the schedule, instead of not displaying the video window that overlaps with the video window operated within 3 minutes from the time registered in the schedule It may be possible not to display the restored objects other than the window, and to prevent the display of a video window that overlaps the operated object other than the video window operated within 3 minutes from the time registered in the schedule. It may be done. The object to be operated is a display object displayed on the multi-display 1021 and has been operated within 3 minutes from the time registered in the schedule. The range is where the input is made, the range where the control for changing the brightness is made, and the like.

Instead of not always displaying a video window that overlaps with a video window operated within 3 minutes from the time registered in the schedule, it overlaps with a video window operated within 3 minutes from the time registered in the schedule. It may be set whether or not the video window is not displayed. For example, whether or not a video window that overlaps a video window operated within 3 minutes from the time registered in the schedule is not displayed may be set for each video window layout or each display. The operation range of each user may be set in units of coordinate planes or display units, and only the operation range may be prevented from displaying a video window overlapping with a video window operated within 3 minutes from the time registered in the schedule.

When the displays included in the displays 1041, 1042, 1043 and 1044 display the video windows operated within 3 minutes from the time registered in the schedule, the schedule execution unit 1086 includes the video windows 1061 and 1062. The restoration processing may prevent the video window control unit 1082 from executing the processing of displaying the video window displayed on the display on the display at the time registered in the schedule. As a result, since the video window whose layout is restored is not displayed on the display that displays the video window operated within 3 minutes from the time registered in the schedule, the operation was performed within 3 minutes from the time registered in the schedule. The visibility of the video window is improved.

1.9.3 Control Process FIG. 3 is also a schematic diagram showing the arrangement of video windows immediately before the control process is executed. FIG. 7 is a timing chart showing the timing of ending the operation on the video window and executing the control process.

The video window control unit 1082 creates video windows 1063 and 1064, and displays the created video windows 1063 and 1064 on the multi-display 1021. Further, the video window control unit 1082 controls each of the created video windows 1063 and 1064 according to the operation performed by the user. As a result, the video windows 1063 and 1064 shown in FIG. 3 are displayed on the multi display 1021. The starting point coordinates, the ending point coordinates, and the sizes of the video windows 1063 and 1064 are as shown in Table 4.

The time management unit 1087 measures the elapsed time after the operation on each of the video windows 1063 and 1064 is completed.

The schedule execution unit 1086 performs display control on the control process “Turn off the power of the displays 1043 and 1044” registered in the schedule at the time “2016/02/20 17:00:00” registered in the schedule. Causes the unit 1085 to execute. The display control unit 1085 turns off the power of each of the displays 1043 and 1044 in accordance with the instruction of the schedule execution unit 1086. Instead of the two displays 1043 and 1044, each of one or more displays may be powered off.

However, the schedule execution unit 1086 enables the visual confirmation of the video window whose elapsed time is shorter than 3 minutes to be continued even when the control processing registered in the schedule is executed at the time registered in the schedule.

For example, as shown in FIG. 7, when the operation on the video window 1064 ends at 16:57:30 on February 20, 2016 and the operation on the video window 1063 ends at 16:58 on February 20, 2016. Indicates that the elapsed time after the operation on the video window 1064 is completed is 3 minutes or less at 17:00 on February 20, 2016 when the control processing is executed, and the progress after the operation on the video window 1063 is completed. The time is within 3 minutes. Therefore, the schedule execution unit 1086 enables the visual confirmation of each of the video windows 1063 and 1064 even when the control process registered in the schedule is executed. Therefore, the schedule execution unit 1086 prevents the display 1044 displaying the video window 1064 from being powered off.

FIG. 8 is a flowchart showing the flow of control processing.

In step S111 shown in FIG. 8, it is determined whether or not there is a video window operated within 3 minutes from the time registered in the schedule. If it is determined that there is a video window operated within 3 minutes from the time registered in the schedule, the process proceeds to step S112. If it is determined that there is no video window operated within 3 minutes from the time registered in the schedule, the process proceeds to step S114.

In step S112, the displays displaying the video windows operated within 3 minutes from the time registered in the schedule are listed among the displays 1043 and 1044 whose power is turned off.

The timing of ending the operation and executing the control process for each of the video windows 1063 and 1064 is shown in FIG. 7, and the arrangement of each of the video windows 1063 and 1064 immediately before the control process is executed is shown in FIG. If it is, the video window operated within 3 minutes from the time registered in the schedule, the display that displays the video window operated within 3 minutes from the time registered in the schedule, the power supply by the control process. Table 6 shows the display that is turned off and the display that displays the video window operated within 3 minutes from the time registered in the schedule and that is also the display that is powered off by the control process. Like

Whether or not each of the displays 1041, 1042, 1043 and 1044 is displaying each of the video windows of each of the video windows 1063 and 1064 is specified by the coordinate layout information of each display shown in Table 1. It is determined whether or not the range to be overlapped with the range specified by the coordinate layout information of each video window shown in Table 4.

In step S113 subsequent to step S112, control processing is performed except for the displays listed in step S112. If the display listed is display 1044, then display 1043 is powered off and display 1044 is not powered off.

In step S114, the control process is executed according to the schedule. This turns off the power of each of the displays 1043 and 1044.

According to such control processing, the processing of turning off the power of the display 1044 included in the displays 1043 and 1044 and displaying the video window 1064 is not executed, and the continuous display of the video windows 1063 and 1064 on the multi-display 1021 is performed. Blocking Blocking is not executed. Therefore, even if the control processing registered in the schedule is executed at the time registered in the schedule, the display of the video windows 1063 and 1064 operated within 3 minutes from the time is continued to be displayed on the multi-display 1021, and the video window is displayed. Monitoring of 1063 and 1064 can continue.

For example, in the regular shift monitoring work, the power-off of each of at least one display included in the displays 1041, 1042, 1043 and 1044 or the decrease of the brightness of each of the at least one display is registered for power saving. A schedule may be created. There may be cases where the power is turned off or the brightness is reduced more than once a day in the schedule. In the case where the control process of the first embodiment is performed, even if the control process registered in the schedule is executed, the power of the display that is overlapped with the video window operated by the user on the coordinate plane is controlled. Since it is not turned off, the video window operated by the user can be continuously viewed.

In the case where the video windows 1063 and 1064 include the video windows 1063 and 1064 operated within 3 minutes from the time registered in the schedule, and the control processing includes the inhibition processing for turning off the power of the display 1044 displaying the video window 1064. The input device 1103 may receive permission to execute the inhibition process, and the schedule execution unit 1086 may cause the display control unit 1085 to execute the inhibition process after the permission is received by the input device 1103. As a result, the power of the display 1044 can be turned off at an appropriate timing.

In addition, the video windows 1063 and 1064 include the video windows 1063 and 1064 operated within 3 minutes from the time registered in the schedule, and the control processing includes the inhibition processing for turning off the power of the display 1044 displaying the video window 1064. In this case, the schedule execution unit 1086 may cause the display control unit 1085 to execute the obstruction process after the time registered in the schedule. This allows the display 1044 to be powered off without forgetting.

Video that has been operated within 3 minutes from the time registered in the schedule Instead of not always turning off the power of the display, the video operated within 3 minutes from the time registered in the schedule It may be set whether or not the power of the video window displaying the window is not turned off. For example, whether to turn off the power of the display that displays the video window operated within 3 minutes from the time registered in the schedule may be set for each layout of the video window or for each display. The operation range of each user is set in units of coordinate planes or display units, and the display of the video window operated within 3 minutes from the time registered in the schedule is not turned off only in the operation range. Good.

1.10 Modified Example Instead of transmitting the video signal group from one video display processing device 1022 to the multi display 1021, it is possible to transmit the video signal group from two or more video display processing devices to the multi display 1021. May be done. When a video signal group is transmitted from two or more video display processing devices to the multi display 1021, a coordinate system defined by two or more desktops that the two or more video display processing devices respectively display on the multi display 1021. Alternatively, a system that uniformly manages the coordinate plane defined by the coordinate system is adopted.

By transmitting a video signal group from the video display processing device 1022 to the multi display 1021, the video display processing device 1022 may generate a video signal inside the multi display 1021 instead of displaying the video on the multi display 1021. Alternatively, a processor other than the video display processing apparatus 1022 and the multi-display 1021 may transmit a video signal group to the multi-display 1021, thereby causing the processor or the like to display a video on the multi-display 1021. Good. Even when a video signal is generated inside the multi-display 1021, or when a video signal group is transmitted to the multi-display 1021 from a processor other than the video display processing device 1022 and the multi-display 1021, the video display processing device 1022 is It is possible to determine whether the range specified by the coordinate layout information of the video window overlaps the range specified by the coordinate layout information of another video window, and the range specified by the coordinate layout information of the video window is the coordinate layout of the display. It can be determined whether or not it overlaps with the range specified by the information. This enables the restoration processing and control processing described above.

The input device 1103 accepts the setting as to whether to enable the function that does not cause the process execution unit 1088 to perform the inhibition process at the time registered in the schedule, and the schedule execution unit 1086 inputs the setting to enable the function. It is also permitted to prevent the process execution unit 1088 from executing the inhibition process at the time registered in the schedule when it is accepted by the device 1103. As a result, it is possible to prevent the user's operation from interfering with the execution of the process registered in the schedule during normal operation.

Second Embodiment
FIG. 1 is also a block diagram showing a multi-display system according to the second embodiment.

Hereinafter, an example of executing the restoration processing registered in the schedule will be described. In the restoration process, the video window whose layout is restored includes the video window displayed on the multi-display 1021.

In the example described below, the schedule execution unit 1086 causes the process execution unit 1088 to execute the process registered in the schedule according to the schedule shown in Table 3 at the time registered in the schedule.

The schedule shown in Table 3 is registered with the time “2016/02/20 15:00:00” and the restoration process “to restore the arrangement of the video windows 1061 and 1062” to be executed at that time. There is.

In the restoration process, the arrangement of each of the video windows 1061 and 1062 specified by the coordinate layout information shown in Table 2 is restored.

FIG. 9 is a schematic diagram showing the arrangement of video windows immediately before the restoration processing is executed. FIG. 10 is a schematic diagram showing the arrangement of the video windows immediately before the restoration processing is executed and the arrangement of the video windows immediately after the restoration processing is executed according to the schedule. FIG. 11 is a schematic diagram showing the arrangement of video windows immediately after the restoration processing is executed. FIG. 12 is a timing chart showing the timing of ending the operation on the video window and the timing of executing the restoration process.

The video window control unit 1082 creates video windows 1062 and 1063, and displays the created video windows 1062 and 1063 on the multi-display 1021. The video window control unit 1082 also controls each of the created video windows 1062 and 1063 according to the operation performed by the user. As a result, the video windows 1062 and 1063 shown in FIG. 9 are displayed on the multi-display 1021.

The time management unit 1087 measures the elapsed time after the operation on each of the video windows 1062 and 1063 is completed.

The schedule execution unit 1086 performs a restoration process of "restoring the arrangement of the video windows 1061 and 1062" registered in the schedule at the time of "2016/02/20 15:00:00" registered in the schedule. The control unit 1082 is made to execute. The video window control unit 1082 reads the arrangement of each of the video windows 1061 and 1062 from the memory 1083 and restores the arrangement of each of the video windows 1061 and 1062 in accordance with the instruction of the schedule execution unit 1086. Are displayed on the multi-display 1021. As a result, the video windows 1061 and 1062 shown in FIG. 10 are displayed on the multi display 1021.

However, the schedule execution unit 1086 enables the visual confirmation of the video window whose elapsed time is shorter than 3 minutes to be continued even when the restoration processing registered in the schedule is executed at the time registered in the schedule.

For example, as shown in FIG. 12, when the operation on the video window 1063 ends at 14:56 on February 20, 2016 and the operation on the video window 1062 ends at 14:58 on February 20, 2016, At 15:00 on February 20, 2016 when the restoration process is executed, the elapsed time from the end of the operation on the video window 1063 is not less than 3 minutes, but the elapsed time from the end of the operation on the video window 1062. Is within 3 minutes. Therefore, the schedule execution unit 1086 enables the visual confirmation of the video window 1062 to continue even when the restoration process registered in the schedule is executed. Therefore, the schedule execution unit 1086 prevents the arrangement of the video window 1062 from being restored.

FIG. 13 is a flowchart showing the flow of restoration processing.

In step S201 shown in FIG. 13, it is determined whether or not there is a video window operated within 3 minutes from the time registered in the schedule. If it is determined that there is a video window operated within 3 minutes from the time registered in the schedule, the process proceeds to step S202. If it is determined that there is no video window operated within 3 minutes from the time registered in the schedule, the process proceeds to step S204.

In step S202, it is determined whether the video windows 1061 and 1062 whose arrangement is restored include a video window operated within 3 minutes from the time registered in the schedule. If the video windows 1061 and 1062 whose arrangement is restored include video windows operated within 3 minutes from the time registered in the schedule, the process proceeds to step S203. If the video windows 1061 and 1062 whose arrangement is restored do not include a video window operated within 3 minutes from the time registered in the schedule, the process proceeds to step S204.

When the timing of ending the operation on the video windows 1062 and 1063 and executing the restoration process is as shown in FIG. 12, the video window and the layout operated within 3 minutes from the time registered in the schedule are restored. The video window is shown in Table 7.

In step S203, the restoration process is executed excluding the video window operated within 3 minutes from the time registered in the schedule. As a result, the video window 1061 is displayed so that the arrangement of the video window 1061 is restored, and the video window 1063 is deleted. In the display of the video window 1062, the arrangement specified by the coordinate layout information shown in Table 2 is not restored, and the arrangement immediately before the restoration processing is executed is maintained as shown in FIG.

In step S204, the restoration process is executed according to the schedule. As a result, the arrangement of each of the video windows 1061 and 1062 is restored.

According to the restoration processing of the second embodiment, when the video windows 1061 and 1062 whose layout is restored include the video window 1062 operated within 3 minutes from the time registered in the schedule, the video window 1062 is placed. The process of displaying on the multi display 1021 so as to be restored is not executed, and the inhibiting process of inhibiting the continuous display of the video window 1062 on the multi display 1021 is not executed. Therefore, even if the restoration processing registered in the schedule is executed at the time registered in the schedule, the display of the video window 1062 operated within 3 minutes from the time is continued to be displayed on the multi-display 1021, and the video window 1062 is displayed. Monitoring can continue.

When the restoration process according to the second embodiment is not executed, when the user operates the video window in an emergency, the restoration process registered in the schedule created for normal time is executed, and the arrangement is restored. When the window includes the video window operated by the user, the position, size, etc. of the video window operated by the user are changed to the position, size, etc. indicated by the video layout information. Therefore, the video window operated by the user may be lost. On the other hand, when the restoration process according to the second embodiment is executed, even when the restored video window includes the manipulated video window, the restoration registered in the schedule created for normal time is performed. The position and size of the video window operated by the user are not changed even if the process is executed. Therefore, the video window operated by the user is not lost.

Third Embodiment
FIG. 1 is also a block diagram showing a multi-display system according to the third embodiment.

In the multi-display system of the third embodiment, when the process registered in the schedule is executed within a certain time after the user operates the video window, it means that the time registered in the schedule has passed. Also, when the user permits, the process registered in the schedule is executed.

Therefore, a confirmation message is displayed on the GUI screen at the time registered in the schedule, and when the user gives permission, the process registered in the schedule is executed.

As a result, the process registered in the schedule is not automatically executed at an inappropriate timing, and the process registered in the schedule is executed at an appropriate timing.

It should be noted that, in the present invention, the respective embodiments can be freely combined, or the respective embodiments can be appropriately modified or omitted within the scope of the invention.

1000 multi-display system, 1021 multi-display, 1022 video display processing device, 1023 operating device, 1041, 1042, 1043, 1044 display, 1061, 1062, 1063, 1064 video window, 1082 video window control unit, 1083 memory, 1085 display control Section, 1086 schedule execution section, 1087 time management section, 1088 process execution section, 1103 input device.

Claims (12)

A plurality of displays arranged so that one display screen is configured, and a multi-display for displaying at least one display object,
A receiving unit that receives an operation for each of the at least one display object,
A measuring unit that measures the elapsed time from the end of the operation for each of the at least one display object,
A processing execution unit,
According to the time and the schedule in which the process to be executed at the time is registered, the process executing unit can be caused to execute the process at the time, and the operated object which is a display object whose elapsed time is within the reference is If the condition that the inhibition process that is included in at least one display object and that inhibits the continuous display of the operated object on the multi-display is included at the time, the inhibition process is performed at the time. A schedule execution part that the execution part does not execute,
A storage unit for storing each arrangement of at least one arrangement restoration object ;
Equipped with
The time and the processing to be executed at the time include the at least one placement restoration object being read from the storage unit so that the placement of each of the at least one placement restoration object is restored. It is a restoration process of displaying each of the arrangement restorations on the multi-display,
The obstruction process is a process of displaying a placement restoration object included in the at least one placement restoration object and overlapping the front surface of the operated object by the restoration process on the multi-display so that the placement of the placement restoration object is restored. Is
Multi-display system. The schedule execution unit is included in the at least one placement restoration object and displayed on the display by the restoration process when a display included in the plurality of displays is displaying the operation target object at the time. Do not cause the process execution unit to execute the process of displaying the arrangement restoration on the display at the time.
The multi-display system according to claim 1 . A plurality of displays arranged so that one display screen is configured, and a multi-display for displaying at least one display object,
A receiving unit that receives an operation for each of the at least one display object,
A measuring unit that measures the elapsed time from the end of the operation for each of the at least one display object,
A processing execution unit,
According to the time and the schedule in which the process to be executed at the time is registered, the process executing unit can be caused to execute the process at the time, and the operated object which is a display object whose elapsed time is within the reference is If the condition that the inhibition process that is included in at least one display object and that inhibits the continuous display of the operated object on the multi-display is included at the time, the inhibition process is performed at the time. A schedule execution part that the execution part does not execute,
A storage unit for storing each arrangement of at least one arrangement restoration object ;
Equipped with
The time and the processing to be executed at the time include the at least one placement restoration object being read from the storage unit so that the placement of each of the at least one placement restoration object is restored. It is a restoration process of displaying each of the arrangement restorations on the multi-display,
The obstruction process is a process of displaying the operated object on the multi-display so that the arrangement of the operated object is restored when the at least one arrangement restored object includes the operated object.
Multi-display system. The schedule execution unit causes the process execution unit to execute a process of displaying the restored object on the back surface of the operated object when the condition is satisfied at the time.
The multi-display system according to any one of claims 1 to 3 . When the condition is satisfied at the time, the schedule execution unit causes the process execution unit to execute a process of moving and displaying the arrangement restored object so as not to overlap the at least one display object.
The multi-display system according to any one of claims 1 to 3 . When the condition is satisfied at the time, the schedule executing unit causes the process executing unit to execute a process of moving the arrangement restored object so as not to overlap the at least one display object and reducing the display.
The multi-display system according to any one of claims 1 to 3 . The time and the process to be executed at the time are control processes for controlling each of at least one display included in the plurality of displays,
The multi-display system according to claim 1, wherein the inhibition process is a process of controlling a display included in the at least one display and displaying the operated object. The reception unit receives permission to execute the inhibition process,
The schedule execution unit causes the process execution unit to execute the inhibition process after the permission is received by the reception unit when the condition is satisfied at the time.
A multi-display system according to any of claims 1 to 7 . The schedule execution unit causes the process execution unit to execute the inhibition process after a delay from the time when the condition is satisfied at the time.
A multi-display system according to any of claims 1 to 7 . The accepting unit accepts a setting of whether to enable a function that does not cause the process executing unit to perform the inhibition process at the time,
The schedule execution unit does not cause the process execution unit to execute the inhibition process at the time when the setting for enabling the function is received by the reception unit.
A multi-display system according to any of claims 1-9 . Each of the at least one display object is a video window
A multi-display system according to any of claims 1 to 10 . Each of the at least one placement restoration is a video window
A multi-display system according to any of claims 1 to 6 .

Images