JPH07281853A - Method and device for image display and plant monitor system - Google Patents

Abstract

PURPOSE:To easily display information displayed on a large screen, on a screen at hand and also displays which part other supervisors are monitoring on the large screen. CONSTITUTION:A position detection part 110 detects the eyes of a supervisor and a decision part 104 decides which part of a large screen display part 101 the supervisor indicates from the detected position. An image of the specific position is displayed at a hand screen display part 108 for the supervisor and then even when the large screen is hard to see, a position on it can easily be specified. When the supervisor monitors one part of the large-screen display part 101, the position is displayed with a frame and characters indicating the supervisor and other supervisors are made possible to recognize that. Consequently, a part of the display contents of the large screen can easily be displayed on the screen at hand and the monitoring positions of other supervisors can easily be recognized, so securer and more efficient monitoring is enabled.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display device for displaying a plurality of monitoring images, and more particularly to an image display method and device suitable for a plant monitoring system using a large screen and a hand screen and a plant monitoring system.

[0002]

2. Description of the Related Art Conventionally, in monitoring a plant, a monitor image is displayed on a plurality of screens. For example, the overview display on a large screen and the detail display on a plurality of screens at hand are used together. This is because the plant is becoming larger and more complex year by year, and the supervisor needs to handle a large amount of information, for example, hundreds of screens on the display screen of the control computer. The large screen mainly displays common contents that may be viewed by a plurality of observers, for example, a schematic diagram of the entire plant.
The observer obtains detailed information about the subsystems and constituent devices on his / her own screen of the control computer while looking at the summary display on the large screen placed in front of the plurality of observers.

On the other hand, there has been a problem that the observer cannot interact with the large screen in the same manner as the hand screen. Specifically, the observer can see the system diagram and alarms on the big screen to grasp the situation of the entire plant, and when there is a point of concern, refer to the related detailed information on the screen at hand. There was a problem of taking time. Although the large screen should be able to easily change the display contents compared to the fixed monitor panel from the old days, in reality, it is a display that other observers are watching, so This is because it is difficult to change the display content, and the operation system of the large screen and the operation system of the local screen are not linked.

As a conventional technique for solving such a problem, there is a "plant monitoring device" disclosed in Japanese Patent Laid-Open No. 61-243489. In this device, a large screen configured by arranging a plurality of display devices and a small screen for an operator are provided. In the small screen for an operator, a reduced display of the display contents of the large screen and a part of the screen are scrolled. The screen for enlarged monitoring can be switched and displayed.

Further, in the "screen editor scroll method" disclosed in Japanese Patent Laid-Open No. 5-20014, a large main screen and a small sub-screen are provided, and the sub-screen displays an overall view of the monitored object. A frame that can be moved with the mouse is displayed on it. Then, a screen showing the details in the frame is displayed on the main screen so that the details of the target portion can be easily seen.

Further, in the "image display processing device" disclosed in Japanese Patent Laid-Open No. 4-263314, a stationary display device and a portable display device are provided, and an operation input to one display device is applied to the other display device. The same operation input is also applied to, to improve the operability.

[0007]

In the conventional technology,
The detailed information of the part on the screen at hand is displayed, but the summary information is displayed on the large screen. Therefore, when trying to read the overview of the large screen well, for example, if the large screen and the hand-held screen are arranged at a certain distance or angle, the observer has a large line-of-sight movement angle between the hand-held screen and the large-screen. May be difficult to see, or part of the large screen may be too far away to see well. If you can't see the big screen far away, even if you try to enlarge it or open it in a small window, it is difficult to operate because it is commonly used, and it is not an effective solution. Further, for example, when the large screen and the hand-held screen are arranged close to each other, the large screen may be hidden by the hand-held screen and the observer may not be able to see the large screen in the same posture. Even if you change the handheld screen to a small size so as not to hide a part of the large screen, another problem such as looking into the small screen and moving the viewpoint will occur, so it is an effective solution. It doesn't. Therefore, the observer must make efforts such as changing the posture so that the hidden part can be seen.
However, there are still unsolvable things such as missing sights and misunderstandings. As described above, in the conventional technology, when the monitor wants to see the display content on the large screen more closely, the display content on the large screen cannot be viewed on the handheld screen, which limits the usability. It was

Further, in the prior art, the observer cannot inform the other observer of his / her attention on the large screen without disturbing the observer, and vice versa. There is also a problem that the staff wants to know what another observer is paying attention to on the big screen, but sometimes he does not understand.

As a related invention of this case, Japanese Patent Application No.
-102159, "Interactive control system with multiple displays and its control method" was filed. In this application, a large-screen display device viewed by a plurality of operators and a display device held by each operator are provided, and each operator registers in advance an attribute representing his / her work content. Then, when an operation input for designating a position on the large screen and obtaining detailed information of the position is performed from the input means of the display device at hand, what kind of attribute is registered from the registered attributes. Information, for example, information required for maintenance or information required for operation, is determined, and information according to the determination is displayed on the handheld display device. By doing so, it is possible for a plurality of operators to easily see the information they need.

An object of the present invention is to easily specify an arbitrary position on the large screen even when a part of the large screen is hidden by the screen at hand, and to monitor the position monitored by each guardian to another. An object is to provide an image display device that can be easily identified by a worker.

[0011]

[Means for Solving the Problems] The above objects are one large screen display means, a small screen display means provided for one or a plurality of observers, and a monitor when the observer is looking at the large screen. A position detecting means for detecting a viewpoint position on the large screen, and a display element or a display area on the large screen near the viewpoint position from the viewpoint position on the large screen detected by the means. By providing a judging means for judging that it is designated by the observer and a display control means for displaying information on the display element or display area designated by the judgment of the means on the small screen display means corresponding to the observer. A portion on the large screen which is achieved and which corresponds to the portion displayed on the small screen display means is displayed by a display method capable of distinguishing which monitoring person is monitoring the portion. It is achieved by.

[0012]

[Effect] Even if it is hidden in a small screen, the position on the large screen can be easily specified from the viewpoint position, so it is easy to transfer the screen and data of the required part to the local screen without changing the work posture. Can be displayed on. In addition, at the position on the large screen related to the display of each hand screen, a display that can identify which monitor is watching is provided, so each monitor can easily grasp the work of other monitor, Collaborative work between observers can be performed efficiently and reliably.

[0013]

EXAMPLES The present invention will be described below with reference to examples. Figure 1
Shows an embodiment of the image display device of the present invention. This embodiment is a system for monitoring a thermal power plant, and when an observer instructs the operation screen to display a part of the image on the large screen that should be displayed on the local screen, the part is overwritten and displayed in duplicate on the local screen. It is an example that the outer frame part of that part is surrounded by a line and displayed on the big screen,
Large screen display unit 101, cursor control unit 102, image generation unit 103, determination unit 104, display control unit 105, composition unit 10
6, a data storage unit 107, a hand side screen display unit 108, an operation unit 109, and a position detection unit 110.

The determination unit 104 determines whether the instruction input by the monitoring staff from the operation unit 109 is an instruction to display the display contents of the large screen display unit 101 on the local screen display unit 108.
judge.

The image generation unit 103 instructs the display control unit 105 to display an image of this portion designated by the operation unit 109 out of the display images of the large screen display unit 101 on the local screen display unit 108. Please copy it to the. ”, Generate the image, and output the generated image to the synthesis unit 106. In addition, from the display image of the large screen display unit 101, for the image of this portion instructed by the operation unit 109, a figure with an outer frame surrounded by a line is created for the explicit display on the large screen display unit 101. Command is generated, the image is generated, and the generated image is output to the synthesis unit 106.

The display control unit 105 exchanges commands with other units and reads data from the data storage unit 107, so that the large screen display unit 101 and the local screen display unit 108 display other images such as images at the time of initial display. , Output the original image. For example, an image of a schematic system diagram of a thermal power plant is output to the large screen display unit 101, and a detailed system diagram of a certain monitoring target such as a boiler is output to the local screen display unit 108.

The synthesizing unit 106 receives the generated image and the original image for the large screen and the near screen, creates a synthetic image for each of them, and creates a large screen display unit 101,
It is sent to the handheld screen display unit 108. For example, the large screen display unit 1
To 01, send a composite image to be displayed by overwriting on the outline system diagram of the thermal power plant, with a figure surrounded by a line that clearly shows the duplicated range on the local screen, and display the large screen display content on the local screen display unit 108. A composite image is displayed in which the image obtained by duplicating a part of is overwritten on the detailed system diagram of the original hand screen.

The cursor control unit 102 receives from the operation unit 109 the information of the operation of the observer, for example, the mouse movement, and the display control unit 105 displays the cursor on the large screen display unit 101 or the local screen display unit 108. Send information about. The data storage unit 107 stores data related to the display status of the large screen display unit 101 and the display status of the local screen display unit 108. Also, information about the installation status of the display,
For example, the position where the large screen and the handheld screen are installed is stored. The large screen display unit 101 receives the large screen composite image from the composition unit 106 and displays it on the monitor. The hand screen display unit 108 receives the composite image for the hand screen from the composition unit 106 and displays it on the monitor.

The operation unit 109 outputs the instruction input by the mouse drag from the observer to the display control unit 105. Further, the operation unit 109 outputs the operation to the cursor control unit 102 when an operation such as a mouse movement is performed by the observer.

The position detection unit 110 is controlled by the display control unit 105 and detects the viewpoint position of the observer, and uses, for example, a three-dimensional sensor.

Next, the operation of this embodiment will be described. Figure 2
4 is a flowchart of a monitoring operation display control program. First, data loading and initial screen display by this program will be described. When the monitoring program is activated, the display control unit 105 reads the data stored in advance from the data storage unit 107 in step 301, and in the next step 302, the cursor control unit according to the data read by the display control unit 105. 102 and image generation unit 103
Then, the composition unit 106 and the determination unit 104 are initialized, and display contents for initial display are sent to the large screen display unit 101 and the hand screen display unit 108. FIG. 3 shows an example of a display screen at this time. FIG. 3A shows a system diagram of the thermal power plant displayed on the large screen display unit 101, and FIG. 3B shows a local screen display unit 108. It is a detailed systematic diagram of the displayed boiler.

Next, the second half of the monitoring operation display control program, that is, the processing that is repeatedly performed for each instruction until the supervisor instructs the termination of the monitoring system will be described. As an example of the observer's instruction, in the initial screen display state, the observer
Consider a case in which a user wants to display a part of the boiler image, which is the display content of a large screen, on the local screen. If the instruction of the observer is not completed (step 303), the large screen display unit 1
01 and the handheld screen display unit 108 display the screen shown in FIG. 3, and the display control unit 105 is in a state of waiting for an instruction from the monitoring staff (steps 304 and 305). At this time, in step 305, the cursor control unit 102 exchanges data with the operation unit 109 to manage the display of the cursor on the large screen and the hand screen. For example, when the monitor (+ mark) is located at position A in FIG. 3B, if the mouse is moved further upward from this position A on the screen at hand, the cursor control unit 102 causes the operation unit 109 to operate. The moving direction and the moving amount are received, and the cursor is moved from the local screen display unit 108 to the position B of the large screen display unit 101.

In this state, the monitoring staff gives an instruction to display a copy on the screen at hand using the operation unit 109. In this example, the lower part where the boiler to be monitored is displayed is dragged with the mouse so as to surround the surrounding parts.

When an instruction is received from the operation unit 109, the process proceeds to step 306. The display control unit 105 identifies, from the coordinate value of the position input by the surveillance staff, what the surveillance staff has instructed, or whether it is a duplication display command on the local screen instead of instructing an object. To do. Here, the display control unit 105 determines that the operation instruction is a duplicate display instruction on the hand-side screen, because the monitoring subject has not instructed the monitoring target. FIG. 4 shows the state at this time, and the display figure schematically shows the same part as FIG. 3 together with the large screen display section 101 and the hand side screen display section 108. The portion dragged by the mouse to newly instruct the detailed display is shown by a quadrilateral frame C. However, at this point, the frame C is not actually displayed yet.

The display control unit 105, which has received the above-mentioned duplicate display command, issues a command to the image generation unit 103 to instruct the generation of the duplicate display image. Here, the display control unit 105
Is an instruction for the image generation unit 103 to generate a duplicate display image of the corresponding portion below the large-screen boiler.

Upon receiving the duplicate display image generation command, the image generation unit 103 generates a corresponding image and sends each generated image to the synthesis unit 106. Here, the image generation unit 1
03 receives an image generation command at the bottom of the boiler and generates an image. The process of the image generation unit 103 at this time is performed by step 801 and subsequent steps in FIG. That is, in step 801, the image generation unit 103 receives the shape data of the region to be copied from the operation unit 109 via the display control unit 105. In this example, the coordinates (xd, yd) of the button-down position of the mouse and the coordinate values (xu, yu) of the position of the button-up when the frame C of FIG. 4 is designated are stored in the display control unit 105. , Receive its value. Next, at step 802, a duplicate display area is set from the shape data. In this example, the image generation unit 103 uses the smaller of the coordinate values (x, y) (xd, xu, yd, yu) of the upper left point of the duplicate display rectangular area from (xd, yd) and (xu, yu). ), Width w (= | xd-xu |), and height h (= | yd-yu)
|) Is set. In the next step 803, an image for the local screen is generated. Specifically, with respect to the duplicate display areas (x, y), w, and h obtained in step 802, the image data displayed on the large screen is duplicated, and the duplicated image is displayed on the local screen. send. Also, in step 804, a large screen image is generated. This is to create graphic data for actually displaying the frame C for the duplicate display areas (x, y), w, and h obtained in step 802,
It is sent to the synthesis unit 106 for display on a large screen.

The synthesizing unit 106 receives the image from the image generating unit 103 generated as described above and the image from the display control unit 105, and displays what kind of attribute the two types of images are to be synthesized with. The images are combined according to the instruction from the control unit 105, and the respective combined images are displayed on the large screen display unit 101.
To the local screen display unit 108. Large screen display 1
01 and the on-screen display unit 108 receive the respective combined images from the combining unit 106 and display them on the respective display screens.

FIG. 5 shows how the above processing result screen is displayed. In this example, the local screen display unit 108
In addition, the information of the detailed system diagram of the boiler, which is the initial screen on the local screen, and the lower part of the boiler on the large screen are combined and displayed by overwriting. Further, the large screen display unit 101 displays a frame C that clearly shows that the lower part of the boiler in the system diagram of the thermal power plant is duplicated and displayed on the local screen.

The basic flow of the operation of this embodiment has been described above by using an example in which the number of screens at hand is one. However, in reality, there are a plurality of supervisors and a plurality of screens at hand are installed. In such a situation, when each monitor drags the mouse on the large screen, the details of the dragged part on each screen are displayed, and the operation is the same as the explanation in the above singular example. . However, on the large screen, each observer specifies and sees what he or she needs, so it is possible for another observer to see which frame is displayed on each screen. Need to understand. For this reason, in the image generation for the large screen in step 804 of FIG. 2, in addition to the graphic of the frame line, the image of the postcard corresponding to each screen at hand is generated.

FIG. 6 shows a display example of a large screen when such a plurality of supervisors are instructing. In this example, a supervisor in charge of maintenance and a supervisor in charge of operation monitor the thermal power plant. When the maintenance staff is dragging the bottom of the boiler on the large screen with a large mouse and looking at his / her own screen, on the big screen, the person under the maintenance schematic A frame C1 with a bill is displayed. Then, on the screen of the maintenance staff in charge of maintenance, the information of the boiler monitoring video (however, it cannot be seen hidden in the figure below) and the lower part of the boiler on the large screen are overwritten and displayed. There is. on the other hand,
When the supervisor in charge of operation is looking at the screen on his side by dragging the left side of the boiler on the large screen with a small mouse, on the large screen, the left side of the boiler in the schematic system diagram is called "Operator". A frame C2 with a bill is displayed. On the screen of the operator in charge of operation, detailed information of the boiler setting value and the left part of the boiler on the large screen are overwritten and combined.

In this way, a plurality of observers can inform another observer of his / her attention on the large screen without disturbing each other, and conversely, the attention of another observer can be noticed. You can see where you are.

As a method of indicating on the large screen which part each of the monitoring by the plurality of monitoring personnel is, not only the display of the frame line but also the method of changing the brightness inside the frame to fill it. It is also possible to prevent a plurality of observers from operating the same portion by restricting the access right to another observer when a certain portion is being monitored by one of the observers. In addition, although it is not directly related to notifying other monitoring personnel of the monitoring position, as a method of instructing the duplicate display command to the local screen, the width corresponding to the size of the local screen around the point where the mouse is clicked or Determine the height and display a duplicate, select a command, or display a menu such as a duplicate display or a screen showing detailed data after selecting an item, and select from there. It can also be taken.

The process for obtaining detailed information from the large-screen overview display on the hand-side screen will be briefly described here.
For example, when the monitor 108 indicates the boiler itself on the large screen using the operation unit 109 when the display unit 108 is in the state shown in FIG. 3, the display control unit 105 is displayed in step 306 of FIG.
Identifies, from the coordinate values of the position input by the observer, that the observer has instructed the boiler on the large screen. In this case, it is determined that the boiler on the large screen is normal. Then, in step 307, the boiler control information on the large screen is viewed, and if the boiler on the large screen is instructed, 1) "Hide" in the detailed information on the initial screen of the boiler on the local screen, 2) Find a description of the operation such as sending a message "display" to the detailed information of the setting value of the boiler on the local screen, and identify the operation. In step 308, a non-display message is sent to the detailed information on the initial screen of the boiler on the hand side screen, and a display message is sent to the detailed information on the set value of the boiler. In step 309, the image for the hand side screen is created only in the display control unit 105 and is output to the synthesizing unit 106. In this way, the handheld screen display unit 108 is switched to display the detailed information of the boiler set value.

FIG. 7 shows a display example of detailed information on the screen at hand, where (a) is control data set in the boiler, (b) is a graph showing changes over time in the flow rates of fuel and feed water, (C) is a case where the latest inspection record of the boiler is displayed.

The method has been described above in which, when a plurality of supervisors are viewing and displaying the desired portion or the information on their own screens, the supervisory status is notified to each other on the large screen. Another object of the present invention is to solve the problem using the position detection unit 110, in the case where the large screen is difficult to see due to the overlapping of the large screen and the local screen, or the large screen itself is too far to see well. Explained. now,
It is assumed that the initial screen described in the first part of FIG. 2 is displayed. At this time, the data storage unit 107 stores the position of the large screen and the positions of other screens at hand. In this state, when the monitor operates the operation unit 109 to move the cursor to the large screen instead of instructing the duplicate display, the display control unit 1
05 sends a command to the position detector 110. Then, the position detection unit 110 detects the position of the observer's viewpoint and sends it to the determination unit 104. The determination unit 104 includes the position data of the observer's viewpoint sent from the position detection unit 110 and the data storage unit 1.
From the position data of the obstacle other than the on-screen and the position data of the large screen obtained from 07, the hidden and invisible portion of the display content of the large screen is determined. That is, the range for duplicate display is obtained by projecting the range of obstacles such as the screen on hand from the position of the observer's viewpoint onto the large screen. For example, when the observer's viewpoint is at the center of the quadrilateral hand screen, four points on the large screen, which are the four corners of the hand screen, are obtained.
If the position of the observer's viewpoint deviates from the center of the screen at hand, obtain each vertex of the polygon including the device portion behind the screen at hand. With respect to the images in the range thus obtained, the image generation unit 10 will be used thereafter similarly to the first embodiment.
3 generates an image for the local screen, and the local screen display unit 108
To display. Then, the image generation unit 103 generates a large-screen image and specifies the range duplicated on the large-screen display unit 101. As described above, the observer can easily see the display contents on the large screen that cannot be seen by the obstacle on the hand-held screen.

Further, in the method of detecting this viewpoint, even if it is not hidden, the place where the observer is paying attention is determined from the positional relationship between the line of sight of the observer and the large screen, and the screen at hand is displayed. You may make it possible to display and see.

[0037]

According to the present invention, even if a part of a large screen is invisible or difficult to see, there is an effect that the position can be easily specified and the information of the part can be displayed on the local screen. By displaying on the large screen the part that the watchman is looking at on the screen so that they can be identified, each watchman can easily grasp the part that another watchman is watching and perform a rational operation. It has the effect of making it easier.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of an image display device of the present invention.

FIG. 2 is a flowchart showing the operation of the embodiment of FIG.

FIG. 3 is a diagram showing a display example of an initial screen.

FIG. 4 is an operation explanatory diagram when designating a portion to be displayed on a hand-side screen on a large screen.

FIG. 5 is an explanatory diagram of a display method of each screen when a part of the large screen is displayed on the hand screen.

FIG. 6 is a diagram showing a display method of a large screen when displaying on a plurality of hand screen display units.

FIG. 7 is a diagram showing a display example of detailed information on a hand screen.

[Explanation of symbols]

 101 large screen display unit 102 cursor control unit 103 image generation unit 104 determination unit 105 display control unit 106 combining unit 107 data storage unit 108 hand screen display unit 109 operation unit 110 position detection unit

Front page continuation (72) Inventor Koichiro Tanikoshi 7-1-1 Omika-cho, Hitachi-shi, Ibaraki Hitachi Ltd. Hitachi Research Laboratory (72) Inventor Masayasu Futagawa 7-1-1 Omika-cho, Hitachi-shi, Ibaraki Hitachi, Ltd. Hitachi Research Laboratory (72) Inventor Masato Hotta 7-1-1, Omika-cho, Hitachi City, Ibaraki Prefecture Hitachi Ltd. Hitachi Research Laboratory (72) Inventor Atsuhiko Nishikawa 5 Mika-machi, Hitachi City, Ibaraki Prefecture 2-1-1, Hitachi Ltd. Omika factory

Claims (10)

[Claims] 1. A monitor having one large screen and a small screen provided for one or a plurality of observers, and detecting a viewpoint position on the large screen when the observer is looking at the large screen. From the detected viewpoint position on the large screen, it is determined that a display element or a display area on the large screen at or near the viewpoint position is designated by the monitor, and the display element designated by the determination. Alternatively, an image display method is characterized in that information on a display area is displayed on a small screen corresponding to the surveillance staff. 2. A large screen display means, a small screen display means provided for one or more observers, and a viewpoint position on the large screen when the observer is looking at the large screen. Position detecting means for detecting, and it is determined from the viewpoint position on the large screen detected by the means that the display element or display area on the large screen at or near the viewpoint position is designated by the monitor. An image display device, comprising: a determining means for controlling the display element and a display control means for displaying information related to a display element or a display area designated by the determination on the small screen display means corresponding to the monitoring staff. 3. The viewpoint position of the large screen detected by the position detection means is a position hidden by the small screen display means used by the surveillance staff, and near the center of the small screen display means. At the corresponding position, the determination means,
The image display device according to claim 2, wherein a quadrilateral area on the large screen hidden by the small screen display means is set as the designated display area. 4. The viewpoint position of the large screen detected by the position detection means is a position hidden by the small screen display means used by the surveillance staff, and deviated from the center of the small screen display means. When the position is
The device displayed at or near the viewpoint position is used as the designated display element.
The image display device according to. 5. The information relating to the display element or display area is an image displayed in that portion on a large screen or an image in which the image is displayed in more detail. The image display device according to one. 6. The information relating to the display element or the display area is data representing the state of the device displayed in that portion on the large screen, according to one of claims 2 to 4. The image display device described. 7. A part on the large screen corresponding to the part displayed on the small screen display means is displayed by a display method capable of distinguishing which monitoring person is monitoring the part. The image display device according to claim 2. 8. A character string for identifying each observer is defined in advance, and the display method uses a quadrilateral frame surrounding the portion and a character string corresponding to the observer corresponding to the frame. The image display device according to claim 7, wherein the image display device is a display device. 9. A brightness level for identifying each monitor is defined in advance, and the display method uses a frame that surrounds the portion and is displayed at the brightness level corresponding to the corresponding monitor inside. The image display device according to claim 7, wherein the image display device is a device. 10. A plant monitoring system comprising the image display device according to claim 1 for performing plant monitoring.