JPH0620175A - Monitoring device - Google Patents

Abstract

PURPOSE:To clearly demonstrate the object under operation or inspection and the object to which the operation or the inspection is to be executed by images in a process control monitoring system utilized with monitoring images. CONSTITUTION:The object of the operation or the inspection is defined as a boiler A by selecting items 406 in an operation/inspection item menu 405 using a cursor 304 and the operation or the inspection is executed. In this case, in a video display area 302 for displaying ITV camera images including the boiler A401, the boiler A is emphasized by displaying a rectangle 407 so as to surround the boiler A401. Since the object of the operation or the inspection is emphasized and displayed in the images, which equipment is the object is recognized at first sight. Especially, since the object to which the operation or the inspection is actually performed is emphasized even when the plural operation/inspection objects are included in the ITV camera images, the object is clarified.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method of monitoring transportation systems such as railways and road networks, chemical plants, steel, electric power, gas, water and sewage plants and the like, and in particular, without visiting the site. The present invention also relates to a monitoring method and apparatus suitable for performing accurate monitoring.

[0002]

2. Description of the Related Art For example, in a process control monitoring system, a method is adopted in which a monitor device is installed in a central operation room, an ITV camera shoots an object to be monitored and controlled, and the image is displayed on the monitor device. Further, various process data obtained from the monitoring control target and process control information such as input data from the operator are converted into characters, graphs, tables, and figures by a control device such as a control terminal and displayed on a display. it's shown. Conventionally, the ITV camera image and this process control information screen are displayed separately,
Or it was just displayed on the same screen.
Therefore, for example, when operating or inspecting a certain device,
In addition to the operation of displaying the control information of the device on the process control information screen, the operator switches the ITV camera using a dedicated button to see the state of the device in detail.
It was necessary to perform zooming and panning. That is, the operator needs to perform two operations, that is, an operation related to the screen of the process control information and an operation related to the ITV camera image when performing the process monitoring control.

Therefore, in order to solve this problem, Japanese Unexamined Patent Publication (Kokai) No.
In the CRT monitoring control device described in Japanese Patent Publication No. 224101, I
The operation related to the TV camera image is performed. In this conventional technology, the name of the operation inspection target is input using the mouse and keyboard on the process control information screen displayed on the control terminal or the like, the graphic representing the target is selected, or the operation panel is displayed. By pressing the dedicated button on the top, you can select the means for deciding the operation / inspection target and the ITV camera image showing the decided operation / inspection target.
Means for sending a TV camera video selection command to the video selection device;
It is a system having a means for synthesizing an ITV camera image and process data related to the object on a process control information screen and displaying them simultaneously.

According to this conventional technique, by selecting an operation / inspection target on the process control screen, the target image can be automatically displayed on the screen, which saves the labor of the operator. It was

[0005]

However, in this prior art, it is necessary to specify a figure representing an object to be operated or inspected with a mouse or the like, or to input a name from a keyboard. In addition, when inputting commands to execute operations and inspections, and inputting operation confirmations and inspection confirmations of operation inspection targets, there is a menu that displays the name of the target displayed in the process control information screen. It is necessary to specify a target, input an operation inspection execution command, and input an operation inspection confirmation by using an abstractly expressing object such as a figure expressing the object.

[0006] In addition, since this prior art is configured to display a concrete object in a camera image from an abstract representation of the object such as a figure and a name, another object will be displayed unless accurate input is made. It will be displayed. When specifying an object to be operated or inspected, an abstraction of the object such as "name" or "figure" representing the object, even when it is clear that an abnormality has occurred by looking at the camera image. By specifying and inputting, the target for operation and inspection is specified. In this case, it is necessary to correlate a specific object on which the operation inspection is performed on the camera image with the abstract expression such as the name of the object or a graphic representing the object.

Generally, in a process control and monitoring system of a plant or the like, the number of devices to be inspected and operated and the number of graphics information screens displayed on the display for the operator to control them are very large. There are many associations that the operator should remember, such as the correspondence between the name and the graphic representing it and the specific device on the ITV camera image. Therefore, the operator needs to carry out long-term training in advance in order to acquire these associations.

If an operation inspection command is input through such an abstract thing, it is difficult to convey the state of the site. For example, at the time of maintenance and inspection work on a plant or the like, it is important to understand the situation at the site. In conventional systems that select objects using graphics or other abstract things and input operation inspection commands, there is a risk of object selection mistakes and operation mistakes during work. It is the situation that is working.

When an operator inputs an instruction to execute an operation or inspection, or an operator inputs an operation confirmation or inspection confirmation of an object, a confirmation or an instruction made by a camera image display area and a figure or a character is displayed. If the input location is far away, it is necessary to shift the line of sight from the image when inputting. In such a case, the operator may sometimes directly input a confirmation input and an operation command to the input location without looking at the camera image. As described above, the ability to confirm and input commands without sufficiently grasping the condition of the supervisory control target causes operation mistakes and inspection mistakes.

On the other hand, it is not practical from the viewpoint of cost to install a camera for projecting the object for each device to be inspected for operation. Generally, one camera takes an image of the object for which several operations are inspected. is doing. Therefore, even if the target can be specified and operated and inspected as in the prior art, and the target can be switched to a camera image, a plurality of targets that can be the operation inspection target can be displayed in the camera image. It may be done.

In such a case, it becomes unclear to the operator which object is actually being operated or inspected. Similarly, when an object to be operated or inspected is designated, it is unclear to which the object corresponds in the camera image. In addition, it is unclear on the image which object is to be checked when checking the operation and inspection. Also, the devices to be operated or inspected are not independent of each other.
One device may be closely related to another device.
When operating and inspecting, it is necessary to clearly indicate to the operator such related equipment. In addition, it is not possible to extract additional information such as its name, handling method, inspection operation work status, and process data related to that object from a specific object in the camera image, so such data can be extracted while viewing the image. If desired, it must be extracted using the correspondence between the object on the image, its name, and the graphic representing it, as described above. Further, if the display location of the extracted data is displayed in a place apart from the target on the video, it becomes difficult to simultaneously refer to the target on the video and the information related to the target.

Further, in the operation and inspection, the condition of the object to be monitored, the operation inspection time, and the operation inspection, such as the periodic inspection and the inspection at the time of abnormality, the inspection performed by the person in charge of system management and the inspection performed by those who are not Depending on factors such as the operator and the group to which the operator belongs, the contents of the operation inspection vary depending on whether or not the operation or inspection is to be performed or is to be performed. Therefore, it is necessary to change the operation inspection target to be clearly specified and the operation inspection content to be executed according to the data on the database including the status of the monitoring target and the information of the person who performs the operation inspection.

To summarize the above, the prior art has the following problems.

(1) Since the camera image includes a plurality of objects that are likely to be subjected to operation inspection, there is a possibility that the object being operated and inspected is unclear in the camera image.

(2) When a target to be subjected to an operation inspection is designated from the supervisory control targets, the target which can be designated next or should be designated is unclear in the camera image. Further, even if the operator specifies the target, it is not clear on the camera image which target has been specified.

(3) When performing the operation inspection, the objects related to the operation inspection object are not clearly shown.

(4) When performing an operation inspection, it is necessary to input an operation and inspection command through an abstract object such as a character or a graphic. In addition, even after inputting confirmation input such as after operating and inspecting the monitoring and control target, confirmation is performed through characters and figures.

(5) Information such as inspection and operation related information and process data related to the object cannot be extracted from the object on the camera image.

(6) Since the location of the information on the inspection and operation of the object on the camera image and the information such as the process data related to the object does not consider the position of the object on the camera image, the operation is performed. It is difficult for a member to refer to the object in the video and the data related thereto at the same time.

(7) When designating an object to be inspected for operation, what is explicitly specified as a candidate must depend on process data and data such as an operator and an operation history obtained from the object to be monitored and controlled. Otherwise, the operator must always select the target to be inspected from the same target based on the situation of the monitoring control target.

(8) When carrying out the operation inspection, the content of the operation inspection must depend on the process data, the operator, the operation history, etc. obtained from the monitoring and control target.
Otherwise, it is necessary for the operator to make all decisions regarding the contents of operation inspection.

An object of the present invention is to solve at least one of the above-mentioned problems of the prior art and to perform an operation performed by an operator.
It is to provide a monitoring device with an improved inspection support function.

[0023]

[Means for Solving the Problems] The above-mentioned object, the following (1) to
This is achieved by providing any of the means (8).
As a means for solving each of the items listed in the above problem, a device having the same item number as the problem corresponds.

(1) Means for highlighting the object under operation inspection in the camera image.

(2) A means for highlighting an object that can be or should be inspected in the camera image when designating an object to be inspected. Also, a means for highlighting a specified target in the camera image.

(3) Means for highlighting the object related to the operation inspection object on the camera image when performing the operation inspection.

(4) Performing operation and inspection by designating an object in the camera image, confirming operation of the object,
Means for performing inspection and confirmation operations.

(5) Means for displaying related control information, name, additional information such as operation and inspection status, and related information when an operator designates the object in the camera image when operating and inspecting the monitored and controlled object.

(6) A means for displaying the process data, the operation inspection status, and the operation inspection contents related to the object designated by the operator at a position determined from the position of the object on the image.

(7) Based on the data on the database such as the process data, the operator ID, and the operation history obtained from the monitoring and control target, the target for the operation inspection is determined, and only the target is highlighted in the camera image. means.

(8) Means for determining the contents of the inspection operation based on the data on the database such as the process data, the operator ID, and the operation history when the operation and inspection of the monitoring and control target are performed.

Further, in the above means (1), (2), and (3), at least one of the following two means is provided as means for highlighting an object on an image.

(9) Means for superimposing and displaying graphics on the object on the video image.

(10) A means for transmitting a camera control signal to a camera for photographing the object so that the object on the video image is enlarged and displayed.

[0035]

By means of (1), it is possible to clearly inform the operator of the object being operated or inspected. In particular, even when the camera image contains multiple objects that can be inspected for operation, the object to be inspected for operation is clarified by highlighting the object that is actually inspected for operation, and the operation using the image is performed. , The inspection can be performed more reliably.

By means of (2), when selecting an operation / inspection target from candidates for operation / inspection, the highlighted camera image of the candidate can be selected for selection, so that a selection error can be prevented. It is possible to select the target after grasping the situation at the site, and it is possible to select the target reliably and quickly in the event of an abnormality.
Further, when the operation inspection target is selected, which target has been selected is clearly displayed on the image, so that the selected target can be confirmed on the image.

By the means of (3), the object related to the operation inspection object is highlighted on the image, so that the operation and inspection can be performed in consideration of the specific state of the related object.

By specifying the target on the camera image by means of (4), it is possible to confirm the target at the time of operation or inspection, or to perform the operation or check on the target. Since the data can be directly input to the object on the image, it is not necessary to consider the connection between the image information and the abstract information such as graphics, which has been conventionally performed when performing the operation inspection. It is possible to input operation and inspection commands after observing the video of the operation inspection object and grasping the situation at the site, and it is possible to perform reliable and prompt operation inspection in the event of an abnormality. Further, when confirming whether or not the operation inspection has been performed surely, by performing confirmation input on the image, a reliable confirmation operation such as pointing and calling can be realized. Since the operator must always view the target video when making a confirmation input, the operator can perform a confirmation operation while grasping the situation at the site.

By carrying out the operation and inspection by means of (5), by specifying the object on the image, the name and process data of the object, information on the operation and inspection (for example, operation manual, inspection items, inspection) Procedure) can be displayed. That is, it is possible to extract various kinds of information about a specific target in a video. As a result, for example, if an abnormality can be found by looking at the video, it is possible to extract such information without knowing the device name, operating method, and the like.

By the means of (6), the process data related to the object is set at a position determined from the position of the object on the image,
The operation inspection status and operation inspection contents can be displayed.
For example, if you display them right next to the target on the video,
It becomes easy for the operator to simultaneously refer to the target on the video and the related information of the target. Further, by displaying the information described above anew while avoiding the display of the target on the image or the related information already displayed, it is possible to refer to all of the various target information.

By the means of (7) and (8), the object which can be designated as the operation inspection object, the inspection content, and the operation content can be specified according to the status of the monitoring object, the group to which the operator belongs, the ID of the operator, the operation inspection history content And so on. This makes it possible to prevent mistakes due to inexperience in operation and mistakes in selecting operation inspection targets by dividing inspection operations for each group or changing inspection operation contents.
In addition, inspections and operations are normally performed easily, and when the system is started up or when some abnormality occurs, switching such as careful inspections and operations is performed automatically. As a result, it is possible to reduce the time and effort required for the operator to check the operation and to ensure the operation.

By means of (9), not only can the object on the image be highlighted, but the degree of emphasis can be added by changing the color or line thickness of the graphics to be superimposed. That is, with respect to the target of important operation inspection, it is possible to make the color of the graphics showing the highlighting different from other cases, or to display the operation inspection order in text on the image. Is.

By means of (10), not only the object on the image is highlighted but also the object on the image is enlarged and displayed, so that the situation of the object can be monitored in more detail than in the normal state. It is possible to perform an operation inspection while looking at the object in detail when performing an operation inspection.

The following effects can be obtained from the above means.

It is possible to reduce the operator training period for a long period, which was conventionally required for a process control system of a plant or the like. You can judge the process status on the video, and if the operation and inspection are necessary, select the target on the video to perform the operational inspection or extract the information related to the target from the target on the video. Therefore, there is no need to learn the association between the object on the image, the name, the figure representing the object, etc., which was necessary in the past.

Since the operation inspection is carried out by designating the object on the image, the operator can carry out the operation and inspection as if he / she is at the site where the operation inspection object is placed. You don't have to go to the site like you used to,
You can perform operations, inspections, and maintenance work in the same way as when you are in the operation room while you are in the operation room.

Furthermore, the system can be used for training operators by using pre-recorded images instead of camera images. That is, the means (5) can extract information related to the object from the object in the image, which is useful for establishing an association between the object in the image and the data related thereto.

[0048]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT A preferred embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a configuration diagram of a monitoring device according to an embodiment of the present invention. Reference numeral 101 denotes a monitoring control target (hereinafter referred to as a monitoring target) that is a target of monitoring and control in a traffic system such as a road and a railroad, an electric power plant, a gas plant, a water and sewer system, a steel plant, and the like. A monitoring device monitors and controls this monitoring target. The data collection and monitoring target control unit (hereinafter, simply referred to as a control computer) 102 that constitutes the monitoring device of this embodiment collects data (hereinafter, referred to as process data) obtained from the monitoring target 101. Or control the monitoring target. The control computer 102 sends the process data to the LAN.
Data is sent to the data display / input acceptance control unit (hereinafter simply referred to as a workstation) 104 and the database 115 through 103. The control computer 102 also receives a control command sent from the workstation 104 through the LAN 103 and controls the monitoring target 101.

The database 115 is used for the control computer 10.
2 stores the process data input from the LAN 103 through the LAN 103, and sets the control target 101 and the operator's I
Data such as D, group ID, and operation history are stored. The stored data is read by a read command from the workstation 104 and sent to the workstation 104 through the LAN 103.

The ITV camera 107 uses the cable 108, the switcher 110, and the cable 1 to display the video of the monitoring target 101.
12 to the workstation 104. on the other hand,
The workstation 104 sends a camera switching command from the cable 113 to the switcher 110, and sends a camera control signal to the cable 113, the switcher 110, and the cable 109.
To the ITV camera 107 through. Switcher 110
Switches the camera according to the sent camera switching command. The ITV camera 107 performs camera control such as zoom and pan according to a camera control command.

At the workstation 104, the process data sent from the control computer 102, the data sent from the database 115, the ITV camera 10
The video signal sent from the No. 7 is processed and displayed on the CRT 105. Further, the operator inputs various input commands to the workstation 104 by using the input device 106 such as a mouse, a tablet, or a touch panel. The workstation 104 processes these input commands, changes the CRT display, sends a data read command to the database 115, and sends the control computer 102 through the LAN 103.
Control signals by sending a control signal to the
A camera switching signal and a camera control signal are sent to the V camera 107 and the switcher 110.

FIG. 2 is a block diagram of the inside of the computer 104.
Reference numeral 201 is a CPU, 202 is a main memory for expanding control programs and process control screen data to be displayed on a CRT screen, 203 is a hard disk, and 204 is an input / output driver.

The video signal input from the ITV camera 107 through the cable 112 to the input / output driver 204 is
It is digitized by the digitizer 205 and drawn in the moving image frame buffer 206.

The process data output from the control computer 102 and the data from the database 115 are stored in the cable 1.
From 11, the operator's input command enters the input / output driver 204 from the input device 106 through the cable 114, and from there, is sent to the CPU 201 through the bus 209. The CPU 201 stores those input data in the main memory 2
02 Process according to the program above.

The hard disk 203 stores the process control screen data, and the CPU 201 reads it out when necessary.
It is expanded on the main memory 202 and written in the graphics frame buffer 207 by a CRT display command.
The blend circuit 208 blends the moving image frame buffer 206 and the graphics screen frame buffer 207 and displays them on the CRT 105.

FIG. 3 shows an example of the CRT screen structure in this embodiment. 301 is a control computer 10
2 is a process data display area for displaying the process data sent from 2, 2, 302 is a video display area for displaying a video from the ITV camera 107, 304 is a cursor moved by a pointing device such as a mouse, and 303 is a button for accepting an input from an operator. , 305 are menus.

There are buttons such as 303 and menus such as 305 for accepting inputs from the operator, but these may be displayed only when necessary. The process data display area 301 displays a trend graph 306, a bar graph, a table 307, etc., and clearly shows the process data to the operator. The operator operates the process data display area 301.
Of the monitoring target 101 by monitoring the data of the above and the video of the video display area 302, and pressing the operation button 303 using the cursor 304 or selecting the item of the menu 305, the operation command of the monitoring target 101 , A control command, a display screen switching command, or the like is input.

Based on the system configuration and screen configuration described above,
Examples of the present invention will be described more specifically. First, in the first embodiment, the inspection button 303 in FIG.
By pressing (selecting) with 4, the inspection item menu 405 of FIG. 4 is displayed. In FIG. 4, the image display area 302 includes a boiler A 401, a boiler B 402, and a boiler C.
An ITV camera image including 403 and a water supply device 404 is displayed. By selecting the item 406 of the inspection item menu 405 using the cursor 304, the boiler A 401 is operated and inspected, and the operation or inspection is performed. At this time,
In the image display area 302, a rectangle 407 surrounding the boiler A 401 is drawn on the image in an overlapping manner to clearly indicate that the boiler A is emphasized. That is, the ITV being displayed
The object being inspected and operated is emphasized by drawing graphics on the camera image. As a result, even if there is something that can be the target of multiple operation inspections in the camera image, the object being inspected or operated can be clarified on the image, and the situation of the object can be grasped more reliably. . Of course, if the operation inspection target for the specified item cannot be displayed in the displayed camera image,
Switch to the image from that camera.

As a method of emphasizing an operation inspection object other than the above embodiment, for example, as shown in FIG.
A control command is sent to 07 to perform remote control to enlarge and display the operation inspection target (here, the boiler A401),
There is a method such as. Alternatively, the boiler A is switched to another ITV camera that can be photographed more easily and is operated remotely. That is, by first sending a camera switching signal to the switcher 110 and then sending a control command to the camera, the target is enlarged and displayed. That is, in the above example, the boiler A is enlarged and displayed.

Next, a method for realizing this embodiment will be described. An object 501 having a structure as shown in FIG. 7 is defined in the main memory 202 of the workstation 104. Here, the object 501 includes attribute definition contents related to display (hereinafter referred to as display attribute definition contents for simplification) 502, data such as process data, an event input by an operator, and attribute definition contents related to an operation driven by the event. (Hereinafter referred to as event attribute definition contents for simplicity) 503.

The contents of the display attribute definition contents 502 are shown in FIG. Here, the drawing data 624 such as the display position 621 of the object, the size 622, the shape 623, the color, the thickness of the character and the line, and the like, whether the object receives an input event from the operator (hereinafter, the state of receiving the input event Information such as an object state variable 626 that represents an activated state when, and an inactivated state when it cannot be received. At the time of display, drawing is performed according to the contents of the size 622, the shape 623, and the drawing data 624. The input event input by the operator is the input position information of the event and the display position 62 of the object defined here.
1, size 622, shape 623, object state variable 6
Sort using a value of 26.

FIG. 8 shows the internal structure of the event attribute definition content 503. The event attribute definition content 503 includes an event index table 601 and an operation table 602 that defines an operation to be executed when the event occurs.

The event index table 601 is
The event name 603 and the process data variable 604 related to the object are registered. In the event name 603, the names of all events received by the object such as operator input and commands sent from other objects are registered. The process data variable 604 is a pointer to the corresponding data storage location 611 of the process database 610. The process data obtained from the controlled object 102 is the process database 61 on the main memory 202.
Placed in the corresponding data store 611 in 0, each object references that data.

The operation table 602 registers an operation function executed when an event occurs, a display format for displaying process data, and the like. As the operation to be executed when an event occurs, for example, data to be displayed on the CRT 105 is created, a command is sent to another object, a control command is sent to the control computer 102, CR
For example, a control command for switching the ITV camera image 302 displayed at T105 is sent. Regarding the column of process data on the operation table 602, in addition to the display format for displaying the data, operations such as issuing a warning when the value of the data is a certain value or more are defined.

A description of such an object is
The UIDL described in "User Interface Construction Support System with Meta-User Interface" by Tani et al., 3 members of Information Processing Society of Japan, Volume 30, No. 9, pages 1200 to 1210 is used. The algorithm shown in FIG. 11 is executed using the object described in UIDL. In step 701, the system is started up. In step 702, the CPU 201 collects operator input information input from the input / output driver 204, process data from the control target 101, data from the database 115, and commands from other objects.

Regarding input information from the operator and commands from other objects, the CPU 201 executes step 703.
In step 704, the corresponding operation in the event attribute definition content 503 is executed.
Regarding the process data, the data collected in step 702 is put in the process database 610.
In step 703, the CPU 201 refers to the data for the object that has referred to the input process data, and in step 704, the CPU 201 executes the operation corresponding to the process data defined in the event attribute definition content 503. For all the event and process data collected in step 702, step 704,
When drawing such as screen update is performed after repeating 705, in step 705, drawing is performed in the frame buffer 207, the moving image frame buffer 206 and the blend circuit 208.
The blended by is displayed on the CRT 105.

Using the above objects and algorithms, the graphics menu 305 and buttons 303 on the display screen shown in FIG. 3, the table 307 in the process data display area 301, the graph 306, etc. are created.
For example, regarding the drawing of the graphics menu 305, display is performed in step 705 based on the content defined in the display attribute definition content 502. An event input by the operator to the graphics menu 305 using the cursor 304 is passed to the graphics menu object 501 in step 703, and an operation corresponding to an item in the menu 305 is executed in step 704. Also, graph 30
With regard to No. 6, the process data obtained from the controlled object is referred to in step 703, drawing data is created in accordance with the display format on the operation table 602 in step 704, and drawing is performed in step 705.

Next, a method of recognizing an object in a video and highlighting it with graphics will be described. The objects shown in FIG. 7 are also defined for the ITV camera 107 that shoots the monitoring target and the target for performing the operation inspection in the video or the target related to the target.

The contents of the display attribute definition contents 502 of the object for the ITV camera (hereinafter referred to as camera object) are the contents shown in FIG. As for the camera object, the workstation 104 is the ITV camera 107.
It has as an attribute the content of the camera control signal output to. That is, the zoom value 651, the vertical angle 652, and the horizontal angle 653. Further, as the related object list 654, there is a list of objects corresponding to the objects related to the operation inspection shown by the camera. It also has an object state variable 655 indicating whether or not the image from the camera is displayed in the image display area 302, and further position information 656 indicating the place where the camera is installed.

An object defined for an operation inspection target or a target related to the video (referred to as a video object for simplicity) is displayed in the display attribute definition content 502.
It has a three-dimensional model 627 of the object. In addition, the name of the camera object that reflects the object is noted in the related object list 625.

In FIG. 12, position information 655, horizontal angle information 653, vertical angle information 65 possessed by the camera object.
The image 805 is obtained by projecting the model 627 to be operated and inspected on the plane 802 defined by 2 and the zoom value 651.
At this time, the operation inspection target in the actual ITV camera image is displayed in the position, size, and shape of the image 805. Therefore, from this projected image, the position, size, and shape of the target in the image being displayed can be determined.

The position and size of the object in the image are calculated by the algorithm shown in FIG. When the video is switched in step 701 or step 704 at the time of system start-up, a command to hide the existing camera object is issued and a command to display the new camera object is issued. For the camera object that has received the display instruction, the object state variable 655 becomes the display value. At the same time, a command to activate the object in the image registered in the related object list 654 is issued.

In step 703, the in-video object that received the command is activated, and thereafter, the operator's input event can be taken. Similarly, the camera object that has received the non-display instruction sets the object state variable 655 to the non-display value and deactivates the in-video object registered in the related object list 654.

When the ITV camera 107 is remotely operated, the camera object is instructed to recalculate the projected image of the object in the image. The camera object which has received the command in step 703 sends the command for executing the projection image calculation to all the in-video objects registered in the related object list 654. Next, the in-video object that has received the command in step 703 recalculates the projected image from the three-dimensional model data 627 in step 704 as an operation corresponding to the command. If the zoom value is changed as shown in FIG. 12, the three-dimensional model 801 corresponds to the corresponding plane 803.
It is projected on 804, and the images become 806 and 807, respectively. At this time, the projection image 806 or 8 of the three-dimensional model
The position, size, and shape of 07 are the position 621, the size 622, and the shape 62 of the display attribute definition content 502 of the object 501.
Register to 3. As a result, while the ITV camera 107 is not remotely operated, the in-video object can be handled according to the position, size, and shape registered in the display attribute content 502.

In the case of highlighting an object under operation inspection in the video by graphics, the graphics is drawn according to the position 621, size 622, and shape 623 of the object in the video. Next, a case will be described in which the operation inspection target in the image is enlarged and displayed by switching the camera or by remote control to emphasize the target. In this case, the action table 602 in the event attribute definition content 503 of the object corresponding to the target is defined in advance so that the camera switching command or camera control signal for expanding the target is output to the camera object. I'll do it. When the camera object receives the camera switching command in step 703, a camera switching signal is sent to the switcher 110. Also, if the camera control signal is received, IT
Send it to the V-camera 107. Further, a list 65 of objects in the image registered in the camera object
4, a command is issued to recalculate the position, size and shape of the object in the image.

In this way, by registering the ITV camera and the object to be inspected for operation in the camera image and the object related thereto as an object, the position and size of the object on the ITV camera image can be recognized. it can. In addition, by registering the object displayed by the camera in the related object list 654 in the attribute definition content 502 relating to the display of the camera object, the position and size of the object in the image such as when the camera is remotely operated. If the shape needs to be recalculated, only the objects registered there need to be recalculated. In addition, the action to be executed, such as when the operation inspection target is selected, is defined in the object, and the action can be executed when an event is input. This video object is also described in UIDL.

In the case of the first embodiment, it is as follows.
When the inspection button 303 is pressed, steps 702 and 703
The event is passed to the check button object via. As an operation corresponding to the event input in step 704, a command for display and activation is sent to the inspection item menu object. Similarly, steps 702 and 703
The inspection item menu object which has received the display and activation command via step 704 displays the inspection item menu 405 in steps 704 and 705. Inspection item menu 405
When is pressed, the event is passed to the inspection item menu object through steps 702 and 703, the operation inspection command of the item selected as the corresponding operation in step 704 is sent to the control computer 102, and the selected item is selected. The command for highlighting is sent to the object in the video corresponding to. Upon receiving the highlighting instruction, the in-video object examines the state variable, and if it is in the inactive state, issues an instruction to display the image of the camera to the camera object that reflects itself. With this, the camera is switched to the one showing the target. If it is in the activated state, the image of the camera showing the target is already displayed.
7 is created, and the rectangle created in step 705 is displayed.

Next, a second embodiment of the present invention will be described with reference to FIG. When the operator presses the check button 303 (FIG. 3), the devices 401, 402, and 4 that can be selected or should be selected in the video display area 302 are the operation check targets.
Rectangles 407, 901, 90 surrounding 03, 404
2, 903 are displayed on the image. In this way, when the operator selects a target to be operated or inspected, the device to be selected is emphasized by displaying the graphics in a superimposed manner on the image. As a result, the target on which the operation inspection should be performed or can be performed becomes clear on the image.

The realization method of this embodiment uses the object described in UIDL as in the first embodiment.
When the inspection button 303 is pressed, steps 702 and 70
In 3, an event is passed to the inspection button object, and in step 704, a rectangular display command is issued to the video object in the ITV camera video that can be or should be specified as the target of the operation inspection as the corresponding operation. The object in the video which has received the command through steps 702 and 703 creates rectangular data in step 704, and in steps 705, rectangles 407, 801, 802, respectively.
803 is displayed on the screen.

When there are a plurality of objects that can be selected in the image as in this embodiment, a method for clarifying the objects will be given. As shown in FIG. 4, the cursor 304
Is the item 40 of the boiler A in the operation inspection item menu 405.
A rectangle 407 for highlighting the boiler A 401 is drawn only when it is on the upper side. This is a method of emphasizing only the operation inspection target that the operator intends to select. Alternatively, as shown in FIG. 6, the cursor 304 is moved to the item 4 of the boiler A.
06, the color and line thickness of the rectangle 407 for highlighting the boiler A 401 are changed, and the rectangle is highlighted or blinked. In this method, the operation inspection target that can be or should be selected is clearly displayed in the image, and the operation inspection target to be selected is further emphasized and displayed.

Regarding these, similarly to the second embodiment,
It is realized by using the object described in UIDL. That is, the event that the cursor 304 has come over the item 406 is passed to the object corresponding to the operation inspection item menu 405 through steps 702 and 703. In step 704, a command for highlighting is sent to the object corresponding to the boiler A 401 as a corresponding operation. Boiler A which received the command through steps 702 and 703
The object corresponding to 401 is the steps 704, 7
In 05, draw the rectangle 407, change the color of the rectangle 407,
Change the thickness and display blinking.

Further, when an object to be inspected for operation is designated, the object to be designated on the image can be prioritized by highlighting using such graphics. That is, in FIG. 13, operations and inspections are performed by changing the color, line thickness, line type, etc. of the displayed rectangles 407, 901, 902, 903, or by superimposing characters such as numbers on the rectangles. It is possible to clearly indicate on the video the priority, importance, etc. when carrying out. The operator, based on the priority specified on the video,
Next, you can specify the target for operations and inspections.

Next, a third embodiment will be described with reference to FIG. By displaying the rectangle 407 in the image display area 302 (FIG. 3), the boiler A401 is highlighted. The operator brings the cursor 304 inside the rectangle 407 and inputs a confirmation input for an operation inspection or the like. The rectangle 407 is erased to clearly indicate that the confirmation has been made. That is, by directly inputting the confirmation input regarding inspection, operation, etc. to the target image, the operator must always see the target image when confirming the performed operation, inspection, and the situation of the target. It is possible to perform the confirmed confirmation operation. Further, when the confirmation input is input, the confirmation operation can be further facilitated by highlighting the target on the image. Furthermore, the confirmation operation can be made more reliable by clearly indicating that the confirmation operation has been executed on the image showing the target. As described above, by clearly indicating the confirmation target, confirmation input, and confirmation execution on the video, it is possible to perform operations such as pointing and calling performed at the site such as the plant while in the operation room. be able to.

The above example is an example of confirmation in operation inspection. Similarly, when performing various operations in plant control, the operator specifies the operation inspection target,
(1) The target in the video is highlighted so that the operator can directly specify the target on the video, and (2) the operator specifies it when specifying. (3) The image is displayed when the operator specifies the target. It is possible to have a means of clearly indicating that the designation has been made above. As a result, not only can the target be specified as if on-site, but it is possible to receive assistance from a computer that cannot be obtained on-site.

This embodiment can also be realized by using the object described in UIDL described in the first embodiment. Information such as operation and completion of inspection is sent from the control computer 102 to the L
Input to the workstation 104 through the AN 103. After steps 702 and 703, the event of the operation / inspection confirmation command passes to the object corresponding to the object on which the operation / inspection is executed, and in steps 704 and 705, a rectangle 407 that emphasizes the object is drawn. When the operator brings the cursor 304 here and performs confirmation input, in step 702 and 703, the event of the confirmation input extends to the objects related to the operation inspection target. As a result, in step 704, the rectangle 407 is deleted as an operation corresponding to the confirmation input.

Next, a fourth embodiment will be described with reference to FIG. When the boiler A 401 is operated and inspected, a predetermined operation and inspection contents are automatically carried out by selecting the operation inspection target 401 with the input device 105 such as a mouse in the image display area 302. Thus, operation,
When performing an inspection, the operation and inspection are performed by directly selecting the operation inspection target on the image. The operator can view the image and select an object to be operated or inspected by using a mouse or the like, and can realize direct and quick inspection and operation.

This embodiment can also be realized by using the object described in UIDL shown in the first embodiment. That is, in steps 702 and 703, the input event from the operator is captured and passed to the object corresponding to the operation inspection target. As a corresponding operation in step 704, the operation and inspection command to be performed on the device corresponding to the object are sent to the control computer 102 through the LAN 103. The control computer 102 operates and inspects according to the sent command.

By combining the above four embodiments, it is possible to create a system that supports inspection and operation as follows.
As shown in FIG. 13, when an inspection or operation is performed, an object to be designated as an operation inspection object by the operator is highlighted on the image. When the operator brings the cursor to an object to be inspected or operated on the image and selects it, the operator performs a predetermined inspection or operation on the object and is not selected as shown in FIG. The highlighting of the target disappears, and only the target for which operation or inspection is being performed is highlighted. After the operation and the inspection are finished, the operator also inputs the confirmation of the operation and inspection on the image in FIG. 14 to confirm the operation and the inspection and finish the highlighted display. Further, thereafter, candidates that can be selected as the operation inspection target are highlighted again as shown in FIG. As described above, the selection of the operation inspection target, the execution of the operation inspection, the grasp of the operation inspection status, and the confirmation of the operation inspection can all be performed directly by using the ITV camera image displayed on the CRT. This is the first
Since only the fourth embodiment is combined, the implementation method is as described in each embodiment.

Further, in some operation inspection targets,
In some cases, the operation inspection target may include a target to be selected by the operator. For example, even if the boiler A is selected as an operation inspection target, if some of the valves included in the boiler A need to be further specified as the operation inspection target, the following is performed, for example.

In FIG. 4, by selecting the item 406 from the menu 405, the boiler A 401 is selected.
At this time, as shown in FIG. 15, the image of the boiler A is enlarged, and some of the operations and inspections included in the boiler A that can be performed or are to be performed are displayed in the submenu 1106, and rectangles 1101 and 1102 are displayed. , 1103
By drawing 1104 and 1105, they are highlighted. As described above, by combining the zooming of the image by the camera and the enhancement by the graphic, the operator can be more clearly notified of the operation inspection target.

The implementation method for this example is as follows. The ITV camera 10 operates as an operation executed when the item 406 in the operation inspection item menu 405 is selected.
7, such as sending a command to enlarge the target 401, sending a display command to an object related to the submenu 406, and sending a display command to objects in the image corresponding to the rectangles 1101 to 1105. Is defined in the operation inspection item menu object. An operation for displaying is defined as an operation in response to a command sent to an object corresponding to the submenu 406 or the rectangles 1101 to 1105. The operation defined as above is executed when an event occurs by the algorithm shown in FIG.

Next, the fifth embodiment will be described. FIG.
At, by designating an object on the image using the cursor 304, the related information 1201 related to the operation and inspection of this object is displayed. At this time, the object displaying the related information is emphasized by drawing a rectangle 407 on the image. The related information includes, for example, the name of the operation inspection target, the inspection contents at the time of inspection, the manual display of the inspection operation procedure and the like, the operation inspection status, and related process data.

At this time, for example, as indicated by 1201,
Display related information right next to the selected object. By doing so, it is possible to refer to the relevant information of this target without keeping an eye on the target on the image. Alternatively, avoid areas such as the selected object and related objects, the part that clearly shows the process data related to it, and display the related information by overlaying on the part that clearly shows the information that is not directly related to the selected object. . In this way, various data of the selected target are clearly displayed, and the operator can refer to all of them.

As described above, various related information can be extracted from the object on the image, and the operator can perform the operation and inspection while referring to the various information. Also,
By highlighting the object displaying the related information on the image, it is possible to clarify which object in the image the information is related to.

Also in this embodiment, the realization method is the first
The object described in UIDL described in the embodiment is used.
That is, in steps 702 and 703, an event is sent to the object in the image selected by the operator, and in step 7
As a corresponding operation at 04, drawing information is created by reading the related information related to the object from the hard disk 203, processing the process data sent from the monitoring target 101 for display, or reading from the database 115. . The display position is determined using the display position 621, the size 622, and the related object list 625 of the object in the image, and step 705
Display with.

Next, a sixth embodiment will be described. This embodiment is an extension of the second embodiment, and the operation inspection to be selected or selectable according to the operation data such as the process data issued by the controlled object 101, the operation inspection history, the operator ID, and the group ID. I decide the target and I
This is to be highlighted on the TV camera image.

As already described in the first and second embodiments, when the operator designates the object to be operated or inspected in FIG. 4, by holding the cursor 304 on the menu 405, Operation inspection target 401 of item 406
Is highlighted by drawing a rectangle 407 on the image. By specifying the item 406 in the menu 405 with the cursor 304, the operation inspection target 4
Select 01. If the process data related to this object is not a value in normal times, the objects 1101 to 1105 that are present in the selected objects 401 and should be specified by the operator are displayed as shown in FIG. Highlight above.
On the other hand, in the normal operation inspection, such a detailed target designation can be omitted.

Furthermore, depending on the value of the process data,
It is necessary to carry out the target operation and inspection as soon as possible.
In this case, when selecting the operation inspection target, the other objects are not highlighted, and only the object for which the operation inspection is urgently needed is highlighted, or when highlighted as shown at 407 in FIG. Use rectangle color change, line thickness change, blink display, etc. to increase the emphasis level higher than other objects.

At this time, particularly when the image of the target whose process data value shows an abnormality is not displayed, the camera is switched to a camera capable of displaying the target, and the camera is remotely operated to display the target. It is also possible to highlight the target.

As a result, when the system is started up or when the process data sent to the workstation 104 by the control computer 102 has an abnormal value, the operator highlights the details of the object to which the process data is output on the image. It is possible to specify the operation inspection target while observing the displayed object, or preferentially specify the object outputting the abnormal process data.

Further, in FIG. 17, reference numeral 1301 denotes a group ID / user ID input section. The operator is the input device 1
Enter the ID here using 06. The operator can specify or the operation inspection target to be specified by the input ID. When the operator specifies the operation inspection target, only the operation inspection target is highlighted on the ITV camera image. As a result, only the objects to be inspected and operated that are decided for each operator or group are highlighted, so that the inspection and operation targets can be simplified, and operation errors and inspection errors due to unfamiliar operation inspection can be prevented. be able to.

Further, at this time, as shown by 407 in FIG. 6, by using the color of the rectangle for highlighting, changing the thickness of the line, blinking, etc., the operator can operate that portion with priority. It can be inspected or the operator can be instructed to carefully inspect and operate the part.

The implementation method related to this embodiment is also UI
Use the object described in DL. Control computer 10
2 sends the data to the workstation 104 and the data sent from the database 115 in step 7
02 in the process database 610. When a command to specify an operation inspection target is sent to the operation inspection target object in steps 702 and 703, the data 611 in the process database 610 is referred to as the corresponding operation in step 704, and the data value In order to allow the operator to specify the details of the operation inspection target as described above, in order to send a display command to the object corresponding to the target of the details or to specify the target preferentially. , Perform operations such as more highlighting.

On the other hand, the operator operates the user ID input unit 1301.
The user ID input to the user ID is passed to the object corresponding to the user ID input unit 1301 through steps 702 and 703. In step 704, this user ID is held in the display attribute definition content 502. In step 704, the object in the image that has received the command to perform the highlighting for designating the operation inspection target is the user ID held by the object corresponding to the user ID input unit.
Refer to to decide whether to highlight or not, and highlight those that are the target of operation inspection.

Next, the seventh embodiment will be described. This embodiment is an extension of the fourth embodiment, and is based on the process data issued by the controlled object 101 or the data on the controlled object such as the operator's ID and group ID and the operator who performs the operation and inspection. It determines the inspection and operation details to be executed by.

For example, in FIG. 14, when the operation or inspection of the target is performed by designating the target operation inspection target 401 on the image with the cursor 304, when the process data regarding the target is an abnormal value. Is
The system performs detailed operations and inspections on the target. If not, get it done easily. This allows ITV
When an abnormality is found while looking at the camera image, the operation and inspection corresponding to the abnormality are automatically performed by designating the target. In addition, it is possible to simplify the input operation of the operator.

In FIG. 17, the operator inputs an ID into the user ID input unit 1301 to determine the inspection and operation contents to be executed when the operator specifies the operation inspection target. By specifying the device highlighted in the image, the operation to be performed and the inspection content are determined by the group ID and the ID entered in the user ID input section, and the tasks such as inspection and operation in the group are shared. can do. In addition, it is possible to prevent erroneous operations and inspection operations by partially restricting the execution of the inspection operation contents depending on the operator.

The method for realizing this embodiment is almost the same as the method for realizing the sixth embodiment. In step 702, the process data is held in the process database 610. When an event for executing an operation inspection is received in steps 702 and 703, the data 611 in the process database 610 is referred to as a corresponding operation, the value of the data is evaluated, and the operation to be executed and the inspection content are determined and executed. Such an operation is executed in step 704. Similarly, the user ID input by the operator to the user ID input unit 1301 is passed to the object corresponding to the user ID input unit 1301, and this user ID is held in the display attribute definition content 502 in step 704. When performing the operation inspection, an operation of deciding and executing the operation inspection content by referring to the user ID held by the object corresponding to the user ID input unit is executed in step 704.

The fifth embodiment can be expanded as follows by the same method as in the sixth and seventh embodiments. That is, the content of the related information extracted by the operator selecting a target on the image is determined by the value of the process data or the operator ID. As a result, the operation inspection procedure, operation inspection manual, and the like depend on the target situation at the time of reference and the operator who referred to the information, and the necessary information can be obtained more easily.

Next, an eighth embodiment will be described. This embodiment is an extension of the first embodiment. As shown in FIG. 18, when the boiler A 401 is operated and inspected by designating an item 406 by using the cursor 304, not only the rectangle 407 is displayed and the operation inspection target is highlighted on the image, but also displayed. The process data 1401, 1402, 1403 related to the target among the process data in the inside are changed in color or blinked to perform highlighting. Further, as shown in FIG. 6, when operating and inspecting, not only the operation inspection target is highlighted on the image, but also the target related to the target is highlighted. For example, in FIG. 6, the boiler A401 is the target of operation inspection, and the boilers B402 and C403 are highlighted as the equipment related thereto. Here, the operation inspection target and the target related thereto can be distinguished by the color of the highlighted rectangle, the thickness of the line, blinking, highlighting, or the like. In this way, when carrying out operations and inspections, by highlighting not only the operation / inspection target in the video but also the process data related to it and the target in the related video,
It is possible to comprehensively show the operator the operation inspection target in detail.

In the method of realizing these embodiments, in the first embodiment, the related video object and the related process data are displayed on the operation table 602 which defines that the operation inspection target is highlighted. An operation of sending a command for highlighting as described above to a graph object or a table object is added. When this operation is executed in step 704, a command for highlighting is sent to the related video object, graph object, or table object. This command is step 7
02 and 703, the objects are distributed to the respective objects, and in step 704, the respective objects are highlighted as described above.

The ninth embodiment is an extension of the second embodiment in the same manner as the eighth embodiment. That is, in FIG. 18, when the target of the operation inspection is designated, the operator operates the cursor 304
Item 406, the operation inspection target 401 is not only emphasized by displaying a rectangle 407 on the video, but also process data 1401, 1402 related to the target of the process data being displayed. , 1403
Highlight by changing the color of or blinking.

Further, as shown in FIG. 6, when the operation / inspection target is designated, not only the target which can be or is to be operated / inspected on the image is highlighted but also the target related to the target is checked. I'll emphasize it. For example, in FIG.
The boiler A401 is an operation inspection target to be or can be designated by the operator, and the boilers B402 and C403 are highlighted as the equipment related thereto. Here, the object that can be or should be inspected for operation and the object related thereto can be distinguished from each other by the color of the highlighted rectangle, the thickness of the line, blinking, highlighting, or the like. As a result, when the operation inspection target is specified, it is possible to specify the operation inspection object in the image that can be or should be executed, the object in the image related thereto, the related process data being displayed, and the like.

In this embodiment, as in the eighth embodiment, the related video object and the related process data are added to the operation table 602 which defines that the operation checkable or the object to be executed is highlighted. Add an operation to send a command to highlight the displayed graph object or table object. Step 70
When this operation is executed in 4, the command for highlighting is sent to the related video object, graph object, and table object. This command is issued in steps 702 and 7
It is distributed to each object in 03, step 7
At 04, the respective objects are highlighted as described above. It can be implemented by combining the implementation methods of the eighth embodiment and the second embodiment.

[0115]

According to the present invention, a supervisory control target is operated,
At the time of inspection, the object during the operation inspection and the object for which the operation inspection can be or should be performed are highlighted on the image, so that it is possible to prevent a mistake in selecting an object and to clarify the operation inspection object. The operator can select the operation inspection target after well understanding the situation of the site, and can sufficiently understand the condition of the target of which the operation inspection is currently performed.

Further, by designating the operation inspection target on the image, the operation inspection of the target can be carried out. In this case, if the abnormality can be seen by looking at the image, it may be designated as an operation inspection target with a pointing device such as a mouse. In addition, it is important for the operator to confirm when operating or inspecting, but this confirmation can also be performed by grasping the situation of the site by performing it on the image showing the monitoring target. By realizing these, the operator can operate and inspect as if he / she were in the field while in the operation room.

Further, by determining the operation contents and inspection contents to be carried out at that time depending on the situation of the controlled object, and by deciding what can be selected as the object, an appropriate operation or inspection can be carried out. In addition, at this time, by emphasizing only the object to be inspected on the image or changing the highlighting method according to the importance or priority of the operation and inspection, the operator can specify the object more accurately. You can

Furthermore, by designating the target on the video,
Information on the operation inspection status, operation inspection procedure, operation inspection contents, other related process data, other objects in the related video, etc. can be retrieved. Further, by displaying the position where these are displayed in the immediate vicinity of the object on the image, it becomes easy to simultaneously refer to the object in the image and its data. In addition, even in the data already displayed on the trend graphs and tables, the overall plant diagram, etc., by emphasizing related items, comprehensive monitoring,
It is possible to realize the operation.

[Brief description of drawings]

FIG. 1 is a configuration diagram of a monitoring device according to an embodiment of the present invention.

FIG. 2 is a block diagram of the inside of a data display / input acceptance computer (workstation) shown in FIG.

FIG. 3 is a diagram showing an example of a display screen displayed on a display.

FIG. 4 is a diagram showing an inspection item menu.

FIG. 5 is a diagram showing an example of highlighted display.

FIG. 6 is a diagram showing another example of highlighted display.

FIG. 7 is an object configuration diagram.

FIG. 8 is a configuration diagram of event attribute definition contents.

FIG. 9 is a configuration diagram of display attribute definition contents.

FIG. 10 is a configuration diagram of display attribute definition contents of a camera object.

FIG. 11 is a flowchart showing a processing procedure of the monitoring device according to the embodiment of the present invention.

FIG. 12 is a diagram for creating the ITV camera control information and the three-dimensional model of the operation inspection target that the object has, and the position and size of the operation inspection target that can be placed in the image from the model.

FIG. 13 is a diagram showing another example of highlighted display.

FIG. 14 is a diagram showing still another example of highlighted display.

FIG. 15 is a diagram showing still another example of highlighted display.

FIG. 16 is a diagram showing still another example of highlighted display.

FIG. 17 is a diagram showing an example of an ID input screen.

FIG. 18 is a diagram showing still another example of highlighted display.

[Explanation of symbols]

101 ... Control, monitoring target, 102 ... Data collection and monitoring target control unit (control computer), 104 ... Display and operator input reception computer (workstation), 105 ...
CRT, 106 ... Operator input receiving device, 107 ... ITV
Camera, 115 ... Database, 301 ... Process data display area, 302 ... Camera image display area from ITV camera, 304 ... Cursor, 305 ... Trend graph,
405 ... Operation inspection item menu, 401 ... Operation inspection target (boiler A).

 ─────────────────────────────────────────────────── ─── Continued Front Page (72) Inventor Koichiro Tanikoshi 4026 Kujicho, Hitachi City, Hitachi, Ibaraki Prefecture Hitachi Research Laboratory, Ltd. (72) Shinya Tanifuji 4026 Kujicho, Hitachi City, Ibaraki Prefecture Hitachi, Ltd. Hitachi, Ltd. (72) Inventor Atsuhiko Nishikawa 52-1 Omika-cho, Hitachi City, Ibaraki Hitachi Ltd. Omika Plant, Hitachi Ltd. (72) Inventor Atsuhiko Hirota 5-2-1 Omika, Hitachi City, Ibaraki Hitachi Ltd. Omika factory

Claims (27)

[Claims] 1. A monitoring device comprising a display for displaying a video image of a monitoring target and an input receiving means for receiving an operation input of an operator, wherein a target of operation or inspection is displayed on the video image displayed on the display. A surveillance device comprising means for distinguishing and displaying the target from other display objects on the video image. 2. A video image in which a target being operated or inspected is displayed on a display in a monitoring device including a display for displaying a video image of a monitoring target and an input receiving means for receiving an operation input of an operator. A monitoring apparatus comprising means for distinguishing and clearly indicating the target from other display objects on the video image. 3. A monitoring device comprising a display for displaying a video image of a monitored object and an input receiving means for receiving an operation input of an operator, wherein the operator specifies an object on the video image displayed on the display. A monitoring device comprising means for performing an operation or an inspection on the object at the time. 4. A monitoring device comprising a display for displaying a video image of a monitoring target and an input receiving means for receiving an operation input of an operator, wherein the operator specifies an object on the video image displayed on the display. A monitoring device comprising means for displaying information on the target on a display or distinguishing it from other display objects. 5. A monitoring device comprising a display for displaying a video image of a monitoring target and an input receiving means for receiving an operation input of an operator, wherein the video image displayed on the display when the operator specifies the target. 2. A monitoring device, comprising means for displaying the target by distinguishing it from other display objects on the video image. 6. In a monitoring device comprising a display for displaying a video image of a monitoring target and an input receiving means for receiving an operation input of an operator, the operator designates the target on the video image displayed on the display. At this time, the monitoring device is provided with means for displaying related information of the target related to the designation near the designation target display. 7. A monitoring device comprising a display for displaying a video image of a monitoring target and an input receiving means for receiving an operation input of an operator, in a video image displaying the target when the operator designates the target object. The target position of
And a means for clearly indicating the relevant information of the designated target at a position determined from the position of the information on the target displayed on the display. 8. The monitoring target and the monitoring according to claim 1,
Data collecting and holding means for collecting and holding data relating to the operator who performs control and the operation history performed by the operator, and the operation specified on the video image by the data in the data holding means and the object to be inspected are determined. And a monitoring device. 9. The device according to claim 8, further comprising means for collecting data from a monitoring target, and means for deciding a target which can be operated or inspected for operation inspection clearly shown on a video image based on a value of the collected data. Monitoring device characterized by. 10. The data holding means for holding information about an operator who inputs an operation / inspection command according to claim 8, and the data holding means for performing or inspecting an operation inspection clearly indicated on a video image. A monitoring device comprising means for making a decision using information about an operator on the means. 11. The data collection and holding unit according to claim 3, which collects and holds data related to a monitoring target, an operator who performs monitoring and control, and an operation history performed by the operator, and a video image displayed on the display. A monitoring device comprising means for deciding the contents of an operation or inspection to be executed when an object therein is selected by an operator, based on the data in the data holding means. 12. The means for collecting data from a monitored object according to claim 11, and the contents of operation and inspection to be executed when the operator specifies the object in the video image displayed on the display by the collected data. A monitoring device comprising means for determining. 13. The data holding means for holding information about an operator who inputs an operation / inspection command according to claim 11, and is executed when an object in a video image displayed on the display is designated by the operator. A monitoring device comprising means for determining the contents of operation and inspection by using information about an operator on a data holding means. 14. A monitoring device comprising a display for displaying a video image of a monitoring target and an input receiving means for receiving an operation input of an operator, and an object designated by the operator on the video image displayed on the display. Is provided so as to be clearly distinguished from other display objects on the video image. 15. The monitoring device according to claim 6 or 7, further comprising means for highlighting an object displaying related information on a video image displayed on the display. 16. A means for collecting data from a monitored object, a data display means for displaying the data, and an object under operation inspection or operation inspection on a video image displayed on the display according to claim 1 or 2. A monitoring device comprising: means for highlighting an object that can be performed or to be executed; and means for displaying data related to the highlighted object. 17. The means according to claim 1 or 2, wherein the video image displayed on the display is highlighted with means for highlighting an object under operation inspection or an object for which operation inspection can be performed or should be performed. A surveillance device comprising means for highlighting an object in a video image associated with the object. 18. The monitoring device according to claim 1, further comprising means for displaying priority or importance of an object to be subjected to operation inspection on a video image displayed on a display. 19. The data collection and holding means for collecting and holding data relating to a monitoring target, an operator who performs monitoring and control, and an operation history performed by the operator, and operation by data in the data holding means. A monitoring device, comprising: means for determining the priority or importance of an object to be inspected. 20. The device according to claim 19, further comprising means for collecting data from the monitoring target, and means for determining the priority or importance of the object to be subjected to the operation inspection based on the value of the collected data. Monitoring equipment. 21. The data holding means for holding information about an operator who inputs an operation / inspection command according to claim 19, and a priority or importance of an object to be subjected to an operation / inspection clearly indicated on a video image. A monitoring apparatus comprising means for making a decision using information about an operator on the data holding means. 22. A monitoring device for displaying a video image of a monitored object with a plurality of cameras and displaying the video image on the screen, wherein a means for displaying instruction data indicating each of the monitored objects on the screen and one of the instruction data. Means for selecting a camera for photographing the surveillance object according to the designation, means for sending a control command to the selected camera to photograph the surveillance object for the designation, and the camera. And a means for displaying the video image according to the above-mentioned on the screen and distinguishing the display of the monitored object according to the designation from other display objects of the video image. 23. In a monitoring device for shooting a monitoring target with a plurality of cameras and displaying the video image on the screen, means for determining whether or not there is an abnormality in output data of each monitoring target,
When an abnormality occurs, means for selecting a camera for photographing the abnormality monitoring target object, means for sending a control command to the selected camera to cause the abnormality monitoring target object to be photographed, and a video image by the camera. And a means for displaying the abnormality monitoring target on the screen separately from other display objects of the video image. 24. In a surveillance device comprising at least one camera for photographing a surveillance target and a display for displaying an image from the camera, a means for storing a subject name projected by the camera for each camera and a camera are provided. A monitoring device comprising: means for referring to position information of the target from the information to be controlled and the stored target name; and means for determining the target in the video based on the referred position information. 25. Claims 1, 2, 5, 8, 9, 10, 1
4,15,16,17,18,19,20,21,2
2 or 23, the explicit or highlighted display is a means of displaying graphics on an object in a video image in a superimposed manner, deleting the graphics, blinking, or changing the color. A monitoring device characterized by the above. 26. Claims 1, 2, 5, 8, 9, 10, 1
In any one of 4, 15, 16, 22, and 23, the object is clearly indicated in the video image by sending a camera control command to the camera that shoots the monitored object or switching to a camera that can better shoot the object, A monitoring device characterized by displaying a magnified image of. 27. In a monitoring device comprising a display for displaying a video image of a monitoring target and an input receiving means for receiving an operation input of an operator, the operator displays the inspection target on the video image displayed on the display. When specified, the display of the target object is highlighted from other display objects in the video image, and the operator performs inspection by monitoring the highlighted video image. An inspection method characterized in that when there is a confirmation input from the reception means, the confirmation input is shown on the screen.