JP2010055263A - Monitoring control system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily and safely control each of apparatuses in a plant by using an external central monitoring device. <P>SOLUTION: An image processing device 20 includes: an image transmitting means 212 transmitting control panel imaging data input from a camera to the central monitoring device; a collation processing means 213 collating received coordinates with coordinate data to identify a selected operation part; and a screen transmitting means 214 transmitting operation screen data to be used for operation of the operation part to the central monitoring device. The central monitoring device includes: a first display processing means 311 displaying the imaging data on a display device, a first transmitting means 312 transmitting the coordinates of the selected operation part to the image processing device, a second display processing means 311 displaying the operation screen data on the display device, and a second transmitting means 312 transmitting an input operation signal to the plant. The plant 10 includes a controller 12 operating the apparatuses according to the operation signal received from the central monitoring device. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a monitoring control system for monitoring and controlling each device of a plant.

  In a plant such as a water and sewage plant, it is important to perform monitoring control so that the plant can be in a stable operation state, and monitoring control using a sensor is common (for example, see Patent Document 1). In recent years, remote monitoring of systems has been performed in various fields (see, for example, Patent Document 2), but remote monitoring may also be performed in plant monitoring control.

  For example, as shown in FIG. 11, an operation panel 11 at the site (inside the plant) and a central monitoring device 30 provided in an operator room or the like away from the site are used for monitoring control of a plant such as a water and sewage plant. .

For the operation of the plant 10, for example, a plurality of devices (not shown) such as pumps, valves, and sensors are used. Generally, during normal operation, these devices are centrally monitored by an operator. Monitoring and control are performed using the device 30. On the other hand, in the event of an emergency such as during maintenance or when an abnormality occurs, an operator, an engineer, etc., goes to the place where the equipment and the operation panel 11 for operating the equipment are installed, and controls using the situation that can be grasped by the operation panel 11. To do.
JP 2000-107744 A JP 2005-108217 A

  In view of the above problems, the present invention provides a monitoring control system for easily and safely controlling each device of a plant using an external central monitoring device.

  A monitoring control system according to a feature of the present invention includes a camera that captures an operation panel having an operation unit that operates each device of a plant, an image processing apparatus that inputs and processes captured image data captured by the camera, A monitoring control system comprising a central monitoring device that monitors and controls the plant using the captured image data, the image processing device responding to a request for requesting transmission of captured image data on the operation panel, From the image transmission means for transmitting the captured image data of the operation panel input from the camera to the central monitoring device, the coordinate data storage unit for storing the coordinate data of the operation unit in the captured image data, and the central monitoring device Collation processing means for collating with the coordinate data and identifying the selected operation unit upon receiving the coordinates of the operation unit selected on the captured image data; A screen data storage unit for storing operation screen data used when operating the operation unit with the central monitoring device, and an operation screen data used for operation of the operation unit specified by the collation processing unit. Screen transmitting means for reading from the central monitoring device and transmitting to the central monitoring device, the central monitoring device comprising: a first display processing means for displaying the captured image data received from the image processing device on a display device; and an input device. When an operation unit is selected on the photographed image data via the first transmission means for transmitting the coordinates of the selected operation unit to the image processing device, and receiving from the image processing device in response to the coordinate data A second display processing means for displaying the operation screen data on a display device; and an operation signal for operating the plant equipment on the operation screen data via an input device. When a force, and a second transmission means for transmitting an operation signal input to the plant, the plant comprises a control device to operate the equipment in accordance with an operation signal received from the central monitoring unit.

  ADVANTAGE OF THE INVENTION According to this invention, each plant apparatus can be monitored and controlled easily and safely using an external central monitoring apparatus.

  A monitoring control system according to the best embodiment of the present invention will be described below with reference to the drawings. In the following description, the same components are denoted by the same reference numerals and description thereof is omitted.

  As shown in FIG. 1, a monitoring control system 1a according to the best embodiment of the present invention includes a plant 10 that is a monitoring control target, and an image processing device 20 that receives and processes captured image data captured by the plant 10. And a central monitoring apparatus 30 that receives the captured image data processed from the image processing apparatus 20 and monitors and controls equipment (not shown) included in the plant 10 using the captured image data. Has been.

<plant>
The plant 10 is operated by a plurality of devices such as sensors, pumps or valves, and an operation signal received from the central monitoring device 30 via an operation panel 11 for operating these devices and a network 40 connected thereto. Are provided with a control device 12 for controlling the operation of the device and a camera 13 for photographing the operation panel 11.

  The operation panel 11 includes operation units 111 and 112 such as operation buttons and operation levers, and the operation units 111 and 112 are operated by the operator to control the operation of the equipment of the plant 10. The operation panel 11 includes a display unit that displays a measurement result obtained by a sensor that measures the state of the device operated by the operation units 111 and 112.

  The control device 12 is, for example, a general computer having a central processing unit, a storage device, a communication interface, and the like. When an operation signal is input from the central monitoring device 30 via the network 40, the control device 12 controls devices connected to the operation panel via the operation panel 11. The control device 12 may be directly connected to the device and may control the device without using the operation panel 11.

  The camera 13 is a camera that captures the state of the operation panel 11 such as the operation units 111 and 112 of the operation panel 11 and a display unit that displays a measurement result by the sensor. To the image processing apparatus 20.

  FIG. 2 is an example of a captured image of the camera 13. Since the camera 13 is fixed so that the operation units 111 and 112 and the display unit of the operation panel 11 can be grasped, the operator refers to the captured image captured by the camera 13, so The control state can be grasped. For example, when the operator is operating the operation panel 11 at the site, the camera 13 takes a picture of the operating operator together with the operation panel 11 as shown in FIG.

  In FIG. 1, only one operation panel 11 and camera 13 are shown. However, since a plurality of devices are operated by the plurality of operation panels 11 in the plant 10, a plurality of operation panels 11 and cameras 13 are also provided. ing.

<Image processing device>
The image processing apparatus 20 is a general computer including a central processing unit (CPU) 21, a storage device 22, a communication interface (communication I / F) 23, and the like, and requires captured image data received from the plant camera 13. Then, the data is transmitted to the central monitoring device 30.

  In the central processing unit 21, an image processing unit 211, an image transmission unit 212, a collation processing unit 213, and a screen transmission unit 214 are mounted by installing an image processing program. The storage device 22 stores coordinate data 221 and screen data 222.

  As shown in FIG. 3, the coordinate data 221 is data that associates the “coordinates” of the captured image with the “operation unit identifier” that identifies the operation unit of the operation panel 11 existing at the position represented by these coordinates. . Since the photographing field of view of the camera 13 is fixed, the operation units 111 and 112 are always on the same coordinates. Therefore, in the coordinate data 221, the operation unit identifier is associated with the coordinates representing the position where the operation units 111 and 112 exist.

  FIG. 4 shows an example in which an image photographed by the camera 13 is divided into 8 × 6 blocks and each block is represented as coordinates. In the example shown in FIG. 4, when each block is represented by coordinates (x, y), the changeover switch is present at a position represented by coordinates (5, 4), and the first pump switch is (4, 6). The second pump switch exists at a position indicated by coordinates (5, 6).

  Note that the plurality of operation panels 11 in the plant have different configurations, and the photographing field of view of the camera 13 is different, so that the same coordinate data 221 cannot be used. Therefore, the storage device 22 stores coordinate data 221 in which different “coordinates” and “operation unit identifiers” are associated with each camera 13. Here, each camera 13 stores coordinate data 221 in association with an identifier of the operation panel in order to photograph the determined operation panel 11.

  The screen data 222 is operation screen data used when control corresponding to the operation of each operation unit 111, 112 is performed from the central monitoring device 30, and is associated with an operation unit identifier for identifying the operation unit 111, 112. It is stored in the storage device 22. For example, the operation screen data corresponding to the second pump switch of the operation panel 11 shown in FIG. 2 is data for displaying the operation screen as shown in FIG.

  The image processing unit 211 receives captured image data transmitted from the camera 13 via the communication interface 23. Further, the image processing unit 211 converts the received captured image data into a format suitable for the central monitoring device 30 and stores it in a memory (not shown). Here, the image processing unit 211 does not need to convert all the captured image data received from the camera 13. That is, the image processing device 20 receives the captured image data from the plurality of cameras 13 in the plant 10, but the images that are simultaneously displayed on the central monitoring device 30 are limited. Accordingly, when the image processing unit 211 receives a request for requesting transmission of captured image data from the central monitoring device 30, it converts only the captured image data received from the camera 13 that captures the operation panel 11 specified by this request. Just do it.

  The image transmission unit 212 transmits the captured image data converted by the image processing unit 211 to the central monitoring device 30 via the communication interface 23 and the network 40. Specifically, when receiving a request for requesting transmission of captured image data from the central monitoring device 30, the image transmission unit 212 transmits the captured image data of the operation panel 11 specified by this request to the central monitoring device 30. .

  The collation processing unit 213 receives the coordinate data including the coordinates (hereinafter referred to as “selected coordinates”) transmitted from the central monitoring device 30 and the identifier of the operation panel via the communication interface 23. The collation processing unit 213 collates the received selected coordinates with the coordinates included in the coordinate data 221 specified by the identifier of the operation panel, and extracts the operation unit identifier associated with the coordinates matching the selected coordinates. For example, when (5, 6) is received as the selected coordinate, “second pump switch” is extracted as the operation unit identifier from the coordinate data 221 shown in FIG.

  The screen transmission unit 214 reads the screen data 222 identified by the operation unit identifier extracted by the collation processing unit 213 from the storage device 22 and transmits it to the central monitoring device 30 via the communication interface 23 and the network 40.

  For example, if the coordinate data 221 does not include coordinates that match the received selected coordinates, the collation processing unit 213 determines that a malfunction has occurred, and the screen transmission unit 214 sends an error signal to the central monitoring device 30. If the data is transmitted and displayed on the display device 33 by the central monitoring device 30, the operator can correctly select the operation units 111 and 112 again.

<Central monitoring device>
The central monitoring device 30 is a computer including a central processing unit (CPU) 31, a communication interface (communication I / F) 32, a display device 33, an input device 24 and the like, and monitors and controls the plant 10 via the network 40. . The display device 33 is a general display, and the input device 24 is a keyboard, a mouse, a touch panel, or the like. Here, since the input device 34 may be composed of a plurality of elements, the central monitoring device 30 can include all of a keyboard, a mouse, and a touch panel as the input device 34, and yet another A device may also be included as input device 34.

  The central processing unit 31 is equipped with a display processing unit 311 and a transmission unit 312 by installing a monitoring program.

  The display processing unit 311 displays an image or the like necessary for monitoring control on the display device 33. For example, the display processing unit 311 displays, for example, the captured image shown in FIG. 2 on the display device 33 based on the captured image data captured by the plant camera 13 received from the image processing device 20. Further, the display processing unit 311 displays, for example, the operation screen illustrated in FIG. 5 on the display device 33 based on the operation screen data received from the image processing device 20.

  The transmission unit 312 transmits various requests to the image processing apparatus 20 via the communication interface 32 and the network 40 according to the operation of the input device 34. For example, when it is desired to display a captured image on any of the operation panels 11 in the plant 10, the transmission unit 312 transmits a captured image request for requesting transmission of captured image data to the image processing apparatus 20. This photographed image request includes an operation panel identifier for identifying the selected operation panel 11.

  When the operation units 111 and 112 included in the operation panel 11 on the display screen are selected and display of the operation screens of the operation units 111 and 112 is desired, the transmission unit 312 requests transmission of the operation screen data. Send an operation screen request. This operation screen request includes the identifier of the operation panel and the selected coordinates on the selected display screen. When the touch panel provided on the display device 33 is the input device 34, the operator can select the coordinates of the operation units 111 and 112 by touching the display device 33.

<< Monitoring process >>
Next, processing in the monitoring control system 1a will be described using the sequence diagram shown in FIG. As shown in FIG. 6, in the plant 10, the operation panel 11 to which the camera 13 corresponds is imaged, and the captured image data is transmitted to the image processing device 20 (S1, S2).

  In the central monitoring device 30, it is determined that the operator has the authority to operate (S3), and in the monitoring control system 1a, the central monitoring device 30 is set to a mode in which the plant 10 can be operated. Is determined (S4), the central monitoring device 30 can control the plant 10. When the central monitoring device 30 selects an operation panel identifier of the operation panel 11 to be operated via the input device 34 (S5), the transmission means 312 takes a captured image including the selected operation panel identifier. The request is transmitted to the image processing apparatus 20 (S6).

  The image processing apparatus 20 performs image processing on the captured image data received from the camera 13 that captures the operation panel 11 identified by the identifier of the operation panel received in step S6 among the captured image data received from the plant 10. Then, it is converted into a format suitable for the central monitoring apparatus 30 (S7). Thereafter, the image transmission unit 212 transmits the captured image data converted by the image processing unit 211 to the central monitoring device 30 (S8).

  In the central monitoring device 30, the display processing unit 311 displays the captured image as shown in FIG. 2 on the display device 33 based on the captured image data received from the image processing device 20 (S9). When the operation units 111 and 112 to be operated are selected from the shooting screen displayed on the display device 33 via the input device 34 (S10), the transmission unit 312 selects the coordinates (selected coordinates) of the selected position. ) Including the operation screen request is transmitted to the image processing apparatus 20 (S11).

  The collation processing means 213 of the image processing apparatus 20 collates the received coordinate data with the screen data 222 (S12), and extracts operation screen data identified by the operation unit identifier specified by the received coordinate data (S13). ). Thereafter, the screen transmission unit 214 transmits the extracted operation screen data to the central monitoring device 30 (S14).

  In the central monitoring device 30, the display processing means 311 displays the operation screen as shown in FIG. 5 on the display device 33 based on the operation screen data received from the image processing device 20 (S15). When an operation of the operation units 111 and 112 is input via the input device 34 using the operation screen displayed on the display device 33 (S16), the transmission unit 312 transmits the input operation signal to the image processing device 20. (S17).

  In the plant 10, equipment is controlled according to the operation signal input from the central monitoring device 30 (S18).

  As described above, according to the monitoring control system 1 a according to the best embodiment of the present invention, even when the plant 10 is remotely operated from the central monitoring device 30, it is the same as when operating the operation panel 11. Visual information is obtained and can be operated using this visual information. Therefore, the operation of the operator becomes easy.

<First Modification>
Subsequently, a monitoring control system 1b according to a first modification will be described with reference to FIG. The monitoring control system 1b according to the first modified example is different from the monitoring control system 1a described above with reference to FIG. 1 in the method of selecting the coordinates of the operation units 111 and 112 to be operated from the captured image. Specifically, in the monitoring control system 1a, the image processing apparatus 20 uses coordinate data 221 that specifies the operation units 111 and 112 from two-dimensional coordinates represented by (x, y). On the other hand, in the monitoring control system 1b according to the first modification, the operation units 111 and 112 are specified by three-dimensional coordinates represented by (x, y, z).

  Therefore, in the monitoring control system 1b, the central monitoring device 30 includes the three-dimensional sensing device 35 that grasps the operator's operation in three dimensions, and the transmission unit 312 transmits the three-dimensional selected coordinates as an operation screen request. For example, as shown in FIG. 8, the three-dimensional sensing device 35 includes a plurality of cameras 35 a to 35 c, and detects the movement of the operator's hand from the captured images obtained by the cameras 35 a to 35 c to perform tertiary processing. It is a device for obtaining original coordinates. In the three-dimensional sensing device 35, a sensor may be used in addition to the camera.

  In the image processing device 20, the storage device 22 stores three-dimensional coordinate data 223 in which the three-dimensional coordinates and the operation unit identifier are associated instead of the coordinate data 221. When the selected coordinates are three-dimensional, the coordinates used for collation are also three-dimensional coordinates. For example, as shown in FIG. 9, the three-dimensional “coordinates” and the operation unit specified by these coordinates are identified. 3D coordinate data 223 associated with the “operation unit identifier” is stored.

  As described above, according to the monitoring control system 1b according to the first modification of the present invention, the central monitoring device 30 includes the three-dimensional sensing device 35. Therefore, since the operator can operate by the same hand movement as operating the operation panel 11, the operator's operation is further facilitated.

<Second modification>
Next, a monitoring control system 1c according to a second modification will be described with reference to FIG. The monitoring control system 1c according to the second modification is received by the control device 12, the image processing device 20, and the central monitoring device 30 of the plant 10 as compared with the monitoring control system 1c described above with reference to FIG. Error determining means for detecting data errors is provided.

    Specifically, the control device 12 includes an error determination unit 121 that detects an error in an operation signal received from the central monitoring device 30. In addition, the image processing device 20 includes a captured image request received from the central monitoring device 30 and an error determination unit 215 that detects an error in the operation screen request. The central monitoring device 30 includes error determination means 313 that detects an error in the captured image data received from the image processing device 20 and the operation screen data.

  For example, each device 12, 20, and 30 transmits data to be added with parity check data, and each error determination means 121, 215, and 313 receives data received from the other devices 12, 20, and 30. Perform error checking for.

  When the error determination unit 121 detects an error in the received operation signal, the error determination unit 121 invalidates the operation signal received from the central monitoring device 30 and does not perform an operation based on the operation signal. At this time, the error determination means 121 transmits an error notification to the central monitoring device 30 and the central monitoring device 30 displays an error so that the operator can know the error.

  When the error determination unit 215 detects an error in the received captured image data, the error determination unit 215 does not perform subsequent processing on the captured image data received from the camera 13 of the plant 10. At this time, the error determination means 215 can notify the plant 10 of the error and notify the abnormality of the camera 13.

  In addition, when the error determination unit 215 detects an error in the received captured image request or operation screen request, the error determination unit 215 does not transmit data for responding that the request received from the central monitoring device 30 is invalid. At this time, the error determination means 121 transmits an error notification to the central monitoring device 30 and the central monitoring device 30 displays an error so that the operator can know the error. The central monitoring device 30 may output an error by sound in addition to the error display.

  When the error determination unit 313 detects an error in the received captured image data or operation screen data, the error determination unit 313 invalidates the data received from the image processing device 20 and does not display the captured image or operation screen on the display device 33. At this time, the error determination unit 121 may transmit an error notification to the image processing apparatus 20, or may transmit a request again.

  As described above, according to the monitoring control system 1a according to the second modification of the present invention, each of the devices 12, 20, and 30 detects an error in the received data. Therefore, malfunction can be prevented and the plant 10 can be operated safely.

  Even when there is an error in the received data or when there is an abnormality in the image processing apparatus itself, the plant 10 and the central monitoring apparatus 30 are connected via the network 40, so that the image processing apparatus 20 is not connected. The equipment can be monitored and operated by communication between the plant 10 and the central monitoring device 30.

It is a figure explaining the composition of the supervisory control system concerning the best embodiment of the present invention. It is an example of the picked-up image image | photographed with the camera of a plant. It is an example of the coordinate data utilized with a supervisory control system. It is a figure showing the relationship between a picked-up image and a coordinate. It is an example of the operation screen utilized with a monitoring control system. It is a sequence diagram explaining the process performed with the monitoring control system of FIG. It is a figure explaining the structure of the monitoring control system which concerns on a 1st modification. It is a figure explaining an example of the three-dimensional sensing apparatus utilized with the monitoring control system which concerns on a 1st modification. It is an example of the three-dimensional coordinate data utilized with the monitoring control system which concerns on a 1st modification. It is a figure explaining the structure of the monitoring control system which concerns on a 2nd modification. It is a figure explaining the structure of the conventional monitoring control system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1a-1c ... Monitoring control system 10 ... Plant 11 ... Operation panel 111,112 ... Operation part 12 ... Control apparatus 121 ... Error determination means 13 ... Camera 20 ... Image processing device 21 ... Central processing unit 211 ... Image processing means 212 ... Image Transmission unit 213 ... collation processing unit 214 ... screen transmission unit 215 ... error determination unit 22 ... storage device (coordinate data storage unit, screen data storage unit)
221: Coordinate data 222 ... Screen data 223 ... Three-dimensional coordinate data 23 ... Communication interface 24 ... Input device 30 ... Central monitoring device 31 ... Central processing unit 311 ... Display processing means 312 ... Transmission means 313 ... Error determination means 32 ... Communication interface 33 ... Display device 34 ... Input device 35 ... Three-dimensional sensing device 35a-35c ... Camera 40 ... Network

Claims (5)

A camera that captures an operation panel having an operation unit that operates each device of the plant, an image processing device that inputs and processes captured image data captured by the camera, and monitors the plant using the captured image data A monitoring control system comprising a central monitoring device for controlling,
The image processing apparatus includes:
In response to a request for requesting transmission of captured image data of the operation panel, image transmission means for transmitting captured image data of the operation panel input from the camera to the central monitoring device;
A coordinate data storage unit for storing coordinate data of the operation unit in captured image data;
When receiving the coordinates of the operation unit selected on the captured image data from the central monitoring device, collation processing means for collating with the coordinate data and identifying the selected operation unit;
A screen data storage unit for storing operation screen data used when operating the operation unit with the central monitoring device;
Screen transmission means for reading operation screen data used for operation of the operation unit specified by the collation processing means from the screen data storage unit and transmitting it to the central monitoring device;
The central monitoring device is
First display processing means for displaying on the display device the captured image data received from the image processing device;
A first transmission unit configured to transmit coordinates of the selected operation unit to the image processing device when an operation unit is selected on the captured image data via the input device;
Second display processing means for displaying on the display device the operation screen data received from the image processing device in response to the coordinate data;
When an operation signal for operating the equipment of the plant is input to the operation screen data via the input device, the second transmission means for transmitting the input operation signal to the plant,
The plant is
A monitoring control system comprising a control device for operating a device in accordance with an operation signal received from the central monitoring device. The coordinates are three-dimensional coordinates,
The central monitoring device has, as an input device, a three-dimensional sensing device that detects an operation by an operator as a change in three-dimensional coordinates,
The first transmission means transmits the three-dimensional coordinates detected by the three-dimensional sensing device to the plant as the coordinates of the selected operation unit,
The monitoring control system according to claim 1, wherein the second transmission unit transmits a change in the three-dimensional coordinates detected by the three-dimensional sensing device to the plant as an operation signal.   The monitoring control system according to claim 1, wherein the plant control device includes an error detection unit that detects an error of an operation signal input from the central monitoring device.   The said image processing apparatus is provided with the error detection means which detects the error of the picked-up image data received from the said plant, and the request received from the said central monitoring apparatus, The Claim 1 characterized by the above-mentioned. Supervisory control system.   The monitoring control system according to claim 1, wherein the central monitoring device includes an error detection unit that detects an error in data received from the image processing device.

Images