JPH10229554A - Supervisory system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a superintendent to easily and surely conduct a monitor and check job. SOLUTION: In a database 3C of a central monitoring control station 3 position information, shape information as to each point and equipment and procedure information linked with an automatic execution procedure program for monitoring and checking are stored. Furthermore, a computer 3B specifies each of equipment by collating a position and a shape of each of equipment on a picked-up image screen 3A1 of a monitoring camera with the position and shape information. In the case of specifying optional equipment on the picked-up image screen, the procedure required for monitoring and checking is automatically executed according to the procedure information of the equipment.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a surveillance system for processing surveillance video captured by a surveillance camera such as an industrial television camera (ITV) system and providing information to a surveillance person. The present invention relates to a monitoring work support system for providing a monitoring person.

[0002]

2. Description of the Related Art In an ITV system, a television camera is installed at a monitoring position, this television signal is transmitted to a monitoring center (centralized monitoring and control station) by a dedicated cable, and the received television signal is displayed on a monitor television. The video is monitored by the observer. A video tape recorder is used for recording / reproducing video.

[0003] As another monitoring system of this kind, a television signal is converted and modulated into a digital video signal and transmitted to a center, and the center side displays a received and decoded video signal on a display device or compresses an intra-frame image. There is a logging system provided with an image processing function such as storing the image as a frame image, expanding the image as necessary, and reproducing and displaying the image.

As a system configuration for obtaining an integrated surveillance environment, a computer (workstation) is used as a central unit, a plurality of cameras are provided, and a function of controlling the positions and angles of the cameras on the center side is provided. There is a digital line network provided with a function of selectively capturing an image signal into a center as a means for transmitting the image signal. Furthermore, there is a function provided with a function of detecting an abnormality of a monitoring target from a temporal change of an image signal, a function of specifying a monitoring target by image analysis or recognition processing, and a function of capturing sound information of a monitoring position.

[0005]

SUMMARY OF THE INVENTION In a monitoring center,
When a monitor monitors and inspects a device to be monitored, generally, the monitor grasps the status of the device based on various types of measurement information, video and sound information obtained from the device to be monitored.

[0006] In such monitoring and inspection work, for monitoring and inspection on a regular basis, an operation of selecting a device to be monitored and an operation of selecting monitoring and inspection conditions are often performed in accordance with a predetermined set of manuals. This can be a tedious and tedious task that can lead to oversight of important monitoring and inspection items.

[0007] In addition, in the procedure table created in advance, monitoring and
It was impossible to obtain an appropriate monitoring status for each monitoring target, for example, there were extra items in the inspection work, and conversely, there were situations where monitoring of small parts was insufficient. Also, changing the equipment to be monitored requires a major change in the procedure table.

It is an object of the present invention to provide a monitoring system for ensuring and facilitating monitoring and inspection work by a monitor.

Another object of the present invention is to provide a monitoring system capable of quickly and easily obtaining appropriate monitoring / inspection information according to a monitoring target.

[0010]

Means for Solving the Problems (First Invention) A monitoring system for monitoring a monitoring target point and equipment by displaying an image of a monitoring target point and equipment captured by a monitoring camera on a display of a centralized monitoring control center. In the database of the centralized monitoring and control station, location information and shape information and monitoring /
The procedure information linked to the automatic execution procedure program for inspection is stored, and the computer of the centralized monitoring control station estimates the position / posture of the surveillance camera, and displays the position / posture on the shooting screen at this position / posture. Means for identifying each device from a comparison between the position and shape of each device and the position and shape information of the database, and the computer, when specifying any device on the shooting screen, A means for executing the automatic execution program according to procedure information is provided.

(2nd invention) The computer calculates a distance or a distance and an angle of the camera to each device on the photographed image, and determines a device whose distance or the distance and the angle are within a set range. A means for executing the automatic execution program according to the procedure information of the device is provided.

(Third invention) A specific position is set in advance on the screen on the display, and the computer is displayed at the specific position in the photographed image of each device displayed on the display. Is determined as a device to be monitored, and means for executing the automatic execution program in accordance with the procedure information of the device is provided.

(Fourth invention) In the database, work procedures such as inspection for each device are registered in advance, and the computer recognizes the position and orientation of the monitoring camera whose movement and photographing angle are controlled. When the surveillance camera reaches a preset position / posture, an automatic execution procedure program is executed from a procedure registered in the database.

(Fifth invention) The database stores still image data of each device and operation data related thereto, and the computer displays an arbitrary image on a display screen of an image taken by the surveillance camera. When a device is designated, a still image data and operation data of the device are extracted from the database, and a means for displaying a still image based on the still image data and accepting an operation based on the operation data is provided.

[0015]

BEST MODE FOR CARRYING OUT THE INVENTION

(First Embodiment) FIG. 1 is a configuration diagram of a main part of a monitoring system according to an embodiment of the present invention. A large number of objects 1A to be monitored in the monitoring area 1 are photographed by the respective monitoring cameras 1B, and their video signals are transmitted to the central monitoring and control station 3 via the network 2 or the like, and the monitoring images 3A ₁ are displayed on the terminal display 3A of the central monitoring and control station 3. Is displayed, and image processing such as frame imaging is performed and stored.

These series of monitoring controls are performed by a computer 3B such as a workstation according to the system configuration. Also, various data required for monitoring and control
It is stored in the monitoring point / device database 3C.

In this embodiment, work procedures such as inspections to be periodically performed are registered in the database 3C, and the work procedures registered automatically according to a predetermined trigger condition are automatically executed. Provide support functions.

The work procedure data to be registered in the database 3C, as shown in FIG. 2, the monitoring target device is separate item 3C ₁ point and devices installed, the shape information of the position information and the device each device is installed and it is provided with a device information 3C ₂ with a procedure information that is automatically executed to the device.

The position information is, for example, position data of each device with respect to the world coordinate system of a marker installed in the area monitored by the camera. The position data is coordinates of the device on an image captured by the camera at an arbitrary shooting position / posture, and is used to specify the device.

To specify the device, the computer estimates parameters such as the position and orientation of the camera from the marker position on the image captured by the camera 1B, and uses the parameters to determine the world coordinates of each device image on the captured image. The computer specifies the device at the position by matching the position of the system with the position information of the database 3C.

The shape information equipment, a wireframe or shading feature point coordinate information of the graphic data upon shooting the device, and the shape information in the case the information is to be displayed the device as a monitoring image 3A _1, position information At the same time, it is used for specifying a device in matching with an image captured by the camera 1B.

[0022] procedure information, the execution condition for executing the procedure is described, and further execution condition is automatic execution procedure program information 3C ₃ which is executed when satisfied link.

In the system having the database described above, the computer 3B estimates the position and orientation of the camera 1B from the photographed image, and determines the position and shape of the device image on the photographed image at this time in each device of the database 3C. By comparing the position information and the shape information of the surveillance camera, it is recognized where and what device is shown in the video from the surveillance camera.

When a pointing device such as a mouse or a touch panel is used to specify an arbitrary device on the screen on a display displaying an image from the surveillance camera, the pointing device indicates which device. The computer determines whether or not the specified device is specified, and specifies the designated device based on the determination result, and executes the automatic execution procedure program using the specified device as the execution condition of the procedure information.

The automatic execution procedure program describes the contents of procedural work such as inspections that are periodically performed. For example,
As shown in FIG. 1, and go and monitor video information 3A ₂ about the specified location and equipment on the display 3A of the supervisory control terminal in parallel or window display, a zoom-up surveillance cameras, mobile monitoring camera If the robot has a magic hand like a robot, it is a procedure program for performing some operation (opening and closing a bubble, etc.) on the device.

Therefore, the work, such as inspection, which is carried out regularly, is performed in the following procedure.

(1) The image from the surveillance camera 1B is displayed on the display of the central monitoring and control station.

(2) The surveillant confirms the device to be monitored through the surveillance camera image while remotely controlling the direction and position of the surveillance camera 1B.

(3) When a device or a point at which a procedure such as an inspection is to be executed is displayed, the observer designates on the screen using a point function such as a mouse connected to the terminal.
At this time, the computer 3B determines which of the devices specified by the image analysis and recognition processing using the position information and the shape information is specified.

(4) From these designations and determination results, the computer searches the device database 3C and executes the procedure described therein. For example, when the device A is designated by a mouse in FIG.
To display as A _2.

Therefore, according to the present embodiment, the monitoring person can quickly and easily obtain detailed monitoring and inspection information by designating the monitoring target, thereby making the monitoring and inspection work sure and easy. Further, the change of the equipment to be monitored requires only the change of the procedure information of the equipment to be changed and the change of the automatic execution procedure program, thereby facilitating the change process.

(Second Embodiment) In the above embodiment,
Execution of the procedure registered in each device is performed under the condition that the monitor specifies and operates the device.

In the present embodiment, the computer automatically determines an appropriate device from the photographing state of the monitoring camera and automatically executes the procedure program, thereby simplifying the monitoring operation and eliminating oversight of monitoring.

FIG. 3 is a configuration diagram of a main part for describing the present embodiment. The database 3C stores position information, shape information, and procedure information equivalent to those in FIG. In this configuration, as shown in FIG. 3, when the shooting position of the monitoring camera 1B is moved at time t1, t2, or t3 manually or by time management by a timer, or when the camera posture is changed, the positions of these cameras are changed. The monitoring image on the display 3A of the centralized monitoring and control center 3 changes with the change of the posture.

At this time, the computer 3B
When the position / posture of B stops, it is automatically determined which device to execute the procedure.

In this determination, it is determined that the distance between the device on the image and the camera or the device whose distance and angle are within the set range. In other words, the camera 1B is a device whose distance between the device on the image being photographed by the camera 1B is within a preset distance (for example, 10 m), and the angle of the camera 1B with respect to the device is the preset angle. Devices located within (for example, ± 30 degrees) are determined as inspection target devices.

From this determination result, the computer 3B
The device is determined, the automatic execution procedure program is executed based on the procedure information, and the inspection information 3A ₂ is displayed on the display 3A.
Display a window above.

FIG. 3 shows a case where the camera 1B stops at the position of the device B, and the computer 3B automatically determines this and displays inspection information on the device B.

The method of calculating the distance and angle between the camera and the device is as follows. The position of each device on the image is obtained by image recognition technology, and the position and angle information of the camera is obtained from the relative relationship between this position and the image coordinate information. The distance and the angle can be obtained from the position information and the relative relationship between the position information and the shape information of each device in the database 3C.

As described above, in the present embodiment, the equipment which needs monitoring / inspection is automatically determined based on the photographing state of the camera, and the procedure is automatically executed. In addition, the monitor does not need to perform an operation to specify a device to be inspected, so that the work load on the monitor can be reduced.
In addition, it is possible to prevent an inspection item or an abnormal situation from being overlooked, as compared to monitoring that relies on the eyes of the observer.

(Third Embodiment) In the second embodiment, the computer automatically determines an appropriate device based on the shooting conditions of the monitoring camera, and automatically executes the procedure program. For this purpose, the computer needs a means for calculating the distance or distance and angle of the camera to each device on the captured image, and determining the device whose distance or distance and angle are located within the set range.

In the present embodiment, the calculation / judgment means of the computer is not required, and the apparatus suitable for monitoring can be automatically judged and its procedure program can be automatically executed.

In the present embodiment, a specific position is set in advance on the monitoring video, and the device displayed at this position is determined as a device to be monitored.

FIG. 4 is a configuration diagram of a main part for describing the present embodiment. In the figure, a specific position is defined as the center of the screen, as indicated by a cross at the center of the screen of the monitoring video. In this setting state, when displaying the captured image on the display 3A ₁ by changing the position and orientation of the camera 1B, the computer 3B is each device by referring to the position information and the shape information of each device on the screen Identify, and when any of the devices at the display position including the specific position, or any of the display pixels of the device at the coordinates of the specific position, determine the device as a monitoring target and execute the procedure program. Execute automatically.

In the case of FIG. 4, the device A is determined to be monitored, and its execution program is displayed on the screen in a window.

As described above, in this embodiment, a specific position is designated on the screen of the monitoring video, the device displayed at this position is determined as a monitoring target, and the procedure is automatically executed. Therefore, in addition to the effects of the second embodiment,
The calculation of the distance or distance and angle of the camera to each device on the image captured by the computer and the determination of the device whose distance or distance and angle are within the set range become unnecessary, and the calculation / determination process is simplified. .

(Fourth Embodiment) In the third embodiment,
A specific position is set in advance on the monitoring video, and the device displayed at this position is determined as a monitoring target device. For this purpose, the monitoring procedure is executed only for the device at the specific position set on the monitoring video, the monitoring device is limited by the position and orientation of the camera, and when the position and orientation of the camera is manually operated, Monitoring may be overlooked. In addition, the burden on the observer increases in order to prevent oversight.

In the present embodiment, the oversight of the monitoring is eliminated even in the manual operation of the camera.

In this embodiment, in the system configuration shown in FIG. 1 and the like, work procedures such as inspection are registered in advance in the database 3C of the device to be monitored, and registered when a specific position or posture is reached. By automatically executing the procedure, the burden on the observer is reduced without oversight.

In the configuration shown in FIG. 1, the computer 3B estimates parameters such as the position and orientation of the camera from the marker position on the image taken by the camera 1B, with respect to the position and orientation of the camera whose movement and shooting angle are controlled. From these parameters, the position and orientation of the camera 1B in the world coordinate system are recognized.

According to the position and orientation information of the camera 1B,
When the camera 1B reaches the preset position and posture, the computer 3B executes the automatic execution procedure program from the procedure registered in the database 3C.

Therefore, the work such as the inspection periodically performed is performed in the following procedure as shown in FIG.

(1) An image from the surveillance camera 1B whose position and orientation is controlled manually or automatically is displayed on a display of a centralized monitoring control station.

(2) The observer confirms the device to be monitored through the video of the monitoring camera while remotely controlling the direction and position of the monitoring camera 1B.

(3) Regarding predetermined work procedures such as inspection, when the monitoring camera 1B comes to the set position / posture, the computer 3B searches the database 3C and there is a procedure described therein. It is checked whether or not the procedure is performed (S1). If a procedure exists, the procedure is automatically executed (S2). For example, when the camera reaches a certain position, information on the normal state of the device at that position is displayed on the screen.

(4) When the inspection is performed irregularly or when there is no procedure for the moving position of the camera, an inquiry is made to the observer as to whether or not to execute the procedure manually (S3).
When the procedure is executed manually, the procedure registered in the database 3 </ b> C is executed by the monitor instructing with a mouse or the like.

Therefore, according to the present embodiment, when manually or automatically manipulating the position and orientation of the camera, the observer automatically executes a procedure registered in advance without individual instructions by the observer. In addition, it is possible to reduce the work load of the monitor and prevent the monitoring from being overlooked.

(Fifth Embodiment) The first embodiment, etc.
In each of the embodiments described above, for monitoring / inspection, the image from the surveillance camera is displayed on the display of the centralized monitoring and control station, and the observer monitors the device to be monitored while controlling the position and attitude of the surveillance camera. Check through the camera image,
An operation such as an inspection is instructed to the device from the display.

In such a monitoring operation, the quality of the image captured by the monitoring camera may be reduced depending on the shooting environment (time zone, weather, camera angle / position, focus / zoom, etc.).

Even if the computer 3B can recognize the device with respect to the image whose image quality has deteriorated, there is a case where a monitor person looking at the display screen cannot visually recognize the device due to darkness, defocus, or the like.

In addition to the case where the automatic execution of the inspection and the like for the device on the display is simply performed, the following problem occurs when an unspecified inspection and the like occur.

(1) When the number of target devices is large, it is difficult to understand the relationship between the devices and their operations.

(2) When a plurality of operations are required for one device, the contents of all operations are unclear in one image to be monitored. For example, for the monitoring target,
If the action is performed with a single mouse click,
I don't know if all the actions are needed.

In the present embodiment, an observer can surely recognize even an image having inferior image quality, and the operability is improved.

In the present embodiment, a function capable of displaying detailed information of a display image as a still image (clear image or skeleton image) is provided in the system configuration of FIG.

FIG. 6 shows a procedure for switching display images in the present embodiment. An image A in the figure shows a monitoring image of a substation equivalent to the conventional one, and in this image, the transformer is located far away and cannot be seen well by a monitoring person. At this time, if the observer enlarges and displays the transformer portion by instructing the camera to zoom, the transformer may still not be clearly displayed. In such a case, the image display means according to the present embodiment is as follows.

(1) When a portion considered to be a transformer position is clicked with a mouse or the like, the computer 3B extracts a still image (photograph data or skeleton image) of the transformer from the database 3C if the transformer is recognized. , An image B is provided, so that a clear image is displayed.

(2) The computer 3B includes a means for displaying a character on a still screen as shown in an image B when a name or function is described in the display of a still image. Therefore, the image display is made easy for the observer to understand. This display also has a function of accepting an operation by a monitor.

(3) When a description of a function or the like is clicked with a mouse or the like in displaying a still image, the computer 3B displays a skeleton image related to the function as shown in an image C. A function is also provided for accepting the operation of the monitor for this image.

(4) The computer 3B accepts the operation of the observer in the display state of the photographic data or the still image of the skeleton. For example, if operation instruction buttons such as “automatic operation”, “opening / closing operation”, and “voltage measurement” are arranged in the image B of the transformer, the switches can be operated on the skeleton screen by operating the buttons. .

Therefore, according to the present embodiment, when the monitoring image on the display is unclear, the observer can display the screen as clear photographic data by instructing the position or the device to be monitored. To ensure the visibility of the person. If there is an operation function or the like for the displayed device, a description thereof is displayed, and by clicking with a mouse or the like, the operation status based on the skeleton image can be displayed, and the automatic operation can be performed while checking.

[0072]

As described above, according to the present invention, in the database of the centralized monitoring and control station, the procedure linked to the position information and shape information of each point and equipment and the automatic execution procedure program for monitoring / inspection. Save the information, identify each device on the shooting screen of the surveillance camera,
When an arbitrary device on the photographing screen is designated, a necessary procedure is executed according to the procedure information of the device, so that the observer can quickly and easily obtain detailed monitoring and inspection information by specifying a monitoring target. This has the effect of making monitoring and inspection work reliable and easy.

Further, according to the present invention, a distance or a distance and an angle of a camera to each device on a photographed image are calculated, a device whose distance or the distance and the angle are located within a set range is determined, and the procedure of the device is determined. Since the automatic execution program is executed according to the information, the monitor does not need to perform an operation of specifying a device to be inspected, and the work load can be reduced. In addition, it is possible to prevent an inspection item or an abnormal situation from being overlooked, as compared to monitoring that relies on the eyes of the observer.

Further, according to the present invention, a specific position is set in advance on a screen on a display, and a device displayed at a specific position in a captured image of each device displayed on the display is set as a device to be monitored. The automatic execution program is executed according to the procedure information of this device, so that the computer
The determination process can be simplified.

Further, according to the present invention, work procedures such as inspection of each device are registered in a database in advance, and the computer recognizes the position and orientation of the surveillance camera whose movement and photographing angle are controlled. Since the automatic execution procedure program is executed from the procedure registered in the database when the position / posture set in advance is reached, the work load on the monitor can be reduced and monitoring can be prevented from being overlooked.

Further, according to the present invention, when a still image data of each device and operation data related thereto are stored in a database, an arbitrary device is designated on a display screen of an image taken by a camera. Since the still image data and the operation data are taken out, and the still image display based on the still image data and the reception of the operation based on the operation data are performed, the observer can clearly understand the operation contents and operate, and can prevent an erroneous operation.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a main part of a monitoring system according to an embodiment of the present invention.

FIG. 2 is work procedure data in the embodiment.

FIG. 3 is a configuration diagram of a main part of a monitoring system according to another embodiment of the present invention.

FIG. 4 is a configuration diagram of a main part of a monitoring system according to another embodiment of the present invention.

FIG. 5 is a control flow in the embodiment.

FIG. 6 is an image switching display example showing another embodiment of the present invention.

[Explanation of symbols]

 1: Monitoring area 1B: Surveillance camera 3: Central monitoring and control station 3A: Surveillance control terminal display 3B: Computer 3C: Monitoring point / device database

Continued on the front page (72) Inventor Hirohisa Matsuda 2-1-17 Osaki, Shinagawa-ku, Tokyo Inside Meidensha Co., Ltd.

Claims (5)

[Claims] 1. A monitoring system for monitoring a monitoring target point and equipment by displaying images of the monitoring target point and equipment captured by a monitoring camera on a display of a central monitoring control station. Stores the position information and shape information of each point and equipment and the procedure information linked to the automatic execution procedure program for monitoring and inspection, and the computer of the centralized monitoring and control station stores the position and the position of the monitoring camera. The posture is estimated, and means are provided for identifying each device from a comparison between the position and shape of each device on the shooting screen at this position and posture and the position and shape information of the database, and the computer, Means for executing the automatic execution program according to the procedural information of the device when an arbitrary device on a shooting screen is designated A surveillance system comprising: 2. The computer calculates a distance or a distance and an angle of the camera with respect to each device on the captured image, determines a device whose distance or the distance and the angle are within a set range, and determines the procedure of the device. 2. The monitoring system according to claim 1, further comprising means for executing the automatic execution program according to information. 3. A specific position is set in advance on a screen on the display, and the computer monitors a device displayed at the specific position in a captured image of each device displayed on the display. 3. The monitoring system according to claim 1, further comprising means for determining a target device and executing the automatic execution program according to the procedure information of the device. 4. A work procedure such as inspection for each device is registered in the database in advance, and the computer recognizes a position and a posture of the surveillance camera whose movement and photographing angle are controlled. Is a preset position
The monitoring system according to any one of claims 1 to 3, wherein an automatic execution procedure program is executed from a procedure registered in the database when the posture is reached. 5. The database stores still image data of each device and operation data related thereto, and the computer specifies an arbitrary device on a display screen of an image captured by the surveillance camera. 5. The apparatus according to claim 1, further comprising: a unit that retrieves still image data and operation data of the device from the database when the operation is performed, and displays a still image based on the still image data and accepts an operation based on the operation data. 6. Any one of the monitoring systems.