JP3869780B2 - Ground surface monitoring system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention is a ground surface monitoring system that constantly monitors a dangerous location such as a collapse of the ground surface even from a remote location through a network such as the Internet, and in particular, not only a difference detection signal by a target photographing camera but also a ground surface of the dangerous location. The present invention relates to a ground surface monitoring system capable of avoiding misjudgment and performing reliable and stable ground surface monitoring by using a state amount detection signal from a state amount detection means as data for ground surface determination.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, for example, a technique using a wire harness sensor is known as means for observing a dangerous point where there is a risk of landslide or collapse. This is done by setting a wire on the ground surface to be observed and determining whether or not the wire is broken, so that a definite abnormality can be detected in real time. However, observation with such a wire sensor only determines whether or not the wire is broken, so not only the situation at the site is known, but also to investigate the cause of the sensor breakage, you must go to the site, Even if it arrives at the site, there is a drawback that the road closure for avoiding an accident due to a cliff slippage to be taken in the meantime is delayed.
In order to avoid such drawbacks, a technique is known in which the surface of a dangerous zone is monitored using a monitoring camera, and video data is differentially detected by a differential detection device. It was possible to perform unmanned monitoring in real time, and it was possible to replay the situation several seconds back from the situation in which changes occurred on the ground surface, making it easier to grasp the situation.
[0003]
However, such a difference detection device using a monitoring camera has an advantage that it can be processed in real time while being unattended and remotely monitored. However, when a difference is detected in video data from the monitoring camera, only a change in luminance on the image is tracked. Therefore, there are problems that frequently generate false alarms that cause detection failures due to the use of surveillance cameras outdoors, and in order to prevent errors, settings that narrow the monitoring range or differences are Since it was impossible to reset the determination of whether or not it occurred, there was a problem that the monitoring accuracy was significantly lowered. In addition, even if a dangerous point is externally monitored by using such a difference detection device, whether or not a crack is actually generated on the ground surface is observed from the physical and internal side. Absent. For this reason, the state of the ground surface is determined only by the ground detection signal from the difference detection device even though there is no physical crack or the like. There is also a problem that is still insufficient for monitoring the ground surface.
[0004]
As a technique for monitoring a monitoring target using two cameras, for example, Japanese Patent Laid-Open No. 9-212339 is known. However, this is merely a technique for observing the night sky by simply providing an optical filter to remove sunlight and its scattered light as background light, or to reduce the amount of light. It is not a technique for monitoring the ground surface.
[0005]
The present invention has been devised in view of the above-mentioned problems, and constantly monitors dangerous locations such as the collapse of the ground surface from a remote location through a network such as the Internet, and detects a difference on the ground surface of the dangerous location with a target photographing camera. By adding not only signals but also state quantity detection signals from the surface state quantity detection means as physical data to judge the state of the ground surface, it is possible to avoid misjudgment and perform reliable and stable ground surface monitoring. The purpose is to provide a system.
[0006]
[Means for Solving the Problems]
In order to achieve the above object, the present invention has the following configuration. That is, the ground surface monitoring system according to the first aspect of the present invention is connected to a plurality of target photographing cameras installed at positions separated from each other so as to be paired with a plurality of targets installed on the ground surface. A plurality of difference detection computers for performing difference detection based on moving images from the respective target shooting cameras, and a panoramic view recording camera for shooting and recording the entire view of the ground surface including the target, A panoramic recording computer having a function of continuously recording a moving image from the panoramic recording camera and a function of receiving a difference detection signal output from the difference detecting computer. A client terminal is connected through the network, and the panorama recording computer is connected to each of the difference detection computers. AND filtering means for selecting each detected difference detection signal by AND filtering and outputting a selected difference detection signal; Ground state quantity detection signal from the ground state quantity detection means for detecting the state of the ground surface installed in the vicinity of the target And a ground surface judging means for judging whether or not a change has occurred on the ground surface based on the selection difference detection signal, and when the ground surface judging means judges that a change in the ground surface has occurred, the whole-scene recording computer The image data indicating the ground surface condition is transmitted to the client terminal through the network.
[0007]
According to the first aspect of the present invention, not only the sorting difference detection signal output from the AND filtering means of the difference detection computer but also the ground state quantity detection signal output from the ground state quantity detection means is detected by the panoramic view recording computer. Therefore, it is judged by the ground surface judgment means, so that more reliable, stable and reliable detection results are output while avoiding frequent occurrence of alarms that cause detection failures, By accessing a panoramic recording computer having a server function through a network, information such as a moving image, a still image, and a panoramic image related to the ground surface can be browsed to realize smooth remote monitoring.
[0008]
The invention according to claim 2 relates to the ground surface monitoring system according to claim 1, wherein the difference detection performed by the difference detection computer performs red, green, blue at a predetermined resolution between the preceding and following frames. It is characterized in that it is performed by comparing and inspecting the change of each color.
[0009]
According to the invention described in claim 2, since the difference detection is performed by comparing and judging the change in the colors of red, green and blue rather than simply tracking the change in the luminance on the image, the target is detected. By variously setting the monitoring range and the threshold value at which the difference occurs, it is possible to set and use for each ground surface monitoring site.
[0010]
A third aspect of the present invention relates to the ground surface monitoring system according to the first or second aspect, wherein the predetermined resolution is set to a maximum of 480 pixels × 640 pixels for 30 frames per second. To do.
According to the ground surface monitoring system according to claim 3, 1 second × 30 frames × 640 × 480 pixels = 9,216,000. Since there are three colors of red, green, and blue, a comparison inspection of 9,216,000 × 3 = 27,648,000 times / second is performed by the difference detection computer. Therefore, a highly accurate abnormality monitoring system can be realized.
[0011]
A fourth aspect of the present invention relates to the ground surface monitoring system according to any one of the first to third aspects, wherein the target imaging computer uses a mask function to identify each target as a monitoring target region, a monitoring target, It is characterized in that it can be set so as to be disregarded, and to ignore the areas not to be monitored.
[0012]
According to the ground surface monitoring system of the fourth aspect, by setting the area not to be monitored by the mask function and ignoring the area other than the monitoring area, it is possible to change the brightness due to weather, time, wind, etc. It is reliable, stable, avoids the occurrence of undesired alarms due to changes in the grass on the monitoring target, wild animals crossing the front of the camera, etc., and it becomes impossible to determine which alarm is really necessary. It becomes possible to obtain a reliable output.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Below, the ground surface monitoring system which concerns on embodiment of this invention is explained in full detail based on FIGS. 1-3.
FIG. 1 is a schematic configuration diagram showing an overview of a ground surface monitoring system, FIG. 2 is a block diagram showing the whole system in blocks, and FIG. 3 is a flowchart thereof.
The configuration of the ground surface monitoring system will be described with reference to FIGS. A snowfall protection fence (not shown) is installed on the slope of the ground surface E, such as a mountain cliff to be monitored, and a pair of monitoring targets A and B (hereinafter referred to as “targets”) are adjacent to the snowfall protection fence. It is installed in the state of. These targets A and B are formed of, for example, a chevron signboard having a large contrast and a red V mark on a white background in order to eliminate uncertain elements such as weather.
[0014]
Each target A and B is provided with a pair of target photographing cameras. The number of cameras to be installed may be two or more. That is, the target A has a target photographing camera 1 (hereinafter referred to as “camera 1”), and the target B has a target photographing camera 2 (hereinafter referred to as “camera 2”). Are mounted on concrete pedestals 1a and 2a in separate monitoring rooms, not shown.
[0015]
The camera 1 is connected to a difference detection computer PC1 that performs difference detection based on the moving image of the camera 1, and the camera 2 is also a difference detection computer PC2 that similarly performs difference detection based on the moving image of the camera 2. Connected to. Each of the difference detection computers PC1 and PC2 includes encoders 3 and 4 for encoding signals output from the cameras 1 and 2 and difference detection units 5 and 6 for detecting a difference between output signals from the encoders 3 and 4. Yes. Difference detection in the difference detection units 5 and 6 is achieved by compressing and storing each image and recognizing the difference between the previous frame and the subsequent frame. It is formed as follows. In the case of the present embodiment, the maximum resolution is 30 frames per second and is set to 640 × 480 pixels, and all pixels are detected in real time. Therefore, because 1 second per second × 30 frames × 640 × 480 pixels = 9,216,000, the gray scale for each color of red (R), green (G), and blue (B) of 9,216,000 pixels is comparatively inspected. To do. These processes are performed by predetermined software on the difference detection computers PC1 and PC2.
[0016]
The pedestal 1a to which the camera 1 is attached is provided with a panoramic view recording camera 7 for photographing and recording a panoramic view of the ground surface E to be monitored. This panoramic recording camera 7 is connected to a panoramic recording computer 8. The panoramic view recording computer 8 has a function as an integrated server, for example, a function of continuously recording moving images from the panoramic recording camera 7, and outputs output from the difference detection computers PC1 and PC2. The function of AND filtering the signal (alarm signal), the function of sending the alarm signal to a relay server (not shown) on the Internet 13 described later, the function of operating the alarm lamp 14 (see FIG. 2) in the observation room, etc. I have.
[0017]
That is, the panoramic view recording computer 8 includes an encoder 9 that encodes a video signal output from the camera 7, a storage unit 10, a CPU 11 (central processing unit), and an output unit 12. The storage unit 10 includes an encoder 9, a difference detection unit 5, a difference detection unit 6, and ground surface state amount detection means installed on the ground surface E in the vicinity of the targets A and B. For example, an output signal of a ground surface state detection sensor 17 such as an electrolytic sensor is input. In addition, according to the ground surface E to be monitored, such a number of ground surface state quantity detection sensors 17 are appropriately installed such as P1 to PN.
[0018]
The CPU 11 performs an AND filtering on the difference detection signals output from the difference detection units 5 and 6, the ground surface state detection unit 11 b, and whether or not a change such as a collapse has occurred in the ground surface E. It is comprised with the determination part 11c as a ground surface determination means to determine. AND filtering is usually covered by setting a detection threshold for difference detection, but the camera is set so that it is not captured except for the necessary monitoring points, This is performed using the mask function in the detection system, that is, the targets A and B are divided into a monitoring target area and a non-monitoring area by the mask function, and a non-monitoring area is set to be ignored. And so on. Thus, the AND filtering unit 11a selects the difference detection signal output from each of the difference detection units 5 and 6, and the selected selection difference detection signal is output to the determination unit 11c.
[0019]
The ground surface state detection unit 11b detects whether or not changes such as strain, cracks, cracks, distortion, and deformation have occurred on the ground surface E based on the signal output from the ground surface state amount detection sensor 17. is there.
[0020]
The determination unit 11c comprehensively determines whether or not a change has occurred in the ground surface E based on the selection difference detection signal output from the AND filtering unit 11a and the ground surface state amount detection signal output from the ground surface detection unit 11b. Judgment. The determination unit 11c detects that there is an abnormality on the ground surface E externally by the selection difference detection signal, and detects that there is also an abnormality inside the ground surface by the ground surface state detection signal, so that a sign of collapse or The situation where the collapse is occurring is detected in advance.
[0021]
In this way, the computers of the difference detection computer PC1, the difference detection computer PC2, and the panoramic view recording computer 8 are LAN-connected by the router 20 and connected to the Internet 13 as a network. Note that a dedicated communication line network may be used instead of the Internet 13. Further, although not shown, it goes without saying that elements such as a firewall are appropriately installed in the network. The panoramic view recording computer 8 having the server function detects the ground surface to be monitored at the timing requested from the mobile phone terminal 16 or the personal computer terminal 15 when it is detected that an abnormality has occurred on the ground surface. Can be viewed with video information such as a moving image or a still image, or can be immediately reported by e-mail.
[0022]
Next, the flow of the ground surface collapse monitoring of the ground surface monitoring system according to the present embodiment will be described with reference to the flowchart shown in FIG. That is, the camera 1 and the camera 2 simultaneously photograph the pair of targets A and B installed on the snow fall prevention fence on the ground surface E to be monitored for occurrence of collapse (step S1, step S1 ′). The moving image data photographed by the cameras 1 and 2 is encoded by the difference detection computers PC1 and PC2 (step S2, step S2 ′) and the difference detection units 5 and 6 detect the difference in order to compress the image signal. (Step S3, Step S3 ′). In step S4 and step S4 ′, it is determined whether or not a difference is detected. When the difference is detected, the difference detection signals W1 and W2 are output to the storage unit 10 of the panoramic recording camera computer 8 (step S5, step S5 ′). When the difference is not detected, step S1 is performed. Steps S4 to S4 (Steps S1 ′ to S4 ′) are repeated. Next, when the difference detection signals W1 and W2 are output from the storage unit 10 to the AND filtering unit 11a (step S6), difference detection by the two cameras 1 and 2 is established as an AND condition in the AND filtering unit 11a. It is determined whether or not it has been done (step S7). When the AND condition is satisfied, the selection difference detection signal is output to the determination unit 11c.
[0023]
The video from the camera 1 and the camera 2 is output from the storage unit 10 as a moving image or a still image in response to a request from the image data sending unit 12a from the client terminals 15 and 16, and the status of the abnormality target is used as video information. I can grasp it.
[0024]
Similarly, the video shot by the panoramic view recording camera 7 is encoded by the encoder 9 and then stored in the storage unit 10 in order to compress the image signal. When there is a request from the client terminals 15 and 16, the video information in the storage unit 10 is output from the image data transmission unit 12 a.
[0025]
On the other hand, when the ground surface is detected by the ground surface state detection sensor 17 (step S8), it is determined whether or not an abnormality has been detected by the ground surface detection unit 11b (step S9). When an abnormality is detected, a state abnormality detection signal is output to the determination unit 11c.
[0026]
In step S10, the selection difference detection signal of the AND filtering unit 11a and the state abnormality detection signal of the ground surface state detection unit 11b are checked by the determination unit 11c to determine whether or not a change such as a collapse has occurred on the ground surface. Is done. That is, when the determination unit 11c outputs the selection difference detection signal and the state abnormality detection signal, it determines that an abnormality has occurred on the ground surface, and outputs it to the output unit 12.
[0027]
When there is an image browsing request from the client terminals 15 and 16 via the Internet 13, a moving image or a still image on the ground surface, in which an abnormality is appropriately detected from the image data transmission unit, is transferred to the client terminals 15 and 16 (step S11). ). In addition, when a change, that is, an abnormality occurs, the alarm lamp 14 installed in the monitoring room is activated by the alarm lamp operating unit 12b and lights to notify that an abnormality has occurred in the surroundings.
[0028]
As described above, according to the present embodiment, the ground surface state is not only photographed and visually monitored by the camera 1, the camera 2, and the panoramic recording camera 7, but also the ground surface state amount detection sensor 17 is used. The state of the surface E is monitored, and the surface condition detection signal being monitored is also determined by the determination unit 11c as determination data as to whether or not a change (abnormality) has occurred. For this reason, when the determination unit 11c determines that an abnormality has occurred, the state of the ground surface E to be monitored can be sent to the client as a moving image or a still image from the sign stage in which the change occurs. It is possible to realize reliable, stable and reliable ground surface monitoring without judgment.
[0029]
In the above-described embodiment, the ground surface E is targeted for a dangerous location that may collapse, but rivers such as debris flows and bank breaks can also be monitored.
Of course, the camera 1, the camera 2, and the panoramic recording camera 7 can use infrared cameras for night photography.
Further, the mobile phone 16 is exemplified as the client-side terminal, but any mobile communication means may be used. For example, a terminal using sanitary communication such as GPS mounted in a car may be used.
[0030]
【The invention's effect】
The invention according to claim 1 is connected to a plurality of target imaging cameras installed at positions separated from each other so as to be paired with a plurality of targets installed on the ground surface. A plurality of difference detection computers that perform difference detection based on the moving image of the image and a whole-view recording camera that captures and records the entire view of the ground surface including the target, and a moving image from the whole-view recording camera And a panoramic view recording computer having a function of receiving a differential detection signal output from the differential detection computer, and a client terminal is connected to the panoramic recording computer through a network. At the same time, the panoramic view recording computer outputs each difference detection signal output from each difference detection computer to an AND block. AND filtering means for sorting and outputting a sorting difference detection signal by filtering, a ground state quantity detection signal from a ground state quantity detection means for detecting a ground surface state installed in the vicinity of the target, and the sorting difference detection signal. It has a ground surface judging means for judging whether or not a change has occurred on the surface, and when the ground surface judging means judges that a ground surface change has occurred, the computer for panoramic recording records the client terminal through the network. The image data indicating the ground surface condition is transmitted.
[0031]
For this reason, the panoramic view recording computer considers not only the sorting difference detection signal output from the AND filtering means of the difference detection computer but also the ground state quantity detection signal output from the ground state quantity detection means. Since it is judged by the surface judgment means, it outputs a more reliable, stable and reliable detection result while avoiding frequent occurrence of alarms that cause detection failure, and a panoramic view with server function from the client terminal through the network By accessing the computer for recording, information such as moving images, still images, and panoramic images related to the ground surface can be browsed to realize smooth remote monitoring, and a ground surface monitoring system free from erroneous judgment can be obtained. There is an effect.
[0032]
According to the second aspect of the present invention, the difference detection performed by the difference detection computer is performed by comparing and inspecting the change of each color of red, green, and blue at a predetermined resolution between the preceding and succeeding frames. Because it is configured, it does not simply track changes in brightness on the video, but detects differences by comparing changes in the colors of red, green, and blue, so the target monitoring range and difference By variously setting the threshold value at which the occurrence of the problem occurs, there is an effect that it can be set and used for each ground surface monitoring site.
[0033]
Further, since the invention according to claim 3 has a configuration in which the predetermined resolution is set to 480 pixels × 640 pixels at the maximum for 30 frames per second, second × 30 frames × 640 × 480 pixels = 9, 216,000 . Since there are three colors of red, green, and blue, a comparison inspection of 9,216,000 × 3 = 27,648,000 times / second is performed by the difference detection computer. Therefore, an effect that a highly accurate abnormality monitoring system can be realized is achieved.
[0034]
In the invention described in claim 4, the target imaging computer sets each target into a monitoring target area and a non-monitoring area by the mask function, and ignores the non-monitoring area. By setting the area not to be monitored with the mask function and ignoring the area other than the monitored area, the weather, the change in brightness due to time, wind, etc. The effect of avoiding frequent occurrences of undesired alarms due to changes, wild animals crossing the front of the camera, etc., making it impossible to determine which alarms are truly necessary, and providing reliable, stable and reliable output There is.
[Brief description of the drawings]
FIG. 1 is a schematic configuration diagram showing an outline of a ground surface monitoring system according to an embodiment of the present invention.
FIG. 2 is a block diagram showing FIG. 1 in blocks.
FIG. 3 is a flowchart showing the block diagram of FIG. 2 as a flowchart.
[Explanation of symbols]
1 ... Camera (Target shooting camera)
2 ... Camera (Target shooting camera)
7 ... panoramic recording camera 8 ... panoramic recording computer 11a ... AND filtering unit 11b ... ground surface state detecting unit 11c ... determination unit 13 ... internet 15 ... client terminal 16 ... mobile phone A ... target B ... target E ... ground surface PC1 ... Difference detection computer PC2... Difference detection computer

Claims (4)

Connected to multiple target shooting cameras installed at positions distant from each other so as to pair with multiple targets installed on the ground surface, and detects differences based on moving images from each target shooting camera A plurality of difference detection computers, and a function for continuously recording a moving image from the panoramic recording camera, connected to a panoramic recording camera that captures and records the panoramic view of the ground including the target, And a panoramic view recording computer having a function of receiving a differential detection signal output from the differential detection computer. A client terminal is connected to the panoramic recording computer through a network, and the panoramic recording computer The difference detection signals output from the difference detection computers are selected by AND filtering. AND filtering means for outputting a sorting difference detection signal and a ground state quantity detection signal from a ground state quantity detection means for detecting a ground surface condition installed in the vicinity of the target and the sorting difference detection signal cause a change in the ground surface. A ground surface judging means for judging whether or not it has occurred, and when the ground surface judging means judges the occurrence of a change in the ground surface, the ground surface status is sent from the panoramic recording computer to the client terminal through the network. A ground surface monitoring system characterized in that image data to be transmitted is transmitted. 2. The difference detection performed by the difference detection computer is performed by comparing and inspecting changes in red, green, and blue colors at a predetermined resolution between the previous and next frames. The ground surface monitoring system described. 3. The ground surface monitoring system according to claim 1, wherein the predetermined resolution is set to 640 × 480 pixels at the maximum for 30 frames per second. The target photographing computer can divide each target into a monitoring target area and a non-monitoring area by using a mask function, and can be set to ignore the non-monitoring area. The ground surface monitoring system according to any one of claims 1 to 3, wherein

Images