WO2014171661A1

WO2014171661A1 - Facility safety management method by image measurement

Info

Publication number: WO2014171661A1
Application number: PCT/KR2014/003035
Authority: WO
Inventors: 손인규
Original assignee: Son In Gyu
Priority date: 2013-04-17
Filing date: 2014-04-08
Publication date: 2014-10-23
Also published as: KR101379237B1

Abstract

A facility safety management method by image measurement according to the present invention comprises: step 1 for arranging, at an observation place, a camera, a reference marking point installed at a front end position of the camera to be displayed at a predetermined position in an image photographed by the camera, and a camera driving unit enabling a posture change of the camera through panning and tilting; step 2 for installing a distant marking point at a distant place having an absolute position which never changes, and a first measurement marking point at a first measurement place; step 3 for acquiring position values of the first measurement place and the distant place; step 4 for simultaneously photographing the reference marking point, the distant marking point, and the first measurement marking point according to a predetermined observation cycle; and step 5 for calculating a position value of the first measurement marking point according to the relationship between the distant marking point and the reference marking point of an image photographed in step 4.

Description

Facility Safety Management Method by Image Measurement

The present invention relates to a method for safety management of facilities by image measurement, and more particularly, to more precisely and conveniently manage by image measurement when constructing or maintaining civil facilities such as dams, bridges, tunnels, and roads. It is about a method.

In general, when constructing civil installations such as dams, bridges, tunnels, roads, etc., the deformation of soil, etc. should be periodically observed, and after completion of construction, the deformation state of the facilities is periodically checked for safety.

As a conventional technique for managing a facility, Korean Patent No. 456524 can be given.

Patent No. 456524 uses a zoom-in / zoom-out camera to photograph a landmark installed on a construction structure, and analyzes the photographed image to measure the amount of deformation. I'm using. If you use the zoom-in function to capture the landmarks installed on a construction structure, the camera must be panned or tilted by controlling the camera to capture the next landmark, which makes it difficult for the camera to return to the previous shooting position correctly. .

This problem is described in more detail with an example of taking the measurement target mark installed on the slope as follows.

That is, when the measurement target mark 10 is first photographed using the camera 1 as shown in FIG. 1A, an image as shown in FIG. 1B is obtained. After that, the camera driver 2 adjusts the posture of the camera by panning or tilting to photograph other marks (not shown), and then adjusts the posture of the camera to photograph the target mark 10 again.

When panning or tilting is performed to adjust the posture of the camera, it is difficult to return to the photographing posture in which the target measurement target 10 was accurately photographed due to the lack of precision of the camera driver 2 controlling the panning or tilting. Although the position of the measurement target mark 10 has not changed, the posture of the camera as shown in FIG. 1 (c) does not return to the same posture as in FIG. 1 (a). An error occurs because the position of the mark 10 is taken as being changed by L in the image captured from the initial position (the mark indicated by the dotted line).

For this very reason, the reliability of image analysis and measurement is low, and there is a problem that cannot be applied to actual facilities.

Korean Patent No. 1181706, filed and registered by the present applicant to solve the above problems, is to measure deformation of a facility by installing an image measuring device. There was a difficulty in managing this.

In the present application, the term "facility" includes not only civil facilities that require safety management, such as dams, bridges, tunnels, roads, etc., but also mountains or robbers, which are natural products to be managed to prevent natural disasters.

The present invention has been made to solve the problems of the prior art as described above, even when zoom-in / panning / tilting to photograph the landmark installed in the facility, by accurately grasp the position of the landmark to accurately determine the deformation of the facility It is an object of the present invention to provide a method for the safety management of facilities by measuring measurable images.

Facility safety management method by the image measurement of the present invention,

Camera,

A camera driver for changing the posture of the camera by panning and tilting;

A reference mark installed at the tip position of the camera so as to be moved in the same direction as the direction of the lens of the camera by panning and tilting,

Step 1 provided at the observation point;

A step 2 of installing a far point mark designated at a far point whose absolute position does not change, and a first mark to be measured at the first measurement point;

Photographing the reference mark, the far point mark, and the first target mark at the same time according to a predetermined observation period;

Calculating a position value of the first measurement target mark according to the relationship between the reference mark and the far point of the image captured in step 3; Characterized in that the made up.

The step 2 further includes the step 2-1 of installing the second measurement target mark at the second measurement point;

Photographing the reference mark, the first measurement target mark, and the second measurement target mark simultaneously according to a predetermined observation period;

Calculating a position value of the second measurement target mark according to the relationship between the reference mark and the first measurement target mark according to a predetermined observation period; It is also preferable to further comprise.

According to the method of facility safety management by image measurement having the above configuration, even when zoom-in / panning / tilting to photograph the mark installed in the facility, the deformation of the facility can be accurately measured by accurately identifying the position of the mark. In addition, it is possible to implement the present invention using a security camera that is usually used for security facilities without installing a separate dedicated camera equipment, there is an effect that can reduce the cost.

1 is a view for explaining the prior art.

Figure 2 is a view for explaining the first embodiment of the present invention.

3 is a view for explaining a second embodiment of the present invention.

4 is a view for explaining a third embodiment of the present invention.

5 to 9 is a view showing a picture implementing the embodiment 1 of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings.

In this embodiment, the method will be described with reference to FIG. 2 by taking a measurement target mark on a facility (slope) having the same shape as that of FIG. 1.

First, the camera 1, the camera driver 2 capable of changing the posture of the camera by panning / tilting, and the reference mark 3 installed at the camera tip position to be displayed at a predetermined position in the image taken by the camera 1 )and,

A reference mark provided at the tip position of the camera is installed at the observation point so as to move in the same direction as the direction of the lens of the camera by panning and tilting. (Step 1)

As the observation point, install the camera by selecting the solid ground where the ground does not settle or rise.

The reference mark 3 is shown in FIGS. 2B and 2D even when panning and tilting are applied by the camera driver 2, that is, even when the pose of the camera changes from FIG. 2A to FIG. 2C. As shown in Fig. 1, the camera is installed at the camera tip position in the same direction as the lens lens facing so as to appear at the same position in the captured image.

Next, the far point mark 4 is assigned to the far point where the absolute position does not change. In the drawings shown in FIGS. 2 to 4, although artificially manufactured marks are used as far-point marks, the far-point marks may designate one point of a structure, such as a bridge, a traffic sign, or an intersection point of a mountain ridge, for example. .

The far point where the absolute position does not change means the position where the ground does not sink because it is far from the measurement target point where the deformation occurs.

The far point may be a far point that can be identified through image analysis in the photographed image.

Next, the first measurement target mark 10-1 is installed at the first measurement point to be measured. (Step 2)

The first measurement target mark 10-1 is installed at the first measurement point of the slope to be measured.

The reference mark (3), the target mark and the long mark (4) can be manufactured in various shapes such as rods, cubes, and tetrahedrons with triangles on the upper and lower sides, and scales or marks to identify the unit length are formed on each side. Can be. In addition, the color of the scale or mark displayed on each side is different from the color of each side so that the position of the scale / mark can be detected automatically by image analysis. The mark points in Fig. 2 indicate the markings of (X), (+) and (^) shapes on each side of the cube. The reference marks, the targets to be measured, and the size and marks of the far point may be different.

After specifying or installing the far point mark 4 and installing the first measurement target mark 10-1, the position value of the first measurement point is acquired.

There may be various methods for obtaining the position value. As commonly used, a method of measuring an absolute position value such as longitude / latitude / height of the first measurement target mark 10-1 by surveying may be used.

What is intended to be implemented through the present invention is not to obtain the absolute position value by surveying, but to monitor the deformation of the facility to perform safety management, it is sufficient to measure the amount of deformation from the initial position.

In this embodiment, the measurement of the deformation amount from the initial position will be described.

When the first photographing is performed as shown in FIG. 2 (a), an image having the form as shown in FIG.

The method for measuring the distance from the image of FIG. 2 (b) to the first measurement target mark 10-1 is as follows. The actual length of the reference mark 3 is S1, the actual length of the first measurement target mark 10-1 is S2, the distance between the reference mark 3 at the camera 1 is L1, the length of the reference mark shown in the image. When K1 and the length of the first measurement target mark 10-1 shown in the image are K2, the distance L2 from the camera 1 to the first measurement target mark 10-1 is

L2 = K1 / K2 × L1 × S2 / S1 ----- (1)

It can be calculated as in Equation (1) above.

If the size of the far point can be known, the distance from the camera 1 to the far point 4 can also be calculated in the same manner as above.

The change in the distance to the first measurement target mark 10-1 means that the first measurement target mark 10-1 is moved back and forth toward the camera by the changed moving distance.

Since it is only necessary to use one of various known image analysis methods by separating and identifying the mark in the image, the description thereof will be omitted.

In addition, the distance h2 between the first measurement target mark 10-1 and the far mark 4 is measured in the image of FIG. 2 (b).

After that, the camera 1 is used for security of the facility, and simultaneously photographs the reference mark, the far point mark, and the first measurement target mark according to a predetermined observation period. (Step 3)

At this time, the camera 1 is difficult to return to the exact same posture as in FIG. 2 (a) again due to a control error of the camera driving unit 2, for example, to return to the posture as shown in FIG. In this case, an image as shown in FIG. 2 (d) is obtained.

The distance between the reference mark of the image of FIG. 2 (d) and the first measurement target mark through the image photographed in step 3 (FIG. 2 (d)) may be recalculated by the form of equation (1). The change in distance from the measurement point to the first measurement target mark can be known.

The vertical movement distance of the first measurement target mark is calculated as follows.

The coordinates of the far point in the first image of FIG. 2 (b) are referred to as (x1, y1) and the coordinates of the first measurement target point are (x2, y2), and the distance of the far point in the image of FIG. When the coordinates are (x1 ', y1') and the coordinates of the first measurement target mark are (x2 ', y2'),

The interval h2 between the first measurement target mark 10-1 and the far point mark 4 in the image of FIG. 2 (b) is calculated as (y1-y2), and the first measurement target mark 10 in the image of FIG. The distance h2 'between -1) and the far point mark 4 is calculated as (y1'-y2').

The vertical movement distance H of the first measurement target mark is determined by the following equation (2).

H = (h2'-h2) / K2 * S2 ----- (2)

The left and right movement distances of the first measurement target mark may be calculated in a manner with respect to the vertical movement distances.

If the position values of the reference mark, the first measurement target mark, and the far point mark are measured by surveying or the like, the value becomes an absolute position value and is determined according to the value analyzed in the image by the above formulas (1) and (2). 1 Of course, the actual position value of the target point to be measured can be calculated,

When the moving distance (deformation amount) is measured by the image based on the position value of the first measurement target mark and the far target mark identified by the first photographed image, the actual moving distance of the first measurement target mark by the relative position value ( Deformation amount) can be measured. (Step 4)

Hereinafter, an application example according to the present embodiment will be described with reference to FIGS. 5 to 7.

5 shows an initial image taken at an observation point. The reference mark was designated as the right corner of the red cylinder showing the unit length in white, and the measurement target mark was indicated by the red rectangle on the square white background, and the red rectangle was designated as the upper left corner. It was designated as the top edge of the second column of the bridge shown on the right side of the bar on which the mark was placed.

6 shows that the camera is turned upward by tilting. In the photographed image, the reference mark is positioned above the measurement target mark. In addition, FIG. 7 shows that the camera faces downward by tilting. In the photographed image, the reference mark is positioned below the measurement target mark and the far point mark.

5 to 7 show that the position and height of the camera and the position and height of the measurement target mark have not changed, but the height of the measurement target mark appears differently on the screen.

First, the image is analyzed, and the y coordinates of the pixels on the image of the reference mark, the measurement target mark, and the far point mark are as follows. The y coordinate of the image is measured from the upper side of the image.

Table 1

Table 1. y-coordinate of each landmark pixel of FIGS. 5 to 7

	Y coordinate of reference point	Y-coordinate of the target point to be measured	Coordinates of the far point
5	318	282	350
6	318	341	409
7	318	237	305

Naturally, the Y coordinate of the pixel on the image of the reference mark does not change in FIGS. 5 to 7. In FIG. 6, the measurement target landmark is downwardly shifted by 59 pixels and the far point landmark is also downward by 59 pixels in comparison with FIG. 5. In (2), (h2'-h2) becomes 0, indicating that the target to be measured is not deformed (moved).

Similarly, in FIG. 7, the measured target mark is 45 pixels up and the far point is 45 pixels up as compared to FIG. 5. In (2), (h2'-h2) becomes 0, indicating that the target to be measured is not deformed (moved).

Left and right deformation (movement) can also be calculated as described above, it is possible to know the exact amount of deformation in spite of the change in the attitude of the camera by panning / tilting only by using the relationship between the far point and the reference point as in the present invention.

8 and 9 show yet another application example, in which FIG. 8 shows an initial image taken at an observation point and FIG. 9 shows a form in which a target to be measured is settled.

It is natural that the y-coordinate of the pixel on the image of the reference mark in Figs. 8 and 9 does not change, and the y-coordinate of the far point mark does not change.

TABLE 2

Table 2. y-coordinate of each landmark pixel in FIGS. 8 and 9

	Y coordinate of reference point	Y-coordinate of the target point to be measured	Coordinates of the far point
8	340	282	350
9	340	316	350

Therefore, since only the y-coordinate of the target to be measured is lowered by 33 pixels, h2 'is 34 and h2 is 68 in Eq. (2).

The facility can set up multiple target marks depending on its size or need (step 2-1), while the first target mark should be taken at the same time as the remote mark, while the remaining target marks may be taken at the same time as the remote mark. It may not be taken.

Since the moving distance (deformation amount) of the first measurement target mark is already known, when the first measurement target mark and the second measurement target mark are photographed through the camera driving unit (step 5), the second measurement object is based on the first measurement target mark. It is possible to measure the vertical movement distance (strain) of the target to be measured. You can also use the camera's zoom-in feature to improve measurement accuracy.

Even when the first and second measurement target marks are taken, the reference marks are installed at the front end position of the camera so that they are displayed at a predetermined position in the image taken by the camera, and the reference marks are taken simultaneously with the first and second measurement target marks. 2 The distance of the target to be measured can also be grasped. (Step 6)

After photographing the first target mark and the long target mark, the camera driving unit is operated so that the camera captures the first target mark and the second target mark. Operation of the camera driver for this is possible by a predetermined panning / tilting / zoom-in. Alternatively, the camera may be zoomed out to capture the measurement target marks in one image, and then find the second measurement target marks. In this case, the shape of the marks displayed on the measurement target marks may be different.

As described above, after measuring the moving distance (deformation amount) of the second measurement target mark on the basis of the first measurement target mark, and again measuring the moving distance (strain) of the third measurement target mark on the basis of the second measurement target mark. As a result, it is possible to measure the moving distance (strain) of a large number of measurement target marks sequentially.

As such, the moving distance (strain) of a large number of measurement target marks is automatically made by image analysis, recorded and stored in the management server, and it is recommended to notify the administrator when the moving distance (strain) exceeds the reference value. desirable. Image analysis may be performed by a dedicated device or a management server integrally formed with the camera.

Example 2 is an example of monitoring landslides and the like based on the principle of Example 1, which will be described with reference to FIG. 3.

The reference mark 300 is installed and photographed at the far point mark 4 and the first measurement target mark 10-1 by the first camera 100 driven by the camera driving unit. The moving distance is measured up, down, left and right, and then, the second measurement target mark 10-2 and the first measurement target mark 10-1 are photographed to measure the front, rear, left, and right movement distances. When the above process is repeated for each measurement target mark, the front, rear, left, and right moving distances of the measurement target mark that can be measured by the first camera 100 are measured.

Next, a second camera 101 provided with a reference mark of reference numeral 301 is installed at the position of the measurement target mark of 10-8. In the first camera 100, only the target marks of measurement 10-1, 10-2, ..., 10-8 are observed, and in the second camera 101, the target marks and the measurement target 10-1 are shown. The positions of the second cameras are set so that the target marks of measurement 20-1, 20-2, ..., 20-5 are observed. Each target mark can be identified by recognizing a number formed on the mark or by storing and controlling the pose of the camera with respect to the target marks in the initial setting.

Based on the measurement target mark indicated by reference numeral 10-1, which grasps the moving distance (deformation amount) through the first camera 100, the measurement target mark indicated by reference numerals 10-1 and 20-1 is taken. It is possible to measure the moving distance (deformation amount) of the target to be measured at 1. Subsequently, the second camera 101 captures the measurement target marks 20-2,..., 20-6 that can be measured together with the reference marks indicated by reference numeral 301 to measure the moving distance (strain). It becomes possible.

It is then possible to monitor the entire mountain using the second, third, fourth, fifth and

sixth cameras

102, 103, 104, 105 and 106 in the same manner.

The third embodiment is an example of monitoring the deformation of the tunnel based on the principle of the first embodiment, which will be described with reference to FIG. 4.

The target mark and the far-point mark of 10-1 are installed outside the tunnel 500 by the camera 1 having the reference mark 3 and the reference mark 3 installed and driven by the camera driver. 4) photographed and the position values of the target marks of measurement targets 10-1, 10-2, and 10-3 are measured by the method described in Example 1 above. In this case, the camera 1 is preferably installed at a point designed to prevent deformation. Afterwards, the measurement target mark of reference numeral 10-4 and the long target mark of reference numeral 4 'are photographed for the long target mark of 4' and the position value of the target target measurement of reference numerals 10-4, 10-5, and 10-6. Measure also.

If the tunnel is long, measuring deformation in the tunnel by installing a camera and a camera driver having a measurement target mark between the measurement target marks as necessary and determining the position value of the measurement target point in the method of the second embodiment. It is possible.

In addition, it is also possible to install a camera and a camera driver provided with a reference mark outside the tunnel.

The present invention relates to a method for safety management of facilities by image measurement, and more particularly, to more precisely and conveniently manage by image measurement when constructing or maintaining civil facilities such as dams, bridges, tunnels, and roads. The present invention relates to a method for precisely determining the location of a mark and accurately measuring deformation of a facility, and also using the security camera used for securing a facility without installing a separate dedicated camera equipment. It is possible to implement, which can reduce costs.

Claims

Camera,

A camera driver for changing the posture of the camera by panning and tilting;

A reference mark installed at the tip position of the camera so as to be moved in the same direction as the direction of the lens of the camera by panning and tilting,

Step 1 provided at the observation point;

A step 2 of installing a far point mark designated at a far point whose absolute position does not change, and a first mark to be measured at the first measurement point;

Photographing the reference mark, the far point mark, and the first target mark at the same time according to a predetermined observation period;

Calculating a position value of the first measurement target mark according to the relationship between the reference mark and the far point of the image captured in step 3; Facility safety management method by the image measurement, characterized in that made.
The method of claim 1,

The step 2 further includes the step 2-1 of installing the second measurement target mark at the second measurement point;

Photographing the reference mark, the first measurement target mark, and the second measurement target mark simultaneously according to a predetermined observation period;

Calculating a position value of the second measurement target mark according to the relationship between the reference mark and the first measurement target mark according to a predetermined observation period; Facility safety management method by the image measurement, characterized in that further comprises.