KR20230094041A - Structure status diagnosis device using image information and sensors - Google Patents

Abstract

The present invention relates to a structure state diagnosis device using image information and a sensor, and more particularly, to a measuring device; a reference coordinate setting unit provided in the measuring device and configured to set reference coordinates based on one point in the subject; An image capturing unit provided in the measuring device and for capturing the reference coordinates set by the reference coordinate setting unit; a magnetic displacement measuring unit provided in the measuring device to measure magnetic displacement; And when it is determined that the displacement of the subject has occurred after converting the image of the reference coordinates captured by the image capturing unit into pixels and storing the reference coordinate data, determining whether or not the subject has been displaced based on the set reference coordinate values. and a central processing unit for measuring magnetic displacement of the measuring device by the magnetic displacement measurement unit.
That is, the present invention measures the inclination of a subject such as a cultural property, building, object, etc. to determine whether or not it is displaced, and at the same time measures the magnetic displacement of the measuring device to minimize the measurement error of the subject through image processing and correction to determine the displacement of the subject. We would like to propose a device for diagnosing structural conditions using image information and sensors that can accurately measure.

Description

Structure status diagnosis device using image information and sensors}

The present invention measures the inclination of objects such as cultural properties, buildings, objects, etc. to determine whether or not they are displaced, and at the same time measures the magnetic displacement of the measuring device to minimize the measurement error of the measurement object through image processing and correction, thereby accurately measuring the displacement of the object. It relates to a structure condition diagnosis device using measurable image information and sensors.

Conventionally, various techniques for diagnosing the safety of facilities by measuring the displacement of structures such as cultural assets, bridges, civil engineering, and buildings have been disclosed.

Such conventional state diagnosis devices are configured to measure only the displacement of a subject.

However, even when the displacement of the subject occurs due to earthquake, vibration, or other causes, only the actual subject may be displaced, but in some cases, the measuring device itself installed near the subject may also be displaced.

In this way, when the magnetic displacement of the measuring device occurs, it is difficult to accurately measure the displacement of the subject if the basic reference coordinates are used as they are.

Therefore, there is an urgent need to develop a device that can implement a more accurate safety diagnosis in consideration of the displacement of not only the subject but also the measuring device installed nearby to measure the displacement of the subject.

Republic of Korea Patent Registration No. 10-0411753 (registered on December 6, 2003)

The present invention has been made to solve the above problems,

It is possible to accurately measure the displacement of a subject by measuring the tilt of a subject such as a fire, building, or object to determine whether it is displaced, and at the same time measuring the magnetic displacement of the measuring device to minimize the measurement error of the subject through image processing and correction. Its purpose is to provide a structure condition diagnosis device using image information and sensors.

A structure condition diagnosis device using image information and a sensor according to the present invention includes a measuring device; a reference coordinate setting unit provided in the measuring device and configured to set reference coordinates based on one point in the subject; An image capturing unit provided in the measuring device and for capturing the reference coordinates set by the reference coordinate setting unit; a magnetic displacement measuring unit provided in the measuring device to measure magnetic displacement; And when it is determined that the displacement of the subject has occurred after converting the image of the reference coordinates captured by the image capturing unit into pixels and storing the reference coordinate data, determining whether or not the subject has been displaced based on the set reference coordinate values. and a central processing unit for measuring magnetic displacement of the measuring device by the magnetic displacement measurement unit.

The central processing unit according to the present invention includes an image information conversion unit for converting the image captured by the image capture unit into pixels, a data storage unit for storing reference coordinate values converted by the image information conversion unit, It is characterized in that it comprises a displacement discriminating unit for determining whether or not the subject is displaced by using the image information photographed by the image capturing unit, and an arithmetic unit for calculating a coordinate shift value according to whether or not the subject is displaced.

According to the present invention, the central processing unit determines that the displacement of the subject has occurred by the displacement determining unit and the magnetic displacement is not measured by the magnetic displacement measurement unit, the displacement value of the subject calculated by the calculation unit is stored as a manager. It is characterized by issuing a warning to

When it is determined that the displacement of the subject has occurred by the displacement discrimination unit according to the present invention and the magnetic displacement is measured by the magnetic displacement measurement unit at the same time, the pixel converted according to the magnetic displacement value and the coordinate movement of the subject by the calculation unit. It is characterized in that the coordinate displacement value is calculated using

The central processing unit according to the present invention is characterized in that it sets the coordinate displacement value calculated by the calculation unit as a new reference coordinate.

The reference coordinate setting unit according to the present invention is composed of a laser pointer, and the magnetic displacement measuring unit is characterized in that it is composed of a tilt sensor.

The measuring device according to the present invention is characterized in that an IR sensor for recognizing a subject is further mounted.

The device for diagnosing the condition of a structure using image information and a sensor according to the present invention measures the tilt of a subject such as a cultural property, building, object, etc. to determine whether or not there is a displacement, and at the same time measures the magnetic displacement of the measuring device through image processing and correction. By minimizing the measurement error of the target, the displacement of the target can be accurately measured.

In addition, the present invention modularizes the condition diagnosis device so that a laser pointer as a reference coordinate setting unit, a camera as an image capture unit, a tilt sensor and an IR sensor as a magnetic displacement measuring unit can be mounted, and thus not only safety diagnosis and tilt displacement of structures, but especially cultural properties and By preventing theft or damage to structures with high preservation value, the purpose of use can be diversified, and the usability of the device can be expanded through this.

1 is a conceptual diagram showing a structure state diagnosis device using image information and a sensor according to the present invention;
2 is a block diagram showing a structure condition diagnosis device according to the present invention;
3 is a conceptual diagram for calculating coordinate displacement values by the structure state diagnosis device according to the present invention;
Figure 4 is a flow chart showing a processor according to the structure state diagnosis device according to the present invention.

In order to explain the present invention and the operational advantages of the present invention and the objectives achieved by the practice of the present invention, the following describes a preferred embodiment of the present invention and references it.

First, the terms used in this application are used only to describe specific embodiments, and are not intended to limit the present invention, and singular expressions may include plural expressions unless the context clearly indicates otherwise. In addition, in this application, terms such as "comprise" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other It should be understood that the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof is not precluded.

In describing the present invention, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present invention, the detailed description will be omitted.

First, in this specification, a subject is a concept that includes structures such as cultural assets, buildings, bridges, and civil engineering that cause structural problems when tilted or displaced by factors such as earthquakes, vibrations, or earthquakes.

As shown in FIGS. 1 to 3, the structure state diagnosis device using image information and sensors according to the present invention includes a measuring device 10, a reference coordinate setting unit 20, an image capturing unit 30, and magnetic displacement measurement. It is configured to include a unit 40 and a central processing unit 50.

First, as shown in FIGS. 1 to 3, the measuring device 10 according to the present invention is installed near the measuring object and includes a reference coordinate setting unit 20, an image capturing unit 30, a magnetic displacement measuring unit 40, and It is configured so that the central processing unit 50 can be mounted.

Next, as shown in FIGS. 1 to 3 , the reference coordinate setting unit 20 according to the present invention is configured to set reference coordinates A based on one point in the subject.

That is, the reference coordinate setting unit 20 irradiates a laser to a point that becomes a reference point of a subject with a laser pointer, converts the irradiated laser point into coordinates, and sets it as the reference coordinate (A).

1 to 3, the image capturing unit 30 according to the present invention captures the reference coordinates A set by the reference coordinate setting unit 20 and transmits image information to the central processing unit 50. Consists of.

To this end, it is preferable that the imaging unit 30 uses an imaging device such as a digital camera to transmit image information data to the central processing unit 50 with a camera.

Therefore, the image captured by the image capturing unit 30 is transmitted to the central processing unit 50, and the central processing unit 50 converts the image into pixels and stores the image as reference coordinate data.

In addition, the displacement of the subject, which will be described later, is determined by comparing the real-time data obtained by converting the image taken by the video capture unit 30 into pixels in the center unit and the set reference coordinate data to determine whether there is a left-right displacement or an up-down displacement.

As shown in FIGS. 1 to 3 , the magnetic displacement measuring unit 40 according to the present invention measures whether or not the measuring device 10 is displaced and transmits it to the central processing unit 50 .

When it is determined that the subject has been displaced due to earthquake, vibration, or other causes, only the actual subject may be displaced, but in some cases, the measuring device 10 installed near the subject may also be displaced. In this way, when the magnetic displacement of the measuring device 10 occurs, it is difficult to accurately measure the displacement of the subject when the existing reference coordinates A are used as they are.

Therefore, when magnetic displacement of the measuring device 10 is generated by the magnetic displacement measuring unit 40, it is preferable to enable accurate measurement by determining whether or not the subject is displaced in consideration of the coordinate movement caused by the magnetic displacement.

It is preferable that such a magnetic displacement measurement unit 40 uses a tilt sensor capable of measuring a change in tilt of the measuring device 10 .

As shown in FIGS. 1 to 3, the central processing unit 50 according to the present invention converts the image of the reference coordinates A captured by the image capture unit 30 into pixels and stores them as stored reference coordinate data. After setting the reference coordinate value (A) and determining whether or not the displacement of the subject is based on the set reference coordinate value (A), if it is determined that the displacement of the subject has occurred, the measuring device by the magnetic displacement measuring unit 40 It is configured to measure whether or not the magnetic displacement of (10) is present.

Such a central processing unit 50 includes an image information conversion unit 51 for converting the image captured by the image capture unit 30 into pixels, and the reference coordinate values A converted by the image information conversion unit 51. ), a data storage unit 53 for storing, a displacement determination unit 55 for determining whether or not the subject is displaced by using the image information captured by the image capturing unit 30, and It is configured to include a calculation unit 57 for calculating coordinate shift values.

That is, the central processing unit 50 is composed of an image information conversion unit 51, a data storage unit 53, a displacement determination unit 55, and an arithmetic unit 57 to determine whether or not the subject is displaced, and to determine whether the displacement of the subject occurs. In this case, it is configured to measure the actual displacement and displacement value of the subject depending on whether only the displacement of the subject occurs or the displacement also occurs in the magnetic displacement of the measuring device 10.

First, as shown in FIGS. 1 to 4, the central processing unit 50 determines that the displacement of the subject has occurred by the displacement determining unit 55 based on the reference coordinate (A), and the magnetic displacement measuring unit 40 When the magnetic displacement of the measuring device 10 is not measured, the calculation unit 57 calculates the displacement value of the subject and notifies the manager of the tilt information as a warning.

In this case, the displacement determining unit 55 is photographed in real time by the image capture unit 30, and compares the captured image with the reference coordinate data for pixels converted by the image information conversion unit 51, and when displacement occurs, the subject It is determined that the displacement of will occur.

In addition, since the displacement of the measuring device 10 itself has not occurred and the tilt of the subject has changed, the calculation unit 57 calculates the coordinates (x, y) movement distance by Equation 1, and the central processing unit 50 The changed gradient value calculated by the calculation unit 57 is transmitted to the manager.

Equation 1:

In this case, the changed gradient value transmitted to the manager is transmitted from the central processing unit 50 to the manager's terminal using wired/wireless communication to notify a warning.

Next, as shown in FIGS. 1 to 4, the central processing unit 50 determines that the displacement of the subject has occurred by the displacement determination unit 55 based on the reference coordinates A, and the magnetic displacement measurement unit 40 When the magnetic displacement of the measuring device 10 is measured by , the calculator 57 calculates a coordinate displacement value using the magnetic displacement value and a pixel converted according to the coordinate movement of the subject.

In this case, the displacement determining unit 55 is photographed in real time by the image capture unit 30, and compares the captured image with the reference coordinate data for pixels converted by the image information conversion unit 51, and when displacement occurs, the subject It is determined that the displacement of will occur.

However, in this case, the displacement of the subject can be distinguished into a case where the displacement of the subject occurs only by the magnetic displacement of the measuring device 10 (case 1) and a case where the magnetic displacement of the measuring device 10 and the displacement of the subject are added (case 2). can If the decision logic for this is shown in FIG. 4, it will be described in detail below.

As shown in FIG. 4, this is the case where there is a change in the inclination data (B) measured by the magnetic displacement measurement unit 40. In this case, the coordinate values of the subject, that is, the reference coordinates (A) and the inclination data (B of the measuring device) ), and subtracting the inclination coordinates converted from the inclination data (B) from the coordinates (A) of the subject, the calculated value (C) is determined.

Afterwards, the calculated value (C) and the coordinates (A) of the subject are compared. If the comparison result is within the error range, it is determined that only the measuring device 10 is tilted (case 1), and the comparison result exceeds the error range. In this case, it is determined that displacement of the subject will also occur (second case).

In this case, as the criterion for the error range, the difference in coordinate values may be set to a decimal point or less, or a specific value less than or equal to the decimal point may be set, and displacement may be determined based on the set value.

First, in the case of the first case, the tilt data (B) measured by the magnetic displacement measurement unit 40 and the pixel obtained by converting the captured image with respect to the location where the current displacement occurred, that is, the distance between the subject and the measuring device 10, That is, the x-coordinate value can be specified.

Therefore, according to Equation 2, the y value, which is the coordinate movement distance in the vertical direction from the reference coordinate (A), can be calculated, and thereby the coordinate value of y can be measured. The x, y coordinate values calculated in this way are set as new reference coordinates (NC) and stored in the log record. In this case, a warning notification is not sent to the manager, because the displacement of the subject is determined based on the newly set reference coordinates (NC), so there is no need to notify the manager.

Equation 2:

Next, in the case of the second case, when the subject, the coordinates (A), and the calculated value (C) exceed the error range, it is determined that the subject has been displaced as shown in FIG. 4 . Therefore, the calculation unit 57 calculates the movement distance of the coordinates (x, y) according to Equation 1, and the central processing unit 50 sends the changed inclination value calculated by the calculation unit 57 to the manager to notify the inclination information will do

Furthermore, when the state diagnosis device according to the present invention is installed for the purpose of diagnosing cultural assets, it is necessary to prevent theft or damage of cultural assets. In preparation for this case, the measuring device 10 is equipped with an IR sensor 60 for object recognition, and if the cultural property that is the subject is not recognized by the IR sensor 60, this fact is immediately sent to the manager to give a warning notification. .

In this case, it is preferable that the central processing unit 50 automatically stores the image data taken in real time by the image capture unit 30 and checks the stored image data to perform a quick countermeasure.

The structure state diagnosis device using image information and sensors according to the present invention configured as described above measures the tilt of a subject such as a cultural property, building, object, etc. By minimizing the measurement error of the measurement target through image processing and correction, the displacement of the subject can be accurately measured and diagnosed.

In addition, the state diagnosis device according to the present invention is modularized by mounting a laser pointer as a reference coordinate setting unit 20, a camera as an image capturing unit 30, a tilt sensor and an IR sensor 60 as a magnetic displacement measuring unit 40, It is possible to diversify the purpose of use and expand the usability of the device by preventing theft from damage to structures (S) with high preservation value, such as cultural assets, as well as safety and tilt displacement of the structure (S). can

As such, the present invention has been described with reference to one embodiment shown in the drawings, but this is only exemplary, and those skilled in the art can make various modifications and equivalent other embodiments therefrom. will understand

Therefore, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims.

S: structure
A: reference coordinates
10: measuring device
20: reference coordinate setting unit
30: imaging department
40: magnetic displacement measurement unit
50: central processing unit
51: image information conversion unit 53: data storage unit
55: displacement determination unit 57: calculation unit
60: IR sensor

Claims (7)

measuring device 10;
a reference coordinate setting unit 20 provided in the measuring device 10 and configured to set reference coordinates A based on one point in the subject;
An image capturing unit 30 provided in the measuring device 10 and photographing the reference coordinates A set by the reference coordinate setting unit 20;
a magnetic displacement measuring unit 40 provided in the measuring device 10 to measure magnetic displacement; and
The image of the reference coordinates (A) photographed by the image capture unit 30 is converted into pixels and stored as reference coordinate data, and after determining whether or not the subject is displaced based on the set reference coordinate values, the displacement of the subject a central processing unit 50 for measuring whether magnetic displacement of the measuring device 10 is determined by the magnetic displacement measurement unit 40 when it is determined that it has occurred;
Structural state diagnosis apparatus using image information and sensors made up of a.
The method of claim 1, wherein the central processing unit (50)
An image information conversion unit 51 for converting the image captured by the image capturing unit 30 into pixels;
A data storage unit 53 for storing the reference coordinate values converted by the image information conversion unit 51;
A displacement discrimination unit 55 for determining whether or not the subject is displaced using the image information captured by the image capture unit 30;
A structure state diagnosis device using image information and a sensor, characterized in that it comprises a calculation unit (57) for calculating a coordinate shift value according to whether or not the subject is displaced.
According to claim 2,
When the central processing unit 50 determines that the displacement of the subject has occurred by the displacement determining unit 55 and the magnetic displacement measurement unit 40 does not measure the magnetic displacement,
Structure state diagnosis device using image information and sensors, characterized in that for issuing a warning to the manager of the displacement value of the subject calculated by the calculation unit (57).
According to claim 2,
When it is determined that the displacement of the subject has occurred by the displacement determination unit 55 and the magnetic displacement is measured by the magnetic displacement measurement unit 40 at the same time,
The calculation unit 57 calculates the coordinate displacement value using the magnetic displacement value and the pixel converted according to the coordinate movement of the subject.
According to claim 4,
The central processing unit 50 sets the coordinate displacement value calculated by the calculation unit 57 as a new reference coordinate (NC).
According to any one of claims 1 to 5,
The reference coordinate setting unit 20 is composed of a laser pointer,
The magnetic displacement measurement unit 40 is a structure state diagnosis device using image information and a sensor, characterized in that composed of a tilt sensor.
According to any one of claims 1 to 5,
Structure condition diagnosis device using image information and sensor, characterized in that the measuring device (10) is further equipped with an IR sensor (60) for recognizing the subject.

Images