KR102306056B1 - Method and apparatus for measuring size of damaged area of inside of sewer pipe - Google Patents

Abstract

Disclosed is a method for measuring a slope inside a sewer pipe using a processor. The method of the present invention comprises the steps of: obtaining inertia data in response to the movement of a moving object inside a sewer pipe; obtaining moving distance data in response to the movement of the moving object inside the sewer pipe; and calculating location information of the moving object inside the sewer pipe using the obtained inertia data and the obtained moving distance data.

Description

Method and apparatus for measuring size of damaged area of inside of sewer pipe

The present invention relates to a method and apparatus for measuring the slope inside a sewage pipe, and a method and apparatus for measuring the size of a damaged area inside a sewage pipe.

In general, the type of sewage pipe is buried in the ground in the form of a normal pipe isolated from the outside, and various harmful gases such as ammonia, hydrogen sulfide, trimethylamine, and methyl mercaptan are generated in the sewage pipe due to the retention of contaminants such as sewage.

In particular, hydrogen sulfide (H2S) is the main culprit of corrosion of concrete and acts as a factor of corrosion and damage of sewage pipes.

In addition, as the sewage conduit is used for a long period of time, the smooth drainage flow is inhibited due to the accumulation of pollutants, and structural and functional problems such as cracks due to the aging of the sewage conduit occur. It causes other problems such as groundwater pollution.

Therefore, in order to determine in advance whether a problem such as damage, cracking, or subsidence of the sewage pipe has occurred, continuous management of the sewage pipe is essential.

To this end, each local government not only builds a database (DataBase: DB) of basic specifications such as pipe type, pipe diameter, and year of laying of sewage pipes, but also records the status and performance of sewage pipes and uses them for maintenance of sewage pipes. have.

In the maintenance of such a sewage pipe, conventionally, a photographing device is installed on a moving object to photograph the sewage pipe, and damage, cracks, subsidence, etc. are determined by the inspector's naked eye based on the captured image.

In this case, since it is necessary to examine the image with the naked eye of the inspector, it is difficult to accurately measure the size or range of the damaged area such as the inconvenience of the image reading operation and the resulting decrease in productivity and damage or cracks.

On the other hand, even if the sewage pipe is constructed according to the design drawings, the actual position of the sewer pipe will be displaced over time depending on the condition of the land, etc. These displacements are the cause of sewage pipe defects.

Accordingly, it is necessary to accurately measure the information on the photographing location of the photographing equipment in the sewage conduit where the satellite positioning device cannot be used, such as in an indoor environment, and there is no suitable method for achieving this in the prior art.

The present invention has been devised to solve the above problems, and an object of the present invention is to provide a method and an apparatus for calculating location information coordinated inside a sewage conduit using inertial data and movement distance data.

Another object of the present invention is to provide a method and apparatus for measuring the slope inside a sewage conduit by using the calculated location information.

Another object of the present invention is to provide a method and apparatus for measuring the size of a sewage pipe damaged area by using location information matched to image data and an angle on the image of the damaged area.

The method for measuring the slope inside the sewage conduit using a processor according to an embodiment of the present invention for achieving the above object includes acquiring inertial data according to the movement of a moving body inside the sewage conduit; obtaining movement distance data according to the movement of the moving object; and calculating position information of the moving object in the sewage conduit by using the obtained inertia data and the obtained movement distance data.

In addition, the calculating of the location information may include comparing the time point at which the distance data and the inertia data are generated, and calculating the location information at the time point using the distance data and the inertia data generated at the same time point. have.

In addition, the method may further include generating slope data inside the sewage conduit based on the location information.

And, further comprising the step of acquiring image data of the inside of the sewage conduit photographed according to the movement of the mobile body, the image data may be image data photographed using an omnidirectional camera.

The method may further include mapping at least one of location information and gradient data corresponding to each of a plurality of frames constituting the image data, and generating a sewage conduit image map based on the mapped image data. .

On the other hand, the slope measuring device inside the sewage conduit according to an embodiment of the present invention for achieving the above object is an inertia measuring unit for acquiring inertial data according to the movement of a moving body inside the sewage conduit, inside the sewage conduit An encoder unit for obtaining movement distance data according to the movement of the moving body of .

In addition, the method for measuring the size of the damaged area inside the sewage conduit using a processor according to an embodiment of the present invention for achieving the above object is a specific area included in the image data photographed at the first position of the sewage conduit. selecting a first point and a second point of Calculating the size of the specific area using the mapped location information and the pixel angle, wherein the image data is an omnidirectional photographed image taken according to the movement of a moving body inside the sewage conduit, and the image data includes the sewage conduit. Location information and pixel angles that coordinate the interior may be mapped.

The calculating of the size of the specific region may include detecting first position information corresponding to the first position mapped to the image data and second position information corresponding to the second position, the first calculating a distance between a first position and a second position by using the position information and the second position information; a pixel angle corresponding to each of the first and second positions of the first position; calculating a pixel angle corresponding to each of the first point and the second point, and calculating a distance between the first point and the second point based on the calculated pixel angle and the calculated distance have.

On the other hand, the apparatus for measuring the size of the damaged area inside the sewage conduit according to an embodiment of the present invention for achieving the above object is a first point of a specific area included in the image data at a first position of the sewage conduit and A selection unit that selects a second point and selects the first point and the second point of the specific region included in the image data at the second location of the sewage conduit, and location information and pixel angle mapped to the image data and a control unit for calculating the size of the specific area using and pixel angles may be mapped.

On the other hand, the program according to an embodiment of the present invention for achieving the above object may include a program code for executing the method for measuring the slope inside the conduit.

According to the present invention, by calculating the position information of the moving object inside the sewage conduit using the inertial data obtained through the inertial measuring device and the moving distance data obtained through the encoder, the global positioning system (GPS) It is possible to accurately measure the position of a moving object even in the internal environment of the sewage pipe, where it is impossible to measure the position of the moving object.

And, since the calculated position value of the moving object can be used as a position value inside the sewage pipe, the inside of the sewage pipe can be coordinated using the calculated position information.

In addition, according to the present invention, it is possible to accurately measure the slope inside the sewage conduit by using the inertia data obtained through the inertia measurement device and the movement distance data obtained through the encoder, and accordingly, the water flow capacity of the sewage conduit can be checked, · It can help in decision-making to determine the priorities of maintenance and operation management.

In addition, according to the present invention, by measuring the size of the damaged area inside the sewage pipe using the angle and position information on the image, there is an effect that can objectively measure the size and range of the damaged area of the sewage pipe.

In addition, according to the present invention, the scale and size of the damaged part inside the sewage pipe and the slope information inside the sewage pipe can be managed by DB (Data Base), so that the efficiency of the work can be increased, and even after re-reading It has an easy effect.

1 is a block diagram illustrating an apparatus for measuring the inside of a sewage conduit according to an embodiment of the present invention.
2 is an exemplary view showing image data captured using an omnidirectional camera according to an embodiment of the present invention.
3 is a flowchart illustrating a method of calculating location information inside a sewage conduit according to an embodiment of the present invention.
4 is a flowchart illustrating a method for generating a sewage conduit image map according to an embodiment of the present invention.
5 is a block diagram illustrating an apparatus for measuring the size of a damaged area inside a sewage conduit according to an embodiment of the present invention.
6 is an exemplary view illustrating a method for measuring the size of a damaged area inside a sewage conduit according to an embodiment of the present invention.
7 is a flowchart illustrating a method for determining the size of a damaged area inside a sewage conduit according to an embodiment of the present invention.
8 is an exemplary view illustrating image data inside a sewage conduit according to an embodiment of the present invention.
9 is an exemplary diagram illustrating a case in which a moving object is implemented as an underwater drone according to an embodiment of the present invention.

The following is merely illustrative of the principles of the invention. Therefore, those skilled in the art can devise various devices that, although not explicitly described or shown herein, embody the principles of the invention and are included in the spirit and scope of the invention. In addition, it should be understood that all conditional terms and examples listed herein are, in principle, expressly intended only for the purpose of understanding the inventive concept and are not limited to the specifically enumerated embodiments and states as such. .

Moreover, it is to be understood that all detailed description reciting specific embodiments, as well as principles, aspects, and embodiments of the present invention, are intended to cover structural and functional equivalents thereof. It is also to be understood that such equivalents include both currently known equivalents as well as equivalents developed in the future, ie, all devices invented to perform the same function, regardless of structure.

Accordingly, it should be understood that all flowcharts, state transition diagrams, pseudo code, etc. may be tangibly embodied on a computer-readable medium and represent various processes performed by a computer or processor, whether or not a computer or processor is explicitly shown. .

The functions of the various elements shown in the figures including a processor or functional blocks represented by similar concepts may be provided by the use of dedicated hardware as well as hardware having the ability to execute software in association with appropriate software. When provided by a processor, the functionality may be provided by a single dedicated processor, a single shared processor, or a plurality of separate processors, some of which may be shared.

The above-described objects, features and advantages will become more apparent through the following detailed description in relation to the accompanying drawings, and accordingly, those of ordinary skill in the art to which the invention pertains will be able to easily practice the technical idea of the invention. .

In addition, in the description of the invention, if it is determined that a detailed description of a known technology related to the invention may unnecessarily obscure the gist of the invention, the detailed description thereof will be omitted.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating an apparatus 100 for measuring the inside of a sewage conduit according to an embodiment of the present invention. Referring to FIG. 1 , the sewage pipe internal measuring device 100 includes an inertia measuring unit 110 , an encoder unit 120 , a location information generating unit 130 , a slope calculating unit 140 , an image acquiring unit 150 , It may include all or part of the mapping unit 160 and the sewage conduit image map generation unit 170 .

Here, the apparatus 100 for measuring the inside of the sewage conduit may be mounted on a moving body traveling inside the sewage conduit, and may collect exploration data for the inside of the conduit at the same time as the moving body travels.

In the sewage conduit, sewage refers to sewage and rainwater, and the conduit may be implemented in various forms such as a square or a circle in cross-section.

Sewage may or may not flow in the sewage conduit, depending on the installation location of the conduit.

The moving body may be implemented as a vehicle running inside a sewage conduit through which no sewage flows. Alternatively, the moving body may be implemented as an underwater drone capable of buoying on sewage flowing in a sewage conduit. Alternatively, the mobile body may be implemented as a mobile body capable of amphibious travel.

Such a moving body may be implemented in the form of traveling inside the sewage conduit using the driving force transmitted from the power source, or may be implemented in the form of moving by receiving the power of a person without a separate power source.

Meanwhile, according to another embodiment, the mobile body may be implemented as a person.

Accordingly, the sewage pipe internal measuring device 100 is mounted on a moving body and moves with the movement of the moving body, and obtains inertial data through the inertia measuring unit 110 and the moving distance data through the encoder unit 120. have. In addition, the apparatus 100 for measuring the inside of the sewage pipe may calculate location information of the moving object inside the sewage pipe by using the obtained inertia data and the movement distance data.

In addition, the apparatus 100 for measuring the inside of the sewage pipe may acquire and calculate various data representing the sewage pipe, such as image data, location information, and the slope of the sewage pipe inside the sewage pipe.

This, sewage pipe internal measurement device 100 may be implemented using software, hardware, or a combination thereof. For example, according to the hardware implementation, ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors (processors) ), controllers, micro-controllers, micro-processors, and other electrical units for performing other functions.

Hereinafter, each configuration constituting the sewage pipe internal measurement device 100 will be described in more detail.

The inertia measurement unit 110 may generate inertia data according to the movement of a moving body moving inside the sewage pipe for observation of the sewage pipe.

Specifically, the inertia measurement unit 110 detects a change in at least one of acceleration, angular velocity, geomagnetism, and altitude in the three-axis direction when the moving object moves in the sewage conduit, and detects a change in at least one of the detected acceleration, angular velocity, geomagnetism, and altitude. Inertia data may be generated based on at least one or more values. That is, the inertia data may be generated based on a change in at least one of acceleration, angular velocity, geomagnetism, and altitude according to the movement of the moving object. Here, the inertia measurement unit 110 may include an accelerometer, an angular accelerometer, a geomagnetometer, and an altimeter. Also, the inertial measurement unit 110 may be implemented as an Inertial Measurement Unit (IMU) sensor.

The encoder unit 120 may generate movement distance data by measuring the distance traveled by the moving object in the sewage conduit.

Specifically, the encoder unit 120 detects the number of revolutions of the motor unit (not shown) or the number and direction of rotation of the wheels (not shown) of the moving object, and based on the sensed number of revolutions or the direction of rotation, the sewage pipe measuring device ( 100) may generate distance data by calculating the distance actually moved.

In addition, the encoder unit 120 detects the number of revolutions of a plurality of wheels (not shown), and calculates the distance and direction the moving object actually moves based on the number of revolutions of each wheel (not shown) to obtain moving distance data. can create

For example, if the sewage pipe measuring device 100 is configured with four wheels (not shown), the encoder unit 120 compares the rotational speed and the rotational direction of each of the four wheels (not shown) so that the sewage moving body is actually Moving distance data can be generated by calculating the moving distance and moving direction. Accordingly, the moving distance data may include the actual moving distance and moving direction of the moving object.

Alternatively, a wire may be connected to the moving object, and the encoder unit 120 may calculate the moving distance data of the moving object based on information on the length of the unwrapped wire.

The location information generating unit 130 may calculate the location information of the moving object in the sewage conduit by using the inertia data obtained from the inertia measurement unit 110 and the movement distance data obtained from the encoder unit 120 .

That is, since the position estimation using only the inertia data obtained from the inertial measurement unit 110 tracks the accumulated value of the measured data of the inertial sensor, an error due to noise is amplified over time, thereby causing a large position error. If this data can be corrected using the GPS value, the error can be resolved, but the GPS value cannot be used inside the sewage conduit.

Accordingly, the position information generating unit 130 according to the present invention integrates the inertia data obtained from the inertia measuring unit 110 to generate position information before correction, and the generated position information before correction from the encoder unit 120 . It is possible to calculate the position information of the moving object in the sewage conduit by correcting it based on the obtained moving distance data. As an example, the distance between the current position and the past position is calculated from the pre-correction position information calculated through the integration of the inertial data, and the calculated distance information is compared with the moving distance data obtained from the encoder unit 120 to perform the position correction. It is possible to generate a correction value for the purpose, and to generate position information after correction by correcting the position information before correction based on the generated correction value.

Here, the position information before correction is calculated based on only the inertia data of the inertia measurement unit 110, and the error due to noise is amplified over time, resulting in a large position error, but the position information after correction according to the present invention is the encoder unit Position information of the moving object may be accurately calculated by correcting the position information before correction based on the movement distance data obtained from 120 .

Here, the calculated location information of the moving body inside the sewage pipe may be used as a value indicating the location of the internal space of the sewage pipe. That is, the location information calculated by the location information generator 130 may be a three-dimensional coordinate value that coordinates the inside of the sewage conduit.

The location information generator 130 may calculate location information of the moving object based on various methods as follows.

As an example, the location information generator 130 may generate location information by correcting a measurement value of inertia data based on movement distance data using an Extended Kalman Filter.

As another example, the location information generator 130 may estimate a location by using acceleration and angular velocity values among distance data measured by the encoder unit 120 and inertia data measured by the inertia measurement unit 110 .

Specifically, the location information generator 130 may calculate location information using Equation 1 below.

Here, Position(2) is corrected position information, and Position(1) indicates an existing position.

And, theta represents the difference in the horizontal inclination angle of the current movable body from the horizontal plane. Here, theta may be calculated using the acceleration and angular velocity values and distance data included in the inertia data.

Also, Delta can use the encoder data as it is. Alternatively, Delta may use the corrected encoder data using the angle calculated by tracking and accumulating the current position of the moving object from the starting point of the moving object.

As another example, the location information generator 130 may calculate location information using Equation 2 below.

Here, Position(2) is corrected position information, Position(1) is an existing position, and A may have a value between 0 and 1 as a weight. Here, as A is closer to 1, a weight is assigned to the distance data, and as A is closer to 0, a weight is assigned to the inertia data.

In other words, it is possible to suppress drifting by complementing and synthesizing the inertial measurement sensor values having a time error by performing several times per second (especially, angular accelerometer drifting rotation axis, accelerometer coordinate axis random noise phenomenon) and encoder sensor values having absolute error. can

Meanwhile, when calculating the location information, the location information generating unit 130 compares the moving distance data and the inertia data generation time point, and using the moving distance data and the inertia data generated at the same time point, the location information at the corresponding time point. can be calculated.

As such, the location information generating unit 130 may calculate accurate location information by correcting the accumulated error that may occur in the inertia data with distance data, and accordingly, the inside of the sewage conduit may be accurately coordinated.

The slope calculator 140 may calculate the slope inside the sewage conduit.

Specifically, the slope calculation unit 140 may generate slope data by calculating the slope inside the sewage conduit by using the inertia data obtained by the inertia measurement unit 110 and the distance data measured by the encoder unit 120 . . In this case, the inclination calculator 140 sets the x-axis value and the y-axis value to the same constant (that is, assuming that the position of the moving object does not change on the x-axis and the y-axis), and the inertia measurement unit only for the z-axis value The slope inside the sewage conduit may be calculated using the inertia data obtained at 110 and the distance data measured by the encoder unit 120 .

Alternatively, the slope calculation unit 140 may generate slope data by calculating the slope of the sewage conduit based on the position information generated by the position information generation unit 130 . Specifically, the slope calculating unit 140 may generate slope data inside the sewage conduit based on the Z-axis change amount of the position information generated by the position information generating unit 130 .

Here, the generated slope data may be used to determine the water passage capability of the sewage conduit.

The image acquisition unit 150 may acquire image data of the inside of the sewage conduit photographed according to the movement of the mobile body. Here, as the image data, a camera capable of capturing an omnidirectional image may be used. In this case, the obtained image data may include a pixel angle.

The pixel angle will be described with reference to FIG. 2 .

2 is an exemplary view showing spherical image data taken with an omnidirectional camera according to an embodiment of the present invention.

Referring to FIG. 2 , each region (b, c, d) of 360-degree spherical image data may have a pixel angle corresponding to each. Here, the pixel angle means an angle formed by each region from the reference point of the image data, and the reference point may be the center of the image data or the position of the image acquisition unit 150 .

For example, the pixel angle of the region corresponding to the center of the image data may be 0 degrees.

That is, the image data includes a pixel angle corresponding to each region, and the pixel angle of each region means an angle between the corresponding region and a reference point of the image data.

Meanwhile, each region (b, c, d) may correspond to one pixel or a plurality of pixels, and may have different pixel angles for each region of image data. Also, the spherical image data is an example, and may be implemented in other forms.

In addition, the image data may include a specific area of the sewage conduit. For example, the specific region may be a damaged region in which cracks, corrosion, breakage resistance, cracks, and the like occur.

On the other hand, the specific area included in the image data is not limited to the above-described example, and refers to all areas in which inspection factors for managing sewage pipes are reflected.

The mapping unit 160 may map at least one of the location information generated by the location information generator 130 and the tilt data calculated by the tilt calculator 140 to the image data.

Specifically, the mapping unit 160 may map at least one of position information and tilt data corresponding to each of a plurality of frames constituting image data.

The sewage conduit image map generating unit 170 may generate an image map of the sewage conduit by using the data mapped by the mapping unit 160 .

Specifically, the sewage conduit image map generating unit 170 may generate an image and a sewage conduit image map indicating a location inside the sewage conduit at which the image is captured by using the location information mapped to the image data.

In addition, the sewage conduit image map generator 170 may generate an image and a sewage conduit image map specifically showing only the slope inside the sewage conduit where the image is captured by using the slope data mapped to the image data.

Here, the generated sewage conduit image map may be in a format that can be read through a computing device, and may be displayed through a display of the computing device.

Next, a method of calculating the location information of the inside of the sewage pipe of the sewage pipe internal measurement device 100 with reference to FIG. 3 will be described.

3 is a flowchart illustrating a method of calculating location information inside a sewage conduit according to an embodiment of the present invention.

Referring to FIG. 3 , the apparatus 100 for measuring the inside of the sewage pipe may acquire inertia data according to the movement of a moving body moving inside the sewage pipe for observation of the sewage pipe ( S10 ).

Specifically, when the moving object moves in the sewage conduit, the inertia measuring unit 110 detects a change in at least one of acceleration, angular velocity, geomagnetism, and altitude in the three-axis direction, and detects a change in at least one of the detected acceleration, angular velocity, geomagnetism, and altitude. Inertia data may be generated based on at least one or more values.

Meanwhile, the apparatus 100 for measuring the inside of the sewage pipe may measure the distance moved inside the sewage pipe according to the movement of the moving object to generate distance data (S20).

In addition, the sewage pipe internal measurement apparatus 100 may calculate the location information of the moving object inside the sewage pipe using the inertia data and the moving distance data (S30).

Specifically, in the step of calculating the location information, the sewage conduit measuring apparatus 100 compares the moving distance data and the inertial data generation time point, and using the moving distance data and the inertial data generated at the same time point, the location of the corresponding time point. information can be calculated.

At this time, the sewage pipe internal measurement apparatus 100 may calculate the location information using the inertia data and the movement distance data based on Equations 1 and 2 described above.

On the other hand, additionally, the sewage pipe internal measurement device 100 may generate a sewage pipe image map by photographing a sewage pipe image, which will be described with reference to FIG. 4 .

4 is a flowchart illustrating a method for generating a sewage conduit image map according to an embodiment of the present invention.

Referring to FIG. 4 , the apparatus 100 for measuring the inside of the sewage pipe may acquire image data by photographing the inside of the sewage pipe according to movement ( S100 ).

In addition, the sewage pipe internal measurement device 100 may generate the slope data by calculating the slope of the sewage pipe based on the inertia data and the movement distance data (S200).

In addition, the sewage pipe internal measurement apparatus 100 may map the calculated gradient data to the image data (S300).

In addition, the sewage pipe internal measurement apparatus 100 may generate a sewage pipe image map based on the mapped image data (S400).

On the other hand, the sewage pipe image map generated by the sewage pipe internal measurement device 100 may be used as visualization data for efficient reading of abnormal areas and DB construction of automatic reading technology.

In addition, the sewage conduit image map can be used as a DB for future application of deep learning technology.

In addition, location information, image data, movement distance data, inertia data, slope data, etc. generated by the sewage pipe internal measurement device 100 may be used to determine the size of a crack in the sewage pipe, and the sewage pipe internal measurement device ( 100) may be implemented as a module of the apparatus 200 for determining the size of a crack in a sewage conduit.

However, the present invention is not limited thereto, and the apparatus 200 for measuring the size of the damaged area inside the sewage conduit may be implemented as a separate module from the apparatus 100 for measuring the inside of the sewage conduit.

Hereinafter, the apparatus 200 for measuring the size of the damaged area inside the sewage pipe will be described.

5 is a block diagram illustrating an apparatus for measuring the size of a damaged area inside a sewage conduit according to an embodiment of the present invention. Referring to FIG. 5 , the apparatus 200 may determine the size of a specific area in the sewage conduit by using the location information, image data, distance data, inertia data, etc. generated by the above-described apparatus 100 for measuring the inside of the sewage conduit. have. Here, the specific area is a damaged area in the sewage pipe, and may be an area in which cracks, corrosion, damage resistance, cracks, etc. have occurred.

Here, the device 200 may include a storage unit 210 , an input unit 220 , and a control unit 230 . The device 200 for measuring the size of the damaged area inside the sewage pipe is implemented as a user's terminal device, for example, a personal computer (PC), laptop, laptop, tablet, etc. , or may be implemented as one module constituting the terminal device.

If implemented as one module, the apparatus 200 for measuring the size of the damaged area inside the sewage conduit may be implemented using software, hardware, or a combination thereof. For example, according to the hardware implementation, ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors (processors) ), controllers, micro-controllers, micro-processors, and other electrical units for performing other functions may be implemented using at least one.

Specifically, the storage unit 210 may receive and store data generated by the sewage pipe internal measurement device 100 . More specifically, the storage unit 210 may receive and store the image data generated by the apparatus 100 for measuring the inside of the conduit. Here, location information, tilt data, pixel angle, etc. may be mapped to the image data. In addition, movement distance data, inertia data, etc. generated by the apparatus 100 for measuring the inside of the sewage pipe may be mapped to the image data.

The storage unit 210 includes random access memory (RAM), flash memory, read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), registers, hard disk, removable disk, and memory. It may be implemented as a storage device of a built-in type such as a card or a Universal Subscriber Identity Module (USIM), as well as a storage device of a removable type such as a USB memory.

The input unit 220 functions to convert a physical input from the outside of the electronic device 200 into a specific electrical signal. Here, the input unit 220 may include all or part of the user input unit 220 and the microphone unit 222 .

The user input unit 221 may receive a user input such as a touch or a push operation. Here, the user input unit 221 may be implemented using at least one of various button shapes, a touch sensor for receiving a touch input, and a proximity sensor for receiving an approaching motion.

For example, the user input unit 221 may receive a user input for selecting a first point of a specific area included in the image data of the sewage conduit. Here, the specific area may be an area where corrosion, damage resistance, cracks, etc. have occurred as an abnormal site in the sewage pipe.

In addition, the user input unit 221 may receive a user input for selecting a plurality, such as a first point and a second point of a specific area included in the image data of the sewage conduit. Here, the first point and the second point mean a part of a region included in the specific region.

The microphone unit 222 may receive a user's voice and a sound generated inside or outside.

The controller 230 may determine the size of the specific area based on a user input or automatically detecting a point of the specific area.

Specifically, when points of a specific area are selected according to a user input, the controller 230 may determine the size of the specific area based on the selected point. For example, the controller 230 may detect first location information corresponding to the first location mapped to the image data and second location information corresponding to the second location. In addition, the controller 230 may detect a pixel angle corresponding to each of the first and second points of the first position, and a pixel angle corresponding to each of the first and second points of the second position. In addition, the controller 230 may calculate the size of the specific area using the first location information, the second location information, and the pixel angle.

However, the present invention is not limited thereto, and the control unit 230 detects a damaged area in the image data using the previously learned damaged area learning data, and automatically selects two outermost points in the detected damaged area, thereby size can be determined.

Specifically, the damaged area detection unit (not shown) performs learning through machine learning or deep learning on the image of the damaged area, such as a crack inside the sewage conduit, and a learning model for detecting the damaged area. can be built, and the damaged area can be detected from the image data based on the built learning model. Here, the constructed model is an algorithm or program for detecting a damaged area in an image.

In addition, the learning model for detecting the damaged area may be trained as a more advanced model using an output value representing the result of detecting the damaged area. For example, when the output result is an incorrect answer, the user may input a response to the output result, and the damaged area detection unit (not shown) may train a learning model for detecting the damaged area based on the user's response.

That is, according to the present invention, a learning model for detecting a damaged area may be generated by performing machine learning or deep learning, and a damaged area may be detected from an image using the generated model. Here, for deep learning, a Convolution Neural Network (CNN) algorithm, which is one of neural network models, may be applied. In this case, deep learning may perform learning through augmentation data assuming various conditions of the driving image. Here, the condition defines a condition for transforming an image collected for learning a neural network model. Specifically, since various aspects may be exhibited by factors such as shift, rotation, brightness change, and blur of the image, data may be propagated in consideration of this.

Hereinafter, a method of measuring the size of a damaged area according to an embodiment of the present invention will be described in more detail with reference to FIG. 6 .

6 is an exemplary view showing a method for measuring the size of a sewage pipe damaged area according to an embodiment of the present invention.

Referring to FIG. 6 , a user input for selecting a first point (b) and a second point (c) of a specific area (a) in a first location (a) may be received through the input unit 220 . Here, the first point (b) and the second point (c) may be a starting point and an ending point of the damaged area. In addition, a user input for selecting the first point (b) and the second point (c) of the specific area (a) at the second location (b) may be received.

), 제2 지점(ㄷ)에 대응되는 픽셀 각도(

)를 검출할 수 있다. 그리고, 제어부(230)는 제2 위치(b)에서 특정 영역(ㄱ)의 제1 지점(ㄴ)에 대응되는 픽셀 각도(

), 제2 지점(ㄷ)에 대응되는 픽셀 각도(

)를 검출할 수 있다. In this case, the controller 230 controls the pixel angle (b) corresponding to the first point (b) of the specific area (a) in the first position (a).

), the pixel angle corresponding to the second point (c) (

) can be detected. Then, the control unit 230 controls the pixel angle (b) corresponding to the first point (b) of the specific area (a) at the second position (b).

), the pixel angle corresponding to the second point (c) (

) can be detected.

Here, the first point (b) and the second point (c) of the specific area (a) at the first location (a) and the first point (b) and the second point (b) of the specific area (a) at the second location (b) The two points (c) have different pixel angles because image data acquisition positions are different from each other. In addition, the pixel angle is an angle between each point and the reference point of the image data, and the reference point of the image data may be a center of the image data.

In addition, the controller 230 may calculate the distance L between the two locations based on the first location information corresponding to the first location (a) and the second location information corresponding to the second location (b). .

)와 제2 위치(b)에서 특정 영역(ㄱ)의 제1 지점(ㄴ) 및 제2 지점(ㄷ) 각각에 대응되는 픽셀 각도(

)와 양 위치(a,b) 사이의 거리(L)를 기초로 특정 영역(ㄱ)의 제1 지점(ㄴ)에서 제2 지점(ㄷ)까지의 길이를 판단할 수 있다. In addition, the controller 230 controls the pixel angle ( ) corresponding to each of the first point (b) and the second point (c) of the specific area (a) at the first position (a).

) and the pixel angle (

) and the distance (L) between the two positions (a, b) may determine the length from the first point (b) to the second point (c) of the specific area (a).

)와 양 위치(a,b) 사이의 거리(L)를 수학식 3에 적용하여

와

의 크기를 산출하고, 수학식 4에 적용하여

와

의 크기를 산출할 수 있다. 그리고, 제어부(230)는 계산된

와

의 크기 차이 또는

와

의 크기 차이를 통해 제1 지점(ㄴ)에서 제2 지점(ㄷ)까지의 길이를 산출할 수 있다.Specifically, the controller 230 controls the acquired pixel angle (

) and the distance (L) between the positions (a, b) by applying Equation 3 to

Wow

Calculate the size of and apply Equation 4 to

Wow

size can be calculated. And, the control unit 230 calculates

Wow

the size difference of or

Wow

The length from the first point (b) to the second point (c) can be calculated through the difference in size of .

) 또는 제2 지점(ㄷ)의 높이(

)도 산출할 수도 있다.In addition, the control unit 230 is the height of the first point (b) from the bottom of the sewage pipe with reference to Equations 3 and 4 (

) or the height of the second point (c) (

) can also be calculated.

In addition, the controller 230 controls the pixels at the first point (b) and the second point (c) at the first location (a) compared to the distance (L) between the first location (a) and the second location (b). The size of the specific region may be determined based on the angle and the rate of change of the pixel angle of the first point (b) and the second point (c) at the second position (b).

That is, the controller 230 may determine the size of the crack by using pixel angle and position information for the first point and the second point of the same crack at two locations. Here, the size may be a concept including width and length.

Through this, the present invention can objectively measure the size and range of the damaged part of the sewage conduit.

In addition, according to the present invention, the scale and size of the damaged part inside the sewage pipe and the slope information inside the sewage pipe can be managed by DB (Data Base), so that the efficiency of the work can be increased, and even after re-reading It has an easy effect.

Next, a method of determining the size of a specific region such as a damaged region will be described with reference to FIG. 7 .

Referring to FIG. 7 , the apparatus 200 may receive a user input for selecting a first point and a second point of a specific area included in image data at a first location of a sewage conduit ( S1000 ).

Also, the device 200 may receive a user input for selecting a first point and a second point of a specific area included in the image data at the second location of the sewage conduit (S2000).

Referring additionally to FIG. 8 in this regard, the device 200 shows a first point (a) and a second point (b) of a specific area included in the image data at the first location of the sewage conduit as shown in FIG. 8(a). ), the user selects the first point (c) and the second point (d) of a specific area included in the image data at the second location of the sewage conduit as shown in FIG. 8(b) input can be received.

Here, the first point (a) and the first point (c) selected from the images taken at each of the first position and the second position are the same point, and the second point (b) and the second point (d) are the same point , it may be a starting point and an ending point of the damaged area.

Also, the device 200 may determine the size of a specific area including the selected points based on the received user input ( S3000 ).

Specifically, the electronic device 200 may determine the size of the specific region by comparing the pixel angle and position information of the first and second points selected at the first position and the second position, respectively.

For example, based on the distance between the pixel angle corresponding to the first point of the specific area at the first position and the pixel angle corresponding to the first point of the specific area at the second position, and the distance between the two positions at the first position A length from the first point to the second point of the specific region may be calculated.

As another example, the electronic device 200 may determine the size of the specific region based on a change ratio of the pixel angle of the first point and the second point to the distance between the first location and the second location.

9 is an exemplary diagram illustrating a case in which a moving object is implemented as an underwater drone according to an embodiment of the present invention. Referring to FIG. 9 , the mobile body according to the present invention may be implemented as an underwater drone 1 running in a sewage conduit filled with sewage, and the underwater drone 1 may be equipped with a sewage pipe internal measurement device 100 . have.

In this case, the underwater drone 1 can move while floating on the sewage level inside the sewage conduit. In addition, the sewage pipe internal measurement device 100 uses inertial data according to the movement of the underwater drone 1 and the movement distance data calculated using a wire connected to the underwater drone 1 to provide location information of the underwater drone 1 . can be calculated, and also slope data can be calculated.

Here, since the depth of the water filled in the sewage conduit may vary depending on the slope of the lower inner wall of the sewage conduit, the slope data calculated by the apparatus 100 for measuring the inside of the sewage conduit may be used as a predicted slope of the sewage conduit.

Accordingly, according to the present invention, the slope of the sewage pipe can be predicted based on the slope data calculated by the sewage pipe internal measurement device 100 .

On the other hand, in the specification and claims, terms such as "first", "second", "third", and "fourth", if any, are used to distinguish between similar elements, although this is not necessarily the case. Used to describe a specific sequence or sequence of occurrences. It will be understood that the terms so used are interchangeable under appropriate circumstances to enable the embodiments of the invention described herein to operate, for example, in sequences other than those shown or described herein. Likewise, where methods are described herein as comprising a series of steps, the order of those steps presented herein is not necessarily the order in which those steps may be executed, and any described steps may be omitted and/or Any other steps not described may be added to the method.

Also, terms such as "left", "right", "front", "behind", "top", "bottom", "above", "below" in the specification and claims are used for descriptive purposes, It is not necessarily intended to describe an invariant relative position. It will be understood that the terms so used are interchangeable under appropriate circumstances to enable the embodiments of the invention described herein to operate otherwise than, for example, as shown or described herein. As used herein, the term “connected” is defined as being directly or indirectly connected in an electrical or non-electrical manner. Objects described herein as being "adjacent" to one another may be in physical contact with one another, in proximity to one another, or in the same general scope or area as appropriate for the context in which the phrase is used. The presence of the phrase “in one embodiment” herein refers to the same, but not necessarily, embodiment.

Also, in the specification and claims, references to 'connected', 'connecting', 'fastened', 'fastening', 'coupled', 'coupled', etc., and various variations of these expressions, refer to other elements directly It is used in the sense of being connected or indirectly connected through other components.

In addition, the suffixes "module" and "part" for the components used in this specification are given or mixed in consideration of the ease of writing the specification, and do not have distinct meanings or roles by themselves.

In addition, the terms used herein are for the purpose of describing the embodiments and are not intended to limit the present invention. As used herein, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, 'comprise' and/or 'comprising' means that a referenced component, step, operation and/or element is the presence of one or more other components, steps, operations and/or elements. or addition is not excluded.

The above description is merely illustrative of the technical idea of the present invention, and those of ordinary skill in the art to which the present invention pertains may make various modifications, changes and substitutions within the scope without departing from the essential characteristics of the present invention. will be.

Accordingly, the embodiments disclosed in the present invention and the accompanying drawings are intended to explain, not to limit the technical spirit of the present invention, and the scope of the technical spirit of the present invention is not limited by these embodiments and the accompanying drawings. . The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

Meanwhile, the above-described methods according to various embodiments of the present invention may be implemented as a program and provided to a server or devices. Accordingly, each device can download the program by accessing the server or device in which the program is stored.

In addition, the above-described method according to various embodiments of the present invention may be implemented as a program and stored in various non-transitory computer readable media to be provided. The non-transitory readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc., and can be read by a device. Specifically, the various applications or programs described above may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims Various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

100: sewage pipe internal measurement device 110: inertial measurement unit
120: encoder unit 130: location information generating unit
140: slope calculation unit 150: image acquisition unit
160: mapping unit 170: three-dimensional sewage conduit image map generation unit
200: device for measuring the size of the damaged area inside the sewage pipe
210: storage unit 220: input unit
230: control unit

Claims (13)

delete delete delete delete delete delete In the method of measuring the size of the damage area inside the sewage conduit using a processor,
selecting a first point and a second point of a specific area included in the image data captured at the first location of the sewage conduit;
selecting the first point and the second point of the specific area included in the image data photographed at the second location of the sewage conduit; and
Calculating the size of the specific area by using the location information and the pixel angle mapped to the image data;
The image data is an omnidirectional photographed image taken according to the movement of the inside of the sewage conduit of the mobile body, and the image data has location information coordinated with the inside of the sewage conduit and pixel angles are mapped. How to measure the size of. 8. The method of claim 7,
Calculating the size of the specific region comprises:
detecting first location information corresponding to the first location mapped to the image data and second location information corresponding to the second location;
calculating a distance between a first location and a second location using the first location information and the second location information;
calculating a pixel angle corresponding to each of the first and second points of the first position, and a pixel angle corresponding to each of the first and second points of the second position; and
Calculating the distance between the first point and the second point based on the calculated pixel angle and the calculated distance. In the device for measuring the size of the damaged area inside the sewage conduit,
The first point and the second point of the specific area included in the image data are selected at the first location of the sewage conduit, and the first point and the second point of the specific area included in the image data are selected at the second location of the sewage pipe. a selection unit for selecting a second point; and
A control unit for calculating the size of the specific region by using the pixel angle and the location information mapped to the image data;
The image data is an omnidirectional photographed image taken according to the movement of the inside of the sewage conduit of the mobile body, and the image data has location information coordinated with the inside of the sewage conduit and pixel angles are mapped. size measuring device. 10. The method of claim 9,
The control unit is
detecting first location information corresponding to the first location mapped to the image data and second location information corresponding to the second location;
calculating a distance between a first location and a second location using the first location information and the second location information,
calculating a pixel angle corresponding to each of the first and second points of the first position, and a pixel angle corresponding to each of the first and second points of the second position;
Based on the calculated pixel angle and the calculated distance, the apparatus for measuring the size of the damaged area inside the sewage conduit, characterized in that calculating the distance between the first point and the second point. 9. The method of claim 8,
Calculating the height of each of the first point and the second point on the basis of the calculated pixel angle and the calculated distance; 11. The method of claim 10,
The control unit is
Based on the calculated pixel angle and the calculated distance, the apparatus for measuring the size of the damaged area inside the sewage conduit, characterized in that the height of each of the first point and the second point is calculated. A program stored in a recording medium in which a program code for executing the method for measuring the size of a damaged area inside a sewage conduit according to any one of claims 7, 8 and 11 is recorded.

Images