KR102343248B1 - System of detecting damage status on cultural property with image big-data and operating method thereof - Google Patents

Abstract

The present invention relates to a system for inspecting cultural heritage damage by image big data and a method for operating the same, wherein a damaged state of roof tiles that protect the roof structures of cultural assets such as buildings from snow and rain can be safely, quickly and precisely analyzed using video images and color separation techniques captured by drones, and location information and image processing technology. The system comprises: a drone photography unit in which by recording the source signal of the acquired image taken simultaneously with visible light, microwave signal, and infrared signal at a location designated by GPS coordinate information and beacon location information on a specific part of the roof of the cultural property in frame unit, the same is encrypted into a packet image frame signal, and simultaneous transmission is performed on each channel of multiple communication methods; a wireless relay booster unit in which wireless access is performed at a short distance through each channel by multiple communication methods of Wi-Fi wireless communication method, FM wireless communication method, and Bluetooth wireless new method to the drone photography unit, and each encrypted acquired image packet frame signal is received and delivered all at the same time; and a tiling condition analysis server in which wired connection is made with the wireless relay booster, the acquired image packet frame signal is received through each channel of multiple communication methods, any one acquired image packet frame signal without transmission error is selected and decoded, source signals of the acquired images taken with visible light, microwave and infrared, respectively, are separated, each image processing analysis is performed to estimate the damage grade of the roof tiles, and a final damage grade is detected by processing the arithmetic average of each estimated damage grade.

Description

System of detecting damage status on cultural property with image big-data and operating method thereof

The present invention relates to a system for inspecting cultural properties damage by image big data and a method for operating the same, and more particularly, to a cultural property including stone and wooden objects exposed to the outdoors is exposed to snow, rain, wind and sunlight and is naturally damaged In the state of being damaged or artificially damaged by a human, it is quickly, safely and precisely inspected and damaged by color separation technique, location information, image processing technology, and image big data analysis on video images taken aerially with a drone. It relates to a system for inspecting cultural properties damage by analyzing image big data and its operation method.

Since our people can boast a long history and tradition of more than half a million years, it is true that the remaining cultural assets are very diverse and numerous, and these cultural assets include stone and wooden structures.

Among cultural properties, if they are built or exposed outdoors, they are damaged by snow, rain, wind, sunlight, shock, artificial damage, animals and plants, etc. It loses its value and takes a lot of time and money to restore it.

In the case of wooden buildings, roofing tiles are used to protect against snow and rain, and the roofing tiles are made by forming a selected specific type of soil into the shape of a roofing tile and baking it at a high temperature to increase durability. , When exposed to natural environments such as rain, wind, sunlight, plants, etc., it is damaged by weathering, etc., and snow, rain, etc. penetrate into the inside of the building by the damaged roof tiles and shorten the lifespan of the building by rotting the wooden materials. do.

Stone buildings may have walls, stone towers, etc., and if exposed to natural environments such as snow, rain, wind, sunlight, and plants for a long time, they last longer than wooden buildings, but they are also damaged due to weathering, etc. and may be artificially damaged.

If the preservation value is high and it has been built for a long time, such as cultural assets including wooden and stone buildings, damage and damage conditions should be frequently inspected and repaired.

As a prior art that partially resolves this need, there is a 'method light server for providing cultural properties inspection service using a drone' according to Korean Patent Application No. 10-2019-0178944 (2019. 12. 31.).

1 is a functional configuration diagram of a system for inspecting cultural properties damage by a drone according to an embodiment of the prior art.

Hereinafter, when the prior art will be described in detail with reference to the accompanying drawings, it is a configuration including the server 100 , the database 300 , and the drone 500 .

The server 100 includes hardware consisting of a processor, memory, etc. and software of an application for operation, and further includes a communication unit for wireless communication with the drone 500 , and connects to the database 300 in communication with the drone 500 . ) and records the secured information in the allocated area. The database 300 records and stores sample images for determining a damaged grade for each cultural property or similar cultural property in a separately allocated area.

The drone 500 secures a target image for a designated location of a specific cultural property and transmits it to the server 100 , the server 100 transmits the received target image to the database 300 , and the database 300 transmits the received target image It is a configuration that compares the image with a plurality of sample images, searches for a sample image having a matching rate greater than or equal to a set threshold, and determines the latent damage grade by the searched sample image.

In the prior art, a target image for a specific location of the cultural property to be inspected is photographed with the drone 500, and the server 100 receives the target image and transmits it to the database 300, so the sample closest to the target image in the database 300 It has the advantage of retrieving images and determining the corresponding damage class,

However, the prior art still has not solved the problem that the sample image may not match the target image, and it is practically difficult to secure sample images for all cultural assets in the country, and the storage capacity for recording the sample images must be very large.

In addition, if the target image and the sample image have a matching rate higher than the threshold, the damage grade of the sample image is judged as the damage grade of the photographed target image, so the error is calculated very large. The problem still remains.

Therefore, there is a need to develop a technology to quickly and accurately check the damaged state of cultural properties by comparing and analyzing the captured image signals of cultural properties with the searched big data images of the cultural properties.

Republic of Korea Patent Application No. 10-2019-0178944 (2019. 12. 31.) ‘Method of providing cultural properties inspection service using drones Light Server’

The present invention, devised to solve the problems and necessity of the prior art, collects past image information of cultural assets from big data and compares and analyzes current image information with digital image processing techniques to check the damage state of cultural assets Its purpose is to provide a system for inspecting cultural properties damage by image big data and its operation method.

The system for inspecting cultural heritage damage by image big data of the present invention, devised to achieve the above needs and objectives, navigates to the corresponding location by inputting GPS coordinate information of the cultural heritage 1000, and uses visible light, microwave signal, and infrared signal for cultural heritage (1000) a drone photographing unit 2000 that records the source signals of the acquired images simultaneously photographed in frame units, encrypts the acquired image packet frame signals, and transmits them simultaneously through each channel of a plurality of communication methods provided; The drone photographing unit 2000 wirelessly connects to each channel by multiple communication methods of the Wi-Fi wireless communication method, the FM wireless communication method, and the Bluetooth wireless/new method at the same time and receives the encrypted acquired image packet frame signal, respectively, a wireless relay booster unit 3000 that transmits all at the same time; It connects to the wireless relay booster unit 3000 and receives an acquired image packet frame signal through each channel of multiple communication methods, selects and decodes any one acquired image packet frame signal without a transmission error, and performs visible light, microwave and infrared rays. A cultural heritage image processing server (5000) that separates the source signals of each acquired image taken with each, and analyzes each image processing, and estimates the damage state of the cultural heritage in comparison with the big data image of the cultural heritage collected from the big data image server (4000) ; Connects to the drone photographing unit 2000, transmits GPS coordinate information of the cultural property 1000, checks the image taken with visible light, transmits a corresponding command signal close to a specific part, and transmits the cultural property image processing server 5000 to the an operator terminal unit 6000 for accessing and confirming the estimated damage state information of the cultural property 1000; may include

The drone photographing unit 2000 includes: an operation unit 2100 that operates to a location designated by a corresponding control signal; A drone flight control unit 2200 that connects to the operation unit 2100, receives and analyzes GPS coordinate information and beacon location information, outputs a control signal to fly at a designated location, and outputs a corresponding control signal to each configured function unit; a visible ray photographing unit 2300 for photographing an image signal of a tile located in a specific portion of the cultural property 1000 with visible light according to a corresponding control signal of the drone flight control unit 2200; a microwave imaging unit 2400 for photographing an image signal of a tile located in a specific part of the cultural property 1000 as a microwave signal according to a corresponding control signal of the drone flight control unit 2200; an infrared photographing unit 2500 for photographing an image signal of a tile located in a specific portion of the cultural property 1000 as an infrared signal according to a corresponding control signal of the drone flight control unit 2200; Ambient climate sensor unit 2610 for detecting ambient climate signals including temperature, humidity, wind direction, wind speed, light quantity, and time by the surrounding climate according to the corresponding control signal of the drone direction control unit 2200, respectively; The source signal of the acquired image photographed by the visible ray photographing unit 2300 according to the corresponding control signal of the drone heading control unit 2200, the source signal of the acquired image photographed by the microwave photographing unit 2400, and the infrared photographing unit 2500 a packet encryption/decryption unit 2620 for encrypting or decrypting the acquired image source signal captured by ) and the ambient climate signal detected by the surrounding climate sensor unit 2610 into an acquired image packet frame signal of a predetermined standard; a Wi-Fi wireless unit 2700 that is activated and operated according to a corresponding control signal of the drone flight control unit 2200 and transmits an encrypted acquired image packet frame signal in a Wi-Fi wireless communication method; an FM radio unit 2800 that is activated and operated according to a corresponding control signal of the drone flight control unit 2200 and transmits an encrypted acquired image packet frame signal in an FM radio communication method; a Bluetooth wireless unit 2900 that is activated and operated according to a corresponding control signal of the drone flight control unit 2200 and transmits an encrypted acquired image packet frame signal in a Bluetooth wireless communication method; can include

The method of operating the cultural heritage damage inspection system by image big data of the present invention devised to achieve the above needs and objectives is cultural assets, a drone photographing unit, a wireless relay booster unit, a big data image server, a cultural heritage image processing server, and an operator terminal. In the method of operating a system for inspecting cultural heritage damage by image big data including a part, when it is determined that a command signal to check the damage state of cultural heritage is input by the operator terminal, it connects to the drone photographing part and a GPS in which the cultural heritage is located a flight preparation process of inputting coordinate information and inputting a command signal to navigate to the destination where the cultural property is located; When it is determined that the drone photographing unit has arrived at the destination according to the GPS coordinate information input during the operation intermediate process by the operator terminal unit, the image source of the acquired image of the cultural property is taken simultaneously with the visible light, the microwave signal and the infrared signal in the sky above the cultural property a cultural property photographing process of securing a signal and inputting a command signal for close-up photography when it is determined that there is a damaged part; When it is determined by the operator terminal that the photographing of the cultural property has been completed in the process of photographing the cultural property, a drone recovery process of inputting a return command signal to the drone photographing unit and proceeding to completion; may include.

The present invention with the above configuration has the advantage of collecting the past image information of cultural assets from big data and comparing and analyzing the currently photographed image information with digital image processing techniques to quickly and accurately check the damaged state of the cultural assets at a low cost. .

1 is a functional block diagram of a system for inspecting cultural properties damage by a drone according to an embodiment of the prior art;
Figure 2 is a state shooting view of inspecting the damage of cultural assets by crane mobilization and visual inspection according to an embodiment;
3 is a functional configuration diagram of a cultural property damage inspection system by image big data according to an embodiment of the present invention;
4 is a detailed functional configuration diagram of a drone photographing unit according to an embodiment of the present invention;
5 is a data field configuration diagram of an acquired image packet frame according to an embodiment of the present invention;
6 is an explanatory diagram of an application field for each type of electromagnetic wave according to an embodiment of the present invention;
7 is a flowchart of a method of operating a cultural property damage inspection system by image big data according to an embodiment of the present invention;
and
8 is a state photograph of extracting a damaged state by digital image processing of an image signal of a cultural property according to an embodiment in order to explain the present invention.

Since the present invention can apply various transformations and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing the present invention, if it is determined that a detailed description of a related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

In the following description, each power supply functional unit for supplying operating power is a natural configuration, and drawings and descriptions will be omitted to simplify the description and clearly explain the technical idea.

FIG. 2 is a view showing the state of visually inspecting the damage inspection of cultural assets with a crane mobilization according to an embodiment, and FIG. 3 is an embodiment of the present invention. Functional configuration of a cultural heritage damage inspection system by image big data 4 is a detailed functional configuration diagram of a drone photographing unit according to an embodiment of the present invention, FIG. 5 is a data field configuration diagram of an acquired image packet frame according to an embodiment of the present invention, FIG. 6 is According to an embodiment of the present invention, it is an explanation diagram of application fields for each type of electromagnetic wave.

Hereinafter, a system 900 for inspecting cultural properties damage by image big data according to an embodiment of the present invention will be described in detail with reference to all the accompanying drawings.

The cultural property damage inspection system 900 by image big data includes the cultural property 1000, the drone photographing unit 2000, the wireless relay booster unit 3000, the big data image server 4000, the cultural property image processing server 5000, and the operator It is a configuration including the terminal unit (6000).

The cultural property 1000 includes a wooden building and a stone building, and is a cultural property worth preserving. The cultural property 1000 will be described as including a GPS satellite 1100 that broadcasts a GPS signal and a beacon unit 1200 that provides location information having an error of unit centimeter in a short distance.

In the following description, the short distance is described as a straight-line distance in the range of 0 meters or more to 2 kilometers (Km).

The GPS satellite 1100 is a component that broadcasts a GPS signal analyzed with coordinate information including latitude, longitude, sea level, time, angular velocity, etc. in a relatively low orbit of the Earth, and there are 24 or more GPS satellites in the Earth's orbit. When the satellite 1100 moves along the orbit at regular intervals and receives and analyzes GPS signals from at least three GPS satellites 1100, necessary coordinate information can be extracted, and it is well known that the minimum error range is several tens of centimeters. and further detailed description will be omitted.

The beacon unit 1200 is configured to record and store precisely measured coordinate information of the installed location and information describing the location in detail, and broadcast so that anyone can receive it if only the corresponding frequency matches in a short distance. When a signal transmitted by the beacon unit 1200 is received, a receive signal strength indicator (RSSI) and a precise triangulation method have an error within a few centimeters based on the location where the beacon unit 1200 is installed. Extract location information. The beacon unit 1200 broadcasts the corresponding location information in a Bluetooth wireless communication method and is well known, so a detailed description thereof will be omitted.

The drone photographing unit 2000 connects to the operator terminal unit 6000 via a CDMA mobile communication channel and transmits and receives necessary data.

When the drone photographing unit 2000 receives the GPS coordinate information of the destination where the cultural property 1000 is located from the operator terminal unit 6000, it rises to a height of 150 meters above the ground and then the cultural property 1000 designated by the input GPS coordinate information It automatically navigates to the destination, and while the flight is in flight, the ground image on the route is photographed with visible light and transmitted to the operator terminal unit 6000 via the CDMA mobile communication channel.

After the drone photographing unit 2000 ascends vertically to a height of 150 meters above the ground on the route to the destination, the operation or flight to the destination avoids a collision if there are obstacles such as telephone poles, trees, and buildings on the route. In order to do this, it is very natural that the operator terminal unit 6000 can further take necessary safety measures, such as operating or bypassing operation after further vertical ascent while checking the ground image on the route.

The drone photographing unit 2000 descends to a height of 30 meters above the ground after reaching the destination where the cultural property 1000 is located, and simultaneously transmits visible light, microwave signal, and infrared signal, which are classified as electromagnetic wave signals, to the cultural property 1000 at the location. Record the source signal of the acquired image taken (obtained) by each electromagnetic signal in each frame unit, but record the surrounding climate information detected at the same time as the shooting in the frame unit together with the acquired image packet frame (5000) signal, and encrypt it It is a configuration that eliminates transmission errors because the same content is transmitted simultaneously to each channel by multiple communication methods. Because data without transmission error is used, it can be precisely analyzed.

At this time, according to the corresponding command signal of the operator terminal unit 6000, the drone photographing unit 2000 moves close to a specific part that needs to be checked in detail by 30 centimeters and returns the source signal of the acquired image of the specific part that has been moved close to each electromagnetic wave signal. Each can be photographed (secured) by

The drone photographing unit 2000 can approach the target up to 30 centimeters in a straight line distance, and includes a function and configuration to prevent further access, and is to prevent damage to the drone.

The drone photographing unit 2000 may further include a visible light illumination unit 2310 for photographing in a shaded area or at night and an infrared illumination unit 2510 for infrared photographing, but each of these lighting units is photographed with visible light. In order to secure a signal, it is very desirable to have a configuration that blinks every 0.5 second in order to secure a clear and accurate image signal.

The drone photographing unit 2000 includes the operation unit 2100, the drone steering control unit 2200, the visible light photographing unit 2300, the microwave photographing unit 2400, the infrared photographing unit 2500, and the surrounding climate sensor unit 2610 and It has a configuration including a packet encryption/decryption unit 2620 , a proximity sensor unit 2630 , a Wi-Fi radio unit 2700 , an FM radio unit 2800 , and a Bluetooth radio unit 2900 . In addition, although not shown in the drawing for simplicity of the drawing, it further includes a CDMA mobile communication radio unit 2850 and a GPS receiver 2870 .

The operation unit 2100 is configured to receive a corresponding control signal from the drone flight control unit 2200, operate (fly) to a designated location, and stably stay in the air.

The drone flight control unit 2200 connects to the operation unit 2100 and analyzes any one or more of the GPS coordinate information and the received beacon location information received remotely to accurately and precisely locate the flight (operation) at the designated destination. It outputs the corresponding control signal to do so, and outputs each corresponding control signal to each configured function unit, and monitors each operation state.

When a signal for detecting that there is an object including the cultural property 1000 or an obstacle 30 centimeters ahead of the proximity sensor unit 2630 is input, the drone steering control unit 2200 moves backward 1 meter or more from the current location and then the operator It can be controlled to wait for input of a command signal from the terminal unit 6000 .

The drone flight control unit 2200 is operated by the built-in operating program and operation data, and if necessary, remotely receives, stores, and sets and operates the updated or modified operation program and operation data through the provided radio unit. In addition, it will be explained that an application program that receives the GPS signal, checks the coordinate information of the current location, analyzes the difference from the input coordinate information of the destination, and outputs the corresponding control signal to arrive at the destination is naturally provided.

The drone flight control unit 2200 performs a primary arithmetic average operation on the GPS coordinate information input at the destination where the cultural property 1000 is located and the beacon position information wirelessly received from the beacon unit 1200 of the destination to obtain the position information to be hovered first. It calculates and operates and hovers to a designated location based on the calculated location information, and calculates the location information to be operated and stays for a second time by processing the second arithmetic average of the first calculated location information and the beacon location information again, and the calculated location information Flights and hovers to a location designated by and hold In other words, since the location information is repeatedly corrected and corrected by the third time, it is relatively very accurate, and it flies and hovers to the location designated by the precise location information, and precisely captures the selected part of the cultural property, and records the data and then uses it repeatedly. Also, it is possible to precisely and repeatedly photograph the same part of the cultural heritage 1000 at the same location. This method is a very useful technique when constant investigation is required.

The designated location where the drone photographing unit 2000 hovers includes longitude, latitude, sea level, etc., and the error range is within several centimeters, respectively, and it is explained that the GPS coordinate information of the designated location is input. In addition, it does not collide with the cultural property 1000 or an obstacle by the signal of the proximity sensor unit 2630 .

The visible ray photographing unit 2300 captures an image signal for a specific part of the cultural property 1000 in visible light according to a corresponding control signal of the drone flight control unit 2200 . The drone heading control unit 2200 may output a corresponding control signal so that the visible light illumination unit 2310 is operated as needed.

The microwave imaging unit 2400 captures or scans an image signal for a specific part of the cultural property 1000 as a microwave signal according to a corresponding control signal of the drone flight control unit 2200 . A commonly known radar scan method may be applied.

The infrared photographing unit 2500 captures an image signal for a specific part of the cultural property 1000 as an infrared signal according to a corresponding control signal of the drone flight control unit 2200 . The drone direction control unit 2200 may output a corresponding control signal to operate the infrared lighting unit 2510 as necessary.

That is, the visible ray imaging unit 2300 , the microwave imaging unit 2400 , and the infrared imaging unit 2500 may repeatedly photograph at any time or any time for regular inspection at the same location of the cultural property 1000 .

When it is determined that the drone operation control unit 2200 has arrived at the destination, it may output a corresponding message indicating that it has arrived at the destination. The destination arrival completion message is received by the operator terminal unit (6000).

Referring to FIG. 6 attached, it can be confirmed which electromagnetic wave is appropriate to use in which field. It is explained that electromagnetic waves include visible light, infrared rays, microwaves, and the like. Remote sensing using electromagnetic waves is a generic term for technology that acquires information about a target using electromagnetic energy, and active technology development is taking place due to its high value for astronomy, geography, civil engineering, and military use. Electromagnetic wave energy has various characteristics according to its wavelength, and it analyzes land use conditions, prepares geological maps, determines soil conditions, classifies crops, identifies forest growth conditions and pests, and classifies species for logging, water resource detection and It is used for a variety of purposes, such as checking the status. In particular, it supports the investigation and monitoring of eco-physical objects and artificial structures on Earth, enabling the detection of changes in dynamic and continuously changing objects.

In the case of color separation processing of image signals taken with electromagnetic signals, various information can be extracted, and it is a technology used for resource exploration, geological exploration, climate survey, coastline change, and volcanic activity monitoring in space. It is one of the technical ideas of the present invention to apply to detect , and this space technology will be described again in detail below.

This technology does not need to move close to the measurement target directly, and allows observation of a wider area at a time from a distance. In addition, as it is possible to repeatedly acquire continuous data with a certain period, it is being used for continuous observation and prediction of changes over time. Among them, image analysis refers to calculating the images obtained by various methods to extract necessary information or to reconstruct it into an image suitable for a specific purpose.

The ambient climate sensor unit 2610 detects ambient climate information signals including temperature, humidity, wind direction, wind speed, light quantity, and time by the surrounding climate according to the corresponding control signal of the drone flight direction control unit 2200, respectively. In the case of photographing using electromagnetic waves, since the obtained image signal is affected by the surrounding climate information, it is possible to compensate for the difference compared to the climatic conditions according to the predetermined standards later, and the climatic conditions according to the predetermined standards are repeated experiments. The clearest and most accurate shooting climatic conditions are selected by , which can be updated and modified as needed, recorded in the allocated memory area of the drone shooting unit 2000, and set and updated for the corresponding operation. . Compensation processing may include amplification, attenuation, removal of unnecessary signals, and the like.

The packet encryption/decryption unit 2620 includes an acquired image source signal photographed by the visible ray photographing unit 2300 and an acquired image source signal photographed by the microwave photographing unit 2400 according to a corresponding control signal of the drone heading control unit 2200, and infrared rays The acquired image source signal captured by the photographing unit 2500 and the ambient climate information signal detected by the ambient climate sensor unit 2610 are encrypted or decrypted into an acquired image packet frame 5000 signal of a predetermined standard.

The proximity sensor unit 2630 alternately outputs and receives an ultrasonic signal and an infrared signal with a period of 0.5 seconds, and calculates the output time, the received time, and the speed at which the ultrasonic signal and the infrared signal are propagated to the cultural property 1000 or the object. Measures the straight line distance with and this measurement technique is well known. In detail, the ultrasonic signal is output for 0.2 seconds, the reflected ultrasonic signal is received for the next 0.2 second, and the corresponding time is measured. For 0.2 seconds, the reflected infrared signal is received and the corresponding time is measured, and for 0.1 seconds, it is operated as a pause time. Since the ultrasonic signal and the infrared signal are used at the same time, there is an advantage of increasing the accuracy and precision of distance measurement.

The Wi-Fi wireless unit 2700 is activated by the corresponding control signal of the drone flight control unit 2200 and transmits the encrypted acquired image packet frame 5000 signal through the Wi-Fi wireless communication channel in the Wi-Fi wireless communication method. A communication path occupied by the Wi-Fi wireless unit 2700 for communication may be referred to as a Wi-Fi communication channel.

The FM radio unit 2800 is activated and operated by the corresponding control signal of the drone flight control unit 2200 and transmits the encrypted acquired image packet frame 5000 signal through the FM radio communication channel in the FM radio communication method. The communication path occupied by the FM radio unit 2800 for communication may be referred to as an FM communication channel.

The Bluetooth wireless unit 2900 transmits the acquired image packet frame 5000 signal that is activated and operated according to the corresponding control signal of the drone flight control unit 2200 and is encrypted using the Bluetooth wireless communication method through the Bluetooth wireless communication channel. A communication path occupied by the Bluetooth wireless unit 2900 for communication may be referred to as a Bluetooth communication channel.

The Wi-Fi wireless unit 2700, the FM wireless unit 2800, the Bluetooth wireless unit 2900 and the corresponding communication channel consist of a high-speed data transmission network that transmits digital signals at a transmission rate of 1 gigahertz per second or more, respectively, in order to improve the transmission speed. . Therefore, the corresponding data signal is transmitted quickly.

The acquired image packet frame 7000 consists of a total of 185 bytes and includes an overhead field, a visible light acquired image data field, a microwave acquired image data field, an infrared acquired image data field, a check data field, and an end field. to be.

When the volume of specific data to be recorded is relatively large and cannot be recorded in the assigned field area of one acquired image packet frame 7000, the drone flight control unit 2200 adds it in the following order and adds the acquired image packet frame 7000. data is assigned, the corresponding data is recorded, and an indication that data is concatenated is written to the overhead field area and/or the end field area by assigning a serial number to each corresponding frame, so that the receiving side can perform the necessary data recovery processing make it possible

A byte means a collection of 8 bits, which is the minimum unit for recording the presence or absence of one pulse signal in a digital signal, and if necessary, more than 8 bits are defined as one byte However, in the following description, it is defined that 10 bits constitute one byte for encryption to prevent unauthorized access by unauthorized third parties and theft of valuable information.

The OVHD (overhead) field consists of 10 bytes, and the starting position of the data composing the frame starts recording, the transmission destination, the transmission time, the generation coordinate information, and the total data by bits. When the size and amount of data are large, it can consist of multiple frames, so frame serial number information indicating the connected state is included and recorded.

The visible ray acquired image data field consists of 50 bytes with an interval of 1 byte from the overhead field, and the acquired image source signal captured by the visible ray imaging unit 2300 and the ambient climate signal detected by the surrounding climate sensor unit 2610 is recorded

The microwave acquired image data field consists of 50 bytes with an interval of 1 byte from the visible light acquired image data field, and the acquired image source signal captured by the ultrasound imaging unit 2400 and the ambient climate detected by the ambient climate sensor unit 2610 The signal is recorded.

The infrared acquired image data field consists of 50 bytes with an interval of 1 byte from the microwave acquired image data field, and the acquired image source signal captured by the infrared imaging unit 2500 and the ambient climate signal detected by the ambient climate sensor unit 2610 is recorded

The check (CHK) data field consists of 10 bytes with an interval of 1 byte from the infrared acquired image data field, and the data recorded in the visible light acquired image data field, the microwave acquired image data field, and the infrared acquired image data field If it is determined that an error is included by analyzing each, the cyclic redundancy check (CRC) method and the Hamming code method are sequentially operated to detect duplicate errors and process duplicate repairs.

The END field consists of 10 bytes with an interval of 1 byte from the check data field. Error detection and recovery, retransmission request, data generator information, frame end position, and frame serial number information are included and recorded.

One byte spaced between each data field is not shown in the figure because the figure becomes complicated when shown in the figure.

The wireless relay booster unit 3000 connects wirelessly to the drone shooting unit 2000 at the same time in a short distance by wireless communication method, FM wireless communication method, and multiple communication methods of the Bluetooth wireless communication method, and the encrypted acquired image. The packet frame 7000 is configured to receive each signal and transmit all signals at the same time. In addition, it further includes a CDMA mobile communication radio function unit and a corresponding switching unit. The wireless relay booster unit 3000 connects to the operator terminal unit 6000 through a CDMA mobile communication channel and sets the communication path by switching.

The wireless relay booster unit 3000 is configured to receive all the signals of each radio channel transmitted by the drone photographing unit 2000, amplify them to a certain level required for transmission, and output them wirelessly by wire or CDMA mobile communication method. In the following description, a method of outputting by wire can be mainly described.

The big data image server 4000 includes a data server operated by various mass media, and records, stores, manages, and retrieves image signals of the cultural assets 1000 photographed in various ways at various times and at various angles with respect to the plurality of cultural assets 1000 . provided by

The cultural property image processing server 5000 connects to the big data image server 4000 at a predetermined cycle unit to search for an image signal for the cultural property 1000, and also searches for the time, method, location information, etc. Records are stored, and an image in which the form of the cultural property 1000 can be completely visually confirmed as the photographing period is the longest is designated and managed as a reference image of the cultural property 1000 . It is very certain that the reference image of the cultural property 1000 can be changed as needed, and that artificial intelligence (AI) can use machine learning technology.

The cultural heritage image processing server 5000 is connected to the wireless relay booster unit 3000 by wire and receives the acquired image packet frame 7000 signal through each channel of a plurality of communication methods to receive any one acquired image packet frame without a transmission error. Selects and decodes signals, separates source signals of acquired images taken with visible light, microwave and infrared, respectively, and estimates each damage state of cultural property 1000 by image processing analysis This is a configuration that detects or extracts the final pancreatic loss state. The damaged state can be expressed as a numerical value of % by percentage of the deformed or damaged state compared to the reference image that is collected and selected as big data, and a well-known method can be applied.

If the cultural heritage image processing server 5000 is analyzed and determined that there is no transmission error in the multiple acquired image packet frame 7000 signals via the multiple communication channels, the acquired image packet frame 7000 signal via the channel of the designated priority. select It is very natural that the channels of the designated priority are designated in the order of the Wi-Fi wireless communication channel, the FM wireless communication channel, and the Bluetooth wireless communication channel, and the order can be arbitrarily adjusted as needed.

The detailed function of the cultural property image processing server 5000 will be described again in the description of the operation method below.

The operator terminal unit 6000 is composed of a dedicated data terminal or a smart terminal for CDMA mobile communication.

The operator terminal unit 6000 connects to the drone photographing unit 2000 through a CDMA mobile communication channel, inputs GPS coordinate information that can know the location of the cultural property 1000, and, if necessary, operates the drone photographing unit 2000. The route can be directly controlled (adjusted), and all images captured by the drone photographing unit 2000 with visible light can be checked in real time.

The operator terminal unit 6000 searches for or receives the big data image of the cultural property 1000 collected by the cultural property image processing server 5000, the selected reference image, and the analyzed damage state information.

The operator terminal unit 6000 takes an image of the cultural property 1000 in the drone photographing unit 2000 and the cultural property image processing server 5000, collects big data images for the cultural property 1000, and sets standards for the cultural property 1000 A corresponding command signal required for image selection can be input.

There are about 8,100 cultural assets in Korea, and the number of management personnel is about 70 as of 2019, and it is analyzed that there is a limit to the safe inspection by caring for cultural assets due to the limited budget. In particular, the Gyeongju and Pohang earthquakes that hit the Korean Peninsula in 2019 caused 63 cultural property damage and approximately 3 billion national treasury was invested. In particular, in order to inspect the damaged (damaged) state of cultural properties, it is necessary to visually inspect them using a high-altitude crane due to their characteristics, so cost, safety, and time are limited.

As an example, according to the performance table of minor repairs for the cultural property care project in 2016-2017, the item that accounts for the largest portion of the repair of wooden cultural properties is the inspection of damage and cracks in the roof tiles, accounting for 3,297 cases, accounting for the largest portion. Meanwhile, a budget of about 27.6 billion won is secured for the 2020 cultural heritage care project, and a preventive management system is established through regular inspection and monitoring of cultural heritage through 23 care work groups across the country, with the goal of reducing the post-mortem maintenance and repair burden. It is known that there is

The reason that repairing tiles is important in wooden cultural properties is that when damage or cracks occur in the roof tiles, the absorption rate increases, water leakage occurs, and the wooden parts rot, resulting in severe damage. On the other hand, in order to inspect the roof tiles, a high-level crane is used or a direct visual inspection is carried out through a high ladder, so it is very difficult to perform regular inspections with limited manpower while increasing costs due to safety accidents and long-term inspections.

During the inspection of cultural properties, the inspection for damage to tiles is one of the most time-consuming items as it determines the state of damage through visual inspection and detailed inspections such as water absorption, bending strength, and freezing. In the case of a relatively large cultural property, the tiles are randomly extracted to determine the state of damage, and when a problem is found in the roof tiles, it is a maintenance method that replaces up to 30 to 50% of the surrounding tiles based on the point where the problem occurred. is operated with

The current method of inspecting the damaged state of cultural heritage is inefficient due to insufficient manpower, time and budget, and it is difficult to manage because there is no clear reference point for repair and maintenance because maintenance is dependent on visual inspection. In other words, in order to solve fundamental problems such as lack of manpower and limitations of visual inspection, we provide a technology to measure the degree of damage to various cultural assets using drones to overcome the limitations of cultural heritage management and enable accurate and prompt repair and maintenance. This is the technical idea that is being pursued.

Papers on the mechanisms of damage to wooden and stone cultural properties are divided into physical, chemical, and biological weathering and explained. In particular, studies on the physical weathering of sarcophagi are the weathering process in which freeze-thaw occurs (Powers, 1945; 1949, Everett, 1961), the damage model of rocks that occur in the process of submersion and drying (Kiessl, 1989), and the inside of rocks. Weathering process caused by salts present in , 2002; Carlos et al, 2002) are covered.

Hereinafter, roof tiles, stone objects, wooden objects, wooden cultural properties, and stone cultural properties have the same meaning and will be described selectively as appropriate to the context, but if possible, they will be described as cultural properties.

The study of chemical weathering was suggested by Jenny (1950), Wollast (1967), and Birkeland (1984) by tracing the path of movement of elements that occur when minerals constituting rocks react with water, and the weathering process of masonry was suggested. After that, many researchers explained the weathering process of rocks by tracing the movement paths of elements that occur in the process of weathering rocks. As such studies are actively conducted, various weathering indices have been proposed that can determine the degree of weathering of rocks by quantitative analysis of principal elements (Ruxton, 1968; Paker, 1970; Nesbitt and Young, 1982; Jayaverdena and Izawa, 1994).

The study of biological weathering was conducted in Chl. A study was conducted to evaluate the effect of living things on the roof tiles by calculating the subject of a weathering state based on a and chromaticity (Donner et al., 2002; Schumann et al., 2005), and calculating the environmental factors and the vitality of living things. (Piervittori et al., 2002; Gazzano et al., 2009). Research on damage diagnosis mainly focuses on damage map, ultrasound probe, and infrared thermal image analysis. Fitzner (2004) and Kandemir-Yucel (2006) conducted ultrasonic surveys and IR thermography on historic buildings with internal cavities and found that several factors in the surrounding environment influence the ultrasonic velocity. In addition, research on compressive strength estimation using ultrasonic velocity is in progress by Ranazarn Demirboga (2004) and Matusinovic (2004). A study was conducted to compare the properties of granite by using ultrasonic velocity and the properties of granite.

As such, it can be seen that most of the studies on stone preservation are conducted with professional knowledge in the background, and are focused on damage mechanisms and precise diagnosis. In addition, it was found that studies on conservation treatment and field application were also conducted targeting a single cultural property. Therefore, it was confirmed that a study for the efficient conservation, management and monitoring of a large number of stone structures was necessary.

In order to establish a systematic monitoring and preservation system for masonry in Korea, various studies are being carried out to identify damage factors through diagnosing the degree of weathering damage based on the characteristics of constituent materials. Conservation scientific research on stone structures has been conducted by many domestic and foreign researchers including Jiyoung Kim et al. (2009), Mancheol Seo et al. (2001), Myeongseong Lee et al. (2012), Sunmyung Lee et al. (2010), Yugeun Jeon et al. (2008), Younghoon Cho and Chanhee Lee (2011). has been reported and considerable progress has been made. As for the application of non-destructive diagnostic methods to stone structures, starting with Seokgatap and Dabotap of Bulguksa by Seo Man-cheol (2002), studies have been conducted mainly to identify the mechanical and physical characteristics of each member of stone structures up to now. Recently, Jeon Yu-geun et al. (2008) and Lee Chan-hee (2011) provide guidelines for masonry preservation and treatment in the future through the diagnosis of damage using ultrasonic exploration. In addition, for long-term preservation and management of masonry, research on the structural stability diagnosis of masonry masonry through infrared thermal image analysis and 3D image analysis is being actively conducted (Howoong Son and Seongmin Lee, 2003; Byeonggyu Jeon et al., 2008; Younghoon Cho and Chanhee Lee, 2009). In addition, non-destructive techniques that are being practiced in engineering and natural sciences are being applied to masonry.

As such, it was confirmed that studies on the monitoring of masonry in Korea showed a similar pattern to that of overseas research. While studies on stone damage mechanisms and precision diagnosis technology are being actively conducted at home and abroad, studies on long-term monitoring are lacking. As mentioned above, each study is quite effective when applied to a single cultural property, but there are many limitations when applied to multiple cultural properties due to the research period and lack of professional manpower. In addition, there are many difficulties in systematically converting the research results into a database because the research methods are slightly different. Weathering of masonry is a complex natural phenomenon that occurs when physical, chemical, and biological factors act alone or in combination. Therefore, quantitatively representing the state of stone structures is an important research theme in rock engineering as well as geology and architecture, and various methods are being developed and tried. However, most masonry strength evaluation techniques involve the destruction of samples, so it is often not appropriate as a monitoring method for the preservation of cultural properties. Therefore, the state of the stonework is mainly used to measure the strength of the stonework indirectly by using the ultrasonic speed, and an integrated damage evaluation technique that performs XRF analysis and visual inspection in parallel. This technology evaluates the degree of damage to masonry step by step from a physical, chemical, biological and structural point of view by synthesizing scientific analysis of measurement data and professional judgment on weathering conditions. The evaluation result is expressed as an integer of 5 steps for each element, and quantitative evaluation is possible through the calculation of the integrated damage rate, providing standards for the preservation, treatment and management of roof tiles.

However, while this method enables relatively accurate diagnosis of the state of stonework, it has limitations in terms of efficiency as it requires specialized technology, equipment, and long-term investigation time. In particular, stone structures are scattered all over the country, and in most cases, it is difficult to establish an appropriate environment because most of them are in the form of large buildings. Therefore, preventive preservation through blocking of weathering factors is often impossible, and in this case, even if the condition is improved through conservation treatment, additional damage will occur. Weathering that occurs on the surface of masonry commonly causes changes in the color and texture of the surface, so it seems that the degree of weathering of masonry can be inferred through the change in color. These changes can be quantitatively interpreted through color analysis through photography. In particular, in the field of cultural properties, photographic materials are easy to take and store, and as the most reliable record of the current state, they have vast amounts of data from the past. Therefore, it is possible to analyze changes and make predictions based on them, so more effective conservation management is expected. The color of a rock is determined by the composition and chemical composition of the minerals contained inside, and exhibits its own color by absorption of electromagnetic waves due to the electronic transition of major transition elements and lanthanum elements. However, typical weathering patterns such as irregularities and abrasion on the surface of rocks formed by the removal of surface particles and expansion of gaps, elution and aggregation of specific components, and growth of lichens and green plants change the color of rocks (Mitsushita, et al. , 1998). In particular, in the field of soil chemistry, the color is used as an important indicator when describing the characteristics of the soil, and the Munsell symbol is used for more objective and quantitative description.

In addition, Nakashima et al. (1989) measured the color of rocks and minerals using a colorimeter and proved that the color changes systematically according to the internal oxidation state and the progress of the chemical reaction. In addition, Nagano and Nakashima (1989) examined the color change according to the weathering of granite using a colorimeter and found that the color of the rock changes systematically to yellowish brown by the generation of iron hydroxide (FeO(OH)) according to the weathering. proved. This series of studies provided the mineralogical and chemical basis for the color change due to weathering through quantitative measurement of rock color.

With the development of space technology and image sensors, a new technology that has recently been attracting attention is remote sensing. Remote sensing refers to finding information about an object in an indirect way using electromagnetic waves such as light or heat from a distant object. In case of using visible light, it is possible to observe various changes in the earth, such as occurrence of red tides, movement of pollutants, changes in coastlines, monitoring of desertification and volcanic activity, using images taken from a long distance. In particular, since it uses photographic data, it is non-destructive, can be investigated from a distance, and it is easy to observe continuous changes.

The current continuous monitoring and management of cultural properties decides whether to preserve them based on the results of detailed diagnosis after weathering has progressed. Through constant monitoring of cultural properties including stone structures, prompt action can be taken in the event of an abnormality, so more effective and smooth conservation management is expected. Therefore, in the present invention, image analysis, which is a field of remote sensing, has been introduced as a monitoring technique for cultural assets, and its possibility can be confirmed by applying it to representative cultural assets.

7 is a flowchart of a method of operating a system for inspecting cultural property damage by image big data according to an embodiment of the present invention, and FIG. 8 is a digital image processing process for image signals of cultural assets in order to explain the present invention to extract a damaged state There is also a picture of the state.

Hereinafter, a method of operating a tile state detection system by a drone will be described in detail with reference to all the accompanying drawings.

In the method of operating a cultural heritage damage inspection system by image big data, which includes a cultural asset, a drone photographing unit, a wireless relay booster unit, a big data image server, a cultural asset image processing server, and an operator terminal unit, by the operation preparation process, the When it is determined that a command signal to check the damage state of the cultural property is input (S100), wirelessly connect to the CDMA mobile communication method to the drone photographing unit, input the GPS coordinate information where the cultural property is located, and transmit it to the drone photographing unit, A command signal for causing the drone photographing unit to operate to the destination where the cultural property is located is input (S110).

When it is determined by the operator terminal that the signal that the drone photographing unit has arrived at the installation location of the cultural property, which is the operation destination, is input by the cultural property photographing process, visible light, microwave signal, and infrared signal are taken respectively at a predetermined height above the cultural property. Inputs a command signal to make the cultural asset to be damaged (S130), and if it is analyzed that a specific part of the cultural property is damaged (S140), a command signal to photograph the damaged part of the cultural property by 30 centimeters is input (S150).

According to the drone recovery process, when it is determined that the drone photographing unit has completed the photographing of the cultural property (S160), the operator terminal inputs a return command signal to the drone photographing unit (S170) and proceeds to the end. At this time, if it is determined that the drone photographing unit has not completed the photographing of the cultural property (S160), the drone photographing unit automatically feeds back to the beginning of the cultural property photographing process (S130) and continues the photographing.

As shown in the accompanying FIG. 8, the source signal of the acquired image of the cultural property is subjected to color separation by digital image processing processing, the boundary image is extracted using digital image processing of the morphological operation, and Gaussian (Gaussian function) ) removes unnecessary signals, uses digital image processing of morphological operation to enhance the boundary image, and removes relatively long lines to clarify the graffiti image of the damaged area. has been extracted. Here, morphological operation digital image processing is a technology that manipulates the morphological aspect of a specific image, and it is a technology that extracts useful elements to extract and express the shape of areas such as boundaries, skeletons, and blocks. will be employed and used.

In the above, the present invention has been described in detail with respect to the described embodiments, but it is apparent to those skilled in the art that various changes and modifications are possible within the scope of the technical spirit of the present invention.

900: tile state detection system by drone
1000: Cultural property 1100: GPS satellite
1200: beacon unit 2000: drone photography unit
2100: operation unit 2200: drone flight control unit
2300: visible light imaging unit 2400: microwave imaging unit
2500: infrared imaging unit 2610: ambient climate sensor unit
2620: packet encryption/decryption unit 2700: Wi-Fi wireless unit
2800: FM wireless part 2900: Bluetooth wireless part
3000: wireless relay booster unit 4000: big data image server
5000: cultural property image processing server 6000: operator terminal unit
7000: acquired image packet frame

Claims (3)

By entering the GPS coordinate information of the cultural property 1000, it flies to the corresponding location and records the source signal of the acquired image obtained by simultaneously photographing the cultural property 1000 with visible light, microwave signal, and infrared signal, respectively, in frame units, respectively, as an acquired image packet frame signal A drone photographing unit 2000 that encrypts and transmits each channel of a plurality of communication methods at the same time;
The drone photographing unit 2000 wirelessly connects to each channel by multiple communication methods of the Wi-Fi wireless communication method, the FM wireless communication method, and the Bluetooth wireless/new method at the same time and receives the encrypted acquired image packet frame signal, respectively, a wireless relay booster unit 3000 that transmits all at the same time;
It connects to the wireless relay booster unit 3000 and receives an acquired image packet frame signal through each channel of multiple communication methods, selects and decodes any one acquired image packet frame signal without a transmission error, and performs visible light, microwave and infrared rays. A cultural heritage image processing server (5000) that separates the source signals of each acquired image taken with each and analyzes each image processing and estimates the damage state of the cultural heritage in comparison with the big data image of the cultural heritage collected from the big data image server (4000) ;
Connects to the drone photographing unit 2000, transmits GPS coordinate information of the cultural property 1000, checks the image taken with visible light, transmits a corresponding command signal close to a specific part, and transmits the cultural property image processing server 5000 to the an operator terminal unit 6000 for accessing and confirming the estimated damage state information of the cultural property 1000; A cultural property damage inspection system by image big data, including a.
The method of claim 1,
The drone photographing unit 2000 is
a navigation unit 2100 that navigates to a location designated by the corresponding control signal;
A drone flight control unit 2200 that accesses the navigation unit 2100, receives and analyzes GPS coordinate information and beacon location information, outputs a control signal to fly at a designated location, and outputs a corresponding control signal to each configured functional unit;
a visible ray photographing unit 2300 for photographing an image signal of a tile located in a specific portion of the cultural property 1000 with visible light according to a corresponding control signal of the drone flight control unit 2200;
a microwave photographing unit 2400 for photographing an image signal of a tile located in a specific part of the cultural property 1000 as a microwave signal according to a corresponding control signal of the drone flight control unit 2200;
an infrared photographing unit 2500 for photographing an image signal of a tile located in a specific part of the cultural property 1000 as an infrared signal according to a corresponding control signal of the drone flight control unit 2200;
Ambient climate sensor unit 2610 for respectively detecting ambient climate signals including temperature, humidity, wind direction, wind speed, light amount, and time according to the surrounding climate according to the corresponding control signal of the drone direction control unit 2200;
The source signal of the acquired image photographed by the visible ray photographing unit 2300, the source signal of the acquired image photographed by the microwave photographing unit 2400, and the infrared photographing unit 2500 according to the corresponding control signal of the drone heading control unit 2200 a packet encryption/decryption unit 2620 for encrypting or decrypting the acquired image source signal captured by ) and the ambient climate signal detected by the surrounding climate sensor unit 2610 into an acquired image packet frame signal of a predetermined standard;
a Wi-Fi wireless unit 2700 that is activated and operated according to a corresponding control signal of the drone flight control unit 2200 and transmits an encrypted acquired image packet frame signal in a Wi-Fi wireless communication method;
an FM radio unit 2800 that is activated and operated according to a corresponding control signal of the drone flight control unit 2200 and transmits an encrypted acquired image packet frame signal in an FM radio communication method;
a Bluetooth wireless unit 2900 that is activated and operated according to a corresponding control signal of the drone flight control unit 2200 and transmits an encrypted acquired image packet frame signal in a Bluetooth wireless communication method; A cultural property damage inspection system by image big data, including
delete

Images