KR102196744B1 - Method and server for providing cultural property inspection service using drone - Google Patents

Abstract

The present invention relates to a method for providing a cultural property inspection service using a drone to determine an optimal maintenance and repair method for a specific target point. According to the present invention, the method comprises the following steps: (a) (i) assisting at least one reconnaissance drone to capture a specific target point and (ii) determining a provisional damage grade for the specific target point of a specific cultural property or assisting the determination; (b) assisting a precision imaging drone to re-capture the specific target point, and determining or supporting a specific sample image in which a coincidence rate between two image is greater than or equal to a preset threshold; and (c) determining an optimal maintenance and repair method corresponding to history pattern information of specific damage progress degrees or assisting the determination.

Description

Method and server for providing cultural property inspection services using drones {METHOD AND SERVER FOR PROVIDING CULTURAL PROPERTY INSPECTION SERVICE USING DRONE}

The present invention relates to a method and a server for providing a cultural property inspection service using a drone.

The global drone market has grown mainly in the military market, but is gradually expanding to various fields such as agriculture, mining, security, logistics, energy, and broadcasting industries.

In particular, drones have recently been supporting aerial photography in a variety of environments, such as areas where humans cannot shoot, areas with a lot of clouds, wide areas, and inaccessible areas, so they are used to identify cultural assets that are difficult to access or require careful access. Has become.

However, it is only necessary to take pictures of cultural assets or shoot videos with only the basic photographing device mounted on the drone, so a method of accurately inspecting cultural assets and determining appropriate maintenance methods is required.

An object of the present invention is to solve all of the above-described problems.

In addition, another object of the present invention is to enable the determination of a tentative damage level of an image captured for a specific target point.

In addition, the present invention makes it possible to determine a combination of a set of precision photographing devices mounted on a precision photographing drone and the number of precision photographing drones to re-photograph a specific target point according to the provisional damage grade of an image photographed for a specific target point. It has another purpose.

In addition, it is another object of the present invention to be able to determine an optimal maintenance method for a specific target point by using the retaken precision cultural property image.

A characteristic configuration of the present invention for achieving the object of the present invention as described above and realizing the characteristic effects of the present invention described later is as follows.

According to an aspect of the present invention, in a method of providing a cultural property inspection service using a drone, each of a plurality of sample images is stored in a database while corresponding to one of a plurality of damage grades divided according to the damage value of the cultural property. In the state, (a) the server determines that (i) at least one reconnaissance drone uses a set of basic photographing devices mounted on the reconnaissance drone as a specific partial area of a specific cultural property, where it is determined that there is a possibility of a predetermined damage. In support to shoot a specific target point, (ii) with reference to at least a portion of the plurality of sample images and the image taken for the specific target point, a provisional damage rating for the specific target point of the specific cultural property Determining or assisting in making a decision; (b) When the server determines that the determined provisional damage class corresponds to a specific provisional damage class, the first to k-th precision drones, which are k units of precision shooting drones determined according to action information corresponding to the specific provisional damage class, are determined. Shooting drones-The first to the kth precision photographing drones are each equipped with a first to kth precision photographing device set-to support at least the specific target point to be re-photographed, and the re-photographed precision cultural property image Comparing with at least some of the plurality of sample images, determining or assisting to determine a specific sample image having a match rate between them equal to or greater than a preset threshold; And (c) the server determines or determines an optimal maintenance method corresponding to the specific damage progression history pattern information at the specific target point with reference to the specific damage progression history pattern information corresponding to the specific sample image. Disclosed is a method for providing a cultural property inspection service comprising: supporting to do so.

As an example, in step (c), when the specific damage progression history pattern information corresponds to information on a plurality of specific maintenance methods, the server corresponds to each of the information on the plurality of specific maintenance methods. Check the history information of each damage suppression degree, and determine or determine a specific maintenance method corresponding to the specific damage suppression degree history information with the highest degree of damage suppression among the history information of each damage suppression degree as the optimal maintenance method. Disclosed is a method of providing a cultural property inspection service, characterized in that supporting to do so.

As an example, in the step (b), when it is determined that there is an existing image that has taken the specific cultural property, the server compares the precise cultural property image with the existing image, and (i) the specific target point is In the case of the same as the existing target point existing in the existing image, information related to the increase in damage of the specific target point is calculated, and (ii) the specific target point is not the same as the existing target point existing in the existing image, Calculate new damage related information for the specific target point, and in step (c), the server additionally refers to at least one of (i) the damage increase related information and (ii) the new damage related information Disclosed is a method of providing a cultural property inspection service, characterized in that supporting the determination or determination of the optimal maintenance method.

As an example, in step (b), the server stores information related to the optimal precision photographing device set corresponding to each predetermined environment based on at least some of the shape, size, color, and material of each of the plurality of cultural properties. Supports to determine or determine the k precision drones as the number of precision drones corresponding to the specific cultural property with reference to the database, and the configuration of a precision imaging device set mounted on each of the k precision drones As a cultural property inspection service, characterized in that it supports to determine or determine the first to k-th precision photographing device sets, and to determine or determine parameters of each of the mounted first to k-th precision photographing device sets. Disclosed is a method of providing.

As an example, the server includes information on a combination of at least one photographing device of a digital camera, an ultra-precision camera, a 3D scanner, a control system (live streaming), and a thermal imaging camera included in the information related to the precision photographing device set, and a combination thereof. Supports to determine or determine the first to k-th precision photographing device sets mounted on each of the k-th precision photographing drones with reference to at least a part of parameter information of each of the included photographing devices, and the first to mounted Disclosed is a method of providing a cultural property inspection service, characterized in that supporting or determining a parameter of each of the k-th precision photographing apparatus set.

As an example, the server checks the damage type information of the specific target point, additionally refers to the damage type information to determine or determine the k precision drones as the number of the precision shooting drones, and the Supports to determine or determine the first to k-th precision photographing device sets mounted on each of k precision photographing drones, and support to determine or determine parameters of each of the first to k th precision photographing device sets to be mounted Disclosed is a method of providing a cultural property inspection service, characterized in that the

As an example, in step (b), when the server supports the k-units of the precision-photographing drones to re-take the specific target point at different locations on a predetermined space to obtain a plurality of precision cultural property images , Reconstructing a three-dimensional precision cultural property image using the plurality of precision cultural property images, and in step (c), the server determines or determines the optimal maintenance method by additionally referring to the three-dimensional precision cultural property image Disclosed is a method of providing a cultural property inspection service, characterized in that supporting to do so.

As an example, the reconnaissance drone discloses a method of providing a cultural property inspection service, characterized in that it includes at least one blowing device for removing foreign substances included in the specific target point by releasing air.

As an example, the server, based on at least a portion of the shape, size, color, and material of each of a plurality of cultural properties, the air blowing by referring to the database in which optimal ventilation related information corresponding thereto for each predetermined environment is stored. When it is determined that the device is operated or not, and when the blowing device is determined to be operated, the server refers to at least one of the blowing intensity, the blowing duration, and the blowing direction included in the blowing-related information. Disclosed is a method of providing a cultural property inspection service, characterized in that the blowing device is operated or supported to be operated in response thereto.

As an example, prior to the step (a), (a0) the server, including the step of setting or supporting the basic parameters of the basic photographing device set to be set, wherein the existing image of the specific cultural property is present. When it is confirmed, the server refers to the database in which information related to a set of existing photographing devices corresponding to a predetermined environment is stored based on at least a part of the shape, size, color, and material of each of the plurality of cultural properties. Disclosed is a method of providing a cultural property inspection service, characterized in that supporting setting or setting the basic parameter.

According to another aspect of the present invention, in a server providing a cultural property inspection service using a drone, each of a plurality of sample images is stored in a database while corresponding to one of a plurality of damage classes divided according to the damage value of the cultural property. In a state, at least one memory for storing instructions; And at least one processor configured to execute the instructions; including, the processor comprising: (1) at least one reconnaissance drone using a basic photographing device set mounted on the reconnaissance drone to a specific partial area of a specific cultural property It supports to shoot a specific target point, which is an area that is determined to have a certain possibility of damage, and refers to at least a part of the plurality of sample images and an image photographed for the specific target point. A process for determining or supporting the determination of a tentative damage class for a specific target point, (2) When it is determined that the determined tentative damage class corresponds to a specific tentative damage class, according to the action information corresponding to the specific tentative damage class First to kth precision photographing drones, which are the k-th precision photographing drones determined-the first to kth precision photographing drones are each equipped with the first to the kth precision photographing device sets-to allow at least the specific target point to be re-established. A process for supporting photographing and comparing the re-taken precision cultural property images with at least some of the plurality of sample images to determine or assisting in determining or determining a specific sample image in which a match rate between the two is equal to or greater than a preset threshold, and (3) the specific sample A process for determining or supporting the determination of an optimal maintenance method corresponding to the specific damage progression history pattern information at the specific target point with reference to the specific damage progression history pattern information corresponding to the image, characterized in that A server providing a cultural property inspection service is disclosed.

As an example, in the process (3), when the specific damage progression history pattern information corresponds to information on a plurality of specific maintenance methods, the processor corresponds to each of the information on the plurality of specific maintenance methods. Check the history information of each damage suppression degree, and determine or determine a specific maintenance method corresponding to the specific damage suppression degree history information with the highest degree of damage suppression among the history information of each damage suppression degree as the optimal maintenance method. A server providing a cultural property inspection service is disclosed, which is characterized in that it supports to be performed.

As an example, the processor, in the (2) process, if it is determined that there is an existing image in which the specific cultural property was photographed, compares the precision cultural property image with the existing image, and (i) the specific target point is In the case of the same as the existing target point existing in the existing image, information related to the increase in damage of the specific target point is calculated, and (ii) the specific target point is not the same as the existing target point existing in the existing image, Calculates information related to new damage occurrence for the specific target point, and the processor, in the process (3), additionally refers to at least one of the damage increase related information and the new damage occurrence related information as the optimal maintenance Disclosed is a server for providing a cultural property inspection service, characterized in that the method is determined or assisted to determine.

As an example, in the process (2), the processor stores information related to the optimal precision photographing device set corresponding to each predetermined environment based on at least some of the shape, size, color, and material of each of the plurality of cultural properties. Supports to determine or determine the k precision drones as the number of precision drones corresponding to the specific cultural property with reference to the database, and the configuration of a precision imaging device set mounted on each of the k precision drones As a cultural property inspection service, characterized in that it supports to determine or determine the first to k-th precision photographing device sets, and to determine or determine parameters of each of the mounted first to k-th precision photographing device sets. A server providing a is disclosed.

As an example, the processor includes information on a combination of at least one photographing device of a digital camera, an ultra-precision camera, a 3D scanner, a control system (live streaming), and a thermal imaging camera included in the information related to the precision photographing device set, and a combination thereof. Supports to determine or determine the first to k-th precision photographing device sets mounted on each of the k-th precision photographing drones with reference to at least a part of parameter information of each of the included photographing devices, and the first to mounted Disclosed is a server for providing a cultural property inspection service, characterized in that supporting determining or determining a parameter of each of the k-th precision photographing apparatus set.

As an example, the processor checks the damage type information of the specific target point and additionally refers to the damage type information to determine or determine the k precision drones as the number of the precision drones, and the Supports to determine or determine the first to k-th precision photographing device sets mounted on each of k precision photographing drones, and support to determine or determine parameters of each of the first to k th precision photographing device sets to be mounted A server for providing a cultural property inspection service is disclosed.

As an example, in the case of obtaining a plurality of precision cultural property images by supporting the k-units of the precision shooting drones to retake the specific target point at different locations on a predetermined space in the process (2), the processor , Reconstructing a three-dimensional precision cultural property image using the plurality of precision cultural property images, and the processor, in the (3) process, determine or determine the optimal maintenance method by additionally referring to the three-dimensional precision cultural property image A server providing a cultural property inspection service is disclosed, which is characterized in that supporting to be performed.

As an example, the server for providing a cultural property inspection service is initiated according to claim 11, wherein the reconnaissance drone includes at least one blowing device that removes foreign substances included in the specific target point by releasing air. do.

As an example, the processor, based on at least a part of the shape, size, color, and material of each of a plurality of cultural properties, the air blowing by referring to the database in which optimal ventilation related information corresponding thereto for each predetermined environment is stored. Supports determining or determining whether to operate the device, and when it is determined that the blowing device is running, the processor refers to at least one of a blowing intensity, a blowing duration, and a blowing direction included in the blowing-related information. In response to this, a server providing a cultural property inspection service is disclosed, characterized in that the blowing device is operated or supported to be operated.

As an example, the processor includes, prior to the (1) process, (1-0) a process for setting or supporting a basic parameter of the basic photographing device set, wherein the process includes: When it is confirmed that an existing image exists, refer to the database in which information related to the existing photographing device set corresponding to the predetermined environment is stored based on at least a part of the shape, size, color, and material of each of the plurality of cultural properties. A server for providing a cultural property inspection service, characterized in that supporting the setting or setting of the basic parameter, is disclosed.

According to the present invention, the following effects are obtained.

The present invention has the effect of enabling the determination of a tentative damage level of an image captured for a specific target point.

In addition, the present invention, in addition, the present invention is a combination of the number of precision shooting drones to re-capture a specific target point and a set of precision shooting devices mounted on the precision shooting drone according to the tentative damage level of the image taken for a specific target point It has the effect of helping you decide.

In addition, the present invention has the effect of allowing the optimal maintenance method for a specific target point to be determined by using the retaken precision cultural property image.

1 is a diagram illustrating a schematic configuration of a server providing a cultural property inspection service using a drone according to an embodiment of the present invention.
2 is a diagram for explaining a schematic sequence of a method of providing a cultural property inspection service using a drone according to an embodiment of the present invention.
3A and 3B are diagrams illustrating an example for describing information stored in a database for each field according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION The detailed description of the present invention to be described later refers to the accompanying drawings, which illustrate specific embodiments in which the present invention may be practiced. These embodiments are described in detail sufficient to enable a person skilled in the art to practice the present invention. It is to be understood that the various embodiments of the present invention are different from each other, but need not be mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the present invention in relation to one embodiment. In addition, it is to be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description to be described below is not intended to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all scopes equivalent to those claimed by the claims. Like reference numerals in the drawings refer to the same or similar functions over several aspects.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to enable those of ordinary skill in the art to easily implement the present invention.

1 is a diagram showing a schematic configuration of a server 100 that provides a cultural property inspection service using a drone according to an embodiment of the present invention.

As shown in FIG. 1, the server 100 of the present invention may include a memory 110 and a processor 120.

The memory 110 of the server 100 may store instructions of the processor 120. Specifically, the instructions are codes generated for the purpose of causing the server 100 to function in a specific manner, and a computer or other program It may be stored in a computer usable or computer readable memory that may be directed towards possible data processing equipment. Instructions may perform processes for performing the functions described in the specification of the present invention.

In addition, the processor 120 of the server 100 may include a hardware configuration such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, it may further include an operating system and a software configuration of an application that performs a specific purpose.

In addition, the server 100 may be linked with the database 300 including information used to provide a cultural property inspection service using a drone. Here, the database 300 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory), At least one of RAM (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (ReadOnly Memory, ROM), EEPROM (Electrically Erasable Programmable ReadOnly Memory), PROM (Programmable ReadOnly Memory), magnetic memory, magnetic disk, optical disk It may include one type of storage medium, but is not limited thereto and may include any medium capable of storing data. In addition, the database 300 may be installed separately from the server 100, or otherwise installed inside the server 100 to transmit data or record received data, and, unlike the illustration, it is separated into two or more. It may be implemented, which may vary depending on the conditions of the invention.

Further, the server 100 may include a communication unit (not shown) for transmitting and receiving with the drone 500. Here, the drone 500 may include a reconnaissance drone and a precision shooting drone to be described later, but the present invention is not limited thereto.

In addition, the server 100 may transmit/receive with a photographing device (not shown) mounted on the drone 500 using a communication unit (not shown).

A method of providing a cultural property inspection service using a drone using the server 100 according to an embodiment of the present invention configured as described above will be described with reference to FIG. 2.

2 is a diagram for explaining a schematic sequence of a method of providing a cultural property inspection service using a drone according to an embodiment of the present invention.

First, the server 100 causes at least one reconnaissance drone to use a set of basic photographing devices mounted on the reconnaissance drone, as a specific partial area of a specific cultural property, which is a specific target point, which is an area where it is determined that a certain damage may exist. And, with reference to at least some of a plurality of sample images and an image photographed for the specific target point, it may be supported to determine or determine a provisional damage level for the specific target point of the specific cultural property ( S210).

At this time, at least one sample image corresponding to each of the plurality of cultural properties is stored in the database 300, and each of the plurality of sample images corresponds to one of a plurality of damage grades divided according to the damage value of the cultural property. ) May be stored.

Here, referring to FIG. 3A, the database 300 corresponds to a cultural property field 310 in which each of a plurality of cultural properties is stored, a sample image field 315 in which each of a plurality of sample images is stored, and each of a plurality of sample images. It may include a damage rating filter 320 in which information on each damaged information is stored.

That is, the server 100 compares the image captured for the specific target point with at least some of the plurality of sample images, selects a sample image in which a target point most similar to the specific target point is captured, and the selected sample image It may be possible to assist in determining or determining the damage class corresponding to the provisional damage class for the specific target point. Here, the sample image compared with the image captured for the specific target point may be a sample image corresponding to a cultural property that is the same or similar in type to the specific cultural property, but is not limited thereto.

For example, assuming that a specific cultural property is Sungnyemun, and the image for a specific target point that has been photographed is an image for a part of the roof, the server 100 stores an image of a part of the roof of the Sungnyemun that has been photographed in a database ( It may be compared with a sample image corresponding to Gwanghwamun, a cultural property that is the same or similar to Sungnyemun, among the cultural properties stored in the cultural property field 310 of 300). In this case, it may be compared with all sample images corresponding to Gwanghwamun, or only sample images for the roof of the sample images corresponding to Gwanghwamun.

Further, the basic photographing apparatus set may include a digital camera, but is not limited thereto, and at least one photographing apparatus capable of performing at least one of photographing and video photographing may be included.

And, the server 100, when it is determined that the determined provisional damage class corresponds to a specific provisional damage class, the first to k-th precision shooting drones of k units determined according to action information corresponding to the specific provisional damage class. Supports a precision-photographing drone to re-take at least the specific target point, and compares the re-taken precision cultural property image with at least some of the plurality of sample images, and determines a specific sample image in which a match rate between the two is equal to or greater than a preset threshold, or It can be supported to determine (S220).

In this case, each of the first to kth precision photographing drones may be equipped with first to kth precision photographing device sets. In addition, the precision photographing device set may include at least one of a digital camera, an ultra-precision camera, a 3D scanner, a control system (live streaming), and a thermal imaging camera, but is not limited thereto, and at least one of a precise photographing and a precise video recording. At least one precision photographing device capable of performing may be included.

Here, k is not a predetermined number, but may be a number that can be changed to one of 1 to n according to the action information.

That is, the number of precision photographing drones and the set of precision photographing devices mounted on the precision photographing drone may be determined differently according to the determined specific provisional damage grade for a specific target point.

At this time, the server 100 is the database 300 in which information related to the optimal precision photographing device set corresponding to the predetermined environment is stored based on at least a part of the shape, size, color, and material of each of the plurality of cultural properties. ) To determine or determine the k precision-photographing drones as the number of precision-photographing drones corresponding to the specific cultural property, and as a configuration of a precision-photographing device set mounted on each of the k precision-photographing drones. It may support to determine or determine a set of 1 to k-th precision photographing apparatuses, and may support determining or determining a parameter of each of the first to k-th precision photographing apparatus sets to be mounted.

Here, for each of the plurality of cultural properties, information on at least some of the shapes, sizes, colors, and materials corresponding thereto is stored in the database 300, and at least one of the shapes, sizes, colors, and materials of each of the plurality of stored cultural properties Information related to an optimal precision photographing apparatus set corresponding thereto for each predetermined environment may be stored in the database 300 based on a part.

For example, referring to FIG. 3B, the database 300 stores information on at least some of the cultural properties field 310 in which each of a plurality of cultural properties is stored, and the shape, size, color, and material of each of the plurality of cultural properties. An environmental field 345 in which information on a predetermined environment corresponding to at least a part of the shape, size, color, and material of each of the plurality of cultural properties is stored, and an optimal photographing for each predetermined environment is taken. At least one of information on the number of drones for precision shooting, information on the type of mounted precision shooting device, information on a combination of mounted precision shooting devices, and information on each parameter of the mounted precision shooting device is stored. A precision photographing device set field 350 may be included.

In addition, the server 100 includes information on a combination of at least one photographing device of a digital camera, an ultra-precision camera, a 3D scanner, a control system (live streaming), and a thermal imaging camera included in the information related to the precision photographing device set, and a combination thereof. With reference to at least a part of parameter information of each of the photographing apparatuses included in, support to determine or determine the first to k-th precision photographing device sets mounted on each of the k-th precision photographing drones, and the first mounted To determine or support a parameter of each of the k-th precision photographing apparatus set.

Here, the photographing apparatus mounted on each of the k precision photographing drones may be different for each of the detailed photographing drones, may be partially different, or all may be the same.

For example, assuming that four precision reconnaissance drones are determined to retake according to action information corresponding to a specific provisional damage class of a specific target point, the first precision shooting drone among the four precision reconnaissance drones is equipped with a high-precision camera and , The second precision shooting drone will be equipped with a 3D scanner, the third precision shooting drone will be equipped with a control system (Live streaming), and the fourth precision shooting drone will be equipped with a thermal imaging camera. In addition, the first precision shooting drone and the second precision shooting drone may be equipped with a digital camera and an ultra-precision camera, and the third precision shooting drone and the fourth precision shooting drone may be equipped with a digital camera and a thermal imaging camera.

In addition, the server 100 checks the damage type information of the specific target point and additionally refers to the damage type information to determine or determine the k number of precision shooting drones as the number of the precision shooting drones, Support to determine or determine the first to k-th precision photographing device sets mounted on each of the k-th precision photographing drones, and to determine or determine parameters of each of the first to k-th precision photographing device sets mounted You can apply.

Here, the server 100 compares at least one of the shape and size of a specific target point with at least some of the plurality of damage type information stored in the database 300 to identify the most similar damage type among the plurality of damage type information. It can be determined as the damage type of the target point.

In addition, the server 100 is to determine or determine a specific sample image having a matching rate equal to or greater than a preset threshold value by comparing the retaken precision cultural property images using k precision drones with at least some of the plurality of sample images. You can apply.

Here, there may be a plurality of re-photographed precision cultural property images. In addition, the plurality of precision cultural property images may be images taken by different precision photographing device sets, respectively, and only some of the plurality of precision cultural property images may be images photographed by different precision photographing device sets, respectively. All images of cultural properties may be images taken by the same set of precision photographing devices.

In addition, when there are a plurality of retaken precision cultural property images, the server 100 compares each of the plurality of precision cultural property images with at least some of the plurality of sample images, and obtains a plurality of specific sample images having a matching rate equal to or greater than a preset threshold. It may be determined, and the sample image having the highest matching rate among the plurality of specific sample images may be determined or supported to be determined as the specific sample image.

Here, the specific sample image may or may not be the same as the sample image used to determine the tentative damage level for the specific target point in step S210.

Next, the server 100 determines an optimal maintenance method corresponding to the specific damage progression history pattern information at the specific target point with reference to the specific damage progression history pattern information corresponding to the specific sample image, or It may be supported to determine (S230).

At this time, the server 100, when the specific damage progression history pattern information corresponds to information on a plurality of specific maintenance methods, each damage suppression degree corresponding to each of the information on the plurality of specific maintenance methods The history information may be checked, and a specific maintenance method corresponding to the specific damage suppression degree history information having the highest degree of damage suppression among the respective damage suppression history information may be determined or supported as the optimal maintenance method.

Here, at least one damage progression history pattern information may be associated with each of the plurality of sample images and stored in the database 300. In addition, information on at least one maintenance method is corresponding to each damage progression history pattern information and stored in the database 300, and damage suppression history information is corresponding to each maintenance method, and the database 300 May be stored in

For example, referring to FIG. 3A, the database 300 contains information about the shape, size, depth, etc. of the damaged part of each sample image, information about the speed of damage, and information about the damage progression form of the damaged part. The stored damage progression history pattern field 325, the maintenance method field 330 in which information on how the damaged part was maintained in response to each damage progression history pattern information is stored, respectively It may include a damage progress degree history pattern filter 335 in which at least one of information on the maintenance process of the damaged part, the maintenance result, and the degree of suppression of the damaged part is stored corresponding to the maintenance method of.

That is, the server 100 refers to specific damage progression history pattern information corresponding to a specific sample image and information on a specific maintenance method corresponding thereto in order to determine a method for maintaining a specific target point. When at least one of the damage progression history pattern information and information on a specific maintenance method corresponding thereto is a plurality, the damage suppression degree history information may be additionally referred to.

On the other hand, the server 100, in the step S220 of the method of providing a cultural property inspection service using a drone consisting of steps S210 to S230 as described above, when it is confirmed that an existing image that photographed the specific cultural property exists, Comparing the precise cultural property image with the existing image, when the specific target point is the same as the existing target point existing in the existing image, information related to the increase in damage of the specific target point is calculated, and the specific target point is the existing target point. If it is not the same as the existing target point existing in the image, calculates new damage occurrence related information for the specific target point, and in step S230, at least one of the damage increase related information and the new damage occurrence related information In addition, it is possible to assist in determining or determining the optimal maintenance method with reference.

That is, the server 100 compares the precise cultural property image with the existing image when there is an existing image in which the existing target point corresponding to a specific target point is captured among sample images corresponding to a specific cultural property in the database 300. Then, by calculating damage increase-related information including at least one of information on the degree of damage increase, information on the rate of damage progress, and information on the degree of change in damage type, additionally refer to this information to determine or determine the optimal maintenance method. Maybe.

In addition, the server 100 compares the precision cultural property image with the existing image when there is an existing image in which the existing target point corresponding to a specific target point is captured among sample images corresponding to a specific cultural property in the database 300. Therefore, by calculating the information related to the occurrence of new damage, including information on the existence of a new damaged part that did not exist in the existing image, and information on the shape, size, and depth of the new damaged part, the optimal maintenance method was calculated with such additional reference. You may decide or you may decide.

On the other hand, the server 100, in the step S220 of the method of providing a cultural property inspection service using a drone consisting of steps S210 to S230 as described above, the k-sized drones are positioned on different predetermined spaces. In the case where a plurality of precision cultural property images are acquired by supporting the re-photographing of the specific target point in, the 3D precision cultural property image is reconstructed using the plurality of precision cultural property images, and in step S230, the 3D precision cultural property image It may be supported to determine or determine the optimal maintenance method with additional reference.

Here, each of the k-units of precision photographing drones may be equipped with a different set of precision photographing devices, a set of different precision photographing devices may be mounted, or the same set of precision photographing devices may be mounted.

On the other hand, in the step S210 of the method of providing a cultural property inspection service using a drone consisting of steps S210 to S230 as described above, the reconnaissance drone is at least one for removing foreign substances included in the specific target point by releasing air. It may include a blowing device.

At this time, the server 100 refers to the database in which optimal ventilation-related information corresponding to each predetermined environment is stored based on at least a part of the shape, size, color, and material of each of the plurality of cultural properties. It may be able to assist in deciding whether or not to operate the blower system.

Here, referring to FIG. 3B, the database 300 includes a cultural property field 310 in which each of a plurality of cultural properties is stored, and a cultural property in which information on at least some of the shape, size, color, and material of each of the plurality of cultural properties is stored. Appearance field 340, environment field 345 in which information on a predetermined environment corresponding to at least a part of the shape, size, color, and material of each of a plurality of cultural properties is stored, optimal for removing foreign substances for each predetermined environment It may include a blowing device field 355 in which at least one of information on the blowing intensity of, information on the duration of blowing, and information on the blowing direction is stored.

That is, the server 100 may refer to the database 300 to determine whether the operation of the blowing device is necessary according to the corresponding environment of the specific cultural property.

In addition, when it is determined that the blowing device is to be operated, the server 100 refers to at least one of the blowing strength, the blowing duration, and the blowing direction included in the blowing-related information, and operates the blowing device to correspond thereto. Or support to get it running.

On the other hand, the server 100, before the step S210 of the method for providing a cultural property inspection service using a drone consisting of steps S210 to S230 as described above, supports setting or setting basic parameters of the basic photographing device set. It may include steps.

At this time, when it is confirmed that the existing image in which the specific cultural property has been photographed exists, the server 100 is based on at least a part of the shape, size, color, and material of each of the plurality of cultural properties. It is possible to support setting or setting the basic parameter with reference to the database in which information related to the photographing device set is stored, respectively.

Here, referring to FIG. 3B, the database 300 includes a cultural property field 310 in which each of a plurality of cultural properties is stored, and a cultural property in which information on at least some of the shape, size, color, and material of each of the plurality of cultural properties is stored. Appearance field 340, an environment field 345 in which information on a predetermined environment corresponding to at least a part of the shape, size, color, and material of each of the plurality of cultural properties is stored, and a reconnaissance drone suitable for shooting for each predetermined environment A basic photographing apparatus set field 360 in which at least one of information on a combination of mounted photographing apparatuses and information on parameters of each photographing apparatus is stored.

That is, if a specific cultural property has been previously photographed and is stored in the database 300, the basic photographing device set may be determined in the same or similar to a combination of photographing devices that photographed an existing image and parameters of each photographing device. .

Meanwhile, in Figs. 3A and 3B, the same database is stored, but is divided and expressed for explanation.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded in the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in the computer software field. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magnetooptical media such as floptical disks. , And a hardware device specially configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform processing according to the present invention, and vice versa.

In the above, the present invention has been described by specific matters such as specific elements and limited embodiments and drawings, but this is provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , Anyone with ordinary knowledge in the technical field to which the present invention pertains can make various modifications and variations from these descriptions.

Therefore, the spirit of the present invention is limited to the above-described embodiments and should not be defined, and all modifications that are equally or equivalent to the claims as well as the claims to be described later fall within the scope of the spirit of the present invention. I would say.

Claims (20)

In the method of providing a cultural property inspection service using a drone,
In a state in which each of the plurality of sample images is stored in the database while corresponding to one of the plurality of damage classes divided according to the damage value of the cultural property,
(a) The server will: (i) cause at least one reconnaissance drone to use a set of basic photographing devices mounted on the reconnaissance drone, as a specific partial area of a specific cultural property, a specific target, which is an area that is judged to have a certain possibility of damage. Supports shooting a point, and (ii) with reference to at least a portion of the plurality of sample images and an image captured for the specific target point, determine or determine a provisional damage level for the specific target point of the specific cultural property Supporting to do;
(b) When the server determines that the determined provisional damage class corresponds to a specific provisional damage class, the first to k-th precision drones, which are k units of precision shooting drones determined according to action information corresponding to the specific provisional damage class, are determined. Shooting drones-The first to the kth precision photographing drones are each equipped with a first to kth precision photographing device set-to support at least the specific target point to be re-photographed, and the re-photographed precision cultural property image Comparing with at least some of the plurality of sample images, determining or assisting to determine a specific sample image having a match rate between them equal to or greater than a preset threshold; And
(c) the server to determine or determine an optimal maintenance method corresponding to the specific damage progression history pattern information at the specific target point with reference to the specific damage progression history pattern information corresponding to the specific sample image Applying;
Including,
In step (c),
When the specific damage progression history pattern information corresponds to information on a plurality of specific maintenance methods, the server checks each damage suppression history information corresponding to each of the information on the plurality of specific maintenance methods. And, among the respective damage suppression history information, a specific maintenance method corresponding to the specific damage suppression degree history information having the highest degree of damage suppression is determined or supported as the optimal maintenance method,
In step (b),
The server, based on at least a portion of the shape, size, color, and material of each of a plurality of cultural properties, is specified by referring to the database in which information related to the optimal precision photographing device set corresponding thereto for each predetermined environment is stored. The first to the k-th precision photographing as a configuration of a precision photographing device set mounted on each of the k precision photographing drones and supporting to determine or determine the k precision photographing drones as the number of precision photographing drones corresponding to cultural properties. It is characterized in that it supports to determine or determine a device set, and supports to determine or determine a parameter of each of the mounted first to k-th precision imaging device sets,
The server includes information on a combination of at least one of a digital camera, a high-precision camera, a 3D scanner, a control system (live streaming), and a thermal imaging device included in the information related to the precision photographing device set, and photographing included in the combination. Supports determining or determining a set of the first to k-th precision photographing devices mounted on each of the k-th precision photographing drones with reference to at least a part of parameter information of each device, and the first to the k-th mounted A method of providing a cultural property inspection service, characterized in that supporting or determining parameters of each set of precision photographing devices. delete The method of claim 1,
In step (b),
When it is confirmed that there is an existing image from which the specific cultural property was photographed, the server compares the precise cultural property image with the existing image, and (i) the specific target point and the existing target point existing in the existing image In the same case, information related to the increase in damage of the specific target point is calculated, and (ii) if the specific target point is not the same as the existing target point existing in the existing image, new damage to the specific target point occurs. Produce information,
In step (c),
A cultural property inspection service, characterized in that the server supports to determine or determine the optimal maintenance method by additionally referring to at least one of (i) the damage increase related information and (ii) the new damage related information. How to provide. delete delete The method of claim 1,
The server checks the damage type information of the specific target point, additionally refers to the damage type information to determine or determine the k precision drones as the number of precision drones, and the k precision drones Supports to determine or determine the first to the k-th precision photographing device sets mounted on each of the photographing drones, and supports determining or determining parameters of each of the first to k-th precision photographing device sets to be mounted How to provide cultural property inspection services. The method of claim 1,
In step (b),
When the server obtains a plurality of precision cultural heritage images by supporting the k-sized drones to re-photograph the specific target point at a different predetermined space location, using the plurality of precision cultural heritage images Reconstruct the image of a 3D precise cultural property,
In step (c),
The method of providing a cultural property inspection service, characterized in that the server supports to determine or determine the optimal maintenance method by additionally referring to the three-dimensional precision cultural property image. The method of claim 1,
The reconnaissance drone is a method of providing a cultural property inspection service, characterized in that it includes at least one blowing device for removing foreign substances included in the specific target point by releasing air. The method of claim 8,
The server operates the blowing device with reference to the database in which optimal ventilation-related information corresponding to each predetermined environment is stored based on at least a part of the shape, size, color, and material of each of a plurality of cultural properties. To decide whether or not to support them,
When it is determined that the blowing device is to be operated, the server refers to at least one of the blowing intensity, the blowing duration, and the blowing direction included in the blowing-related information, and supports to operate or operate the blowing device to correspond thereto. A method of providing a cultural property inspection service, characterized in that. The method of claim 1,
Before step (a),
(a0) including the step of supporting, by the server, setting or setting basic parameters of the basic photographing device set,
When it is confirmed that there is an existing image in which the specific cultural property was photographed, the server relates to a set of existing photographing devices corresponding to the predetermined environment based on at least some of the shape, size, color, and material of each of the plurality of cultural properties. A method of providing a cultural property inspection service, comprising setting or supporting the basic parameter to be set with reference to the database in which each information is stored. In a server that provides a cultural property inspection service using a drone,
In a state in which each of the plurality of sample images is stored in the database while corresponding to one of the plurality of damage classes divided according to the damage value of the cultural property,
At least one memory for storing instructions; And
At least one processor configured to execute the instructions;
Including,
The processor is configured to: (1) allow at least one reconnaissance drone to select a specific target point, which is an area that is determined to have a certain possibility of damage as a specific partial area of a specific cultural property by using a set of basic photographing devices mounted on the reconnaissance drone. A process of supporting shooting, and determining or supporting the determination of a provisional damage level for the specific target point of the specific cultural property, with reference to at least a portion of the plurality of sample images and an image captured for the specific target point, (2) When it is determined that the determined provisional damage class corresponds to a specific provisional damage class, the first to kth precision shooting drones, which are k units of precision shooting drones determined according to action information corresponding to the specific temporary damage class,-the Each of the first to k-th precision photographing drones is equipped with a first to k-th precision photographing device set-supports at least the specific target point to be re-photographed, and the re-taken precision cultural property image is transferred to the plurality of sample images. Compared with at least some of the process, a process for determining or supporting a specific sample image with a match rate equal to or greater than a preset threshold value, and (3) the specific damage progression history pattern information corresponding to the specific sample image Perform a process of determining or supporting the determination of an optimal maintenance method corresponding to the specific damage progression history pattern information at the target point,
The processor,
In the above (3) process,
When the specific damage progression history pattern information corresponds to information on a plurality of specific maintenance methods, check each damage suppression level history information corresponding to each of the information on the plurality of specific maintenance methods, and each of the It is characterized in that it supports to determine or determine as the optimal maintenance method a specific maintenance method corresponding to the specific damage suppression degree history information having the highest degree of damage suppression among the history information of the degree of damage suppression of
The processor,
In the above (2) process,
Based on at least a portion of the shape, size, color, and material of each of the plurality of cultural properties, the database corresponding to the optimal precision photographing device set corresponding thereto is stored for each predetermined environment. Supports to determine or determine the k precision-photographing drones as the number of precision-photographing drones, and determines the first to k-th precision-photographing device sets as a configuration of a precision-photographing device set mounted on each of the k-th precision-photographing drones Or support to determine, and support to determine or determine parameters of each of the first to k-th precision photographing device sets mounted,
The processor,
Information on a combination of at least one of a digital camera, an ultra-precision camera, a 3D scanner, a control system (live streaming), and a thermal imaging camera included in the information related to the precision photographing device set, and parameters of each photographing device included in the combination The first to the k-th precision photographing device sets to be mounted and to determine or determine the first to k th precision photographing device sets mounted on each of the k precision photographing drones with reference to at least some of the information Server for providing a cultural property inspection service, characterized in that supporting to determine or determine each parameter. delete The method of claim 11,
The processor,
In the above (2) process,
When it is confirmed that there is an existing image in which the specific cultural property was photographed, the precise cultural property image is compared with the existing image, and (i) when the specific target point is the same as the existing target point existing in the existing image, the Calculate information related to damage increase of a specific target point, (ii) when the specific target point is not the same as the existing target point existing in the existing image, calculate new damage related information for the specific target point, and ,
The processor,
In the above (3) process,
The server providing a cultural property inspection service, characterized in that supporting to determine or determine the optimal maintenance method by additionally referring to at least one of the damage increase related information and the new damage related information. delete delete The method of claim 11,
The processor,
Check the damage type information of the specific target point, additionally refer to the damage type information to determine or determine the k precision drones as the number of precision drones, and support each of the k precision drones. Supports determining or determining a set of mounted first to k-th precision photographing device, and supporting determining or determining a parameter of each of the first to k-th precision photographing device sets to be mounted The server that provides the service. The method of claim 11,
The processor,
In the above (2) process,
When a plurality of precision cultural property images are acquired by supporting the k range of precision drones to re-photograph the specific target point at different predetermined space locations, a three-dimensional precision cultural property using the plurality of precision cultural property images Reconstruct the image,
The processor,
In the above (3) process,
Server for providing a cultural property inspection service, characterized in that for supporting to determine or determine the optimal maintenance method by additionally referring to the three-dimensional precision cultural property image. The method of claim 11,
The reconnaissance drone is a server providing a cultural property inspection service, characterized in that it comprises at least one blowing device for removing foreign substances included in the specific target point by releasing air. The method of claim 18,
The processor,
Determine whether or not to operate the blowing device with reference to the database in which optimal ventilation-related information corresponding to each predetermined environment is stored based on at least a portion of the shape, size, color, and material of each of a plurality of cultural properties, or Support decisions,
The processor,
When it is determined that the blowing device is to be operated, the blowing device is operated or supported to be operated to correspond thereto by referring to at least one of the blowing intensity, the blowing duration, and the blowing direction included in the blowing-related information. A server that provides a cultural property inspection service. The method of claim 11,
The processor,
Before the above (1) process,
(1-0) Including a process of setting or supporting the setting of basic parameters of the basic photographing device set,
The processor,
When it is confirmed that there is an existing image of the specific cultural property, information related to the existing shooting device set corresponding thereto is stored for each predetermined environment based on at least some of the shape, size, color, and material of each of the plurality of cultural properties. A server providing a cultural property inspection service, characterized in that supporting the setting or setting of the basic parameter with reference to the database.

Images