KR102007761B1 - Facility maintenance repair method recommendation system and method - Google Patents

Abstract

The present invention relates to a system for recommending a facility maintenance repair method comprising: a facility maintenance device for recommending a repair method by collecting damage information of facilities and analyzing a cause of damage of the facilities through machine learning; and a user terminal mounted with a photographing device for obtaining damage image information of facilities and receiving recommendation for the repair method from the facility maintenance device wherein the facility maintenance device may include a collection unit for collecting damage information of the facilities, a cause analysis unit for analyzing a cause of damage of the facilities based on an artificial neural network constructed through learning using the damage information of the facilities and the damage image information of the facilities as input, and using items about a damage cause analysis result of the facilities as output, and a recommendation unit for recommending a repair method corresponding to a cause of damage of the facilities.

Description

Facility maintenance repair method recommendation system and method {FACILITY MAINTENANCE REPAIR METHOD RECOMMENDATION SYSTEM AND METHOD}

The present application relates to a facility maintenance repair method recommendation system and a control method thereof.

In general, concrete structures are cracked by drying, shrinking and curing after curing, freezing, melting, and stretching of concrete due to external loads.The cracks formed in concrete diffuse into the concrete over time to corrode the steel. Since the strength of the concrete is lowered, it is repaired by injecting filler into the cracked portion.

Plastering refers to "construction or spraying indeterminate materials such as mortar, plaster, plaster, and soil using tools such as trowels on walls, columns, or floors of structures at construction sites." It usually takes 9 ~ 12% of the construction cost and is the second largest construction after the frame, which is the final finishing or foundation of the building.

"Waterproofing" refers to civil engineering and construction using artificial materials such as asphalt, sealing material, epoxy, cement mortar, synthetic resin, etc. to protect roofs, awnings, balconies, exterior walls, interiors, aquariums, swimming pools, and other parts of buildings from rain and moisture. "Waterproofing, moisture proof, water leakage prevention, etc. in structures and landfill facilities". Waterproofing is generally defined as 'blocking water', but the emphasis should be on how to effectively, completely and for a long time block natural and naturally occurring water from Mother Nature. Waterproof terms should also be subdivided according to the purpose, such as 'index' to temporarily block hydraulic pressure, 'waterproof' to protect the finished structure from water pressure, and 'water repellent' to facilitate the ventilation of the structure.

Tile construction means "Plastic tile products, such as ceramic tiles, cement tiles, vinyl tiles, and asphalt tiles, which are made mainly of clay and kaolin, require the aesthetic sense of the building (balcony, kitchen, E / V hall, interior). Construction on the outside walls, etc. ". The original meaning of the tile is 'covering', and it has been used as a noun for 'tiling' and 'cover', and the tile has been used in architecture in earnest due to the influence of Islam around 610 AD. It is said to be mainly used for the back. As a general feature of tile construction, it has excellent design effect, which can make the exterior of a building beautiful, and it is hygienic, so it is widely used as interior and exterior finishing material of buildings, and requires skilled workers to install it because it requires precision compared to other processes. to be.

The painting works have a great influence on the value, quality, and performance of the building according to the finish results by the surface finish of the parts and parts of the building. Appropriate coating should be selected with economic effects depending on factors such as environment, durability plan, and plasticity, and the part, material, and surface condition of the workpiece.

Based on the cause of the facility crack and the external environment, the necessary repair method should be selected and repaired.However, even if the worker performs the repair work due to the problem that the worker did not find the cause of the crack of the facility with his or her eyes, the crack could occur again. Possible problems arise.

Background art of the present application is disclosed in Korean Patent Publication No. 10-1798097.

The present application is to solve the above-mentioned problems of the prior art, to provide a facility maintenance repair method recommendation system and method that can provide a plurality of repair methods by collecting a plurality of information, grasp the cause of the crack of the facility The purpose.

The present application is to solve the above-mentioned problems of the prior art, by analyzing the crack image of the facility provided from the user's terminal and information obtained from the sensor, etc., to recommend a facility maintenance repair method that can provide one or more repair methods It is intended to provide a system and method.

However, the technical problem to be achieved by the embodiments of the present application is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, the facility maintenance repair method recommendation system according to an embodiment of the present application collects damage information of the facility and analyzes the cause of the damage of the facility through machine learning to recommend a repair method And a user terminal equipped with a facility maintenance device and a photographing device for acquiring damaged image information of the facility, and receiving the repair method recommendation information from the facility maintenance device, wherein the facility maintenance device includes: A neural network constructed through learning to collect damage information, damage information of the facility and damage image information of the facility as inputs, and output items relating to the results of the damage cause analysis of the facility, and the collected neural network Based on the damage information, the cause of damage to the facility Cause analyzer for analysis, and may include a recommendation recommending maintenance process corresponding to the cause of the damage to the facility.

The facility management and maintenance device according to an embodiment of the present application further includes an environment collection unit for collecting the external environment information of the facility, wherein the environment collection unit is provided on the outer wall of the facility, the external environment information for each predetermined period Information about the external environment of the facility may be collected from a sensor sensing the external server and the external server.

According to an embodiment of the present application, the recommendation unit, based on the collection result of the collection unit provides whether or not work of the repair method, whether or not the work of the repair method is at a predetermined temperature corresponding to a plurality of repair method Judgment can be made based on this.

The facility management maintenance apparatus according to an embodiment of the present application further includes a crack analysis unit for analyzing the damage image information of the facility provided from the user terminal, the crack analysis unit, analyzing the brightness of the damage image of the facility Analyze the crack depth of the facility (Crack), and the recommendation unit may recommend the repair method in consideration of the depth of the crack of the facility and the cause of damage to the facility.

According to an embodiment of the present disclosure, the crack analysis unit analyzes a crack depth of the facility based on crack distance measurement information measured using an ultrasonic sensor in the crack area of the facility, and the recommendation unit comprises the facility. Considering the depth of cracks and the causes of damage to the facility may recommend the repair method.

The facility management maintenance apparatus according to an embodiment of the present application includes a monitoring unit for monitoring the damage state of the facility based on the facility management image obtained by using the infrared imaging device for photographing the facility, the monitoring unit, the normal facility The damage state of the facility can be monitored through a damage discrimination model built through supervised learning using the image of the outer wall and the image of the outer wall of the damaged facility.

The collection unit according to an embodiment of the present application collects the color information of the surrounding environment of the facility, the recommendation unit when painting the facility based on the color information of the surrounding environment when the painting method is included in the repair method You can recommend the required color.

Facility maintenance repair method recommendation system according to an embodiment of the present application may further include a cost calculation unit for calculating the cost of the repair method of the facility generated when the recommended repair method is applied in consideration of the degree of damage of the facility. .

Facility maintenance repair method recommendation method according to an embodiment of the present application, in the maintenance device, collecting the damage information of the facility and analyzing the cause of the damage of the facility through machine learning to recommend the repair method and the facility In a user terminal equipped with a photographing device for acquiring damaged image information, the method includes receiving a recommendation of the repair method from the maintenance device, and the recommending of the repair method includes collecting damage information of the facility at all times; Based on the damage information of the facility and the damage image information of the facility as input, based on the artificial neural network and the collected damage information of the facility through the learning to output the item on the damage cause analysis results of the facility, the facility Analyzing the cause of damage to the system and a report corresponding to the cause of damage to the facility. It may comprise recommended method.

The above-mentioned means for solving the problems are merely exemplary and should not be construed as limiting the present application. In addition to the above-described exemplary embodiments, additional embodiments may exist in the drawings and detailed description of the invention.

According to the above-mentioned problem solving means of this application, a some repair method can be provided by collecting a some information, grasping the cause of a crack of a facility.

According to the aforementioned problem solving means of the present application, by analyzing the crack image of the facility provided from the user's terminal and the information obtained from the sensor, it is possible to provide at least one repair method.

According to the above-described problem solving means of the present application, the operator can provide a facility maintenance repair method recommendation system and method that can roughly check the crack of the facility only with the eyes, and select the repair method to prevent the crack occurring again. Can be.

According to the above-mentioned problem solution means of the present application, by determining the possible and impossible maintenance work based on the external environmental information,

However, the effects obtainable herein are not limited to the effects as described above, and other effects may exist.

1 is a schematic system diagram of a facility maintenance repair method recommendation system according to an embodiment of the present application.
Figure 2 is a schematic block diagram of a facility maintenance method recommendation apparatus according to an embodiment of the present application.
3 is a view for explaining an example of collecting damage information of the facility of the facility maintenance repair method recommendation system according to an embodiment of the present application.
4 is a view for explaining an embodiment of analyzing the degree of cracking of the facilities of the facility maintenance and repair method recommendation system according to an embodiment of the present application.
5 is a view illustrating a facility monitoring process of the facility maintenance repair method recommendation system according to an embodiment of the present application.
6 is a flowchart illustrating a method for recommending a facility maintenance repair method according to an embodiment of the present application.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present disclosure. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted for simplicity of explanation, and like reference numerals designate like parts throughout the specification.

Throughout this specification, when a part is "connected" to another part, it is not only "directly connected" but also "electrically connected" or "indirectly connected" with another element in between. "Includes the case.

Throughout this specification, when a member is said to be located on another member "on", "upper", "top", "bottom", "bottom", "bottom", this means that any member This includes not only the contact but also the presence of another member between the two members.

Throughout this specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding the other components unless specifically stated otherwise.

The present application relates to a facility maintenance repair method recommendation system, which collects damage information of a facility, analyzes the cause of damage of the facility through learning, and provides repair method recommendation information to a user terminal. Only the approximate degree of damage to the facility can be judged to prevent secondary damage.

1 is a schematic system diagram of a facility maintenance repair method recommendation system according to an embodiment of the present application.

The facility maintenance repair method recommendation system 1 may include a facility maintenance device 10 and a user terminal 20. The facility maintenance apparatus 10 and the user terminal 20 may include all types of servers, terminals, or devices that transmit and receive a plurality of information and various communication signals through the network, and have a function of data storage and processing. Can be.

According to an embodiment of the present application, the facility maintenance repair method recommendation system 1 may collect damage information of the facility and analyze the cause of the damage of the facility through machine learning to recommend the repair method. Facility maintenance repair method recommendation system (1) can analyze the damage image of the facility to determine the depth of crack (cracks), corrosion of reinforcing bars, and recommend more than one repair method among a plurality of repair methods corresponding to the analysis results can do. The user (worker) can repair the damage of the facility by applying the relevant repair method, and by identifying the cause of the damage of the facility, it is possible to prepare measures to prevent damage that may occur in other areas of the facility.

According to one embodiment of the present application, the facility maintenance device 10 may provide repair method recommendation information to the user terminal 20. For example, the user terminal 20 may download and install an application program provided by the facility maintenance apparatus 10, and provide repair method recommendation information through the installed application. In addition, the user terminal 20 may be equipped with a photographing apparatus, and obtain damaged image information of the facility. The user terminal 20 may provide damage image information of the facility to the facility maintenance apparatus 10 through an application.

The user terminal 20 is a device interworking with the facility maintenance apparatus 10 through a network, for example, a smartphone, a smart pad, a tablet PC, a wearable device, and the like, and a personal communication system (PCS). ), Global System for Mobile communication (GSM), Personal Digital Cellular (PDC), Personal Handyphone System (PHS), Personal Digital Assistant (PDA), International Mobile Telecommunication (IMT) -2000, Code Division Multiple Access (CDMA) -2000 Wireless communication devices such as W-Code Division Multiple Access (W-CDMA) and Wireless Broadband Internet (Wbro) terminals, and fixed terminals such as desktop computers and smart TVs.

An example of a network for sharing information between the facility maintenance device 10 and the user terminal 20 is a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) network, a 5G network, and a World Interoperability for Microwave Access. ) Network, Wired / Wireless Internet (LAN), Local Area Network (LAN), Wireless Local Area Network (WLAN), Wide Area Network (WAN), Personal Area Network (PAN), Bluetooth (Bluetooth) Network, Wifi Network, NFC ( And may include, but are not limited to, a Near Field Communication network, a satellite broadcast network, an analog broadcast network, and a Digital Multimedia Broadcasting (DMB) network.

In the present invention, the facility (Facility) refers to a general building or device installed to meet a specific purpose, in a broad sense the facility refers to a group of buildings, roads, substructures, etc. having a common characteristic, but usually human life It may mean a device that is closely related to the environment, that is, plumbing such as electricity, telephone, water and sewage, heating, and home / distribution and connection devices in a building.

Hereinafter, for convenience of description, an example of analyzing a damage cause of a building in the facility maintenance repair method recommendation system 1 and recommending a repair method will be described. A building is a building made of a roof, pillars, walls, windows, and floors that are attached to land, which has a certain shape, and can be used for giving, business, or business purposes. It may mean a structure.

2 is a schematic block diagram of a facility maintenance repair method recommendation apparatus according to an embodiment of the present application, Figure 3 is a collection of damage information of the facility of the facility maintenance repair method recommendation system according to an embodiment of the present application 4 is a view for explaining an example, Figure 4 is a view for explaining an embodiment for analyzing the degree of cracking of the facilities of the facility maintenance repair method recommendation system according to an embodiment of the present application, Figure 5 is an embodiment of the present application This is a diagram illustrating a facility monitoring process of the facility maintenance and repair method recommendation system according to an example.

Referring to FIG. 2, the facility maintenance and repair method recommendation device 10 includes a collecting unit 11, an environmental collecting unit 12, a cause analyzing unit 13, a crack analyzing unit 14, a recommending unit 15, The monitoring unit 16 may include a cost calculator 17. However, the configuration of the facility maintenance repair method recommendation device 10 is not limited to those disclosed above. For example, the facility maintenance repair method recommendation apparatus 10 may further include a database for storing a plurality of information.

According to one embodiment of the present application, the collection unit 11 may collect damage information of the facility (building). Damage information of a facility (building) may include crack information, leak information, repair reinforcement history information, and material information of the facility. The crack information may be information about a crack in a facility (building). The crack information may be information including an area, a size, and a depth of the crack. The leak information may be information obtained by using the leak apparatus. Repair and reinforcement history information is the information including the history of repair and reinforcement of the facility, such as cracks, leaks, painting, etc. of the facility (building). Material information of the facility (building) may include information such as concrete, rebar, paint, etc. used in the construction (building).

For example, referring to FIG. 3, the collection unit 11 may collect crack image information of an outer wall, an inner wall, a floor, and a concrete material of a facility (building). The crack image information may be provided from the user terminal 20. The user terminal 20 may acquire damage image information by capturing a crack area of a facility (building) for obtaining a repair method by identifying a cause of damage by using a photographing apparatus mounted on the user terminal 20.

In addition, the collector 11 may obtain damage information of the facility (building) through cameras and sensors installed inside or outside the facility (building). For example, the collection unit 11 may be provided with a sensor on the reinforcing bar when the facility (building) is constructed, thereby obtaining the corrosion status of the reinforcing bar. In addition, the collection unit 11 may obtain damage information of a facility (building) from a sensor for detecting a crack in concrete, a sensor for detecting a leak of water leaking from a pipeline such as water and sewage.

In addition, the collector 11 may collect damage information of the facility (building) based on the user's input information obtained through the user terminal 20. In this case, the collection unit 11 may provide a user (worker) with a plurality of input items for acquiring damage information using an application of the user terminal 20. For example, the collector 11 may provide an input item including micro cracks, hair cracks, critical cracks, lateral cracks and longitudinal cracks in order to determine the shape of cracks in the outer wall of the facility (building).

According to an embodiment of the present application, the environmental information collecting unit 12 may collect external environmental information of the facility. The environmental information collecting unit 120 may collect external environmental information from a sensor which is provided on the outer wall of the facility and senses external environmental information at predetermined intervals. In addition, the environmental information collecting unit 120 may collect external environmental information of a facility (building) from an external server. The external server may be a meteorological office server.

Climate conditions play an important role in the maintenance of facilities. For example, an exterior wall of an apartment made of concrete gradually decreases in durability such as the exterior wall cracking under the influence of various environmental requirements, and the painted surface is also contaminated to damage the aesthetics. Concrete buildings have concrete aging, neutralization and corrosion of rebars over time due to rain and carbon due to their structural characteristics. In other words, the environmental information collecting unit 12 may collect external environmental information of a facility (building) in order to determine an optimal environment for carrying out construction for repairing the exterior wall of the apartment. In addition, the environmental information collection unit 12 may stop the work immediately when rainy weather or high humidity by collecting external environmental information because the painted surface may be cracked or peeled off early depending on the climatic conditions at the time of painting construction. Information can be provided.

The cause analysis unit 13 inputs the damage information of the facility and the damage image information of the facility, and inputs the damage information of the artificial neural network and the collected facilities that are constructed through learning to output an item on the damage cause analysis result of the facility. Based on this, the cause of damage to the facility can be analyzed. For example, the damage information of the facility may include crack information obtained from a plurality of cameras and sensors, leak information, repair / reinforcement history information, crack information provided from material information of the facility and user input information, Leakage information, repair and reinforcement history information and material information of the facility may be included. In other words, the information for acquiring damage information outside and inside the facility (building) may be used as an input of the artificial neural network.

In addition, the input of the artificial neural network may include the classification information on the cause of damage to the facility (building) as an item. For example, the classification information on the cause of damage may be information including causes for shortening the life of the building (building), such as cracks, leaks, aging of paint, corrosion of reinforcing bars. The collector 11 may provide a user (worker) by dividing each item of the classification information on the cause of the damage when providing a plurality of input items to obtain the damage information by using the application of the user terminal 20. . In other words, formal data including not only atypical data including damage information of the facility and damage image information of the facility, but also classification information on the cause of damage of the facility (building) may be considered together.

In addition, the cause analyzing unit 13 may derive variables necessary for analyzing the damage information of the facility and damage image information of the facility collected to analyze the cause of the damage of the facility. The cause analysis unit 13 obtains data from the collecting unit 11 collecting the damage information of the facility and the user terminal 20 that receives the damage image information of the facility and the damage information of the facility from a user's input, and obtained An analysis variable to be analyzed may be selected from the data, and preprocessing of data corresponding to the selected variable may be performed. For example, the cause analyzer 13 may format damage information of the facility and damage image information of the facility based on the atypical specific variable. For example, the variable required for analysis may be data corresponding to crack information, leakage information, maintenance / reinforcement history information, and material information of a facility, but is not limited thereto. In addition, variables required for analysis may correspond to environmental factors, internal factors, external factors, material factors, construction factors, and structural factors. The cause analyzer 13 may perform preprocessing to normalize data stored in the data set. In other words, the cause analyzer 13 may perform data normalization that matches variable values of data stored in the data set on a predetermined basis.

Meanwhile, the cause analyzing unit 13 may output the damage cause result of the facility by dividing the cause of damage of the facility (building) into environmental factors, internal factors, external factors, material factors, construction factors, structural factors, and the like.

According to one embodiment of the present application, the cause analysis unit 13 may provide an output item of cause analysis corresponding to each item of the cause of damage of the facility based on a user input provided from the user terminal 20. For example, the user terminal 20 may receive an input that desires to classify damage information of facilities corresponding to structural and unstructured crack items. Structural cracking may refer to cracking caused by the action of a working load on a structure or structural member. Non-structural cracks may refer to cracks that cause no stability deterioration of the structure, but may result in deterioration of durability and usability. Major cracks in structural cracks may include cracks due to design errors, cracks due to external loads, cracks due to lack of cross section and reinforcement. Non-structural cracks may include plastic settling cracks, plastic shrinkage cracks, initial temperature shrinkage cracks, long-term dry shrinkage cracks, irregular microcracks, cracks by reinforcing steel by chlorides, and cracks by alkaline aggregate reactions. In other words, when the cause analyzing unit 13 wants to output the damage cause of the facility from the user terminal 20 to be included in the structural and unstructured cracks, the damage information of the facility as the input and the damage information of the facility are already present. As the output of the corresponding artificial neural network, the cause of damage to the facility can be provided as outputs corresponding to structural and non-structural cracking. In addition, the cause analysis unit 13 outputs the output (result) of the cause of damage of the facility to cracks due to material factors, cracks due to construction factors, cracks due to structural factors, cracks due to environmental factors, fires and earthquakes (natural disasters). It may be derived in the form of selecting any one of the cracks, but is not limited thereto.

The damage information of the facility collected from the collection unit 11 and the damage image of the facility received from the user terminal 20 and the learning of the cause of the damage of the facility according to the data input from the damage information of the facility may be made repeatedly, Accordingly, the artificial neural network analyzing the cause of damage of the facility of the cause analyzing unit 13 may be continuously updated. Damage information of a facility is data that is continuously measured (collected) at predetermined time intervals and may be referred to as big data.

According to the exemplary embodiment of the present application, the cause analyzing unit 13 inputs information (data) collected in real time or periodically from the collecting unit 11 for the constructed artificial neural network as a result of the cause of the damage of the facility. You can output

In addition, the cause analysis unit 13 may include damage information of the facility (building) including crack information, leakage information, repair reinforcement history information, and material information of the facility collected by the collection unit 11, and the user terminal ( Damage image information obtained by photographing a crack area of a facility (building) using the photographing apparatus mounted in 20), information obtained from a camera and a sensor installed inside or outside the facility (building), user terminal 20 Damage information of the facility (building) collected based on the user's input information obtained through the application of the information, the external environment information of the facility collected by the environmental information collection unit 12, the crack analysis of the crack analysis unit 14 Analyze the cause of damage to the facility through an artificial neural network built through learning that inputs width, depth, corrosion of reinforcing steel structures, and outputs items related to the cause of damage analysis. Can be.

In addition, the cause analysis unit 13 is the damage information of the facility, in other words, the facility (building) including crack information, leakage information, repair reinforcement history information and material information of the facility collected by the collection unit 11 described above Damaged image information obtained by photographing the crack area of the facility (building) using the damage information of the user terminal and the photographing apparatus mounted on the user terminal 20, from cameras and sensors installed inside or outside the facility (building). Damage information of the facility (building) collected based on the acquired information, the user input information obtained through the application of the user terminal 20, external environment information of the facility collected by the environmental information collection unit 12, crack analysis Collect big data (damage information) for the input including at least one of the width, depth of the crack analyzed in section 14, or whether the reinforcing structure is corroded, and iteratively based on the big data Can. Cause analysis unit 13 is a known result associated with any one of cracks due to material factors, cracks due to construction factors, cracks due to structural factors, cracks due to environmental factors, cracks caused by fire and earthquake (natural disaster) By repeating the learning with the big data corresponding to the output, the artificial neural network can be updated and constructed. For example, the artificial neural network may be a deep learning neural network, but is not limited thereto, and various neural network systems that have been developed or developed in the future may be applied.

In addition, the cause analysis unit 13 provides new construction information including detailed drawings, construction dates, construction documents, construction images, construction videos, other related documents, worker information, etc. of the facilities (buildings) collected by the collection unit 11. The cause of the damage can be analyzed. In addition, based on at least one of maintenance facility / equipment information, maintenance date, maintenance document, maintenance image, maintenance video, other related documents, and worker information information, which is the information for performing the first maintenance after new construction. The cause of the damage can be analyzed.

According to an embodiment of the present application, the cause analysis unit 13 is based on the first crack information of the first area of the facility (building), the second crack information to be generated in the area of the facility (building) except the first area It can be predicted. In other words, the cause analyzing unit 13 may predict crack information that may occur in an area except the right outer wall of the facility (building) or another area of the right outer wall based on the crack information generated on the right outer wall of the facility (building). Can be.

The crack analysis unit 14 may analyze damage image information of the facility provided from the user terminal 20. For example, referring to FIGS. 3 to 4, the crack analyzing unit 14 may analyze the depth of the crack (crack) of the facility by analyzing the brightness of the damage image of the facility. For example, referring to FIG. 4, the crack analyzing unit 14 may determine the depth of a crack (crack) by using the damage image of the facility provided from the user terminal 20. For example, the crack analyzer 14 may analyze damage image information of the facility as shown in FIG. 4A. Damage image information of the facility as shown in Figure 4 (a) can be divided into higher brightness than the damage image of the facility as shown in Figure 4 (b) because the depth of the crack deep. In other words, the crack analysis unit 14 may acquire a darker brightness as the depth of the crack (crack) is deeper, and analyze the depth of the crack (crack) of the corresponding facility (building). Although FIG. 4 shows that only the depth of cracks can be analyzed, the crack analyzing unit 14 may analyze the width and depth of cracks of the facility (building), corrosion of the steel structure, and the like. .

According to one embodiment of the present application, the crack analysis unit 14 may learn the damage image information of the plurality of acquired facilities to determine the depth of the crack (crack) of the facility (building). In addition, the crack analysis unit 14 learns the accumulated damage image information of the facility, and when the damage image of the facility including the crack (crack) as shown in FIG. 4 is received, the depth of the crack (crack) of the facility (building). Can be analyzed.

In addition, the crack analysis unit 14 may analyze the crack depth of the facility (building) based on the crack distance measurement information measured using an ultrasonic sensor in the crack area of the facility (building). For example, the crack analyzer 14 arranges the transmission probe TX and the reception probe TR at intervals around the crack portion using an ultrasonic sensor, and the longitudinal wave ultrasonic waves transmitted from the transmission probe propagate in the concrete. Then, the time Tc until reaching the receiving probe via the crack tip is obtained. The crack depth (H) is evaluated by determining the distance L of the transmitting and receiving transducers and the time To propagating by the ultrasonic waves in the same way for the part without cracks. In addition, the crack analysis unit 14 may classify the damage degree of the crack depth for each predetermined criterion. In this case, the damage degree may be a damage of the crack depth. For example, if the degree of damage is 1, it can be classified into sufficient stages without corrosion of steel in concrete, and even regular regular inspections. If the degree of damage is 2, it can be classified into the stages requiring precise durability diagnosis according to the level of maintenance such as the start of corrosion of steel in concrete, the importance of the structure, and the durability. If the damage degree is 3, it can be classified into the stages in which the progress of corrosion of the steel in concrete and the accurate durability diagnosis are performed to clearly understand the situation of the structure. If the degree of damage is 4, it can be categorized into stages requiring corrosion of steel in concrete, and promptly accurate durability diagnosis. It is not limited to the embodiment of the cray analysis unit 14 described above, various embodiments may exist.

In addition, the crack analysis unit 15 may analyze the causes of the cracks of the concrete classified into material factors, construction factors, structural factors, environmental factors and the like. For example, material factors may include cracks due to dry shrinkage, cracks due to alkali aggregate reactions, and cracks due to heat of hydration. Construction factors may include concrete compounding construction, reinforcement, formwork. Cracks due to structural (internal and external) factors include cracks due to increased load, cracks due to member damage, cracks due to unequal settlement, cracks due to insufficient strength of the structure, cracks due to faulty design loads, and cracks in opening edges. can do. Cracks due to environmental factors (cracking due to aging) may include cracking due to concrete neutralization, cracking due to salt adhesion and invasion, cracking due to fluctuations in ambient temperature, and cracking due to repetition of freezing-thawing. The crack analysis unit 15 may determine the cause of the crack (crack) corresponding to at least one of the factors described above. In other words, the crack analyzing unit 15 may analyze the cause of the crack (crack) based on any one of an image of the crack (crack), damage information provided from the user, and collected information.

According to one embodiment of the present application, the recommendation unit 15 may recommend a repair method corresponding to the cause of damage to the facility. For example, the repair method may include a surface treatment method, injection method, filling method, water leakage repair method, coating method, waterproof method. The recommendation unit 15 may provide two or more repair methods among the plurality of repair methods based on the analysis result of the cause analyzer 13 described above.

Repair of facilities (buildings) may be performed mainly in terms of personal safety and aesthetics, in addition to performing waterproofing and durability for recovery purposes. For example, the recommendation unit 15 may recommend a repair method in response to a maintenance of the facility due to cracks in the exterior walls of the apartment (building), leakage, and aging of the paint. At this time, the recommendation unit 15 is the width of the outer wall of the apartment (building), depth, area, the corrosion of the reinforcing bars, the cause of the cracks (for example, environmental factors), the analysis of the facility based on the material of the concrete Remedial measures can be recommended to address the cause of the damage. The recommendation unit 15 may provide the material of the putty based on the material information of the collected facility, in order to use the putty (filling material used for cracking during crack repair) as it is, as the raw material. . In addition, the recommendation section 15 V-cutting and U-cutting, and V-cutting based on the analyzed cracks in order to appropriately carry out a method of cutting a cracked portion of a predetermined size or more into a V-shape so that the putty can fill the cracked portion securely. And U-cutting any one of the repair method can be recommended.

In addition, since the recommendation unit 15 is preferably carried out separately to perform the crack repair and repainting during repainting work, it can be recommended so that the crack repair work can be performed first. The exterior walls of apartments may be corroded due to leakage of reinforcing steel bars over time, and leaks and condensation may occur due to minute cracks, so the cracks and exposed steel bars are covered by the film repair method before repainting. A repair method may be recommended step by step to treat and apply the waterproofing material.

In addition, the recommendation unit 15 may provide whether or not the repair method can work based on the collection result of the environmental collector. The recommendation unit 15 may determine whether work of the repair method is possible based on a preset temperature corresponding to the plurality of repair methods. For example, it is the environmental temperature (dry shrinkage, temperature cracking), which is one of the causes of damage to the facility (building), and the recommendation unit 15 is environmental because the paint surface may be cracked or peeled off prematurely during the paint repair method. Based on the collection results of the collector, it is possible to provide the possibility of repair work. In addition, since it is necessary to stop the painting work during rainy weather or high humidity, the recommendation unit 15 may recommend the corresponding repair method only when the coating work is between 5 degrees and 35 degrees Celsius. no.

In addition, the recommendation unit 15 may recommend the repair method in preference to the material information of the facility at the time of recommending the paint repair method. For example, the recommendation unit 15 may recommend the type and grade of the paint so that the second grade of paint can be used even when a new construction is performed if the second grade of paint was used in the previous construction. In addition, the recommendation unit 15 may recommend different kinds of paints by distinguishing areas of apartments (buildings). For example, the recommendation unit 15 may recommend using an aqueous paint on the entire outer wall of the apartment (building), and recommend using an oil paint on the gas pipe.

As such, the recommendation unit 15 does not merely provide a repair method corresponding to one cause of damage based on various information, but provides a plurality of repair methods to prevent damage that may occur again even if repair is performed. have. In addition, the recommendation unit 15 recommends a repair method in consideration of various causes, the user (worker) can perform a meticulous repair by performing a repair of the facility (building) based on this.

The recommendation unit 15 includes damage information of the facility (building) including crack information, leakage information, repair reinforcement history information, and material information of the facility collected by the collection unit 11, and the user terminal 20. Damage image information obtained by photographing a crack area of a facility (building) using a mounted photographing device, information obtained from a camera and a sensor installed inside or outside the facility (building), and an application of the user terminal 20 Damage information of the facility (building) collected based on the user's input information obtained through the external environment information of the facility collected by the environmental information collection unit 12, crack width, depth analyzed by the crack analysis unit 14 At least one piece of information, such as the output of the artificial neural network constructed through learning that the input of the corrosion of the reinforcing steel structure is input and the item on the cause of the damage analysis of the facility is output. It can can recommend the method.

According to an embodiment of the present application, the collection unit 11 may collect color information of the environment of the facility (building). Color information of the surrounding environment may be information obtained by collecting environmental information from a central area of a facility (building) to an area separated by a predetermined distance. For example, when the first apartment is located and the second apartment, the third apartment, the fourth apartment, and the fifth apartment are present in an area surrounded by the east, west, south, and north of the first apartment, the collection unit 11 Color information of the first to fifth apartments may be collected with a focus on the first apartment. The collecting unit 11 collects the color information of the surrounding environment of the facility (building), so that the painting work is the most important work for improving the aesthetics, and to avoid harming the surrounding landscape by selecting a color that does not have a heterogeneous feeling in the surrounding environment. Can be.

The recommendation unit 15 may recommend a color required for painting the facility (building) based on color information of the surrounding environment of the facility (building) collected by the collecting unit 11. For example, when only the first apartment is repainted by the recommendation unit 15, colors between the second and fifth apartments may be recommended. In the second to fifth apartments, blue paint is painted. When only the first apartment is recommended to be painted with a red paint, a heterogeneity may occur, so the recommendation unit 15 may recommend that the first apartment be blue. It is recommended that the paint be painted.

The recommender 15 may provide the recommendation through an application of the user terminal 20. The user can designate and change the color of the corresponding facility (building) in advance through the application of the user terminal 20, and can be simulated through the user terminal 20 even without directly painting the facility (building). There is a more economic effect.

The recommendation unit 15 may provide the user (worker) with a repair method corresponding to the analysis of the cause of damage of the facility by using an application of the user terminal 20. The user terminal 20 outputs the recommended repair method, and a user (worker) may perform repair work using the corresponding information. The user terminal 20 may re-recommend the recommended repair method corresponding to the change when the user arbitrarily changes among the provided recommended repair methods. In other words, the user (worker) among the repair methods provided by a plurality of (for example, three) provided through the analysis of the cause of damage of the facility by the recommendation unit 15 determines that one repair method is not suitable for the user terminal 20. In the case of deleting the corresponding repair method through), the recommendation unit 15 may provide a modified repair method through the user terminal 20 using the deleted repair method and the remaining two repair method information. In other words, the user (worker) does not simply perform the repair work based only on the repair method information provided through the user terminal 20, the recommendation unit 15 is determined by the user (worker) going out to the repair work site Considering the results, you can recommend a repair method.

The monitoring unit 16 may monitor the damage state of the facility based on the facility management image obtained by using the infrared photographing apparatus 161 for photographing the facility (building). The monitoring unit 16 damages the facility through a damage discrimination model constructed through supervised learning using inputs of the normal facility exterior wall image (FIG. 5 (a)) and the damaged facility exterior wall image (FIG. 5 (b)) as input. Status can be monitored.

For example, referring to FIG. 5, the infrared imaging apparatus 161 may photograph an outer wall of a facility (building). The monitoring unit 16 may monitor a damage state of a facility (building) based on data continuously measured (collected) at a predetermined time interval from the infrared imaging apparatus 161. The monitoring unit 16 is based on the image of the exterior wall of the normal facility (FIG. 5 (a)) and the image of the exterior wall of the damaged facility (FIG. 5 (B)) and the damage (cracking, leakage, After peeling off the paint, Tensorflow can be trained to classify normal and damaged.

The monitoring unit 16 uses the sage facility through a parking space discrimination model constructed through supervised learning using inputs of an exterior wall image of a normal facility (FIG. 5A) and an image of an exterior wall of the damaged facility (FIG. 5B). The exterior wall state information of the (building) can be generated. Supervised learning means learning a model by using previously built training data. The monitoring unit 16 receives damage state information of a facility (building) based on a decision algorithm that takes an input of an exterior wall image of a normal facility (FIG. 5A) and an image of an exterior wall of the damaged facility (FIG. 5B). You can learn to generate it.

According to one embodiment of the present application, the cost calculation unit 17 may calculate the repair cost of the facility (building) that occurs when the recommended repair method is applied in consideration of the damage degree of the facility (building). For example, the cost calculator 17 may occur when a plurality of repair methods recommended by the recommender 15 are applied in consideration of the degree of damage obtained from the cause analyzer 13 and the crack analyzer 14. Can calculate the cost of repairs. In other words, the cost calculator 17 may calculate the repair cost generated when the plaster repair method and the paint repair method, which are recommended in consideration of the degree of damage of the crack of the concrete generated on the exterior wall of the apartment. The cost calculator 17 may provide the calculated repair method to the user terminal 20. In this case, the user terminal 20 may include a worker and a tenant's terminal. Maintenance of a more equitable facility (building) can be performed by providing each worker and tenant with a repair method cost calculated by the cost calculator 17.

The facility maintenance apparatus 10 may include a database. The database (not shown) may store the detailed drawing of the facility (building), construction date, construction document, construction image, construction video, other related documents, worker information, etc. in association with the facility and location information. In addition, the database (not shown) may store the maintenance history performed by applying the repair method provided by the recommendation unit 15. At this time, the maintenance history may include a maintenance facility / equipment name, maintenance date, maintenance documents, maintenance image, maintenance video, other related documents, worker information information. The database (not shown) may provide previously stored information to the user terminal 20. The user terminal 20 is a detailed drawing of a facility (building), construction date, construction document, construction image, construction video, other related documents, worker information and maintenance facility / equipment name, maintenance date, maintenance document, maintenance Based on a user input of selecting at least one of an item including an image, a maintenance video, other related documents, and worker information, information corresponding thereto may be displayed.

The database (not shown) provides worker information and history to users (workers) or landlords (tenants), and provides work history and work contents so that a more fair and accurate maintenance environment for facilities (buildings) can be provided. can do.

According to one embodiment of the present application, the damage prediction unit (not shown) may predict the damage of the facility. The damage prediction unit (not shown) may predict the damage of the facility based on any one of the damage degree of the facility, damage information of the facility collected by the collection unit, and damage image information of the facility provided from the user terminal. . Damage prediction unit (not shown) is the first area of the damage information, new construction information (detailed drawings, construction date, construction documents, images, video, equipment information, etc.), maintenance information (maintenance facilities and equipment name, maintenance Based on at least one of repair date, maintenance document, image video, etc.) and damage information of the facility, it is possible to predict the damage of the facility that may occur in the area except the first area in the facility (building). Damage to the facility may include cracks, leaks, concrete aging, corrosion of reinforcing bars, corrosion of painted surfaces, and the like. The damage prediction unit (not shown) may prepare countermeasures for the risk factor of the damage that may occur in the second area by using the damage information of the first area of the facility (building). For example, the damage prediction unit (not shown) may determine information obtained through a camera and a sensor provided in the monitoring unit 16 or a facility (building) when the cause of damage of the first area is a crack due to aging of concrete. Based on this, it is possible to predict the area where damage may occur due to the aging of concrete.

Hereinafter, based on the details described above, the operation flow of the present application will be briefly described.

6 is a flowchart illustrating a repair method recommendation method for facility maintenance according to an embodiment of the present application.

The repair method recommendation method for facility maintenance shown in FIG. 6 may be performed by the facility maintenance repair method recommendation system 1 described above. Therefore, even if omitted below, the contents described for the facility maintenance repair method recommendation system 1 may be equally applied to the description of the repair method recommendation method for facility maintenance.

In operation S601, the facility maintenance apparatus 10 may collect damage information of the facility. The damage information of the facility may be information including damage image information of the facility provided from the user terminal 20, crack information, leak information, maintenance / reinforcement history information, material information of the facility, and the like.

In addition, the facility maintenance device 10 may collect external environment information of the facility. The external environment information may be information including temperature, weather, and the like of the area where the facility is located. Facility maintenance repair method recommendation system (1) can receive external environment information from an external server. In this case, the external server may be a meteorological office server.

In step S602, the facility maintenance apparatus 10 inputs the damage information of the facility and the damage image information of the facility, and outputs an item relating to the damage cause analysis result of the facility as an output. Based on the damage information, the cause of damage to the facility can be analyzed.

In operation S603, the facility maintenance apparatus 10 may recommend a repair method corresponding to the cause of damage to the facility. In this case, the facility maintenance device 10 may recommend two or more repair methods.

In operation S604, the user terminal 20 may receive the repair method recommendation information from the facility maintenance apparatus 10. The user terminal 20 may provide damage image information of the facility to the facility maintenance device 10 through the application, and may receive the repair method recommendation information.

In the above description, steps S601 through S604 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present disclosure. In addition, some steps may be omitted as necessary, and the order between the steps may be changed.

Maintenance method recommendation method for facility maintenance according to an embodiment of the present application may be implemented in the form of program instructions that can be executed by various computer means may be recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

In addition, the above-described repair method recommendation method for the maintenance of the facility may be implemented in the form of a computer program or an application executed by a computer stored in a recording medium.

The above description of the present application is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present application is indicated by the following claims rather than the above description, and it should be construed that all changes or modifications derived from the meaning and scope of the claims and their equivalents are included in the scope of the present application.

1: Facility maintenance repair method recommendation system
10: Facility maintenance recommendation device
11: Collector 12: Cause Analysis Unit
13: Recommendation 14: Environment Collection
15: crack analysis unit 16: monitoring unit
17: Cost calculation department
20: user terminal

Claims (11)

In the facility maintenance repair method recommendation system,
A facility maintenance device for collecting damage information of a building and analyzing a damage cause of the building through machine learning to recommend a repair method; And
A user terminal equipped with a photographing apparatus for acquiring damage image information of a building and receiving recommendation information of the repair method from the facility maintenance apparatus,
The facility maintenance device,
It provides a plurality of input items for acquiring damage information of the building to the camera and a plurality of sensors and the user terminal provided inside or outside of the building, and from the input information of the user associated with the plurality of input items Collecting unit for collecting damage information;
Information obtained from cameras and sensors installed inside or outside the building collected by the collection unit, user input information and crack information, leakage information, repair reinforcement history information, and material of the building obtained through the user terminal. Cause of damage to the building by inputting the damage information of the building and the damage image information of the building including information and classifying the damage cause of the building into environmental factors, internal factors, external factors, materials factors, construction factors, and structural factors. A cause analyzer configured to analyze the cause of damage to the building based on the artificial neural network and the collected damage information of the building, which are built through a crane outputting an item relating to an analysis result;
A crack analyzer configured to analyze a crack of the building using damage image information of the building provided from the user terminal;
A recommendation unit recommending a plurality of repair methods corresponding to the damage cause of the building; And
The crack of the building based on the facility management image obtained by using an infrared photographing apparatus for photographing the building through a damage discrimination model built through supervised learning that inputs an image of a normal building exterior wall and an image of a damaged building exterior wall; Monitoring unit for monitoring the damage state related to leakage and peeling of the paint,
Including,
The cause analyzing unit may be configured to derive a variable necessary to analyze the cause of damage of the building by using the damage information of the building and the damage image information of the building, and based on the atypical specific variable, the damage information of the building and Analyze damage image of the building to analyze the cause of damage of the building,
The crack analysis unit analyzes the brightness of the damage image of the building to analyze the extent and depth of the cracks of the building and the corrosion of the reinforced structure, the crack distance measured by using an ultrasonic sensor in the crack area of the building Based on the information, the damage degree of the depth of the crack of the building is classified by a predetermined criterion,
The recommendation unit is a plurality of repairs in consideration of the output of the artificial neural network constructed through learning to input the width, depth of the crack and the analysis of the corrosion of the reinforcement structure as an input and output the item on the cause of damage of the building Facility maintenance repair method recommendation system that recommends construction method. delete The method of claim 1,
The facility maintenance device,
Further comprising an environment collecting unit for collecting the external environment information of the building,
The environmental collection unit,
Collecting the external environment information of the building from a sensor and an external server provided on the outer wall of the building for sensing the external environment information every predetermined period, facility maintenance and repair method recommendation system. The method of claim 3,
The recommendation unit,
Providing whether the repair method can work based on the collection result of the environmental collection unit, whether or not the work of the repair method is determined based on a predetermined temperature corresponding to a plurality of repair method, facility maintenance maintenance Method recommendation system. delete delete delete The method of claim 1,
The collection unit collects color information of the surrounding environment of the building,
The recommendation unit recommends a color required for painting the building based on the color information of the surrounding environment when the painting method is included in the repair method, facility maintenance and repair method recommendation system. The method of claim 1,
The facility maintenance repair method recommendation system that further comprises a cost calculation unit for calculating the repair cost of the building that occurs when the recommended repair method is applied in consideration of the damage degree of the building. The method of claim 9,
Further comprising a damage prediction unit for predicting the damage of the building based on any one of the damage degree of the building, the damage information of the building collected by the collection unit and the damage image information of the building provided from the user terminal, Facility maintenance repair method recommendation system. In facility maintenance repair method recommendation method by facility maintenance device,
In the maintenance device, collecting damage information of the building and analyzing a damage cause of the building through machine learning to recommend a repair method; And
In the user terminal equipped with a photographing device for acquiring damage image information of the building, comprising the step of receiving the recommended repair method from the maintenance device,
Recommend the repair method,
A plurality of input items for acquiring damage information of the building is provided to a camera, a plurality of sensors, and the user terminal provided inside or outside the building, and from the user's input information associated with the plurality of input items, the building Collecting corruption information of the;
Information obtained from cameras and sensors installed inside or outside the building collected in the collecting step, user input information and crack information, leakage information, repair reinforcement history information and building information obtained through the user terminal; Damage to the building by inputting damage information of the building including material information and damage image information of the building, and dividing the damage cause of the building into environmental factors, internal factors, external factors, materials factors, construction factors, and structural factors. Analyzing the cause of damage to the building based on the artificial neural network and the collected damage information of the building through learning to output an item relating to a cause analysis result;
Analyzing a crack of the building using damage image information of the building provided from the user terminal;
Recommending a repair method corresponding to the damage cause of the building; And
The crack of the building based on the facility management image obtained by using an infrared photographing apparatus photographing the building through a damage discrimination model constructed through supervised learning that takes an image of a normal building exterior wall and an image of a damaged building exterior wall as input; Monitoring for damages associated with leaks and peeling of paint,
Including,
Analyzing the cause of damage of the building, using the damage information of the building and the damage image information of the building, to derive a variable necessary to analyze the cause of the damage of the building, based on the atypical specific variable Analyze the damage information of the building and the damage image information of the building to analyze the cause of the damage of the building,
The analyzing of the crack of the building may include analyzing the brightness of the damage image of the building to analyze the extent and depth of the crack of the building and the corrosion of the reinforced structure, and using an ultrasonic sensor in the crack area of the building. Based on the measured crack distance measurement information, the damage degree of the depth of the crack of the building (class) is classified by a predetermined criterion,
In the recommendation of the repair method, the output of the artificial neural network established through learning to input the width, depth of the analyzed crack and the corrosion of the reinforcement structure as an input, and output the items related to the damage cause result of the building The recommendation method is to recommend a plurality of repair methods in consideration.

Images