KR20220151263A - SAFETY INSPECTION SYSTEM FOR STRUCTURE USING SMART PORTABLE DEVICE, AND METHOD FOR THe SAME - Google Patents

Abstract

Provided are a facility safety inspection system using a smart mobile device, and a method thereof. According to the facility safety inspection system and method, the status and location of a safety inspection facility can be identified through augmented reality and virtual reality visualization based on the real-time linkage of a smart mobile device and a safety inspection server without a physical assist device by utilizing a lidar sensor and depth camera built into the smart mobile device and accordingly, beginners or non-professionals can easily access. In addition, a systematic and reasonable maintenance strategy can be established by managing the time history of the facility based on the quantitative evaluation data of the safety inspection facility. In addition, the type of deterioration and damage of the facility can be identified through image classification and analysis based on the input data. In addition, the quantitative degree and amount of deterioration and damage of the facility can be identified by utilizing the classified and analyzed data. The grade of the safety inspection facility can be easily calculated and a reasonable maintenance strategy can be established and presented to a managing body.

Description

Facility safety inspection system and method using smart mobile devices {SAFETY INSPECTION SYSTEM FOR STRUCTURE USING SMART PORTABLE DEVICE, AND METHOD FOR THE SAME}

The present invention relates to a facility safety inspection system, and more specifically, to a safety inspection facility using augmented reality (AR)/virtual It relates to a facility safety inspection system and method using a smart mobile device that visualizes reality (VR) and evaluates the state of safety inspection facilities.

Currently, the safety inspection market for facilities or structures is mostly conducted only by visual inspection by manpower, and as a result, it is difficult to perform quantitative evaluation as the inspector's experience and competence affect the grade of the facility.

For example, some of the existing visual inspection methods are performed in a qualitative rather than quantitative evaluation method, such as calculating deterioration and damage grades based on the judgment of the inspector. is influencing.

Specifically, in the case of Korea, numerous infrastructures are being built along with economic development, but the systematization and advancement of information management of public roads, bridges, tunnels, dams, and ports are insufficient. However, the field information input method of the infrastructure network was not implemented in a manager- or user-friendly environment using the latest information technology, and it was difficult to secure the reliability of the collected data.

In the existing facility management system, the information of the management site and the information of the management system are not efficiently linked and circulated, and the role of providing useful information is insufficient because it is only biased toward information input. In addition, since the information input method utilizes text or a two-dimensional plane, the ease of input is very low.

In addition, in order to inquire information by accessing a facility management system that provides useful information to managers by storing, accumulating, utilizing, and analyzing information of facilities such as bridges, and to input information through field surveys into the facility management system, recently, portable devices have been developed. An attempt is being made to use a terminal (eg, a smart phone).

Meanwhile, in the current construction field, through the application of the BIM (Building Information Modeling) method, three-dimensional design for public facilities and information generated during the entire life cycle are managed in an integrated manner to improve the quality of construction work. However, most information management is focused on solving problems during planning, design and construction. In other words, the users and applications of BIM in the planning, design, and construction stages are limited to engineers with professional skills, and the person in charge of the maintenance of the finally completed and in-use facility is limited in utilizing it. there is

On the other hand, in the case of on-site investigations stipulated in the current 「Detailed Guidelines for Safety and Maintenance of Facilities」, cracks, efflorescence, peeling, exfoliation, exposure of reinforcing bars, material separation, leaks, etc. of concrete materials are evaluated. In addition, in the case of steel materials, , paint deterioration, corrosion, cracks, rusting, etc. are evaluated through visual inspection.

When such deterioration and damage are evaluated by area ratio, the defect and damage area is divided by the unit area of investigation and evaluated as a percentage multiplied by 100. In addition, when evaluating structural cracks, the evaluation criteria are different depending on the direction and width of the crack. In the case of evaluating non-structural cracks, there is a qualitative grading system such as local cracks and global cracks.

In addition, when calculating the overall grade of the safety inspection facility, the weight of each deterioration and damage or the level of serious defects can be adjusted under the judgment of the responsible engineer, and the grade of the safety inspection facility and methods for repair and reinforcement are presented. Should be.

Specifically, when deterioration and damage are evaluated by area ratio for the safety inspection of facilities, the area of deterioration and damage must be calculated. In addition, there is a limit to calculating the quantitative amount of repair and reinforcement with the concept of a two-dimensional area rather than the concept of volume considering depth.

In addition, when evaluating structural cracks, a crack measuring device is required to measure and record the crack width separately. In addition, when evaluating non-structural cracks, there is no quantitative calculation standard, so they are evaluated locally. Accordingly, it has a qualitative evaluation system such as local cracks and overall cracks, and the experience and capabilities of engineers affect the grade of the facility.

In addition, when calculating the overall rating of safety inspection facilities, many matters are determined under the judgment of the responsible engineer, and at this time, unnecessary investment may occur as maintenance strategies such as repair and reinforcement methods are proposed based on experience. In addition, since the evaluated deterioration and damage and repair and reinforcement methods are written and recorded in a report, a large amount of document work is required, and it is difficult to intuitively grasp the facility due to poor information transmission, making it difficult for beginners or non-experts to approach it realistically. There is a problem.

On the other hand, as a prior art, Korean Patent Publication No. 2013-101202 discloses an invention titled "Augmented reality-based safety diagnosis information visualization method and system for bridge structures", which will be described with reference to FIG.

1 is a configuration diagram showing a system for visualizing augmented reality-based safety diagnosis information of a bridge structure according to the prior art.

Referring to FIG. 1, the augmented reality-based safety diagnosis information visualization system of a bridge structure according to the prior art provides information collected from measurement data and GPS location information related to a bridge structure in a mobile terminal 10 to 3D augmented reality. It includes an augmented reality visualization device 20 that is visualized and expressed as.

The augmented reality visualization device 20 can monitor the bridge structure anytime, anywhere in real time. Here, augmented reality (AR) refers to a mixed reality technology that combines a virtual world having additional information in real time with the real world and expresses it as a single image. In order to implement such augmented reality (AR), an AR application 23 is installed in the mobile terminal 10 .

This AR application 23 is operated based on the Android OS 21, but may also be operated in other operating systems such as iOS or a web browser. Accordingly, augmented reality using the AR application 23 can perform a real-time safety diagnosis of parts that are not easy to access, such as bridge structures, and can repair and reinforce bridges at an appropriate time through such real-time safety diagnosis.

Specifically, the Android OS 21-based augmented reality visualization device 20 is divided into an engine 22 and an application 23. Here, the engine 22 includes a GPS receiving module 22a for receiving location information from a plurality of GPS satellites 32, a communication module 22c for receiving measurement data from the server 40, and structure information and location of the bridge structure. It includes an AR module 22b that collects information and measurement data and visualizes them in 3D augmented reality, and the server 40 includes a DB 41 and a distribution server 42 .

This AR module 22b includes a camera and a gyro sensor. In addition, the application 23 includes a UI (user interface) module 23a that provides a user-centered interface on the screen of the mobile terminal 10, and a measurement data receiving module 23b that receives the position and measurement data of the measuring instrument 31 of the bridge structure. ) and a user location module 23c providing location information of a user holding the mobile terminal 10.

In the case of the augmented reality-based safety diagnosis information visualization system of a bridge structure according to the prior art, a plurality of sensors are installed in the bridge structure, and the internal and external factors of the bridge structure are detected and measured, and then stored in the server DB, The user selects the AR application loaded on the mobile terminal to set the basic data of the bridge, but collects structural information, location information, and measurement data of the structure using the camera and GPS module of the mobile terminal to create a 3D augmented reality. By visualizing it, it is possible to provide safety diagnosis evaluation information on the detailed state of the structure.

In the case of the augmented reality-based safety diagnosis information visualization system of a bridge structure according to the prior art, in addition to GPS information for efficient maintenance and management of a bridge structure, additional information is real-time in the real world in conjunction with GPS information from a smartphone or tablet PC. It is possible to diagnose a bridge structure by visualizing real-time sensor data access and history information through a location recognition algorithm using augmented reality, in which a real environment is three-dimensionalized and shown as a single image by mixing a virtual world having .

According to the augmented reality-based safety diagnosis information visualization system of bridge structures according to the prior art, for safety diagnosis of bridge structures, safety diagnosis of bridges at appropriate times through real-time monitoring by utilizing augmented reality-based sensor recognition and diagnostic information visualization. Using this safety diagnosis information visualization system, sensor information transmitted in real time to the control center 33 through wired/wireless communication can be monitored regardless of time and place.

In addition, by installing sensors for safety diagnosis at each major part or point of the bridge structure, it is possible to diagnose not only the entire bridge but also each part or point, and by linking with the GPS module, the location of the sensor is accurately identified to increase the accuracy of the data. , Measurement information can be easily obtained anytime, anywhere through a wireless communication network, and maintenance convenience of bridge structures can be improved by easily diagnosing inaccessible parts of the bridge using 3D augmented reality technology. .

However, in the case of the augmented reality-based safety diagnosis information visualization system of a bridge structure according to the prior art, it is for visualizing the safety diagnosis information of a bridge structure based on augmented reality, and the configuration and operation of the augmented reality visualization device 20 are complicated. However, there is a limit to performing specific safety diagnosis.

On the other hand, as another prior art, Korean Patent Registration No. 10-2195890 discloses an invention titled "Smart Glass Safety Diagnosis System and Safety Diagnosis Method", which will be described with reference to FIGS. 2A and 2B.

Figure 2a is a simplified configuration diagram of a smart glasses safety diagnosis system according to the prior art, Figure 2b is a diagram illustrating the operation of the smart glasses safety diagnosis system.

2a and 2b, the smart glass safety diagnosis system according to the prior art includes a smart glass 50, a portable terminal 60, a server 70 and a database 80 do.

The smart glasses 50 are equipped with a camera 51, an interface device capable of inputting commands (eg, a microphone), a wireless communication device, and an augmented reality (AR) function to perform a perspective function and a computer function. It is a device in the form of glasses that can be worn by a user.

The portable terminal 60 is a terminal that is portable and has communication and computer functions, and a smartphone, tablet PC, etc. can be used, and a screen input capable of writing contents on the liquid crystal screen of the portable terminal 60 in a touch method. It may be a portable terminal capable of this.

In addition, the portable terminal 60 may always output a digital drawing 91 of the structure under diagnosis, and if there is damage or deterioration that has been previously discovered and managed in the structure, a marker 92 has already been created and displayed. may be in a state

The marker 92 may be a simple mark such as marking a point where damage and deterioration is located on the drawing 91 with a cross, but such a marker 92 is preferably a QR code, and the marker 92 as a QR code In the drawing 91, all information on damage and deterioration, such as the structure, the location of damage and deterioration within the structure, the shape and length of damage and deterioration, the time of discovery, and the estimated time of occurrence, can be included and included, and smart glass ( When the recognition unit 52 of 50) recognizes the QR code, information related to damage and deterioration may be displayed on the smart glasses 50 in augmented reality. At this time, the smart glasses 50 and the portable terminal 60 may be used in the field as a device that the examiner directly wears, carries, and brings with him when inspecting the structure.

On the other hand, the server 70 and the database 80 may be located in a remote central control center or management office.

The server 70 includes a communication unit 71, a processor 72, and a storage unit 73, and is preferably a server equipped with an artificial intelligence function, and is a wireless network with the smart glasses 50 and the portable terminal 60 It can be connected through communication, and for the damage and deterioration transmitted in the form of a video by the smart glass 50 and the portable terminal 60 at the structure site, the degree of growth is read, and the newly discovered and detected signs of damage and deterioration It can be performed including a function of reading damage or deterioration, determining the risk of damage or deterioration, and deciding whether to notify the relevant authorities.

The database 80 stores the drawing 91 of the structure, and can also store extensive data on general damage, deterioration images, and detailed characteristics that may occur in the structure, so that the server 70 transmits damage from the structure site, It can provide data used when looking for a related drawing (91) by looking at images of signs of deterioration, damage, or suspected signs of deterioration, or reading damage or deterioration for newly detected signs of damage or signs of deterioration, and conducting a safety diagnosis of a structure. It is possible to save the drawings of the structure updated according to the version order.

The server 70 may be locally connected to the database 80 in a wired or wireless manner, and may be connected to the smart glasses 50 and the portable terminal 60 at a structure site through a wireless network.

According to the smart glass safety diagnosis system according to the prior art, when the safety diagnosis of a structure in the field, when the smart glass recognizes the QR code of damage and deterioration, the corresponding damage and deterioration information can be output to the smart glass through augmented reality. By doing so, safety diagnosis on structures can be performed quickly, accurately, safely and conveniently. However, in the case of the smart glass safety diagnosis system according to the prior art, there is a problem in that it is difficult to apply it easily because a separate smart glass 50 in the form of glasses must be provided.

Republic of Korea Patent Registration No. 10-1984778 (Registration Date: May 27, 2019), Title of Invention: "Multi-collaborative method for diagnosing the outer wall of a facility and apparatus for performing the same" Republic of Korea Patent Registration No. 10-2195890 (registration date: December 21, 2020), title of invention: "Smart Glass Safety Diagnosis System and Safety Diagnosis Method" Republic of Korea Patent Registration No. 10-1772916 (registration date: August 24, 2017), title of invention: "Method and system for detecting cracks on the surface of tunnel lining using an automated crack detection program based on photographic images and artificial intelligence algorithm" Republic of Korea Patent Registration No. 10-2192341 (registration date: December 11, 2020), title of invention: "Smartphone-based mobile filming facility inspection device" Republic of Korea Patent Registration No. 10-1486443 (registration date: January 20, 2015), title of invention: "Mobile field survey-based multi-dimensional object-oriented bridge information processing system and its method" Republic of Korea Patent No. 10-2189111 (registration date: December 3, 2020), title of invention: "Underground facility detection system using machine learning, augmented reality and virtual reality" Republic of Korea Patent Publication No. 2013-101202 (published date: September 13, 2013), title of invention: "Augmented reality-based safety diagnosis information visualization method and system for bridge structures"

The technical task to be achieved by the present invention for solving the above-mentioned problems is to utilize the LiDAR sensor and depth camera built into the smart mobile device, thereby real-time linkage between the smart mobile device and the safety check server without physical aids. It is to provide a facility safety inspection system and method using smart mobile devices that can grasp the status and location of safety inspection facilities through augmented reality/virtual reality visualization.

Another technical problem to be achieved by the present invention is to establish a systematic and reasonable maintenance strategy by managing the time history of the facility based on the quantitative evaluation data of the safety inspection facility, facility safety inspection using a smart mobile device To provide a system and method thereof.

Another technical problem to be achieved by the present invention is to identify the type of deterioration/damage of facilities through image classification and analysis based on input data, and to quantitatively evaluate the deterioration/damage of facilities by utilizing the classified and analyzed data. To provide a facility safety inspection system and method using smart mobile devices that can grasp the degree and quantity, calculate the grade of safety inspection facilities, establish a reasonable maintenance management strategy, and present it to the management subject it is for

As a means for achieving the above-described technical problem, the facility safety inspection system using a smart mobile device according to the present invention is a facility safety inspection system using a smart mobile device having a lidar sensor, a depth camera, and a GPS module. A lidar sensor, a depth camera, and a GPS module are provided, and the exterior of the safety inspection facility is scanned using the lidar sensor and the depth camera, the location of the safety inspection facility is registered based on GPS, and the safety A smart mobile device that transmits exterior scan data and depth images of inspection facilities together with the GPS location data; According to the exterior scan data of the safety inspection facility received from the smart mobile device, the safety inspection facility is visualized in augmented reality/virtual reality, a facility grade for each member/material of the safety inspection facility is calculated, and a facility time history is calculated. A safety inspection server that analyzes and manages and establishes a maintenance management strategy for facilities; a safety check DB implemented to store data received and processed by the safety check server, and store and manage the obtained data by augmenting/virtualizing; and an interlocking system that is interlocked so that the safety inspection server can analyze and manage facility time histories, wherein the safety inspection facility is visualized through augmented reality/virtual reality according to real-time interlocking of the smart mobile device and the safety inspection server. It is characterized by grasping the state and location.

Here, the smart mobile device inputs the specifications of the safety inspection facility, maintains a certain distance from the safety inspection facility, scans the exterior of the safety inspection facility using the built-in LiDAR sensor and depth camera, and obtains GPS Based on this, the location of the safety inspection facility may be registered, and exterior scan data and a depth image of the safety inspection facility may be transmitted together with the GPS location data.

Here, the interworking system may be a facility integrated information management system or a building information management (BIM) system.

Here, the smart mobile device, the lidar sensor for irradiating the safety inspection facility to generate external scan data of the safety inspection facility; a depth camera for generating a 3D depth image by photographing the safety inspection facility; a GPS module for generating GPS location data according to the location of the smart mobile device and confirming and registering the location of the safety inspection facility corresponding to the location of the smart mobile device; a data collection unit that collects exterior scan data of the safety inspection facility generated from the lidar sensor, 3D depth image captured from the depth camera, and GPS location data; a facility data input unit inputting the data of the safety inspection facility provided from the safety inspection server; and a communication module that collects exterior scan data, 3D depth image, and GPS location data of the safety inspection facility collected from the data collection unit and transmits the collected data to the safety inspection server.

Here, the safety check server includes: a data receiving unit for receiving LIDAR sensor scan data, depth camera photographing data, and GPS location data transmitted from the smart mobile device; an augmented reality (AR)/virtual reality (VR) visualization module that visualizes the safety inspection facility in augmented reality/virtual reality according to the exterior scan data of the safety inspection facility received by the data receiving unit; a facility grade calculation module for calculating a facility grade for each member/material of the safety inspection facility; a facility time history management unit that analyzes and manages facility time histories in conjunction with the interlocking system; and a facility maintenance strategy establishment unit in which the safety inspection server establishes a facility maintenance strategy according to an image analysis algorithm and notifies the management subject terminal of the facility maintenance strategy.

Here, the facility rating calculation module includes an image classification and analysis unit that classifies and analyzes deterioration/damage types of safety inspection facilities by using an image classification algorithm; a deterioration/damage area ratio calculation unit that calculates a deterioration/damage area ratio according to lidar scan data; A crack width calculation unit that calculates the crack width through image analysis; A deterioration/damage location display unit displaying a deterioration/damage location according to GPS location data; and a facility grade calculation unit that calculates the grade for each member/material of the safety inspection facility.

On the other hand, as another means for achieving the above-described technical problem, the facility safety inspection method using a smart mobile device according to the present invention is a facility safety using a smart mobile device having a lidar sensor, a depth camera, and a GPS module. An inspection method comprising the steps of: a) inputting specifications for a safety inspection facility at a starting point of the safety inspection facility using a smart mobile device; b) collecting exterior scan data and GPS location data of the safety inspection facility while maintaining a predetermined distance from the starting point of the safety inspection facility; c) transmitting data collected from the smart mobile device to a safety check server; d) visualizing, by the safety inspection server, the safety inspection facility in augmented reality/virtual reality according to the exterior scan data of the safety inspection facility; e) calculating, by the safety inspection server, a facility grade for each member/material of the safety inspection facility; f) analyzing and managing facility time histories by the safety inspection server in association with an interlocking system; and g) establishing, by the safety inspection server, a facility maintenance strategy according to an image analysis algorithm and notifying the management subject terminal, augmented reality/virtual reality according to real-time linkage between the smart mobile device and the safety inspection server. It is characterized in that the state and location of the safety inspection facility are grasped through visualization.

Here, step e) includes: e-1) classifying and analyzing types of deterioration/damage of safety inspection facilities using an image classification algorithm; e-2) Calculating a deterioration/damage area ratio according to lidar scan data; e-3) calculating crack width through image analysis; e-4) displaying the deterioration/damage location according to the GPS location data; and e-5) calculating a grade for each member/material of the safety inspection facility.

According to the present invention, by utilizing the built-in lidar sensor and depth camera in the smart mobile device, safety inspection facility through augmented reality / virtual reality visualization according to real-time linkage of the smart mobile device and safety inspection server without physical aids It is possible to grasp the state and location of the system, and thus, beginners or non-professionals can easily access it.

According to the present invention, it is possible to establish a systematic and reasonable maintenance management strategy by managing the time history of the facility based on the quantitative evaluation data of the safety inspection facility.

According to the present invention, it is possible to identify the type of deterioration/damage of a facility through image classification and analysis based on input data, and also to determine the quantitative degree and amount of deterioration/damage of a facility by utilizing the classified and analyzed data. In addition, it is possible to easily calculate the grade of safety inspection facilities, and establish a reasonable maintenance management strategy and present it to the management body.

1 is a configuration diagram showing a system for visualizing augmented reality-based safety diagnosis information of a bridge structure according to the prior art.
Figure 2a is a simplified configuration diagram of a smart glasses safety diagnosis system according to the prior art, Figure 2b is a diagram illustrating the operation of the smart glasses safety diagnosis system.
3 is a schematic configuration diagram of a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.
4 is a diagram illustrating obtaining scan data of the exterior of a safety inspection facility using a smart mobile device in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.
5 is a diagram for explaining the configuration and operation principle of a lidar sensor mounted on a smart mobile device in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.
6 is a diagram for explaining schematic operations of a smart mobile device and a safety inspection server in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.
7 is a diagram for explaining a specific operation of a safety inspection server in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.
8 is a detailed configuration diagram of a smart mobile device in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.
9 is a detailed configuration diagram of a safety inspection server in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.
10 is an operation flowchart of a facility safety inspection method using a smart mobile device according to an embodiment of the present invention.
FIG. 11 is an operation flow chart showing in detail the process of calculating facility grades for each member/material shown in FIG. 10 .

Hereinafter, embodiments of the present invention will be described in detail so that those skilled in the art can easily practice with reference to the accompanying drawings. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a certain component is said to "include", it means that it may further include other components without excluding other components unless otherwise stated. Also, terms such as “… unit” described in the specification refer to a unit that processes at least one function or operation, and may be implemented by hardware, software, or a combination of hardware and software.

[Facility safety inspection system using smart mobile devices]

3 is a schematic configuration diagram of a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.

Referring to FIG. 3, the facility safety inspection system using a smart mobile device according to an embodiment of the present invention is a facility safety inspection system using a smart mobile device 200 having a lidar sensor, a depth camera, and a GPS module. As, it is configured to include a smart mobile device 200, a safety check server 300, a safety check DB 400, an interworking system 500, a management subject terminal 600 and other equipment 700.

The smart mobile device 200 includes a lidar sensor 210, a depth camera 220, and a GPS module 240, and generates external scan data for the safety inspection facility 100 and a depth image of the depth camera, Transmits with GPS location data.

Specifically, the smart mobile device 200 includes a lidar sensor 210, a depth camera 220, a GPS module 240, etc., and the specifications of the safety inspection facility 100 After inputting in, while maintaining a certain distance from the safety inspection facility 100, the exterior is scanned using the built-in LIDAR sensor 210, depth camera 220, etc. to the safety inspection facility based on GPS ( 100) to register the location. Here, the lidar sensor 210 and the depth camera 220 are built into the smart mobile device 200 according to recent technological development, and the facility safety inspection system using the smart mobile device according to an embodiment of the present invention , scan data for the exterior of the safety inspection facility 100 is generated using the LIDAR sensor 210 and the depth camera 220 built into the smart mobile device 200 .

In other words, the facility safety inspection system using a smart mobile device according to an embodiment of the present invention is equipped with a LiDAR sensor, a depth camera, a gyroscope sensor, etc. according to recent technological development, and is equipped with a smart device having various functions. The state of the safety inspection facility 100 may be quantitatively evaluated using the mobile device 200 . Here, the safety inspection facility 100 may be an infrastructure structure such as a public road, bridge, tunnel, dam, port, etc., but is not limited thereto.

The safety inspection server 300 visualizes the safety inspection facility 100 in augmented reality/virtual reality according to the appearance scan data of the safety inspection facility 100 received from the smart mobile device 200, and Calculate the facility grade by member/material of (100), analyze and manage the time history of the facility, and establish a maintenance management strategy for the facility.

Specifically, the safety inspection server 300 uses the external scan data of the safety inspection facility 100 to visualize the safety inspection facility 100 in augmented reality or virtual reality, and utilizes an image classification algorithm to perform the safety inspection. After classifying the deterioration/damage type of the facility 100, the damage area ratio is calculated using the classified image analysis data and LIDAR detection data, the crack width is calculated through image analysis, and the GPS-based damage location is displayed. After calculating the damage grade for each member/material of the safety inspection facility 100 by using an evaluation algorithm with the analyzed data, it interlocks with the interlocking system 500 such as the FMS or BIM system to record the time history of the facility and establishes and presents a maintenance strategy for facilities using image analysis and machine learning.

The safety check DB 400 stores data received and processed by the safety check server 300, and is a database implemented to store and manage the obtained data by augmenting/virtualizing it, and also includes an image classification algorithm, An algorithm that can calculate a grade by analyzing stored data, a machine learning algorithm, and an algorithm that can compare and analyze the calculated grades over time to propose an appropriate maintenance strategy are stored.

The interworking system 500 is connected and interlocked with the safety inspection server 300 by wire or wireless so that the safety inspection server 300 can analyze and manage the facility time history. For example, the integrated facility information management system (Facility Management System: FMS) or building information management (Building Information Management: BIM) system, but is not limited thereto.

The management subject terminal 600 receives the facility maintenance management strategy established and presented by the safety check server 300 .

In addition, the other equipment 700 may be a field experiment equipment capable of interworking with the smart mobile device 200 . Here, the interlockable field test equipment may be, but is not limited to, non-destructive testing equipment, etc., and may vary depending on the type of the safety inspection facility 100, and the other equipment 700 may be a drone or unmanned equipment. Alternatively, the smart mobile device 200 may be mounted and used in a drone or unmanned equipment so that the smart mobile device 200 may be put into an inaccessible or dangerous place.

Meanwhile, FIG. 4 is a diagram illustrating obtaining scan data of the exterior of a safety inspection facility by using a smart mobile device in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.

In the case of a facility safety inspection system using a smart mobile device according to an embodiment of the present invention, as shown in FIG. 4, an inspector accesses a safety inspection facility, for example, a bridge, and performs the safety inspection on specifications, location, etc. Basic data for the facility 100 is checked. At this time, if necessary, data and information related to the evaluation of the safety inspection facility 100 may be input and transmitted through an additional field experiment using an experiment equipment capable of interlocking with the smart mobile device 200.

In addition, by utilizing the LIDAR sensor 210, depth camera 220, gyroscope sensor 230, etc. mounted on the smart mobile device 200, scan the exterior of the safety inspection facility 100 to obtain scan data, In addition, the location of deterioration or damage of the safety inspection facility 100 is registered or displayed using the GPS module 240 or the like.

On the other hand, Figure 5 is a diagram for explaining the configuration and operating principle of the LIDAR sensor mounted on the smart mobile device in the facility safety inspection system using the smart mobile device according to an embodiment of the present invention.

Referring to FIG. 5, in the facility safety inspection system using a smart mobile device according to an embodiment of the present invention, the lidar sensor 210 mounted on the smart mobile device shines a laser on the safety inspection facility 100 as a target. As a result, the distance, direction, speed, temperature, material distribution and concentration characteristics to the safety inspection facility 100 can be sensed.

Such a lidar sensor 210 is generally used for more precise observation of physical properties in the air and distance measurement by utilizing the advantages of a laser capable of generating a pulse signal having a high energy density and a short period. Specifically, the lidar sensor 210 includes a simple lidar sensor for measuring long-distance distances on the ground, enforcement of vehicle speed violations, and more recently, a laser scanner for restoring a 3D image, and a 3D sensor for future unmanned vehicles. As it is used as a core technology of image sensors, its usefulness and importance are gradually increasing.

Although the configuration of lidar sensors is sometimes very complicated depending on the application field, the basic configuration is simply divided into a laser transmitter, a laser detector, signal collection and processing, and data transmission and reception parts, as shown in FIG. It can be. In addition, lidar sensors may be classified into a time-of-flight (TOF) method and a phase-shift method according to a modulation method of a laser signal. In the TOF method, a laser emits a pulse signal and it is possible to measure a distance by measuring the time taken for reflected pulse signals from objects within a measurement range to arrive at a receiver. In addition, the phase-shift method is a method of calculating time and distance by emitting a continuously modulated laser beam with a specific frequency and measuring the amount of phase change of a signal that is reflected from an object within a measurement range and returned.

Meanwhile, FIG. 6 is a diagram for explaining schematic operations of a smart mobile device and a safety inspection server in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.

In the case of the facility safety inspection system using a smart mobile device according to an embodiment of the present invention, as shown in FIG. It is possible to extract the grade result of and express the entire grade of the facility for each member in the format specified on the augmented reality/virtual reality visualization screen.

In addition, the safety check server 300 registers all data in conjunction with the FMS or BIM system and the Garten interlocking system 500 to determine whether progressive / non-progressive repairs and reinforcements are performed through time history management and image analysis .

In addition, the safety inspection server 300 establishes a systematic and reasonable facility maintenance management strategy by utilizing grade information, deterioration/damage information, image analysis information, and time history information of the safety inspection facility 100 and proposes it to the management body. will do

Meanwhile, FIG. 7 is a diagram for explaining a specific operation of a safety inspection server in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.

In the facility safety inspection system using a smart mobile device according to an embodiment of the present invention, as shown in FIG. The inspection facility 100 is augmented/virtualized, and the deterioration/damage position of the safety inspection facility 100 is expressed according to a designated symbol and form.

In addition, the safety inspection server 300 analyzes the scan data acquired through the exterior scan of the safety inspection facility 100 to classify and analyze the type of deterioration/damage, and through this analysis, the facility is graded. You can extract the information you need. Thereafter, the safety inspection facility 100 may be graded by member or by material through the information extracted for grading the facility and the auxiliary information obtained through the additional field experiment.

Meanwhile, FIG. 8 is a detailed configuration diagram of a smart mobile device in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.

Referring to FIG. 8 , in the facility safety inspection system using a smart mobile device according to an embodiment of the present invention, the smart mobile device 200 includes a LiDAR sensor 210 and a depth camera 220 , a gyroscope sensor 230, a GPS module 240, a data collection unit 250, a control unit 260, a facility data input unit 270, a display 280, and a communication module 290.

A Light Detection And Ranging (LiDAR) sensor 210 irradiates the safety inspection facility 100 to generate exterior scan data of the safety inspection facility 100 .

A depth camera 220 captures the safety inspection facility 100 and generates a 3D depth image. Specifically, the depth camera 220 is a ToF (Time Of Flight Camera) type camera, and generates a 3D depth image by photographing the safety inspection facility 100, which is an object, according to a predetermined exposure time (Integration Time). can

The gyroscope sensor 230 generates acceleration data in response to the movement of the smart mobile device 200 .

The GPS module 240 generates GPS location data according to the location of the smart mobile device 200, and identifies and registers the location of the safety inspection facility 100 corresponding to the location of the smart mobile device 200. can

The data collection unit 250 collects exterior scan data of the safety inspection facility 100 generated by the lidar sensor 210, 3D depth image captured by the depth camera 220, and GPS location data.

The control unit 260 controls the operation of the lidar sensor 210 scanning the exterior of the safety inspection facility 100, the photographing operation of the depth camera 220, the operation of the GPS module 240, and the like.

The facility specification input unit 270 inputs the specifications of the safety check facility 100 provided from the safety check server 300 through the screen of the display 280 .

The display 280 displays external scan data of the safety inspection facility 100 generated by the lidar sensor 210 and a 3D depth image captured by the depth camera 220 .

The communication module 290 collects the exterior scan data, 3D depth image, and GPS location data of the safety inspection facility 100 collected from the data collection unit 250 and transmits them to the safety inspection server 300 .

Accordingly, the smart mobile device 200 may generate exterior scan data of the safety inspection facility 100 and a depth image of a depth camera, and transmit the data to the safety inspection server 300 together with the GPS location data.

Meanwhile, FIG. 9 is a detailed configuration diagram of a safety inspection server in a facility safety inspection system using a smart mobile device according to an embodiment of the present invention.

Referring to FIG. 9, in the facility safety inspection system using a smart mobile device according to an embodiment of the present invention, the safety inspection server 300 includes a data receiver 310, an augmented reality (AR)/virtual reality (VR) visualization module 320, a facility rating calculation module 330, a facility time history management unit 340, and a facility maintenance management strategy establishment unit 350, wherein the facility rating calculation module 330 includes an image classification and analysis unit 331 , a deterioration/damage area ratio calculation unit 332, a crack width calculation unit 333, a deterioration/damage location display unit 334, and a facility grade calculation unit 335.

The data receiver 310 receives LIDAR sensor scan data, depth camera capture data, and GPS location data transmitted from the smart mobile device 200 .

The augmented reality (AR)/virtual reality (VR) visualization module 320 displays the safety inspection facility 100 according to the external scan data of the safety inspection facility 100 received by the data receiver 310. Visualize virtual reality.

The facility grade calculation module 330 calculates the facility grade for each member/material of the safety inspection facility 100 . Specifically, the image classification and analysis unit 331 of the facility rating calculation module 330 classifies and analyzes the deterioration/damage type of the safety inspection facility 100 by using an image classification algorithm. In addition, the deterioration/damage area ratio calculation unit 332 of the facility class calculation module 330 calculates the deterioration/damage area ratio according to lidar scan data. In addition, the crack width calculation unit 333 of the facility grade calculation module 330 calculates the crack width through image analysis. In addition, the deterioration/damage location display unit 334 of the facility rating calculation module 330 displays the location of deterioration/damage according to GPS location data. Accordingly, the facility grade calculation unit 335 of the facility grade calculation module 330 calculates the grade for each member/material of the safety inspection facility 100 .

The facility time history management unit 340 analyzes and manages the facility time history in association with the linkage system 500 .

The facility maintenance management strategy establishment unit 350 establishes a facility maintenance management strategy according to the image analysis machine learning algorithm by the safety inspection server 300 and notifies the management subject terminal 600 of the facility maintenance management strategy establishment unit 350 . At this time, since it is obvious to those skilled in the art that the image analysis machine learning can be used to establish a maintenance management strategy for the facility, a detailed description thereof will be omitted.

As a result, the facility safety inspection system using a smart mobile device according to an embodiment of the present invention visualizes augmented reality/virtual reality according to real-time linkage of the safety inspection server 300 and the smart mobile device 200 without a physical auxiliary device. Since the status and location of the safety inspection facility 100 can be grasped through this, beginners or non-professionals can easily access it, and also systematically and systematically manages facility time history based on quantitative evaluation data for safety inspection facilities. A reasonable maintenance strategy can be established.

In addition, the facility safety inspection system using a smart mobile device according to an embodiment of the present invention identifies the type of deterioration / damage of the facility through image classification and analysis based on the input data, and also classifies and analyzes the data It is possible to grasp the quantitative degree and amount of deterioration/damage of the facility by utilizing , it is possible to calculate the grade of the safety inspection facility (100), and it is possible to establish a reasonable maintenance management strategy and present it to the management body.

[Facility safety inspection method using smart mobile devices]

FIG. 10 is an operation flow chart of a facility safety inspection method using a smart mobile device according to an embodiment of the present invention, and FIG. 11 is an operation flow chart showing in detail the facility grade calculation process for each member/material shown in FIG. 10 .

10 and 11, in the facility safety inspection method using a smart mobile device according to an embodiment of the present invention, first, the smart mobile device of the facility safety inspection system arrives at the starting point of the safety inspection facility 100 ( 200) is driven, and the specifications of the safety inspection facility 100 are input to the driven smart mobile device 200 (S110).

Next, after registering the starting point of the safety inspection facility 100, while maintaining a certain distance from the safety inspection facility 100, the lidar sensor 210 of the smart mobile device 200, the depth camera 220, etc. The exterior of the safety inspection facility 100 is scanned by using, the location is registered through the GPS-based triangulation technique through the GPS module 240 of the smart mobile device 200, and data is collected (S120). ).

Next, the data collected from the smart mobile device 200 is transmitted to the safety check server 300 (S130). Specifically, after the smart mobile device 200 inputs the specifications of the safety inspection facility 100, the built-in lidar sensor 210 and depth while maintaining a certain distance from the safety inspection facility 100 By using the camera 220, the exterior of the safety inspection facility 100 is scanned to register the location of the safety inspection facility 100 based on GPS, and the exterior scan data and depth image of the safety inspection facility 100 is transmitted together with the GPS location data.

Next, the augmented reality/virtual reality visualization module 320 of the safety inspection server 300 utilizes the external scan data of the safety inspection facility 100 to create the safety inspection facility 100 through augmented reality (AR)/ Virtual reality (VR) is visualized (S140). Here, the safety check server 300 includes a data receiving unit 310, an augmented reality/virtual reality visualization module 320, a facility rating calculation module 330, a facility time history management unit 340, and a facility maintenance management strategy establishment unit ( 350).

Next, the facility grade calculation module 330 of the safety check server 300 calculates the facility grade for each member/material of the safety check facility 100 by utilizing the collected data and evaluation algorithm (S150). . Specifically, the facility grade calculation module 330 includes an image classification and analysis unit 331, a deterioration/damage area ratio calculation unit 332, a crack width calculation unit 333, a deterioration/damage location display unit 334, and a facility grade A calculation unit 335 is included.

Specifically, the image classification and analysis unit 331 of the facility rating calculation module 330 classifies and analyzes deterioration/damage types using an image classification algorithm (S151). Thereafter, the deterioration/damage area ratio calculation unit 332 of the facility class calculation module 330 calculates the deterioration/damage area ratio using the LIDAR scan data (S152). Thereafter, the crack width calculation unit 333 of the facility grade calculation module 330 calculates the crack width through image analysis (S153). Thereafter, the deterioration/damage position display unit 334 of the facility grade calculation module 330 displays the deterioration/damage position using GPS-based triangulation (S154). Thereafter, the facility grade calculation unit 335 of the facility grade calculation module 330 utilizes the analyzed data and evaluation algorithm to calculate the evaluation grade for each member/material of the safety inspection facility 100 (S155). .

Next, the facility time history management unit 340 of the safety inspection server 300 interlocks with the interlocking system, for example, the FMS or BIM system to correspond to the change over time of the safety inspection facility 100. The history is analyzed and managed (S160).

Next, the facility maintenance strategy establishment unit 350 of the safety check server 300 establishes a facility maintenance strategy using an image analysis machine learning algorithm and presents it to the management subject terminal 600 (S170).

After all, according to an embodiment of the present invention, the visual inspection of facilities conducted according to the "Special Act on Safety and Maintenance of Facilities" can be carried out more systematically and quantitatively. In addition, by utilizing various functions and sensors added to smart mobile devices, more systematic maintenance of facilities is promoted through quantitative and clear safety inspection, and reasonable maintenance strategies are provided to the management body to lower and utilize the life cycle cost of facilities. sexuality can be maximized. In addition, it enables quantitative and systematic evaluation in the evaluation of facilities, and after attaching smart mobile devices to drones or unmanned equipment, etc., it is possible to put them in difficult or dangerous places so that the management body can conduct safety inspections and access more easily. can In addition, quantitative evaluation of safety inspection facilities is possible, and the cost for safety inspection can be reduced. By utilizing this, it becomes possible to develop various businesses such as technical training for safety inspection related companies, development of customized systems for facilities through cooperation with management entities such as Korea Land Safety Management Agency and Korea Expressway Corporation.

The above description of the present invention is for illustrative purposes, and those skilled in the art can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts should be construed as being included in the scope of the present invention. do.

100: safety inspection facility 200: smart mobile device
300: safety check server 400: safety check DB
500: interworking system 600: management subject terminal
700: other equipment
210: LiDAR sensor 220: Depth camera
230: gyroscope sensor 240: GPS module
250: data collection unit 260: control unit
270: facility data input unit 280: display
290: communication module 310: data receiving unit
320: augmented reality (AR) / virtual reality (VR) visualization module
330: Facility rating calculation module 340: Facility time history management unit
350: Facility maintenance strategy establishment unit 331: Image classification and analysis unit
332: deterioration/damage area ratio calculation unit 333: crack width calculation unit
334: deterioration/damage location display unit 335: facility rating calculation unit

Claims (12)

In a facility safety inspection system using a smart mobile device 200 with a lidar sensor, a depth camera, and a built-in GPS module,
A LIDAR sensor 210, a depth camera 220, and a GPS module 240 are provided, and the safety inspection facility 100 utilizes the lidar sensor 210 and the depth camera 220 ) A smart mobile device that scans the exterior, registers the location of the safety inspection facility 100 based on GPS, and transmits the exterior scan data and depth image of the safety inspection facility 100 together with the GPS location data (200);
According to the external scan data of the safety inspection facility 100 received from the smart mobile device 200, the safety inspection facility 100 is visualized in augmented reality/virtual reality, and each member/member of the safety inspection facility 100 A safety inspection server 300 that calculates facility grades for each material, analyzes and manages facility time histories, and establishes a facility maintenance management strategy;
a safety check DB (400) implemented to store data received and processed by the safety check server 300, and store and manage the obtained data by augmenting/virtualizing; and
Including an interlocking system 500 interlocked so that the safety inspection server 300 can analyze and manage facility time histories,
Using a smart mobile device, characterized in that for grasping the state and location of the safety inspection facility 100 through augmented reality / virtual reality visualization according to real-time linkage of the smart mobile device 200 and the safety inspection server 300 A facility safety inspection system. According to claim 1,
After the smart mobile device 200 inputs the specifications of the safety inspection facility 100, the built-in lidar sensor 210 and the depth camera 220 while maintaining a certain distance from the safety inspection facility 100 ) to scan the exterior of the safety inspection facility 100, register the location of the safety inspection facility 100 based on GPS, and transmit the exterior scan data and depth image of the safety inspection facility 100 to the GPS A facility safety inspection system using a smart mobile device characterized in that it is transmitted together with location data. According to claim 1,
The interworking system 500 is a facility safety inspection system using a smart mobile device, characterized in that a facility integrated information management system (Facility Management System: FMS) or a building information management (Building Information Management: BIM) system. The method of claim 1, wherein the smart mobile device 200,
A lidar sensor 210 irradiated to the safety inspection facility 100 to generate external scan data of the safety inspection facility 100;
a depth camera 220 for generating a 3D depth image by photographing the safety inspection facility 100;
A GPS module 240 that generates GPS location data according to the location of the smart mobile device 200 and confirms and registers the location of the safety inspection facility 100 corresponding to the location of the smart mobile device 200;
A data collection unit 250 that collects exterior scan data of the safety inspection facility 100 generated from the lidar sensor 210, 3D depth image and GPS location data taken from the depth camera 220;
a facility specification input unit 270 for inputting specifications of the safety check facility 100 provided from the safety check server 300; and
A communication module 290 for collecting exterior scan data, 3D depth image, and GPS location data of the safety inspection facility 100 collected from the data collection unit 250 and transmitting the collected data to the safety inspection server 300 Facility safety inspection system using smart mobile devices. The method of claim 1, wherein the safety check server 300,
a data receiver 310 for receiving lidar sensor scan data, depth camera capture data, and GPS location data transmitted from the smart mobile device 200;
An augmented reality (AR)/virtual reality (VR) visualization module that visualizes the safety inspection facility 100 in augmented reality/virtual reality according to the exterior scan data of the safety inspection facility 100 received by the data receiving unit 310. (320);
a facility grade calculation module 330 that calculates a facility grade for each member/material of the safety inspection facility 100;
a facility time history management unit 340 that analyzes and manages facility time histories in association with the interlocking system 500; and
Facility safety using a smart mobile device including a facility maintenance strategy establishment unit 350 in which the safety inspection server 300 establishes a facility maintenance strategy according to an image analysis algorithm and notifies the management subject terminal 600 inspection system. The method of claim 5, wherein the facility rating calculation module 330,
An image classification and analysis unit 331 that classifies and analyzes deterioration/damage types of the safety inspection facility 100 using an image classification algorithm;
A deterioration/damage area ratio calculation unit 332 that calculates a deterioration/damage area ratio according to lidar scan data;
A crack width calculator 333 that calculates the crack width through image analysis;
a deterioration/damage location display unit 334 displaying a deterioration/damage location according to GPS location data; and
A facility safety inspection system using a smart mobile device including a facility rating calculation unit 335 that calculates the grade of each member/material of the safety inspection facility. In the facility safety inspection method using a smart mobile device 200 having a lidar sensor, a depth camera, and a built-in GPS module,
a) inputting specifications for the safety inspection facility 100 at the starting point of the safety inspection facility 100 using a smart mobile device 200;
b) collecting exterior scan data and GPS location data of the safety inspection facility 100 while maintaining a certain distance from the starting point of the safety inspection facility 100;
c) transmitting the data collected from the smart mobile device 200 to the safety check server 300;
d) visualizing, by the safety inspection server 300, the safety inspection facility 100 in augmented reality/virtual reality according to the exterior scan data of the safety inspection facility 100;
e) calculating, by the safety inspection server 300, a facility grade for each member/material of the safety inspection facility 100;
f) analyzing and managing facility time histories by the safety inspection server 300 in association with the linkage system 500; and
g) the safety check server 300 establishing a facility maintenance strategy according to an image analysis algorithm and notifying the management subject terminal 600,
Using a smart mobile device, characterized in that for grasping the state and location of the safety inspection facility 100 through augmented reality / virtual reality visualization according to real-time linkage of the smart mobile device 200 and the safety inspection server 300 A facility safety inspection method. The method of claim 7, wherein step e),
e-1) classifying and analyzing the type of deterioration/damage of the safety inspection facility 100 using an image classification algorithm;
e-2) Calculating a deterioration/damage area ratio according to lidar scan data;
e-3) calculating crack width through image analysis;
e-4) displaying the deterioration/damage location according to the GPS location data; and
e-5) A facility safety inspection method using a smart mobile device comprising the step of calculating the grade for each member/material of the safety inspection facility 100. According to claim 7,
In the step c), the smart mobile device 200 inputs the specifications of the safety inspection facility 100, and then maintains a certain distance from the safety inspection facility 100, and the built-in lidar sensor 210 and The exterior of the safety inspection facility 100 is scanned using the depth camera 220 to register the location of the safety inspection facility 100 based on GPS, and the exterior scan data and depth for the safety inspection facility 100 A facility safety inspection method using a smart mobile device, characterized in that for transmitting an image together with the GPS location data. The method of claim 7, wherein the smart mobile device 200,
A lidar sensor 210 irradiated to the safety inspection facility 100 to generate external scan data of the safety inspection facility 100;
a depth camera 220 for generating a 3D depth image by photographing the safety inspection facility 100;
A GPS module 240 that generates GPS location data according to the location of the smart mobile device 200 and confirms and registers the location of the safety inspection facility 100 corresponding to the location of the smart mobile device 200;
A data collection unit 250 that collects exterior scan data of the safety inspection facility 100 generated from the lidar sensor 210, 3D depth image and GPS location data taken from the depth camera 220;
a facility specification input unit 270 for inputting specifications of the safety check facility 100 provided from the safety check server 300; and
A communication module 290 for collecting exterior scan data, 3D depth image, and GPS location data of the safety inspection facility 100 collected from the data collection unit 250 and transmitting the collected data to the safety inspection server 300 A method for safety inspection of facilities using smart mobile devices. The method of claim 6, wherein the safety check server 300,
a data receiver 310 for receiving lidar sensor scan data, depth camera capture data, and GPS location data transmitted from the smart mobile device 200;
An augmented reality (AR)/virtual reality (VR) visualization module that visualizes the safety inspection facility 100 in augmented reality/virtual reality according to the exterior scan data of the safety inspection facility 100 received by the data receiving unit 310. (320);
a facility grade calculation module 330 that calculates a facility grade for each member/material of the safety inspection facility 100;
a facility time history management unit 340 that analyzes and manages facility time histories in association with the interlocking system 500; and
Facility safety using a smart mobile device including a facility maintenance strategy establishment unit 350 in which the safety inspection server 300 establishes a facility maintenance strategy according to an image analysis algorithm and notifies the management subject terminal 600 How to check. The method of claim 11, wherein the facility rating calculation module 330,
An image classification and analysis unit 331 that classifies and analyzes deterioration/damage types of the safety inspection facility 100 using an image classification algorithm;
A deterioration/damage area ratio calculation unit 332 that calculates a deterioration/damage area ratio according to lidar scan data;
A crack width calculator 333 that calculates the crack width through image analysis;
a deterioration/damage location display unit 334 displaying a deterioration/damage location according to GPS location data; and
A facility safety inspection method using a smart mobile device including a facility rating calculation unit 335 that calculates the rating for each member/material of the safety inspection facility.

Images