AU2020101011A4 - Method for identifying concrete cracks based on yolov3 deep learning model - Google Patents
Method for identifying concrete cracks based on yolov3 deep learning model Download PDFInfo
- Publication number
- AU2020101011A4 AU2020101011A4 AU2020101011A AU2020101011A AU2020101011A4 AU 2020101011 A4 AU2020101011 A4 AU 2020101011A4 AU 2020101011 A AU2020101011 A AU 2020101011A AU 2020101011 A AU2020101011 A AU 2020101011A AU 2020101011 A4 AU2020101011 A4 AU 2020101011A4
- Authority
- AU
- Australia
- Prior art keywords
- bounding box
- target
- yolov3
- boxes
- crack
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
- G06F18/232—Non-hierarchical techniques
- G06F18/2321—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
- G06F18/23213—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
- G01N2021/8887—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- General Health & Medical Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Computing Systems (AREA)
- Signal Processing (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Probability & Statistics with Applications (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Image Analysis (AREA)
Abstract
The present invention belongs to the technical field of concrete structure damage detection, and
discloses a method for identifying concrete cracks based on a YOLOv3 deep learning model. Crack
images are imported into the YOLOv3 model and automatically compressed to a 416x416 pixel
resolution; the original images are each divided into SxS grids according to the scale of a feature map
by up-sampling and feature fusion methods similar to FPN; an Intersection over Union (IoU) of a
candidate bounding box and a ground truth bounding box is taken as an evaluation standard, and all
crack target annotation boxes in an image training set are subjected to K-means clustering analysis to
obtain the size of the candidate bounding box; and a probability that each bounding box contains
targets is predicted through logistic regression. The present invention simplifies the complexity of
network training and reduces the computing cost, quickly and accurately identifies multiple targets,
has a much better accuracy rate than other models while quickly detecting the targets, has stronger
robustness and generalization capability, and is more suitable for engineering application
environment.
14
Description
METHOD FOR IDENTIFYING CONCRETE CRACKS BASED ON YOLOV3 DEEP LEARNING MODEL TECHNICAL FIELD The present invention belongs to the technical field of concrete structure damage detection, and particularly relates to a method for identifying concrete cracks based on a YOLOv3 deep learning model. BACKGROUND Concrete is a building material most widely used in the construction of roads, bridges, houses, tunnels, dams and other infrastructure. Due to the low tensile strength of concrete and the joint influence of internal and external factors such as shrinkage and creep, external temperature change and foundation deformation, various cracks often occur in the process of construction and operation. Crack propagation is the initial stage of structural failure. With the continuous development of cracks, once the width of cracks exceeds a certain limit, it not only affects the appearance of infrastructure, but also may cause leakage, durability reduction, protective layer falling off, reinforcement corrosion, concrete carbonization, etc., or even have a great impact on traffic and pedestrian safety. Therefore, it is necessary to regularly detect the cracks on the surface of concrete structures and to prevent and control the cracks in advance according to test results. The meso-scale study of concrete strength and engineering practice experience show that cracking of the concrete structure is inevitable. If the requirements for crack evaluation of the concrete structure are too high, the maintenance process will be complicated and the cost will be high. The scientific approach should be to set a limit. The crack width on the same crack is generally uneven. The controlling width of the crack refers to controlling the average width of a wider section (within a range of 10%-15% of the crack length), and the average crack width determined in this way is the maximum width of the crack. Similarly, the average width of a narrower section (within a range of %-15% of the crack length) of the crack is the minimum crack width. The average crack width is between the maximum and the minimum. The minimum crack width visible to naked eyes is generally 0.05 mm. Cracks with a width less than 0.05 mm are usually called microcracks, cracks with a width greater than or equal to 0.05 mm are called macrocracks, and macrocracks are the result of microcrack propagation. Cracks with a width less than 0.05 mm in general concrete structures are not dangerous to use, and thus structures with microcracks having a width less than 0.05 mm can be considered as crack-free structures. Therefore, the structure that does not allow cracking in the design can only be a structure without cracks greater than 0.05 mm. The control standard for the maximum crack width of concrete is rough as follows: the maximum crack width is 0.3-0.4 mm if there is no erosion medium and no waterproof requirement; it is 0.2-0.3 mm if there is slight erosion and no waterproof requirements; and it is 0.1-0.2 mm if there is serious erosion and waterproof requirements. China's Technical Codefor Test and Evaluation ofcity bridges stipulates that the width of bridge cracks shall not exceed 0.3 mm. According to shape, cracks fall into surface cracks, through cracks, longitudinal cracks, transverse cracks, cracks with a wide top and a narrow bottom, cracks with a narrow top and a wide bottom, date pit-shaped cracks, diagonal cracks, oblique cracks, cracks with a wide exterior and a narrow interior, deep cracks (with a depth up to 1/2 of the thickness), etc. The shape of the crack is directly related to its stress state. The directions of most cracks are perpendicular to the direction of principal tensile stress, while the direction of pure shear cracks is parallel to the direction of shear stress. Accurately identifying the lengths, directions and widths of cracks in concrete structures is of great significance for determining the disease degree and operation status of structures, and is also a great issue for health inspection of concrete structures. The crack testing method adopted in the early stage is mainly manual testing, requiring maintenance personnel to carry out on-site investigation, marking and measurement and record test results. The manual testing method features high working intensity, low efficiency and insecurity, and it is required to approach the surface of the structure with the aid of a detecting auxiliary device, thus requiring higher professional knowledge and experience of testing personnel. In addition, the results of manual testing are subjectively affected, resulting in inconsistent measurement results, low measurement accuracy, etc. Besides, it is sometimes necessary to close the site for manual testing on bridges, tunnels and other traffic arteries. This greatly affects the normal traffic, bringing inconvenience to the normal passage of vehicles and pedestrians, or even causing traffic accidents in serious cases. Advanced nondestructive testing methods, such as an ultrasonic method, a thermal imaging method, computed tomography and an electromagnetic acoustic emission sensor testing method, have the disadvantages of expensive instruments, small measurement range, inability to completely realize non-contact measurement, etc. In about 2000, image processing techniques (IPTs) based on computer vision technology began to be used for identification of concrete surface cracks. The IPTs have an obvious advantage of identifying almost all surface defects (such as cracks and corrosion). However, the light intensity, light and shade changes, image distortion and other factors of an image seriously affect detection results, and a large amount of noise is generated during the processing. This makes it difficult to accurately and efficiently identify concrete crack targets in the image in the conventional computer vision technology. An edge detection method closest to the present invention is the most commonly used method in the IPTs, and its commonly used operators generally include first derivatives such as Sobel operator and Canny operator, and second derivatives such as Laplacian operator. The core principle of the edge detection method is to detect a set of pixel points with sharp changes in the gray level of surrounding pixels. In the image with uniform gray level changes, a boundary obtained by using only the first derivative operator is relatively coarse, or even no boundary can be found. However, the second derivative operator based on zero-crossing detection is sensitive to noise. Even if the edge can be detected, the number of edge points obtained is relatively small. Since the concrete image background has a small overall gray difference and a crack edge has a low pixel gradient and is usually a weak edge, the edge detection method has a poor effect when applied in the crack identification field. With the rapid development of artificial intelligence, a deep learning algorithm is widely used in all aspects of image processing. An image processing technology based on deep learning provides a good solution for concrete crack detection. Some scholars have proposed some methods in concrete crack identification by applying deep learning theory, such as detecting cracks without calculating defect features, proposing a deep learning framework for detecting cracks in each video frame, proposing a novel data fusion solution to aggregate information, and applying principal component analysis (PCA) to classify cracks. Such methods are generally based on a sliding window technology and deep learning, and the sliding window technology is not targeted. Due to the small widths of target cracks, most of the windows generated by the sliding window technology are usually redundant windows, actual effective windows account for only a small part, so that a large amount of computation resources are wasted, the computation cost is high, and the detection efficiency is low. The deep learning method requires a large amount of data, which is also the biggest bottleneck in the development of deep learning. In order to solve this problem, some deep learning frameworks that have their own data sets and have some target features extracted to facilitate use have been widely used. How to better realize the detection and identification of specific targets under these built frameworks is an urgent problem to be solved in thefield of concrete structure damage detection at present. In summary, the prior art has the following problems: At present, the commonly used edge detection method is not suitable for the field of crack identification; and the deep learning method based on the sliding window technology needs a large amount of data, lacks pertinence and has high computing cost and low detection efficiency. It is difficult to solve the foregoing technical problems for the following reasons. There is a lack of universally recognized and effective crack data sets in the world, while manual production of data sets requires a lot of manpower and material resources and is high in cost; and simplifying the complex model framework to maintain the accuracy and speed of detection while reducing the intermediate output of the network requires a lot of time for adjustment, trial calculation and training of the network. The solving of the foregoing technical problems has the significance that accurate identification results can be obtained under limited data sets, and all targets to be detected in an image can be obtained after a single detection of the input image, thus realizing end-to-end object detection and identification, i.e., achieves the input end--single neural network--output end, and reduces generated redundant data and computing costs. SUMMARY In view of the problems existing in the prior art, the present invention provides a method for identifying concrete cracks based on a YOLOv3 deep learning model. The present invention is implemented in this way: a method for identifying concrete cracks based on a YOLOv3 deep learning model, where the method takes a Darknet-53 network in the YOLOv3 model as a feature extractor and treats object detection as a regression problem, and target area positioning and target class prediction are directly performed based on a single end-to-end neural network model; Crack images are imported into the YOLOv3 model and automatically compressed to a 416x416 pixel resolution; the original images are each divided into SxS grids according to the scale of a feature map by up-sampling and feature fusion methods similar to Feature Pyramid Networks (FPN); an Intersection over Union (IoU) of a candidate bounding box and a ground truth bounding box is taken as an evaluation standard, and all crack target annotation boxes in an image training set are subjected to K-means clustering analysis to obtain the size of the candidate bounding box; and the YOLOv3 model predicts a probability that each bounding box contains targets through logistic regression. Further, the method for identifying concrete cracks based on a YOLOv3 deep learning model specifically includes: step 1: obtaining crack target images with a crack width of about 0.05 mm or more; cutting the images into a uniform size, and manually adding rectangular labels to targets in the images as ground truth bounding boxes to form a database; step 2: importing the target images into the YOLOv3 model, and automatically compressing the images to a 416x416 pixel resolution, and dividing the original images into SxS grids according to a feature map by up-sampling and feature fusion methods similar to FPN; step 3: determining the number and widths and heights of anchors, learning features from data of crack target annotation boxes to find statistical rules, then using a K-means clustering algorithm for clustering analysis of the target boxes, and taking a K value as the number of the anchors; taking an IoU of a candidate bounding box and a ground truth bounding box as an evaluation standard, and subjecting all crack target annotation boxes in an image training set to K-means clustering analysis to obtain the size of the candidate bounding box; step 4: using three anchor boxes, i.e., prior boxes, for each grid to predict a target boundary, where bounding box information is an offset (t, ty) of a center position of an object relative to an upper left corner of the grid where the point is located, and a width t, and a height th; if a targetcenter has an offset (cx, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box has a width p, and a height ph; step 5: predicting classes of the targets, and predicting, by the YOLOv3 model, a probability that each bounding box contains targets through logistic regression, where if the predicted bounding box overlaps with the ground truth bounding box in a large area and has a higher coincidence rate than other predicted bounding boxes, the probability is 1; if the coincidence rate does not reach 0.5 of a YOLOv3 threshold or is between the threshold and the maximum, the predicted bounding box will be ignored and will not affect a loss function; and step 6: taking the predicted results: a high-dimensional feature vector, a target ground truth bounding box and a class label as inputs, setting a learning rate, a learning rate decay rate, a network momentum parameter, a weight decay regular term, a batch size, batch size divisions and the threshold, and training a regression model for fine regression of the target bounding box and the class. Further, a distance function of K-means clustering in step 3 is: d(B,C)=1-Riou(B,C); where B is the size of a rectangular box, C is the center of the rectangular box, and Rou (B,C) represents an IoU of a candidate bounding box and a ground truth bounding box. Further, in step 4, the bounding box information is an offset (tx, t,) of a center position of a target relative to an upper left corner of the grid where the point is located, and a width t, and a height th; and if a target center has an offset (cx, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box has a widthp, and a heightph, then the corrected bounding boxes are: bx=a(tx)+cx b,=a(ty)+cy bw=pwetw bh=pheth
Further, in step 5, the classes of the targets are predicted, and the feature size obtained by each prediction task is: Sx Sx [3 x (4+1+B)]; where S is the grid size, 3 is the number of prior boxes of each grid, 4 is the bounding box size and coordinates, 1 is the confidence level, and B is the number of classes. Another objective of the present invention is to provide a concrete structure damage detection and control system applying the method for identifying concrete cracks based on a YOLOv3 deep learning model. In summary, the present invention has the advantages that the present invention takes a Darknet 53 network in a YOLOv3 model as a feature extractor and treats object detection as a regression problem, and target area positioning and target class prediction are directly performed based on a single end-to-end neural network model; and the deeper network is used for multi-scale prediction. This simplifies the complexity of network training, reduces the computing cost, achieves a higher accuracy rate while detecting targets quickly, and is more suitable for an engineering application environment. Deep learning-based object detection generally involves two-stage and one-stage models. When the two-stage model is used to detect targets, a series of sample candidate bounding boxes need to be generated, and then sample classification is performed by a convolution neural network, which has high computing costs and low efficiency. The YOLOv3 model converts the problem of locating the target frame into the regression problem for processing by using the one-stage model without generating candidate bounding boxes, and the algorithm has a quick speed. By a comparison with other three representative object detection models Faster-rcnn, SSD and CNN+SD, it is found that the present invention has obvious advantages in detection speed and detection effect. A detection speed comparison diagram is shown in FIG. 8 and a detection effect comparison diagram is shown in FIG. 9. It is proven that the present invention is more suitable for the field of crack identification than the existing deep learning model. At the same time, the actually detected objects in the present invention include structural cracks and non-structural cracks, as shown in FIGs. 11 and 13. The structural cracks are generally caused by structural cracking resulting from the structural stress reaching the limit, and are the beginning of structural damage, while the non-structural cracks are generally formed due to the influence of various factors such as concrete materials, pouring, curing and use environment. The appearance form of the non-structural cracks is quite different from that of the structural cracks. The present invention has better detection effect on the two kinds of cracks, and solves the problem that the general models only detect structural cracks occurring in a laboratory. Compared with IPTs, the YOLOv3 model of the present invention directly performs target area positioning and target class prediction through the single neural network model, effectively reduces the interference of the external environment and improves the accuracy rate. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a flowchart of a method for identifying concrete cracks based on a YOLOv3 deep learning model according to an example of the present invention; FIG. 2 is an implementation flowchart of a method for identifying concrete cracks based on a YOLOv3 deep learning model according to an example of the present invention; FIG. 3 is a schematic diagram of a variation curve between an average IoU and the number of candidate bounding boxes according to an example of the present invention, where when the number of the candidate bounding boxes increases, the average IoU increases, but the growth speed gradually decreases; FIG. 4 is a schematic diagram of candidate bounding box positions in an example of the present invention; FIG. 5 is a schematic diagram of predicted bounding boxes of a YOLOv3 model in 13x13 cells according to an example of the present invention; FIG. 6 is a schematic diagram of a learning rate change curve according to an example of the present invention; FIG. 7 is a schematic diagram of a PR change curve according to an example of the present invention; FIG. 8 is a diagram of a comparison between detection speeds of the present invention and other models according to an example of the present invention; FIG. 9 is a diagram of a comparison between detection effects of the present invention and other models according to an example of the present invention; FIG. 10 is a schematic diagram of a span size ofJiangling Bridge in Wujiang District, Suzhou City, provided by an example of the present invention; FIG. 11 shows an image detection result of structural cracks ofJiangling Bridge according to an example of the present invention; FIG. 12 is a schematic diagram of the acquisition of images by an unmanned aerial vehicle in an example of the present invention; FIG. 13 shows an image detection result of non-structural cracks ofJiangling Bridge according to an example of the present invention; and FIG. 14 is a principle flowchart of a method for identifying concrete cracks based on a YOLOv3 deep learning model according to an example of the present invention. DETAILED DESCRIPTION In order to make the objectives, technical solutions and advantages of the present invention clearer and more comprehensible, the present invention is further described in detail below with reference to the examples. It should be understood that the specific examples described herein are merely illustrative of the present invention and are not intended to limit the present invention. In view of the problems that at present, a commonly used approximately exhaustive type deep learning method needs a large amount of data, lacks pertinence and has a high computing cost and low detection efficiency, the present invention provides a crack detection technology with strong robustness, good generalization capability and higher detection efficiency and accuracy rate, which has originality and is more suitable for the engineering field. The application principle of the present invention is described in detail below with reference to the accompanying drawings. As shown in FIG. 1, a method for identifying concrete cracks based on a YOLOv3 deep learning model according to an example of the present invention includes the following steps. S101: Obtain crack target images with a crack width of about 0.05 mm or more; cut the images into a uniform size, and manually add rectangular labels to targets in the images as ground truth bounding boxes to form a database. S102: Import the target images into the YOLOv3 model, and automatically compress the images to a 416x416 pixel resolution, divide the original images into SxS grids according to a feature map by up-sampling and feature fusion methods similar to FPN. S103: Determine the number and widths and heights of anchors, learn features from data of crack target annotation boxes to find statistical rules, then use a K-means clustering algorithm for clustering analysis of the target boxes, and finally take a K value as the number of the anchors; take an IoU (represented by Riou) of a candidate bounding box and a ground truth bounding box as an evaluation standard, and subject all crack target annotation boxes in an image training set to K-means clustering analysis to obtain the size of the candidate bounding box. S104: Use three anchor boxes, i.e., prior boxes, for each grid to predict a target boundary, where bounding box information is an offset (t, ty) of a center position of an object relative to an upper left comer of the grid where the point is located, and a width t, and a height th; if a target center has an offset (c, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box has a width p, and a height ph; S105: Predict classes of the targets, and predict, by the YOLOv3 model, a probability that each bounding box contains targets through logistic regression, where if the predicted bounding box overlaps with the ground truth bounding box in a large area and has a higher coincidence rate than other predicted bounding boxes, the probability is 1; if the coincidence rate does not reach 0.5 of a YOLOv3 threshold or is between the threshold and the maximum, the predicted bounding box will be ignored and will not affect a loss function. S106: Take the predicted results: a high-dimensional feature vector, a target ground truth bounding box and a class label as inputs, set a learning rate, a learning rate decay rate, a network momentum parameter, a weight decay regular term, a batch size, batch size divisions, the threshold and other parameters, and train a regression model for fine regression of the target bounding box and the class. The application principle of the present invention is further described below with reference to the accompanying drawings. As shown in FIG. 2, a method for identifying concrete cracks based on a YOLOv3 deep learning model according to an example of the present invention includes the following steps. (1) A database was obtained. Based on human eye accuracy, crack target images with a crack width of about 0.05 mm or more were obtained. In order to ensure better robustness and stability of the trained model, the development directions and definitions of targets were different. The structural background surfaces on which the targets were located were also disturbed by stains, template traces or water stains, etc. In this example, 242 images were obtained, and the original images were uniformly cut into smaller images with a resolution of 1000x1000 pixels; the non-concrete background parts were removed, and cracks in the images were manually annotated by LabellImg and used as a total database, totaling 3821 images. A training set, a verification set and a test set were randomly generated in the database.
(2) The original images were segmented. The crack images were imported into YOLOv3 and automatically compressed to a 416x416 pixel resolution. The original images were each divided into SxS grids according to the sizes of a feature map (13x13, 26x26, 52x52) by up-sampling and feature fusion methods similar to FPN. (3) The number and widths and heights of anchors were determined. Crack ground truth bounding boxes were subjected to clustering analysis by using a K-means algorithm. The number of anchors and the width-height dimension of the YOLOv3 model were obtained by clustering VOC20 data sets, there was a big difference between the target shapes in the data sets, and there was a greater difference from concrete crack targets. Therefore, it is necessary to perform clustering analysis on the crack ground truth bounding boxes to re-determine the number and widths and heights of anchors. An IoU (represented by Riou) of a candidate bounding box and a ground truth bounding box was taken as an evaluation standard, and K-means clustering analysis was performed on all crack target annotation boxes in an image training set to obtain the size of the candidate bounding box. A distance function of K-means clustering is: d(B,C)=1-Riou (B,C); where B is the size of a rectangular box, C is the center of the rectangular box, and Riou (B,C) represents an IoU of a candidate bounding box and a ground truth bounding box. A variation curve between an average IoU and the number of candidate bounding boxes is shown in FIG. 3. It can be seen that as the number of candidate bounding boxes increases, the average IoU increases more and more slowly. In this example, after the relationship between the average IoU and the number of candidate bounding boxes was balanced, nine candidate bounding boxes were taken, namely (33,46), (122,43), (50,148), (73,362), (144,155), (350,74), (153,381), (364,75), (322,365). Every three anchor corresponded to three scales, as shown in FIG. 4, where small dots were annotation boxes of crack data sets, large dots represented clustering candidate bounding boxes of crack data sets, and triangular dots were candidate bounding boxes of VOC20 data sets of original YOLOv3. (4) Bounding boxes were predicted. For each grid, three anchor boxes, i.e. prior boxes, were used to predict the target boundary. A prediction example is shown in FIG. 5. The boundary boxes were predicted in the 13x13 cells, where gray boxes were prior boxes obtained by clustering, white boxes are ground truth bounding boxes, and dark gray boxes were grids where center points of objects were located. Bounding box information was an offset (t, t,) of a center position of an object relative to an upper left corner of the grid where the point was located, and a width tw and a height th. If a target center had an offset (c, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box had a width p, and a height ph, then the corrected bounding boxes were: bx=a-(tx)+cx b,=oa(ty)+cy bw=pwe'" bh=pheth (5) The classes of the targets were predicted, and the feature size obtained by each prediction task was: Sx Sx [3 x (4+1+B)]; where S is the grid size, 3 is the number of prior boxes of each grid, 4 is the bounding box size and coordinates, 1 is the confidence level, and B is the number of classes. The YOLOv3 model predicted a probability that each bounding box contains targets through logistic regression. If the predicted bounding box overlapped with the ground truth bounding box in a large area and had a higher coincidence rate than other predicted bounding boxes, the probability was 1; if the coincidence rate did not reach 0.5 of a YOLOv3 threshold or was greater than the threshold and was not the maximum, the predicted bounding box would be ignored and would not affect a loss function. In the training process, the YOLOv3 model assigned only one prediction box to each object. (6) A model was trained. The predicted results: a high-dimensional feature vector, a target ground truth bounding box and a class label were taken as inputs. A learning rate was set to 0.001; a learning rate decay rate was 10 times when iterations reached 40000 times, and was 100 times when iterations reached 45000 times, and a change curve is shown in FIG. 6; a network momentum parameter was 0.9; a weight decay regular term was 0.005; a batch size was 64, there were 16 batch size divisions; the threshold was 0.5, and there were 50200 iterations, and a regression model for fine regression of the target bounding box and the class was trained. After the training was completed, the identification ability of the YOLOv3 model was verified with the samples of the test set, the AP value reached 89.4, and a PR curve is shown in FIG. 7. By a comparison with other three representative object detection models Faster-rcnn, SSD, CNN+SD, the present invention has obvious advantages in detection speed and detection effect. A detection speed comparison diagram is shown in FIG. 8 and a detection effect comparison diagram is shown in FIG. 9. In view of the problem of the example, the present invention has more prominent detection speed and detection effect, and the detection speed can meet the requirement for real-time detection, which proves the advantage of the present invention in the field of concrete structure damage detection. The method was applied to crack detection and identification ofJiangling Bridge in Wujiang District, Suzhou City. The bridge is a three-span prestressed concrete rigid frame bridge with a continuous box girder, and has a span of 50 m+86 m+50 m = 186 m, as shown in FIG. 10. Cracks appeared after bridge operation for 15 years. Crack images of a main span baseplate above the canal were acquired by an unmanned aerial vehicle and identified. The results show that the concrete crack detection model based on a YOLOv3 deep learning model can quickly and accurately identify multiple targets such as structural cracks and non-structural cracks. The identification speed is much faster than those of other models, and even meets the requirements of real-time detection of concrete crack targets. The object detection model has much better concrete crack identification accuracy than other models, and has stronger robustness and generalization capability. The above are only the preferred examples of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements and the like made within the spirit and principles of the present invention should fall within the protection scope of the present invention.
Claims (5)
- What is claimed is: 1. A method for identifying concrete cracks based on a YOLOv3 deep learning model, wherein the method takes a Darknet-53 network in the YOLOv3 model as a feature extractor and treats object detection as a regression problem, and target area positioning and target class prediction are directly performed based on a single end-to-end neural network model; crack images are imported into the YOLOv3 model and automatically compressed to a 416x416 pixel resolution; the original images are each divided into SxS grids according to the scale of a feature map by up-sampling and feature fusion methods similar to FPN; an Intersection over Union (IoU) of a candidate bounding box and a ground truth bounding box is taken as an evaluation standard, and all crack target annotation boxes in an image training set are subjected to K-means clustering analysis to obtain the size of the candidate bounding box; and the YOLOv3 model predicts a probability that each bounding box contains targets through logistic regression.
- 2. The method for identifying concrete cracks based on a YOLOv3 deep learning model according to claim 1, specifically comprising: step 1: obtaining crack target images with a crack width of about 0.05 mm or more; cutting the images into a uniform size, and manually adding rectangular labels to targets in the images as ground truth bounding boxes to form a database; step 2: importing the target images into the YOLOv3 model, and automatically compressing the images to a 416x416 pixel resolution; dividing the original images into SxS grids according to a feature map by up-sampling and feature fusion methods similar to FPN; step 3: determining the number and widths and heights of anchors, learning features from data of crack target annotation boxes to find statistical rules, then using a K-means clustering algorithm for clustering analysis of the target boxes, and taking a K value as the number of the anchors; taking an IoU of a candidate bounding box and a ground truth bounding box as an evaluation standard, and subjecting all crack target annotation boxes in an image training set to K-means clustering analysis to obtain the size of the candidate bounding box; step 4: using three anchor boxes, i.e., prior boxes, for each grid to predict a target boundary, wherein bounding box information is an offset (t, ty) of a center position of an object relative to an upper left corner of the grid where the point is located, and a width t, and a height th; if a targetcenter has an offset (c, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box has a width p, and a height ph; step 5: predicting classes of the targets, and predicting, by the YOLOv3 model, a probability that each bounding box contains targets through logistic regression, wherein if the predicted bounding box overlaps with the ground truth bounding box in a large area and has a higher coincidence rate than other predicted bounding boxes, the probability is 1; if the coincidence rate does not reach 0.5 of a YOLOv3 threshold or is between the threshold and the maximum, the predicted bounding box will be ignored and will not affect a loss function; and step 6: taking the predicted results: a high-dimensional feature vector, a target ground truth bounding box and a class label as inputs, setting a learning rate, a learning rate decay rate, a network momentum parameter, a weight decay regular term, a batch size, batch size divisions and the threshold, and training a regression model for fine regression of the target bounding box and the class.
- 3. The method for identifying concrete cracks based on a YOLOv3 deep learning model according to claim 2, wherein a distance function of K-means clustering in step 3 is: d(B,C)=1-Rou (B,C) wherein B is the size of a rectangular box, C is the center of the rectangular box, and Rou (B,C) represents an IoU of a candidate bounding box and a ground truth bounding box.
- 4. The method for identifying concrete cracks based on a YOLOv3 deep learning model according to claim 2, wherein the bounding box information is an offset (tx, ty) of a center position of a target relative to an upper left corner of the grid where the point is located, and a width t" and a height th; and if a target center has an offset (cx, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box has a width p, and a heightph, then the corrected bounding boxes are: b= otx)+cx b,= a(ty)+cy bw=pwe'" bh-pheth wherein in step 5, the classes of the targets are predicted, and the feature size obtained by each prediction task is: Sx Sx [3 x (4+1+B)]; wherein S is the grid size, 3 is the number of prior boxes of each grid, 4 is the bounding box size and coordinates, 1 is the confidence level, and B is the number of classes.
- 5. A concrete structure damage detection and control system applying the method for identifying concrete cracks based on a YOLOv3 deep learning model according to any one of claims 1 to 4.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910558541.9 | 2019-06-26 | ||
CN201910558541.9A CN110175658A (en) | 2019-06-26 | 2019-06-26 | A kind of distress in concrete recognition methods based on YOLOv3 deep learning |
Publications (1)
Publication Number | Publication Date |
---|---|
AU2020101011A4 true AU2020101011A4 (en) | 2020-07-23 |
Family
ID=67698976
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
AU2020101011A Ceased AU2020101011A4 (en) | 2019-06-26 | 2020-06-15 | Method for identifying concrete cracks based on yolov3 deep learning model |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN110175658A (en) |
AU (1) | AU2020101011A4 (en) |
Cited By (43)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112052853A (en) * | 2020-09-09 | 2020-12-08 | 国家气象信息中心 | Text positioning method of handwritten meteorological archive data based on deep learning |
CN112132064A (en) * | 2020-09-25 | 2020-12-25 | 新希望六和股份有限公司 | Method, device, equipment and medium for identifying number of pregnant sacs based on artificial intelligence |
CN112184687A (en) * | 2020-10-10 | 2021-01-05 | 南京信息工程大学 | Road crack detection method based on capsule characteristic pyramid and storage medium |
CN112183485A (en) * | 2020-11-02 | 2021-01-05 | 北京信息科技大学 | Deep learning-based traffic cone detection positioning method and system and storage medium |
CN112215208A (en) * | 2020-11-10 | 2021-01-12 | 中国人民解放军战略支援部队信息工程大学 | Remote sensing image bridge target detection algorithm based on improved YOLOv4 |
CN112229585A (en) * | 2020-09-18 | 2021-01-15 | 长沙理工大学 | Crack damage positioning method and system based on artificial intelligence and acoustic emission technology |
CN112362756A (en) * | 2020-11-24 | 2021-02-12 | 长沙理工大学 | Concrete structure damage monitoring method and system based on deep learning |
CN112508168A (en) * | 2020-09-25 | 2021-03-16 | 上海海事大学 | Frame regression neural network construction method based on automatic correction of prediction frame |
CN112613343A (en) * | 2020-12-01 | 2021-04-06 | 浙江大学 | Improved YOLOv 4-based river waste monitoring method |
CN112634195A (en) * | 2020-11-23 | 2021-04-09 | 清华大学 | Concrete structure crack prediction method, device and system |
CN112634205A (en) * | 2020-12-04 | 2021-04-09 | 江苏鼎集智能科技股份有限公司 | Micro-feature detection algorithm based on image |
CN112785574A (en) * | 2021-01-25 | 2021-05-11 | 金陵科技学院 | Scarf pattern defect detection method based on improved YOLOv3 |
CN112949634A (en) * | 2021-03-08 | 2021-06-11 | 北京交通大学 | Bird nest detection method for railway contact network |
CN113177499A (en) * | 2021-05-11 | 2021-07-27 | 上海道生医疗科技有限公司 | Tongue crack shape identification method and system based on computer vision |
CN113192045A (en) * | 2021-05-13 | 2021-07-30 | 西安数合信息科技有限公司 | Defect size analysis method for weld image |
CN113392852A (en) * | 2021-04-30 | 2021-09-14 | 浙江万里学院 | Vehicle detection method and system based on deep learning |
CN113408584A (en) * | 2021-05-19 | 2021-09-17 | 成都理工大学 | RGB-D multi-modal feature fusion 3D target detection method |
CN113496480A (en) * | 2021-05-13 | 2021-10-12 | 西安数合信息科技有限公司 | Method for detecting weld image defects |
CN113591270A (en) * | 2021-06-29 | 2021-11-02 | 北京交通大学 | Monitoring method for analyzing and comparing performance on steel rail weld joint data set based on MDCD (modified discrete cosine transform) |
CN113610054A (en) * | 2021-08-27 | 2021-11-05 | 广州慧瞳科技有限公司 | Underwater structure disease depth detection method, system and device and storage medium |
CN113609895A (en) * | 2021-06-22 | 2021-11-05 | 上海中安电子信息科技有限公司 | Road traffic information acquisition method based on improved Yolov3 |
CN113610178A (en) * | 2021-08-17 | 2021-11-05 | 湖南工学院 | Inland ship target detection method and device based on video monitoring image |
CN113674213A (en) * | 2021-07-26 | 2021-11-19 | 南京航空航天大学 | Subway tunnel crack identification method based on rotating target detection technology |
CN113808080A (en) * | 2021-08-12 | 2021-12-17 | 常州大学 | Method for detecting number of interference fringes of glass panel of mobile phone camera hole |
CN113822148A (en) * | 2021-08-05 | 2021-12-21 | 同济大学 | Convolution neural network-based track tiny remnant intelligent identification method |
CN113888525A (en) * | 2021-10-20 | 2022-01-04 | 中国矿业大学 | Swirler blockage and early warning detection method based on camera data |
CN114298145A (en) * | 2021-11-22 | 2022-04-08 | 三峡大学 | Permeable concrete pore intelligent identification and segmentation method based on deep learning |
CN114581764A (en) * | 2021-12-24 | 2022-06-03 | 中交基础设施养护集团有限公司 | Underground structure crack disease distinguishing method based on deep learning algorithm |
CN114913438A (en) * | 2022-03-28 | 2022-08-16 | 南京邮电大学 | Yolov5 garden abnormal target identification method based on anchor frame optimal clustering |
CN115063679A (en) * | 2022-06-15 | 2022-09-16 | 电子科技大学 | Pavement quality assessment method based on deep learning |
CN115100175A (en) * | 2022-07-12 | 2022-09-23 | 南京云创大数据科技股份有限公司 | Rail transit detection method based on small sample target detection |
CN115184372A (en) * | 2022-07-13 | 2022-10-14 | 水利部交通运输部国家能源局南京水利科学研究院 | Intelligent detection device and method for micro-crack fluorescence permeation of inaccessible part of concrete structure |
CN115393725A (en) * | 2022-10-26 | 2022-11-25 | 西南科技大学 | Bridge crack identification method based on feature enhancement and semantic segmentation |
CN115691026A (en) * | 2022-12-29 | 2023-02-03 | 湖北省林业科学研究院 | Intelligent early warning monitoring management method for forest fire prevention |
US20230060459A1 (en) * | 2021-09-01 | 2023-03-02 | FootPrintKu Inc. | Image object classification optimizing method, system and computer readable medium |
CN115953672A (en) * | 2023-03-13 | 2023-04-11 | 南昌工程学院 | Method for identifying surface cracks of underwater dam |
CN116385434A (en) * | 2023-06-02 | 2023-07-04 | 同济检测(济宁)有限公司 | Intelligent detection method for precast beam cracks |
CN116912238A (en) * | 2023-09-11 | 2023-10-20 | 湖北工业大学 | Weld joint pipeline identification method and system based on multidimensional identification network cascade fusion |
CN117522195A (en) * | 2023-11-06 | 2024-02-06 | 北京住总集团有限责任公司 | Residential quality detection and assessment system and method |
CN117809310A (en) * | 2024-03-03 | 2024-04-02 | 宁波港信息通信有限公司 | Port container number identification method and system based on machine learning |
CN117893872A (en) * | 2024-03-18 | 2024-04-16 | 成都理工大学 | Plane fracture optical detection method based on multi-model fusion detection |
CN118154993A (en) * | 2024-05-09 | 2024-06-07 | 南昌工程学院 | Bimodal underwater dam crack detection method based on acousto-optic image fusion |
CN115100175B (en) * | 2022-07-12 | 2024-07-09 | 南京云创大数据科技股份有限公司 | Rail transit detection method based on small sample target detection |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110503098A (en) * | 2019-08-29 | 2019-11-26 | 西安电子科技大学 | A kind of object detection method and equipment of quick real-time lightweight |
CN110826555B (en) * | 2019-10-12 | 2021-05-04 | 天津大学 | Man-machine cooperative image target detection data semi-automatic labeling method |
CN110992307A (en) * | 2019-11-04 | 2020-04-10 | 华北电力大学(保定) | Insulator positioning and identifying method and device based on YOLO |
CN110826636A (en) * | 2019-11-12 | 2020-02-21 | 吉林省民航机场集团公司 | Aircraft anomaly detection system and anomaly detection method thereof |
CN111210408A (en) * | 2019-12-30 | 2020-05-29 | 南京航空航天大学 | Ray image-based composite material defect identification method |
CN111241343A (en) * | 2020-01-07 | 2020-06-05 | 西安电子科技大学 | Road information monitoring and analyzing detection method and intelligent traffic control system |
CN111222474B (en) * | 2020-01-09 | 2022-11-04 | 电子科技大学 | Method for detecting small target of high-resolution image with any scale |
CN111325738B (en) * | 2020-02-28 | 2023-06-23 | 湖北工业大学 | Intelligent detection method and system for transverse hole peripheral cracks |
CN111553949B (en) * | 2020-04-30 | 2023-05-19 | 张辉 | Positioning and grabbing method for irregular workpiece based on single-frame RGB-D image deep learning |
CN111861982B (en) * | 2020-06-07 | 2024-03-12 | 中国葛洲坝集团第一工程有限公司 | Visual image monitoring and identifying system |
CN111815573B (en) * | 2020-06-17 | 2021-11-02 | 科大智能物联技术股份有限公司 | Coupling outer wall detection method and system based on deep learning |
CN112215824A (en) * | 2020-10-16 | 2021-01-12 | 南通大学 | YOLO-v 3-based cloth cover defect detection and auxiliary device and method |
CN112419244B (en) * | 2020-11-11 | 2022-11-01 | 浙江大学 | Concrete crack segmentation method and device |
CN112508030A (en) * | 2020-12-18 | 2021-03-16 | 山西省信息产业技术研究院有限公司 | Tunnel crack detection and measurement method based on double-depth learning model |
CN112712076A (en) * | 2020-12-29 | 2021-04-27 | 中信重工开诚智能装备有限公司 | Visual positioning device and method based on label-free positioning |
CN112767357A (en) * | 2021-01-20 | 2021-05-07 | 沈阳建筑大学 | Yolov 4-based concrete structure disease detection method |
CA3150478A1 (en) * | 2021-03-01 | 2022-09-01 | Ecole De Technologie Superieure | Ultrasonic testing for defect detection |
CN113033390B (en) * | 2021-03-23 | 2022-12-13 | 中国科学院空天信息创新研究院 | Dam remote sensing intelligent detection method based on deep learning |
CN112926584B (en) * | 2021-05-11 | 2021-08-06 | 武汉珈鹰智能科技有限公司 | Crack detection method and device, computer equipment and storage medium |
CN113689380B (en) * | 2021-07-20 | 2023-05-16 | 中国铁路设计集团有限公司 | Deep learning-based intelligent recognition method for rust damage of truss bridge rivet |
CN113838078B (en) * | 2021-09-06 | 2023-06-30 | 中国矿业大学(北京) | Method and device for identifying and extracting coal mining subsidence ground cracks and storage medium |
CN113917562B (en) * | 2021-09-27 | 2023-02-28 | 中国科学院武汉岩土力学研究所 | Macro-microscopic structure representation and three-dimensional space construction method and device for deep-buried soft interlayer |
CN113863400B (en) * | 2021-12-02 | 2022-02-15 | 中建安装集团有限公司 | Cement-soil composite pile deformation detection system and detection method |
CN115908411B (en) * | 2023-01-06 | 2023-05-30 | 山东水利建设集团有限公司 | Concrete curing quality analysis method based on visual detection |
CN117011295B (en) * | 2023-10-07 | 2024-01-23 | 西南科技大学 | UHPC prefabricated member quality detection method based on depth separable convolutional neural network |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109064461A (en) * | 2018-08-06 | 2018-12-21 | 长沙理工大学 | A kind of detection method of surface flaw of steel rail based on deep learning network |
CN109767423B (en) * | 2018-12-11 | 2019-12-10 | 西南交通大学 | Crack detection method for asphalt pavement image |
CN109671064A (en) * | 2018-12-14 | 2019-04-23 | 大连理工大学 | A kind of multi-target detection method of industrial part face crack |
-
2019
- 2019-06-26 CN CN201910558541.9A patent/CN110175658A/en active Pending
-
2020
- 2020-06-15 AU AU2020101011A patent/AU2020101011A4/en not_active Ceased
Cited By (67)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112052853B (en) * | 2020-09-09 | 2024-02-02 | 国家气象信息中心 | Text positioning method of handwriting meteorological archive data based on deep learning |
CN112052853A (en) * | 2020-09-09 | 2020-12-08 | 国家气象信息中心 | Text positioning method of handwritten meteorological archive data based on deep learning |
CN112229585B (en) * | 2020-09-18 | 2022-07-08 | 长沙理工大学 | Crack damage positioning method and system based on artificial intelligence and acoustic emission technology |
CN112229585A (en) * | 2020-09-18 | 2021-01-15 | 长沙理工大学 | Crack damage positioning method and system based on artificial intelligence and acoustic emission technology |
CN112132064A (en) * | 2020-09-25 | 2020-12-25 | 新希望六和股份有限公司 | Method, device, equipment and medium for identifying number of pregnant sacs based on artificial intelligence |
CN112508168B (en) * | 2020-09-25 | 2023-09-22 | 上海海事大学 | Frame regression neural network construction method based on automatic correction of prediction frame |
CN112508168A (en) * | 2020-09-25 | 2021-03-16 | 上海海事大学 | Frame regression neural network construction method based on automatic correction of prediction frame |
CN112184687A (en) * | 2020-10-10 | 2021-01-05 | 南京信息工程大学 | Road crack detection method based on capsule characteristic pyramid and storage medium |
CN112184687B (en) * | 2020-10-10 | 2023-09-26 | 南京信息工程大学 | Road crack detection method based on capsule feature pyramid and storage medium |
CN112183485A (en) * | 2020-11-02 | 2021-01-05 | 北京信息科技大学 | Deep learning-based traffic cone detection positioning method and system and storage medium |
CN112183485B (en) * | 2020-11-02 | 2024-03-05 | 北京信息科技大学 | Deep learning-based traffic cone detection positioning method, system and storage medium |
CN112215208A (en) * | 2020-11-10 | 2021-01-12 | 中国人民解放军战略支援部队信息工程大学 | Remote sensing image bridge target detection algorithm based on improved YOLOv4 |
CN112634195A (en) * | 2020-11-23 | 2021-04-09 | 清华大学 | Concrete structure crack prediction method, device and system |
CN112362756B (en) * | 2020-11-24 | 2024-02-20 | 长沙理工大学 | Concrete structure damage monitoring method and system based on deep learning |
CN112362756A (en) * | 2020-11-24 | 2021-02-12 | 长沙理工大学 | Concrete structure damage monitoring method and system based on deep learning |
CN112613343B (en) * | 2020-12-01 | 2023-12-15 | 浙江大学 | River waste monitoring method based on improved YOLOv4 |
CN112613343A (en) * | 2020-12-01 | 2021-04-06 | 浙江大学 | Improved YOLOv 4-based river waste monitoring method |
CN112634205A (en) * | 2020-12-04 | 2021-04-09 | 江苏鼎集智能科技股份有限公司 | Micro-feature detection algorithm based on image |
CN112785574A (en) * | 2021-01-25 | 2021-05-11 | 金陵科技学院 | Scarf pattern defect detection method based on improved YOLOv3 |
CN112785574B (en) * | 2021-01-25 | 2023-06-06 | 金陵科技学院 | Scarf pattern defect detection method based on improved YOLOv3 |
CN112949634B (en) * | 2021-03-08 | 2024-04-26 | 北京交通大学 | Railway contact net nest detection method |
CN112949634A (en) * | 2021-03-08 | 2021-06-11 | 北京交通大学 | Bird nest detection method for railway contact network |
CN113392852A (en) * | 2021-04-30 | 2021-09-14 | 浙江万里学院 | Vehicle detection method and system based on deep learning |
CN113392852B (en) * | 2021-04-30 | 2024-02-13 | 浙江万里学院 | Vehicle detection method and system based on deep learning |
CN113177499A (en) * | 2021-05-11 | 2021-07-27 | 上海道生医疗科技有限公司 | Tongue crack shape identification method and system based on computer vision |
CN113496480A (en) * | 2021-05-13 | 2021-10-12 | 西安数合信息科技有限公司 | Method for detecting weld image defects |
CN113192045A (en) * | 2021-05-13 | 2021-07-30 | 西安数合信息科技有限公司 | Defect size analysis method for weld image |
CN113408584A (en) * | 2021-05-19 | 2021-09-17 | 成都理工大学 | RGB-D multi-modal feature fusion 3D target detection method |
CN113408584B (en) * | 2021-05-19 | 2022-07-26 | 成都理工大学 | RGB-D multi-modal feature fusion 3D target detection method |
CN113609895A (en) * | 2021-06-22 | 2021-11-05 | 上海中安电子信息科技有限公司 | Road traffic information acquisition method based on improved Yolov3 |
CN113591270A (en) * | 2021-06-29 | 2021-11-02 | 北京交通大学 | Monitoring method for analyzing and comparing performance on steel rail weld joint data set based on MDCD (modified discrete cosine transform) |
CN113591270B (en) * | 2021-06-29 | 2024-01-19 | 北京交通大学 | MDCD-based monitoring method for performance analysis and comparison on steel rail weld data set |
CN113674213B (en) * | 2021-07-26 | 2024-04-09 | 南京航空航天大学 | Subway tunnel crack identification method based on rotating target detection technology |
CN113674213A (en) * | 2021-07-26 | 2021-11-19 | 南京航空航天大学 | Subway tunnel crack identification method based on rotating target detection technology |
CN113822148B (en) * | 2021-08-05 | 2024-04-12 | 同济大学 | Intelligent identification method for trace tiny carryover based on convolutional neural network |
CN113822148A (en) * | 2021-08-05 | 2021-12-21 | 同济大学 | Convolution neural network-based track tiny remnant intelligent identification method |
CN113808080A (en) * | 2021-08-12 | 2021-12-17 | 常州大学 | Method for detecting number of interference fringes of glass panel of mobile phone camera hole |
CN113808080B (en) * | 2021-08-12 | 2023-10-24 | 常州大学 | Method for detecting number of interference fringes of glass panel of camera hole of mobile phone |
CN113610178A (en) * | 2021-08-17 | 2021-11-05 | 湖南工学院 | Inland ship target detection method and device based on video monitoring image |
CN113610054A (en) * | 2021-08-27 | 2021-11-05 | 广州慧瞳科技有限公司 | Underwater structure disease depth detection method, system and device and storage medium |
US20230060459A1 (en) * | 2021-09-01 | 2023-03-02 | FootPrintKu Inc. | Image object classification optimizing method, system and computer readable medium |
CN113888525A (en) * | 2021-10-20 | 2022-01-04 | 中国矿业大学 | Swirler blockage and early warning detection method based on camera data |
CN114298145A (en) * | 2021-11-22 | 2022-04-08 | 三峡大学 | Permeable concrete pore intelligent identification and segmentation method based on deep learning |
CN114298145B (en) * | 2021-11-22 | 2024-07-09 | 三峡大学 | Deep learning-based permeable concrete pore intelligent recognition and segmentation method |
CN114581764A (en) * | 2021-12-24 | 2022-06-03 | 中交基础设施养护集团有限公司 | Underground structure crack disease distinguishing method based on deep learning algorithm |
CN114581764B (en) * | 2021-12-24 | 2024-04-26 | 中交基础设施养护集团有限公司 | Underground structure crack disease discriminating method based on deep learning algorithm |
CN114913438A (en) * | 2022-03-28 | 2022-08-16 | 南京邮电大学 | Yolov5 garden abnormal target identification method based on anchor frame optimal clustering |
CN115063679A (en) * | 2022-06-15 | 2022-09-16 | 电子科技大学 | Pavement quality assessment method based on deep learning |
CN115063679B (en) * | 2022-06-15 | 2024-04-26 | 电子科技大学 | Pavement quality assessment method based on deep learning |
CN115100175B (en) * | 2022-07-12 | 2024-07-09 | 南京云创大数据科技股份有限公司 | Rail transit detection method based on small sample target detection |
CN115100175A (en) * | 2022-07-12 | 2022-09-23 | 南京云创大数据科技股份有限公司 | Rail transit detection method based on small sample target detection |
CN115184372A (en) * | 2022-07-13 | 2022-10-14 | 水利部交通运输部国家能源局南京水利科学研究院 | Intelligent detection device and method for micro-crack fluorescence permeation of inaccessible part of concrete structure |
CN115393725A (en) * | 2022-10-26 | 2022-11-25 | 西南科技大学 | Bridge crack identification method based on feature enhancement and semantic segmentation |
CN115691026B (en) * | 2022-12-29 | 2023-05-05 | 湖北省林业科学研究院 | Intelligent early warning monitoring management method for forest fire prevention |
CN115691026A (en) * | 2022-12-29 | 2023-02-03 | 湖北省林业科学研究院 | Intelligent early warning monitoring management method for forest fire prevention |
CN115953672B (en) * | 2023-03-13 | 2024-02-27 | 南昌工程学院 | Method for identifying surface cracks of underwater dam |
CN115953672A (en) * | 2023-03-13 | 2023-04-11 | 南昌工程学院 | Method for identifying surface cracks of underwater dam |
CN116385434A (en) * | 2023-06-02 | 2023-07-04 | 同济检测(济宁)有限公司 | Intelligent detection method for precast beam cracks |
CN116385434B (en) * | 2023-06-02 | 2023-08-08 | 同济检测(济宁)有限公司 | Intelligent detection method for precast beam cracks |
CN116912238A (en) * | 2023-09-11 | 2023-10-20 | 湖北工业大学 | Weld joint pipeline identification method and system based on multidimensional identification network cascade fusion |
CN116912238B (en) * | 2023-09-11 | 2023-11-28 | 湖北工业大学 | Weld joint pipeline identification method and system based on multidimensional identification network cascade fusion |
CN117522195A (en) * | 2023-11-06 | 2024-02-06 | 北京住总集团有限责任公司 | Residential quality detection and assessment system and method |
CN117809310B (en) * | 2024-03-03 | 2024-04-30 | 宁波港信息通信有限公司 | Port container number identification method and system based on machine learning |
CN117809310A (en) * | 2024-03-03 | 2024-04-02 | 宁波港信息通信有限公司 | Port container number identification method and system based on machine learning |
CN117893872B (en) * | 2024-03-18 | 2024-05-14 | 成都理工大学 | Plane fracture optical detection method based on multi-model fusion detection |
CN117893872A (en) * | 2024-03-18 | 2024-04-16 | 成都理工大学 | Plane fracture optical detection method based on multi-model fusion detection |
CN118154993A (en) * | 2024-05-09 | 2024-06-07 | 南昌工程学院 | Bimodal underwater dam crack detection method based on acousto-optic image fusion |
Also Published As
Publication number | Publication date |
---|---|
CN110175658A (en) | 2019-08-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AU2020101011A4 (en) | Method for identifying concrete cracks based on yolov3 deep learning model | |
Wei et al. | Instance-level recognition and quantification for concrete surface bughole based on deep learning | |
Peng et al. | A UAV-based machine vision method for bridge crack recognition and width quantification through hybrid feature learning | |
Koch et al. | A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure | |
WO2019134252A1 (en) | Method and device for automated portrayal and accurate measurement of width of structural crack | |
CN110246130B (en) | Airport pavement crack detection method based on infrared and visible light image data fusion | |
CN111784657A (en) | Digital image-based system and method for automatically identifying cement pavement diseases | |
Chen et al. | Convolutional neural networks (CNNs)-based multi-category damage detection and recognition of high-speed rail (HSR) reinforced concrete (RC) bridges using test images | |
CN114705689A (en) | Unmanned aerial vehicle-based method and system for detecting cracks of outer vertical face of building | |
CN109035232A (en) | A kind of intermediate plate defect inspection method merged based on deep learning and machine vision | |
CN109993742B (en) | Bridge crack rapid identification method based on diagonal derivative operator | |
Guldur et al. | Condition assessment of bridges using terrestrial laser scanners | |
Song et al. | Automatic segmentation and quantification of global cracks in concrete structures based on deep learning | |
Dong et al. | Intelligent segmentation and measurement model for asphalt road cracks based on modified mask R-CNN algorithm | |
Guo et al. | Monitoring and automatic characterization of cracks in strain-hardening cementitious composite (SHCC) through intelligent interpretation of photos | |
Mishra et al. | Artificial intelligence-based visual inspection system for structural health monitoring of cultural heritage | |
Tayo et al. | Portable crack width calculation of concrete road pavement using machine vision | |
CN115994901A (en) | Automatic road disease detection method and system | |
Luo et al. | Using deep learning-based defect detection and 3D quantitative assessment for steel deck pavement maintenance | |
Kargah-Ostadi et al. | Evaluation framework for automated pavement distress identification and quantification applications | |
CN117610375A (en) | Bridge suspension casting construction digital twin method, device and equipment based on machine vision | |
Yao et al. | Chromatic aberration identification of fair-faced concrete research based on multi-scale lightweight structured data algorithm | |
Chen | Migration Learning‐Based Bridge Structure Damage Detection Algorithm | |
Shin et al. | Defect-detection model for underground parking lots using image object-detection method | |
Yao et al. | Multi-volume variable scale bitmap data object classification algorithm architectural concrete color difference detection |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FGI | Letters patent sealed or granted (innovation patent) | ||
MK22 | Patent ceased section 143a(d), or expired - non payment of renewal fee or expiry |