AU2020101011A4 - Method for identifying concrete cracks based on yolov3 deep learning model - Google Patents

Method for identifying concrete cracks based on yolov3 deep learning model Download PDF

Info

Publication number
AU2020101011A4
AU2020101011A4 AU2020101011A AU2020101011A AU2020101011A4 AU 2020101011 A4 AU2020101011 A4 AU 2020101011A4 AU 2020101011 A AU2020101011 A AU 2020101011A AU 2020101011 A AU2020101011 A AU 2020101011A AU 2020101011 A4 AU2020101011 A4 AU 2020101011A4
Authority
AU
Australia
Prior art keywords
bounding box
target
yolov3
boxes
crack
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2020101011A
Inventor
Yonggang SHEN
Zuolin WEN
Zhenwei Yu
Yiping Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Application granted granted Critical
Publication of AU2020101011A4 publication Critical patent/AU2020101011A4/en
Ceased legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • G06F18/232Non-hierarchical techniques
    • G06F18/2321Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
    • G06F18/23213Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G01N2021/8887Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Signal Processing (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Probability & Statistics with Applications (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Image Analysis (AREA)

Abstract

The present invention belongs to the technical field of concrete structure damage detection, and discloses a method for identifying concrete cracks based on a YOLOv3 deep learning model. Crack images are imported into the YOLOv3 model and automatically compressed to a 416x416 pixel resolution; the original images are each divided into SxS grids according to the scale of a feature map by up-sampling and feature fusion methods similar to FPN; an Intersection over Union (IoU) of a candidate bounding box and a ground truth bounding box is taken as an evaluation standard, and all crack target annotation boxes in an image training set are subjected to K-means clustering analysis to obtain the size of the candidate bounding box; and a probability that each bounding box contains targets is predicted through logistic regression. The present invention simplifies the complexity of network training and reduces the computing cost, quickly and accurately identifies multiple targets, has a much better accuracy rate than other models while quickly detecting the targets, has stronger robustness and generalization capability, and is more suitable for engineering application environment. 14

Description

METHOD FOR IDENTIFYING CONCRETE CRACKS BASED ON YOLOV3 DEEP LEARNING MODEL TECHNICAL FIELD The present invention belongs to the technical field of concrete structure damage detection, and particularly relates to a method for identifying concrete cracks based on a YOLOv3 deep learning model. BACKGROUND Concrete is a building material most widely used in the construction of roads, bridges, houses, tunnels, dams and other infrastructure. Due to the low tensile strength of concrete and the joint influence of internal and external factors such as shrinkage and creep, external temperature change and foundation deformation, various cracks often occur in the process of construction and operation. Crack propagation is the initial stage of structural failure. With the continuous development of cracks, once the width of cracks exceeds a certain limit, it not only affects the appearance of infrastructure, but also may cause leakage, durability reduction, protective layer falling off, reinforcement corrosion, concrete carbonization, etc., or even have a great impact on traffic and pedestrian safety. Therefore, it is necessary to regularly detect the cracks on the surface of concrete structures and to prevent and control the cracks in advance according to test results. The meso-scale study of concrete strength and engineering practice experience show that cracking of the concrete structure is inevitable. If the requirements for crack evaluation of the concrete structure are too high, the maintenance process will be complicated and the cost will be high. The scientific approach should be to set a limit. The crack width on the same crack is generally uneven. The controlling width of the crack refers to controlling the average width of a wider section (within a range of 10%-15% of the crack length), and the average crack width determined in this way is the maximum width of the crack. Similarly, the average width of a narrower section (within a range of %-15% of the crack length) of the crack is the minimum crack width. The average crack width is between the maximum and the minimum. The minimum crack width visible to naked eyes is generally 0.05 mm. Cracks with a width less than 0.05 mm are usually called microcracks, cracks with a width greater than or equal to 0.05 mm are called macrocracks, and macrocracks are the result of microcrack propagation. Cracks with a width less than 0.05 mm in general concrete structures are not dangerous to use, and thus structures with microcracks having a width less than 0.05 mm can be considered as crack-free structures. Therefore, the structure that does not allow cracking in the design can only be a structure without cracks greater than 0.05 mm. The control standard for the maximum crack width of concrete is rough as follows: the maximum crack width is 0.3-0.4 mm if there is no erosion medium and no waterproof requirement; it is 0.2-0.3 mm if there is slight erosion and no waterproof requirements; and it is 0.1-0.2 mm if there is serious erosion and waterproof requirements. China's Technical Codefor Test and Evaluation ofcity bridges stipulates that the width of bridge cracks shall not exceed 0.3 mm. According to shape, cracks fall into surface cracks, through cracks, longitudinal cracks, transverse cracks, cracks with a wide top and a narrow bottom, cracks with a narrow top and a wide bottom, date pit-shaped cracks, diagonal cracks, oblique cracks, cracks with a wide exterior and a narrow interior, deep cracks (with a depth up to 1/2 of the thickness), etc. The shape of the crack is directly related to its stress state. The directions of most cracks are perpendicular to the direction of principal tensile stress, while the direction of pure shear cracks is parallel to the direction of shear stress. Accurately identifying the lengths, directions and widths of cracks in concrete structures is of great significance for determining the disease degree and operation status of structures, and is also a great issue for health inspection of concrete structures. The crack testing method adopted in the early stage is mainly manual testing, requiring maintenance personnel to carry out on-site investigation, marking and measurement and record test results. The manual testing method features high working intensity, low efficiency and insecurity, and it is required to approach the surface of the structure with the aid of a detecting auxiliary device, thus requiring higher professional knowledge and experience of testing personnel. In addition, the results of manual testing are subjectively affected, resulting in inconsistent measurement results, low measurement accuracy, etc. Besides, it is sometimes necessary to close the site for manual testing on bridges, tunnels and other traffic arteries. This greatly affects the normal traffic, bringing inconvenience to the normal passage of vehicles and pedestrians, or even causing traffic accidents in serious cases. Advanced nondestructive testing methods, such as an ultrasonic method, a thermal imaging method, computed tomography and an electromagnetic acoustic emission sensor testing method, have the disadvantages of expensive instruments, small measurement range, inability to completely realize non-contact measurement, etc. In about 2000, image processing techniques (IPTs) based on computer vision technology began to be used for identification of concrete surface cracks. The IPTs have an obvious advantage of identifying almost all surface defects (such as cracks and corrosion). However, the light intensity, light and shade changes, image distortion and other factors of an image seriously affect detection results, and a large amount of noise is generated during the processing. This makes it difficult to accurately and efficiently identify concrete crack targets in the image in the conventional computer vision technology. An edge detection method closest to the present invention is the most commonly used method in the IPTs, and its commonly used operators generally include first derivatives such as Sobel operator and Canny operator, and second derivatives such as Laplacian operator. The core principle of the edge detection method is to detect a set of pixel points with sharp changes in the gray level of surrounding pixels. In the image with uniform gray level changes, a boundary obtained by using only the first derivative operator is relatively coarse, or even no boundary can be found. However, the second derivative operator based on zero-crossing detection is sensitive to noise. Even if the edge can be detected, the number of edge points obtained is relatively small. Since the concrete image background has a small overall gray difference and a crack edge has a low pixel gradient and is usually a weak edge, the edge detection method has a poor effect when applied in the crack identification field. With the rapid development of artificial intelligence, a deep learning algorithm is widely used in all aspects of image processing. An image processing technology based on deep learning provides a good solution for concrete crack detection. Some scholars have proposed some methods in concrete crack identification by applying deep learning theory, such as detecting cracks without calculating defect features, proposing a deep learning framework for detecting cracks in each video frame, proposing a novel data fusion solution to aggregate information, and applying principal component analysis (PCA) to classify cracks. Such methods are generally based on a sliding window technology and deep learning, and the sliding window technology is not targeted. Due to the small widths of target cracks, most of the windows generated by the sliding window technology are usually redundant windows, actual effective windows account for only a small part, so that a large amount of computation resources are wasted, the computation cost is high, and the detection efficiency is low. The deep learning method requires a large amount of data, which is also the biggest bottleneck in the development of deep learning. In order to solve this problem, some deep learning frameworks that have their own data sets and have some target features extracted to facilitate use have been widely used. How to better realize the detection and identification of specific targets under these built frameworks is an urgent problem to be solved in thefield of concrete structure damage detection at present. In summary, the prior art has the following problems: At present, the commonly used edge detection method is not suitable for the field of crack identification; and the deep learning method based on the sliding window technology needs a large amount of data, lacks pertinence and has high computing cost and low detection efficiency. It is difficult to solve the foregoing technical problems for the following reasons. There is a lack of universally recognized and effective crack data sets in the world, while manual production of data sets requires a lot of manpower and material resources and is high in cost; and simplifying the complex model framework to maintain the accuracy and speed of detection while reducing the intermediate output of the network requires a lot of time for adjustment, trial calculation and training of the network. The solving of the foregoing technical problems has the significance that accurate identification results can be obtained under limited data sets, and all targets to be detected in an image can be obtained after a single detection of the input image, thus realizing end-to-end object detection and identification, i.e., achieves the input end--single neural network--output end, and reduces generated redundant data and computing costs. SUMMARY In view of the problems existing in the prior art, the present invention provides a method for identifying concrete cracks based on a YOLOv3 deep learning model. The present invention is implemented in this way: a method for identifying concrete cracks based on a YOLOv3 deep learning model, where the method takes a Darknet-53 network in the YOLOv3 model as a feature extractor and treats object detection as a regression problem, and target area positioning and target class prediction are directly performed based on a single end-to-end neural network model; Crack images are imported into the YOLOv3 model and automatically compressed to a 416x416 pixel resolution; the original images are each divided into SxS grids according to the scale of a feature map by up-sampling and feature fusion methods similar to Feature Pyramid Networks (FPN); an Intersection over Union (IoU) of a candidate bounding box and a ground truth bounding box is taken as an evaluation standard, and all crack target annotation boxes in an image training set are subjected to K-means clustering analysis to obtain the size of the candidate bounding box; and the YOLOv3 model predicts a probability that each bounding box contains targets through logistic regression. Further, the method for identifying concrete cracks based on a YOLOv3 deep learning model specifically includes: step 1: obtaining crack target images with a crack width of about 0.05 mm or more; cutting the images into a uniform size, and manually adding rectangular labels to targets in the images as ground truth bounding boxes to form a database; step 2: importing the target images into the YOLOv3 model, and automatically compressing the images to a 416x416 pixel resolution, and dividing the original images into SxS grids according to a feature map by up-sampling and feature fusion methods similar to FPN; step 3: determining the number and widths and heights of anchors, learning features from data of crack target annotation boxes to find statistical rules, then using a K-means clustering algorithm for clustering analysis of the target boxes, and taking a K value as the number of the anchors; taking an IoU of a candidate bounding box and a ground truth bounding box as an evaluation standard, and subjecting all crack target annotation boxes in an image training set to K-means clustering analysis to obtain the size of the candidate bounding box; step 4: using three anchor boxes, i.e., prior boxes, for each grid to predict a target boundary, where bounding box information is an offset (t, ty) of a center position of an object relative to an upper left corner of the grid where the point is located, and a width t, and a height th; if a targetcenter has an offset (cx, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box has a width p, and a height ph; step 5: predicting classes of the targets, and predicting, by the YOLOv3 model, a probability that each bounding box contains targets through logistic regression, where if the predicted bounding box overlaps with the ground truth bounding box in a large area and has a higher coincidence rate than other predicted bounding boxes, the probability is 1; if the coincidence rate does not reach 0.5 of a YOLOv3 threshold or is between the threshold and the maximum, the predicted bounding box will be ignored and will not affect a loss function; and step 6: taking the predicted results: a high-dimensional feature vector, a target ground truth bounding box and a class label as inputs, setting a learning rate, a learning rate decay rate, a network momentum parameter, a weight decay regular term, a batch size, batch size divisions and the threshold, and training a regression model for fine regression of the target bounding box and the class. Further, a distance function of K-means clustering in step 3 is: d(B,C)=1-Riou(B,C); where B is the size of a rectangular box, C is the center of the rectangular box, and Rou (B,C) represents an IoU of a candidate bounding box and a ground truth bounding box. Further, in step 4, the bounding box information is an offset (tx, t,) of a center position of a target relative to an upper left corner of the grid where the point is located, and a width t, and a height th; and if a target center has an offset (cx, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box has a widthp, and a heightph, then the corrected bounding boxes are: bx=a(tx)+cx b,=a(ty)+cy bw=pwetw bh=pheth
Further, in step 5, the classes of the targets are predicted, and the feature size obtained by each prediction task is: Sx Sx [3 x (4+1+B)]; where S is the grid size, 3 is the number of prior boxes of each grid, 4 is the bounding box size and coordinates, 1 is the confidence level, and B is the number of classes. Another objective of the present invention is to provide a concrete structure damage detection and control system applying the method for identifying concrete cracks based on a YOLOv3 deep learning model. In summary, the present invention has the advantages that the present invention takes a Darknet 53 network in a YOLOv3 model as a feature extractor and treats object detection as a regression problem, and target area positioning and target class prediction are directly performed based on a single end-to-end neural network model; and the deeper network is used for multi-scale prediction. This simplifies the complexity of network training, reduces the computing cost, achieves a higher accuracy rate while detecting targets quickly, and is more suitable for an engineering application environment. Deep learning-based object detection generally involves two-stage and one-stage models. When the two-stage model is used to detect targets, a series of sample candidate bounding boxes need to be generated, and then sample classification is performed by a convolution neural network, which has high computing costs and low efficiency. The YOLOv3 model converts the problem of locating the target frame into the regression problem for processing by using the one-stage model without generating candidate bounding boxes, and the algorithm has a quick speed. By a comparison with other three representative object detection models Faster-rcnn, SSD and CNN+SD, it is found that the present invention has obvious advantages in detection speed and detection effect. A detection speed comparison diagram is shown in FIG. 8 and a detection effect comparison diagram is shown in FIG. 9. It is proven that the present invention is more suitable for the field of crack identification than the existing deep learning model. At the same time, the actually detected objects in the present invention include structural cracks and non-structural cracks, as shown in FIGs. 11 and 13. The structural cracks are generally caused by structural cracking resulting from the structural stress reaching the limit, and are the beginning of structural damage, while the non-structural cracks are generally formed due to the influence of various factors such as concrete materials, pouring, curing and use environment. The appearance form of the non-structural cracks is quite different from that of the structural cracks. The present invention has better detection effect on the two kinds of cracks, and solves the problem that the general models only detect structural cracks occurring in a laboratory. Compared with IPTs, the YOLOv3 model of the present invention directly performs target area positioning and target class prediction through the single neural network model, effectively reduces the interference of the external environment and improves the accuracy rate. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a flowchart of a method for identifying concrete cracks based on a YOLOv3 deep learning model according to an example of the present invention; FIG. 2 is an implementation flowchart of a method for identifying concrete cracks based on a YOLOv3 deep learning model according to an example of the present invention; FIG. 3 is a schematic diagram of a variation curve between an average IoU and the number of candidate bounding boxes according to an example of the present invention, where when the number of the candidate bounding boxes increases, the average IoU increases, but the growth speed gradually decreases; FIG. 4 is a schematic diagram of candidate bounding box positions in an example of the present invention; FIG. 5 is a schematic diagram of predicted bounding boxes of a YOLOv3 model in 13x13 cells according to an example of the present invention; FIG. 6 is a schematic diagram of a learning rate change curve according to an example of the present invention; FIG. 7 is a schematic diagram of a PR change curve according to an example of the present invention; FIG. 8 is a diagram of a comparison between detection speeds of the present invention and other models according to an example of the present invention; FIG. 9 is a diagram of a comparison between detection effects of the present invention and other models according to an example of the present invention; FIG. 10 is a schematic diagram of a span size ofJiangling Bridge in Wujiang District, Suzhou City, provided by an example of the present invention; FIG. 11 shows an image detection result of structural cracks ofJiangling Bridge according to an example of the present invention; FIG. 12 is a schematic diagram of the acquisition of images by an unmanned aerial vehicle in an example of the present invention; FIG. 13 shows an image detection result of non-structural cracks ofJiangling Bridge according to an example of the present invention; and FIG. 14 is a principle flowchart of a method for identifying concrete cracks based on a YOLOv3 deep learning model according to an example of the present invention. DETAILED DESCRIPTION In order to make the objectives, technical solutions and advantages of the present invention clearer and more comprehensible, the present invention is further described in detail below with reference to the examples. It should be understood that the specific examples described herein are merely illustrative of the present invention and are not intended to limit the present invention. In view of the problems that at present, a commonly used approximately exhaustive type deep learning method needs a large amount of data, lacks pertinence and has a high computing cost and low detection efficiency, the present invention provides a crack detection technology with strong robustness, good generalization capability and higher detection efficiency and accuracy rate, which has originality and is more suitable for the engineering field. The application principle of the present invention is described in detail below with reference to the accompanying drawings. As shown in FIG. 1, a method for identifying concrete cracks based on a YOLOv3 deep learning model according to an example of the present invention includes the following steps. S101: Obtain crack target images with a crack width of about 0.05 mm or more; cut the images into a uniform size, and manually add rectangular labels to targets in the images as ground truth bounding boxes to form a database. S102: Import the target images into the YOLOv3 model, and automatically compress the images to a 416x416 pixel resolution, divide the original images into SxS grids according to a feature map by up-sampling and feature fusion methods similar to FPN. S103: Determine the number and widths and heights of anchors, learn features from data of crack target annotation boxes to find statistical rules, then use a K-means clustering algorithm for clustering analysis of the target boxes, and finally take a K value as the number of the anchors; take an IoU (represented by Riou) of a candidate bounding box and a ground truth bounding box as an evaluation standard, and subject all crack target annotation boxes in an image training set to K-means clustering analysis to obtain the size of the candidate bounding box. S104: Use three anchor boxes, i.e., prior boxes, for each grid to predict a target boundary, where bounding box information is an offset (t, ty) of a center position of an object relative to an upper left comer of the grid where the point is located, and a width t, and a height th; if a target center has an offset (c, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box has a width p, and a height ph; S105: Predict classes of the targets, and predict, by the YOLOv3 model, a probability that each bounding box contains targets through logistic regression, where if the predicted bounding box overlaps with the ground truth bounding box in a large area and has a higher coincidence rate than other predicted bounding boxes, the probability is 1; if the coincidence rate does not reach 0.5 of a YOLOv3 threshold or is between the threshold and the maximum, the predicted bounding box will be ignored and will not affect a loss function. S106: Take the predicted results: a high-dimensional feature vector, a target ground truth bounding box and a class label as inputs, set a learning rate, a learning rate decay rate, a network momentum parameter, a weight decay regular term, a batch size, batch size divisions, the threshold and other parameters, and train a regression model for fine regression of the target bounding box and the class. The application principle of the present invention is further described below with reference to the accompanying drawings. As shown in FIG. 2, a method for identifying concrete cracks based on a YOLOv3 deep learning model according to an example of the present invention includes the following steps. (1) A database was obtained. Based on human eye accuracy, crack target images with a crack width of about 0.05 mm or more were obtained. In order to ensure better robustness and stability of the trained model, the development directions and definitions of targets were different. The structural background surfaces on which the targets were located were also disturbed by stains, template traces or water stains, etc. In this example, 242 images were obtained, and the original images were uniformly cut into smaller images with a resolution of 1000x1000 pixels; the non-concrete background parts were removed, and cracks in the images were manually annotated by LabellImg and used as a total database, totaling 3821 images. A training set, a verification set and a test set were randomly generated in the database.
(2) The original images were segmented. The crack images were imported into YOLOv3 and automatically compressed to a 416x416 pixel resolution. The original images were each divided into SxS grids according to the sizes of a feature map (13x13, 26x26, 52x52) by up-sampling and feature fusion methods similar to FPN. (3) The number and widths and heights of anchors were determined. Crack ground truth bounding boxes were subjected to clustering analysis by using a K-means algorithm. The number of anchors and the width-height dimension of the YOLOv3 model were obtained by clustering VOC20 data sets, there was a big difference between the target shapes in the data sets, and there was a greater difference from concrete crack targets. Therefore, it is necessary to perform clustering analysis on the crack ground truth bounding boxes to re-determine the number and widths and heights of anchors. An IoU (represented by Riou) of a candidate bounding box and a ground truth bounding box was taken as an evaluation standard, and K-means clustering analysis was performed on all crack target annotation boxes in an image training set to obtain the size of the candidate bounding box. A distance function of K-means clustering is: d(B,C)=1-Riou (B,C); where B is the size of a rectangular box, C is the center of the rectangular box, and Riou (B,C) represents an IoU of a candidate bounding box and a ground truth bounding box. A variation curve between an average IoU and the number of candidate bounding boxes is shown in FIG. 3. It can be seen that as the number of candidate bounding boxes increases, the average IoU increases more and more slowly. In this example, after the relationship between the average IoU and the number of candidate bounding boxes was balanced, nine candidate bounding boxes were taken, namely (33,46), (122,43), (50,148), (73,362), (144,155), (350,74), (153,381), (364,75), (322,365). Every three anchor corresponded to three scales, as shown in FIG. 4, where small dots were annotation boxes of crack data sets, large dots represented clustering candidate bounding boxes of crack data sets, and triangular dots were candidate bounding boxes of VOC20 data sets of original YOLOv3. (4) Bounding boxes were predicted. For each grid, three anchor boxes, i.e. prior boxes, were used to predict the target boundary. A prediction example is shown in FIG. 5. The boundary boxes were predicted in the 13x13 cells, where gray boxes were prior boxes obtained by clustering, white boxes are ground truth bounding boxes, and dark gray boxes were grids where center points of objects were located. Bounding box information was an offset (t, t,) of a center position of an object relative to an upper left corner of the grid where the point was located, and a width tw and a height th. If a target center had an offset (c, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box had a width p, and a height ph, then the corrected bounding boxes were: bx=a-(tx)+cx b,=oa(ty)+cy bw=pwe'" bh=pheth (5) The classes of the targets were predicted, and the feature size obtained by each prediction task was: Sx Sx [3 x (4+1+B)]; where S is the grid size, 3 is the number of prior boxes of each grid, 4 is the bounding box size and coordinates, 1 is the confidence level, and B is the number of classes. The YOLOv3 model predicted a probability that each bounding box contains targets through logistic regression. If the predicted bounding box overlapped with the ground truth bounding box in a large area and had a higher coincidence rate than other predicted bounding boxes, the probability was 1; if the coincidence rate did not reach 0.5 of a YOLOv3 threshold or was greater than the threshold and was not the maximum, the predicted bounding box would be ignored and would not affect a loss function. In the training process, the YOLOv3 model assigned only one prediction box to each object. (6) A model was trained. The predicted results: a high-dimensional feature vector, a target ground truth bounding box and a class label were taken as inputs. A learning rate was set to 0.001; a learning rate decay rate was 10 times when iterations reached 40000 times, and was 100 times when iterations reached 45000 times, and a change curve is shown in FIG. 6; a network momentum parameter was 0.9; a weight decay regular term was 0.005; a batch size was 64, there were 16 batch size divisions; the threshold was 0.5, and there were 50200 iterations, and a regression model for fine regression of the target bounding box and the class was trained. After the training was completed, the identification ability of the YOLOv3 model was verified with the samples of the test set, the AP value reached 89.4, and a PR curve is shown in FIG. 7. By a comparison with other three representative object detection models Faster-rcnn, SSD, CNN+SD, the present invention has obvious advantages in detection speed and detection effect. A detection speed comparison diagram is shown in FIG. 8 and a detection effect comparison diagram is shown in FIG. 9. In view of the problem of the example, the present invention has more prominent detection speed and detection effect, and the detection speed can meet the requirement for real-time detection, which proves the advantage of the present invention in the field of concrete structure damage detection. The method was applied to crack detection and identification ofJiangling Bridge in Wujiang District, Suzhou City. The bridge is a three-span prestressed concrete rigid frame bridge with a continuous box girder, and has a span of 50 m+86 m+50 m = 186 m, as shown in FIG. 10. Cracks appeared after bridge operation for 15 years. Crack images of a main span baseplate above the canal were acquired by an unmanned aerial vehicle and identified. The results show that the concrete crack detection model based on a YOLOv3 deep learning model can quickly and accurately identify multiple targets such as structural cracks and non-structural cracks. The identification speed is much faster than those of other models, and even meets the requirements of real-time detection of concrete crack targets. The object detection model has much better concrete crack identification accuracy than other models, and has stronger robustness and generalization capability. The above are only the preferred examples of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements and the like made within the spirit and principles of the present invention should fall within the protection scope of the present invention.

Claims (5)

  1. What is claimed is: 1. A method for identifying concrete cracks based on a YOLOv3 deep learning model, wherein the method takes a Darknet-53 network in the YOLOv3 model as a feature extractor and treats object detection as a regression problem, and target area positioning and target class prediction are directly performed based on a single end-to-end neural network model; crack images are imported into the YOLOv3 model and automatically compressed to a 416x416 pixel resolution; the original images are each divided into SxS grids according to the scale of a feature map by up-sampling and feature fusion methods similar to FPN; an Intersection over Union (IoU) of a candidate bounding box and a ground truth bounding box is taken as an evaluation standard, and all crack target annotation boxes in an image training set are subjected to K-means clustering analysis to obtain the size of the candidate bounding box; and the YOLOv3 model predicts a probability that each bounding box contains targets through logistic regression.
  2. 2. The method for identifying concrete cracks based on a YOLOv3 deep learning model according to claim 1, specifically comprising: step 1: obtaining crack target images with a crack width of about 0.05 mm or more; cutting the images into a uniform size, and manually adding rectangular labels to targets in the images as ground truth bounding boxes to form a database; step 2: importing the target images into the YOLOv3 model, and automatically compressing the images to a 416x416 pixel resolution; dividing the original images into SxS grids according to a feature map by up-sampling and feature fusion methods similar to FPN; step 3: determining the number and widths and heights of anchors, learning features from data of crack target annotation boxes to find statistical rules, then using a K-means clustering algorithm for clustering analysis of the target boxes, and taking a K value as the number of the anchors; taking an IoU of a candidate bounding box and a ground truth bounding box as an evaluation standard, and subjecting all crack target annotation boxes in an image training set to K-means clustering analysis to obtain the size of the candidate bounding box; step 4: using three anchor boxes, i.e., prior boxes, for each grid to predict a target boundary, wherein bounding box information is an offset (t, ty) of a center position of an object relative to an upper left corner of the grid where the point is located, and a width t, and a height th; if a targetcenter has an offset (c, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box has a width p, and a height ph; step 5: predicting classes of the targets, and predicting, by the YOLOv3 model, a probability that each bounding box contains targets through logistic regression, wherein if the predicted bounding box overlaps with the ground truth bounding box in a large area and has a higher coincidence rate than other predicted bounding boxes, the probability is 1; if the coincidence rate does not reach 0.5 of a YOLOv3 threshold or is between the threshold and the maximum, the predicted bounding box will be ignored and will not affect a loss function; and step 6: taking the predicted results: a high-dimensional feature vector, a target ground truth bounding box and a class label as inputs, setting a learning rate, a learning rate decay rate, a network momentum parameter, a weight decay regular term, a batch size, batch size divisions and the threshold, and training a regression model for fine regression of the target bounding box and the class.
  3. 3. The method for identifying concrete cracks based on a YOLOv3 deep learning model according to claim 2, wherein a distance function of K-means clustering in step 3 is: d(B,C)=1-Rou (B,C) wherein B is the size of a rectangular box, C is the center of the rectangular box, and Rou (B,C) represents an IoU of a candidate bounding box and a ground truth bounding box.
  4. 4. The method for identifying concrete cracks based on a YOLOv3 deep learning model according to claim 2, wherein the bounding box information is an offset (tx, ty) of a center position of a target relative to an upper left corner of the grid where the point is located, and a width t" and a height th; and if a target center has an offset (cx, cy) in a cell relative to an upper left corner of the image, and the candidate bounding box has a width p, and a heightph, then the corrected bounding boxes are: b= otx)+cx b,= a(ty)+cy bw=pwe'" bh-pheth wherein in step 5, the classes of the targets are predicted, and the feature size obtained by each prediction task is: Sx Sx [3 x (4+1+B)]; wherein S is the grid size, 3 is the number of prior boxes of each grid, 4 is the bounding box size and coordinates, 1 is the confidence level, and B is the number of classes.
  5. 5. A concrete structure damage detection and control system applying the method for identifying concrete cracks based on a YOLOv3 deep learning model according to any one of claims 1 to 4.
AU2020101011A 2019-06-26 2020-06-15 Method for identifying concrete cracks based on yolov3 deep learning model Ceased AU2020101011A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910558541.9 2019-06-26
CN201910558541.9A CN110175658A (en) 2019-06-26 2019-06-26 A kind of distress in concrete recognition methods based on YOLOv3 deep learning

Publications (1)

Publication Number Publication Date
AU2020101011A4 true AU2020101011A4 (en) 2020-07-23

Family

ID=67698976

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2020101011A Ceased AU2020101011A4 (en) 2019-06-26 2020-06-15 Method for identifying concrete cracks based on yolov3 deep learning model

Country Status (2)

Country Link
CN (1) CN110175658A (en)
AU (1) AU2020101011A4 (en)

Cited By (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112052853A (en) * 2020-09-09 2020-12-08 国家气象信息中心 Text positioning method of handwritten meteorological archive data based on deep learning
CN112132064A (en) * 2020-09-25 2020-12-25 新希望六和股份有限公司 Method, device, equipment and medium for identifying number of pregnant sacs based on artificial intelligence
CN112184687A (en) * 2020-10-10 2021-01-05 南京信息工程大学 Road crack detection method based on capsule characteristic pyramid and storage medium
CN112183485A (en) * 2020-11-02 2021-01-05 北京信息科技大学 Deep learning-based traffic cone detection positioning method and system and storage medium
CN112215208A (en) * 2020-11-10 2021-01-12 中国人民解放军战略支援部队信息工程大学 Remote sensing image bridge target detection algorithm based on improved YOLOv4
CN112229585A (en) * 2020-09-18 2021-01-15 长沙理工大学 Crack damage positioning method and system based on artificial intelligence and acoustic emission technology
CN112362756A (en) * 2020-11-24 2021-02-12 长沙理工大学 Concrete structure damage monitoring method and system based on deep learning
CN112508168A (en) * 2020-09-25 2021-03-16 上海海事大学 Frame regression neural network construction method based on automatic correction of prediction frame
CN112613343A (en) * 2020-12-01 2021-04-06 浙江大学 Improved YOLOv 4-based river waste monitoring method
CN112634195A (en) * 2020-11-23 2021-04-09 清华大学 Concrete structure crack prediction method, device and system
CN112634205A (en) * 2020-12-04 2021-04-09 江苏鼎集智能科技股份有限公司 Micro-feature detection algorithm based on image
CN112785574A (en) * 2021-01-25 2021-05-11 金陵科技学院 Scarf pattern defect detection method based on improved YOLOv3
CN112949634A (en) * 2021-03-08 2021-06-11 北京交通大学 Bird nest detection method for railway contact network
CN113177499A (en) * 2021-05-11 2021-07-27 上海道生医疗科技有限公司 Tongue crack shape identification method and system based on computer vision
CN113192045A (en) * 2021-05-13 2021-07-30 西安数合信息科技有限公司 Defect size analysis method for weld image
CN113392852A (en) * 2021-04-30 2021-09-14 浙江万里学院 Vehicle detection method and system based on deep learning
CN113408584A (en) * 2021-05-19 2021-09-17 成都理工大学 RGB-D multi-modal feature fusion 3D target detection method
CN113496480A (en) * 2021-05-13 2021-10-12 西安数合信息科技有限公司 Method for detecting weld image defects
CN113591270A (en) * 2021-06-29 2021-11-02 北京交通大学 Monitoring method for analyzing and comparing performance on steel rail weld joint data set based on MDCD (modified discrete cosine transform)
CN113610054A (en) * 2021-08-27 2021-11-05 广州慧瞳科技有限公司 Underwater structure disease depth detection method, system and device and storage medium
CN113609895A (en) * 2021-06-22 2021-11-05 上海中安电子信息科技有限公司 Road traffic information acquisition method based on improved Yolov3
CN113610178A (en) * 2021-08-17 2021-11-05 湖南工学院 Inland ship target detection method and device based on video monitoring image
CN113674213A (en) * 2021-07-26 2021-11-19 南京航空航天大学 Subway tunnel crack identification method based on rotating target detection technology
CN113808080A (en) * 2021-08-12 2021-12-17 常州大学 Method for detecting number of interference fringes of glass panel of mobile phone camera hole
CN113822148A (en) * 2021-08-05 2021-12-21 同济大学 Convolution neural network-based track tiny remnant intelligent identification method
CN113888525A (en) * 2021-10-20 2022-01-04 中国矿业大学 Swirler blockage and early warning detection method based on camera data
CN114298145A (en) * 2021-11-22 2022-04-08 三峡大学 Permeable concrete pore intelligent identification and segmentation method based on deep learning
CN114581764A (en) * 2021-12-24 2022-06-03 中交基础设施养护集团有限公司 Underground structure crack disease distinguishing method based on deep learning algorithm
CN114913438A (en) * 2022-03-28 2022-08-16 南京邮电大学 Yolov5 garden abnormal target identification method based on anchor frame optimal clustering
CN115063679A (en) * 2022-06-15 2022-09-16 电子科技大学 Pavement quality assessment method based on deep learning
CN115100175A (en) * 2022-07-12 2022-09-23 南京云创大数据科技股份有限公司 Rail transit detection method based on small sample target detection
CN115184372A (en) * 2022-07-13 2022-10-14 水利部交通运输部国家能源局南京水利科学研究院 Intelligent detection device and method for micro-crack fluorescence permeation of inaccessible part of concrete structure
CN115393725A (en) * 2022-10-26 2022-11-25 西南科技大学 Bridge crack identification method based on feature enhancement and semantic segmentation
CN115691026A (en) * 2022-12-29 2023-02-03 湖北省林业科学研究院 Intelligent early warning monitoring management method for forest fire prevention
US20230060459A1 (en) * 2021-09-01 2023-03-02 FootPrintKu Inc. Image object classification optimizing method, system and computer readable medium
CN115953672A (en) * 2023-03-13 2023-04-11 南昌工程学院 Method for identifying surface cracks of underwater dam
CN116385434A (en) * 2023-06-02 2023-07-04 同济检测(济宁)有限公司 Intelligent detection method for precast beam cracks
CN116912238A (en) * 2023-09-11 2023-10-20 湖北工业大学 Weld joint pipeline identification method and system based on multidimensional identification network cascade fusion
CN117522195A (en) * 2023-11-06 2024-02-06 北京住总集团有限责任公司 Residential quality detection and assessment system and method
CN117809310A (en) * 2024-03-03 2024-04-02 宁波港信息通信有限公司 Port container number identification method and system based on machine learning
CN117893872A (en) * 2024-03-18 2024-04-16 成都理工大学 Plane fracture optical detection method based on multi-model fusion detection
CN118154993A (en) * 2024-05-09 2024-06-07 南昌工程学院 Bimodal underwater dam crack detection method based on acousto-optic image fusion
CN115100175B (en) * 2022-07-12 2024-07-09 南京云创大数据科技股份有限公司 Rail transit detection method based on small sample target detection

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110503098A (en) * 2019-08-29 2019-11-26 西安电子科技大学 A kind of object detection method and equipment of quick real-time lightweight
CN110826555B (en) * 2019-10-12 2021-05-04 天津大学 Man-machine cooperative image target detection data semi-automatic labeling method
CN110992307A (en) * 2019-11-04 2020-04-10 华北电力大学(保定) Insulator positioning and identifying method and device based on YOLO
CN110826636A (en) * 2019-11-12 2020-02-21 吉林省民航机场集团公司 Aircraft anomaly detection system and anomaly detection method thereof
CN111210408A (en) * 2019-12-30 2020-05-29 南京航空航天大学 Ray image-based composite material defect identification method
CN111241343A (en) * 2020-01-07 2020-06-05 西安电子科技大学 Road information monitoring and analyzing detection method and intelligent traffic control system
CN111222474B (en) * 2020-01-09 2022-11-04 电子科技大学 Method for detecting small target of high-resolution image with any scale
CN111325738B (en) * 2020-02-28 2023-06-23 湖北工业大学 Intelligent detection method and system for transverse hole peripheral cracks
CN111553949B (en) * 2020-04-30 2023-05-19 张辉 Positioning and grabbing method for irregular workpiece based on single-frame RGB-D image deep learning
CN111861982B (en) * 2020-06-07 2024-03-12 中国葛洲坝集团第一工程有限公司 Visual image monitoring and identifying system
CN111815573B (en) * 2020-06-17 2021-11-02 科大智能物联技术股份有限公司 Coupling outer wall detection method and system based on deep learning
CN112215824A (en) * 2020-10-16 2021-01-12 南通大学 YOLO-v 3-based cloth cover defect detection and auxiliary device and method
CN112419244B (en) * 2020-11-11 2022-11-01 浙江大学 Concrete crack segmentation method and device
CN112508030A (en) * 2020-12-18 2021-03-16 山西省信息产业技术研究院有限公司 Tunnel crack detection and measurement method based on double-depth learning model
CN112712076A (en) * 2020-12-29 2021-04-27 中信重工开诚智能装备有限公司 Visual positioning device and method based on label-free positioning
CN112767357A (en) * 2021-01-20 2021-05-07 沈阳建筑大学 Yolov 4-based concrete structure disease detection method
CA3150478A1 (en) * 2021-03-01 2022-09-01 Ecole De Technologie Superieure Ultrasonic testing for defect detection
CN113033390B (en) * 2021-03-23 2022-12-13 中国科学院空天信息创新研究院 Dam remote sensing intelligent detection method based on deep learning
CN112926584B (en) * 2021-05-11 2021-08-06 武汉珈鹰智能科技有限公司 Crack detection method and device, computer equipment and storage medium
CN113689380B (en) * 2021-07-20 2023-05-16 中国铁路设计集团有限公司 Deep learning-based intelligent recognition method for rust damage of truss bridge rivet
CN113838078B (en) * 2021-09-06 2023-06-30 中国矿业大学(北京) Method and device for identifying and extracting coal mining subsidence ground cracks and storage medium
CN113917562B (en) * 2021-09-27 2023-02-28 中国科学院武汉岩土力学研究所 Macro-microscopic structure representation and three-dimensional space construction method and device for deep-buried soft interlayer
CN113863400B (en) * 2021-12-02 2022-02-15 中建安装集团有限公司 Cement-soil composite pile deformation detection system and detection method
CN115908411B (en) * 2023-01-06 2023-05-30 山东水利建设集团有限公司 Concrete curing quality analysis method based on visual detection
CN117011295B (en) * 2023-10-07 2024-01-23 西南科技大学 UHPC prefabricated member quality detection method based on depth separable convolutional neural network

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109064461A (en) * 2018-08-06 2018-12-21 长沙理工大学 A kind of detection method of surface flaw of steel rail based on deep learning network
CN109767423B (en) * 2018-12-11 2019-12-10 西南交通大学 Crack detection method for asphalt pavement image
CN109671064A (en) * 2018-12-14 2019-04-23 大连理工大学 A kind of multi-target detection method of industrial part face crack

Cited By (67)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112052853B (en) * 2020-09-09 2024-02-02 国家气象信息中心 Text positioning method of handwriting meteorological archive data based on deep learning
CN112052853A (en) * 2020-09-09 2020-12-08 国家气象信息中心 Text positioning method of handwritten meteorological archive data based on deep learning
CN112229585B (en) * 2020-09-18 2022-07-08 长沙理工大学 Crack damage positioning method and system based on artificial intelligence and acoustic emission technology
CN112229585A (en) * 2020-09-18 2021-01-15 长沙理工大学 Crack damage positioning method and system based on artificial intelligence and acoustic emission technology
CN112132064A (en) * 2020-09-25 2020-12-25 新希望六和股份有限公司 Method, device, equipment and medium for identifying number of pregnant sacs based on artificial intelligence
CN112508168B (en) * 2020-09-25 2023-09-22 上海海事大学 Frame regression neural network construction method based on automatic correction of prediction frame
CN112508168A (en) * 2020-09-25 2021-03-16 上海海事大学 Frame regression neural network construction method based on automatic correction of prediction frame
CN112184687A (en) * 2020-10-10 2021-01-05 南京信息工程大学 Road crack detection method based on capsule characteristic pyramid and storage medium
CN112184687B (en) * 2020-10-10 2023-09-26 南京信息工程大学 Road crack detection method based on capsule feature pyramid and storage medium
CN112183485A (en) * 2020-11-02 2021-01-05 北京信息科技大学 Deep learning-based traffic cone detection positioning method and system and storage medium
CN112183485B (en) * 2020-11-02 2024-03-05 北京信息科技大学 Deep learning-based traffic cone detection positioning method, system and storage medium
CN112215208A (en) * 2020-11-10 2021-01-12 中国人民解放军战略支援部队信息工程大学 Remote sensing image bridge target detection algorithm based on improved YOLOv4
CN112634195A (en) * 2020-11-23 2021-04-09 清华大学 Concrete structure crack prediction method, device and system
CN112362756B (en) * 2020-11-24 2024-02-20 长沙理工大学 Concrete structure damage monitoring method and system based on deep learning
CN112362756A (en) * 2020-11-24 2021-02-12 长沙理工大学 Concrete structure damage monitoring method and system based on deep learning
CN112613343B (en) * 2020-12-01 2023-12-15 浙江大学 River waste monitoring method based on improved YOLOv4
CN112613343A (en) * 2020-12-01 2021-04-06 浙江大学 Improved YOLOv 4-based river waste monitoring method
CN112634205A (en) * 2020-12-04 2021-04-09 江苏鼎集智能科技股份有限公司 Micro-feature detection algorithm based on image
CN112785574A (en) * 2021-01-25 2021-05-11 金陵科技学院 Scarf pattern defect detection method based on improved YOLOv3
CN112785574B (en) * 2021-01-25 2023-06-06 金陵科技学院 Scarf pattern defect detection method based on improved YOLOv3
CN112949634B (en) * 2021-03-08 2024-04-26 北京交通大学 Railway contact net nest detection method
CN112949634A (en) * 2021-03-08 2021-06-11 北京交通大学 Bird nest detection method for railway contact network
CN113392852A (en) * 2021-04-30 2021-09-14 浙江万里学院 Vehicle detection method and system based on deep learning
CN113392852B (en) * 2021-04-30 2024-02-13 浙江万里学院 Vehicle detection method and system based on deep learning
CN113177499A (en) * 2021-05-11 2021-07-27 上海道生医疗科技有限公司 Tongue crack shape identification method and system based on computer vision
CN113496480A (en) * 2021-05-13 2021-10-12 西安数合信息科技有限公司 Method for detecting weld image defects
CN113192045A (en) * 2021-05-13 2021-07-30 西安数合信息科技有限公司 Defect size analysis method for weld image
CN113408584A (en) * 2021-05-19 2021-09-17 成都理工大学 RGB-D multi-modal feature fusion 3D target detection method
CN113408584B (en) * 2021-05-19 2022-07-26 成都理工大学 RGB-D multi-modal feature fusion 3D target detection method
CN113609895A (en) * 2021-06-22 2021-11-05 上海中安电子信息科技有限公司 Road traffic information acquisition method based on improved Yolov3
CN113591270A (en) * 2021-06-29 2021-11-02 北京交通大学 Monitoring method for analyzing and comparing performance on steel rail weld joint data set based on MDCD (modified discrete cosine transform)
CN113591270B (en) * 2021-06-29 2024-01-19 北京交通大学 MDCD-based monitoring method for performance analysis and comparison on steel rail weld data set
CN113674213B (en) * 2021-07-26 2024-04-09 南京航空航天大学 Subway tunnel crack identification method based on rotating target detection technology
CN113674213A (en) * 2021-07-26 2021-11-19 南京航空航天大学 Subway tunnel crack identification method based on rotating target detection technology
CN113822148B (en) * 2021-08-05 2024-04-12 同济大学 Intelligent identification method for trace tiny carryover based on convolutional neural network
CN113822148A (en) * 2021-08-05 2021-12-21 同济大学 Convolution neural network-based track tiny remnant intelligent identification method
CN113808080A (en) * 2021-08-12 2021-12-17 常州大学 Method for detecting number of interference fringes of glass panel of mobile phone camera hole
CN113808080B (en) * 2021-08-12 2023-10-24 常州大学 Method for detecting number of interference fringes of glass panel of camera hole of mobile phone
CN113610178A (en) * 2021-08-17 2021-11-05 湖南工学院 Inland ship target detection method and device based on video monitoring image
CN113610054A (en) * 2021-08-27 2021-11-05 广州慧瞳科技有限公司 Underwater structure disease depth detection method, system and device and storage medium
US20230060459A1 (en) * 2021-09-01 2023-03-02 FootPrintKu Inc. Image object classification optimizing method, system and computer readable medium
CN113888525A (en) * 2021-10-20 2022-01-04 中国矿业大学 Swirler blockage and early warning detection method based on camera data
CN114298145A (en) * 2021-11-22 2022-04-08 三峡大学 Permeable concrete pore intelligent identification and segmentation method based on deep learning
CN114298145B (en) * 2021-11-22 2024-07-09 三峡大学 Deep learning-based permeable concrete pore intelligent recognition and segmentation method
CN114581764A (en) * 2021-12-24 2022-06-03 中交基础设施养护集团有限公司 Underground structure crack disease distinguishing method based on deep learning algorithm
CN114581764B (en) * 2021-12-24 2024-04-26 中交基础设施养护集团有限公司 Underground structure crack disease discriminating method based on deep learning algorithm
CN114913438A (en) * 2022-03-28 2022-08-16 南京邮电大学 Yolov5 garden abnormal target identification method based on anchor frame optimal clustering
CN115063679A (en) * 2022-06-15 2022-09-16 电子科技大学 Pavement quality assessment method based on deep learning
CN115063679B (en) * 2022-06-15 2024-04-26 电子科技大学 Pavement quality assessment method based on deep learning
CN115100175B (en) * 2022-07-12 2024-07-09 南京云创大数据科技股份有限公司 Rail transit detection method based on small sample target detection
CN115100175A (en) * 2022-07-12 2022-09-23 南京云创大数据科技股份有限公司 Rail transit detection method based on small sample target detection
CN115184372A (en) * 2022-07-13 2022-10-14 水利部交通运输部国家能源局南京水利科学研究院 Intelligent detection device and method for micro-crack fluorescence permeation of inaccessible part of concrete structure
CN115393725A (en) * 2022-10-26 2022-11-25 西南科技大学 Bridge crack identification method based on feature enhancement and semantic segmentation
CN115691026B (en) * 2022-12-29 2023-05-05 湖北省林业科学研究院 Intelligent early warning monitoring management method for forest fire prevention
CN115691026A (en) * 2022-12-29 2023-02-03 湖北省林业科学研究院 Intelligent early warning monitoring management method for forest fire prevention
CN115953672B (en) * 2023-03-13 2024-02-27 南昌工程学院 Method for identifying surface cracks of underwater dam
CN115953672A (en) * 2023-03-13 2023-04-11 南昌工程学院 Method for identifying surface cracks of underwater dam
CN116385434A (en) * 2023-06-02 2023-07-04 同济检测(济宁)有限公司 Intelligent detection method for precast beam cracks
CN116385434B (en) * 2023-06-02 2023-08-08 同济检测(济宁)有限公司 Intelligent detection method for precast beam cracks
CN116912238A (en) * 2023-09-11 2023-10-20 湖北工业大学 Weld joint pipeline identification method and system based on multidimensional identification network cascade fusion
CN116912238B (en) * 2023-09-11 2023-11-28 湖北工业大学 Weld joint pipeline identification method and system based on multidimensional identification network cascade fusion
CN117522195A (en) * 2023-11-06 2024-02-06 北京住总集团有限责任公司 Residential quality detection and assessment system and method
CN117809310B (en) * 2024-03-03 2024-04-30 宁波港信息通信有限公司 Port container number identification method and system based on machine learning
CN117809310A (en) * 2024-03-03 2024-04-02 宁波港信息通信有限公司 Port container number identification method and system based on machine learning
CN117893872B (en) * 2024-03-18 2024-05-14 成都理工大学 Plane fracture optical detection method based on multi-model fusion detection
CN117893872A (en) * 2024-03-18 2024-04-16 成都理工大学 Plane fracture optical detection method based on multi-model fusion detection
CN118154993A (en) * 2024-05-09 2024-06-07 南昌工程学院 Bimodal underwater dam crack detection method based on acousto-optic image fusion

Also Published As

Publication number Publication date
CN110175658A (en) 2019-08-27

Similar Documents

Publication Publication Date Title
AU2020101011A4 (en) Method for identifying concrete cracks based on yolov3 deep learning model
Wei et al. Instance-level recognition and quantification for concrete surface bughole based on deep learning
Peng et al. A UAV-based machine vision method for bridge crack recognition and width quantification through hybrid feature learning
Koch et al. A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure
WO2019134252A1 (en) Method and device for automated portrayal and accurate measurement of width of structural crack
CN110246130B (en) Airport pavement crack detection method based on infrared and visible light image data fusion
CN111784657A (en) Digital image-based system and method for automatically identifying cement pavement diseases
Chen et al. Convolutional neural networks (CNNs)-based multi-category damage detection and recognition of high-speed rail (HSR) reinforced concrete (RC) bridges using test images
CN114705689A (en) Unmanned aerial vehicle-based method and system for detecting cracks of outer vertical face of building
CN109035232A (en) A kind of intermediate plate defect inspection method merged based on deep learning and machine vision
CN109993742B (en) Bridge crack rapid identification method based on diagonal derivative operator
Guldur et al. Condition assessment of bridges using terrestrial laser scanners
Song et al. Automatic segmentation and quantification of global cracks in concrete structures based on deep learning
Dong et al. Intelligent segmentation and measurement model for asphalt road cracks based on modified mask R-CNN algorithm
Guo et al. Monitoring and automatic characterization of cracks in strain-hardening cementitious composite (SHCC) through intelligent interpretation of photos
Mishra et al. Artificial intelligence-based visual inspection system for structural health monitoring of cultural heritage
Tayo et al. Portable crack width calculation of concrete road pavement using machine vision
CN115994901A (en) Automatic road disease detection method and system
Luo et al. Using deep learning-based defect detection and 3D quantitative assessment for steel deck pavement maintenance
Kargah-Ostadi et al. Evaluation framework for automated pavement distress identification and quantification applications
CN117610375A (en) Bridge suspension casting construction digital twin method, device and equipment based on machine vision
Yao et al. Chromatic aberration identification of fair-faced concrete research based on multi-scale lightweight structured data algorithm
Chen Migration Learning‐Based Bridge Structure Damage Detection Algorithm
Shin et al. Defect-detection model for underground parking lots using image object-detection method
Yao et al. Multi-volume variable scale bitmap data object classification algorithm architectural concrete color difference detection

Legal Events

Date Code Title Description
FGI Letters patent sealed or granted (innovation patent)
MK22 Patent ceased section 143a(d), or expired - non payment of renewal fee or expiry