CN115423995A - Lightweight curtain wall crack target detection method and system and safety early warning system - Google Patents
Lightweight curtain wall crack target detection method and system and safety early warning system Download PDFInfo
- Publication number
- CN115423995A CN115423995A CN202210959902.2A CN202210959902A CN115423995A CN 115423995 A CN115423995 A CN 115423995A CN 202210959902 A CN202210959902 A CN 202210959902A CN 115423995 A CN115423995 A CN 115423995A
- Authority
- CN
- China
- Prior art keywords
- crack
- target detection
- curtain wall
- network
- convolution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 157
- 238000000605 extraction Methods 0.000 claims abstract description 40
- 238000012549 training Methods 0.000 claims abstract description 28
- 238000012360 testing method Methods 0.000 claims abstract description 26
- 238000007781 pre-processing Methods 0.000 claims abstract description 16
- 230000007246 mechanism Effects 0.000 claims abstract description 14
- 238000010276 construction Methods 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 claims description 41
- 238000012545 processing Methods 0.000 claims description 12
- 230000006870 function Effects 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 8
- 230000004913 activation Effects 0.000 claims description 7
- 238000011176 pooling Methods 0.000 claims description 6
- 238000012795 verification Methods 0.000 claims description 6
- 238000004140 cleaning Methods 0.000 claims description 4
- 238000010606 normalization Methods 0.000 claims description 4
- 230000004927 fusion Effects 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 230000008447 perception Effects 0.000 claims 1
- 238000012163 sequencing technique Methods 0.000 claims 1
- 230000000007 visual effect Effects 0.000 claims 1
- 238000004364 calculation method Methods 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 13
- 238000004422 calculation algorithm Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 230000006872 improvement Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000011897 real-time detection Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Evolutionary Computation (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Biophysics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Databases & Information Systems (AREA)
- Medical Informatics (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
Description
技术领域technical field
本发明涉及计算机视觉技术领域,尤其涉及一种轻量化幕墙裂纹目标检测方法及系统、安全预警系统。The invention relates to the technical field of computer vision, in particular to a light-weight curtain wall crack target detection method and system, and a safety early warning system.
背景技术Background technique
目标检测是计算机视觉中一个具有挑战的领域,其成果已广泛应用到很多领域,在墙体裂纹检测或墙体伤害检测等方面已经有不少实际应用。墙体上裂纹的检测是一个一直存在的问题,这对于现在越来越高的大厦更加明显,这种高层建筑的裂纹对建筑本身具有很大的隐藏危害,同时也不再是肉眼易观察到的裂纹。但对于这种裂纹,本身是广泛存在的,使用传统方法进行检测无意有极大的限制和代价。Object detection is a challenging field in computer vision. Its results have been widely used in many fields, and there have been many practical applications in wall crack detection or wall damage detection. The detection of cracks on the wall is an ever-existing problem, which is more obvious for the taller and taller buildings. The cracks of this kind of high-rise buildings have great hidden dangers to the building itself, and are no longer easy to observe with the naked eye. cracks. But for this kind of crack, it is widespread, and there is no great limitation and cost in using traditional methods for detection.
YOLO系列算法经过了多年的更新迭代,一级目标类型的目标检测算法省略了对候选框的生成,相较于二级目标类型算法本身有着一定的检测速度上的优势。但同样由于算法的更新,YOLO系列目标检测算法越来越重视检测精度,从而使得网络模型越来越复杂,使得原版YOLO模型不再适合搭载在常见计算单元上。The YOLO series of algorithms have been updated and iterated for many years. The target detection algorithm of the first-level target type omits the generation of candidate frames. Compared with the second-level target type algorithm itself, it has a certain advantage in detection speed. But also due to the update of the algorithm, the YOLO series target detection algorithm pays more and more attention to the detection accuracy, which makes the network model more and more complex, making the original YOLO model no longer suitable for carrying on common computing units.
由此可知,现有技术中的方法存在检测精度不高的技术问题。It can be seen that the method in the prior art has the technical problem of low detection accuracy.
发明内容Contents of the invention
本发明提供了一种轻量化幕墙裂纹目标检测方法及系统、安全预警系统,用以解决或者至少部分解决现有技术中存在的检测精度不高的技术问题。The invention provides a lightweight curtain wall crack target detection method and system, and a safety early warning system, which are used to solve or at least partly solve the technical problem of low detection accuracy existing in the prior art.
为了解决上述技术问题,本发明第一方面提供了一种轻量化幕墙裂纹目标检测方法,包括:In order to solve the above technical problems, the first aspect of the present invention provides a lightweight curtain wall crack target detection method, including:
收集大量的墙体图像;Collect a large number of wall images;
对收集的墙体图像进行预处理;Preprocessing the collected wall images;
构建轻量化幕墙裂纹目标检测模型,模型采用改进的目标检测网络,改进的目标检测网络包括主干特征提取网络、加强特征提取网络和检测头,其中,主干特征提取网络使用Ghost卷积替换原有YOLOv5网络中的标准卷积,主干特征提取网络和加强特征网络将原有YOLOv5网络的C3结构中的卷积替换为Ghost卷积,并在主干特征提取网络通道数最大的位置增加一个CA注意力模块,用以关注与墙体裂纹相关的重要特征;Build a lightweight curtain wall crack target detection model. The model uses an improved target detection network. The improved target detection network includes a backbone feature extraction network, an enhanced feature extraction network, and a detection head. Among them, the backbone feature extraction network uses Ghost convolution to replace the original YOLOv5 The standard convolution in the network, the backbone feature extraction network and the enhanced feature network replace the convolution in the C3 structure of the original YOLOv5 network with Ghost convolution, and add a CA attention module at the position with the largest number of channels in the backbone feature extraction network , to focus on important features related to wall cracks;
对构建的轻量化幕墙裂纹目标检测模型进行训练与测试,得到训练好的轻量化幕墙裂纹目标检测模型;Train and test the constructed lightweight curtain wall crack target detection model to obtain a trained lightweight curtain wall crack target detection model;
利用训练好的轻量化幕墙裂纹目标检测模型对待检测图像进行裂纹检测。Use the trained lightweight curtain wall crack target detection model to detect cracks in the image to be detected.
在一种实施方式中,对收集的墙体图像进行预处理,包括:In one embodiment, the collected wall images are preprocessed, including:
对收集的墙体图像进行数据清洗和整理,将图像统一转化为PNG或JPG格式;Perform data cleaning and sorting on the collected wall images, and uniformly convert the images into PNG or JPG format;
根据图像在墙体上的物理位置进行编号和排序。The images are numbered and sorted according to their physical location on the wall.
在一种实施方式中,CA注意力模块的处理过程包括:In one embodiment, the processing of the CA attention module includes:
使用沿着两个垂直和水平两个方向的池化核进行平均池化,得到沿着水平坐标和垂直坐标的一对一维特征编码,这对特征编码为具有全局的感受野和方向感知的特征表示;Using the pooling kernel along the two vertical and horizontal directions for average pooling, a pair of one-dimensional feature encoding along the horizontal and vertical coordinates is obtained, which is encoded as a global receptive field and direction-aware feature representation;
将一对一维特征编码进行特征融合后进行卷积变换以及非线性激活函数的处理,然后再次将融合后的特征沿着空间方向变为两个单独的张量和,对两个张量和进行再次卷积;After performing feature fusion on a pair of one-dimensional feature codes, convolution transformation and nonlinear activation function processing are performed, and then the fused features are transformed into two separate tensor sums along the spatial direction, and the two tensor sums Convolve again;
将再次卷积得到的张量和使用sigmoid激活函数进行归一化处理,然后输出到主干特征提取网络中的下一模块,作为权重指导网络学习更重要的通道中的特征。The tensor obtained by re-convolution is normalized using the sigmoid activation function, and then output to the next module in the backbone feature extraction network as a weight to guide the network to learn features in more important channels.
在一种实施方式中,对构建的轻量化幕墙裂纹目标检测模型进行训练,包括:In one embodiment, the lightweight curtain wall crack target detection model of construction is trained, including:
将预处理后的墙体图像按照预设比例,划分为训练集、验证集和测试集;Divide the preprocessed wall image into a training set, a verification set and a test set according to a preset ratio;
将划分的训练集进行归一化处理为分辨率一致的图像;Normalize the divided training set into images with consistent resolution;
将归一化处理后的训练集图像输入到轻量化幕墙裂纹目标检测模型,由Ghost卷积生成额外特征,由CA注意力机制关注重要特征,并根据额外特征和CA注意力机制关注的重要特征得到输出的图像特征;Input the normalized training set images to the lightweight curtain wall crack target detection model, generate additional features by Ghost convolution, and focus on important features by CA attention mechanism, and focus on important features based on additional features and CA attention mechanism Get the output image features;
根据输出的图像特征对验证集进行回归预测与定位,验证训练和收敛情况,得出训练过程中图像中裂纹的检测结果、裂纹程度、召回率和目标检测精度;Perform regression prediction and positioning on the verification set according to the output image features, verify the training and convergence, and obtain the detection results, crack degree, recall rate and target detection accuracy of cracks in the image during the training process;
将训练好的轻量化幕墙裂纹目标检测模型在测试集上进行测试,对于测试过程中找出的具有裂纹的图像,根据墙体图像的编号得出裂缝的位置,并将最终目标检测精度大于阈值时的模型作为训练好的轻量化幕墙裂纹目标检测模型。Test the trained light-weight curtain wall crack target detection model on the test set. For the images with cracks found during the test, the position of the crack is obtained according to the number of the wall image, and the final target detection accuracy is greater than the threshold The time model is used as a trained lightweight curtain wall crack target detection model.
在一种实施方式中,利用训练好的轻量化幕墙裂纹目标检测模型对待检测图像进行裂纹检测,包括:In one embodiment, using the trained lightweight curtain wall crack target detection model to perform crack detection on the image to be detected, including:
将待检测图像进行预处理后输入训练好的轻量化幕墙裂纹目标检测模型,得到裂纹检测结果,其中,裂纹检测结果使用锚框可视化的标注裂纹;After preprocessing the image to be detected, input the trained lightweight curtain wall crack target detection model to obtain the crack detection result, wherein the crack detection result uses the anchor box to visually mark the crack;
根据裂纹程度区分裂纹等级和裂纹形状,并将裂纹等级和裂纹形状标注在锚框旁。The crack grade and crack shape are distinguished according to the crack degree, and the crack grade and crack shape are marked next to the anchor frame.
在一种实施方式中,所述方法还包括:根据裂纹等级进行报警。In one embodiment, the method further includes: giving an alarm according to the crack level.
基于同样的发明构思,本发明第二方面提供了一种轻量化幕墙裂纹目标检测系统,包括:Based on the same inventive concept, the second aspect of the present invention provides a lightweight curtain wall crack target detection system, including:
图像收集模块,用于收集大量的墙体图像;Image collection module, used to collect a large number of wall images;
预处理模块,用于对收集的墙体图像进行预处理;A preprocessing module is used to preprocess the collected wall images;
模型构建模块,用于构建轻量化幕墙裂纹目标检测模型,模型采用改进的目标检测网络,改进的目标检测网络包括主干特征提取网络、加强特征提取网络和检测头,其中,主干特征提取网络使用Ghost卷积替换原有YOLOv5网络中的标准卷积,主干特征提取网络和加强特征网络将原有YOLOv5网络的C3结构中的卷积替换为Ghost卷积,并在主干特征提取网络通道数最大的位置增加一个CA注意力模块,用以关注与墙体裂纹相关的重要特征;The model building module is used to build a lightweight curtain wall crack target detection model. The model uses an improved target detection network. The improved target detection network includes a backbone feature extraction network, an enhanced feature extraction network and a detection head. Among them, the backbone feature extraction network uses Ghost Convolution replaces the standard convolution in the original YOLOv5 network, the backbone feature extraction network and the enhanced feature network replace the convolution in the C3 structure of the original YOLOv5 network with Ghost convolution, and place the largest number of channels in the backbone feature extraction network Add a CA attention module to focus on important features related to wall cracks;
训练与测试模块,用于对构建的轻量化幕墙裂纹目标检测模型进行训练与测试,得到训练好的轻量化幕墙裂纹目标检测模型;The training and testing module is used to train and test the constructed lightweight curtain wall crack target detection model to obtain a trained lightweight curtain wall crack target detection model;
裂纹检测模块,用于利用训练好的轻量化幕墙裂纹目标检测模型对待检测图像进行裂纹检测。The crack detection module is used to use the trained lightweight curtain wall crack target detection model to detect cracks on the image to be detected.
基于同样的发明构思,本发明第三方面提供了一种安全警报系统,包括第二方面所述的轻量化幕墙裂纹目标检测系统和警报模块,警报模块用于根据裂纹等级进行报警。Based on the same inventive concept, the third aspect of the present invention provides a security alarm system, including the light-weight curtain wall crack target detection system described in the second aspect and an alarm module, the alarm module is used for alarming according to the crack level.
基于同样的发明构思,本发明第四方面提供了一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现第一方面所述的方法。Based on the same inventive concept, the fourth aspect of the present invention provides a computer device, including a memory, a processor, and a computer program stored in the memory and operable on the processor, when the processor executes the program, the first A method as described in one aspect.
相对于现有技术,本发明的优点和有益的技术效果如下:Compared with prior art, advantage of the present invention and beneficial technical effect are as follows:
本发明提供的一种轻量化幕墙裂纹目标检测方法,包括图像收集、图像预处理、模型构建、模型的训练与测试、裂纹检测步骤,构建的轻量化幕墙裂纹目标检测模型,对YOLOv5网络进行了改进,使用Ghost卷积替换原有网络中的标准卷积,将C3结构中卷积替换为Ghost卷积,则C3替换为GhostC3,从而可以减少计算量,提高计算效率;增加一个CA注意力机制在主干特征提取网络通道数最大的位置,使得网络更加关注有价值的特征,使得提升整个网络的目标检测精度。也就是说,本发明使用轻量化的目标检测模型,不需要大量的计算单元,可以实时的做到对墙体裂纹进行检测并找到裂纹所在位置,在保证效率的同时提高了检测精度。A lightweight curtain wall crack target detection method provided by the present invention includes image collection, image preprocessing, model construction, model training and testing, and crack detection steps, and the constructed lightweight curtain wall crack target detection model is implemented on the YOLOv5 network Improvement, use Ghost convolution to replace the standard convolution in the original network, replace the convolution in the C3 structure with Ghost convolution, then replace C3 with GhostC3, which can reduce the amount of calculation and improve calculation efficiency; add a CA attention mechanism In the position where the number of backbone feature extraction network channels is the largest, the network pays more attention to valuable features, which improves the target detection accuracy of the entire network. That is to say, the present invention uses a lightweight target detection model, does not require a large number of computing units, can detect wall cracks in real time and find the location of the cracks, and improves detection accuracy while ensuring efficiency.
进一步地,本发明还提供了安全警报系统,通过警报模块根据裂纹的等级进行不同级别的报警。Further, the present invention also provides a safety alarm system, through which the alarm module performs different levels of alarms according to the level of cracks.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are For some embodiments of the present invention, those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1为本发明实施例公开的一种轻量化幕墙裂纹目标检测方法的流程示意图;Fig. 1 is a schematic flow chart of a light-weight curtain wall crack target detection method disclosed in an embodiment of the present invention;
图2为本发明实施例中轻量化幕墙裂纹目标检测模型(GC-YOLOv5网络)的结构图和基本YOLOv5s网络结构图的对比图示意图;Fig. 2 is a schematic diagram of a structural diagram of a lightweight curtain wall crack target detection model (GC-YOLOv5 network) and a basic YOLOv5s network structural diagram in an embodiment of the present invention;
图3为本发明实施例中Ghost卷积工作方式示意图;FIG. 3 is a schematic diagram of the working mode of Ghost convolution in the embodiment of the present invention;
图4为本发明实施例中CA注意力机制结构图;Fig. 4 is the structural diagram of CA attention mechanism in the embodiment of the present invention;
图5为本发明实施例中利用轻量化幕墙裂纹目标检测模型实现安全报警的实施流程图。Fig. 5 is a flow chart of implementing a safety alarm by using a lightweight curtain wall crack target detection model in an embodiment of the present invention.
具体实施方式detailed description
本发明公开一种轻量化幕墙裂纹目标检测方法,包括图像收集、图像预处理、模型构建、模型的训练与测试、裂纹检测步骤。其中的图像收集步骤为通过无人机等工具拍摄墙体图片,图像预处理将获得图片编号并进行数据清洗和格式转换,模型构建步骤构建了轻量化幕墙裂纹目标检测模型,该模型可以方便地部署在无人机等设备上,并结合搭载在无人机等工具上的计算能力有限的计算单元(CPU和GPU等)实现目标的检测与分析,模型的训练与测试步骤对模型进行训练与测试,得到检测精度较高的模型,裂纹分类检测步骤是使用训练好的模型对待检墙体进行检测,并且根据裂纹的形状和等级进行分类并标出锚框。本方法是基于目标检测技术对墙体裂纹进行识别,本方法优势在于使用轻量化的目标检测模型,不需要大量的计算单元,可以实时的做到对墙体裂纹进行检测并找到裂纹所在位置,在保证检测效率的同时提高了检测精度。The invention discloses a light-weight curtain wall crack target detection method, which includes the steps of image collection, image preprocessing, model construction, model training and testing, and crack detection. The image collection step is to take pictures of the wall with drones and other tools. The image preprocessing will obtain the picture number and perform data cleaning and format conversion. The model construction step builds a lightweight curtain wall crack target detection model, which can be conveniently Deployed on devices such as drones, combined with computing units (CPU and GPU, etc.) Test to obtain a model with high detection accuracy. The crack classification detection step is to use the trained model to detect the wall to be inspected, and classify and mark the anchor frame according to the shape and grade of the crack. This method is based on target detection technology to identify wall cracks. The advantage of this method is that it uses a lightweight target detection model, does not require a large number of computing units, and can detect wall cracks and find the location of cracks in real time. The detection accuracy is improved while ensuring the detection efficiency.
进一步地,本发明还公开了安全警报系统,根据裂纹分类检测步骤标出的锚框等级发出不同等级的警报,以保证裂纹得到处理。Further, the present invention also discloses a safety alarm system, which sends out alarms of different levels according to the grades of anchor frames marked in the crack classification and detection step, so as to ensure that the cracks are dealt with.
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
实施例一Embodiment one
本发明实施例提供了一种轻量化幕墙裂纹目标检测方法,包括:An embodiment of the present invention provides a lightweight curtain wall crack target detection method, including:
收集大量的墙体图像;Collect a large number of wall images;
对收集的墙体图像进行预处理;Preprocessing the collected wall images;
构建轻量化幕墙裂纹目标检测模型,模型采用改进的目标检测网络,改进的目标检测网络包括主干特征提取网络、加强特征提取网络和检测头,其中,主干特征提取网络使用Ghost卷积替换原有YOLOv5网络中的标准卷积,主干特征提取网络和加强特征网络将原有YOLOv5网络的C3结构中的卷积替换为Ghost卷积,并在主干特征提取网络通道数最大的位置增加一个CA注意力模块,用以关注与墙体裂纹相关的重要特征;Build a lightweight curtain wall crack target detection model. The model uses an improved target detection network. The improved target detection network includes a backbone feature extraction network, an enhanced feature extraction network, and a detection head. Among them, the backbone feature extraction network uses Ghost convolution to replace the original YOLOv5 The standard convolution in the network, the backbone feature extraction network and the enhanced feature network replace the convolution in the C3 structure of the original YOLOv5 network with Ghost convolution, and add a CA attention module at the position with the largest number of channels in the backbone feature extraction network , to focus on important features related to wall cracks;
对构建的轻量化幕墙裂纹目标检测模型进行训练与测试,得到训练好的轻量化幕墙裂纹目标检测模型;Train and test the constructed lightweight curtain wall crack target detection model to obtain a trained lightweight curtain wall crack target detection model;
利用训练好的轻量化幕墙裂纹目标检测模型对待检测图像进行裂纹检测。Use the trained lightweight curtain wall crack target detection model to detect cracks in the image to be detected.
请参见图1,为本发明实施例公开的一种轻量化幕墙裂纹目标检测方法的流程示意图。Please refer to FIG. 1 , which is a schematic flowchart of a method for detecting cracks in lightweight curtain walls disclosed in an embodiment of the present invention.
具体实施过程中,可以使用无人机等设备获取墙体高清图像,后续训练过程中被分为训练用图像和检测图像,训练用图像目的是训练网络模型以获取更好的检测精度,对训练用图像应当标注裂纹所在位置,以帮助目标检测网络模型进行学习。而检测图像是用于实际检测,直接交由目标检测网络处理。In the specific implementation process, drones and other equipment can be used to obtain high-definition images of the wall. In the subsequent training process, they are divided into training images and detection images. The purpose of training images is to train the network model to obtain better detection accuracy. The location of the crack should be marked with the image to help the object detection network model to learn. The detection image is used for actual detection and is directly processed by the target detection network.
对墙体图像进行预处理主要是将图像进行清洗、格式转换以及编号,以便后续的处理,以及根据图像编号确定裂纹的位置。The preprocessing of the wall image is mainly to clean the image, convert the format, and number the image for subsequent processing, and determine the location of the crack according to the image number.
改进的目标检测网络对原始目标检测网络YOLOv5进行改进,请参见图2,为本发明采用的轻量化幕墙裂纹目标检测模型(GC-YOLOv5网络)的结构图与基本YOLOv5s网络结构图的对比图示意图。The improved target detection network improves the original target detection network YOLOv5, please refer to Figure 2, which is a schematic diagram of the comparison between the structure diagram of the lightweight curtain wall crack target detection model (GC-YOLOv5 network) adopted in the present invention and the basic YOLOv5s network structure diagram .
改进主要包括以下几个部分:Improvements mainly include the following parts:
一:使用Ghost卷积替换原有网络中的标准卷积,其中YOLOv5中Conv结构即为基本卷积模块,由普通卷积层、批标准化层以及激活函数组成,即将Conv结构替换为GhostConv结构;One: Use Ghost convolution to replace the standard convolution in the original network. The Conv structure in YOLOv5 is the basic convolution module, which is composed of ordinary convolution layer, batch normalization layer and activation function, that is, replace the Conv structure with the GhostConv structure;
二:在网络模型中,C3结构包括了一些残差结构和三个卷积,可以起到减少一些参数的作用,本发明将C3结构中卷积替换为Ghost卷积,即C3替换为GhostC3;Two: In the network model, the C3 structure includes some residual structures and three convolutions, which can reduce some parameters. The present invention replaces the convolution in the C3 structure with Ghost convolution, that is, replaces C3 with GhostC3;
三:增加一个CA注意力机制在主干特征提取网络通道数最大的位置,使得网络更加关注有价值的特征,使得提升整个网络的目标检测精度。Three: Add a CA attention mechanism to the position where the number of backbone feature extraction network channels is the largest, making the network pay more attention to valuable features and improving the target detection accuracy of the entire network.
请参见图3,为本发明实施例中Ghost卷积工作方式示意图。Please refer to FIG. 3 , which is a schematic diagram of the Ghost convolution working method in the embodiment of the present invention.
Ghost卷积的作用是使用一些计算代价比较廉价的线性运行生成一些冗余特征,用冗余特征代替标准卷积生成的部分特征,这些冗余特征虽然消耗的计算量很小,但可以大大提高检测精度,其工作方式如图3所示。其中,n为使用的卷积个数,而s是一个系数,使得是在Ghost卷积中使用常规卷积的比例,而是使用线性运算的比例,w'和h'是输出特征图的长和宽,c是输出的通道数,k和d分别是常规卷积和先行操作的内核长宽,一般内核长宽相同所以用到的是k*k和d*d,且此处由于设备运算的并行性,一般使得k和d相等。The function of Ghost convolution is to use some relatively cheap linear operations to generate some redundant features, and replace some features generated by standard convolution with redundant features. Although these redundant features consume a small amount of calculation, they can be greatly improved. Detection accuracy, its working method is shown in Figure 3. Among them, n is the number of convolutions used, and s is a coefficient, so that is the ratio of regular convolution used in Ghost convolution, and is the ratio of using linear operations, w' and h' are the length and width of the output feature map, c is the number of output channels, k and d are the kernel length and width of the conventional convolution and the preceding operation, respectively, and the general kernel length and width are the same so k*k and d*d are used, and here, due to the parallelism of device operations, k and d are generally equal.
根据Ghost卷积的工作方式,与相对应的标准卷积相比,其加速比为:According to the working method of Ghost convolution, compared with the corresponding standard convolution, its speedup ratio is:
总体来说,本发明通过改进的YOLO网络模型GC-YOLOv5对墙体裂纹进行实时检测,可以检测出是否出现墙体裂纹,同时由于对墙体图像进行排序,可以得到裂纹位置,同时可以可视化的标注裂纹的等级和形状。这种轻量化的GC-YOLOv5目标检测网络可以搭载在无人机等常见工具上运行,可以保证实时性检测的同时保障检测人员的安全并节省人力。In general, the present invention detects wall cracks in real time through the improved YOLO network model GC-YOLOv5, and can detect whether there are wall cracks. At the same time, due to sorting the wall images, the crack position can be obtained, and at the same time, it can be visualized Mark the grade and shape of the crack. This lightweight GC-YOLOv5 target detection network can be run on common tools such as drones, which can ensure real-time detection while ensuring the safety of inspectors and saving manpower.
在一种实施方式中,对收集的墙体图像进行预处理,包括:In one embodiment, the collected wall images are preprocessed, including:
对收集的墙体图像进行数据清洗和整理,将图像统一转化为PNG或JPG格式;Perform data cleaning and sorting on the collected wall images, and uniformly convert the images into PNG or JPG format;
根据图像在墙体上的物理位置进行编号和排序。The images are numbered and sorted according to their physical location on the wall.
具体实施过程中,对无法分辨的图像进行重拍,还对图像进行分割。按列或者行对图像进行编号和排序。In the specific implementation process, the unresolved images are retaken, and the images are also segmented. Number and sort images by column or row.
在一种实施方式中,CA注意力模块的处理过程包括:In one embodiment, the processing of the CA attention module includes:
使用沿着两个垂直和水平两个方向的池化核进行平均池化,得到沿着水平坐标和垂直坐标的一对一维特征编码,这对特征编码为具有全局的感受野和方向感知的特征表示;Using the pooling kernel along the two vertical and horizontal directions for average pooling, a pair of one-dimensional feature encoding along the horizontal and vertical coordinates is obtained, which is encoded as a global receptive field and direction-aware feature representation;
将一对一维特征编码进行特征融合后进行卷积变换以及非线性激活函数的处理,然后再次将融合后的特征沿着空间方向变为两个单独的张量和,对两个张量和进行再次卷积;After performing feature fusion on a pair of one-dimensional feature codes, convolution transformation and nonlinear activation function processing are performed, and then the fused features are transformed into two separate tensor sums along the spatial direction, and the two tensor sums Convolve again;
将再次卷积得到的张量和使用sigmoid激活函数进行归一化处理,然后输出到主干特征提取网络中的下一模块,作为权重指导网络学习更重要的通道中的特征。The tensor obtained by re-convolution is normalized using the sigmoid activation function, and then output to the next module in the backbone feature extraction network as a weight to guide the network to learn features in more important channels.
具体来说,CA注意力模块的作用是从水平和垂直两个空间方向上获取到每个特征通道的重要程度,在这个过程中,可以得到对于整个图像空间关系,这种空间关系可以帮助网络更好的关注有价值的空间信息。CA注意力模块的工作整体步骤如图4所示。Specifically, the role of the CA attention module is to obtain the importance of each feature channel from the horizontal and vertical spatial directions. In this process, the spatial relationship of the entire image can be obtained. This spatial relationship can help the network Better focus on valuable spatial information. The overall steps of the work of the CA attention module are shown in Figure 4.
卷积神经网络网络模型主要模块都是卷积,除了已介绍的Conv标准卷积和C3残差卷积模块外,还有SPPF结构,包括了三个卷积核相同的串行卷积,目的是为了将更多不同分辨率的特征进行融合,得到更多的信息。The main modules of the convolutional neural network model are convolutions. In addition to the Conv standard convolution and C3 residual convolution modules that have been introduced, there is also an SPPF structure, including three serial convolutions with the same convolution kernel. It is to fuse more features with different resolutions to get more information.
与现有技术中的一般改进模型不同的是,本发明不仅在主干特征提取网络中使用了GhostConv和GhostC3模块,并且将后续加强特征提取网络中也将相应的模块更改为了GhostConv和GhostC3模块,通过这种改进,模块本身更加轻量化,可以使得模型满足实时监测的需求,因此,本发明采用的模型比一般仅改进主干特征提取网络的模型更加轻量化。此外,由于模型替换GhostConv和GhostC3模块更多,由于其计算方式,会使得损失部分特征,导致最终精度略微下降,因此,本发明还增加了一个CA注意力模块,该模块采用注意力机制会使得网络更加关注原有的高价值特征,而降低对于GhostConv和GhostC3模块生成的冗余特征的权重,两者结合使得模型高度轻量化的同时保持了较高的检测精度。Different from the general improved models in the prior art, the present invention not only uses the GhostConv and GhostC3 modules in the backbone feature extraction network, but also changes the corresponding modules in the subsequent enhanced feature extraction network to GhostConv and GhostC3 modules, through This improvement makes the module itself more lightweight, which can make the model meet the requirements of real-time monitoring. Therefore, the model adopted by the present invention is lighter than the general model that only improves the backbone feature extraction network. In addition, since the model replaces more GhostConv and GhostC3 modules, due to its calculation method, some features will be lost, resulting in a slight decrease in final accuracy. Therefore, the present invention also adds a CA attention module, which uses the attention mechanism to make The network pays more attention to the original high-value features, and reduces the weight of redundant features generated by GhostConv and GhostC3 modules. The combination of the two makes the model highly lightweight while maintaining high detection accuracy.
具体地,本发明使用Ghost卷积替换原有网络中的标准卷积,Ghost卷积的作用是使用一些计算代价比较廉价的线性运行生成一些冗余特征,用冗余特征代替标准卷积生成的部分特征,这些冗余特征虽然消耗的计算量很小,但可以大大提高检测精度,这使得使用本方法对墙体裂纹进行识别时,不需要大量的计算单元,并且可以实时的做到对墙体裂纹进行检测并找到裂纹所在位置和分辨裂纹严重等级,而后给出不同等级的警报。Specifically, the present invention uses Ghost convolution to replace the standard convolution in the original network. The function of Ghost convolution is to use some linear operations with relatively cheap calculation costs to generate some redundant features, and replace the standard convolution with redundant features. Some features, although these redundant features consume a small amount of calculation, they can greatly improve the detection accuracy, which makes it unnecessary to use a large number of computing units when using this method to identify wall cracks, and can achieve real-time detection of wall cracks. It detects the cracks of the body and finds the location of the cracks and distinguishes the severity level of the cracks, and then gives different levels of alarms.
进一步地,本发明增加一个CA注意力机制在主干特征提取网络通道数最大的位置,使得网络更加关注有价值的特征,使得提升整个网络的目标检测精度。这种注意力机制有效提升了因为使用Ghost卷积不可避免的降低的目标检测精度。两种方法结合下,使得目标检测网络简化和轻量化的同时保持了检测精度。Furthermore, the present invention adds a CA attention mechanism to the position where the number of backbone feature extraction network channels is the largest, making the network pay more attention to valuable features and improving the target detection accuracy of the entire network. This attention mechanism effectively improves the object detection accuracy that is inevitably reduced due to the use of Ghost convolution. The combination of the two methods makes the target detection network simplified and lightweight while maintaining the detection accuracy.
在一种实施方式中,对构建的轻量化幕墙裂纹目标检测模型进行训练,包括:In one embodiment, the lightweight curtain wall crack target detection model of construction is trained, including:
将预处理后的墙体图像按照预设比例,划分为训练集、验证集和测试集;Divide the preprocessed wall image into a training set, a verification set and a test set according to a preset ratio;
将划分的训练集进行归一化处理为分辨率一致的图像;Normalize the divided training set into images with consistent resolution;
将归一化处理后的训练集图像输入到轻量化幕墙裂纹目标检测模型,由Ghost卷积生成额外特征,由CA注意力机制关注重要特征,并根据额外特征和CA注意力机制关注的重要特征得到输出的图像特征;Input the normalized training set images to the lightweight curtain wall crack target detection model, generate additional features by Ghost convolution, and focus on important features by CA attention mechanism, and focus on important features based on additional features and CA attention mechanism Get the output image features;
根据输出的图像特征对验证集进行回归预测与定位,验证训练和收敛情况,得出训练过程中图像中裂纹的检测结果、裂纹程度、召回率和目标检测精度;Perform regression prediction and positioning on the verification set according to the output image features, verify the training and convergence, and obtain the detection results, crack degree, recall rate and target detection accuracy of cracks in the image during the training process;
将训练好的轻量化幕墙裂纹目标检测模型在测试集上进行测试,对于测试过程中找出的具有裂纹的图像,根据墙体图像的编号得出裂缝的位置,并将最终目标检测精度大于阈值时的模型作为训练好的轻量化幕墙裂纹目标检测模型。Test the trained light-weight curtain wall crack target detection model on the test set. For the images with cracks found during the test, the position of the crack is obtained according to the number of the wall image, and the final target detection accuracy is greater than the threshold The time model is used as a trained lightweight curtain wall crack target detection model.
具体实施过程中,预设比例可以实际情况进行设置,例如8:1:1、7:1:2等。阈值也可以根据实际情况设置,例如70%、80%等。During the specific implementation process, the preset ratio can be set according to the actual situation, such as 8:1:1, 7:1:2 and so on. The threshold can also be set according to the actual situation, such as 70%, 80% and so on.
此外,当目标检测精度小于80%时,则需要扩大数据集,返回到数据集划分步骤重新进行训练从而保证检测精度。In addition, when the target detection accuracy is less than 80%, it is necessary to expand the data set and return to the data set division step to retrain to ensure the detection accuracy.
在一种实施方式中,利用训练好的轻量化幕墙裂纹目标检测模型对待检测图像进行裂纹检测,包括:In one embodiment, using the trained lightweight curtain wall crack target detection model to perform crack detection on the image to be detected, including:
将待检测图像进行预处理后输入训练好的轻量化幕墙裂纹目标检测模型,得到裂纹检测结果,其中,裂纹检测结果使用锚框可视化的标注裂纹;After preprocessing the image to be detected, input the trained lightweight curtain wall crack target detection model to obtain the crack detection result, wherein the crack detection result uses the anchor box to visually mark the crack;
根据裂纹程度区分裂纹等级和裂纹形状,并将裂纹等级和裂纹形状标注在锚框旁。The crack grade and crack shape are distinguished according to the crack degree, and the crack grade and crack shape are marked next to the anchor frame.
具体来说,根据裂纹程序将裂纹分为是三个等级:轻度、中度、重度。这种可视化结果以供人力检查时直观发现裂纹信息。Specifically, according to the crack program, cracks are divided into three grades: mild, moderate, and severe. This visualization result can be used to visually discover crack information during human inspection.
在一种实施方式中,所述方法还包括:根据裂纹等级进行报警。In one embodiment, the method further includes: giving an alarm according to the crack level.
具体来说,当裂纹检测步骤中发现裂纹,则根据裂纹等级发出不同等级警报,轻度和中度裂纹可以在提交日志中标明裂纹等级和裂纹形状,并根据墙体图像处理中分割时的编号,在日志中标明出现裂纹的墙体具体位置。对于重度裂纹,则直接发出警报,搭载有该轻量化目标检测网络的无人机应当暂停后续工作,持续检测该墙体,直到警报被排除。Specifically, when a crack is found in the crack detection step, different levels of alarms are issued according to the crack level. Mild and moderate cracks can be marked with the crack level and crack shape in the submission log, and according to the wall image processing. , mark the specific location of the wall where the crack appears in the log. For severe cracks, an alarm is issued directly, and the drone equipped with the lightweight target detection network should suspend follow-up work and continue to detect the wall until the alarm is eliminated.
具体地,请参见图5,为本发明实施例中利用轻量化幕墙裂纹目标检测模型实现安全报警的实施流程图。Specifically, please refer to FIG. 5 , which is an implementation flowchart of implementing a safety alarm by using a lightweight curtain wall crack target detection model in an embodiment of the present invention.
本发明使用与原始YOLOv5s相比更加轻便的CG-YOLOv5网络,使用Ghost卷积代替原本卷积,使得计算量大幅下降,Ghost卷积用更加廉价的线性操作生成部分冗余特征,用冗余特征填补原有标准卷积生成的特征。使用冗余特征必然会降低一部分检测精度,所以插入CA注意力机制,使得网络更加关注重要的特征。使用这两种方法的CG-YOLOv5网络,可以在保持检测精度的前提下大大降低网络的复杂度,从而降低对硬件的要求。Compared with the original YOLOv5s, the present invention uses the lighter CG-YOLOv5 network, and uses Ghost convolution to replace the original convolution, so that the amount of calculation is greatly reduced. Ghost convolution uses cheaper linear operations to generate some redundant features, and uses redundant features Fill in the features generated by the original standard convolution. The use of redundant features will inevitably reduce part of the detection accuracy, so the CA attention mechanism is inserted to make the network pay more attention to important features. The CG-YOLOv5 network using these two methods can greatly reduce the complexity of the network while maintaining the detection accuracy, thereby reducing the requirements for hardware.
实施例二Embodiment two
基于同样的发明构思,本实施例提供了一种轻量化幕墙裂纹目标检测系统,包括:Based on the same inventive concept, this embodiment provides a lightweight curtain wall crack target detection system, including:
图像收集模块,用于收集大量的墙体图像;Image collection module, used to collect a large number of wall images;
预处理模块,用于对收集的墙体图像进行预处理;A preprocessing module is used to preprocess the collected wall images;
模型构建模块,用于构建轻量化幕墙裂纹目标检测模型,模型采用改进的目标检测网络,改进的目标检测网络包括主干特征提取网络、加强特征提取网络和检测头,其中,主干特征提取网络使用Ghost卷积替换原有YOLOv5网络中的标准卷积,主干特征提取网络和加强特征网络将原有YOLOv5网络的C3结构中的卷积替换为Ghost卷积,并在主干特征提取网络通道数最大的位置增加一个CA注意力模块,用以关注与墙体裂纹相关的重要特征;The model building module is used to build a lightweight curtain wall crack target detection model. The model uses an improved target detection network. The improved target detection network includes a backbone feature extraction network, an enhanced feature extraction network and a detection head. Among them, the backbone feature extraction network uses Ghost Convolution replaces the standard convolution in the original YOLOv5 network, the backbone feature extraction network and the enhanced feature network replace the convolution in the C3 structure of the original YOLOv5 network with Ghost convolution, and place the largest number of channels in the backbone feature extraction network Add a CA attention module to focus on important features related to wall cracks;
训练与测试模块,用于对构建的轻量化幕墙裂纹目标检测模型进行训练与测试,得到训练好的轻量化幕墙裂纹目标检测模型;The training and testing module is used to train and test the constructed lightweight curtain wall crack target detection model to obtain a trained lightweight curtain wall crack target detection model;
裂纹检测模块用于利用训练好的轻量化幕墙裂纹目标检测模型对待检测图像进行裂纹检测。The crack detection module is used to use the trained lightweight curtain wall crack target detection model to detect cracks on the image to be detected.
由于本发明实施例二所介绍的系统为实施本发明实施例一中轻量化幕墙裂纹目标检测方法所采用的系统,故而基于本发明实施例一所介绍的方法,本领域所属人员能够了解该系统的具体结构及变形,故而在此不再赘述。凡是本发明实施例一中方法所采用的系统都属于本发明所欲保护的范围。Since the system introduced in the second embodiment of the present invention is the system used to implement the target detection method for lightweight curtain wall cracks in the first embodiment of the present invention, based on the method introduced in the first embodiment of the present invention, those skilled in the art can understand the system The specific structure and deformation, so it will not be repeated here. All systems used in the method in the first embodiment of the present invention belong to the scope of protection of the present invention.
实施例三Embodiment three
基于同一发明构思,本发明还提供了一种安全警报系统,包括实施二所述的轻量化幕墙裂纹目标检测系统和警报模块,警报模块用于根据裂纹等级进行报警。Based on the same inventive concept, the present invention also provides a security alarm system, including the light-weight curtain wall crack target detection system described in Embodiment 2 and an alarm module, the alarm module is used for alarming according to the crack level.
由于本发明实施例三所介绍的系统基于实施例二的系统来实现故而基于本发明实施例二所介绍的系统,本领域所属人员能够了解该安全警报系统,具体结构及变形,故而在此不再赘述。实施例四Because the system introduced in Embodiment 3 of the present invention is implemented based on the system described in Embodiment 2, and based on the system described in Embodiment 2 of the present invention, those skilled in the art can understand the security alarm system, its specific structure and deformation, so it will not be described here. Let me repeat. Embodiment four
基于同一发明构思,本申请还提供了一种计算机设备,包括存储、处理器及存储在存储器上并可在处理器上运行的计算机程序,处理器执行上述程序时实现实施例一中的方法。Based on the same inventive concept, the present application also provides a computer device, including storage, a processor, and a computer program stored in the storage and operable on the processor. The method in Embodiment 1 is implemented when the processor executes the above program.
由于本发明实施例四所介绍的计算机设备为实施本发明实施例一中轻量化幕墙裂纹目标检测方法所采用的计算机设备,故而基于本发明实施例一所介绍的方法,本领域所属人员能够了解该计算机设备的具体结构及变形,故而在此不再赘述。凡是本发明实施例一中方法所采用的计算机设备都属于本发明所欲保护的范围。Since the computer equipment introduced in Embodiment 4 of the present invention is the computer equipment used to implement the target detection method for lightweight curtain wall cracks in Embodiment 1 of the present invention, based on the method described in Embodiment 1 of the present invention, those skilled in the art can understand The specific structure and deformation of the computer device will not be repeated here. All computer equipment used in the method in Embodiment 1 of the present invention belongs to the scope of protection intended by the present invention.
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, systems, or computer program products. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
尽管已描述了本发明的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例做出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本发明范围的所有变更和修改。While preferred embodiments of the present invention have been described, additional changes and modifications can be made to these embodiments by those skilled in the art once the basic inventive concept is appreciated. Therefore, it is intended that the appended claims be construed to cover the preferred embodiment as well as all changes and modifications which fall within the scope of the invention.
显然,本领域的技术人员可以对本发明实施例进行各种改动和变型而不脱离本发明实施例的精神和范围。这样,倘若本发明实施例的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。Apparently, those skilled in the art can make various changes and modifications to the embodiments of the present invention without departing from the spirit and scope of the embodiments of the present invention. In this way, if the modifications and variations of the embodiments of the present invention fall within the scope of the claims of the present invention and equivalent technologies, the present invention also intends to include these modifications and variations.
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210959902.2A CN115423995A (en) | 2022-08-11 | 2022-08-11 | Lightweight curtain wall crack target detection method and system and safety early warning system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210959902.2A CN115423995A (en) | 2022-08-11 | 2022-08-11 | Lightweight curtain wall crack target detection method and system and safety early warning system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN115423995A true CN115423995A (en) | 2022-12-02 |
Family
ID=84198210
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210959902.2A Pending CN115423995A (en) | 2022-08-11 | 2022-08-11 | Lightweight curtain wall crack target detection method and system and safety early warning system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115423995A (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116229410A (en) * | 2022-12-05 | 2023-06-06 | 重庆邮电大学 | Lightweight neural network road scene detection method integrating multidimensional information pooling |
CN116502810A (en) * | 2023-06-28 | 2023-07-28 | 威胜信息技术股份有限公司 | Standardized production monitoring method based on image recognition |
CN116973898A (en) * | 2023-07-17 | 2023-10-31 | 哈尔滨工程大学 | Active detection method, system, terminal and computer storage medium for target under ice |
CN117113010A (en) * | 2023-10-24 | 2023-11-24 | 北京化工大学 | Power transmission channel safety monitoring method and system based on convolutional network lightweight |
CN119444765A (en) * | 2025-01-13 | 2025-02-14 | 中南大学 | A fluorescent skin fungus detection method based on pseudo-label and lightweight model |
-
2022
- 2022-08-11 CN CN202210959902.2A patent/CN115423995A/en active Pending
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116229410A (en) * | 2022-12-05 | 2023-06-06 | 重庆邮电大学 | Lightweight neural network road scene detection method integrating multidimensional information pooling |
CN116502810A (en) * | 2023-06-28 | 2023-07-28 | 威胜信息技术股份有限公司 | Standardized production monitoring method based on image recognition |
CN116502810B (en) * | 2023-06-28 | 2023-11-03 | 威胜信息技术股份有限公司 | Standardized production monitoring method based on image recognition |
CN116973898A (en) * | 2023-07-17 | 2023-10-31 | 哈尔滨工程大学 | Active detection method, system, terminal and computer storage medium for target under ice |
CN117113010A (en) * | 2023-10-24 | 2023-11-24 | 北京化工大学 | Power transmission channel safety monitoring method and system based on convolutional network lightweight |
CN117113010B (en) * | 2023-10-24 | 2024-02-09 | 北京化工大学 | Power transmission channel safety monitoring method and system based on convolutional network lightweight |
CN119444765A (en) * | 2025-01-13 | 2025-02-14 | 中南大学 | A fluorescent skin fungus detection method based on pseudo-label and lightweight model |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111681240B (en) | A bridge surface crack detection method based on YOLO v3 and attention mechanism | |
CN115423995A (en) | Lightweight curtain wall crack target detection method and system and safety early warning system | |
CN110310261B (en) | A catenary suspension string defect detection model training method and defect detection method | |
CN111832608B (en) | A multi-wear particle identification method in ferrogram images based on the single-stage detection model yolov3 | |
WO2019109793A1 (en) | Human head region recognition method, device and apparatus | |
CN117496384B (en) | Unmanned aerial vehicle image object detection method | |
CN117576632B (en) | Multi-mode AI large model-based power grid monitoring fire early warning system and method | |
CN113989726B (en) | Construction site safety helmet identification method and system | |
CN114662605A (en) | Flame detection method based on improved YOLOv5 model | |
Hu et al. | Automatic defect detection from X-ray scans for aluminum conductor composite core wire based on classification neutral network | |
CN113569756A (en) | Abnormal behavior detection and positioning method, system, terminal equipment and readable storage medium | |
CN114693670B (en) | Ultrasonic detection method for weld defects of longitudinal submerged arc welded pipe based on multi-scale U-Net | |
CN117036243A (en) | Method, device, equipment and storage medium for detecting surface defects of shaving board | |
CN113496260B (en) | Detection method for irregular operations of grain depot personnel based on improved YOLOv3 algorithm | |
CN115937736A (en) | Small target detection method based on attention and context awareness | |
CN113569912A (en) | Vehicle identification method and device, electronic equipment and storage medium | |
CN114418956A (en) | Method and system for change detection of key electrical equipment in substation | |
CN116129135A (en) | Tower Crane Safety Early Warning Method Based on Small Target Visual Recognition and Virtual Entity Mapping | |
CN111462140A (en) | A real-time image instance segmentation method based on block stitching | |
CN115797970A (en) | Dense pedestrian target detection method and system based on YOLOv5 model | |
CN117253191A (en) | Safety helmet wearing detection method based on DETR model | |
CN116863271A (en) | Lightweight infrared flame detection method based on improved YOLO V5 | |
CN117854036A (en) | Water surface obstacle detection method based on improved YOLOv3 | |
CN116310967A (en) | Chemical plant safety helmet wearing detection method based on improved YOLOv5 | |
CN117726991B (en) | High-altitude hanging basket safety belt detection method and terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |