WO2020038389A1 - Welding seam negative defect recognition method - Google Patents

Welding seam negative defect recognition method Download PDF

Info

Publication number
WO2020038389A1
WO2020038389A1 PCT/CN2019/101716 CN2019101716W WO2020038389A1 WO 2020038389 A1 WO2020038389 A1 WO 2020038389A1 CN 2019101716 W CN2019101716 W CN 2019101716W WO 2020038389 A1 WO2020038389 A1 WO 2020038389A1
Authority
WO
WIPO (PCT)
Prior art keywords
weld
defect
image
negative
feature data
Prior art date
Application number
PCT/CN2019/101716
Other languages
French (fr)
Chinese (zh)
Inventor
董绍华
谢书懿
孙玄
张河苇
张来斌
Original Assignee
中国石油大学(北京)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国石油大学(北京) filed Critical 中国石油大学(北京)
Publication of WO2020038389A1 publication Critical patent/WO2020038389A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N23/00Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00
    • G01N23/02Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material
    • G01N23/06Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material and measuring the absorption
    • G01N23/18Investigating the presence of flaws defects or foreign matter

Definitions

  • the invention relates to the field of safety inspection of oil and gas pipelines, in particular to a method for identifying a defect of a weld negative.
  • X-ray digital real-time imaging detection technology has the characteristics of noisy images, low contrast, blurred weld edges and more textures. It is difficult to meet the required quality standards. In order to improve the quality of inspection objects, it is necessary to carry out subsequent computer image processing. And combined with the computer evaluation form to complete the automatic identification of defects in the weld.
  • due to many problems in the actual detection process such as motion-induced image capture blurring (edges and defects are blurred and rough), noise caused by various aspects is trapped in the sample to be detected, resulting in long recognition process and low accuracy. , which severely limits the application of image processing technology in this field; in addition, for the same workpiece, the angle of ray irradiation during detection is different, and the quality of the obtained image also varies greatly.
  • the purpose of the present invention is to provide a method for identifying defects in a weld film, which overcomes the lack of accuracy in amplitude and direction, and is superior in classification accuracy to the direct method of determining shape features and contours, and the traditional LTP, LBP, and CLBP texture feature methods. system.
  • the method for identifying a defect of a weld negative specifically includes: obtaining a weld negative of a weld by radiography; obtaining image texture feature data of a weld negative of a weld negative by using image recognition technology; The welding image texture feature data and the defect type of the weld backsheet are used to establish a recognition model by a machine learning algorithm; the weld image texture feature data of the weld backsheet to be inspected is obtained; and the weld image texture feature is based on the weld backsheet to be inspected The data and the identification model are used to calculate and obtain the defect category of the weld backsheet to be detected.
  • the use of image recognition technology to obtain the weld image texture feature data of the welding film includes: using the image recognition technology to obtain the size information, the symbol information, and the central region information of the welding film. , Obtaining the texture feature data of the weld image of the weld negative based on the size information, the symbol information, and the central area information.
  • obtaining the size information of the welding film by using the image recognition technology includes: obtaining the size information of the welding film by the following formula;
  • a and b are custom constants
  • TH is a predetermined threshold
  • p is the number of pixels.
  • obtaining the symbol information of the weld negative by using image recognition technology includes: obtaining the symbol information of the weld negative by calculating by the following formula;
  • CLTP_S * is the symbol information
  • TH is a predetermined threshold
  • p is the number of pixels.
  • obtaining the center region information of the welding film by using image recognition technology includes: obtaining the center region information of the welding film by the following formula;
  • CLTP_C * is the central area information
  • TH1 is the average value of the image pixels.
  • establishing a recognition model by a machine learning algorithm based on the texture image feature data of the welding seam and the defect category of the welding film further includes: obtaining the detection using a defect edge detection and tracking processing technology.
  • the characteristic parameters include: welding plate number, image length pixel, image width pixel, gray difference between the defect and the background, relative position of the defect, gray deviation of the defect itself, Defect aspect ratio, equivalent area, circularity, entropy, correlation, moment of inertia, energy.
  • establishing a recognition model by a machine learning algorithm based on the welding image texture feature data and the welding seam film defect type includes: according to the welding seam image texture feature data and the welding seam
  • the defect categories of the negatives are used to build an SVM model using an SVM (Support Vector Machine) classification algorithm.
  • the establishing the SVM model by the SVM classification algorithm further includes: obtaining a number of categories of the classifier in the SVM model by a global optimization method; and constructing each category according to a category difference exclusion method.
  • the classifier; the categories of the classifier include: cracks, circular slag inclusions, strip slag inclusions, air holes, not welded through, and not fused.
  • the present invention also provides an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the processor executes the computer program, the method for identifying the above-mentioned weld film defect identification method is implemented. step.
  • the present invention also provides a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the steps of the above-mentioned method for identifying a defect in a weld film are implemented.
  • the method and system for identifying the defect of a weld negative film provided by the present invention effectively solve the problems of inaccurate texture accuracy and inaccurate judgment of the characteristics of the weld negative identification, and greatly improve the accuracy of the edge detection and defect tracking identification of the weld negative image. Laying the foundation for development.
  • FIG. 1 is a schematic flowchart of a method for identifying a defect of a weld negative film according to an embodiment of the present invention
  • CLTP complete local three-valued mode
  • FIG. 3 is a schematic structural diagram of an SVM multi-class classifier according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a welding film defect recognition system according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
  • the standardized image processing technology for weld negatives includes image preprocessing and segmentation of image weld areas. , Defect feature extraction, defect classification and recognition, and finally display the defect results. Therefore, a complete computer intelligent evaluation system is a very important research branch of radiographic inspection.
  • an embodiment of the present invention provides a welding film defect recognition method.
  • the method specifically includes: S101 is obtained by radiography technology Weld seam negatives of the weld seam; S102 uses image recognition technology to obtain the seam image texture feature data of the seam negative film; S103 establishes a recognition model through a machine learning algorithm based on the seam image texture feature data and the defect type of the seam negative film; S104 Obtaining the texture feature data of the weld image of the to-be-detected backsheet; S105 calculating and obtaining the defect category of the weld plate of the to-be-tested according to the texture feature data of the weld image of the to-be-detected backsheet and the recognition model.
  • a radiographic image of the weld seam is obtained by using radiographic imaging technology, and then a machine model is trained based on the known defect types of the weld seam and the texture feature data of the weld seam image identified according to image recognition technology.
  • the subsequent machine model obtains an identification model for identifying the type of the weld negative film defect; after obtaining the weld negative film to be inspected, the texture feature data of the weld image of the weld negative film to be inspected can be directly used with the recognition model. Determine the defect type of the weld; compared with the existing amplifier, this method not only has higher recognition accuracy, but also is more efficient.
  • the obtaining the weld image texture feature data of the weld negative by using image recognition technology includes: obtaining the size information, symbol information, and center area information of the weld negative by using image recognition technology.
  • the size information, the symbol information, and the central area information are used to obtain the texture feature data of the weld image of the weld negative.
  • the improved CTLP (Complete Local Local Ternary Patterns) algorithm proposed by the present invention is used to obtain the weld image texture feature data of the weld negative.
  • the extracted weld image texture feature method retains richer textures.
  • Structure information based on the reconstruction of the central descriptor, including the symbol descriptor and the size descriptor; it is mainly divided into three components: two components contain size information, symbol information, and the other component retains the center area of the weld image Information, to achieve the fusion of texture features and weld shape features, the characterization data is closer to the actual situation.
  • TH is a given fixed threshold
  • a and b are custom constants
  • CLTP_C * is equal to: Among them, TH1 is the average value of image pixels, and then use The modes are converted into encoded values, CLTP_S * CLTP_M * and CLTP_C * respectively corresponding to those shown in FIG. 2.
  • the CLTP algorithm mainly uses some amplitude information lost in the existing texture extraction algorithm to improve the recognition rate.
  • the symbol part can be re-assigned according to a given threshold, and finally modified CLTP_C * , CLTP_S * , CLTP_M * are used to represent the central area information, symbol information, and size information .
  • a represents a 3 ⁇ 3 sample block with a center pixel of 38, and the eight pixels in the neighborhood are [27,72,69,32,25,43,26,88];
  • CL CLTP_S * local
  • the three-valued encoding vector of the difference sign is [0, 2, 2, 0, 0, 1, 0, 2]; in d, the CLTP_M * operator value is [1,2,2,0,1,0,1 , 2];
  • a film defect library can also be established.
  • establishing a recognition model by a machine learning algorithm based on the texture image data of the weld image and the defect category of the weld film also includes: using defect edges
  • the detection and tracking processing technology obtains feature parameters of a predetermined category in the texture feature data of the weld image; establishes a defect feature database according to the feature parameters and the defect category of the weld negative; and establishes recognition through a machine learning algorithm according to the defect feature database model.
  • the characteristic parameters include: pad number, image length pixel, image width pixel, gray difference between defect and background, relative position of defect, gray deviation of defect itself, defect aspect ratio, equivalent area, circle Degree, entropy, correlation, moment of inertia, energy.
  • this embodiment mainly integrates the above shape features and texture features, and the corresponding film blackness is different to form different defect features to construct a defect feature database shown in Table 1 below.
  • the defect feature database contains parameters such as grayscale difference, equivalent area, circularity, entropy, correlation, etc., which facilitates the improvement of the recognition model by machine learning algorithms at the later stage.
  • the defect feature database further characterizes the characteristics of weld defects
  • the size, symbol information and central area information, the algorithm overcomes the lack of precision in amplitude and direction, and is superior to the simple shape feature contour direct judgment method and the traditional LTP, LBP, CLBP texture feature methods in classification accuracy.
  • establishing a recognition model by a machine learning algorithm based on the weld image texture feature data and the defect type of the weld backsheet includes: according to the weld image texture feature data and the defect of the weld backsheet
  • the SVM model is established by the SVM classification algorithm.
  • the establishment of the SVM model by the SVM classification algorithm further includes: obtaining the number of classes of the classifier in the SVM model through a global optimization method; constructing the classifiers of each class according to a class difference exclusion method; Categories include: cracks, round slag inclusions, strip slag inclusions, pores, not welded, and not fused.
  • M-SVM multi-classifier SVM model
  • a single class and the remaining classes can be used to determine the criteria for determining this classifier. Repeat the above process for all classes. Find out the value of each judgment function and compare these values. The largest category is the best classification structure of the sample.
  • M-SVM direct global optimization method
  • the discriminant function is: ST.y i (w T ⁇ (x i ) + b) ⁇ 1- ⁇ i
  • each classifier structure should preferentially adopt the method of class difference exclusion, that is, in the overall structure, firstly, the similarity is regarded as a category, and then based on the small changes between the similarities, the model algorithm is used to distinguish.
  • This classification has extremely high efficiency in classification accuracy and balance accuracy.
  • this paper constructs six types of defects, such as cracks, circular slag inclusions, strip slag inclusions, pores, unwelded, unfused, and other typical defects. As shown in Figure 3 below.
  • the calculation parameters include: image length pixels, image width pixels, the gray difference between the defect and the background ⁇ h, the relative position d of the defect, the gray deviation of the defect itself ⁇ , the defect aspect ratio, the equivalent area S / C, and the circularity e.
  • the SVM data classification technology based on the defect database is applied.
  • the CTLP mode greatly improves the accuracy of edge detection and defect tracking identification of welded negatives.
  • the SVM defect classification model enables automatic recognition and judgment of image defects. The accuracy has been greatly improved, and has basically reached the level of industrial application.
  • the above method was used to verify that the X-ray film of the weld at the 7.28 accident section of the West-East China Gas Pipeline shows the unfused characteristic at the lower left of position 38, and its computer system judgment is completely consistent with the result of manual evaluation.
  • the above method was used to verify that the second-line welded negative film of Shaanxi-Beijing in China showed the characteristics of incomplete penetration, and the main defects were located between the position points 6-7. This shows that the method has better accuracy and accuracy.
  • an embodiment of the present invention further provides a welding film defect recognition system.
  • the system includes a data acquisition unit, a model construction unit, and an identification unit.
  • the data acquisition unit is used for radiography technology.
  • the model construction unit is configured to pass the machine according to the weld image texture feature data and the defect type of the weld seam film
  • a learning algorithm establishes a recognition model;
  • the recognition unit is configured to obtain texture feature data of a weld image of a negative plate of the weld to be tested; and calculate and obtain the texture feature data of the weld image of the negative plate of the weld to be tested and the recognition model Defect category of the negative to be tested.
  • the identification and description of the texture features and shape features of pipeline defects, and the accurate judgment of defects, are the problems of automatic computer image recognition and the main problems facing intelligent welding.
  • the method and system for identifying weld film defects in the present invention solve the problem of inaccurate texture accuracy and feature judgment of weld film identification.
  • An improved CTLP algorithm is provided, and the central descriptor is reconstructed, including the symbol descriptor.
  • the defect shape features are obtained by classification, and cracks, slag inclusions, pores, unwelded, unfused, Defect characteristics such as strip defects.
  • the present invention uses the fusion processing technology of the improved CTLP algorithm and the SVM classification algorithm to make the weld defect feature description more accurate, and overcomes the shortcomings of the previous algorithms in terms of amplitude, directional accuracy, and easily confused defect features.
  • the contour feature direct judgment method is superior to the shape feature in the accuracy rate and the traditional LTP, LBP, CLBP texture feature description method; the pipe weld seam defect SVM method based on CLTP texture & shape feature has better accuracy, which makes the welding negative image
  • the accuracy of edge detection and defect tracking recognition has been greatly improved, laying a foundation for the development of weld feature recognition technology.
  • the present invention also provides an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the processor executes the computer program, the method for identifying the above-mentioned weld film defect identification method is implemented. step.
  • the present invention also provides a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the steps of the above-mentioned method for identifying a defect in a weld film are implemented.
  • the electronic device 600 may further include a communication module 110, an input unit 120, an audio processing unit 130, a display 160, and a power source 170. It is worth noting that the electronic device 600 does not necessarily need to include all the components shown in FIG. 5; in addition, the electronic device 600 may also include components not shown in FIG. 5, and reference may be made to the prior art.
  • the central processing unit 100 is sometimes referred to as a controller or an operation control, and may include a microprocessor or other processor devices and / or logic devices.
  • the central processing unit 100 receives input and controls each of the electronic devices 600. Operation of parts.
  • the memory 140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory, or other suitable devices.
  • the above-mentioned failure-related information can be stored, and a program for executing the related information can also be stored.
  • the central processing unit 100 may execute the program stored in the memory 140 to implement information storage or processing.
  • the input unit 120 provides input to the central processing unit 100.
  • the input unit 120 is, for example, a key or a touch input device.
  • the power source 170 is used to provide power to the electronic device 600.
  • the display 160 is used for displaying display objects such as images and characters.
  • the display may be, for example, an LCD display, but is not limited thereto.
  • the memory 140 may be a solid-state memory, such as a read-only memory (ROM), a random access memory (RAM), a SIM card, and the like. It may also be a memory that holds information even when power is off, can be selectively erased and is provided with more data, and an example of the memory is sometimes called EPROM or the like.
  • the memory 140 may also be some other type of device.
  • the memory 140 includes a buffer memory 141 (sometimes referred to as a buffer).
  • the memory 140 may include an application / function storage section 142 for storing application programs and function programs or a flow for performing operations of the electronic device 600 through the central processing unit 100.
  • the memory 140 may further include a data storage section 143 for storing data, such as contacts, digital data, pictures, sounds, and / or any other data used by the electronic device.
  • the driver storage section 144 of the memory 140 may include various drivers for the electronic device for communication functions and / or for performing other functions of the electronic device (such as a messaging application, an address book application, etc.).
  • the communication module 110 is a transmitter / receiver 110 that transmits and receives signals via the antenna 111.
  • a communication module (transmitter / receiver) 110 is coupled to the central processing unit 100 to provide input signals and receive output signals, which may be the same as the case of a conventional mobile communication terminal.
  • multiple communication modules 110 may be provided in the same electronic device, such as a cellular network module, a Bluetooth module, and / or a wireless local area network module.
  • the communication module (transmitter / receiver) 110 is also coupled to the speaker 131 and the microphone 132 via the audio processor 130 to provide audio output via the speaker 131 and to receive audio input from the microphone 132, thereby realizing general telecommunication functions.
  • the audio processor 130 may include any suitable buffers, decoders, amplifiers, and the like.
  • the audio processor 130 is also coupled to the central processing unit 100, so that the microphone 132 can be used to record on the unit, and the speaker 131 can be used to play the sound stored on the unit.
  • the embodiments of the present invention may be provided as a method, a system, or a computer program product. Therefore, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
  • computer-usable storage media including, but not limited to, disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to work in a particular manner such that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device, the instructions
  • the device implements the functions specified in one or more flowcharts and / or one or more blocks of the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing device, so that a series of steps can be performed on the computer or other programmable device to produce a computer-implemented process, which can be executed on the computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Image Analysis (AREA)

Abstract

A welding seam negative defect recognition method, specifically comprising: acquiring a welding seam negative of a welding seam by means of radiography (S101); acquiring welding seam image texture feature data of the welding seam negative by utilizing an image recognition technique (S102); establishing a recognition model via a machine learning algorithm on the basis of the welding seam image texture feature data and of welding seam negative defect types (S103); acquiring the welding seam image texture feature data of a welding seam negative to be detected (S104); and calculating on the basis of the welding seam image texture feature data of the welding seam negative to be detected and of the recognition model to acquire the defect type of the welding seam negative to be detected (S105). With this, effectively solved is the problem of inaccuracy in the texture precision of welding negative recognition and feature determination, thus greatly increasing the precision of welding negative image edge detection and defect tracking and recognition, and laying a foundation for the development of a welding seam feature recognition technique.

Description

一种焊缝底片缺陷识别方法Defect recognition method for welding film 技术领域Technical field
本发明涉及油气管道安全检测领域,尤指一种焊缝底片缺陷识别方法。The invention relates to the field of safety inspection of oil and gas pipelines, in particular to a method for identifying a defect of a weld negative.
背景技术Background technique
焊接作为连接构件的一种基本工艺方法,在我国工业领域的生产和日常维护中都起到了重要作用。由于焊接施工中会产生各种各样的缺陷,受焊接过程中各种参数稳定性的影响,焊缝难免会出现夹渣、裂纹、气孔等各类缺陷,为了确保焊接构件的品质,所以有必要对焊缝缺陷进行详细的检测和合理的评价。常规无损检测方法主要有超声波检测法、X射线检测法等。X射线检测方式以其灵敏度高、直观可靠、而且重复性好等特点为后续焊接工作做出了可靠性的指导,从而在油气管道和石油化工领域应用普遍。以往对于焊缝内缺陷的具体位置及类别的判定多采用人工审阅评定,但该方法存在劳动强度大、效率低下、主观性强等缺点,同时容易受到影响质量的影响。As a basic process method of connecting members, welding has played an important role in the production and daily maintenance of China's industrial field. Due to various defects in the welding construction, affected by the stability of various parameters during the welding process, various defects such as slag inclusion, cracks, and pores will inevitably occur in the weld. In order to ensure the quality of the welded components, there are It is necessary to carry out detailed inspection and reasonable evaluation of weld defects. Conventional non-destructive testing methods mainly include ultrasonic testing and X-ray testing. The X-ray inspection method provides reliable guidance for subsequent welding work with its high sensitivity, intuitive and reliable, and good repeatability, so it is widely used in oil and gas pipelines and petrochemical fields. In the past, the specific location and type of defects in the weld were mostly judged manually. However, this method has the disadvantages of high labor intensity, low efficiency, strong subjectivity, etc., and it is easy to be affected by the quality.
X射线数字化实时成像检测技术其图像存在噪声大、对比度不高、焊缝边缘模糊且纹理较多的特点,质量难以达到规定的衡量标准,为了改善检测对象的质量,开展后续计算机图像处理是必要的,并结合计算机评片的形式完成对焊缝内缺陷的自动识别。但由于实际检测工段出现的诸多问题,如运动导致的图像抓取模糊(边缘及缺陷部分模糊粗糙)等多方面带来的噪声被夹入待检测样本中,导致识别过程耗时长、准确率低,严重限制了图像处理技术在该领域的应用;此外,对于同一个工件,检测时射线照射的角度不同,获得图像的质量也存在较大差异。针对以上问题,有以下几种方法对焊片缺陷进行提取与识别分类。X-ray digital real-time imaging detection technology has the characteristics of noisy images, low contrast, blurred weld edges and more textures. It is difficult to meet the required quality standards. In order to improve the quality of inspection objects, it is necessary to carry out subsequent computer image processing. And combined with the computer evaluation form to complete the automatic identification of defects in the weld. However, due to many problems in the actual detection process, such as motion-induced image capture blurring (edges and defects are blurred and rough), noise caused by various aspects is trapped in the sample to be detected, resulting in long recognition process and low accuracy. , Which severely limits the application of image processing technology in this field; in addition, for the same workpiece, the angle of ray irradiation during detection is different, and the quality of the obtained image also varies greatly. In view of the above problems, there are several methods to extract and identify the defects of the solder pads.
1、王鹏[1]提出的基于模糊理论的焊缝缺陷图像识别算法研究,该方法基于自动选择阈值,使用模糊集合进行灰度变换以增强图像对比度;利用最大类间方差算法(0TSu)求解自适应阈值,检测并提取焊缝边缘;依据缺陷几何特征识别不同缺陷。该方案对于一些面积较小的缺陷,二值图像细化后仅为一点,去噪后被删除。因此,对于部分缺陷使用文中方法存在较为严重的过分割现象,技术方法还有待提高与改进。1. Research on the welding defect image recognition algorithm based on fuzzy theory proposed by Wang Peng [1]. This method is based on the automatic selection of thresholds and the use of fuzzy sets for gray-scale transformation to enhance image contrast; it uses the maximum inter-class variance algorithm (0TSu) Adaptive threshold to detect and extract the edge of the weld; identify different defects based on the geometric characteristics of the defect. For some small area defects, the solution is only one point after thinning, and it is deleted after denoising. Therefore, for some defects, the method described in this paper has a serious over segmentation phenomenon, and the technical methods need to be improved and improved.
2、唐国维提出基于模糊神经网络对焊缝缺陷进行研究,用模糊集合的概念描述特征参数,建立特征参数的模糊规则库,构建以模糊化后的特征参数为输入层,以模糊规则为隐含层,缺陷预知识别分类为输出的模糊神经网络模型。分析实验结果,成功定位缺陷在数字图像中的大概位置与边缘检测;该方案对于特征集合交叉比较大的类别识别率较低。例 如未焊透与未熔合缺陷,识别率分别为92.30%、88.46%。焊缝缺陷的错误识别还与特征选取的准确程度,训练样本的多少相关。焊缝纹理特征提取涉及边界清晰度、局部信息细化程度,传统方法使用二值法LTP、LBP,CLBP纹理特征描述方法,但纹理描述的精度受到影响。同时也影响焊缝内缺陷的判断。2.Tang Guowei proposed to study weld defect based on fuzzy neural network, use the concept of fuzzy set to describe feature parameters, establish a fuzzy rule base of feature parameters, and construct fuzzy feature parameters as input layers and fuzzy rules as hidden layers. The fuzzy neural network model with layer and defect prediction recognition is classified as output. Analyzing the experimental results, the approximate location of the defect in the digital image and edge detection are successfully located; the scheme has a lower recognition rate for categories with a large feature set crossover. For example, for unwelded and unfused defects, the recognition rates are 92.30% and 88.46%, respectively. The misidentification of weld defects is also related to the accuracy of feature selection and the number of training samples. Welding seam texture feature extraction involves boundary definition and local information refinement. Traditional methods use binary method LTP, LBP, CLBP texture feature description methods, but the accuracy of texture description is affected. It also affects the judgment of defects in the weld.
发明内容Summary of the Invention
本发明目的在于提供一种克服了幅度、方向的精度不足,在分类准确率上优于单纯的形状特征轮廓直接判断法和传统的LTP、LBP,CLBP纹理特征方法的焊缝底片缺陷识别方法及系统。The purpose of the present invention is to provide a method for identifying defects in a weld film, which overcomes the lack of accuracy in amplitude and direction, and is superior in classification accuracy to the direct method of determining shape features and contours, and the traditional LTP, LBP, and CLBP texture feature methods. system.
为达上述目的,本发明所提供的焊缝底片缺陷识别方法,具体包含:通过射线成像技术获得焊缝的焊缝底片;利用图像识别技术获取焊缝底片的焊缝图像纹理特征数据;根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过机器学习算法建立识别模型;获得待检测焊缝底片的焊缝图像纹理特征数据;根据所述待检测焊缝底片的焊缝图像纹理特征数据与所述识别模型,计算获得待检测焊缝底片的缺陷类别。In order to achieve the above-mentioned object, the method for identifying a defect of a weld negative provided by the present invention specifically includes: obtaining a weld negative of a weld by radiography; obtaining image texture feature data of a weld negative of a weld negative by using image recognition technology; The welding image texture feature data and the defect type of the weld backsheet are used to establish a recognition model by a machine learning algorithm; the weld image texture feature data of the weld backsheet to be inspected is obtained; and the weld image texture feature is based on the weld backsheet to be inspected The data and the identification model are used to calculate and obtain the defect category of the weld backsheet to be detected.
在上述焊缝底片缺陷识别方法中,优选的,所述利用图像识别技术获取焊缝底片的焊缝图像纹理特征数据包含:利用图像识别技术获取焊缝底片的大小信息、符号信息以及中心区域信息,根据所述大小信息、所述符号信息以及所述中心区域信息获得焊缝底片的焊缝图像纹理特征数据。In the above-mentioned welding film defect recognition method, preferably, the use of image recognition technology to obtain the weld image texture feature data of the welding film includes: using the image recognition technology to obtain the size information, the symbol information, and the central region information of the welding film. , Obtaining the texture feature data of the weld image of the weld negative based on the size information, the symbol information, and the central area information.
在上述焊缝底片缺陷识别方法中,优选的,利用图像识别技术获取焊缝底片的大小信息包含:通过以下公式计算获得焊缝底片的大小信息;In the above-mentioned welding film defect recognition method, preferably, obtaining the size information of the welding film by using the image recognition technology includes: obtaining the size information of the welding film by the following formula;
Figure PCTCN2019101716-appb-000001
Figure PCTCN2019101716-appb-000001
Figure PCTCN2019101716-appb-000002
Figure PCTCN2019101716-appb-000002
在上式中,a,b为自定义常量,TH为预定阈值,p为像素点个数。In the above formula, a and b are custom constants, TH is a predetermined threshold, and p is the number of pixels.
在上述焊缝底片缺陷识别方法中,优选的,利用图像识别技术获取焊缝底片的符号信息包含:通过以下公式计算获得焊缝底片的符号信息;In the above-mentioned method for identifying the defect of a weld negative, preferably, obtaining the symbol information of the weld negative by using image recognition technology includes: obtaining the symbol information of the weld negative by calculating by the following formula;
Figure PCTCN2019101716-appb-000003
Figure PCTCN2019101716-appb-000003
Figure PCTCN2019101716-appb-000004
Figure PCTCN2019101716-appb-000004
在上式中,CLTP_S *为符号信息,TH为预定阈值,p为像素点个数。 In the above formula, CLTP_S * is the symbol information, TH is a predetermined threshold, and p is the number of pixels.
在上述焊缝底片缺陷识别方法中,优选的,利用图像识别技术获取焊缝底片的中心区域信息包含:通过以下公式计算获得焊缝底片的中心区域信息;In the above-mentioned welding film defect recognition method, preferably, obtaining the center region information of the welding film by using image recognition technology includes: obtaining the center region information of the welding film by the following formula;
Figure PCTCN2019101716-appb-000005
Figure PCTCN2019101716-appb-000005
在上式中,CLTP_C *为中心区域信息,TH1为图像像素均值。 In the above formula, CLTP_C * is the central area information, and TH1 is the average value of the image pixels.
在上述焊缝底片缺陷识别方法中,优选的,根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过机器学习算法建立识别模型还包含:利用缺陷边缘检测和跟踪处理技术获得所述焊缝图像纹理特征数据中预定类别的特征参数;根据所述特征参数与焊缝底片的缺陷类别建立缺陷特征数据库;根据所述缺陷特征数据库通过机器学习算法建立识别模型。In the above-mentioned welding film defect recognition method, preferably, establishing a recognition model by a machine learning algorithm based on the texture image feature data of the welding seam and the defect category of the welding film further includes: obtaining the detection using a defect edge detection and tracking processing technology. A feature parameter of a predetermined category in the texture feature data of the weld image; a defect feature database is established according to the feature parameter and a defect category of the weld negative; and a recognition model is established by a machine learning algorithm according to the defect feature database.
在上述焊缝底片缺陷识别方法中,优选的,所述特征参数包含:焊片编号、图像长度像素、图像宽度像素、缺陷与背景的灰度差、缺陷的相对位置、缺陷自身灰度偏差、缺陷长宽比、等效面积、圆形度、熵、相关度、惯性矩、能量。In the above-mentioned welding film defect recognition method, preferably, the characteristic parameters include: welding plate number, image length pixel, image width pixel, gray difference between the defect and the background, relative position of the defect, gray deviation of the defect itself, Defect aspect ratio, equivalent area, circularity, entropy, correlation, moment of inertia, energy.
在上述焊缝底片缺陷识别方法中,优选的,根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过机器学习算法建立识别模型包含:根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过SVM(支持向量机)分类算法建立SVM模型。In the above-mentioned welding film defect recognition method, preferably, establishing a recognition model by a machine learning algorithm based on the welding image texture feature data and the welding seam film defect type includes: according to the welding seam image texture feature data and the welding seam The defect categories of the negatives are used to build an SVM model using an SVM (Support Vector Machine) classification algorithm.
在上述焊缝底片缺陷识别方法中,优选的,所述通过SVM分类算法建立SVM模型还包含:通过全局优化方法获得所述SVM模型中分类器的类别数量;根据类别差异性排除法构建各类别的所述分类器;所述分类器的类别包含:裂纹、圆形夹渣、条形夹渣、气孔、未焊透、未熔合。In the above-mentioned welding film defect recognition method, preferably, the establishing the SVM model by the SVM classification algorithm further includes: obtaining a number of categories of the classifier in the SVM model by a global optimization method; and constructing each category according to a category difference exclusion method. The classifier; the categories of the classifier include: cracks, circular slag inclusions, strip slag inclusions, air holes, not welded through, and not fused.
本发明还提供一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述的焊缝底片缺陷识别方法的步骤。The present invention also provides an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the method for identifying the above-mentioned weld film defect identification method is implemented. step.
本发明还提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现上述的焊缝底片缺陷识别方法的步骤。The present invention also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned method for identifying a defect in a weld film are implemented.
本发明所提供的焊缝底片缺陷识别方法及系统有效解决了焊接底片识别的纹理精度和特征判断不准问题,使焊接底片图像边缘检测和缺陷跟踪识别精度大大提高,为焊缝特征识别技术的发展打下基础。The method and system for identifying the defect of a weld negative film provided by the present invention effectively solve the problems of inaccurate texture accuracy and inaccurate judgment of the characteristics of the weld negative identification, and greatly improve the accuracy of the edge detection and defect tracking identification of the weld negative image. Laying the foundation for development.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,并不构成对本发明的限定。在附图中:The drawings described herein are used to provide a further understanding of the present invention, and constitute a part of the present application, and do not constitute a limitation on the present invention. In the drawings:
图1为本发明一实施例所提供的焊缝底片缺陷识别方法的流程示意图;FIG. 1 is a schematic flowchart of a method for identifying a defect of a weld negative film according to an embodiment of the present invention; FIG.
图2为本发明一实施例所提供的完全局部三值模式(CLTP)计算示意图;2 is a schematic diagram of a complete local three-valued mode (CLTP) calculation provided by an embodiment of the present invention;
图3为本发明一实施例所提供的SVM多类分类器构造示意图;3 is a schematic structural diagram of an SVM multi-class classifier according to an embodiment of the present invention;
图4为本发明一实施例所提供的焊缝底片缺陷识别系统的结构示意图;4 is a schematic structural diagram of a welding film defect recognition system according to an embodiment of the present invention;
图5为本发明一实施例所提供的电子设备的结构示意图。FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
具体实施方式detailed description
为使本发明实施例的目的、技术方案和优点更加清楚明白,下面结合实施例和附图,对本发明做进一步详细说明。在此,本发明的示意性实施例及其说明用于解释本发明,但并不作为对本发明的限定。In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following further describes the present invention in detail with reference to the embodiments and the accompanying drawings. Here, the exemplary embodiments of the present invention and the description thereof are used to explain the present invention, but are not intended to limit the present invention.
在本说明书的描述中,参考术语“一实施例”、“一具体实施例”、“例如”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。各实施例中涉及的步骤顺序用于示意性说明本申请的实施,其中的步骤顺序不作限定,可根据需要作适当调整。In the description of this specification, the description with reference to the terms “an embodiment”, “a specific embodiment”, “for example”, etc. means that specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in this application In at least one embodiment or example. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. The sequence of steps involved in each embodiment is used to schematically illustrate the implementation of this application, and the sequence of steps therein is not limited, and can be appropriately adjusted as needed.
近年来,中国管道建设高速发展,已近12.5万公里,2020年未来规划将达到16.9万公里,管道建设焊接检测技术的可靠性直接影响管道建设质量和未来运行的安全,由于建设量大,射线成像技术已经在管道焊接检测过程中普遍使用,射线成像为智能化辅助评片打下基础,虽然计算机智能辅助评片发展迅速,目前一定数量的底片分析处理系统已经投入使用,但这些系统应用还不成熟,目前的评片工作大多情况下需要人工干预,人机交互的进行。射线底片缺陷识别是通过底片的数字化处理,依靠计算机的高速处理能力,将人工评片的工作转化为图像处理技术,焊缝底片的标准化图像处理技术,包括图像预处理,图像焊缝区域的分割,缺陷特征提取,缺陷分类识别等工作,最终将缺陷 结果显示出来。因此,完全的计算机智能评片系统是射线检测的一个非常重要的研究分支。In recent years, China ’s pipeline construction has developed at a rapid rate of nearly 125,000 kilometers. In 2020, the future plan will reach 169,000 kilometers. The reliability of pipeline construction welding inspection technology directly affects the quality of pipeline construction and the safety of future operations. Imaging technology has been widely used in the pipeline welding inspection process. Ray imaging has laid the foundation for intelligent auxiliary evaluation. Although computer-assisted intelligent evaluation has developed rapidly, a certain number of negative film analysis processing systems have been put into use, but the application of these systems is not yet Mature, most of the current review work requires manual intervention and human-computer interaction. X-ray film defect recognition is through the digital processing of negatives and the high-speed processing capabilities of computers to convert the manual evaluation into image processing technology. The standardized image processing technology for weld negatives includes image preprocessing and segmentation of image weld areas. , Defect feature extraction, defect classification and recognition, and finally display the defect results. Therefore, a complete computer intelligent evaluation system is a very important research branch of radiographic inspection.
为有效根据焊缝底片准确识别出各焊缝缺陷情况,本发明一实施例提供了一种焊缝底片缺陷识别方法,请参考图1所示,所述方法具体包含:S101通过射线成像技术获得焊缝的焊缝底片;S102利用图像识别技术获取焊缝底片的焊缝图像纹理特征数据;S103根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过机器学习算法建立识别模型;S104获得待检测焊缝底片的焊缝图像纹理特征数据;S105根据所述待检测焊缝底片的焊缝图像纹理特征数据与所述识别模型,计算获得待检测焊缝底片的缺陷类别。在该实施例中,首先利用射线成像技术获得焊缝的焊缝底片,其后根据已知焊缝的缺陷类型以及根据图像识别技术所识别出的焊缝图像纹理特征数据训练机器模型,根据训练后的机器模型获得用于识别焊缝底片缺陷类型的识别模型;其后当获得待检测的焊缝底片后,即可根据待检测焊缝底片的焊缝图像纹理特征数据与所述识别模型直接确定该焊缝的缺陷类型;该方法相较于现有的放来来讲,不仅识别准确率更高,且更为效率。In order to effectively identify the defects of each welding seam according to the welding film, an embodiment of the present invention provides a welding film defect recognition method. Please refer to FIG. 1, the method specifically includes: S101 is obtained by radiography technology Weld seam negatives of the weld seam; S102 uses image recognition technology to obtain the seam image texture feature data of the seam negative film; S103 establishes a recognition model through a machine learning algorithm based on the seam image texture feature data and the defect type of the seam negative film; S104 Obtaining the texture feature data of the weld image of the to-be-detected backsheet; S105 calculating and obtaining the defect category of the weld plate of the to-be-tested according to the texture feature data of the weld image of the to-be-detected backsheet and the recognition model. In this embodiment, first, a radiographic image of the weld seam is obtained by using radiographic imaging technology, and then a machine model is trained based on the known defect types of the weld seam and the texture feature data of the weld seam image identified according to image recognition technology. The subsequent machine model obtains an identification model for identifying the type of the weld negative film defect; after obtaining the weld negative film to be inspected, the texture feature data of the weld image of the weld negative film to be inspected can be directly used with the recognition model. Determine the defect type of the weld; compared with the existing amplifier, this method not only has higher recognition accuracy, but also is more efficient.
在上述实施例中的图像识别技术中特征提取方法有以下两类:线性投影特征抽取和非线性特征抽取方法;线性投影分析中,最具有代表性的是PCA(主分量分析)和LDA(Fisher线性鉴别分析);其所提取的图像特征主要表现为纹理特征和形态(形状)特征,针对焊缝而言,则一类是焊缝缺陷几何特征的提取,另一类是焊缝缺陷纹理特征的提取。几何特征的提取是缺陷的大小、形状、椭圆度、长宽比等的量化,目前一般采用形状特征轮廓直接判断法,存在判断精度不足,准确率不高的情况;焊缝纹理特征提取是设计边界清晰度、局部信息细化程度等,其中纹理特征应用更为广泛,表现比较稳定,通常性能优于单纯的形状特征描述。基于上述情况,本发明一实施例中,所述利用图像识别技术获取焊缝底片的焊缝图像纹理特征数据包含:利用图像识别技术获取焊缝底片的大小信息、符号信息以及中心区域信息,根据所述大小信息、所述符号信息以及所述中心区域信息获得焊缝底片的焊缝图像纹理特征数据。在该实施例中,主要是由本发明所提出的改进的CTLP(Complete Local Ternary Patterns)算法来获得焊缝底片的焊缝图像纹理特征数据,该提取的焊缝图像纹理特征方法保留更丰富的纹理结构信息,重构了中心描述子的基础上,更包括符号描述子和大小描述子;其主要分为3个分量:两个分量包含大小信息、符号信息,另一分量保留焊缝图像中心区域信息,以此实现纹理特征与焊缝形状特征相融合,表征数据更为贴近实际情况。In the image recognition technology in the above embodiments, there are two types of feature extraction methods: linear projection feature extraction and non-linear feature extraction methods; in linear projection analysis, the most representative are PCA (Principal Component Analysis) and LDA (Fisher Linear discriminant analysis); the extracted image features are mainly represented by texture features and morphological (shape) features. For welds, one is the extraction of geometric features of weld defects, and the other is the texture features of weld defects. Extraction. The extraction of geometric features is the quantification of the size, shape, ellipticity, and aspect ratio of defects. At present, the direct judgment method of shape features is generally used. There are cases where the judgment accuracy is insufficient and the accuracy rate is not high. Welding texture feature extraction is designed. Boundary definition, local information refinement, etc. Among them, texture features are more widely used, and their performance is more stable. Generally, their performance is better than simple shape feature description. Based on the foregoing, in an embodiment of the present invention, the obtaining the weld image texture feature data of the weld negative by using image recognition technology includes: obtaining the size information, symbol information, and center area information of the weld negative by using image recognition technology. The size information, the symbol information, and the central area information are used to obtain the texture feature data of the weld image of the weld negative. In this embodiment, the improved CTLP (Complete Local Local Ternary Patterns) algorithm proposed by the present invention is used to obtain the weld image texture feature data of the weld negative. The extracted weld image texture feature method retains richer textures. Structure information, based on the reconstruction of the central descriptor, including the symbol descriptor and the size descriptor; it is mainly divided into three components: two components contain size information, symbol information, and the other component retains the center area of the weld image Information, to achieve the fusion of texture features and weld shape features, the characterization data is closer to the actual situation.
在实际工作中,焊缝纹理特征提取涉及边界清晰度、局部信息细化程度,传统方法使用二值法LTP、LBP,CLBP纹理特征描述方法,但纹理描述的精度受到影响,因此,需要不断改进算法;为此,在本发明一实施例中,提出了完全局部三值CLTP模式,包含3种核心算子,称为中心描述子,符号描述子和大小描述子,分别用CLTP_C,CLTP_S,CLTP_M表示,将算子转化后,最终得到修正的CLTP_C *、CLTP_S *、CLTP_M *来分别表示中心区域信息、符号信息以及大小信息,它们的计算过程如下: In actual work, the extraction of weld texture features involves boundary sharpness and local information refinement. Traditional methods use binary method LTP, LBP, CLBP texture feature description methods, but the accuracy of texture description is affected, so continuous improvement is needed. Algorithm; To this end, in an embodiment of the present invention, a fully local three-valued CLTP mode is proposed, which includes three core operators, called the central descriptor, the symbol descriptor, and the size descriptor, respectively using CLTP_C, CLTP_S, and CLTP_M Represents that after transforming the operators, CLTP_C * , CLTP_S * , and CLTP_M * are finally obtained to represent the central area information, symbol information, and size information, respectively. Their calculation process is as follows:
CLTP_S *即符号信息计算等同于CLTP_M *即大小信息的计算: CLTP_S * calculation of symbol information is equivalent to CLTP_M * calculation of size information:
其中,
Figure PCTCN2019101716-appb-000006
among them,
Figure PCTCN2019101716-appb-000006
Figure PCTCN2019101716-appb-000007
Figure PCTCN2019101716-appb-000007
其中,TH的含义是给定的某个固定阈值,a,b为自定义常量,可取a=0.3,b=0.7。Among them, the meaning of TH is a given fixed threshold, a and b are custom constants, and a = 0.3 and b = 0.7 are preferable.
至于中心区域信息CLTP_C *则等于:
Figure PCTCN2019101716-appb-000008
其中,TH1为图像像素均值,然后用
Figure PCTCN2019101716-appb-000009
模式分别转化编码值,CLTP_S *CLTP_M *,CLTP_C *分别对应图2所示。
As for the central area information CLTP_C * is equal to:
Figure PCTCN2019101716-appb-000008
Among them, TH1 is the average value of image pixels, and then use
Figure PCTCN2019101716-appb-000009
The modes are converted into encoded values, CLTP_S * CLTP_M * and CLTP_C * respectively corresponding to those shown in FIG. 2.
在上述实施例中,CLTP算法主要是利用了现有纹理提取算法中丢失的一些幅度信息来提高识别率,在得到CLTP特征之后,为了达到算法具有完全旋转不变性的目的,本发明构造了均匀模式的直方图傅里叶特征;具体的,为构造完全局部三值模式,将符号p s按给定的阈值重新赋值,将其改写为下面的形式:中心像素点依然为gc,邻域半径为R,邻域中的像素为gp,其中P的取值为:p=[0,1…,P-1],像素的个数为P,并且将中心像素和邻域像素点的差值记为dp=gp-gc。其中,dp的值有两部分组成,一部分是符号部分,一部分是数值相差的绝对值,分别记为sp和mp,那么dp就可以由这两个部分相乘来表示,即dp=sp.mp,符号部分和数值部分可以这样表示,In the above embodiment, the CLTP algorithm mainly uses some amplitude information lost in the existing texture extraction algorithm to improve the recognition rate. After obtaining the CLTP feature, in order to achieve the purpose of the algorithm having complete rotation invariance, the present invention constructs a uniform The Fourier feature of the histogram of the pattern; specifically, to construct a fully local three-valued pattern, re-assign the symbol ps according to a given threshold and rewrite it to the following form: the center pixel is still gc, and the neighborhood radius Is R, the pixels in the neighborhood are gp, where the value of P is: p = [0,1 ..., P-1], the number of pixels is P, and the difference between the center pixel and the pixels in the neighborhood is Let dp = gp-gc. Among them, the value of dp consists of two parts, one is the symbol part, and the other is the absolute value of the difference between the values, which are denoted as sp and mp, respectively. Then dp can be expressed by multiplying the two parts, that is, dp = sp.mp , The symbolic part and numerical part can be expressed like this,
Figure PCTCN2019101716-appb-000010
Figure PCTCN2019101716-appb-000010
为了构造出上述实施例中的完全局部三值模式,可将符号部分按照给定的阈值重新赋值,最终得到修正的CLTP_C *、CLTP_S *、CLTP_M *来分别表示中心区域信息、符号信息以及大小信息。 In order to construct a completely local three-valued pattern in the above embodiment, the symbol part can be re-assigned according to a given threshold, and finally modified CLTP_C * , CLTP_S * , CLTP_M * are used to represent the central area information, symbol information, and size information .
在该图中,a表示的是中心像素为38的3×3样本块,邻域的8个像素为[27,72,69,32,25,43,26,88];b中abs即绝对值,TH=24为求得的阈值,计算局部差值,得到的算子结果为[-11,34,31,-6,-13,5,-12,50];c中,CLTP_S *局部差值符号的三值编码向量为[0,2,2,0,0,1,0,2];d中,CLTP_M *算子值为[1,2,2,0,1,0,1,2];e中TH1=47.75由[27,72,69,32,25,43,26,88]计的平均值,表示CLTP的CLTP_C *值为[01100101]。 In the figure, a represents a 3 × 3 sample block with a center pixel of 38, and the eight pixels in the neighborhood are [27,72,69,32,25,43,26,88]; abs in b is absolute Value, TH = 24 is the obtained threshold, calculate the local difference, and the obtained operator result is [-11, 34, 31, -6, -13, 5, -12, 50]; in CL, CLTP_S * local The three-valued encoding vector of the difference sign is [0, 2, 2, 0, 0, 1, 0, 2]; in d, the CLTP_M * operator value is [1,2,2,0,1,0,1 , 2]; TH1 = 47.75 in e is the average value calculated from [27, 72, 69, 32, 25, 43, 26, 88], which indicates that the CLTP_C * value of CLTP is [01100101].
在构建识别模型之前,还可建立底片缺陷库;在本发明一实施例中,根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过机器学习算法建立识别模型还包含:利用缺陷边缘检测和跟踪处理技术获得所述焊缝图像纹理特征数据中预定类别的特征参数;根据所述特征参数与焊缝底片的缺陷类别建立缺陷特征数据库;根据所述缺陷特征数据库通过机器学习算法建立识别模型。其中,所述特征参数包含:焊片编号、图像长度像素、图像宽度像素、缺陷与背景的灰度差、缺陷的相对位置、缺陷自身灰度偏差、缺陷长宽比、等效面积、圆形度、熵、相关度、惯性矩、能量。在实际工作中,该实施例主要综合以上形状特征和纹理特征,对应的底片黑度不同形成不同缺陷特征,来构建如下表1所示的缺陷特征数据库。Before constructing the recognition model, a film defect library can also be established. In an embodiment of the present invention, establishing a recognition model by a machine learning algorithm based on the texture image data of the weld image and the defect category of the weld film also includes: using defect edges The detection and tracking processing technology obtains feature parameters of a predetermined category in the texture feature data of the weld image; establishes a defect feature database according to the feature parameters and the defect category of the weld negative; and establishes recognition through a machine learning algorithm according to the defect feature database model. The characteristic parameters include: pad number, image length pixel, image width pixel, gray difference between defect and background, relative position of defect, gray deviation of defect itself, defect aspect ratio, equivalent area, circle Degree, entropy, correlation, moment of inertia, energy. In actual work, this embodiment mainly integrates the above shape features and texture features, and the corresponding film blackness is different to form different defect features to construct a defect feature database shown in Table 1 below.
表1Table 1
Figure PCTCN2019101716-appb-000011
Figure PCTCN2019101716-appb-000011
Figure PCTCN2019101716-appb-000012
Figure PCTCN2019101716-appb-000012
该缺陷特征数据库,包含灰度差、等效面积、圆形度、熵、相关度等参数,便于后期通过机器学习算法完善所述识别模型,同时该缺陷特征数据库进一步表征了焊缝缺陷的特征大小、符号信息和中心区域信息,该算法克服了幅度、方向的精度不足,在分类准确率上优于单纯的形状特征轮廓直接判断法和传统的LTP、LBP,CLBP纹理特征方法。The defect feature database contains parameters such as grayscale difference, equivalent area, circularity, entropy, correlation, etc., which facilitates the improvement of the recognition model by machine learning algorithms at the later stage. At the same time, the defect feature database further characterizes the characteristics of weld defects The size, symbol information and central area information, the algorithm overcomes the lack of precision in amplitude and direction, and is superior to the simple shape feature contour direct judgment method and the traditional LTP, LBP, CLBP texture feature methods in classification accuracy.
在本发明一优选的实施例中,根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过机器学习算法建立识别模型包含:根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过SVM分类算法建立SVM模型。其中,所述通过SVM分类算法建立SVM模型还包含:通过全局优化方法获得所述SVM模型中分类器的类别数量;根据类别差异性排除法构建各类别的所述分类器;所述分类器的类别包含:裂纹、圆形夹渣、条形夹渣、气孔、未焊透、未熔合。在实际工作中,构建多分类器的SVM模型即M-SVM分类器时,可使用单个类与剩下的类进行构造,确定这个分类器的判断标准,对所有的类别重复以上的过程,求出每个判断函数的值,将这些数值进行对比,最大的类别即为样本的最好分类结构。在该方法中,需要构造M个分类器,使用直接全局优化方法(M-SVM),构造多批分类器,对M个分类器的求解一次性完成;具体方法可如下所示:In a preferred embodiment of the present invention, establishing a recognition model by a machine learning algorithm based on the weld image texture feature data and the defect type of the weld backsheet includes: according to the weld image texture feature data and the defect of the weld backsheet The SVM model is established by the SVM classification algorithm. Wherein, the establishment of the SVM model by the SVM classification algorithm further includes: obtaining the number of classes of the classifier in the SVM model through a global optimization method; constructing the classifiers of each class according to a class difference exclusion method; Categories include: cracks, round slag inclusions, strip slag inclusions, pores, not welded, and not fused. In actual work, when constructing a multi-classifier SVM model, that is, an M-SVM classifier, a single class and the remaining classes can be used to determine the criteria for determining this classifier. Repeat the above process for all classes. Find out the value of each judgment function and compare these values. The largest category is the best classification structure of the sample. In this method, it is necessary to construct M classifiers, use the direct global optimization method (M-SVM), construct multiple batches of classifiers, and solve the M classifiers at one time; the specific method can be as follows:
设:
Figure PCTCN2019101716-appb-000013
为样本训练集,l为样本个数,N代表样本维数,M代表样本的类别,引入非负松弛变量ξ i,则该方法的优化问题如以下公式:
Assume:
Figure PCTCN2019101716-appb-000013
Is the sample training set, l is the number of samples, N is the number of samples, and M is the type of the sample. The non-negative relaxation variable ξ i is introduced. The optimization problem of this method is as follows:
Figure PCTCN2019101716-appb-000014
Figure PCTCN2019101716-appb-000014
判别函数为:ST.y i(w Tφ(x i)+b)≥1-ξ i The discriminant function is: ST.y i (w T φ (x i ) + b) ≥1-ξ i
其中,ξ i≥0,i=1,2,...l,φ(*)为输入空间到高维特征空间的非线性映射函数,通过求解最优化问题,可得到相应的最优决策函数f(x): Among them, ξ i ≥0, i = 1,2, ... l, φ (*) is a non-linear mapping function from the input space to the high-dimensional feature space. By solving the optimization problem, the corresponding optimal decision function can be obtained. f (x):
Figure PCTCN2019101716-appb-000015
Figure PCTCN2019101716-appb-000015
在上述实施例中,各分类器构造应优先采用类别差异性排除法,即在整体结构中,先将相似量作为一类,然后根据相似量之间的细微变化,再通过模型算法进行区分。这种分类在分类准确率和平衡准确率上都有极高的效率。具体本文构造了6种缺陷,裂纹、 圆形夹渣、条形夹渣、气孔、未焊透、未熔合等典型缺陷SVM多类分类器。如下图3所示。In the above embodiment, each classifier structure should preferentially adopt the method of class difference exclusion, that is, in the overall structure, firstly, the similarity is regarded as a category, and then based on the small changes between the similarities, the model algorithm is used to distinguish. This classification has extremely high efficiency in classification accuracy and balance accuracy. Specifically, this paper constructs six types of defects, such as cracks, circular slag inclusions, strip slag inclusions, pores, unwelded, unfused, and other typical defects. As shown in Figure 3 below.
为检测上述焊缝底片缺陷识别方法的有效性,采用上述模型,首先对焊缝底片进行完全局部三值模式CLTP纹理识别,采用缺陷边缘检测和跟踪处理技术计算各参数,上述纹理识别和特征识别计算参数包括:图像长度像素、图像宽度像素、缺陷与背景的灰度差△h、缺陷的相对位置d、缺陷自身灰度偏差δ、缺陷长宽比、等效面积S/C、圆形度e、熵ENT、相关度COR、惯性矩CON、能量参数等,所有特征参数输入到SVM模型,进行SVM焊接底片的缺陷识别,最终得到缺陷的类别。焊接底片经过完全局部三值模式CLTP纹理识别后,应用基于缺陷数据库的SVM数据分类技术,CTLP模式使焊接底片图像边缘检测和缺陷跟踪识别精度大大提高,SVM缺陷分类模型使图像缺陷的自动识别判断上准确度大大提高,基本达到了工业应用级的水平。利用上述方法验证中国西气东输管道7.28事故段焊口X-射线底片,在位置点38位置左下方体现未熔合特征,其计算机系统判别与人工评片结果完全一致。再利用上述方法验证中国陕京二线焊接底片,表现为未焊透特征,主要的缺陷位于位置点6-7之间,由此可见该方法具有较好的精度和准确性。In order to test the effectiveness of the above-mentioned welding film defect recognition method, using the above model, firstly perform a full local three-valued mode CLTP texture recognition on the welding film, and use defect edge detection and tracking processing technology to calculate various parameters. The calculation parameters include: image length pixels, image width pixels, the gray difference between the defect and the background Δh, the relative position d of the defect, the gray deviation of the defect itself δ, the defect aspect ratio, the equivalent area S / C, and the circularity e. Entropy ENT, correlation COR, moment of inertia CON, energy parameters, etc. All the characteristic parameters are input to the SVM model, and the defects of the SVM welding film are identified, and the category of the defects is finally obtained. After the welded negatives are completely identified by the CLTP texture in the local three-valued mode, the SVM data classification technology based on the defect database is applied. The CTLP mode greatly improves the accuracy of edge detection and defect tracking identification of welded negatives. The SVM defect classification model enables automatic recognition and judgment of image defects. The accuracy has been greatly improved, and has basically reached the level of industrial application. The above method was used to verify that the X-ray film of the weld at the 7.28 accident section of the West-East China Gas Pipeline shows the unfused characteristic at the lower left of position 38, and its computer system judgment is completely consistent with the result of manual evaluation. The above method was used to verify that the second-line welded negative film of Shaanxi-Beijing in China showed the characteristics of incomplete penetration, and the main defects were located between the position points 6-7. This shows that the method has better accuracy and accuracy.
在请参考图4所示,本发明一实施例还提供一种焊缝底片缺陷识别系统,所述系统包含数据获取单元、模型构造单元和识别单元;所述数据获取单元用于通过射线成像技术获得焊缝的焊缝底片;以及利用图像识别技术获取焊缝底片的焊缝图像纹理特征数据;所述模型构造单元用于根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过机器学习算法建立识别模型;所述识别单元用于获得待检测焊缝底片的焊缝图像纹理特征数据;以及根据所述待检测焊缝底片的焊缝图像纹理特征数据与所述识别模型,计算获得待检测焊缝底片的缺陷类别。As shown in FIG. 4, an embodiment of the present invention further provides a welding film defect recognition system. The system includes a data acquisition unit, a model construction unit, and an identification unit. The data acquisition unit is used for radiography technology. Obtaining the weld seam film of the weld seam; and obtaining the seam image texture feature data of the weld seam film using image recognition technology; the model construction unit is configured to pass the machine according to the weld image texture feature data and the defect type of the weld seam film A learning algorithm establishes a recognition model; the recognition unit is configured to obtain texture feature data of a weld image of a negative plate of the weld to be tested; and calculate and obtain the texture feature data of the weld image of the negative plate of the weld to be tested and the recognition model Defect category of the negative to be tested.
管道缺陷的纹理特征和形状特征的识别和描述,以及缺陷的精准判断,是计算机图像自动识别的难题,也是焊接智能化面临的主要问题。本发明所提供的焊缝底片缺陷识别方法及系统解决了焊接底片识别的纹理精度和特征判断不准问题,其给出了一种改进的CTLP算法,重构了中心描述子,包括符号描述子和大小描述子,表征了焊缝缺陷的特征大小、符号信息和中心区域信息;继而建立了焊缝底片图像缺陷特征库,包含形状特征和纹理特征,图像长度像素、图像宽度像素、缺陷与背景的灰度差△h、缺陷的相对位置d、缺陷自身灰度偏差δ、缺陷长宽比、等效面积S/C、圆形度e、熵ENT、相关度COR、惯性矩CON、能量等参数;同时在该缺陷特征数据库的基础上训练获得支持向量 机(SVM)分类模型,基于缺陷特征数据库,分类获取了缺陷形状特征,找出裂纹、夹渣、气孔、未焊透、未熔合、条形缺陷等缺陷特征。综上所示,本发明通过采用改进的CTLP算法和SVM分类算法的融合处理技术,使焊缝缺陷特征描述更加准确,克服了以往算法在幅度、方向精度、缺陷特征易混淆等方面的不足,在准确率上优于形状特征的轮廓特征直接判断法和传统的LTP、LBP,CLBP纹理特征描述方法;基于CLTP纹理&形状特征的管道焊缝缺陷SVM方法具有较好的精度,使焊接底片图像边缘检测和缺陷跟踪识别精度大大提高,为焊缝特征识别技术的发展打下基础。The identification and description of the texture features and shape features of pipeline defects, and the accurate judgment of defects, are the problems of automatic computer image recognition and the main problems facing intelligent welding. The method and system for identifying weld film defects in the present invention solve the problem of inaccurate texture accuracy and feature judgment of weld film identification. An improved CTLP algorithm is provided, and the central descriptor is reconstructed, including the symbol descriptor. And size descriptors, which characterize the feature size, symbol information, and central area information of the weld defect; then establish a weld image defect feature library that includes shape features and texture features, image length pixels, image width pixels, defects and background Gray difference △ h, relative position of defect d, gray deviation of defect itself δ, defect aspect ratio, equivalent area S / C, circularity e, entropy ENT, correlation COR, moment of inertia CON, energy, etc. Parameters; at the same time, based on the defect feature database, a support vector machine (SVM) classification model is trained. Based on the defect feature database, the defect shape features are obtained by classification, and cracks, slag inclusions, pores, unwelded, unfused, Defect characteristics such as strip defects. In summary, the present invention uses the fusion processing technology of the improved CTLP algorithm and the SVM classification algorithm to make the weld defect feature description more accurate, and overcomes the shortcomings of the previous algorithms in terms of amplitude, directional accuracy, and easily confused defect features. The contour feature direct judgment method is superior to the shape feature in the accuracy rate and the traditional LTP, LBP, CLBP texture feature description method; the pipe weld seam defect SVM method based on CLTP texture & shape feature has better accuracy, which makes the welding negative image The accuracy of edge detection and defect tracking recognition has been greatly improved, laying a foundation for the development of weld feature recognition technology.
本发明还提供一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述的焊缝底片缺陷识别方法的步骤。The present invention also provides an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the method for identifying the above-mentioned weld film defect identification method is implemented. step.
本发明还提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现上述的焊缝底片缺陷识别方法的步骤。The present invention also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned method for identifying a defect in a weld film are implemented.
如图5所示,该电子设备600还可以包括:通信模块110、输入单元120、音频处理单元130、显示器160、电源170。值得注意的是,电子设备600也并不是必须要包括图5中所示的所有部件;此外,电子设备600还可以包括图5中没有示出的部件,可以参考现有技术。As shown in FIG. 5, the electronic device 600 may further include a communication module 110, an input unit 120, an audio processing unit 130, a display 160, and a power source 170. It is worth noting that the electronic device 600 does not necessarily need to include all the components shown in FIG. 5; in addition, the electronic device 600 may also include components not shown in FIG. 5, and reference may be made to the prior art.
如图5所示,中央处理器100有时也称为控制器或操作控件,可以包括微处理器或其他处理器装置和/或逻辑装置,该中央处理器100接收输入并控制电子设备600的各个部件的操作。As shown in FIG. 5, the central processing unit 100 is sometimes referred to as a controller or an operation control, and may include a microprocessor or other processor devices and / or logic devices. The central processing unit 100 receives input and controls each of the electronic devices 600. Operation of parts.
其中,存储器140,例如可以是缓存器、闪存、硬驱、可移动介质、易失性存储器、非易失性存储器或其它合适装置中的一种或更多种。可储存上述与失败有关的信息,此外还可存储执行有关信息的程序。并且中央处理器100可执行该存储器140存储的该程序,以实现信息存储或处理等。The memory 140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory, or other suitable devices. The above-mentioned failure-related information can be stored, and a program for executing the related information can also be stored. In addition, the central processing unit 100 may execute the program stored in the memory 140 to implement information storage or processing.
输入单元120向中央处理器100提供输入。该输入单元120例如为按键或触摸输入装置。电源170用于向电子设备600提供电力。显示器160用于进行图像和文字等显示对象的显示。该显示器例如可为LCD显示器,但并不限于此。The input unit 120 provides input to the central processing unit 100. The input unit 120 is, for example, a key or a touch input device. The power source 170 is used to provide power to the electronic device 600. The display 160 is used for displaying display objects such as images and characters. The display may be, for example, an LCD display, but is not limited thereto.
该存储器140可以是固态存储器,例如,只读存储器(ROM)、随机存取存储器(RAM)、SIM卡等。还可以是这样的存储器,其即使在断电时也保存信息,可被选择性地擦除且设有更多数据,该存储器的示例有时被称为EPROM等。存储器140还可以是某种其它类型的装置。存储器140包括缓冲存储器141(有时被称为缓冲器)。存储 器140可以包括应用/功能存储部142,该应用/功能存储部142用于存储应用程序和功能程序或用于通过中央处理器100执行电子设备600的操作的流程。The memory 140 may be a solid-state memory, such as a read-only memory (ROM), a random access memory (RAM), a SIM card, and the like. It may also be a memory that holds information even when power is off, can be selectively erased and is provided with more data, and an example of the memory is sometimes called EPROM or the like. The memory 140 may also be some other type of device. The memory 140 includes a buffer memory 141 (sometimes referred to as a buffer). The memory 140 may include an application / function storage section 142 for storing application programs and function programs or a flow for performing operations of the electronic device 600 through the central processing unit 100.
存储器140还可以包括数据存储部143,该数据存储部143用于存储数据,例如联系人、数字数据、图片、声音和/或任何其他由电子设备使用的数据。存储器140的驱动程序存储部144可以包括电子设备的用于通信功能和/或用于执行电子设备的其他功能(如消息传送应用、通讯录应用等)的各种驱动程序。The memory 140 may further include a data storage section 143 for storing data, such as contacts, digital data, pictures, sounds, and / or any other data used by the electronic device. The driver storage section 144 of the memory 140 may include various drivers for the electronic device for communication functions and / or for performing other functions of the electronic device (such as a messaging application, an address book application, etc.).
通信模块110即为经由天线111发送和接收信号的发送机/接收机110。通信模块(发送机/接收机)110耦合到中央处理器100,以提供输入信号和接收输出信号,这可以和常规移动通信终端的情况相同。The communication module 110 is a transmitter / receiver 110 that transmits and receives signals via the antenna 111. A communication module (transmitter / receiver) 110 is coupled to the central processing unit 100 to provide input signals and receive output signals, which may be the same as the case of a conventional mobile communication terminal.
基于不同的通信技术,在同一电子设备中,可以设置有多个通信模块110,如蜂窝网络模块、蓝牙模块和/或无线局域网模块等。通信模块(发送机/接收机)110还经由音频处理器130耦合到扬声器131和麦克风132,以经由扬声器131提供音频输出,并接收来自麦克风132的音频输入,从而实现通常的电信功能。音频处理器130可以包括任何合适的缓冲器、解码器、放大器等。另外,音频处理器130还耦合到中央处理器100,从而使得可以通过麦克风132能够在本机上录音,且使得可以通过扬声器131来播放本机上存储的声音。Based on different communication technologies, multiple communication modules 110 may be provided in the same electronic device, such as a cellular network module, a Bluetooth module, and / or a wireless local area network module. The communication module (transmitter / receiver) 110 is also coupled to the speaker 131 and the microphone 132 via the audio processor 130 to provide audio output via the speaker 131 and to receive audio input from the microphone 132, thereby realizing general telecommunication functions. The audio processor 130 may include any suitable buffers, decoders, amplifiers, and the like. In addition, the audio processor 130 is also coupled to the central processing unit 100, so that the microphone 132 can be used to record on the unit, and the speaker 131 can be used to play the sound stored on the unit.
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present invention may be provided as a method, a system, or a computer program product. Therefore, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowcharts and / or block diagrams, and combinations of processes and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to produce a machine, so that the instructions generated by the processor of the computer or other programmable data processing device are used to generate instructions Means for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令 装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to work in a particular manner such that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device, the instructions The device implements the functions specified in one or more flowcharts and / or one or more blocks of the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing device, so that a series of steps can be performed on the computer or other programmable device to produce a computer-implemented process, which can be executed on the computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.
以上所述的具体实施例,对本发明的目的、技术方案和有益效果进行了进一步详细说明,所应理解的是,以上所述仅为本发明的具体实施例而已,并不用于限定本发明的保护范围,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The specific embodiments described above further describe the objectives, technical solutions, and beneficial effects of the present invention. It should be understood that the above are only specific embodiments of the present invention and are not intended to limit the present invention. The scope of protection, any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention shall be included in the scope of protection of the present invention.

Claims (11)

  1. 一种焊缝底片缺陷识别方法,其特征在于,所述方法包含:A method for identifying a defect in a weld negative, wherein the method includes:
    通过射线成像技术获得焊缝的焊缝底片;Weld seam negatives obtained by radiography;
    利用图像识别技术获取焊缝底片的焊缝图像纹理特征数据;Use image recognition technology to obtain the weld image texture feature data of the weld negative;
    根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过机器学习算法建立识别模型;Establishing a recognition model by a machine learning algorithm according to the texture feature data of the weld image and the defect category of the weld negative;
    获得待检测焊缝底片的焊缝图像纹理特征数据;Obtaining the texture feature data of the weld image of the weld backsheet to be detected;
    根据所述待检测焊缝底片的焊缝图像纹理特征数据与所述识别模型,计算获得待检测焊缝底片的缺陷类别。According to the texture feature data of the weld image of the to-be-detected backsheet and the recognition model, a defect category of the to-be-detected back-sheet is calculated and obtained.
  2. 根据权利要求1所述的焊缝底片缺陷识别方法,其特征在于,所述利用图像识别技术获取焊缝底片的焊缝图像纹理特征数据包含:利用图像识别技术获取焊缝底片的大小信息、符号信息以及中心区域信息,根据所述大小信息、所述符号信息以及所述中心区域信息获得焊缝底片的焊缝图像纹理特征数据。The method for identifying defect of a weld negative according to claim 1, characterized in that said obtaining the texture feature data of the weld image of the weld negative by using image recognition technology comprises: obtaining the size information and symbols of the weld negative by using the image recognition technology Information and center area information, and obtain the seam image texture feature data of the weld backsheet according to the size information, the symbol information, and the center area information.
  3. 根据权利要求2所述的焊缝底片缺陷识别方法,其特征在于,利用图像识别技术获取焊缝底片的大小信息包含:通过以下公式计算获得焊缝底片的大小信息;The method for identifying defect of a weld negative according to claim 2, wherein the obtaining the size information of the weld negative by using image recognition technology comprises: obtaining the size information of the weld negative by calculating by the following formula;
    Figure PCTCN2019101716-appb-100001
    Figure PCTCN2019101716-appb-100001
    Figure PCTCN2019101716-appb-100002
    Figure PCTCN2019101716-appb-100002
    在上式中,a,b为自定义常量,TH为预定阈值,p为像素点个数。In the above formula, a and b are custom constants, TH is a predetermined threshold, and p is the number of pixels.
  4. 根据权利要求2所述的焊缝底片缺陷识别方法,其特征在于,利用图像识别技术获取焊缝底片的符号信息包含:通过以下公式计算获得焊缝底片的符号信息;The method of claim 2, wherein obtaining the symbol information of the weld negative by using image recognition technology comprises: obtaining the symbol information of the weld negative by calculating the following formula;
    Figure PCTCN2019101716-appb-100003
    Figure PCTCN2019101716-appb-100003
    Figure PCTCN2019101716-appb-100004
    Figure PCTCN2019101716-appb-100004
    在上式中,CLTP_S *为符号信息,TH为预定阈值,p为像素点个数。 In the above formula, CLTP_S * is the symbol information, TH is a predetermined threshold, and p is the number of pixels.
  5. 根据权利要求2所述的焊缝底片缺陷识别方法,其特征在于,利用图像识别技术获取焊缝底片的中心区域信息包含:通过以下公式计算获得焊缝底片的中心区域信息;The method of claim 2, wherein obtaining the central area information of the weld negative by using image recognition technology comprises: obtaining the central area information of the weld negative by calculating the following formula;
    Figure PCTCN2019101716-appb-100005
    Figure PCTCN2019101716-appb-100005
    在上式中,CLTP_C *为中心区域信息,TH1为图像像素均值。 In the above formula, CLTP_C * is the central area information, and TH1 is the average value of the image pixels.
  6. 根据权利要求1所述的焊缝底片缺陷识别方法,其特征在于,根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过机器学习算法建立识别模型还包含:利用缺陷边缘检测和跟踪处理技术获得所述焊缝图像纹理特征数据中预定类别的特征参数;根据所述特征参数与焊缝底片的缺陷类别建立缺陷特征数据库;根据所述缺陷特征数据库通过机器学习算法建立识别模型。The method of claim 1, wherein establishing a recognition model by a machine learning algorithm according to the texture feature data of the weld image and the defect type of the weld negative further comprises: using defect edge detection and tracking The processing technology obtains a characteristic parameter of a predetermined category in the texture feature data of the weld image; establishes a defect feature database according to the characteristic parameter and the defect category of the weld negative; and establishes a recognition model through a machine learning algorithm according to the defect feature database.
  7. 根据权利要求6所述的焊缝底片缺陷识别方法,其特征在于,所述特征参数包含:焊片编号、图像长度像素、图像宽度像素、缺陷与背景的灰度差、缺陷的相对位置、缺陷自身灰度偏差、缺陷长宽比、等效面积、圆形度、熵、相关度、惯性矩、能量。The method of claim 6, wherein the characteristic parameters include: welding plate number, image length pixel, image width pixel, gray difference between the defect and the background, relative position of the defect, defect Self-gray deviation, defect aspect ratio, equivalent area, circularity, entropy, correlation, moment of inertia, energy.
  8. 根据权利要求1所述的焊缝底片缺陷识别方法,其特征在于,根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过机器学习算法建立识别模型包含:根据所述焊缝图像纹理特征数据与焊缝底片的缺陷类别通过SVM分类算法建立SVM模型。The method for identifying a defect of a weld negative according to claim 1, wherein establishing a recognition model by a machine learning algorithm based on the texture feature data of the weld image and the defect type of the weld negative includes: according to the texture of the weld image The SVM model is established by the SVM classification algorithm based on the feature data and the defect categories of the weld negative.
  9. 根据权利要求8所述的焊缝底片缺陷识别方法,其特征在于,所述通过SVM分类算法建立SVM模型还包含:通过全局优化方法获得所述SVM模型中分类器的类别数量;根据类别差异性排除法构建各类别的所述分类器;所述分类器的类别包含:裂纹、圆形夹渣、条形夹渣、气孔、未焊透、未熔合。The method of claim 8, wherein the establishing an SVM model by using an SVM classification algorithm further comprises: obtaining a number of classes of the classifier in the SVM model by using a global optimization method; and according to class differences The exclusion method constructs the classifiers of each class; the classes of the classifier include: cracks, circular slag inclusions, strip slag inclusions, air holes, not welded through, and not fused.
  10. 一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至9中任一项所述的焊缝底片缺陷识别方法的步骤。An electronic device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that when the processor executes the computer program, any one of claims 1 to 9 is implemented The steps of the method for identifying a defect of a weld negative.
  11. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至9中任一项所述的焊缝底片缺陷识别方法的步骤。A computer-readable storage medium having stored thereon a computer program, characterized in that, when the computer program is executed by a processor, the steps of the method for identifying a defect in a weld film according to any one of claims 1 to 9 are implemented.
PCT/CN2019/101716 2018-08-23 2019-08-21 Welding seam negative defect recognition method WO2020038389A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810966473.5A CN109115812A (en) 2018-08-23 2018-08-23 A kind of weld seam egative film defect identification method and system
CN201810966473.5 2018-08-23

Publications (1)

Publication Number Publication Date
WO2020038389A1 true WO2020038389A1 (en) 2020-02-27

Family

ID=64860802

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/101716 WO2020038389A1 (en) 2018-08-23 2019-08-21 Welding seam negative defect recognition method

Country Status (2)

Country Link
CN (1) CN109115812A (en)
WO (1) WO2020038389A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113369761A (en) * 2021-07-09 2021-09-10 北京石油化工学院 Method and system for guiding robot welding seam positioning based on vision
EP3888839A1 (en) * 2020-03-30 2021-10-06 HITACHI RAIL S.p.A. Method and system for monitoring and identifying the weld quality on metallic components

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109115812A (en) * 2018-08-23 2019-01-01 中国石油大学(北京) A kind of weld seam egative film defect identification method and system
CN109859177B (en) * 2019-01-17 2023-03-10 航天新长征大道科技有限公司 Deep learning-based industrial ray image evaluation method and device
CN110047073B (en) * 2019-05-05 2021-07-06 北京大学 X-ray weld image defect grading method and system
CN110070552B (en) * 2019-05-07 2021-09-07 西南石油大学 Rock image pore type identification method based on semantic segmentation
CN110188734A (en) * 2019-06-06 2019-08-30 秒针信息技术有限公司 The recognition methods of welding type and device
CN110290203A (en) * 2019-06-25 2019-09-27 东莞德福得精密五金制品有限公司 Artificial intelligence cloud computing carries out Noninvasive production defect recognition and information communication to manufactured goods
CN110287968B (en) * 2019-07-01 2022-09-06 河南大学 Detection method for welding line flaw detection negative image counterfeiting based on LBP texture
CN110728325A (en) * 2019-10-12 2020-01-24 太原科技大学 Variable voltage DR image fusion method based on support degree transformation
CN110988140B (en) * 2019-11-25 2021-10-01 西南交通大学 Intelligent identification method for fatigue cracks of orthotropic steel bridge deck slab
CN111091538B (en) * 2019-12-04 2023-06-09 上海君睿信息技术有限公司 Automatic identification and defect detection method and device for pipeline welding seams
CN111292303B (en) * 2020-01-21 2023-09-19 湖北文理学院 Weld defect type detection method and device, electronic equipment and storage medium
CN111507177B (en) * 2020-02-19 2023-04-07 广西云涌科技有限公司 Identification method and device for metering turnover cabinet
CN111421231A (en) * 2020-04-07 2020-07-17 湖南汽车工程职业学院 Omnibearing laser welding production line and welding method thereof
CN111815538B (en) * 2020-07-17 2022-05-10 上海工程技术大学 Liver cirrhosis ultrasonic image liver envelope extraction method based on digital image processing technology
CN112102255B (en) * 2020-08-21 2024-01-23 杭州培慕科技有限公司 Intelligent defect grading method based on X-ray imaging image in industrial scene
CN113076817B (en) * 2021-03-17 2022-11-04 上海展湾信息科技有限公司 Weld pore defect real-time detection method and system
CN113240579A (en) * 2021-04-02 2021-08-10 维库(厦门)信息技术有限公司 Intelligent industrial product defect detection method and device and computer storage medium thereof
CN113319462B (en) * 2021-06-22 2023-04-25 广东工业大学 Welding robot control method and device based on edge cloud cooperation
CN114519792B (en) * 2022-02-16 2023-04-07 无锡雪浪数制科技有限公司 Welding seam ultrasonic image defect identification method based on machine and depth vision fusion
CN115266774B (en) * 2022-07-29 2024-02-13 中国特种设备检测研究院 Artificial intelligence-based weld joint ray detection and evaluation method
CN115187595A (en) * 2022-09-08 2022-10-14 北京东方国信科技股份有限公司 End plug weld defect detection model training method, detection method and electronic equipment
CN115984272B (en) * 2023-03-20 2023-05-23 山东杨嘉汽车制造有限公司 Semitrailer axle defect identification method based on computer vision
CN116994008B (en) * 2023-09-28 2024-02-06 惠州市惠阳聚晟化工涂料有限公司 Method and system for analyzing texture of anode-like aluminum alloy coating film processing
CN117058144B (en) * 2023-10-12 2023-12-19 南昌理工学院 Defect identification method and system for weld joint image

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101118225A (en) * 2007-08-09 2008-02-06 中国航天科技集团公司长征机械厂 Method for analyzing welding quality of aluminium alloy with X radiograph
CN101556598A (en) * 2009-05-08 2009-10-14 中国矿业大学 Radiographic testing weld image management system and auxiliary film viewing method
KR101439758B1 (en) * 2013-03-26 2014-09-16 주식회사 포스코 Apparatus and method of inspecting defect of laser welding
CN104574418A (en) * 2015-01-27 2015-04-29 西安工业大学 Pressure vessel weld defect identification method and device based on neural network
CN107014903A (en) * 2017-05-09 2017-08-04 中国石油天然气集团公司 A kind of pipeline girth weld joint defect positioning method and equipment
CN108346137A (en) * 2017-01-22 2018-07-31 上海金艺检测技术有限公司 Defect inspection method for industrial x-ray weld image
CN109115812A (en) * 2018-08-23 2019-01-01 中国石油大学(北京) A kind of weld seam egative film defect identification method and system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103336972A (en) * 2013-07-24 2013-10-02 中国科学院自动化研究所 Foundation cloud picture classification method based on completion local three value model
JP6264132B2 (en) * 2014-03-25 2018-01-24 日産自動車株式会社 Inspection device and inspection method for painted surface of vehicle body
CN105938563A (en) * 2016-04-14 2016-09-14 北京工业大学 Weld surface defect identification method based on image texture
CN105976352B (en) * 2016-04-14 2019-01-11 北京工业大学 One kind being based on the morphologic face of weld defect characteristic extracting method of gray level image
CN107463667A (en) * 2017-08-02 2017-12-12 大连理工大学 Symbiosis based on neighbor pixel point local three is worth the image search method of pattern

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101118225A (en) * 2007-08-09 2008-02-06 中国航天科技集团公司长征机械厂 Method for analyzing welding quality of aluminium alloy with X radiograph
CN101556598A (en) * 2009-05-08 2009-10-14 中国矿业大学 Radiographic testing weld image management system and auxiliary film viewing method
KR101439758B1 (en) * 2013-03-26 2014-09-16 주식회사 포스코 Apparatus and method of inspecting defect of laser welding
CN104574418A (en) * 2015-01-27 2015-04-29 西安工业大学 Pressure vessel weld defect identification method and device based on neural network
CN108346137A (en) * 2017-01-22 2018-07-31 上海金艺检测技术有限公司 Defect inspection method for industrial x-ray weld image
CN107014903A (en) * 2017-05-09 2017-08-04 中国石油天然气集团公司 A kind of pipeline girth weld joint defect positioning method and equipment
CN109115812A (en) * 2018-08-23 2019-01-01 中国石油大学(北京) A kind of weld seam egative film defect identification method and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
YUANXIANG ET AL.: "Defects Recognition Based on Support Vector Machine within Radiographic Testing Weld", COAL MINE MACHINERY, 25 May 2006 (2006-05-25) *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3888839A1 (en) * 2020-03-30 2021-10-06 HITACHI RAIL S.p.A. Method and system for monitoring and identifying the weld quality on metallic components
CN113369761A (en) * 2021-07-09 2021-09-10 北京石油化工学院 Method and system for guiding robot welding seam positioning based on vision
CN113369761B (en) * 2021-07-09 2023-07-21 北京石油化工学院 Method and system for positioning welding seam based on vision guiding robot

Also Published As

Publication number Publication date
CN109115812A (en) 2019-01-01

Similar Documents

Publication Publication Date Title
WO2020038389A1 (en) Welding seam negative defect recognition method
CN113362326B (en) Method and device for detecting defects of welding spots of battery
WO2022121531A1 (en) Product defect detection method and apparatus
Dong et al. Defect detection and classification by training a generic convolutional neural network encoder
CN109447979B (en) Target detection method based on deep learning and image processing algorithm
CN110544231B (en) Lithium battery electrode surface defect detection method based on background standardization and centralized compensation algorithm
CN111461212A (en) Compression method for point cloud target detection model
CN112037219A (en) Metal surface defect detection method based on two-stage convolution neural network
WO2024002187A1 (en) Defect detection method, defect detection device, and storage medium
CN115601359A (en) Welding seam detection method and device
CN115829965A (en) Method for detecting pore defects in X-ray image based on deep learning
Choudhary et al. Autonomous visual detection of defects from battery electrode manufacturing
CN117078661A (en) Intelligent detection method for production quality of structural member of overhead working truck
Muresan et al. Automatic vision inspection solution for the manufacturing process of automotive components through plastic injection molding
CN117197146A (en) Automatic identification method for internal defects of castings
CN114494103A (en) Defect detection method and device
CN116721080A (en) Small-diameter pipe welding defect detection method based on shape and position sensing and balanced sampling
CN115229374B (en) Method and device for detecting quality of automobile body-in-white weld seam based on deep learning
CN116381053A (en) Ultrasonic detection method and system for welding metal materials
CN116309475A (en) Machine vision detection method for automatically detecting welding quality of roller tooth holder
CN115049600A (en) Intelligent identification system and method for small sample pipeline defects
CN115690001A (en) Method for detecting defects in steel pipe welding digital radiographic image
CN110472583B (en) Human face micro-expression recognition system based on deep learning
Evstafev et al. Surface Defect Detection and Recognition Based on CNN
Liu et al. Recognition confidence of welding seam defects in TOFD images based on artificial intelligence

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19851749

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19851749

Country of ref document: EP

Kind code of ref document: A1