CN113706461A - Micro-defect identification system of insulating blanket based on image identification - Google Patents

Micro-defect identification system of insulating blanket based on image identification Download PDF

Info

Publication number
CN113706461A
CN113706461A CN202110812508.1A CN202110812508A CN113706461A CN 113706461 A CN113706461 A CN 113706461A CN 202110812508 A CN202110812508 A CN 202110812508A CN 113706461 A CN113706461 A CN 113706461A
Authority
CN
China
Prior art keywords
image
defect
blanket
aluminum profile
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110812508.1A
Other languages
Chinese (zh)
Inventor
来轶
周军伟
李文飞
倪佳慧
丁洪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
State Grid Zhejiang Xiaoshan District Power Supply Co ltd
Hangzhou Power Supply Co of State Grid Zhejiang Electric Power Co Ltd
Zhejiang Zhongxin Electric Power Engineering Construction Co Ltd
Original Assignee
State Grid Zhejiang Xiaoshan District Power Supply Co ltd
Zhejiang Zhongxin Electric Power Engineering Construction Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by State Grid Zhejiang Xiaoshan District Power Supply Co ltd, Zhejiang Zhongxin Electric Power Engineering Construction Co Ltd filed Critical State Grid Zhejiang Xiaoshan District Power Supply Co ltd
Priority to CN202110812508.1A priority Critical patent/CN113706461A/en
Publication of CN113706461A publication Critical patent/CN113706461A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/06Electricity, gas or water supply
    • G06T5/70
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/136Segmentation; Edge detection involving thresholding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • G06T2207/20028Bilateral filtering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • G06T2207/20032Median filtering

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Economics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Public Health (AREA)
  • Water Supply & Treatment (AREA)
  • General Health & Medical Sciences (AREA)
  • Quality & Reliability (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

The invention discloses an insulating blanket micro-defect identification system based on image identification, which comprises a portable insulating blanket defect detector, wherein a camera is connected with a machine body, the machine body is provided with an image processing unit and an image output unit, the image processing unit firstly carries out filtering processing on an image acquired by the camera, then carries out binarization on the image, finally analyzes and marks a communicated area with gray level mutation in the image through Blob, and extracts the characteristics of the areas so as to mark the position of a defect in a sampled insulating blanket and the size of the pixel of the defect; the image output unit outputs and displays the insulation blanket image marking the defective position and the pixel size. The invention is based on the machine vision technology, and uses the machine eye to replace the human eye, thereby realizing the automatic detection of the defect of the insulation blanket and solving the defect that the existing human eye and two-electrode method can not detect.

Description

Micro-defect identification system of insulating blanket based on image identification
Technical Field
The invention relates to the technical field of distribution network live-line work maintenance, in particular to an insulating blanket micro-defect identification system based on image identification.
Background
With the continuous progress of the electric power industry in China and the continuous expansion of the construction scale of the power distribution network, the distribution network live working is widely applied to the distribution network live working in China, the gap of the distribution network live working is small, and the occurrence of grounding electric shock accidents can be effectively avoided by adopting insulating shielding to shield a live body and grounding in the working range. After the insulating shielding tool arrives at the site, the insulating shielding tool is usually placed on canvas, firstly, a detector can carry out visual inspection on the insulating shielding tool, and then an insulating detector is used for detection after the visual inspection is finished, and the insulating shielding tool can be used after the detection is complete; however, for the defective insulated shielding tool for hot-line work, the hard tool can be detected by the insulated detector, but the soft insulated tool cannot be detected, such as insulated clothes, insulated blankets and the like, and the tool is the most common insulated tool for distribution network uninterrupted work and is also an important tool for ensuring personal safety.
The existing insulating blanket defect detecting instrument is large in size, inconvenient to carry and troublesome to operate.
In addition, the defect identification can be carried out by using machine vision technology for the defects of the visual inspection.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to provide an insulating blanket micro-defect identification system based on image identification, which is convenient to carry and operate and combines a machine vision identification technology to accurately identify and position the defects of an insulating blanket.
In order to solve the technical problems, the invention adopts the following technical scheme:
an insulating blanket micro-defect identification system based on image identification comprises a portable insulating blanket defect detector, wherein the portable insulating blanket defect detector comprises a box, and a machine body, a panel, a light source, a camera fixing frame, a roller bracket and an insulating blanket defect detector bracket which can be accommodated in the box; wherein the panel is used for placing an insulating blanket, the light source is arranged below the panel, the camera is arranged above the panel, the roller is arranged above the panel and close to the panel, the insulating blanket is in rolling contact with the roller when being pulled along the plane of the panel, the camera is arranged on the camera fixing frame, the roller is arranged on the roller bracket, the machine body, the camera fixing bracket and the roller bracket are arranged on the insulating blanket defect detector bracket, the camera is connected with the machine body, the machine body is provided with an image processing unit and an image output unit, the image processing unit firstly carries out filtering processing on the image collected by the camera, then binarizing the image, finally analyzing and marking the connected region with gradation mutation in the image by Blob, extracting the characteristics of the areas to mark the positions of the defects in the sampled insulation blanket and the pixel sizes of the defects; the image output unit outputs and displays the insulation blanket image marked with the defective position and the pixel size.
Preferably, the roller is a silica gel wheel.
Preferably, install magnet on the silica gel wheel, the silica gel wheel is installed in U type fixed block, the last corresponding magnet of U type fixed block installs the magnetic switch, and when pulling insulating blanket, magnet triggers the magnetic switch, sends the signal of telecommunication to the camera through the magnetic switch.
Preferably, the insulation blanket defect detector support comprises a first aluminum profile, a second aluminum profile correspondingly and vertically connected to two ends of the first aluminum profile, and support legs connected with the second aluminum profile.
Preferably, the roller bracket comprises a third aluminum profile and a fourth aluminum profile, the two rollers are correspondingly installed at two ends of the third aluminum profile, the four-way aluminum profile is perpendicularly connected with the middle of the third aluminum profile through a screw, and the four-way aluminum profile is installed on the first aluminum profile through a screw.
Preferably, the camera fixing frame is connected with the aluminum profile I through screws.
Preferably, the box is an aluminum alloy box, and the aluminum alloy box comprises a box body and a box cover.
Preferably, the panel is installed on the inner side of the opening of the box body, and high-transparency glass is paved on the panel.
Preferably, the filtering processing method includes gaussian filtering, median filtering, mean filtering and bilateral filtering; and carrying out image binarization by adopting a Niblack algorithm, a Sauvola algorithm, a Singh algorithm or a Bersen algorithm.
Preferably, the Blob analysis method is as follows:
completely dividing the pre-processed binary image I (x, y) into n sub-regions Ii(x, y) the n sub-regions comprising n1A Blob and a background, I and IiSatisfies the following relationship:
Figure BDA0003168942900000031
describing the shape characteristics of a Blob area by moments, for a Blob area, the (m, n) order moment is as follows:
Figure BDA0003168942900000032
area center Area of Blob region, i.e. the zeroth order moment of the image:
Figure BDA0003168942900000033
centroid coordinates of Blob region Centroid (x)c,yc):
Figure BDA0003168942900000034
According to the technical scheme, related components such as the panel, the light source, the camera fixing frame, the roller bracket, the insulating blanket defect detector bracket and the like are contained in the box, so that the portable insulating blanket defect detector is convenient to carry and is convenient for detection work on site. When the detection is carried out on site, firstly, the box cover is removed, the aluminum alloy box is opened, the insulating blanket defect detector support is erected and fixed, and other parts are taken out and fixed one by one; and then, rolling up the insulating blanket to be detected and placing one side of the insulating blanket on the panel, and pulling the insulating blanket through an X axis or a Y axis to finish photographing and detecting the defects. Therefore, the portable medical nursing bottle is convenient to carry and operate.
Based on the machine vision technology, the machine eye is used for replacing the human eye, the automatic detection of the defect of the insulating blanket is realized, and the defect which cannot be detected by the existing human eye and two-electrode method is solved.
The specific technical solutions adopted by the present invention and the advantages brought by the solutions will be disclosed in detail in the following specific embodiments with reference to the accompanying drawings.
Drawings
The invention is further described with reference to the accompanying drawings and the detailed description below:
FIG. 1 is a schematic diagram of a main structure of a portable insulation blanket defect detector;
FIG. 2 is a schematic view of a bracket structure of the insulation blanket defect detector;
FIG. 3 is a diagram of the portable insulation blanket defect detector assembly;
FIG. 4 is a diagram of a camera trigger structure of the portable insulation blanket defect detector;
FIG. 5 is a schematic view of a portable insulation blanket defect detector;
FIG. 6 is a functional block diagram of an insulation blanket microdefect identification device;
FIG. 7 is a schematic diagram of mean filtering;
FIG. 8 is a flowchart of an image processing unit processing an image;
in the figure: the device comprises a machine body 1, an insulating blanket 1.0, an insulating blanket defect detector support 2, a camera 3, a light source 4, a light source controller 5, an aluminum alloy box 6, a cross screw 1.2, a hand screw 1.3, an aluminum profile I1.4, an inner hexagon screw 1.5, an L-shaped fixing plate 1.6, an aluminum profile II 1.7, an aluminum profile fixing part 1.8, a cylindrical pin I1.9, a hand screw II 1.10, a cylindrical pin II 1.11, a supporting leg 1.12, an aluminum profile III 1.13, an aluminum profile IV 1.14, a magnetic switch 1.15, a U-shaped fixing block 1.16, a roller 1.17, a camera 1.18, a camera fixing frame 1.19 and an all-in-one machine fixing frame 1.20; l-shaped corner piece 1.1.1, power socket 1.1.2, panel 1.1.3, high-transparency glass 1.1.4 and magnet 1.1.1.1.
Detailed Description
The technical solutions of the embodiments of the present invention are explained and illustrated below with reference to the drawings of the embodiments of the present invention, but the embodiments described below are only preferred embodiments of the present invention, and not all embodiments. Based on the embodiments in the embodiment, other embodiments obtained by those skilled in the art without any creative efforts belong to the protection scope of the invention.
It will be appreciated by those skilled in the art that features from the examples and embodiments described below may be combined with each other without conflict.
In the present invention, unless otherwise expressly specified or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be directly connected or indirectly connected through an intermediate. The specific meanings of the above terms in the present invention can be understood by those of ordinary skill in the art according to specific situations.
With the development of machine vision technology, due to the characteristics of repeatability, reliability and accuracy, the machine eye is used for replacing the human eye to complete the control of industrial production, and the quality control system based on the machine vision is adopted as an industrial detection means, so that people increasingly pay attention to the quality control system and the quality control system is more and more widely applied to production practice.
Aiming at the problem of insulation detection of insulation tools such as insulation clothes, insulation blankets and the like, the invention realizes automatic detection of the defects of the insulation blankets based on the machine vision technology and solves the defects which cannot be detected by the existing human eyes and two-electrode method.
An insulation blanket micro-defect identification system based on image identification comprises a portable insulation blanket defect detector, as shown in fig. 1 to 5, the portable insulation blanket defect detector comprises:
a panel 1.1.3 for placing an insulating blanket 1.0;
a light source 4 installed below the panel and controlled by a light source controller 5;
a camera 3 mounted above the panel;
a roller 1.17 mounted above the panel in rolling contact with the roller as the blanket is pulled along the plane of the panel;
the insulation blanket defect detector comprises an insulation blanket defect detector support 2, wherein a camera fixing frame 1.19 and a roller wheel support are installed on the insulation blanket defect detector support, the camera is installed on the camera fixing frame, and the roller wheel is installed on the roller wheel support.
The insulating blanket defect detector support 2 comprises a first aluminum profile 1.4, second aluminum profiles 1.7 and supporting legs 1.12, wherein the second aluminum profiles are correspondingly and vertically connected to two ends of the first aluminum profile, and the supporting legs are connected with the second aluminum profiles. The roller bracket comprises three aluminum profiles 1.13 and four aluminum profiles 1.14, the two rollers are correspondingly installed at the two ends of the three aluminum profiles through U-shaped fixing blocks 1.16 and screws, the four aluminum profiles pass through the screws and are vertically connected with the middle parts of the three aluminum profiles, and the four aluminum profiles are installed on the first aluminum profiles through the screws. The camera fixing frame is connected with the aluminum profile through screws. In addition, the insulation blanket defect detector support 2 is provided with a machine body 1, the light source 4 and the camera 3 are connected with the machine body, the machine body controls the light source 4 and the camera 3 to work, and images collected by the camera are uploaded to the machine body 1 and can be processed by the machine body 1.
Further, the second aluminum profile 1.7 is mounted on the first aluminum profile fixing part 1.8 through the first cylindrical pin 1.9, and the second aluminum profile fixing part 1.8 is mounted on the supporting leg 1.12 through the second cylindrical pin 1.11. The first aluminum profile 1.4 is connected by an L-shaped fixing plate 1.6 and the second aluminum profile 1.7 is connected by a hexagon socket head cap screw 1.5. The aluminum profile III 1.13 and the aluminum profile IV 1.14 are connected by using an L-shaped fixing plate 1.6 and an inner hexagonal screw 1.5.
The roller 1.17 is installed on the U-shaped fixing block 1.16 by using a second cylindrical pin 1.11, the camera 1.18 is installed on the camera fixing frame 1.19, and the camera fixing frame 1.19 is fixed on the first aluminum profile 1.4 by using an inner hexagonal screw 1.5. The machine body 1 is fixed on an all-in-one machine fixing frame 1.20 through a cross screw 1.2, and the all-in-one machine fixing frame 1.20 is installed on an aluminum profile I1.4 through the cross screw 1.2.
The aluminum profile four 1.14 is mounted on the aluminum profile one 1.4 by using the hand-screwed screw one 1.3. The second hand screw 1.10 is arranged on the supporting leg 1.12, the supporting leg 1.12 is rotatably connected with the aluminum profile fixing piece 1.8 by the second cylindrical pin 1.11, so that the insulating blanket defect detecting instrument support 1.1 forms a joint at the position and can be used for accommodating or standing up and unscrewing the second hand screw 1.10, the part above the supporting leg 1.12 can be rotated downwards and laid flat, the part above the supporting leg 1.12 is rotated upwards to be in a standing state, and the standing state can be kept by screwing the second hand screw 1.10.
Since the insulating blanket is in rolling contact with the roller when being pulled along the plane of the panel, the roller can be a silica gel wheel to avoid damaging the insulating blanket.
Further, still include the case, the case includes box and case lid, the case is equipped with the chamber of accomodating that holds panel, light source controller, camera mount, gyro wheel support and insulating blanket defect detector support. The box body is provided with a power socket 1.1.2 which can be externally connected with a power supply to supply power for the portable insulating blanket defect detector.
Specifically, the casing of case adopts the aluminum alloy to make, and the spare part of portable insulating blanket defect detector not only can be accomodate to the aluminum alloy case, is examining time measuring moreover, uses as testing platform.
As shown in fig. 3, the legs 1.12 of the insulation blanket defect detector support 2 are mounted inside the aluminum alloy box 6 by using cross screws 1.2, specifically, the two legs 1.12 are fixed with the left and right inner side walls of the box body by using the cross screws 1.2. The light source 4 and the L-shaped corner piece 1.1.1 are installed together and fixed in the box body by using the cross screw 1.2, the light source controller 5 and the L-shaped corner piece 1.1.1 are installed together and fixed in the box body by using the cross screw 1.2, and the L-shaped corner piece 1.1.1 is installed in the aluminum alloy box 6 and fixed by using the cross screw 1.2; the left side of the power socket 1.1.2 provided with the aluminum alloy box 6 is fixed by a cross screw 1.2, the panel 1.1.3 is embedded and arranged at the inner side of the opening part of the box body, and the high-transmittance glass 1.1.4 is arranged on the panel 1.1.3. The insulating blanket defect detector support 2 is substantially flat above the high-transparency glass 1.1.4 in the storage state and can be covered by a box cover.
As shown in fig. 4, a magnet 1.1.1.1 is installed on the silica gel wheel, the silica gel wheel is installed on a U-shaped fixing block, a magnetic switch 1.15 is installed on the U-shaped fixing block corresponding to the magnet, when the insulating blanket is pulled and reaches a certain distance, the magnet just corresponds to the position of the magnetic switch, so that the magnet triggers the magnetic switch, and an electric signal is sent to the camera through the magnetic switch. The camera starts to collect photos according to the electric signals, and then processes the collected pictures, so that automatic detection can be automatically realized.
As shown in fig. 5, the aluminum alloy box 6 is opened, the box cover of the aluminum alloy box 6 is removed, the second hand-screwed screw 1.10 is unscrewed, the insulation blanket defect detector bracket 2 is erected, the second hand-screwed screw 1.10 is screwed to fix the insulation blanket defect detector bracket 2 against falling down, the roller bracket is taken out from the net bag of the box cover and is fixed on the first aluminum section 1.4 through the first hand-screwed screw 1.3; and (3) rolling up the insulating blanket 1.0 to be detected, putting the rolled insulating blanket on the panel 1.1.3, and pulling the electric insulating blanket through an X axis or a Y axis to finish the photographing detection of the defects.
As shown in fig. 6, generally, a machine vision system should include an illumination module, an image acquisition module, an image processing module, and an input-output module. The portable insulation blanket defect detector comprises an image acquisition module, an illumination unit and a control unit, wherein the image acquisition module is a camera in the portable insulation blanket defect detector, and the illumination unit is a light source in the portable insulation blanket defect detector. In addition, the input and output module may adopt a touch display screen, and may be integrated on the body 1 together with the image processing module.
The image acquisition module is a perception tool in a machine vision system and acquires information of a detected object by shooting an image of the detected object in real time. The image acquisition module mainly comprises an optical lens, a camera and an acquisition card.
The lens pair influences the imaging quality by the following main indexes: resolution, contrast, depth of field and various aberrations all have an effect. The main considerations that typically need to be taken into account include the focal length, aperture and distortion rate of the lens. In a high-precision vision system, the optical system is required to be able to eliminate the influence of chromatic aberration and phase difference, and to correct curvature of field and astigmatism, which requires as little optical distortion as possible.
The acquisition card has the main task of controlling the camera to acquire and complete the high-speed transmission of the image data processor. At present, the acquisition card not only bears the function of data transmission, but also integrates a plurality of image processing algorithms, thereby greatly improving the convenience and the real-time property of image processing. The selection of the acquisition card needs to consider the matching between the speed of the camera for acquiring the image data and the transmission speed of the acquisition card, and also needs to consider the processing task borne by the acquisition card.
In the present embodiment, a CCD camera manufactured by Haikang robot, model MV-CA050-20GM, named 500 million pixels 1 "CMOS gigabit Ethernet industrial area-array camera, is used. The main parameters of the camera are as follows:
pixel size: 4.8 μm 4.8 μm;
resolution ratio: 25922048, respectively;
maximum frame rate: 22 fps;
exposure method: supporting automatic exposure, manual exposure and one-key exposure modes;
the cache capacity: 128 MB.
The camera supports automatic or manual adjustment of gain, exposure time, LUT, Gamma correction and the like, adopts a gigabit network interface, and has the maximum transmission distance of 100m under the condition of no relay; the 128MB on-board cache can cache a plurality of pictures for burst transmission or image retransmission; and the system is compatible with a GigE Vision V1.2 protocol and a GenlCam standard.
The illumination unit is primarily responsible for providing brightness support for image acquisition and eliminating the effects of extraneous light that may affect image acquisition quality.
The image processing module mainly completes analysis processing on image data, is a decision mechanism of a vision system in a machine vision system of a computer, takes an industrial computer as a processing core, has the characteristics of simple structure, convenience in operation, relative easiness in development, capability of realizing various complex algorithms and high processing efficiency, and is particularly preferred for a product surface detection system with large data volume, complex algorithm design and high operation requirement. In order to ensure the processing of large data volume and convenient algorithm design, the product surface defect online detection system based on machine vision adopts a high-performance industrial computer as an image processing core.
In machine vision, image processing is a core content and key technology, and image processing tasks are mainly completed in respective relatively independent image processing subsystems. There is a great choice of image processing algorithms, and one algorithm can only be applied to process a certain type of images with the same or similar characteristics. In fact, for the insulating shielding tools that require surface inspection, different defects, such as scratches, punctures, smudges, etc., have different optical properties, leading to different characteristics of the acquired images. Therefore, it is not practical to design a fixed and universal image processing algorithm and flow for detecting surface defects of different products. Therefore, different defect detection algorithms must be designed according to different characteristics of the defects.
As shown in fig. 7, the image processing unit firstly performs filtering processing on the acquired image, then binarizes the image, and finally analyzes connected regions with abrupt gray changes in the marked image through Blob, and extracts the features of the regions, so that the positions of defects existing in the sampled insulating blanket and the pixel sizes of the defects are marked, and finally the image output unit outputs and displays the insulating blanket image with the positions and the pixel sizes of the defects marked.
The images acquired in the field usually contain noise, and the main purpose of image preprocessing is to reduce the noise and improve the quality of the images, so that the images are more suitable for the processing of machines. The preprocessing of the image generally comprises a spatial domain method and a frequency domain method, and the algorithms thereof comprise gray scale transformation, histogram equalization, various filtering algorithms based on the spatial domain and the frequency domain, and the like, wherein the intuitive method adopts a low-pass filtering mode to carry out denoising according to the characteristic that the noise energy is generally concentrated on high frequency, and the image frequency spectrum is distributed in a limited region, such as a sliding average window filter, a Wiener linear noise filter, and the like. There are various filtering methods in the Vision master image processing software, and the following filtering methods can be considered in the implementation mode: gaussian filtering, median filtering, mean filtering, and bilateral filtering.
(1) Gauss filtering
Gaussian filtering is a linear smoothing filter suitable for eliminating gaussian noise. The gaussian filtering is a process of weighted average of the whole image, and the value of each pixel point is obtained by weighted average of the value of each pixel point and other pixel values in the neighborhood. The basic principle is as follows:
let the gaussian filtered surface profile be z (x), where the high frequency signal is r (x) and the low frequency signal is ω (x). In the high frequency signal, i.e., r (x). The secondary form of the surface topography is then:
z(x)=r(x)+ω(x) (4-1)
and adopting Gaussian filtering to extract the roughness, wherein the expression of Gaussian distribution is as follows:
Figure BDA0003168942900000101
in the formula: μ is the mean and σ is the standard deviation.
The weight function of the gaussian filter is:
Figure BDA0003168942900000102
fourier transform of the expression (4-2) yields:
Figure BDA0003168942900000111
in the formula: λ is the wavelength; lambda [ alpha ]cIs the cut-off wavelength of the gaussian filter; α is a constant. Wherein the passing rate of the Gaussian filter at the cut-off wavelength is 50 percent to obtain
Figure BDA0003168942900000112
Figure BDA0003168942900000113
The roughness can be obtained by convolving the surface topography with a gaussian weight function:
Figure BDA0003168942900000114
(2) median filtering
The median filtering is a nonlinear signal processing technology which is based on a sequencing statistic theory and can effectively inhibit noise, and the basic principle of the median filtering is to replace the value of one point in a digital image or a digital sequence by the median of all point values in a neighborhood of the point and enable the surrounding pixel values to be close to the true value, thereby eliminating an isolated noise point. It is convenient because it does not need the statistical property of the image in the actual operation process. Under certain conditions, the method can overcome the image detail blurring caused by a linear filter, and is most effective in filtering pulse interference and image scanning noise. However, the median filtering method is not suitable for some images with much details, especially for images with much point, line and pinnacle details. The basic principle is as follows:
is provided with a one-dimensional sequence f1,f2,…,fnThe length of the window is m (m is odd number), the sequence is subjected to median filtering, namely m numbers f are extracted from the input sequence in successioni-v,…,fi-1,…,fi,…,fi+1,…,fi+vWherein i is the central position μ ═ m-1/2 of the window, and then the m points are arranged according to the numerical value, and the mathematical formula is as follows:
Yi=Med{fi-v,...,fi,...,fi+v};i∈Z (4-8)
when the window is actually used, the size of the window is generally increased by 3 × 3 and then by 5 × 5 until the filtering effect is satisfactory. The median filter is able to preserve the transition parts in the original image better overall than the averaging filter.
(3) Mean value filtering
So-called mean filtering essentially replaces individual pixel values in the original image with a mean value.
As shown in FIG. 8, the pixels with sequence number 0 are the current pixels, and the pixels with sequence numbers 1-8 are the neighboring pixels in the template. Calculating the average value of all pixels in the template, and then giving the average value to the current pixel point (x, y) as the gray g (x, y) of the processed image on the point, namely:
Figure BDA0003168942900000121
in the formula: s is a template; m is the total number of pixels including the current pixel in the template. Considering the balance of data distribution, the template is generally selected to be 3 × 3 and 5 × 5, and the pixel to be processed is placed in the center of the template.
The mean filtering has a good noise suppression effect, and the algorithm is simple, but is not satisfactory in processing of edges and details of the image, and although the noise suppression effect is good, the blurring of the image is more serious. The solution of mean filtering to noise is to distribute the noise to surrounding pixels.
(4) Bilateral filtering
The bilateral filtering is a nonlinear filter, and the filter considers the spatial proximity and the pixel similarity of the image at the same time so as to achieve the purpose of edge-preserving and denoising. The pixel expression after bilateral filtering is:
Figure BDA0003168942900000122
Figure BDA0003168942900000123
the weighting coefficient ω (x, y, i, j) is the product of a spatial kernel and a value domain kernel, wherein the spatial kernel selects a weight according to the distance between the pixel point and the center of the template, and the closer the distance, the greater the weight. The value domain kernel assigns weights based on differences between pixel values, with the closer the pixel values are, the greater the weights are. The coefficient ensures that bilateral filtering can achieve the effect of retaining detail characteristics such as edges and the like while denoising and smoothing.
The CCD camera is used for photographing the insulation shielding appliance, the Vision Master software contains the various filtering methods, different defects can be judged in different environments according to local conditions, and the optimal filtering method is selected.
Since the defect detection image still contains a large amount of complex backgrounds after filtering, in order to simplify further processing of the image, reduce data volume and highlight the outline of an interested target, image binarization needs to be performed, and image binarization analysis plays an extremely important role in image processing and pattern recognition, and is widely applied to a plurality of practical applications such as target extraction, character recognition and medical image analysis.
The image binarization is to convert a gray image into a black and white image, and is an important component of an image segmentation algorithm. The measured object is left black and the image background is set to white. The principle is that a threshold value is set, and if the threshold value is smaller than the set threshold value, the pixel is regarded as a background pixel, otherwise, the pixel is regarded as a target pixel. The method comprises the following steps of setting an original image as g (x, y), binarizing the original image as t (x, y), setting a threshold as P e (0-1), and specifically expressing the following formula:
Figure BDA0003168942900000131
as can be seen from the equation (4-12), the threshold is used as a core parameter for binarization, and it is particularly important to select a suitable threshold, which can be usually obtained through an experimental verification method or an adaptive algorithm. At present, there are various algorithms for adaptively solving the threshold, among which the more classical ones are:
(1) niblack algorithm
The Niblack algorithm is to obtain a binarization threshold value after the operation of the average value and the standard deviation of the pixel gray values in the neighborhood of the current target investigation point and the template operator thereof. In the binarization of the image, firstly, calculating the gray average value m and the standard deviation s of pixel points in a neighborhood of n × n with (x, y) as the center:
Figure BDA0003168942900000132
Figure BDA0003168942900000141
the calculation formula of the binarization threshold value T (x, y) is as follows:
T(x,y)=k*s(x,y)+m(x,y) (4-15)
in the formula: k is an empirically predetermined correction factor, typically 0.1-0.5.
The final threshold for the current viewpoint is determined by the following equation:
Figure BDA0003168942900000142
the algorithm takes into account the template neighborhood mean and standard deviation information of the observation points.
(2) Sauvula algorithm
The Sauvola algorithm introduces a dynamic range R of standard deviation on the basis of the Niblack algorithm, and the calculation formula is as follows:
Figure BDA0003168942900000143
in the formula: r is the dynamic range of standard deviation, and a fixed value of 128 is taken for the 8-bit image; k is a standard deviation influence factor, reflects the influence strength of the standard deviation on the threshold T (i, j), and takes a value between (0, 1); m (i, j), s (i, j) are centered on point (i, j), and r is also referred to as the windowing size.
The subject idea of the algorithm is that each pixel point in an image is selected to be proper r, according to the distribution of the gray value of the pixel point in the window, the gray mean value m (i, j) and the gray standard deviation s (i, j) are selected to be used as the calculation basis of the threshold value T (i, j), the threshold value of each pixel in the image is only affected by the pixel in the window, and compared with the global thresholding, the threshold value selection is finer by applying the algorithm. For the image with uneven illumination, because only the influence of the adjacent pixels is considered, under the condition that r is selected to be proper, the illumination in the window is uniform in most cases, and the ideal processing effect can be achieved by using the algorithm.
(3) Singh algorithm
O.imocha.singh proposed in 2012 an algorithm based on local contrast and mean (hereinafter collectively referred to as Singh algorithm). The basic principle is as follows: in a window of r with pixel point (x, y) as center, calculating the maximum value I of pixel gray in the windowmaxAnd the minimum value IminAnd a gray level mean m (x, y), calculating a segmentation threshold of the central pixel point according to the formula 4-18:
T(x,y)=k[m(x,y)+(Imax-Imin)(1-f(x,y))] (4-18)
in the formula: f (x, y) represents the gray value of the central pixel point, and k is a deviation coefficient. The Singh algorithm does not involve calculation of the standard deviation, relative to the Sauvola algorithm and the Niblack algorithm, and the calculation time of the algorithm depends on the size of the window.
(4) Bersen algorithm
The Bersen algorithm is different from the Niblack and Sauvola algorithms, which use the statistical property of the standard deviation of the pixel neighborhood, and the Bersen algorithm is similar to the o. The basic principle of the Bersen algorithm is to calculate the maximum gray level I of a pixel in a window of r by taking a pixel point (x, y) as the centermaxAnd the minimum value IminThe final local segmentation threshold is determined using equations 4-19:
Figure BDA0003168942900000151
in the formula: i ismaxAnd IminThe maximum value and the minimum value of the gray value of the pixel in the window are respectively, L is a gray contrast threshold value in the window and can be selected according to an actual image, and OtsuT represents a threshold value obtained by the whole image according to an Otsu algorithm.
Through a series of experiments, a binarization threshold algorithm is determined to be obtained by taking the Sauvula algorithm as self-adaption, and an image after defect binarization is obtained.
The Blob analysis is used for marking the connected regions with abrupt gray changes in the image and extracting the characteristics of the regions, and for the binary image, the red connected regions are considered as the connected regions with abrupt gray changes. The pre-processed binary image I (x, y) (I) can be completely divided into n sub-regions Ii(x, y), (abbreviated to I)i) The n sub-regions include n1A Blob and a background, I and IiSatisfies the following relationship:
Figure BDA0003168942900000161
the Blob analysis process is divided into labeling and feature extraction: the marking is to count the number of blobs meeting the condition in the image and provide a unique label for each Blob; the Blob analysis has many extractable features, which may be area, centroid coordinates, height and width of the circumscribed rectangle, etc.
Describing the shape characteristics of a Blob area by moments, wherein for a certain Blob area, the (m, n) order moment is as follows:
Figure BDA0003168942900000162
area center Area of Blob region, i.e. the zeroth order moment of the image:
Figure BDA0003168942900000163
centroid coordinates of Blob region Centroid (x)c,yc):
Figure BDA0003168942900000164
The binary image is analyzed by Blob to obtain a result graph, a plurality of defects in the damaged insulating blanket are marked, the marked numbers are pixel areas of the defects in the picture (the pixels of the picture collected by the industrial camera are 2592 by 2048), the defects are different in size and shape, and the defects are marked on the defect image analyzed by Blob.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and those skilled in the art will understand that the present invention includes, but is not limited to, the contents described in the drawings and the above specific embodiments. Any modification which does not depart from the functional and structural principles of the present invention is intended to be included within the scope of the claims.

Claims (10)

1. The utility model provides an insulating blanket micro defect identification system based on image recognition, includes portable insulating blanket defect detector, its characterized in that: the portable insulating blanket defect detector comprises a box, and a machine body, a panel, a light source, a camera fixing frame, a roller bracket and an insulating blanket defect detector bracket which can be contained in the box; the panel is used for placing an insulating blanket, the light source is installed below the panel, the camera is installed above the panel, the roller is installed above the panel and close to the panel, the insulating blanket is in rolling contact with the roller when being pulled along the plane of the panel, the camera is installed on a camera fixing frame, the roller is installed on a roller support, the machine body, the camera fixing frame and the roller support are installed on an insulating blanket defect detector support, the camera is connected with the machine body, the machine body is provided with an image processing unit and an image output unit, the image processing unit firstly carries out filtering processing on an image collected by the camera, then carries out binarization on the image, finally analyzes and marks a communication area with gray level mutation in the image through Blob, and extracts the characteristics of the areas, so that the positions of defects existing in the sampled insulating blanket and the pixel sizes of the defects are marked; the image output unit outputs and displays the insulation blanket image marking the defective position and the pixel size.
2. The insulation blanket micro-defect identification system based on image identification as claimed in claim 1, wherein: the roller is a silica gel wheel.
3. The insulation blanket micro-defect identification system based on image identification as claimed in claim 2, wherein: install magnet on the silica gel wheel, the silica gel wheel is installed in U type fixed block, the magnetism switch is installed to corresponding magnet on the U type fixed block, and when the insulating blanket of pulling, magnet triggers the magnetism switch, sends the signal of telecommunication to the camera through the magnetism switch.
4. The insulation blanket micro-defect identification system based on image identification as claimed in claim 1, wherein: the insulating blanket defect detector support comprises an aluminum profile I, an aluminum profile II and supporting legs, wherein the aluminum profile II is correspondingly and vertically connected to two ends of the aluminum profile I, and the supporting legs are connected with the aluminum profile II.
5. The insulation blanket micro-defect identification system based on image identification as claimed in claim 4, wherein: the roller support comprises a third aluminum profile and a fourth aluminum profile, the two rollers are correspondingly installed at two ends of the third aluminum profile, the four aluminum profile passes through a screw and is vertically connected with the middle of the third aluminum profile, and the four aluminum profile is installed on the first aluminum profile through the screw.
6. The insulation blanket micro-defect identification system based on image identification as claimed in claim 5, wherein: the camera fixing frame is connected with the aluminum profile I through screws.
7. The insulation blanket micro-defect identification system based on image identification as claimed in claim 6, wherein: the box is an aluminum alloy box, and the aluminum alloy box comprises a box body and a box cover.
8. The insulation blanket microdefect identification system based on image identification according to claim 7, wherein: the panel is arranged on the inner side of the opening of the box body, and high-transparency glass is paved on the panel.
9. The insulation blanket micro-defect identification system based on image identification as claimed in claim 1, wherein: the filtering processing method comprises Gaussian filtering, median filtering, mean filtering and bilateral filtering; and carrying out image binarization by adopting a Niblack algorithm, a Sauvola algorithm, a Singh algorithm or a Bersen algorithm.
10. The insulation blanket microdefect identification system based on image identification according to claim 1, wherein: the method of Blob analysis is:
completely dividing the pre-processed binary image I (x, y) into n sub-regions Ii(x, y) the n sub-regions comprising n1A Blob and a background, I and IiSatisfies the following relationship:
Figure FDA0003168942890000021
describing the shape characteristics of a Blob area by moments, for a Blob area, the (m, n) order moment is as follows:
Figure FDA0003168942890000022
area center Area of Blob region, i.e. the zeroth order moment of the image:
Figure FDA0003168942890000023
centroid coordinates of Blob region Centroid (x)c,yc):
Figure FDA0003168942890000031
CN202110812508.1A 2021-07-19 2021-07-19 Micro-defect identification system of insulating blanket based on image identification Pending CN113706461A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110812508.1A CN113706461A (en) 2021-07-19 2021-07-19 Micro-defect identification system of insulating blanket based on image identification

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110812508.1A CN113706461A (en) 2021-07-19 2021-07-19 Micro-defect identification system of insulating blanket based on image identification

Publications (1)

Publication Number Publication Date
CN113706461A true CN113706461A (en) 2021-11-26

Family

ID=78648895

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110812508.1A Pending CN113706461A (en) 2021-07-19 2021-07-19 Micro-defect identification system of insulating blanket based on image identification

Country Status (1)

Country Link
CN (1) CN113706461A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113702775A (en) * 2021-07-19 2021-11-26 浙江中新电力工程建设有限公司配电分公司 Portable insulating blanket defect detector
TWI785912B (en) * 2021-12-01 2022-12-01 開必拓數據股份有限公司 Surface inspection system for foil article
CN116071387A (en) * 2023-03-06 2023-05-05 曲阜市巨力铁路轨道工程股份有限公司 Sleeper rail production quality detection method based on machine vision
CN117232791A (en) * 2023-11-07 2023-12-15 智翼博智能科技(苏州)有限公司 Intelligent detection method for surface flaws and defects of optical film

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6157730A (en) * 1996-02-09 2000-12-05 Roever; Detlef E. Visual inspection system for leather hide
JP2005140655A (en) * 2003-11-07 2005-06-02 Seiko Epson Corp Method of detecting stain flaw, and stain flaw detector
CN106409711A (en) * 2016-09-12 2017-02-15 佛山市南海区广工大数控装备协同创新研究院 Solar silicon wafer defect detecting system and method
CN106650770A (en) * 2016-09-29 2017-05-10 南京大学 Mura defect detection method based on sample learning and human visual characteristics
CN107643295A (en) * 2017-08-24 2018-01-30 中国地质大学(武汉) A kind of method and system of the cloth defect on-line checking based on machine vision
CN108802036A (en) * 2018-08-28 2018-11-13 东莞康耐德智能控制有限公司 A kind of portable integrated form large format checking test platform
CN109030367A (en) * 2018-08-28 2018-12-18 东莞康耐德智能控制有限公司 A kind of portable integrated form dynamic optical experimental system platform
CN208860721U (en) * 2018-08-28 2019-05-14 东莞康耐德智能控制有限公司 A kind of portable integrated form dynamic optical experimental system platform
CN208860753U (en) * 2018-08-28 2019-05-14 东莞康耐德智能控制有限公司 A kind of portable integrated form large format checking test platform
CN111028213A (en) * 2019-12-04 2020-04-17 北大方正集团有限公司 Image defect detection method and device, electronic equipment and storage medium
CN210824174U (en) * 2019-10-31 2020-06-23 浙江浙能温州发电有限公司 Thermal power plant coal conveying conveyer belt wearing and tearing condition detection device based on image
CN212941187U (en) * 2020-07-27 2021-04-13 上海育尚科技发展有限公司 Stable form gyro wheel

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6157730A (en) * 1996-02-09 2000-12-05 Roever; Detlef E. Visual inspection system for leather hide
JP2005140655A (en) * 2003-11-07 2005-06-02 Seiko Epson Corp Method of detecting stain flaw, and stain flaw detector
CN106409711A (en) * 2016-09-12 2017-02-15 佛山市南海区广工大数控装备协同创新研究院 Solar silicon wafer defect detecting system and method
CN106650770A (en) * 2016-09-29 2017-05-10 南京大学 Mura defect detection method based on sample learning and human visual characteristics
CN107643295A (en) * 2017-08-24 2018-01-30 中国地质大学(武汉) A kind of method and system of the cloth defect on-line checking based on machine vision
CN108802036A (en) * 2018-08-28 2018-11-13 东莞康耐德智能控制有限公司 A kind of portable integrated form large format checking test platform
CN109030367A (en) * 2018-08-28 2018-12-18 东莞康耐德智能控制有限公司 A kind of portable integrated form dynamic optical experimental system platform
CN208860721U (en) * 2018-08-28 2019-05-14 东莞康耐德智能控制有限公司 A kind of portable integrated form dynamic optical experimental system platform
CN208860753U (en) * 2018-08-28 2019-05-14 东莞康耐德智能控制有限公司 A kind of portable integrated form large format checking test platform
CN210824174U (en) * 2019-10-31 2020-06-23 浙江浙能温州发电有限公司 Thermal power plant coal conveying conveyer belt wearing and tearing condition detection device based on image
CN111028213A (en) * 2019-12-04 2020-04-17 北大方正集团有限公司 Image defect detection method and device, electronic equipment and storage medium
CN212941187U (en) * 2020-07-27 2021-04-13 上海育尚科技发展有限公司 Stable form gyro wheel

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
徐勤山;左新斌;陈纲;鞠振;曹建国;杨帆;: "便携式智能绝缘织物缺陷检测仪的研制", 中国电业(技术版), no. 12 *
李文飞等: "基于机器视觉的绝缘毯缺陷检测与识别研究", 《软件》, vol. 42, no. 6, 30 June 2021 (2021-06-30), pages 87 - 90 *
王科;: "GIS中局部放电绝缘缺陷综合检测诊断技术分析及应用", 高压电器, no. 09 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113702775A (en) * 2021-07-19 2021-11-26 浙江中新电力工程建设有限公司配电分公司 Portable insulating blanket defect detector
TWI785912B (en) * 2021-12-01 2022-12-01 開必拓數據股份有限公司 Surface inspection system for foil article
CN116071387A (en) * 2023-03-06 2023-05-05 曲阜市巨力铁路轨道工程股份有限公司 Sleeper rail production quality detection method based on machine vision
CN117232791A (en) * 2023-11-07 2023-12-15 智翼博智能科技(苏州)有限公司 Intelligent detection method for surface flaws and defects of optical film
CN117232791B (en) * 2023-11-07 2024-02-09 智翼博智能科技(苏州)有限公司 Intelligent detection method for surface flaws and defects of optical film

Similar Documents

Publication Publication Date Title
CN113706461A (en) Micro-defect identification system of insulating blanket based on image identification
CN113686869A (en) Micro-defect recognition device for insulating blanket
CN110268190B (en) Underground pipe gallery leakage detection method based on static infrared thermography processing
CN108876768B (en) Shadow defect detection method for light guide plate
CN110389127B (en) System and method for identifying metal ceramic parts and detecting surface defects
CN109507192B (en) Magnetic core surface defect detection method based on machine vision
CN115908269B (en) Visual defect detection method, visual defect detection device, storage medium and computer equipment
CN111915704A (en) Apple hierarchical identification method based on deep learning
CN114881915A (en) Symmetry-based mobile phone glass cover plate window area defect detection method
CN108133488A (en) A kind of infrared image foreground detection method and equipment
CN112862744B (en) Intelligent detection method for internal defects of capacitor based on ultrasonic image
CN113252568A (en) Lens surface defect detection method, system, product and terminal based on machine vision
CN106228541A (en) The method and device of screen location in vision-based detection
CN115272256A (en) Sub-pixel level sensing optical fiber path Gaussian extraction method and system
Ma et al. An automatic detection method of Mura defects for liquid crystal display
CN111047598B (en) Deep learning-based ultraviolet discharge light spot segmentation method and device for power transmission and transformation equipment
CN110021012B (en) Mobile phone lens window glass defect detection method based on machine vision technology
KR101677070B1 (en) System and Method for Automatically Detecting a Mura Defect using Morphological Image Processing and Labeling
CN102980659A (en) Digitalized characterization method of monochrome tight fabric surface color
CN114612418A (en) Method, device and system for detecting surface defects of mouse shell and electronic equipment
CN107833223B (en) Fruit hyperspectral image segmentation method based on spectral information
CN109544535B (en) Peeping camera detection method and system based on optical filtering characteristics of infrared cut-off filter
CN111563869B (en) Stain test method for quality inspection of camera module
CN109406539B (en) Transparent medicine bottle bottom accumulated material defect detection system and method
CN109622404B (en) Automatic sorting system and method for micro-workpieces based on machine vision

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination