CN114202508A - Detection method and system suitable for highlighting surface defects of various ceramic tiles - Google Patents

Detection method and system suitable for highlighting surface defects of various ceramic tiles Download PDF

Info

Publication number
CN114202508A
CN114202508A CN202111301767.4A CN202111301767A CN114202508A CN 114202508 A CN114202508 A CN 114202508A CN 202111301767 A CN202111301767 A CN 202111301767A CN 114202508 A CN114202508 A CN 114202508A
Authority
CN
China
Prior art keywords
module
image
dbl
output
input end
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111301767.4A
Other languages
Chinese (zh)
Inventor
陈新度
练洋奇
吴磊
林行
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong University of Technology
Original Assignee
Guangdong University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong University of Technology filed Critical Guangdong University of Technology
Priority to CN202111301767.4A priority Critical patent/CN114202508A/en
Publication of CN114202508A publication Critical patent/CN114202508A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0004—Industrial image inspection
    • G06T7/0008—Industrial image inspection checking presence/absence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)

Abstract

The invention relates to a detection method suitable for highlighting surface defects of various ceramic tiles, which comprises the following steps of acquiring a first image shot by a first camera, and acquiring a second image shot by a second camera; respectively carrying out image preprocessing operation on the first image and the second image to obtain a positioned first image and a positioned second image; inputting the positioned image into a pre-established neural network model, outputting three-dimensional feature maps, wherein each feature map comprises the offset information of each anchor frame and the confidence coefficient of corresponding prediction, and selecting a boundary frame with the confidence coefficient larger than a first threshold value as the final output of the predicted defect. And a double camera is utilized to obtain double images, the fusion processing of the double images is suitable for various complex texture ceramic tiles, and the unobvious defects on the surface of the ceramic tiles are highlighted. And training a sample by using a convolutional neural network to enable the network to obtain a defect identification function, thereby realizing high-precision detection of the ceramic tile defects. And the defect detection is carried out by utilizing a deep learning method, so that the labor cost is reduced, and the detection efficiency is improved.

Description

Detection method and system suitable for highlighting surface defects of various ceramic tiles
Technical Field
The invention relates to the technical field of machine vision, in particular to a detection method and a detection system suitable for highlighting surface defects of various tiles.
Background
The ceramic tile is made of refractory metal oxide and semimetal oxide through the processes of grinding, mixing, pressing, glazing and sintering, and is a kind of acid and alkali resistant building or decoration material made of porcelain or stone, etc., which is generally called as ceramic tile.
When ceramic tiles are produced in batches, the detection of surface defects of various ceramic tiles is often required to ensure that products of a batch of ceramic tiles meet acceptance standards.
In the prior art, most of tiles in batches are detected by experienced workers in a manual detection mode, and the method is easy to solve the problems of low efficiency, high cost and the like existing in a method for detecting various defects.
Disclosure of Invention
The invention aims to at least solve one of the defects of the prior art and provides a detection method and a detection system suitable for highlighting the surface defects of various ceramic tiles.
In order to achieve the purpose, the invention adopts the following technical scheme:
specifically, the detection method suitable for highlighting the surface defects of various tiles comprises the following steps:
acquiring a first image shot by a first camera and a second image shot by a second camera, wherein the first camera is a color line camera and is arranged perpendicular to the shooting plane, and the second camera is a black-and-white line camera and is arranged obliquely to the shooting plane;
respectively carrying out image preprocessing operation on the first image and the second image to obtain a positioned first image and a positioned second image;
inputting the positioned first image and the second image into a pre-established neural network model, outputting feature maps of three dimensions, wherein each feature map comprises the offset information of each anchor frame and the confidence coefficient of corresponding prediction, and selecting a boundary frame with the confidence coefficient larger than a first threshold value as the final output of the predicted defect.
Further, specifically, the image preprocessing operation includes the following,
and respectively carrying out filtering and denoising processing on the first image and the second image, and then carrying out Harris corner detection to position the tile images in the first image and the second image to obtain the positioned first image and second image.
Further, the method may further comprise,
before inputting the first and second positioned images into the pre-established neural network model, the sizes of the first and second positioned images are uniformly adjusted to be integral multiples of 416x416 pixels, and then the first and second positioned images are cut into a plurality of small-size images of 416x416 pixels.
Further, specifically, the pre-established neural network model includes,
a feature extraction module, configured to extract feature information of the first and second images after positioning, where an output end of the feature extraction module is connected to an input end of a first RESn module, an output end of the first RESn module is connected to an input end of a second RESn module and an input end of a second concat module, an output end of the second RESn module is connected to an input end of a first DBL module and an input end of the first concat module, an output end of the first DBL module is connected to input ends of a first output convolution layer conv and a second DBL module respectively for up-sampling, an output end of the second DBL module is connected to an input end of the first concat module, an output end of the first concat module is connected to an input end of a third DBL module, and an output end of the third DBL module is connected to an input end of the second output convolution layer conv and an input end of a fourth DBL module respectively for up-sampling, the output end of the fourth DBL module is connected with the input end of the first concat module, the output end of the first concat module is connected with the input end of a fifth DBL module, the output end of the fifth DBL module is connected with the input end of a third output convolution layer conv, and finally the output ends of the first output convolution layer conv, the second output convolution layer conv and the third output convolution layer conv respectively output characteristic graphs with three dimensions;
the DBL module comprises a convolution layer, a normalization BN layer and a leak relu activation layer, the concat module is formed by splicing feature graphs, RESn is a jump layer structure, n represents a number and represents the number of res _ units contained in the res _ block, the res _ unit structure is formed by connecting two DBL modules and jump layers, the former DBL module adopts a convolution kernel of 1x1, and the latter DBL module adopts a convolution kernel of 3x 3.
Further, specifically, the neural network model is obtained by training in the following way,
the loss function is the same as that of a YOLOv3 network, an Adam gradient descent method is used for training, the learning rate is set to be 0.001, the iteration times are 10 epochs, the verification precision of the verification set is recorded, when the recall rate of the tile verification set reaches over 97%, the training is stopped, the model is tested, and if the recall rate of the tile on the verification set reaches over 95%, the model training is finished.
Further, specifically, the anchor frame is obtained a priori by a kmeans clustering algorithm according to the ceramic tile training data set, and the formula of the position transformation operation is shown as follows
bx＝σ(tx)+cx
by＝σ(ty)+cy
Figure BDA0003338686980000031
Figure BDA0003338686980000032
Wherein t isx,tyIs the predicted coordinate offset value, tw,thIs a scaling, pw、phIs a preset anchor box mapped to width and height in the feature map, cx，cyThe feature map output cells are shifted from the upper left corner of the cell of the corresponding image, and sigma (-) is a sigmoid function.
Further, the sizes of the specific three-dimensional feature maps are 13x13, 26x26 and 52x52 respectively, wherein the feature map of 13x13 has a larger receptive field and is used for predicting large defects; the 26 × 26 signature has a moderate receptive field for predicting moderate defects; the 52x52 signature has a smaller receptive field for predicting small defects.
The invention also provides a detection system suitable for highlighting the surface defects of various ceramic tiles, which comprises the following steps:
the image acquisition module is used for acquiring a first image shot by a first camera and acquiring a second image shot by a second camera, wherein the first camera is a color linear array camera and is arranged perpendicular to the shooting plane, and the second camera is a black and white linear array camera and is arranged obliquely to the shooting plane;
the image preprocessing module is used for respectively carrying out image preprocessing operation on the first image and the second image to obtain a positioned first image and a positioned second image;
and the detection module is used for inputting the positioned first image and the second image into a pre-established neural network model, outputting three-dimensional feature maps, wherein each feature map comprises the offset information of each anchor frame and the confidence coefficient of the corresponding prediction, and selecting a boundary frame with the confidence coefficient larger than a first threshold value as the final output of the predicted defect.
Further, specifically, the pre-established neural network model includes,
a feature extraction module, configured to extract feature information of the first and second images after positioning, where an output end of the feature extraction module is connected to an input end of a first RESn module, an output end of the first RESn module is connected to an input end of a second RESn module and an input end of a second concat module, an output end of the second RESn module is connected to an input end of a first DBL module and an input end of the first concat module, an output end of the first DBL module is connected to input ends of a first output convolution layer conv and a second DBL module respectively for up-sampling, an output end of the second DBL module is connected to an input end of the first concat module, an output end of the first concat module is connected to an input end of a third DBL module, and an output end of the third DBL module is connected to an input end of the second output convolution layer conv and an input end of a fourth DBL module respectively for up-sampling, the output end of the fourth DBL module is connected with the input end of the first concat module, the output end of the first concat module is connected with the input end of a fifth DBL module, the output end of the fifth DBL module is connected with the input end of a third output convolution layer conv, and finally the output ends of the first output convolution layer conv, the second output convolution layer conv and the third output convolution layer conv respectively output characteristic graphs with three dimensions;
the DBL module comprises a convolution layer, a normalization BN layer and a leak relu activation layer, the concat module is formed by splicing feature graphs, RESn is a jump layer structure, n represents a number and represents the number of res _ units contained in the res _ block, the res _ unit structure is formed by connecting two DBL modules and jump layers, the former DBL module adopts a convolution kernel of 1x1, and the latter DBL module adopts a convolution kernel of 3x 3.
The invention also proposes a computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method as described above.
The invention has the beneficial effects that:
the method of the invention utilizes a double camera to obtain the tile image, the fusion processing of the two images can be suitable for the tiles with various complex textures, and various unobvious defects on the surface of the tile are highlighted. And training a sample by using a convolutional neural network to enable the network to obtain a defect identification function, thereby realizing high-precision detection of the ceramic tile defects. The detection system can be suitable for detecting the defects of various tiles and has detection diversity. And the defect detection is carried out by utilizing a deep learning method, so that the labor cost is reduced, and the detection efficiency is improved.
Drawings
The foregoing and other features of the present disclosure will become more apparent from the detailed description of the embodiments shown in conjunction with the drawings in which like reference characters designate the same or similar elements throughout the several views, and it is apparent that the drawings in the following description are merely some examples of the present disclosure and that other drawings may be derived therefrom by those skilled in the art without the benefit of any inventive faculty, and in which:
FIG. 1 is a flow chart of a detection method for highlighting surface defects of various types of ceramic tiles according to the present invention;
FIG. 2 is a schematic structural diagram of a neural network model of a detection method for highlighting surface defects of various tiles according to the present invention;
FIG. 3 is a schematic structural diagram of an RESn module of the detection method for highlighting surface defects of various ceramic tiles according to the present invention;
FIG. 4 is a schematic structural diagram of a res _ unit module of the detection method for highlighting surface defects of various types of tiles according to the present invention;
FIG. 5 is a schematic view of a dual camera adapted to the detection method for highlighting surface defects of various types of tiles of the present invention.
Detailed Description
The conception, the specific structure and the technical effects of the present invention will be clearly and completely described in conjunction with the embodiments and the accompanying drawings to fully understand the objects, the schemes and the effects of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The same reference numbers will be used throughout the drawings to refer to the same or like parts.
Referring to fig. 1 and 5, in embodiment 1, the present invention provides a detection method for highlighting surface defects of various types of tiles, including the following steps:
step 110, acquiring a first image shot by a first camera and a second image shot by a second camera, wherein the first camera is a color line camera and is arranged perpendicular to the shooting plane, and the second camera is a black-and-white line camera and is arranged obliquely to the shooting plane;
step 120, performing image preprocessing operation on the first image and the second image respectively to obtain a first image and a second image after positioning;
step 130, inputting the positioned first image and second image into a pre-established neural network model, outputting feature maps of three dimensions, wherein each feature map comprises the offset information of each anchor frame and the confidence degree of corresponding prediction, and selecting a boundary frame with the confidence degree larger than a first threshold value as the final output of the predicted defect.
The first threshold is set manually, and is set to 0.6 in the present embodiment.
Specifically, a double camera is used for shooting images of various tiles, a color camera is used for shooting color defects such as dirt and glaze dripping, and a black and white camera is used for shooting concave-convex defects such as shallow cracks and small pinholes. Preprocessing the two images, dividing the two images into small pictures, inputting the divided images into a neural network architecture for training, and processing the contrast characteristics of the two images to quickly locate the defects of the ceramic tiles. And finally, detecting the defects of the new ceramic tiles by using the trained network.
As a preferred embodiment of the present invention, specifically, the image preprocessing operation includes the following,
and respectively carrying out filtering and denoising processing on the first image and the second image, and then carrying out Harris corner detection to position the tile images in the first image and the second image to obtain the positioned first image and second image.
As a preferred embodiment of the present invention, the method further comprises,
before inputting the first and second positioned images into the pre-established neural network model, the sizes of the first and second positioned images are uniformly adjusted to be integral multiples of 416x416 pixels, and then the first and second positioned images are cut into a plurality of small-size images of 416x416 pixels.
Referring to fig. 2, 3 and 4, as a preferred embodiment of the present invention, specifically, the neural network model pre-established includes,
a feature extraction module, configured to extract feature information of the first and second images after positioning, where an output end of the feature extraction module is connected to an input end of a first RESn module, an output end of the first RESn module is connected to an input end of a second RESn module and an input end of a second concat module, an output end of the second RESn module is connected to an input end of a first DBL module and an input end of the first concat module, an output end of the first DBL module is connected to input ends of a first output convolution layer conv and a second DBL module respectively for up-sampling, an output end of the second DBL module is connected to an input end of the first concat module, an output end of the first concat module is connected to an input end of a third DBL module, and an output end of the third DBL module is connected to an input end of the second output convolution layer conv and an input end of a fourth DBL module respectively for up-sampling, the output end of the fourth DBL module is connected with the input end of the first concat module, the output end of the first concat module is connected with the input end of a fifth DBL module, the output end of the fifth DBL module is connected with the input end of a third output convolution layer conv, and finally the output ends of the first output convolution layer conv, the second output convolution layer conv and the third output convolution layer conv respectively output characteristic graphs with three dimensions;
the DBL module comprises a convolution layer, a normalization BN layer and a leak relu activation layer, the concat module is formed by splicing feature graphs, RESn is a jump layer structure, n represents a number and represents the number of res _ units contained in the res _ block, the res _ unit structure is formed by connecting two DBL modules and jump layers, the former DBL module adopts a convolution kernel of 1x1, and the latter DBL module adopts a convolution kernel of 3x 3.
In the preferred embodiment, n in the first RESn block is 8, and n in the second RESn block is 4.
In fig. 2, the first RES8 is a first RES module, the second RES4 is a second RES module, the DBL and conv in the first row are the first output convolution layer conv, the DBL and conv in the second row are the second output convolution layer conv, and the DBL and conv in the third row are the third output convolution layer conv, where the up-sampling in the first row is the up-sampling process corresponding to the second DBL module, and the up-sampling in the second row is the up-sampling process of the fourth DBL module.
As a preferred embodiment of the present invention, specifically, the neural network model is obtained by training,
the loss function is the same as that of a YOLOv3 network, an Adam gradient descent method is used for training, the learning rate is set to be 0.001, the iteration times are 10 epochs, the verification precision of the verification set is recorded, when the recall rate of the tile verification set reaches over 97%, the training is stopped, the model is tested, and if the recall rate of the tile on the verification set reaches over 95%, the model training is finished.
Specifically, the anchor frame is obtained a priori by a kmeans clustering algorithm according to the ceramic tile training data set, and the position transformation operation formula is shown as follows
bx＝σ(tx)+cx
by＝σ(ty)+cy
Figure BDA0003338686980000071
Figure BDA0003338686980000072
Wherein t isx,tyIs the predicted coordinate offset value, tw,thIs a scaling, pw、phIs a preset anchor box mapped to width and height in the feature map, cx，cyThe feature map output cells are shifted from the upper left corner of the cell of the corresponding image, and sigma (-) is a sigmoid function.
As a preferred embodiment of the present invention, the sizes of the specific three-dimensional feature maps are 13x13, 26x26, and 52x52, respectively, wherein the feature map of 13x13 has a larger receptive field for predicting large defects; the 26 × 26 signature has a moderate receptive field for predicting moderate defects; the 52x52 signature has a smaller receptive field for predicting small defects.
The invention also provides a detection system suitable for highlighting the surface defects of various ceramic tiles, which comprises the following steps:
the image acquisition module is used for acquiring a first image shot by a first camera and acquiring a second image shot by a second camera, wherein the first camera is a color linear array camera and is arranged perpendicular to the shooting plane, and the second camera is a black and white linear array camera and is arranged obliquely to the shooting plane;
the image preprocessing module is used for respectively carrying out image preprocessing operation on the first image and the second image to obtain a positioned first image and a positioned second image;
and the detection module is used for inputting the positioned first image and the second image into a pre-established neural network model, outputting three-dimensional feature maps, wherein each feature map comprises the offset information of each anchor frame and the confidence coefficient of the corresponding prediction, and selecting a boundary frame with the confidence coefficient larger than a first threshold value as the final output of the predicted defect.
In particular, the above-described system, when in operation,
the color camera and the black and white camera are combined with the line light source to polish and photograph the ceramic tiles, when the conveying belt conveys the ceramic tiles to enter a photographing area, the two-line-array camera starts photographing, and multi-view images of the ceramic tiles are obtained.
And respectively carrying out a series of preprocessing such as filtering and denoising, corner point detection, image segmentation and the like on the black-white tile image and the color image shot by the two cameras.
Inputting the ceramic tiles into a neural network for training, inputting black and white ceramic tile images and color images in a training set into an improved YOLOv3 network, training by using a gradient descent method, and stopping training when the recall rate of the test set reaches a set value.
And in the testing stage, inputting the ceramic tile image to be detected into the network model, and calculating the coordinates, length, width, category and confidence coefficient of the candidate frame of the ceramic tile defect at the output of the last layer to realize the detection of the defect.
As a preferred embodiment of the present invention, specifically, the neural network model pre-established includes,
a feature extraction module, configured to extract feature information of the first and second images after positioning, where an output end of the feature extraction module is connected to an input end of a first RESn module, an output end of the first RESn module is connected to an input end of a second RESn module and an input end of a second concat module, an output end of the second RESn module is connected to an input end of a first DBL module and an input end of the first concat module, an output end of the first DBL module is connected to input ends of a first output convolution layer conv and a second DBL module respectively for up-sampling, an output end of the second DBL module is connected to an input end of the first concat module, an output end of the first concat module is connected to an input end of a third DBL module, and an output end of the third DBL module is connected to an input end of the second output convolution layer conv and an input end of a fourth DBL module respectively for up-sampling, the output end of the fourth DBL module is connected with the input end of the first concat module, the output end of the first concat module is connected with the input end of a fifth DBL module, the output end of the fifth DBL module is connected with the input end of a third output convolution layer conv, and finally the output ends of the first output convolution layer conv, the second output convolution layer conv and the third output convolution layer conv respectively output characteristic graphs with three dimensions;
the DBL module comprises a convolution layer, a normalization BN layer and a leak relu activation layer, the concat module is formed by splicing feature graphs, RESn is a jump layer structure, n represents a number and represents the number of res _ units contained in the res _ block, the res _ unit structure is formed by connecting two DBL modules and jump layers, the former DBL module adopts a convolution kernel of 1x1, and the latter DBL module adopts a convolution kernel of 3x 3.
The invention also proposes a computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method as described above.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium and can implement the steps of the above-described method embodiments when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium includes content that can be suitably increased or decreased according to the requirements of legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunication signals according to legislation and patent practice.
While the present invention has been described in considerable detail and with particular reference to a few illustrative embodiments thereof, it is not intended to be limited to any such details or embodiments or any particular embodiments, but it is to be construed as effectively covering the intended scope of the invention by providing a broad, potential interpretation of such claims in view of the prior art with reference to the appended claims. Furthermore, the foregoing describes the invention in terms of embodiments foreseen by the inventor for which an enabling description was available, notwithstanding that insubstantial modifications of the invention, not presently foreseen, may nonetheless represent equivalent modifications thereto.
The above description is only a preferred embodiment of the present invention, and the present invention is not limited to the above embodiment, and the present invention shall fall within the protection scope of the present invention as long as the technical effects of the present invention are achieved by the same means. The invention is capable of other modifications and variations in its technical solution and/or its implementation, within the scope of protection of the invention.

Claims (10)

1. A detection method suitable for highlighting surface defects of various ceramic tiles is characterized by comprising the following steps:
acquiring a first image shot by a first camera and a second image shot by a second camera, wherein the first camera is a color line camera and is arranged perpendicular to the shooting plane, and the second camera is a black-and-white line camera and is arranged obliquely to the shooting plane;
respectively carrying out image preprocessing operation on the first image and the second image to obtain a positioned first image and a positioned second image;
inputting the positioned first image and the second image into a pre-established neural network model, outputting feature maps of three dimensions, wherein each feature map comprises the offset information of each anchor frame and the confidence coefficient of corresponding prediction, and selecting a boundary frame with the confidence coefficient larger than a first threshold value as the final output of the predicted defect.
2. The method for detecting the surface defect highlighting of the multi-variety ceramic tiles according to claim 1, wherein the image preprocessing operation comprises the following steps,
and respectively carrying out filtering and denoising processing on the first image and the second image, and then carrying out Harris corner detection to position the tile images in the first image and the second image to obtain the positioned first image and second image.
3. The method for detecting the surface defect highlighting of the multi-variety ceramic tiles according to claim 1, further comprising,
before inputting the first and second positioned images into the pre-established neural network model, the sizes of the first and second positioned images are uniformly adjusted to be integral multiples of 416x416 pixels, and then the first and second positioned images are cut into a plurality of small-size images of 416x416 pixels.
4. The method for detecting the highlighting of the surface defect of the multi-variety ceramic tile according to claim 1, wherein the pre-established neural network model comprises,
a feature extraction module, configured to extract feature information of the first and second images after positioning, where an output end of the feature extraction module is connected to an input end of a first RESn module, an output end of the first RESn module is connected to an input end of a second RESn module and an input end of a second concat module, an output end of the second RESn module is connected to an input end of a first DBL module and an input end of the first concat module, an output end of the first DBL module is connected to input ends of a first output convolution layer conv and a second DBL module respectively for up-sampling, an output end of the second DBL module is connected to an input end of the first concat module, an output end of the first concat module is connected to an input end of a third DBL module, and an output end of the third DBL module is connected to an input end of the second output convolution layer conv and an input end of a fourth DBL module respectively for up-sampling, the output end of the fourth DBL module is connected with the input end of the first concat module, the output end of the first concat module is connected with the input end of a fifth DBL module, the output end of the fifth DBL module is connected with the input end of a third output convolution layer conv, and finally the output ends of the first output convolution layer conv, the second output convolution layer conv and the third output convolution layer conv respectively output characteristic graphs with three dimensions;
the DBL module comprises a convolution layer, a normalization BN layer and a leak relu activation layer, the concat module is formed by splicing feature graphs, RESn is a jump layer structure, n represents a number and represents the number of res _ units contained in the res _ block, the res _ unit structure is formed by connecting two DBL modules and jump layers, the former DBL module adopts a convolution kernel of 1x1, and the latter DBL module adopts a convolution kernel of 3x 3.
5. The method for detecting the highlighting of the surface defect of the multi-variety ceramic tile according to claim 4, wherein the neural network model is obtained by training,
the loss function is the same as that of a YOLOv3 network, an Adam gradient descent method is used for training, the learning rate is set to be 0.001, the iteration times are 10 epochs, the verification precision of the verification set is recorded, when the recall rate of the tile verification set reaches over 97%, the training is stopped, the model is tested, and if the recall rate of the tile on the verification set reaches over 95%, the model training is finished.
6. The method for detecting the highlighting of the surface defect of the multi-variety tile according to claim 1, wherein the anchor frame is obtained a priori by a kmeans clustering algorithm according to a tile training data set, and the formula of the position transformation operation is shown as follows
bx＝σ(tx)+cx
by＝σ(ty)+cy
Figure FDA0003338686970000021
Figure FDA0003338686970000022
Wherein t isx,tyIs the predicted coordinate offset value, tw,thIs a scaling, pw、phIs a preset anchor box mapped to width and height in the feature map, cx，cyThe feature map output cells are shifted from the upper left corner of the cell of the corresponding image, and sigma (-) is a sigmoid function.
7. The method for detecting the surface defect highlighting of the multi-variety ceramic tiles as claimed in claim 6, wherein the sizes of the specific three-dimensional feature maps are respectively 13x13, 26x26 and 52x52, wherein the 13x13 feature map has a larger receptive field for predicting large defects; the 26 × 26 signature has a moderate receptive field for predicting moderate defects; the 52x52 signature has a smaller receptive field for predicting small defects.
8. A detection system suitable for highlighting surface defects of various ceramic tiles is characterized by comprising the following components:
the image acquisition module is used for acquiring a first image shot by a first camera and acquiring a second image shot by a second camera, wherein the first camera is a color linear array camera and is arranged perpendicular to the shooting plane, and the second camera is a black and white linear array camera and is arranged obliquely to the shooting plane;
the image preprocessing module is used for respectively carrying out image preprocessing operation on the first image and the second image to obtain a positioned first image and a positioned second image;
and the detection module is used for inputting the positioned first image and the second image into a pre-established neural network model, outputting three-dimensional feature maps, wherein each feature map comprises the offset information of each anchor frame and the confidence coefficient of the corresponding prediction, and selecting a boundary frame with the confidence coefficient larger than a first threshold value as the final output of the predicted defect.
9. The detection system for highlighting surface defects of various tiles according to claim 8, wherein the pre-established neural network model comprises,
a feature extraction module, configured to extract feature information of the first and second images after positioning, where an output end of the feature extraction module is connected to an input end of a first RESn module, an output end of the first RESn module is connected to an input end of a second RESn module and an input end of a second concat module, an output end of the second RESn module is connected to an input end of a first DBL module and an input end of the first concat module, an output end of the first DBL module is connected to input ends of a first output convolution layer conv and a second DBL module respectively for up-sampling, an output end of the second DBL module is connected to an input end of the first concat module, an output end of the first concat module is connected to an input end of a third DBL module, and an output end of the third DBL module is connected to an input end of the second output convolution layer conv and an input end of a fourth DBL module respectively for up-sampling, the output end of the fourth DBL module is connected with the input end of the first concat module, the output end of the first concat module is connected with the input end of a fifth DBL module, the output end of the fifth DBL module is connected with the input end of a third output convolution layer conv, and finally the output ends of the first output convolution layer conv, the second output convolution layer conv and the third output convolution layer conv respectively output characteristic graphs with three dimensions;
the DBL module comprises a convolution layer, a normalization BN layer and a leak relu activation layer, the concat module is formed by splicing feature graphs, RESn is a jump layer structure, n represents a number and represents the number of res _ units contained in the res _ block, the res _ unit structure is formed by connecting two DBL modules and jump layers, the former DBL module adopts a convolution kernel of 1x1, and the latter DBL module adopts a convolution kernel of 3x 3.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
CN202111301767.4A 2021-11-04 2021-11-04 Detection method and system suitable for highlighting surface defects of various ceramic tiles Pending CN114202508A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111301767.4A CN114202508A (en) 2021-11-04 2021-11-04 Detection method and system suitable for highlighting surface defects of various ceramic tiles

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111301767.4A CN114202508A (en) 2021-11-04 2021-11-04 Detection method and system suitable for highlighting surface defects of various ceramic tiles

Publications (1)

Publication Number Publication Date
CN114202508A true CN114202508A (en) 2022-03-18

Family

ID=80646823

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111301767.4A Pending CN114202508A (en) 2021-11-04 2021-11-04 Detection method and system suitable for highlighting surface defects of various ceramic tiles

Country Status (1)

Country Link
CN (1) CN114202508A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114782418A (en) * 2022-06-16 2022-07-22 深圳市信润富联数字科技有限公司 Detection method and device for ceramic tile surface defects and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114782418A (en) * 2022-06-16 2022-07-22 深圳市信润富联数字科技有限公司 Detection method and device for ceramic tile surface defects and storage medium
CN114782418B (en) * 2022-06-16 2022-09-16 深圳市信润富联数字科技有限公司 Detection method and device for ceramic tile surface defects and storage medium

Similar Documents

Publication Publication Date Title
CN110610475B (en) Visual defect detection method of deep convolutional neural network
CN111680690B (en) Character recognition method and device
CN105574533B (en) A kind of image characteristic extracting method and device
CN112233067A (en) Hot rolled steel coil end face quality detection method and system
CN110276759B (en) Mobile phone screen bad line defect diagnosis method based on machine vision
CN107862235B (en) Two-dimensional code position positioning method and device and terminal equipment
CN112435214A (en) Pollen detection method and device based on prior frame linear scaling and electronic equipment
CN115690104B (en) Wafer crack detection method and device and storage medium
CN114332041A (en) U-Net-based polished tile surface flaw detection method and device
CN110503051B (en) Precious wood identification system and method based on image identification technology
CN114913134A (en) Tunnel shotcrete roughness identification method, terminal device and storage medium
CN114782310A (en) Surface defect detection method, device, equipment and storage medium
CN114202508A (en) Detection method and system suitable for highlighting surface defects of various ceramic tiles
CN112330613A (en) Method and system for evaluating quality of cytopathology digital image
CN115546536A (en) Ivory product identification method and system
CN116503391A (en) Tunnel face rock mass joint crack identification method and identification device
CN112634259A (en) Automatic modeling and positioning method for keyboard keycaps
CN110263597B (en) Quick and accurate QR (quick response) code correction method and system
CN112085727A (en) Intelligent identification method for scale structure on surface of hot rolled steel
CN117197479A (en) Image analysis method, device, computer equipment and storage medium applying corn ear outer surface
CN117036756A (en) Remote sensing image matching method and system based on variation automatic encoder
TW200842339A (en) Mura detection method and system
CN115578333A (en) Domestic ceramic surface defect detection method based on region division and yolo5
CN115331209A (en) Bronze inscription identification method and device, computer equipment and storage medium
CN115578362A (en) Defect detection method and device for electrode coating, electronic device and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination