TWI747686B - A defect detection method and a defect detection device - Google Patents

A defect detection method and a defect detection device Download PDF

Info

Publication number
TWI747686B
TWI747686B TW109146051A TW109146051A TWI747686B TW I747686 B TWI747686 B TW I747686B TW 109146051 A TW109146051 A TW 109146051A TW 109146051 A TW109146051 A TW 109146051A TW I747686 B TWI747686 B TW I747686B
Authority
TW
Taiwan
Prior art keywords
defect
detection
template
artificial intelligence
training
Prior art date
Application number
TW109146051A
Other languages
Chinese (zh)
Other versions
TW202219494A (en
Inventor
虞斌
趙麗娜
王桂合
Original Assignee
大陸商艾聚達信息技術(蘇州)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 大陸商艾聚達信息技術(蘇州)有限公司 filed Critical 大陸商艾聚達信息技術(蘇州)有限公司
Application granted granted Critical
Publication of TWI747686B publication Critical patent/TWI747686B/en
Publication of TW202219494A publication Critical patent/TW202219494A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/001Industrial image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30148Semiconductor; IC; Wafer

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)

Abstract

The present invention relates to a defect detection method and a defect detection device. The method includes three detection steps. The first detection step is to setting a defect template in an AOI system and detecting the defect type of the defect template to obtain a first detection result. If the first detection result is accurate, then output, otherwise proceed to the second detection step. The second detection step is to transmit the defect template to the AI model to detect the defect type of the defect template and to obtain the second detection result, and to calculate the detection accuracy of the AI model. If the result is accurate and the detection accuracy meets the set threshold, the second detection result is output and the AI model is trained. If the detection accuracy is less than the set threshold, the third detection step is performed. In the third detection step, the defect template is transmitted to the re-inspection system and a matching detection between the defect template and the preset template is performed to obtain the third detection result, and calculate the re-inspection accuracy rate. If the re-inspection accuracy rate meets the set threshold, output the third detection result and train the AI model.

Description

缺陷檢測方法及檢測裝置Defect detection method and detection device

本發明關於圖形檢測技術領域,尤其關於一種用於缺陷檢測的檢測方法和檢測裝置。The present invention relates to the technical field of pattern detection, in particular to a detection method and a detection device for defect detection.

目前對於缺陷檢測技術,例如芯片缺陷檢測,傳統上包括兩種檢測方式,一種是依靠人工目視檢測,由於人的視角有限(比如無法有效觀察到小型貼片元件之間的脫焊、極性相反等),存在檢測速度慢、準確度不高、檢測效果不好的缺點,因此這種方式使用逐漸越來越少。另外一種方式是通過AOI系統(自動光學檢測,是基於光學原理來對焊接生產中遇到的常見缺陷進行檢測的設備)進行判斷;AOI系統雖然採用光學原理,用光學透鏡代替人眼,並在拍攝過程中進行圖像放大,能夠獲得較為清晰的設備圖像,但AOI系統缺陷在於,判斷檢測點是否故障的方法、都是通過人工基於AOI系統中儲存的標準數位化圖像與實際檢測到的圖像進行對比判別,也就是說同樣需要人為目視對比檢測,因此也存在檢測速度慢,以及漏檢、準確度不高的缺點。At present, defect detection technology, such as chip defect detection, traditionally includes two detection methods. One is to rely on manual visual inspection, due to the limited viewing angle of people (for example, it is impossible to effectively observe the unsoldering between small SMD components, reverse polarity, etc. ), there are shortcomings of slow detection speed, low accuracy, and poor detection effect, so this method is gradually used less and less. Another way is to judge through the AOI system (automatic optical inspection, which is based on optical principles to detect common defects encountered in welding production); although the AOI system uses optical principles, optical lenses are used instead of human eyes, and the Zooming in during the shooting process can obtain clearer equipment images. However, the AOI system has the disadvantage that the method of judging whether the detection point is faulty is manually based on the standard digital image stored in the AOI system and the actual detection. For comparison and discrimination of the images in the image, which means that human visual contrast detection is also required, so there are also the shortcomings of slow detection speed, missed detection, and low accuracy.

在此基礎上,隨著人工智能技術的發展,人工智能深度學習方法也有應用在了檢測技術中。但當前人工智能在檢測、分類、偵測如果要得到準確的判定都需要長期大量樣本搜集、訓練和反復測試,導致人工智能很難在短期或者快速讓用戶看到成果和效益,人工智能不能處理定量,定位和邏輯關係。此外,目前的人工智能檢測方法大多利用神經網絡的學習方法對芯片缺陷進行檢測,神經網絡通過對隱藏層的訓練以實現檢測目的,但隱藏層的訓練和檢測過程類似一個“黑匣子”,其處理、判定過程不可知,造成檢測結果不可控。On this basis, with the development of artificial intelligence technology, artificial intelligence deep learning methods have also been applied to detection technology. However, the current artificial intelligence in detection, classification, and detection requires long-term large-scale sample collection, training and repeated testing, which makes it difficult for artificial intelligence to let users see the results and benefits in the short term or quickly, and artificial intelligence cannot handle it. Quantitative, positioning and logical relationships. In addition, most of the current artificial intelligence detection methods use neural network learning methods to detect chip defects. The neural network achieves the detection purpose by training the hidden layer, but the training and detection process of the hidden layer is similar to a "black box". , The judging process is unknowable, resulting in uncontrollable test results.

為解決上述問題,本發明提供一種缺陷檢測方法和檢測裝置,利用AOI系統獲取產品圖片的基礎上,用大量的產品缺陷圖片作為圖片數據庫,即時自動建立人工智能模型,不斷提升人工智能模型缺陷檢測的準確率;同時根據期望達到的檢測準確率與人工智能模型的實際檢測準確率,視情況引入一種基於AOI檢測邏輯的自定義檢測方法,使得檢測結果更加可控。In order to solve the above problems, the present invention provides a defect detection method and detection device. Based on the use of AOI system to obtain product pictures, a large number of product defect pictures are used as a picture database to automatically establish artificial intelligence models in real time, and continuously improve artificial intelligence model defect detection At the same time, according to the desired detection accuracy and the actual detection accuracy of the artificial intelligence model, a custom detection method based on AOI detection logic is introduced as appropriate to make the detection result more controllable.

具體地,本發明提供一種缺陷檢測方法,包括: 第一檢測步驟,於AOI系統設置一缺陷模板,所述AOI系統檢測所述缺陷模板的缺陷類型,得到第一檢測結果,若所述第一檢測結果準確,則輸出所述第一檢測結果,否則進行第二檢測步驟; 第二檢測步驟,將所述缺陷模板傳輸給一人工智能模型,所述人工智能模型檢測所述缺陷模板的缺陷類型,得到一第二檢測結果,並計算所述人工智能模型的檢測準確率,若所述第二檢測結果準確且所述檢測準確率符合一設定閾值,則輸出所述第二檢測結果並對所述人工智能模型進行訓練,若所述檢測準確率小於所述設定閾值,進行第三檢測步驟; 第三檢測步驟,將所述缺陷模板傳輸給一複檢系統,所述複檢系統將所述缺陷模板與一預設模板進行匹配檢測,得到第三檢測結果,並計算複檢準確率,若複檢準確率符合所述設定閾值,則輸出所述第三檢測結果並對所述人工智能模型進行訓練。 Specifically, the present invention provides a defect detection method, including: In the first detection step, a defect template is set in the AOI system. The AOI system detects the defect type of the defect template and obtains a first detection result. If the first detection result is accurate, the first detection result is output, Otherwise, proceed to the second detection step; The second detection step is to transmit the defect template to an artificial intelligence model, the artificial intelligence model detects the defect type of the defect template, obtains a second detection result, and calculates the detection accuracy of the artificial intelligence model, If the second detection result is accurate and the detection accuracy rate meets a set threshold, output the second detection result and train the artificial intelligence model; if the detection accuracy rate is less than the set threshold, perform The third detection step; In the third inspection step, the defect template is transmitted to a re-inspection system, and the re-inspection system performs matching inspection on the defect template and a preset template, obtains the third inspection result, and calculates the re-inspection accuracy rate, if If the recheck accuracy rate meets the set threshold, the third detection result is output and the artificial intelligence model is trained.

根據所述檢測方法,其中,所述人工智能模型的訓練步驟包括: 收集產品的缺陷圖片,並將所述缺陷圖片按照產品類別及缺陷類型進行分類; 分別統計每一產品具有各類型缺陷的缺陷圖片的數量,當任一產品具有一類型缺陷的缺陷圖片的數量超過一預設值,則使用一預設方法訓練所述人工智能模型對每一所述缺陷圖片進行檢測; 計算所述人工智能模型的訓練檢測準確率,當所述訓練檢測準確率超過所述預設方法訓練所述人工智能模型的預測準確率,完成針對所述缺陷圖片的人工智能模型訓練。 According to the detection method, wherein the training step of the artificial intelligence model includes: Collect defective pictures of products, and classify the defective pictures according to product category and defect type; Separately count the number of defective pictures with various types of defects for each product. When the number of defective pictures with a type of defect for any product exceeds a preset value, a preset method is used to train the artificial intelligence model for each Describe the defect pictures for inspection; The training detection accuracy rate of the artificial intelligence model is calculated, and when the training detection accuracy exceeds the prediction accuracy rate of the artificial intelligence model trained by the preset method, the artificial intelligence model training for the defective picture is completed.

根據所述檢測方法,其中,所述缺陷圖片的分類步驟包括: 獲取待檢測產品信息,確定所述產品的類別; 根據所述產品信息獲取所述產品的缺陷圖片,確定所述缺陷圖片的缺陷位置和缺陷類型; 將所述缺陷圖片按照所述產品類別和所述缺陷類型存入一圖片收集表。 According to the detection method, wherein the step of classifying the defective picture includes: Obtain the product information to be tested, and determine the category of the product; Acquiring a defect picture of the product according to the product information, and determining the defect location and defect type of the defect picture; The defect pictures are stored in a picture collection table according to the product category and the defect type.

根據所述檢測方法,其中,所述預設方法包括第一訓練方法、第二訓練方法和第三訓練方法,所述第一訓練方法、第二訓練方法和第三訓練方法分別具有不同的所述預測準確率。According to the detection method, wherein the preset method includes a first training method, a second training method, and a third training method, and the first training method, the second training method, and the third training method have different results. The prediction accuracy rate.

根據所述檢測方法,其中,所述第三檢測步驟還包括: 識別所述缺陷模板,並將所述缺陷模板匹配一所述預設模板; 抽取所述缺陷模板的特徵信息,其中所述特徵信息包括缺陷位置、顏色和符合; 將所述特徵信息與所述預設模板進行逐一比對檢測。 According to the detection method, wherein the third detection step further includes: Identifying the defect template, and matching the defect template to a preset template; Extracting feature information of the defect template, where the feature information includes defect location, color, and compliance; The feature information is compared and detected with the preset template one by one.

為實現本發明的另一目的,本發明還提供一種缺陷檢測裝置,包括: 接收模組,用於獲取待檢測的缺陷模板; 第一檢測模組,包括一AOI系統,所述AOI系統用於檢測所述缺陷模板的缺陷類型,以獲取第一檢測結果; 第二檢測模組,包括一人工智能模型,所述人工智能模型用於根據已訓練的檢測數據對所述缺陷模板進行缺陷檢測,以獲取第二檢測結果; 第三檢測模組,包括一複檢系統,所述複檢系統將所述缺陷模板與一預設模板進行匹配檢測,以獲取第三檢測結果; 控制模組,用於分別對所述第一檢測結果、第二檢測結果和第三檢測結果進行判斷,其中,若所述第一檢測結果準確,輸出所述第一檢測結果,否則將所述缺陷模板傳輸給所述第二檢測模組; 所述控制模組還用於計算所述人工智能模型的檢測準確率,若所述第二檢測結果準確且所述檢測準確率符合一設定閾值,則輸出所述第二檢測結果並對所述人工智能模型進行訓練,若所述檢測準確率小於所述設定閾值,將所述缺陷模板傳輸給所述第三檢測模組; 所述控制模組還用於計算所述複檢系統的複檢準確率,若複檢準確率符合所述設定閾值,則輸出所述第三檢測結果並對所述人工智能模型進行訓練。 In order to achieve another objective of the present invention, the present invention also provides a defect detection device, including: The receiving module is used to obtain the defect template to be detected; The first detection module includes an AOI system, and the AOI system is used to detect the defect type of the defect template to obtain the first detection result; The second detection module includes an artificial intelligence model that is used to perform defect detection on the defect template according to the trained detection data to obtain a second detection result; The third inspection module includes a re-inspection system, and the re-inspection system performs matching inspection on the defect template with a preset template to obtain a third inspection result; The control module is used to separately judge the first detection result, the second detection result and the third detection result, wherein, if the first detection result is accurate, output the first detection result, otherwise the The defect template is transmitted to the second inspection module; The control module is also used to calculate the detection accuracy rate of the artificial intelligence model, and if the second detection result is accurate and the detection accuracy rate meets a set threshold, output the second detection result and compare the The artificial intelligence model is trained, and if the detection accuracy rate is less than the set threshold, the defect template is transmitted to the third detection module; The control module is also used to calculate the re-inspection accuracy rate of the re-inspection system, and if the re-inspection accuracy rate meets the set threshold, output the third inspection result and train the artificial intelligence model.

根據所述檢測裝置,其中,所述第二檢測模組還包括一訓練單元,用於對所述人工智能模型進行訓練; 其中,所述訓練單元包括: 缺陷圖片分類子單元,用於收集產品的缺陷圖片,並將所述缺陷圖片按照產品類別及缺陷類型進行分類; 模型訓練子單元,用於分別統計每一產品具有各類型缺陷的缺陷圖片的數量,當任一產品具有一類型缺陷的缺陷圖片的數量超過一預設值,則使用一預設方法訓練所述人工智能模型對每一所述缺陷圖片進行檢測; 計算子單元,用於計算所述人工智能模型的訓練檢測準確率,當所述訓練檢測準確率超過所述預設方法訓練所述人工智能模型的預測準確率,完成針對所述缺陷圖片的人工智能模型訓練。 According to the detection device, wherein the second detection module further includes a training unit for training the artificial intelligence model; Wherein, the training unit includes: The defective picture classification subunit is used to collect defective pictures of products and classify the defective pictures according to product category and defect type; The model training subunit is used to separately count the number of defect pictures with each type of defect for each product. When the number of defect pictures with a type of defect for any product exceeds a preset value, a preset method is used to train the The artificial intelligence model detects each of the defective pictures; The calculation subunit is used to calculate the training detection accuracy rate of the artificial intelligence model. When the training detection accuracy rate exceeds the prediction accuracy rate of the artificial intelligence model trained by the preset method, the manual operation for the defective picture is completed. Intelligent model training.

根據所述檢測裝置,其中,所述缺陷圖片分類子單元進一步包括: 產品識別子單元,用於獲取待檢測產品信息,確定所述產品的類別; 缺陷識別子單元,用於根據所述產品信息獲取所述產品的缺陷圖片,確定所述缺陷圖片的缺陷位置和缺陷類型; 儲存子單元,用於將所述缺陷圖片按照所述產品類別和所述缺陷類型存入一圖片收集表。 According to the detection device, wherein the defective picture classification subunit further includes: The product identification subunit is used to obtain information about the product to be tested and determine the category of the product; The defect identification subunit is used to obtain a defect picture of the product according to the product information, and determine the defect location and defect type of the defect picture; The storage subunit is used to store the defective pictures in a picture collection table according to the product category and the defect type.

根據所述檢測裝置,其中,所述預設方法包括第一訓練方法、第二訓練方法和第三訓練方法,所述第一訓練方法、第二訓練方法和第三訓練方法分別具有不同的所述預測準確率。According to the detection device, wherein the preset method includes a first training method, a second training method, and a third training method, and the first training method, the second training method, and the third training method have different results. The prediction accuracy rate.

根據所述檢測裝置,其中,所述第三檢測模組還包括: 模板匹配單元,用於識別所述缺陷模板,並將所述缺陷模板匹配一所述預設模板; 特徵抽取單元,用於抽取所述缺陷模板的特徵信息,其中所述特徵信息包括缺陷位置、顏色和符合; 檢測單元,用於將所述特徵信息與所述預設模板進行逐一比對檢測。 According to the detection device, wherein the third detection module further includes: The template matching unit is used to identify the defective template and match the defective template to a preset template; A feature extraction unit for extracting feature information of the defect template, where the feature information includes defect location, color, and compliance; The detection unit is used to compare and detect the characteristic information with the preset template one by one.

以下結合附圖和具體實施例對本發明進行詳細描述,但不作為對本發明的限定。The following describes the present invention in detail with reference to the accompanying drawings and specific embodiments, but it is not intended to limit the present invention.

下面結合附圖對本發明的結構原理和工作原理作具體的描述,本部分的描述僅是示範性和解釋性,不應對本發明的保護範圍有任何的限制作用。The structural principle and working principle of the present invention will be described in detail below in conjunction with the accompanying drawings. The description in this part is only exemplary and explanatory, and should not have any limiting effect on the protection scope of the present invention.

請參考圖1,圖1所示為本發明的一實施例的缺陷檢測方法的流程示意圖。本實施例的缺陷檢測方法包括以下步驟。Please refer to FIG. 1, which is a schematic flowchart of a defect detection method according to an embodiment of the present invention. The defect detection method of this embodiment includes the following steps.

第一檢測步驟S1,此步驟基於現有的AOI系統而實現,於AOI系統設置一缺陷模板,其中,該缺陷模板為某一待測產品所具有的一類型缺陷的模板或者圖片,在本發明的一些實施例中,缺陷模板可以包括較多數量的產品的缺陷圖片。AOI系統獲取該缺陷模板後,即判別其缺陷類型,進而檢測出其具體的缺陷,以得到第一檢測結果,若第一檢測結果準確即AOI的檢測為可信的,則將第一檢測結果直接進行輸出,否則進行第二檢測步驟S2,也就是說,啟動進行第二檢測步驟S2,係由於第一檢測步驟S1中的AOI檢測不可信(檢測的準確率未達到用戶的需求)。The first detection step S1 is implemented based on the existing AOI system. A defect template is set in the AOI system. The defect template is a template or picture of a type of defect of a product to be tested. In some embodiments, the defect template may include defect images of a larger number of products. After the AOI system obtains the defect template, it distinguishes its defect type, and then detects its specific defect to obtain the first inspection result. If the first inspection result is accurate, that is, the AOI inspection is credible, the first inspection result is The output is directly performed, otherwise the second detection step S2 is performed, that is, the second detection step S2 is initiated because the AOI detection in the first detection step S1 is not credible (the accuracy of the detection does not meet the needs of the user).

第二檢測步驟S2,該檢測步驟主要基於一經過訓練的人工智能模型,該人工智能模型例如基於神經網絡實現。具體地,經第一檢測步驟S1檢測確認為不可信後,即將缺陷模板傳輸給人工智能模型,人工智能模型將缺陷模板與經訓練的檢測數據進行比對,以檢測缺陷模板的缺陷類型,得到第二檢測結果,同時計算人工智能模型的檢測準確率,若第二檢測結果準確且檢測準確率符合一設定閾值,即檢測準確率達到或者超過該設定閾值,則輸出所述第二檢測結果並對人工智能模型進行訓練,若檢測準確率小於所述設定閾值,進行啟用第三檢測步驟S3繼續檢測。於本實施例中,通過在人工智能檢測過程中對其進行循環訓練,實現了人工智能模型的自動建立機制,同時通過對人工智能模型不斷的訓練學習,使其進一步提高檢測準確率。The second detection step S2, the detection step is mainly based on a trained artificial intelligence model, which is implemented based on a neural network, for example. Specifically, after the first detection step S1 is confirmed to be untrustworthy, the defect template is transmitted to the artificial intelligence model, and the artificial intelligence model compares the defect template with the trained inspection data to detect the defect type of the defect template, and obtain The second detection result, and the detection accuracy rate of the artificial intelligence model is calculated at the same time. If the second detection result is accurate and the detection accuracy rate meets a set threshold, that is, the detection accuracy rate reaches or exceeds the set threshold, then the second detection result is output and The artificial intelligence model is trained, and if the detection accuracy rate is less than the set threshold, the third detection step S3 is activated to continue detection. In this embodiment, by performing cyclic training on the artificial intelligence detection process, the automatic establishment mechanism of the artificial intelligence model is realized, and at the same time, the artificial intelligence model is continuously trained and learned to further improve the detection accuracy.

具體來說,本實施例提供了一種人工智能模型的訓練方法,但本發明並不以此為限。請參考圖2,圖2所示為本發明一實施例的人工智能模型的訓練方法流程示意圖,如圖2所示,人工智能模型的訓練方法包括以下步驟。Specifically, this embodiment provides an artificial intelligence model training method, but the present invention is not limited to this. Please refer to FIG. 2. FIG. 2 is a schematic diagram of the flow of an artificial intelligence model training method according to an embodiment of the present invention. As shown in FIG. 2, the artificial intelligence model training method includes the following steps.

S21.收集產品的缺陷圖片,並將缺陷圖片按照產品類別及缺陷類型進行分類。本發明對缺陷圖片的收集方法不做限制,在本實施例中,提供一種圖片標注系統,用以獲取圖片並對圖片進行分類儲存。具體地,請參考圖3,圖3所示為本發明的一實施例的缺陷圖片的分類方法流程示意圖。缺陷圖片的缺陷圖片的分類步驟包括: S211.獲取待檢測產品信息,以確定產品的類別。即圖片標注系統通過掃入產品條碼,根據產品條碼確定產品的所屬類別。 S212.根據產品信息獲取產品的缺陷圖片,確定缺陷圖片的缺陷位置和缺陷類型。即圖片標注系統根據產品條碼找到待分類的產品缺陷圖片,並將待分類的產品缺陷圖片坐標顯示在顯示區,如圖4所示。操作人員根據實際缺陷位置點選對應坐標點,然後對應坐標點會彈出缺陷圖片和缺陷代碼選擇框,完成缺陷圖片的標注與分類工作。 S213.將缺陷圖片按照產品類別和缺陷類型存入一圖片收集表,此時操作人員根據實際缺陷選擇缺陷代碼,圖片標注系統將該實際缺陷按照其選擇的缺陷代碼分類儲存到一圖片收集表,該圖片收集表係標示產品種類和缺陷類型的二維表格。當然,本發明並不以此為限,圖片的儲存形式還可以例如是柱狀圖信息和扇形圖信息等其他符合要其的形式。 S21. Collect defective pictures of products, and classify the defective pictures according to product category and defect type. The present invention does not limit the collection method of defective pictures. In this embodiment, a picture labeling system is provided to obtain pictures and store them in categories. Specifically, please refer to FIG. 3, which is a schematic flowchart of a method for classifying defective pictures according to an embodiment of the present invention. The steps for classifying defective pictures of defective pictures include: S211. Obtain product information to be tested to determine the category of the product. That is, the picture labeling system determines the category of the product according to the product barcode by scanning the product barcode. S212. Obtain the defect picture of the product according to the product information, and determine the defect location and defect type of the defect picture. That is, the picture labeling system finds the product defect picture to be classified according to the product barcode, and displays the coordinate of the product defect picture to be classified in the display area, as shown in Figure 4. The operator clicks on the corresponding coordinate point according to the actual defect position, and then the corresponding coordinate point will pop up the defect picture and defect code selection box to complete the labeling and classification of the defect picture. S213. Store the defect pictures in a picture collection table according to the product category and defect type. At this time, the operator selects the defect code according to the actual defect, and the picture labeling system classifies and stores the actual defect in a picture collection table according to the defect code selected. The picture collection form is a two-dimensional form indicating product types and defect types. Of course, the present invention is not limited to this, and the storage form of the picture may also be other suitable forms such as bar graph information and fan graph information.

S22.分別統計每一產品具有各類型缺陷的缺陷圖片的數量,當其中某一產品具有任一類型缺陷的圖片數量超過一預設值,則使用一預設方法訓練人工智能模型對每一缺陷圖片進行檢測。在本實施例中,當圖片標注系統收集儲存到圖片收集表中的某種缺陷類型的缺陷圖片超過500張的時候,則啟動對人工智能模型進行訓練。S22. Separately count the number of defect pictures with various types of defects for each product. When the number of pictures with any type of defect in a certain product exceeds a preset value, use a preset method to train the artificial intelligence model for each defect Picture for inspection. In this embodiment, when the picture labeling system collects more than 500 defective pictures of a certain defect type stored in the picture collection table, the artificial intelligence model is started to be trained.

S23.計算人工智能模型的訓練檢測準確率,當訓練檢測準確率超過預設方法訓練人工智能模型的預測準確率,完成針對缺陷圖片的人工智能模型訓練。其中,在本實施例中,對人工智能模型的訓練算法可以預設多種,每一訓練算法具有不同的預測準確率,例如包括第一訓練方法、第二訓練方法和第三訓練方法,第一訓練方法、第二訓練方法和第三訓練方法分別具有不同的預測準確率。於實際訓練中,計算該訓練算法下的人工智能模型的實際檢測準確率,並將該實際檢測準確率與該算法具有的預測準確率進行比較,當實際檢測準確率達到或者超過預測準確率,則激活該類型缺陷圖片訓練的人工智能模型。S23. Calculate the training and detection accuracy of the artificial intelligence model. When the training detection accuracy exceeds the prediction accuracy of the artificial intelligence model trained by the preset method, complete the artificial intelligence model training for the defective image. Among them, in this embodiment, multiple training algorithms for the artificial intelligence model can be preset, and each training algorithm has a different prediction accuracy rate, for example, including the first training method, the second training method, and the third training method. The training method, the second training method and the third training method respectively have different prediction accuracy rates. In actual training, the actual detection accuracy rate of the artificial intelligence model under the training algorithm is calculated, and the actual detection accuracy rate is compared with the prediction accuracy rate of the algorithm. When the actual detection accuracy rate reaches or exceeds the prediction accuracy rate, Then activate the artificial intelligence model trained on this type of defect picture.

對於第二檢測步驟S2獲得的檢測準確率,如果尚不能滿足用戶的要求,則進一步進行第三檢測步驟S3。也就是說,於本發明中,第二檢測步驟S2與第三檢測步驟S3係為一種彈性結合方式。第三檢測步驟S3主要基於一種複檢系統,該複檢系統在基於AOI檢測邏輯的基礎上,融合特定的檢測方法。For the detection accuracy obtained in the second detection step S2, if the user's requirements are not yet satisfied, the third detection step S3 is further performed. That is to say, in the present invention, the second detection step S2 and the third detection step S3 are a flexible combination. The third detection step S3 is mainly based on a re-inspection system that integrates specific detection methods on the basis of AOI detection logic.

具體地,當確認上述第二檢測步驟S2獲得的檢測準確率不能滿足要求的情況下,將缺陷模板傳輸給一複檢系統,複檢系統將缺陷模板與一預設模板進行匹配檢測,得到第三檢測結果,並計算複檢準確率,若複檢準確率達到或者超過所述設定閾值,則輸出第三檢測結果並對人工智能模型進行訓練。其中該設定閾值可根據用戶需求進行實際設定。Specifically, when it is confirmed that the detection accuracy obtained in the second detection step S2 cannot meet the requirements, the defect template is transmitted to a re-inspection system, and the re-inspection system performs matching detection between the defect template and a preset template to obtain the first Three detection results, and the re-inspection accuracy rate is calculated. If the re-inspection accuracy rate reaches or exceeds the set threshold, the third detection result is output and the artificial intelligence model is trained. The set threshold can be actually set according to user needs.

具體請參考圖5,圖5所示為本發明一實施例的複檢系統的檢測流程示意圖,其包括以下檢測步驟: S31.對缺陷模板進行識別,並將缺陷模板與複檢系統中的一預設模板進行匹配; S32.抽取缺陷模板的特徵信息,其中特徵信息例如包括缺陷位置、顏色和符合; S33.將特徵信息與預設模板進行逐一比對檢測。 Please refer to FIG. 5 for details. FIG. 5 is a schematic diagram of the detection process of the re-inspection system according to an embodiment of the present invention, which includes the following detection steps: S31. Identify the defect template, and match the defect template with a preset template in the re-inspection system; S32. Extract feature information of the defect template, where the feature information includes, for example, defect location, color, and compliance; S33. Compare and detect the feature information with the preset template one by one.

為實現本發明的另一目的,基於上述同一發明構思,本發明還提供一種缺陷檢測裝置。請繼續參考圖6,圖6所示為本發明的一是私立的缺陷檢測裝置的方塊圖。如圖6所示,本實施例的缺陷檢測裝置100,具體包括接收模組110、第一檢測模組120、第二檢測模組130、第三檢測模組140以及控制模組150。In order to achieve another objective of the present invention, based on the same inventive concept described above, the present invention also provides a defect detection device. Please continue to refer to FIG. 6, which shows a block diagram of a private defect detection device according to the present invention. As shown in FIG. 6, the defect detection device 100 of this embodiment specifically includes a receiving module 110, a first detection module 120, a second detection module 130, a third detection module 140, and a control module 150.

其中,接收模組用於獲取待檢測的缺陷模板。第一檢測模組120中包括一AOI系統,AOI系統用於檢測缺陷模板的缺陷類型,以獲取第一檢測結果;第二檢測模組130,包括一人工智能模型,人工智能模型用於根據已訓練的檢測數據對缺陷模板進行缺陷檢測,以獲取第二檢測結果;第三檢測模組140包括一複檢系統,複檢系統將缺陷模板與一預設模板進行匹配檢測,以獲取第三檢測結果;控制模組150用於分別對第一檢測結果、第二檢測結果和第三檢測結果進行判斷,其中,若第一檢測結果準確,輸出所述第一檢測結果,否則將缺陷模板傳輸給所述第二檢測模組130;所述控制模組150還用於計算人工智能模型的檢測準確率,若第二檢測結果準確且檢測準確率符合一設定閾值,則輸出第二檢測結果並對人工智能模型進行訓練,若檢測準確率小於設定閾值,將缺陷模板傳輸給第三檢測模組140;所述控制模組150還用於計算複檢系統的複檢準確率,若複檢準確率符合(即達到或者超過)設定閾值,則輸出第三檢測結果並對人工智能模型進行訓練。Among them, the receiving module is used to obtain the defect template to be detected. The first inspection module 120 includes an AOI system, which is used to detect the defect type of the defect template to obtain the first inspection result; the second inspection module 130 includes an artificial intelligence model, which is used to The trained inspection data performs defect inspection on the defect template to obtain the second inspection result; the third inspection module 140 includes a re-inspection system, and the re-inspection system performs matching inspection on the defect template with a preset template to obtain the third inspection Result; the control module 150 is used to separately determine the first detection result, the second detection result and the third detection result, wherein, if the first detection result is accurate, output the first detection result, otherwise the defect template is transmitted to The second detection module 130; the control module 150 is also used to calculate the detection accuracy of the artificial intelligence model. If the second detection result is accurate and the detection accuracy meets a set threshold, the second detection result is output and the The artificial intelligence model is trained. If the detection accuracy rate is less than the set threshold, the defect template is transmitted to the third detection module 140; the control module 150 is also used to calculate the re-inspection accuracy rate of the re-inspection system, if the re-inspection accuracy rate is If the threshold is met (that is, reached or exceeded), the third detection result is output and the artificial intelligence model is trained.

進一步地,第二檢測模組130還包括一訓練單元131,用於對人工智能模型進行訓練。其中,訓練單元131包括如下。Further, the second detection module 130 further includes a training unit 131 for training the artificial intelligence model. Among them, the training unit 131 includes the following.

缺陷圖片分類子單元1311,用於收集產品的缺陷圖片,並將缺陷圖片按照產品類別及缺陷類型進行分類;本發明對缺陷圖片的收集方法不做限制,在本實施例中,提供一種圖片標注系統,用以獲取圖片並對圖片進行分類儲存。具體地,缺陷圖片的分類子單元進一步包括: 產品識別子單元A,用於獲取待檢測產品信息,確定產品的類別。即圖片標注系統通過掃入產品條碼,根據產品條碼確定產品的所屬類別。 缺陷識別子單元B,用於根據產品信息獲取產品的缺陷圖片,確定缺陷圖片的缺陷位置和缺陷類型。即圖片標注系統根據產品條碼找到待分類的產品缺陷圖片,並將待分類的產品缺陷圖片坐標顯示在顯示區,如圖4所示。操作人員根據實際缺陷位置點選對應坐標點,然後對應坐標點會彈出缺陷圖片和缺陷代碼選擇框,完成缺陷圖片的標注與分類工作。 儲存子單元C,用於將缺陷圖片按照產品類別和缺陷類型存入一圖片收集表。此時操作人員根據實際缺陷選擇缺陷代碼,圖片標注系統將該實際缺陷按照其選擇的缺陷代碼分類儲存到一圖片收集表,該圖片收集表係標示產品種類和缺陷類型的二維表格。當然,本發明並不以此為限,圖片的儲存形式還可以例如是柱狀圖信息和扇形圖信息等其他符合要其的形式。 The defective picture classification subunit 1311 is used to collect defective pictures of products and classify the defective pictures according to product categories and defect types; the present invention does not limit the collection method of defective pictures. In this embodiment, a picture label is provided The system is used to obtain pictures and sort them into storage. Specifically, the classification subunit of the defective picture further includes: The product identification subunit A is used to obtain the information of the product to be tested and determine the category of the product. That is, the picture labeling system determines the category of the product according to the product barcode by scanning the product barcode. The defect recognition subunit B is used to obtain the defect picture of the product according to the product information, and determine the defect location and defect type of the defect picture. That is, the picture labeling system finds the product defect picture to be classified according to the product barcode, and displays the coordinate of the product defect picture to be classified in the display area, as shown in Figure 4. The operator clicks on the corresponding coordinate point according to the actual defect position, and then the corresponding coordinate point will pop up the defect picture and defect code selection box to complete the labeling and classification of the defect picture. The storage subunit C is used to store the defective pictures in a picture collection table according to the product category and the defect type. At this time, the operator selects the defect code based on the actual defect, and the picture labeling system sorts and stores the actual defect in a picture collection table according to the selected defect code. The picture collection table is a two-dimensional table indicating the product type and the defect type. Of course, the present invention is not limited to this, and the storage form of the picture may also be other suitable forms such as bar graph information and fan graph information.

模型訓練子單元1312,用於分別統計每一產品具有各類型缺陷的缺陷圖片的數量,當任一產品具有一類型缺陷的缺陷圖片的數量超過一預設值,則使用一預設方法訓練人工智能模型對每一缺陷圖片進行檢測。在本實施例中,當圖片標注系統收集儲存到圖片收集表中的某種缺陷類型的缺陷圖片超過500張的時候,則啟動對人工智能模型進行訓練。The model training subunit 1312 is used to separately count the number of defective pictures with various types of defects for each product. When the number of defective pictures with a type of defect for any product exceeds a preset value, a preset method is used to train the manual The intelligent model detects each defect picture. In this embodiment, when the picture labeling system collects more than 500 defective pictures of a certain defect type stored in the picture collection table, the artificial intelligence model is started to be trained.

計算子單元1313,用於計算人工智能模型的訓練檢測準確率,當訓練檢測準確率超過預設方法訓練人工智能模型的預測準確率,完成針對所述缺陷圖片的人工智能模型訓練。其中,在本實施例中,對人工智能模型的訓練算法可以預設多種,每一訓練算法具有不同的預測準確率,例如包括第一訓練方法、第二訓練方法和第三訓練方法,第一訓練方法、第二訓練方法和第三訓練方法分別具有不同的預測準確率。於實際訓練中,計算該訓練算法下的人工智能模型的實際檢測準確率,並將該實際檢測準確率與該算法具有的預測準確率進行比較,當實際檢測準確率達到或者超過預測準確率,則激活該類型缺陷圖片訓練的人工智能模型。The calculation subunit 1313 is used to calculate the training detection accuracy of the artificial intelligence model. When the training detection accuracy exceeds the prediction accuracy of the artificial intelligence model trained by the preset method, the artificial intelligence model training for the defective picture is completed. Among them, in this embodiment, multiple training algorithms for the artificial intelligence model can be preset, and each training algorithm has a different prediction accuracy rate, for example, including the first training method, the second training method, and the third training method. The training method, the second training method and the third training method respectively have different prediction accuracy rates. In actual training, the actual detection accuracy rate of the artificial intelligence model under the training algorithm is calculated, and the actual detection accuracy rate is compared with the prediction accuracy rate of the algorithm. When the actual detection accuracy rate reaches or exceeds the prediction accuracy rate, Then activate the artificial intelligence model trained on this type of defect picture.

對於第二檢測模組130獲得的檢測準確率,如果尚不能滿足用戶的要求,則進一步啟動第三檢測模組140。也就是說,於本發明中,第二檢測模組130與第三檢測模組140係為一種彈性結合方式。第三檢測模組140主要基於一種複檢系統,該複檢系統在基於AOI檢測邏輯的基礎上,融合特定的檢測方法。For the detection accuracy rate obtained by the second detection module 130, if the requirements of the user are not yet satisfied, the third detection module 140 is further activated. That is to say, in the present invention, the second detection module 130 and the third detection module 140 are a flexible combination. The third detection module 140 is mainly based on a re-inspection system that integrates specific detection methods on the basis of AOI detection logic.

具體地,當確認上述第二檢測步驟S2獲得的檢測準確率不能滿足要求的情況下,將缺陷模板傳輸給一複檢系統,複檢系統將缺陷模板與一預設模板進行匹配檢測,得到第三檢測結果,並計算複檢準確率,若複檢準確率符合(即達到或者超過)所述設定閾值,則輸出第三檢測結果並對人工智能模型進行訓練。其中該設定閾值可根據用戶需求進行實際設定。Specifically, when it is confirmed that the detection accuracy obtained in the second detection step S2 cannot meet the requirements, the defect template is transmitted to a re-inspection system, and the re-inspection system performs matching detection between the defect template and a preset template to obtain the first Three detection results, and the re-inspection accuracy rate is calculated. If the re-inspection accuracy rate meets (that is, reaches or exceeds) the set threshold, the third detection result is output and the artificial intelligence model is trained. Among them, the set threshold can be actually set according to user needs.

具體而言,第三檢測模組140還包括:模板匹配單元141、特徵抽取單元142和檢測單元143,其中模板匹配單元141用於識別缺陷模板,並將缺陷模板匹配一所述預設模板;特徵抽取單元142用於抽取缺陷模板的特徵信息,其中特徵信息包括缺陷位置、顏色和符合;檢測單元143用於將特徵信息與預設模板進行逐一比對檢測。Specifically, the third detection module 140 further includes: a template matching unit 141, a feature extraction unit 142, and a detection unit 143, wherein the template matching unit 141 is used to identify a defective template and match the defective template with a preset template; The feature extraction unit 142 is used to extract feature information of the defect template, where the feature information includes defect location, color, and coincidence; the detection unit 143 is used to compare and detect the feature information with the preset template one by one.

綜上所述,本發明提供一種新的用於各種電子元器件的缺陷檢測方法和裝置,本發明針對人工智能模型的檢測準確率較低的情形,分別增加分值卡控(即設置設定閾值),以及在複檢系統中採取基於AOI 邏輯的自定義檢測方法對產品缺陷進行再次檢測,以人為干涉檢測判定過程,增加檢測結果的可控性。進一步地,本發明為快速可讓用戶看到成果和效益,可以通過設置輸入不同缺陷類型的圖片啟動檢測進程,使檢測效果更加高效。本發明通過圖片標注系統於缺陷檢測過程中收集缺陷圖片,對人工智能模型進行不斷訓練,使人工智能模型能夠自動建立,避免了人工智能在檢測、分類等過程中需要長期大量樣本搜集、訓練和反復測試的情形。另外,本發明的缺陷檢測方法和裝置可並行用於多種待判定對象,提升檢測效率。In summary, the present invention provides a new defect detection method and device for various electronic components. In view of the low detection accuracy of the artificial intelligence model, the present invention separately increases the score card control (that is, sets the set threshold ), and in the re-inspection system, a custom inspection method based on AOI logic is adopted to re-inspect product defects, and the inspection and determination process is artificially interfered to increase the controllability of the inspection results. Further, the present invention allows users to see results and benefits quickly, and can start the detection process by setting and inputting pictures of different defect types, so that the detection effect is more efficient. The present invention collects defective pictures during the defect detection process through the picture labeling system, and continuously trains the artificial intelligence model, so that the artificial intelligence model can be automatically established, and avoids the need for long-term large-scale sample collection, training and training in the process of detection and classification. A situation of repeated testing. In addition, the defect detection method and device of the present invention can be used in parallel for a variety of objects to be determined to improve the detection efficiency.

當然,本發明還可有其它多種實施例,在不背離本發明精神及其實質的情況下,熟悉本領域的技術人員當可根據本發明作出各種相應的改變和變形,但這些相應的改變和變形都應屬本發明所附的申請專利範圍的保護範圍。Of course, the present invention can also have various other embodiments. Without departing from the spirit and essence of the present invention, those skilled in the art can make various corresponding changes and modifications according to the present invention, but these corresponding changes and All deformations shall fall within the protection scope of the attached patent application of the present invention.

S1~S3,S21~S23,S211~S213,S31~S33:步驟 100:缺陷檢測裝置 110:接收模組 120:第一檢測模組 130:第二檢測模組 131:訓練單元 1311:缺陷圖片分類子單元 A:產品識別子單元 B:缺陷識別子單元 C:儲存子單元 1312:模型訓練子單元 1313:計算子單元 140:第三檢測模組 141:模板匹配單元 142:特徵抽取單元 143:檢測單元 150:控制模組S1~S3, S21~S23, S211~S213, S31~S33: steps 100: Defect detection device 110: receiving module 120: The first detection module 130: The second detection module 131: Training Unit 1311: Defect image classification subunit A: Product identification subunit B: Defect Recognition Subunit C: Storage subunit 1312: Model training subunit 1313: calculation subunit 140: The third detection module 141: template matching unit 142: Feature Extraction Unit 143: detection unit 150: control module

圖1為本發明的一實施例的缺陷檢測方法的流程示意圖。 圖2為本發明一實施例的人工智能模型的訓練方法流程示意圖。 圖3為本發明的一實施例的缺陷圖片的分類方法流程示意圖。 圖4為本發明的一實施例的圖片標注系統的示意圖。 圖5所示為本發明一實施例的複檢系統的檢測流程示意圖。 圖6所示為本發明的一實施例的缺陷檢測裝置的框架圖。 FIG. 1 is a schematic flowchart of a defect detection method according to an embodiment of the present invention. Fig. 2 is a schematic flowchart of a training method of an artificial intelligence model according to an embodiment of the present invention. FIG. 3 is a schematic flowchart of a method for classifying defective pictures according to an embodiment of the present invention. Fig. 4 is a schematic diagram of a picture labeling system according to an embodiment of the present invention. FIG. 5 is a schematic diagram of the detection process of the re-inspection system according to an embodiment of the present invention. Fig. 6 is a frame diagram of a defect detection device according to an embodiment of the present invention.

S1~S3:步驟 S1~S3: steps

Claims (10)

一種缺陷檢測方法,包括: 第一檢測步驟,於AOI系統設置一缺陷模板,所述AOI系統檢測所述缺陷模板的缺陷類型,得到第一檢測結果,若所述第一檢測結果準確,則輸出所述第一檢測結果,否則進行第二檢測步驟; 第二檢測步驟,將所述缺陷模板傳輸至一人工智能模型,所述人工智能模型檢測所述缺陷模板,得到一第二檢測結果並計算所述人工智能模型的檢測準確率,若所述第二檢測結果準確且所述檢測準確率符合一設定閾值,則輸出所述第二檢測結果並對所述人工智能模型進行訓練,若所述檢測準確率小於所述設定閾值,進行第三檢測步驟; 第三檢測步驟,將所述缺陷模板傳輸至一複檢系統,所述複檢系統將所述缺陷模板與一預設模板進行匹配檢測,得到第三檢測結果並計算複檢準確率,若複檢準確率符合所述設定閾值,則輸出所述第三檢測結果並對所述人工智能模型進行訓練。 A defect detection method, including: In the first detection step, a defect template is set in the AOI system. The AOI system detects the defect type of the defect template and obtains a first detection result. If the first detection result is accurate, the first detection result is output, Otherwise, proceed to the second detection step; The second detection step is to transmit the defect template to an artificial intelligence model, the artificial intelligence model detects the defect template, obtains a second detection result and calculates the detection accuracy of the artificial intelligence model, if the first 2. If the detection result is accurate and the detection accuracy rate meets a set threshold, output the second detection result and train the artificial intelligence model. If the detection accuracy rate is less than the set threshold, perform a third detection step ; In the third inspection step, the defect template is transmitted to a re-inspection system, and the re-inspection system performs matching inspection on the defect template and a preset template to obtain the third inspection result and calculate the re-inspection accuracy rate. If the detection accuracy rate meets the set threshold, output the third detection result and train the artificial intelligence model. 根據請求項1所述的缺陷檢測方法,其中,所述人工智能模型的訓練步驟包括: 收集產品的缺陷圖片,並將所述缺陷圖片按照產品類別及缺陷類型進行分類; 分別統計每一產品具有各類型缺陷的缺陷圖片的數量,當任一產品具有一類型缺陷的缺陷圖片的數量超過一預設值,則使用一預設方法訓練所述人工智能模型對每一所述缺陷圖片逐一進行檢測; 計算所述人工智能模型的訓練檢測準確率,當所述訓練檢測準確率大於或者等於所述預設方法訓練所述人工智能模型的預測準確率,完成針對所述缺陷圖片的人工智能模型訓練。 The defect detection method according to claim 1, wherein the training step of the artificial intelligence model includes: Collect defective pictures of products, and classify the defective pictures according to product category and defect type; Separately count the number of defective pictures with various types of defects for each product. When the number of defective pictures with a type of defect for any product exceeds a preset value, a preset method is used to train the artificial intelligence model for each Check the defect pictures one by one; The training detection accuracy rate of the artificial intelligence model is calculated, and when the training detection accuracy rate is greater than or equal to the prediction accuracy rate of the artificial intelligence model trained by the preset method, the artificial intelligence model training for the defective picture is completed. 根據請求項2所述的缺陷檢測方法,其中,所述缺陷圖片的分類步驟包括: 獲取待檢測產品信息,確定所述產品的類別; 根據所述產品信息獲取所述產品的缺陷圖片,確定所述缺陷圖片的缺陷類型; 將所述缺陷圖片按照所述產品類別和所述缺陷類型進行分類儲存。 The defect detection method according to claim 2, wherein the step of classifying the defect picture includes: Obtain the product information to be tested, and determine the category of the product; Acquiring a defective picture of the product according to the product information, and determining the defect type of the defective picture; The defect pictures are classified and stored according to the product category and the defect type. 根據請求項2所述的缺陷檢測方法,其中,所述預設方法包括第一訓練方法、第二訓練方法和第三訓練方法,所述第一訓練方法、第二訓練方法和第三訓練方法分別具有不同的所述預測準確率。The defect detection method according to claim 2, wherein the preset method includes a first training method, a second training method, and a third training method, and the first training method, the second training method, and the third training method Each has a different prediction accuracy rate. 根據請求項1所述的缺陷檢測方法,其中,所述第三檢測步驟還包括: 識別所述缺陷模板,並將所述缺陷模板匹配一所述預設模板; 抽取所述缺陷模板的特徵信息,其中所述特徵信息包括缺陷位置、顏色和符合; 將所述特徵信息與所述預設模板進行逐一比對檢測。 The defect detection method according to claim 1, wherein the third detection step further includes: Identifying the defect template, and matching the defect template to a preset template; Extracting feature information of the defect template, where the feature information includes defect location, color, and compliance; The feature information is compared and detected with the preset template one by one. 一種缺陷檢測裝置,包括: 接收模組,用於獲取待檢測的缺陷模板; 第一檢測模組,包括一AOI系統,所述AOI系統用於檢測所述缺陷模板的缺陷類型,以獲取第一檢測結果; 第二檢測模組,包括一人工智能模型,所述人工智能模型用於根據已訓練的檢測數據對所述缺陷模板進行缺陷檢測,以獲取第二檢測結果; 第三檢測模組,包括一複檢系統,所述複檢系統將所述缺陷模板與一預設模板進行匹配檢測,以獲取第三檢測結果; 控制模組,用於分別對所述第一檢測結果、第二檢測結果和第三檢測結果進行判斷,其中,若所述第一檢測結果準確,輸出所述第一檢測結果,否則將所述缺陷模板傳輸給所述第二檢測模組; 所述控制模組還用於計算所述人工智能模型的檢測準確率,若所述第二檢測結果準確且所述檢測準確率符合一設定閾值,則輸出所述第二檢測結果並對所述人工智能模型進行訓練,若所述檢測準確率小於所述設定閾值,將所述缺陷模板傳輸給所述第三檢測模組; 所述控制模組還用於計算所述複檢系統的複檢準確率,若複檢準確率符合所述設定閾值,則輸出所述第三檢測結果並對所述人工智能模型進行訓練。 A defect detection device, including: The receiving module is used to obtain the defect template to be detected; The first detection module includes an AOI system, and the AOI system is used to detect the defect type of the defect template to obtain the first detection result; The second detection module includes an artificial intelligence model that is used to perform defect detection on the defect template according to the trained detection data to obtain a second detection result; The third inspection module includes a re-inspection system, and the re-inspection system performs matching inspection on the defect template with a preset template to obtain a third inspection result; The control module is used to separately judge the first detection result, the second detection result and the third detection result, wherein, if the first detection result is accurate, output the first detection result, otherwise the The defect template is transmitted to the second inspection module; The control module is also used to calculate the detection accuracy rate of the artificial intelligence model, and if the second detection result is accurate and the detection accuracy rate meets a set threshold, output the second detection result and compare the The artificial intelligence model is trained, and if the detection accuracy rate is less than the set threshold, the defect template is transmitted to the third detection module; The control module is also used to calculate the re-inspection accuracy rate of the re-inspection system, and if the re-inspection accuracy rate meets the set threshold, output the third inspection result and train the artificial intelligence model. 根據請求項6所述的缺陷檢測裝置,其中,所述第二檢測模組還包括一訓練單元,用於對所述人工智能模型進行訓練; 其中,所述訓練單元包括: 缺陷圖片分類子單元,用於收集產品的缺陷圖片,並將所述缺陷圖片按照產品類別及缺陷類型進行分類; 模型訓練子單元,用於分別統計每一產品具有各類型缺陷的缺陷圖片的數量,當任一產品具有一類型缺陷的缺陷圖片的數量超過一預設值,則使用一預設方法訓練所述人工智能模型對每一所述缺陷圖片進行檢測; 計算子單元,用於計算所述人工智能模型的訓練檢測準確率,當所述訓練檢測準確率超過所述預設方法訓練所述人工智能模型的預測準確率,完成針對所述缺陷圖片的人工智能模型訓練。 The defect detection device according to claim 6, wherein the second detection module further includes a training unit for training the artificial intelligence model; Wherein, the training unit includes: The defective picture classification subunit is used to collect defective pictures of products and classify the defective pictures according to product category and defect type; The model training subunit is used to separately count the number of defect pictures with each type of defect for each product. When the number of defect pictures with a type of defect for any product exceeds a preset value, a preset method is used to train the The artificial intelligence model detects each of the defective pictures; The calculation subunit is used to calculate the training detection accuracy rate of the artificial intelligence model. When the training detection accuracy rate exceeds the prediction accuracy rate of the artificial intelligence model trained by the preset method, the manual operation for the defective picture is completed. Intelligent model training. 根據請求項7所述的缺陷檢測裝置,其中,所述缺陷圖片分類子單元進一步包括: 產品識別子單元,用於獲取待檢測產品信息,確定所述產品的類別; 缺陷識別子單元,用於根據所述產品信息獲取所述產品的缺陷圖片,確定所述缺陷圖片的缺陷位置和缺陷類型; 儲存子單元,用於將所述缺陷圖片按照所述產品類別和所述缺陷類型進行分類儲存。 The defect detection device according to claim 7, wherein the defect picture classification subunit further includes: The product identification subunit is used to obtain information about the product to be tested and determine the category of the product; The defect identification subunit is used to obtain a defect picture of the product according to the product information, and determine the defect location and defect type of the defect picture; The storage subunit is used to classify and store the defect pictures according to the product category and the defect type. 根據請求項7所述的缺陷檢測裝置,其中,所述預設方法包括第一訓練方法、第二訓練方法和第三訓練方法,所述第一訓練方法、第二訓練方法和第三訓練方法分別具有不同的所述預測準確率。The defect detection device according to claim 7, wherein the preset method includes a first training method, a second training method, and a third training method, and the first training method, the second training method, and the third training method Each has a different prediction accuracy rate. 根據請求項6所述的缺陷檢測裝置,其中,所述第三檢測模組還包括: 模板匹配單元,用於識別所述缺陷模板,並將所述缺陷模板匹配一所述預設模板; 特徵抽取單元,用於抽取所述缺陷模板的特徵信息,其中所述特徵信息包括缺陷位置、顏色和符合; 檢測單元,用於將所述特徵信息與所述預設模板進行逐一比對檢測。 The defect detection device according to claim 6, wherein the third detection module further includes: The template matching unit is used to identify the defective template and match the defective template to a preset template; A feature extraction unit for extracting feature information of the defect template, where the feature information includes defect location, color, and compliance; The detection unit is used to compare and detect the characteristic information with the preset template one by one.
TW109146051A 2020-11-11 2020-12-24 A defect detection method and a defect detection device TWI747686B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011253928.2 2020-11-11
CN202011253928.2A CN114494103A (en) 2020-11-11 2020-11-11 Defect detection method and device

Publications (2)

Publication Number Publication Date
TWI747686B true TWI747686B (en) 2021-11-21
TW202219494A TW202219494A (en) 2022-05-16

Family

ID=79907546

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109146051A TWI747686B (en) 2020-11-11 2020-12-24 A defect detection method and a defect detection device

Country Status (2)

Country Link
CN (1) CN114494103A (en)
TW (1) TWI747686B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116380919B (en) * 2023-06-02 2023-08-15 深圳市磐锋精密技术有限公司 Soft appearance defect detection system and detection method based on AOI online technology

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105021694A (en) * 2015-07-02 2015-11-04 清华大学 Magnetic leakage detection defect quantification and display method under imperfect signal
CN107909118A (en) * 2017-12-11 2018-04-13 北京映翰通网络技术股份有限公司 A kind of power distribution network operating mode recording sorting technique based on deep neural network

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105021694A (en) * 2015-07-02 2015-11-04 清华大学 Magnetic leakage detection defect quantification and display method under imperfect signal
CN107909118A (en) * 2017-12-11 2018-04-13 北京映翰通网络技术股份有限公司 A kind of power distribution network operating mode recording sorting technique based on deep neural network

Also Published As

Publication number Publication date
TW202219494A (en) 2022-05-16
CN114494103A (en) 2022-05-13

Similar Documents

Publication Publication Date Title
CN106960195B (en) Crowd counting method and device based on deep learning
CN111401419A (en) Improved RetinaNet-based employee dressing specification detection method
CN110390229B (en) Face picture screening method and device, electronic equipment and storage medium
CN111667455A (en) AI detection method for various defects of brush
CN110378232B (en) Improved test room examinee position rapid detection method of SSD dual-network
CN105224921A (en) A kind of facial image preferentially system and disposal route
CN106886216A (en) Robot automatic tracking method and system based on RGBD Face datections
CN111415339B (en) Image defect detection method for complex texture industrial product
CN113642474A (en) Hazardous area personnel monitoring method based on YOLOV5
CN111062961A (en) Contact lens edge defect detection method based on deep learning
TWI707137B (en) Intelligent production line monitoring system and implementation method thereof
CN111325133A (en) Image processing system based on artificial intelligence recognition
CN116385430A (en) Machine vision flaw detection method, device, medium and equipment
TWI747686B (en) A defect detection method and a defect detection device
CN105844282A (en) Method for detecting defects of fuel injection nozzle O-Ring through line scanning camera
CN109685756A (en) Image feature automatic identifier, system and method
CN116978834B (en) Intelligent monitoring and early warning system for wafer production
Chen et al. Real-time defect detection of TFT-LCD displays using a lightweight network architecture
CN115359412B (en) Hydrochloric acid neutralization experiment scoring method, device, equipment and readable storage medium
CN116342502A (en) Industrial vision detection method based on deep learning
CN105973910A (en) Structure and texture characteristic-based lamp tube quality detection and flaw classification method and system thereof
TWI749714B (en) Method for defect detection, method for defect classification and system thereof
CN109975307A (en) Bearing surface defect detection system and detection method based on statistics projection training
CN106446837B (en) A kind of detection method of waving based on motion history image
CN114596296A (en) High-sensitivity hot-rolled steel coil end surface defect identification system and method