TWI780580B - Image reinspection method, computer device, and storage medium - Google Patents

Image reinspection method, computer device, and storage medium Download PDF

Info

Publication number
TWI780580B
TWI780580B TW110102905A TW110102905A TWI780580B TW I780580 B TWI780580 B TW I780580B TW 110102905 A TW110102905 A TW 110102905A TW 110102905 A TW110102905 A TW 110102905A TW I780580 B TWI780580 B TW I780580B
Authority
TW
Taiwan
Prior art keywords
image
tested
inspection
pcb
parameters
Prior art date
Application number
TW110102905A
Other languages
Chinese (zh)
Other versions
TW202230281A (en
Inventor
黃進東
袁鋒
蕭偉郎
邱垂甫
陳淑如
陳怡靜
張晏瑋
羅豔
Original Assignee
大陸商富泰華工業(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 大陸商富泰華工業(深圳)有限公司 filed Critical 大陸商富泰華工業(深圳)有限公司
Publication of TW202230281A publication Critical patent/TW202230281A/en
Application granted granted Critical
Publication of TWI780580B publication Critical patent/TWI780580B/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/0008Industrial image inspection checking presence/absence
    • G06T5/70
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30141Printed circuit board [PCB]

Abstract

The present application provides an image reinspection method, a computer device, and a storage medium. The image reinspection method includes obtaining images to be tested and corresponding image information; using an artificial intelligence program to analyze the image information and obtain parameters of the image to be tested; using a pre-trained image retest model to retest the images to be tested based on the parameters and obtaining retest results; uploading the images to be tested with flaws in the retest results to a pre-established image re-inspection system; distributing the images to be tested to designated users using the pre-established image re-inspection system, receiving marks of the designated user for the images to be tested, and feeding back a final test result of the images to be tested according to the marks. This application can assist in the reinspection of printed circuit boards judged as defective by automatic optical inspection equipment, reduce labor costs, and improve inspection efficiency and accuracy.

Description

圖像複檢方法、電腦裝置及儲存介質 Image recheck method, computer device and storage medium

本發明涉及印刷電路板檢測領域,尤其涉及一種圖像複檢方法、電腦裝置及儲存介質。 The invention relates to the field of printed circuit board detection, in particular to an image re-inspection method, a computer device and a storage medium.

印刷電路板(Printed Circuit Board,PCB)在製成過程中大多利用自動光學檢測(Automated Optical Inspection,AOI)設備進行檢測,從而判斷PCB是否為含偏位、缺件、少錫、多錫等缺陷元件的不良品。通常,由於被AOI設備判斷為不良品的PCB會出現大量假缺陷的情況,即AOI設備很難將實際上只佔少數的不良品進行精確地檢出,工作人員往往需要對被AOI設備判斷為不良品的PCB進行人工複檢,耗費大量人力和時間。 Printed Circuit Board (PCB) is mostly inspected by Automated Optical Inspection (AOI) equipment during the manufacturing process, so as to determine whether the PCB contains defects such as deviation, missing parts, less tin, and more tin. Defective parts. Usually, due to the fact that there will be a large number of false defects in PCBs judged as defective products by AOI equipment, that is, it is difficult for AOI equipment to accurately detect only a small number of defective products. Manual re-inspection of defective PCBs takes a lot of manpower and time.

鑒於以上內容,有必要提供一種圖像複檢方法、電腦裝置及儲存介質,能夠基於電腦視覺影像處理技術對被自動光學檢測AOI設備判斷為不良品的印刷電路板PCB進行複檢,降低人工複檢工作量,提高檢測效率和準確性。 In view of the above, it is necessary to provide an image re-inspection method, computer device and storage medium, which can re-inspect printed circuit board PCBs judged as defective products by automatic optical inspection AOI equipment based on computer vision image processing technology, and reduce manual re-inspection. The detection workload is improved, and the detection efficiency and accuracy are improved.

所述圖像複檢方法包括:獲得待測圖像以及所述待測圖像的圖像資訊,所述待測圖像在至少一次的檢測中被識別為瑕疵圖像;利用人工智慧程式對所述待測圖像的圖像資訊進行解析,獲得所述待測圖像的參數;利用預先訓練得到的圖像複檢模型,基於所述待測圖像的參數對所述待測 圖像進行複檢,獲得待測圖像的複檢結果;當所述複檢結果指示所述待測圖像存在瑕疵時,上傳所述待測圖像至所述電腦裝置中預先建立的圖像複檢系統;透過所述圖像複檢系統將所述待測圖像分發至指定使用者,接收所述指定用戶對所述待測圖像的標記;及根據所述待測圖像的標記回饋對所述待測圖像的最終檢測結果。 The image re-inspection method includes: obtaining the image to be tested and the image information of the image to be tested, and the image to be tested is identified as a defective image in at least one detection; Analyzing the image information of the image to be tested to obtain the parameters of the image to be tested; Re-inspecting the image to obtain the re-inspection result of the image to be tested; when the re-inspection result indicates that the image to be tested has defects, uploading the image to be tested to the pre-established map in the computer device An image re-inspection system; distribute the image to be tested to designated users through the image re-inspection system, receive the designated user's mark on the image to be tested; and according to the image to be tested The marker returns the final detection result of the image to be tested.

可選地,所述待測圖像為印刷電路板PCB圖像,所述方法利用自動光學檢測AOI設備掃描PCB獲得所述待測圖像,並利用所述AOI設備將所述待測圖像保存在預設的路徑中。 Optionally, the image to be tested is a PCB image of a printed circuit board, the method scans the PCB with an automatic optical inspection (AOI) device to obtain the image to be tested, and uses the AOI device to scan the image to be tested Save in the preset path.

可選地,所述方法還包括獲得所述待測圖像中所述PCB的資訊。 Optionally, the method further includes obtaining information of the PCB in the image to be tested.

可選地,所述方法還包括:獲取預設數量的無瑕疵的PCB圖像;對所述預設數量的無瑕疵的PCB圖像進行影像處理;及利用處理後的所述無瑕疵的PCB圖像訓練神經網路,獲得所述圖像複檢模型。 Optionally, the method further includes: acquiring a preset number of flawless PCB images; performing image processing on the preset number of flawless PCB images; and using the processed flawless PCB The neural network is trained on images to obtain the image re-inspection model.

可選地,所述方法還包括:利用所述人工智慧程式將所述待測圖像的參數輸入所述圖像複檢模型。 Optionally, the method further includes: using the artificial intelligence program to input parameters of the image to be tested into the image re-examination model.

可選地,所述方法還包括:基於所述待測圖像的參數,利用所述圖像複檢模型獲得所述待測圖像。 Optionally, the method further includes: based on parameters of the image to be tested, using the image re-inspection model to obtain the image to be tested.

可選地,所述方法還包括:利用所述圖像複檢模型將所述待測圖像的參數和所述複檢結果輸入所述人工智慧程式;及利用所述人工智慧程式將所述待測圖像的參數和所述複檢結果保存在預先建立的資料庫中。 Optionally, the method further includes: using the image re-inspection model to input the parameters of the image to be tested and the re-inspection result into the artificial intelligence program; and using the artificial intelligence program to input the The parameters of the image to be tested and the retest results are stored in a pre-established database.

可選地,所述待測圖像的最終檢測結果包括:所述待測圖像為無瑕疵圖像,或者所述待測圖像為瑕疵圖像。 Optionally, the final detection result of the image to be tested includes: the image to be tested is a flawless image, or the image to be tested is a flawed image.

所述電腦可讀儲存介質儲存有至少一個指令,所述至少一個指令被處理器執行時實現所述圖像複檢方法。 The computer-readable storage medium stores at least one instruction, and when the at least one instruction is executed by a processor, the image review method is implemented.

所述電腦裝置包括儲存器和至少一個處理器,所述儲存器中儲存有至少一個指令,所述至少一個指令被所述至少一個處理器執行時實現所 述圖像複檢方法。 The computer device includes a memory and at least one processor, at least one instruction is stored in the memory, and the at least one instruction is executed by the at least one processor to realize the Describe the image re-examination method.

相較於習知技術,所述圖像複檢方法、電腦裝置及儲存介質,能夠基於電腦視覺影像處理技術對被AOI設備判斷為不良品的PCB進行複檢,降低人工複檢工作量,提高檢測效率和準確性。 Compared with the known technology, the image re-inspection method, computer device and storage medium can re-inspect PCBs judged as defective products by AOI equipment based on computer vision image processing technology, reduce the workload of manual re-inspection, and improve detection efficiency and accuracy.

3:電腦裝置 3: Computer device

32:處理器 32: Processor

31:儲存器 31: Storage

33:顯示器 33: Display

S1~S5:步驟 S1~S5: steps

為了更清楚地說明本申請實施例或習知技術中的技術方案,下面將對實施例或習知技術描述中所需要使用的附圖作簡單地介紹,顯而易見地,下面描述中的附圖僅僅是本申請的實施例,對於本領域普通技術人員來講,在不付出創造性勞動的前提下,還可以根據提供的附圖獲得其他的附圖。 In order to more clearly illustrate the technical solutions in the embodiments of the present application or in the prior art, the accompanying drawings that need to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present application, and those skilled in the art can also obtain other drawings according to the provided drawings without creative work.

圖1是本申請較佳實施例的圖像複檢方法的流程圖。 Fig. 1 is a flowchart of an image re-examination method in a preferred embodiment of the present application.

圖2是本申請較佳實施例的電腦裝置的架構圖。 FIG. 2 is a structural diagram of a computer device in a preferred embodiment of the present application.

為了能夠更清楚地理解本申請的上述目的、特徵和優點,下面結合附圖和具體實施例對本申請進行詳細描述。需要說明的是,在不衝突的情況下,本申請的實施例及實施例中的特徵可以相互組合。 In order to more clearly understand the above objects, features and advantages of the present application, the present application will be described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that, in the case of no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other.

在下面的描述中闡述了很多具體細節以便於充分理解本申請,所描述的實施例僅僅是本申請一部分實施例,而不是全部的實施例。基於本申請中的實施例,本領域普通技術人員在沒有做出創造性勞動前提下所獲得的所有其他實施例,都屬於本申請保護的範圍。 A lot of specific details are set forth in the following description to facilitate a full understanding of the application, and the described embodiments are only a part of the embodiments of the application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

除非另有定義,本文所使用的所有的技術和科學術語與屬於本申請的技術領域的技術人員通常理解的含義相同。本文中在本申請的說明書中所使用的術語只是為了描述具體的實施例的目的,不是旨在於限制本申請。 Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terms used herein in the specification of the application are only for the purpose of describing specific embodiments, and are not intended to limit the application.

參閱圖1所示,為本申請較佳實施例的圖像複檢方法的流程圖。 Referring to FIG. 1 , it is a flowchart of an image re-examination method in a preferred embodiment of the present application.

在本實施例中,所述圖像複檢方法可以應用於電腦裝置(例如圖2所示的電腦裝置3)中,對於需要進行圖像複檢的電腦裝置,可以直接在電腦裝置上集成本申請的方法所提供的用於圖像複檢的功能,或者以軟體開發套件(Software Development Kit,SDK)的形式運行在電腦裝置上。 In this embodiment, the image re-inspection method can be applied to a computer device (such as the computer device 3 shown in FIG. The image rechecking function provided by the application method may run on a computer device in the form of a software development kit (Software Development Kit, SDK).

如圖1所示,所述圖像複檢方法具體包括以下步驟,根據不同的需求,該流程圖中步驟的順序可以改變,某些步驟可以省略。 As shown in FIG. 1 , the image re-examination method specifically includes the following steps. According to different requirements, the order of the steps in the flow chart can be changed, and some steps can be omitted.

步驟S1、電腦裝置獲得待測圖像以及所述待測圖像的圖像資訊,所述待測圖像在至少一次的檢測中被識別為瑕疵圖像。 Step S1, the computer device obtains the image to be tested and the image information of the image to be tested, and the image to be tested is identified as a defective image in at least one inspection.

在一個實施例中,所述待測圖像為印刷電路板(Printed Circuit Board,PCB)圖像,所述方法利用自動光學檢測(Automated Optical Inspection,AOI)設備掃描PCB獲得所述待測圖像,並利用所述AOI設備將所述待測圖像保存在預設的路徑中。 In one embodiment, the image to be tested is a printed circuit board (Printed Circuit Board, PCB) image, and the method uses an automatic optical inspection (Automated Optical Inspection, AOI) device to scan the PCB to obtain the image to be tested , and use the AOI device to save the image to be tested in a preset path.

需要說明的是,所述AOI設備是一種可以基於光學原理對產品例如PCB進行掃描並對常見缺陷進行檢測的設備。 It should be noted that the AOI device is a device that can scan products such as PCBs based on optical principles and detect common defects.

在一個實施例中,所述PCB可以來自不同的生產線,所述生產線是指生產所述PCB所需的多台設備組成的流水線,所述多台設備依照PCB製造工序的先後順序安置,形成一條生產線。例如,所述多台設備可以包括上板機、焊膏印刷機、高速貼片機、高精度貼片機、回流爐等,上板機為製造PCB的第一道工序所需設備,其他設備依序安置在上板機之後,回流爐安置在生產線最後的位置。所述生產線可以用不同的編號加以區分,例如,可以用有序的兩位元數位將不同的生產線進行編號為01、02等。 In one embodiment, the PCBs can come from different production lines. The production line refers to an assembly line composed of multiple devices required to produce the PCB. The multiple devices are arranged according to the sequence of the PCB manufacturing process to form a production line. production line. For example, the plurality of devices may include a board loading machine, a solder paste printing machine, a high-speed placement machine, a high-precision placement machine, a reflow oven, etc. The board loading machine is the equipment required for the first process of manufacturing PCBs, and other equipment After the board loading machine is arranged in sequence, the reflow oven is arranged at the last position of the production line. The production lines can be distinguished by different numbers, for example, the different production lines can be numbered as 01, 02, etc. by using ordered two-digit numbers.

在一個實施例中,利用AOI設備對生產線生產的PCB進行掃描和檢測時,採取一對一的模式,一台AOI設備對應一條生產線。可以同時利用多台(例如,20台)AOI設備對多條(例如,20台)生產線生產的PCB進行掃描並檢測所述PCB的圖像,獲得所述PCB的圖像的檢測結果。例如, 可以用AOI+有序的三位元數位的格式將不同的AOI設備編號為AOI001,AOI002等,可以將AOI001安置在01號生產線的回流爐後方,利用AOI001對01號生產線生產的PCB進行掃描並進行檢測;同時將AOI002安置在02號生產線的回流爐後方,利用AOI002對02號生產線生產的PCB進行掃描並進行檢測。 In one embodiment, when the AOI equipment is used to scan and detect the PCB produced in the production line, a one-to-one mode is adopted, and one AOI equipment corresponds to one production line. Multiple (eg, 20) AOI devices can be used simultaneously to scan PCBs produced by multiple (eg, 20) production lines and detect images of the PCBs to obtain detection results of the PCB images. E.g, Different AOI equipment can be numbered as AOI001, AOI002, etc. in the format of AOI+ordered three-digit number, and AOI001 can be placed behind the reflow furnace of No. Inspection; at the same time, place AOI002 behind the reflow furnace of No. 02 production line, and use AOI002 to scan and inspect the PCB produced by No. 02 production line.

在一個實施例中,所述AOI設備對所述PCB的圖像進行檢測,獲得的檢測結果包括:所述PCB的圖像為瑕疵圖像,所述PCB的圖像為無瑕疵圖像。所述瑕疵圖像為被所述AOI設備判斷為含瑕疵的PCB的圖像,例如,AOI設備將含偏位元、缺件、少錫、多錫等缺陷元件的PCB的圖像判斷為瑕疵圖像。 In one embodiment, the AOI equipment detects the image of the PCB, and the obtained detection results include: the image of the PCB is a defect image, and the image of the PCB is a defect-free image. The flaw image is an image of a PCB that is judged to contain flaws by the AOI equipment, for example, the AOI equipment judges the image of a PCB containing defective components such as offset, missing parts, less tin, and more tin as flaws image.

在一個實施例中,所述待測圖像為被AOI設備檢測為瑕疵圖像的PCB的圖像,所述待測圖像為待複檢的圖像。 In one embodiment, the image to be tested is an image of a PCB detected as a defect image by the AOI equipment, and the image to be tested is an image to be re-inspected.

在一個實施例中,所述AOI設備只對所述待測圖像進行保存,並將所述待測圖像保存在預設的路徑中,例如,編號為AOI001的AOI設備可以將檢測得到的所述待測圖像保存在本地路徑中預先建立的資料夾Download001中。 In one embodiment, the AOI device only saves the image to be tested, and saves the image to be tested in a preset path, for example, the AOI device numbered AOI001 can save the detected image The image to be tested is saved in the pre-established folder Download001 in the local path.

在一個實施例中,電腦裝置獲得所述待測圖像中所述PCB的資訊。 In one embodiment, the computer device obtains the information of the PCB in the image to be tested.

在一個實施例中,所述PCB的資訊包括所述PCB的產品編號。具體地,可以用有序的四位元數位將不同的PCB編號為PCB0001,PCB0002等。 In one embodiment, the information of the PCB includes a product number of the PCB. Specifically, the different PCBs can be numbered as PCB0001, PCB0002, etc. with sequential four-digit numbers.

在一個實施例中,所述PCB的資訊還包括生產所述PCB的生產線的資訊,例如,編號為PCB0001的PCB對應的生產線為01號生產線。 In one embodiment, the information about the PCB further includes information about the production line that produces the PCB, for example, the production line corresponding to the PCB numbered PCB0001 is No. 01 production line.

在一個實施例中,所述PCB的資訊還包括生產所述PCB的時間,例如,編號為PCB0001的PCB的生產時間為09:30:05。需要說明的是,所述時間還可以包含年、月、日等資訊,在舉例時不對其進行贅述。 In one embodiment, the information of the PCB further includes the production time of the PCB, for example, the production time of the PCB numbered PCB0001 is 09:30:05. It should be noted that the time may also include information such as year, month, and day, which will not be described in detail in examples.

在一個實施例中,所述待測圖像的圖像資訊包括與所述待測圖像對應的AOI設備的機台資訊,例如,編號為AOI001的AOI設備將編號為PCB0001的PCB的圖像判斷為待測圖像,則與編號為PCB0001的PCB的待測圖像對應的AOI設備的機台資訊為AOI001。 In one embodiment, the image information of the image to be tested includes the machine information of the AOI equipment corresponding to the image to be tested, for example, the AOI equipment numbered AOI001 will be the image of the PCB numbered PCB0001 If it is judged as the image to be tested, then the machine information of the AOI equipment corresponding to the image to be tested of the PCB numbered PCB0001 is AOI001.

在一個實施例中,所述待測圖像的圖像資訊還包括所述待測圖像的名稱,例如,編號為AOI001的AOI設備將編號為PCB0001的PCB的圖像作為待測圖像進行保存時,可以將該待測圖像命名為PCB0001.jpg。需要說明的是,當以PCB的編號作為對應的PCB的待測圖像的名稱時,所述待測圖像的名稱可以不必在所述待測圖像的圖像資訊中進行保存,之後不再對其進行贅述。 In one embodiment, the image information of the image to be tested also includes the name of the image to be tested, for example, the AOI equipment numbered AOI001 uses the image of the PCB numbered PCB0001 as the image to be tested When saving, the image to be tested can be named PCB0001.jpg. It should be noted that when the number of the PCB is used as the name of the image to be tested of the corresponding PCB, the name of the image to be tested may not need to be stored in the image information of the image to be tested. Let's talk about it again.

在一個實施例中,所述待測圖像的圖像資訊還包括所述待測圖像的儲存路徑,例如,編號為AOI001的AOI設備將待測圖像PCB0001.jpg保存在資料夾Download001中。 In one embodiment, the image information of the image to be tested also includes the storage path of the image to be tested, for example, the AOI equipment numbered AOI001 saves the image to be tested PCB0001.jpg in the file folder Download001 .

在一個實施例中,所述AOI設備將所述待測圖像的相關資料保存在預設的路徑中,例如,編號為AOI001的AOI設備可以用可延伸標記語言(XML)對所述待測圖像的相關資料進行標記和定義,並將得到的“.xml”格式的文檔保存在本地路徑中,將其命名為File001.xml。在其他實施例中,還可以將所述待測圖像的相關資料用“.txt”格式的文檔進行保存。 In one embodiment, the AOI device saves the relevant data of the image to be tested in a preset path, for example, the AOI device numbered AOI001 can use Extensible Markup Language (XML) to save the image to be tested Mark and define the relevant information of the image, and save the obtained ".xml" format document in the local path, and name it File001.xml. In other embodiments, the related materials of the image to be tested may also be saved in a file in ".txt" format.

需要說明的是,以單獨一台AOI設備舉例,例如,對編號為AOI001的AOI設備來說,可以只生成一個資料夾Download001保存待測圖像,可以只生成一個文檔File001.xml(或File001.txt)保存待測圖像的相關資料。此時與所述待測圖像對應的AOI設備的機台資訊可以不必在所述待測圖像的圖像資訊中進行保存,之後不再對其進行贅述。 It should be noted that, taking a single AOI device as an example, for example, for the AOI device numbered AOI001, only one folder Download001 can be generated to save the image to be tested, and only one file File001.xml (or File001. txt) to save the relevant information of the image to be tested. At this time, the machine information of the AOI equipment corresponding to the image to be tested may not be stored in the image information of the image to be tested, and will not be described in detail later.

在一個實施例中,文檔File001.xml可以保存編號為AOI001的AOI設備得到的多張(例如,300張)待測圖像的相關資料,編號為AOI001 的AOI設備可以在文檔File001.xml中對待測圖像的相關資料中的各個資訊進行標記和定義,對每張待測圖像的相關資料進行對應保存。例如,編號為AOI001的AOI設備可以按照獲得每張待測圖像的時間順序,將每張待測圖像的相關資料依序(例如,從左到右或從上至下)保存在文檔File001.xml中的一列或一行中。需要說明的是,每張待測圖像的所述相關資料中的各個資訊被保存在一行或一列中時,可以是無序的。 In one embodiment, the document File001.xml can save the relevant information of multiple (for example, 300) images to be tested obtained by the AOI equipment numbered AOI001, and the number is AOI001 The AOI equipment can mark and define each information in the relevant data of the image to be tested in the file File001.xml, and save the relevant data of each image to be tested correspondingly. For example, the AOI equipment numbered AOI001 can save the relevant information of each image to be tested in sequence (for example, from left to right or from top to bottom) in the file File001 according to the time sequence in which each image to be tested is obtained. .xml in a column or row. It should be noted that when each information in the relevant data of each image to be tested is stored in a row or a column, it may be out of order.

步驟S2、電腦裝置利用人工智慧程式對所述待測圖像的相關資料進行解析,獲得所述待測圖像的參數。 Step S2, the computer device uses an artificial intelligence program to analyze the relevant data of the image to be tested to obtain parameters of the image to be tested.

在一個實施例中,電腦裝置可以利用人工智慧(Artificial Intelligence,AI)程式獲取所述待測圖像的相關資料,對所述待測圖像的相關資料進行解析,獲得所述待測圖像的參數。例如,利用AI程式獲取文檔File001.xml,所述文件File001.xml保存著利用編號為AOI001的AOI設備得到的待測圖像的相關資料。利用AI程式將文檔File001.xml中的XML格式的相關資料解析為資料庫(例如SQL Server)參數,將所述資料庫參數導入資料庫進行保存。需要說明的是,所述AI程式可以同時獲取多個文檔並同時對該多個文檔進行解析,當AI程式獲得的文檔為“.txt”格式的File001.txt時,可以將File001.txt轉換成其他格式(例如“.xml”格式)的文檔,再對轉換後的文檔中的資料進行解析。 In one embodiment, the computer device can use an artificial intelligence (AI) program to obtain relevant data of the image to be tested, analyze the relevant data of the image to be tested, and obtain the image to be tested parameters. For example, the AI program is used to obtain the file File001.xml, and the file File001.xml stores the relevant data of the image to be tested obtained by using the AOI device numbered AOI001. Use the AI program to parse the relevant data in the XML format in the file File001.xml into database (such as SQL Server) parameters, and import the database parameters into the database for storage. It should be noted that the AI program can obtain multiple documents and analyze the multiple documents at the same time. When the document obtained by the AI program is File001.txt in ".txt" format, File001.txt can be converted into Documents in other formats (such as ".xml" format), and then analyze the data in the converted documents.

在一個實施例中,所述待測圖像的參數即所述待測圖像的圖像資訊和所述PCB的資訊,例如,編號為PCB0001的PCB的圖像為待測圖像,其參數為:Download001(PCB的圖像的儲存路徑),01(PCB的生產線),PCB0001(PCB的編號),09:30:05(PCB的生產時間)。需要說明的是,所述待測圖像的參數的格式為資料庫參數。 In one embodiment, the parameters of the image to be tested are the image information of the image to be tested and the information of the PCB, for example, the image of the PCB numbered PCB0001 is the image to be tested, and its parameters It is: Download001 (storage path of PCB image), 01 (production line of PCB), PCB0001 (number of PCB), 09:30:05 (production time of PCB). It should be noted that the format of the parameters of the image to be tested is a database parameter.

在一個實施例中,電腦裝置利用AI程式將所述待測圖像的參數導入資料庫後,資料庫會對所述待測圖像的參數進行識別並解析,以及依照預設的規則將解析後的所述待測圖像的參數進行排序。例如,所述預設 的規則可以是:參數一為PCB的生產時間,參數二為PCB的生產線,參數三為待測圖像的儲存路徑,參數四為PCB的編號。舉例來說,編號為PCB0001的PCB的圖像為待測圖像,SQL Server可以將此待測圖像的參數對應排序為:09:30:05,01,Download001,PCB0001。 In one embodiment, after the computer device uses the AI program to import the parameters of the image to be tested into the database, the database will identify and analyze the parameters of the image to be tested, and analyze the parameters according to preset rules. After the parameters of the image to be tested are sorted. For example, the default The rule of can be: the first parameter is the production time of the PCB, the second parameter is the production line of the PCB, the third parameter is the storage path of the image to be tested, and the fourth parameter is the serial number of the PCB. For example, the image of the PCB numbered PCB0001 is the image to be tested, and the SQL Server can sort the parameters of the image to be tested as follows: 09:30:05,01,Download001,PCB0001.

在一個實施例中,電腦裝置利用所述AI程式將所述參數輸入所述圖像複檢模型。例如,AI程式調用應用程式設計發展介面(Application Programming Interface,API),將所述待測圖像的參數傳入所述圖像複檢模型。需要說明的是,所述圖像複檢模型接收到所述AI程式透過調用API傳入的待測圖像的參數時,同時接收到執行圖像複檢的指令,進行圖像複檢。 In one embodiment, the computer device uses the AI program to input the parameters into the image review model. For example, the AI program invokes an application programming interface (Application Programming Interface, API) to pass parameters of the image to be tested into the image re-inspection model. It should be noted that when the image re-inspection model receives the parameters of the image to be tested imported by the AI program by calling the API, it also receives an instruction to perform image re-inspection to perform image re-inspection.

步驟S3、電腦裝置利用預先訓練得到的圖像複檢模型基於所述待測圖像的參數對所述待測圖像進行複檢,獲得待測圖像的複檢結果。 Step S3 , the computer device uses the pre-trained image re-inspection model to re-inspect the image-to-be-tested based on the parameters of the image-to-be-tested, and obtain the re-inspection result of the image-to-be-tested image.

在一個實施例中,所述預先訓練得到的圖像複檢模型是指:電腦裝置獲取預設數量的無瑕疵的PCB圖像;對所述預設數量的無瑕疵的PCB圖像進行影像處理;及利用處理後的所述無瑕疵的PCB圖像訓練神經網路,獲得所述圖像複檢模型。 In one embodiment, the pre-trained image re-inspection model refers to: a computer device acquires a preset number of flawless PCB images; image processing is performed on the preset number of flawless PCB images and using the processed image of the flawless PCB to train a neural network to obtain the image re-inspection model.

在一個實施例中,所述預設數量的無瑕疵的PCB圖像可以是少量(例如,200張)無瑕疵的PCB圖像。需要說明的是,由於實際生產過程中PCB的含瑕疵率較低,能夠輕易獲得大量無瑕疵的PCB圖像,可以由工作人員利用步驟S4中的所述預先建立的圖像複檢系統獲得所述預設數量的無瑕疵的PCB圖像。 In one embodiment, the preset number of defect-free PCB images may be a small number (for example, 200) of defect-free PCB images. It should be noted that, due to the low defect rate of the PCB in the actual production process, a large number of defect-free PCB images can be easily obtained, and the staff can use the pre-established image re-inspection system in step S4 to obtain all the images. The preset number of flawless PCB images.

在一個實施例中,所述對所述預設數量的無瑕疵的PCB圖像進行影像處理包括:對所述無瑕疵的PCB圖像的圖元進行分析,計算所述圖像的RGB(紅(R)、綠(G)、藍(B))與灰度,將所述圖像中圖元相近的區域劃分同一區域,將圖像分隔成不同的區域,定位PCB的各元件在所述圖像中的位置,框選出所述各元件所在的區域,利用模糊演算法對所 述各區域的圖像進行降噪,將不重要的區域剔除。需要說明的是,對所述預設數量的無瑕疵的PCB圖像進行影像處理所用的方法,均為影像處理領域的常用方法,具體過程在此不再進行贅述。 In one embodiment, the image processing of the preset number of flawless PCB images includes: analyzing the graphics elements of the flawless PCB images, and calculating the RGB (red color) of the images. (R), green (G), blue (B)) and grayscale, divide the similar regions of the graphic elements in the image into the same region, separate the image into different regions, and locate the components of the PCB in the described position in the image, select the area where each component is located, and use the fuzzy algorithm to Noise reduction is performed on the image of each region mentioned above, and unimportant regions are eliminated. It should be noted that the methods used for image processing of the preset number of flawless PCB images are common methods in the field of image processing, and the specific process will not be repeated here.

在一個實施例中,所述神經網路可以是卷積神經網路(Convolutional Neural Networks,CNN),電腦裝置可以利用所述預設數量的無瑕疵的PCB圖像訓練CNN生成所述圖像複檢模型。在一個實施例中,可以將所述圖像複檢模型進行複製,安裝在與每條生產線對應的AOI設備中,檢測對應的AOI設備獲得的待檢測圖像。在一個實施例中,安裝在不同AOI設備中的不同圖像複檢模型之間沒有任何差異,可以被複製安裝在不同種類的AOI設備之中運行。 In one embodiment, the neural network may be a convolutional neural network (Convolutional Neural Networks, CNN), and the computer device may use the preset number of flawless PCB images to train the CNN to generate the image complex. check model. In one embodiment, the image re-inspection model can be copied, installed in the AOI equipment corresponding to each production line, and detect the image to be inspected obtained by the corresponding AOI equipment. In one embodiment, there is no difference between different image re-inspection models installed in different AOI devices, and can be replicated and installed in different types of AOI devices to run.

在一個實施例中,電腦裝置基於所述待測圖像的參數,利用所述圖像複檢模型獲得所述待測圖像。 In one embodiment, the computer device uses the image re-examination model to obtain the image to be tested based on the parameters of the image to be tested.

在一個實施例中,所述圖像複檢模型可以基於參數三例如Download001確定所述待測圖像的儲存路徑例如為資料夾Download001,基於參數四例如PCB0001確定所述待測圖像的圖像名稱為例如PCB0001.jpg,將儲存路徑如資料夾Download001中的圖像例如PCB0001.jpg複製到本地路徑,獲得所述待測圖像。 In one embodiment, the image re-examination model can determine the storage path of the image to be tested based on parameter three such as Download001, such as the folder Download001, and determine the storage path of the image to be tested based on parameter four such as PCB0001 The name of the image is, for example, PCB0001.jpg, and the image in the storage path, such as the folder Download001, such as PCB0001.jpg is copied to the local path to obtain the image to be tested.

在一個實施例中,所述圖像複檢模型實質上是一個圖像瑕疵檢測模型,利用所述圖像複檢模型對所述待測圖像進行複檢,即是對所述待測圖像進行瑕疵檢測。所述圖像複檢模型可以確定所述待測圖像中PCB板中各元件的所在區域,與PCB的無瑕疵圖像的對應區域進行比對,按照預設的規則(例如,圖元均方誤差是否達到預設的閾值)獲得所述待測圖像的複檢結果。 In one embodiment, the image re-inspection model is essentially an image defect detection model, and using the image re-inspection model to re-inspect the image to be tested is to re-inspect the image to be tested like flaw detection. The image re-inspection model can determine the location of each component in the PCB board in the image to be tested, and compare it with the corresponding area of the flawless image of the PCB, according to preset rules (for example, the graphics elements are all square error reaches a preset threshold) to obtain the re-inspection result of the image to be tested.

在一個實施例中,所述待測圖像的複檢結果包括:所述待測圖像為存在瑕疵的圖像,所述待測圖像為不存在瑕疵的圖像。需要說明的是,由於AOI設備的缺陷性,所述待測圖像中僅有少部分(例如佔比4%)的圖 像為實際上存在瑕疵的圖像。利用圖像複檢模型對所述待測圖像進行複檢,可以將實際上存在瑕疵的圖像從所述待測圖像中檢出。 In one embodiment, the re-inspection results of the image to be tested include: the image to be tested is an image with blemishes, and the image to be tested is an image without blemishes. It should be noted that due to the defect of AOI equipment, only a small part (for example, accounting for 4%) of the image to be tested Like an image that actually has blemishes. By using the image re-inspection model to re-inspect the image to be tested, images that actually have defects can be detected from the image to be tested.

在一個實施例中,電腦裝置可以利用所述圖像複檢模型將所述待測圖像的參數和所述複檢結果輸入所述AI程式;以及利用所述AI程式將所述待測圖像的參數和所述複檢結果保存在預先建立的資料庫(例如SQL Server)中。 In one embodiment, the computer device can use the image re-inspection model to input the parameters of the image to be tested and the re-inspection result into the AI program; and use the AI program to input the image to be tested The image parameters and the re-examination results are stored in a pre-established database (such as SQL Server).

步驟S4、當所述複檢結果指示所述待測圖像存在瑕疵時,電腦裝置上傳所述待測圖像至所述電腦裝置中預先建立的圖像複檢系統。 Step S4. When the re-inspection result indicates that the image to be tested has defects, the computer device uploads the image to be tested to a pre-established image re-inspection system in the computer device.

在一個實施例中,所述圖像複檢系統可以基於所述瑕疵圖像的參數獲取所述待測圖像。 In one embodiment, the image re-inspection system can acquire the image to be tested based on the parameters of the defective image.

在一個實施例中,所述圖像複檢系統可以從所述資料庫中獲取所述複檢結果為存在瑕疵的待測圖像的參數,將所述待測圖像顯示在所述圖像複檢系統的介面中。例如,圖像複檢系統識別到資料庫中編號為PCB0001的PCB的圖像的複檢結果為存在瑕疵後,可以基於編號為PCB0001的PCB的圖像的參數三Download001確定所述待測圖像的儲存路徑為資料夾Download001,基於編號為PCB0001的PCB的圖像的參數四PCB0001確定所述待測圖像的圖像名稱為PCB0001.jpg,將資料夾Download001中的圖像PCB0001.jpg顯示在系統的介面中。例如,所述介面可以按頁顯示所述複檢結果為存在瑕疵的待測圖像,所述介面可以每頁顯示5張所述待測圖像,共20頁,第20頁可以顯示少於5張的所述待測圖像。 In one embodiment, the image re-inspection system can obtain the parameters of the image to be tested that the reinspection result is a defect from the database, and display the image to be tested on the image In the interface of the review system. For example, after the image re-inspection system recognizes that the re-inspection result of the PCB image numbered PCB0001 in the database is flawed, the image to be tested can be determined based on the parameter three Download001 of the PCB image numbered PCB0001 The storage path of the image is the folder Download001. Based on the parameter four PCB0001 of the PCB image numbered PCB0001, the image name of the image to be tested is determined as PCB0001.jpg, and the image PCB0001.jpg in the folder Download001 is determined. displayed in the system interface. For example, the interface can display the re-inspection results as flawed images to be tested page by page, the interface can display 5 images to be tested per page, a total of 20 pages, and the 20th page can display less than 5 images to be tested.

步驟S5、電腦裝置透過所述圖像複檢系統將所述待測圖像分發至指定使用者,接收所述指定用戶對所述待測圖像的標記,根據所述待測圖像的標記回饋對所述待測圖像的最終檢測結果。 Step S5, the computer device distributes the image to be tested to designated users through the image re-examination system, receives the designated user's mark on the image to be tested, and according to the mark of the image to be tested Feedback the final detection result of the image to be tested.

在一個實施例中,所述圖像複檢系統可以將所述複檢結果為存在瑕疵的待測圖像分發給不同的指定用戶,由所述指定用戶對所述待測圖像進行標記,所述使用者為有許可權登錄所述圖像複檢系統進行操作的工作 人員。例如,所述圖像複檢系統可以根據所述待測圖像的類型,將待測圖像分發至與所述待測圖像類型相對應的使用者;也可以是隨機分發;也可以是根據使用者當前待處理的圖像數量(例如,未進行標記的待測圖像的數量)進行分發,直至將所有待測圖像分發完畢。 In one embodiment, the image re-inspection system can distribute the image to be tested that has defects in the re-inspection result to different designated users, and the designated user will mark the image to be tested, The user has permission to log in to the image re-inspection system to operate the work personnel. For example, the image re-inspection system can distribute the image to be tested to users corresponding to the type of the image to be tested according to the type of the image to be tested; it can also be randomly distributed; it can also be Distribution is performed according to the number of images currently to be processed by the user (for example, the number of unmarked images to be tested), until all the images to be tested are distributed.

在一個實施例中,所述待測圖像的最終檢測結果包括:所述待測圖像為無瑕疵圖像,或者所述待測圖像為瑕疵圖像。 In one embodiment, the final detection result of the image to be tested includes: the image to be tested is a flawless image, or the image to be tested is a flawed image.

在一個實施例中,所述指定使用者透過不同的按鈕或圖示對所述待測圖像進行標記,確定所述待測圖像的所述最終檢測結果。例如,工作人員可以登入所述圖像複檢系統,在所述圖像複檢系統的介面上對所述待測圖像進行標記,每張待測圖像下方可以有兩個可供選擇的按鈕:“pass”和“ng”,用“pass”按鈕標記無瑕疵圖像,用“ng”按鈕標記瑕疵圖像。當工作人員確定這張待測圖像為無瑕疵圖像時,可以點擊“pass”按鈕將其標記,或者當工作人員確定這張待測圖像為瑕疵的圖像時,可以點擊“ng”按鈕將其標記。需要說明的是,步驟S2中獲取的所述預設數量的無瑕疵的PCB圖像,即是利用此處所述方法獲得的被工作人員用“pass”按鈕標記的圖像。 In one embodiment, the specified user marks the image to be tested through different buttons or icons to determine the final detection result of the image to be tested. For example, the staff can log in to the image re-inspection system, and mark the images to be tested on the interface of the image re-inspection system, and there can be two options under each image to be tested. Buttons: "pass" and "ng", use the "pass" button to mark flawless images, and the "ng" button to mark flawed images. When the staff determines that the image to be tested is a flawless image, they can click the "pass" button to mark it, or when the staff determines that the image to be tested is a flawed image, they can click "ng" button to mark it. It should be noted that the preset number of flawless PCB images acquired in step S2 are the images obtained by using the method described here and marked with the "pass" button by the staff.

在一個實施例中,電腦裝置可以利用所述圖像複檢系統將被標記為“pass”和“ng”的圖像進行分別保存。 In one embodiment, the computer device can use the image review system to save the images marked as "pass" and "ng" respectively.

在其他的實施例中,在所有所述複檢結果為存在瑕疵的待測圖像被工作人員標記後,電腦裝置將被標記為“ng”的所述待測圖像顯示在所述圖像複檢系統的介面中,並在所述待測圖像的下方顯示所述待測圖像的參數。例如,當編號為PCB0001的PCB的圖像被工作人員標記為“ng”後,可以將PCB0001.jpg顯示在介面中,並在PCB0001.jpg下方顯示09:30:05,01,Download001,PCB0001,便於工作人員對生產PCB0001的01號生產線中的設備進行檢查和調整。 In other embodiments, after all the re-inspection results of the images to be tested with defects are marked by the staff, the computer device will display the images to be tested marked as "ng" on the image In the interface of the re-examination system, the parameters of the image to be tested are displayed below the image to be tested. For example, when the image of PCB numbered PCB0001 is marked as "ng" by the staff, PCB0001.jpg can be displayed in the interface, and 09:30:05,01, Download001, PCB0001, It is convenient for the staff to check and adjust the equipment in the No. 01 production line that produces PCB0001.

上述圖1詳細介紹了本申請的圖像複檢方法,下面結合圖2,對 實現所述圖像複檢方法的硬體裝置架構進行介紹。 The above-mentioned Fig. 1 has introduced the image re-inspection method of the present application in detail, below in conjunction with Fig. 2, for The hardware device architecture for implementing the image re-examination method is introduced.

應該瞭解,所述實施例僅為說明之用,在專利申請範圍上並不受此結構的限制。 It should be understood that the embodiments are only for illustration, and are not limited by the structure in terms of the scope of the patent application.

參閱圖2所示,為本申請較佳實施例提供的電腦裝置的結構示意圖。在本申請較佳實施例中,所述電腦裝置3包括儲存器31、至少一個處理器32、顯示器33。本領域技術人員應該瞭解,圖2示出的電腦裝置的結構並不構成本申請實施例的限定,既可以是匯流排型結構,也可以是星形結構,所述電腦裝置3還可以包括比圖示更多或更少的其他硬體或者軟體,或者不同的部件佈置。 Referring to FIG. 2 , it is a schematic structural diagram of a computer device provided by a preferred embodiment of the present application. In a preferred embodiment of the present application, the computer device 3 includes a storage 31 , at least one processor 32 , and a display 33 . Those skilled in the art should understand that the structure of the computer device shown in Figure 2 does not constitute a limitation of the embodiment of the present application, it can be a bus-type structure or a star structure, and the computer device 3 can also include a ratio More or less other hardware or software, or different arrangements of components are illustrated.

在一些實施例中,所述電腦裝置3包括一種能夠按照事先設定或儲存的指令,自動進行數值計算和/或資訊處理的終端,其硬體包括但不限於微處理器、專用積體電路、可程式設計閘陣列、數文書處理器及嵌入式設備等。 In some embodiments, the computer device 3 includes a terminal capable of automatically performing numerical calculations and/or information processing according to preset or stored instructions, and its hardware includes but not limited to microprocessors, dedicated integrated circuits, Programmable gate arrays, digital word processors and embedded devices, etc.

需要說明的是,所述電腦裝置3僅為舉例,其他現有的或今後可能出現的電子產品如可適應於本申請,也應包含在本申請的保護範圍以內,並以引用方式包含於此。 It should be noted that the computer device 3 is only an example, and other existing or future electronic products that can be adapted to this application should also be included in the scope of protection of this application and included here by reference.

在一些實施例中,所述儲存器31用於儲存程式碼和各種資料,並在電腦裝置3的運行過程中實現高速、自動地完成程式或資料的存取。所述儲存器31包括唯讀儲存器(Read-Only Memory,ROM)、可程式設計唯讀儲存器(Programmable Read-Only Memory,PROM)、可抹除可程式設計唯讀儲存器(Erasable Programmable Read-Only Memory,EPROM)、一次可程式設計唯讀儲存器(One-time Programmable Read-Only Memory,OTPROM)、電子抹除式可複寫唯讀儲存器(Electrically-Erasable Programmable Read-Only Memory,EEPROM)、唯讀光碟(Compact Disc Read-Only Memory,CD-ROM)或其他光碟儲存器、磁碟儲存器、磁帶儲存器、或者任何其他能夠用於攜帶或儲存資料的電腦可讀的儲存介質。 In some embodiments, the storage 31 is used to store program codes and various data, and realize high-speed and automatic access to programs or data during the operation of the computer device 3 . The memory 31 includes a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable Read-Only Memory, PROM), an erasable programmable read-only memory (Erasable Programmable Read -Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically-Erasable Programmable Read-Only Memory (EEPROM) , CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical disk storage, disk storage, tape storage, or any other computer-readable storage medium that can be used to carry or store data.

在一些實施例中,所述至少一個處理器32可以由積體電路組成,例如可以由單個封裝的積體電路所組成,也可以是由多個相同功能或不同功能封裝的積體電路所組成,包括一個或者多個中央處理器(Central Processing unit,CPU)、微處理器、數位訊號處理晶片、圖形處理器及各種控制晶片的組合等。所述至少一個處理器32是所述電腦裝置3的控制核心(Control Unit),利用各種介面和線路連接整個電腦裝置3的各個部件,透過運行或執行儲存在所述儲存器31內的程式碼或者模組,以及調用儲存在所述儲存器31內的資料,以執行電腦裝置3的各種功能和處理資料,例如執行圖像複檢的功能。 In some embodiments, the at least one processor 32 may be composed of an integrated circuit, for example, may be composed of a single packaged integrated circuit, or may be composed of multiple integrated circuits with the same function or different functions. , including one or more central processing units (Central Processing unit, CPU), microprocessors, digital signal processing chips, graphics processors and combinations of various control chips. The at least one processor 32 is the control core (Control Unit) of the computer device 3, and uses various interfaces and lines to connect the various components of the entire computer device 3, by running or executing the program code stored in the memory 31 Or modules, and call the data stored in the storage 31 to execute various functions of the computer device 3 and process data, such as the function of performing image review.

在一些實施例中,結合圖1,所述電腦裝置3中的所述儲存器31儲存電腦可讀指令實現一種圖像複檢方法,所述處理器32可執行所述電腦可讀指令從而實現所述圖像複檢方法。 In some embodiments, with reference to FIG. 1 , the storage 31 in the computer device 3 stores computer-readable instructions to implement an image review method, and the processor 32 can execute the computer-readable instructions to implement The image recheck method.

在一些實施例中,所述顯示器33可以為能進行觸屏操作的能呈現圖像的顯示裝置,例如,顯示器33可以用於顯示所述圖像複檢系統的介面。 In some embodiments, the display 33 may be a display device capable of displaying images capable of touch screen operations, for example, the display 33 may be used to display the interface of the image review system.

儘管未示出,所述電腦裝置3還可以包括給各個部件供電的電源(比如電池),優選的,電源可以透過電源管理裝置與所述至少一個處理器32邏輯相連,從而透過電源管理裝置實現管理充電、放電、以及功耗管理等功能。電源還可以包括一個或一個以上的直流或交流電源、再充電裝置、電源故障檢測電路、電源轉換器或者逆變器、電源狀態指示器等任意元件。所述電腦裝置3還可以包括多種感測器、藍牙模組、Wi-Fi模組等,在此不再贅述。 Although not shown, the computer device 3 may also include a power supply (such as a battery) for supplying power to each component. Preferably, the power supply may be logically connected to the at least one processor 32 through a power management device, thereby realizing Manage functions such as charging, discharging, and power management. The power supply may also include one or more DC or AC power sources, recharging devices, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components. The computer device 3 may also include various sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.

應該瞭解,所述實施例僅為說明之用,在專利申請範圍上並不受此結構的限制。在本申請所提供的幾個實施例中,應該理解到,所揭露的裝置和方法,可以透過其它的方式實現。例如,以上所描述的裝置實施例僅僅是示意性的,例如,所述模組的劃分,僅僅為一種邏輯功能劃分,實 際實現時可以有另外的劃分方式。 It should be understood that the embodiments are only for illustration, and are not limited by the structure in terms of the scope of the patent application. In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative, for example, the division of the modules is only a logical function division, and the implementation In actual implementation, there may be another division method.

所述作為分離部件說明的模組可以是或者也可以不是物理上分開的,作為模組顯示的部件可以是或者也可以不是物理單元,即可以位於一個地方,或者也可以分佈到多個網路單元上。可以根據實際的需要選擇其中的部分或者全部模組來實現本實施例方案的目的。 The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical units, that is, they may be located in one place, or may also be distributed to multiple networks on the unit. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

另外,在本申請各個實施例中的各功能模組可以集成在一個處理單元中,也可以是各個單元單獨物理存在,也可以兩個或兩個以上單元集成在一個單元中。上述集成的單元既可以採用硬體的形式實現,也可以採用硬體加軟體功能模組的形式實現。 In addition, each functional module in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented not only in the form of hardware, but also in the form of hardware plus software function modules.

對於本領域技術人員而言,顯然本申請不限於上述示範性實施例的細節,而且在不背離本申請的精神或基本特徵的情況下,能夠以其他的具體形式實現本申請。因此,無論從哪一點來看,均應將實施例看作是示範性的,而且是非限制性的,本申請的範圍由所附請求項而不是上述說明限定,因此旨在將落在請求項的等同要件的含義和範圍內的所有變化涵括在本申請內。不應將請求項中的任何附圖標記視為限制所涉及的請求項。此外,顯然“包括”一詞不排除其他單元或,單數不排除複數。裝置請求項中陳述的多個單元或裝置也可以由一個單元或裝置透過軟體或者硬體來實現。第一,第二等詞語用來表示名稱,而並不表示任何特定的順序。 It will be apparent to those skilled in the art that the present application is not limited to the details of the exemplary embodiments described above, but that the present application can be implemented in other specific forms without departing from the spirit or essential characteristics of the present application. Therefore, no matter from any point of view, the embodiments should be regarded as exemplary and non-restrictive, and the scope of the application is defined by the appended claims rather than the above description, so it is intended to All changes within the meaning and range of equivalents of the elements are embraced in this application. Any reference sign in a claim should not be construed as limiting the claim to which it relates. Furthermore, it is clear that the word "comprising" does not exclude other elements or the singular does not exclude the plural. A plurality of units or devices stated in the device claim may also be implemented by one unit or device through software or hardware. The words first, second, etc. are used to denote names and do not imply any particular order.

最後所應說明的是,以上實施例僅用以說明本申請的技術方案而非限制,儘管參照以上較佳實施例對本申請進行了詳細說明,本領域的普通技術人員應當理解,可以對本申請的技術方案進行修改或等同替換,而不脫離本申請技術方案的精神和範圍。 Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application without limitation. Although the present application has been described in detail with reference to the above preferred embodiments, those of ordinary skill in the art should understand that the present application can be The technical solution shall be modified or equivalently replaced without departing from the spirit and scope of the technical solution of the present application.

S1~S5:步驟 S1~S5: steps

Claims (10)

一種圖像複檢方法,應用於電腦裝置,其中,所述方法包括:獲得待測圖像以及所述待測圖像的圖像資訊,所述待測圖像在至少一次的檢測中被識別為瑕疵圖像,所述待測圖像的圖像資訊還包括所述待測圖像的儲存路徑與圖像名稱;將所述待測圖像的圖像資訊保存在預設的路徑中,包括:用可延伸標記語言XML對所述待測圖像的圖像資訊進行標記和定義,並將得到的xml格式的文檔保存在本地路徑中,所述xml格式的文檔用於保存所述待測圖像的圖像資訊;利用人工智慧程式對所述待測圖像的圖像資訊進行解析,獲得所述待測圖像的參數,包括:利用所述人工智慧程式程式獲取所述xml格式的文檔,將所述xml格式的文檔中的XML格式的圖像資訊解析為資料庫參數,將所述資料庫參數導入資料庫進行保存;利用所述人工智慧程式調用應用程式設計發展介面API,將所述參數輸入預先訓練得到的圖像複檢模型,利用所述圖像複檢模型,基於所述待測圖像的參數對所述待測圖像進行複檢,獲得待測圖像的複檢結果,包括:利用所述圖像複檢模型根據所述待測圖像的所述儲存路徑與所述圖像名稱獲得所述待測圖像;當所述複檢結果指示所述待測圖像存在瑕疵時,上傳所述待測圖像至所述電腦裝置中預先建立的圖像複檢系統;透過所述圖像複檢系統將所述待測圖像分發至指定使用者,接收所述指定用戶對所述待測圖像的標記,根據所述待測圖像的標記回饋對所述待測圖像的最終檢測結果。 An image re-inspection method applied to a computer device, wherein the method includes: obtaining an image to be tested and image information of the image to be tested, and the image to be tested is identified in at least one detection is a defective image, the image information of the image to be tested also includes a storage path and an image name of the image to be tested; the image information of the image to be tested is saved in a preset path, Including: using Extensible Markup Language XML to mark and define the image information of the image to be tested, and saving the obtained document in xml format in a local path, and the document in xml format is used to save the image to be tested The image information of the image to be tested; using the artificial intelligence program to analyze the image information of the image to be tested to obtain the parameters of the image to be tested, including: using the artificial intelligence program to obtain the xml format document, analyzing the image information in the XML format in the document in the xml format into database parameters, and importing the database parameters into the database for preservation; using the artificial intelligence program to call an application programming development interface API, Input the parameters into the pre-trained image re-inspection model, use the image re-inspection model to re-inspect the image to be tested based on the parameters of the image to be tested, and obtain the image to be tested The re-inspection result includes: using the image re-inspection model to obtain the image to be tested according to the storage path and the image name of the image to be tested; when the reinspection result indicates that the image to be tested When there is a defect in the image to be tested, upload the image to be tested to the pre-established image re-inspection system in the computer device; distribute the image to be tested to designated users through the image re-inspection system, receiving the designated user's mark on the image to be tested, and feeding back a final detection result on the image to be tested according to the mark on the image to be tested. 如請求項1所述的圖像複檢方法,其中,所述待測圖像為印刷電路板PCB圖像,所述方法利用自動光學檢測AOI設備掃描PCB獲得所述待測圖像,並利用所述AOI設備將所述待測圖像保存在預設的路徑中。 The image re-inspection method according to claim 1, wherein the image to be tested is a printed circuit board PCB image, and the method uses automatic optical inspection AOI equipment to scan the PCB to obtain the image to be tested, and uses The AOI equipment saves the image to be tested in a preset path. 如請求項2所述的圖像複檢方法,其中,所述方法還包括獲得 所述待測圖像中所述PCB的資訊。 The image re-examination method as described in claim 2, wherein the method also includes obtaining Information about the PCB in the image to be tested. 如請求項1所述的圖像複檢方法,其中,所述方法還包括:獲取預設數量的無瑕疵的PCB圖像;對所述預設數量的無瑕疵的PCB圖像進行影像處理,包括:對所述無瑕疵的PCB圖像的圖元進行分析,計算所述圖像的RGB紅綠藍與灰度,將所述圖像中圖元相近的區域劃分同一區域,將圖像分隔成不同的區域,定位PCB的各元件在所述圖像中的位置,框選出所述各元件所在的區域,利用模糊演算法對所述各區域的圖像進行降噪;及利用處理後的所述無瑕疵的PCB圖像訓練神經網路,獲得所述圖像複檢模型。 The image re-inspection method according to claim 1, wherein the method further includes: acquiring a preset number of flawless PCB images; performing image processing on the preset number of flawless PCB images, Including: analyzing the graphic elements of the flawless PCB image, calculating the RGB red, green, blue and gray scale of the image, dividing the areas with similar graphic elements in the image into the same area, and separating the images into different areas, locate the position of each component of the PCB in the image, frame the area where each component is located, and use a fuzzy algorithm to denoise the image of each area; and use the processed The flawless PCB image trains a neural network to obtain the image re-inspection model. 如請求項1所述的圖像複檢方法,其中,所述方法還包括:利用所述人工智慧程式將所述待測圖像的參數輸入所述圖像複檢模型。 The image re-inspection method according to claim 1, wherein the method further includes: using the artificial intelligence program to input parameters of the image to be tested into the image re-inspection model. 如請求項1所述的圖像複檢方法,其中,所述方法還包括:基於所述待測圖像的參數,利用所述圖像複檢模型獲得所述待測圖像。 The image re-inspection method according to claim 1, wherein the method further includes: based on the parameters of the image-to-be-tested, using the image re-inspection model to obtain the image-to-be-tested. 如請求項1所述的圖像複檢方法,其中,所述方法還包括:利用所述圖像複檢模型將所述待測圖像的參數和所述複檢結果輸入所述人工智慧程式;及利用所述人工智慧程式將所述待測圖像的參數和所述複檢結果保存在預先建立的資料庫中。 The image re-inspection method according to claim 1, wherein the method further includes: using the image re-inspection model to input the parameters of the image to be tested and the re-inspection results into the artificial intelligence program ; and using the artificial intelligence program to save the parameters of the image to be tested and the re-examination results in a pre-established database. 如請求項1所述的圖像複檢方法,其中,所述待測圖像的最終檢測結果包括:所述待測圖像為無瑕疵圖像,或者所述待測圖像為瑕疵圖像。 The image re-inspection method according to claim 1, wherein the final detection result of the image to be tested includes: the image to be tested is a flawless image, or the image to be tested is a flawed image . 一種電腦可讀儲存介質,其中,所述電腦可讀儲存介質儲存有至少一個指令,所述至少一個指令被處理器執行時實現如請求項1至8中任意一項的所述圖像複檢方法。 A computer-readable storage medium, wherein the computer-readable storage medium stores at least one instruction, and when the at least one instruction is executed by a processor, the image re-examination according to any one of claims 1 to 8 is realized method. 一種電腦裝置,其中,該電腦裝置包括儲存器和至少一個處理器,所述儲存器中儲存有至少一個指令,所述至少一個指令被所述至少一個 處理器執行時實現如請求項1至8中任意一項的所述圖像複檢方法。 A computer device, wherein the computer device includes a memory and at least one processor, at least one instruction is stored in the memory, and the at least one instruction is executed by the at least one The processor implements the image re-examination method according to any one of claims 1 to 8 when executed.
TW110102905A 2021-01-19 2021-01-26 Image reinspection method, computer device, and storage medium TWI780580B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110069794.7A CN113012097B (en) 2021-01-19 2021-01-19 Image rechecking method, computer device and storage medium
CN202110069794.7 2021-01-19

Publications (2)

Publication Number Publication Date
TW202230281A TW202230281A (en) 2022-08-01
TWI780580B true TWI780580B (en) 2022-10-11

Family

ID=76384229

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110102905A TWI780580B (en) 2021-01-19 2021-01-26 Image reinspection method, computer device, and storage medium

Country Status (2)

Country Link
CN (1) CN113012097B (en)
TW (1) TWI780580B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113610414A (en) * 2021-08-13 2021-11-05 深圳市巨力方视觉技术有限公司 PCB (printed Circuit Board) management and control method and device based on machine vision and computer readable medium
CN115100095B (en) * 2021-12-29 2023-08-22 苏州真目人工智能科技有限公司 PCB detection method based on non-supervision algorithm

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI667575B (en) * 2018-06-29 2019-08-01 由田新技股份有限公司 Defect inspection system and method using artificil intelligence
CN110455822A (en) * 2019-07-10 2019-11-15 苏州卓融新能源科技有限公司 A kind of detection method of pcb board defect
TWI703514B (en) * 2018-05-24 2020-09-01 牧德科技股份有限公司 Artificial intelligence recheck system and method thereof
CN111951225A (en) * 2020-07-20 2020-11-17 南京南瑞继保电气有限公司 PCB welding abnormity detection method and device and storage medium

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006113073A (en) * 1997-07-04 2006-04-27 Hitachi Ltd System and method for pattern defect inspection
CN106650770B (en) * 2016-09-29 2019-12-17 南京大学 Mura defect detection method based on sample learning and human eye visual characteristics
TWM548274U (en) * 2016-10-07 2017-09-01 Wintank Automation Inc Inspection equipment of printed circuit board
WO2019095118A1 (en) * 2017-11-14 2019-05-23 深圳和而泰智能控制股份有限公司 Method for classifying blemishes on skin and electronic device
CN110619618B (en) * 2018-06-04 2023-04-07 杭州海康威视数字技术股份有限公司 Surface defect detection method and device and electronic equipment
CN111598827A (en) * 2019-02-19 2020-08-28 富泰华精密电子(郑州)有限公司 Appearance flaw detection method, electronic device and storage medium
CN111915549A (en) * 2019-05-09 2020-11-10 富泰华工业(深圳)有限公司 Defect detection method, electronic device and computer readable storage medium
CN110579479A (en) * 2019-08-09 2019-12-17 康代影像科技(苏州)有限公司 PCB maintenance system and maintenance method based on false point defect detection
CN111693534B (en) * 2020-06-12 2023-09-15 北京百度网讯科技有限公司 Surface defect detection method, model training method, device, equipment and medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI703514B (en) * 2018-05-24 2020-09-01 牧德科技股份有限公司 Artificial intelligence recheck system and method thereof
TWI667575B (en) * 2018-06-29 2019-08-01 由田新技股份有限公司 Defect inspection system and method using artificil intelligence
CN110455822A (en) * 2019-07-10 2019-11-15 苏州卓融新能源科技有限公司 A kind of detection method of pcb board defect
CN111951225A (en) * 2020-07-20 2020-11-17 南京南瑞继保电气有限公司 PCB welding abnormity detection method and device and storage medium

Also Published As

Publication number Publication date
TW202230281A (en) 2022-08-01
CN113012097A (en) 2021-06-22
CN113012097B (en) 2023-12-29

Similar Documents

Publication Publication Date Title
CN110659662B (en) Flaw detection system and method using artificial intelligence
TWI780580B (en) Image reinspection method, computer device, and storage medium
TWI706318B (en) Solder paste printing quality detecting method, data processing device and computer storage medium
WO2019100577A1 (en) Automated test management method and apparatus, terminal device, and storage medium
CN104978270A (en) Automatic software testing method and apparatus
CN108469438A (en) A kind of printed matter detection method, device, equipment and storage medium
JP2012151250A (en) Substrate inspection system
CN103369952A (en) Information display system for supporting analysis operation of substrate inspection results and supporting method
US20180004648A1 (en) Defect reporting in application testing
WO2022183675A1 (en) Semiconductor intelligent inspection system, intelligent inspection method, and storage medium
CN106529050A (en) Three-dimensional model data detection method, device and system for product
CN102789405A (en) Automated testing method and system for mainboard
JP6907508B2 (en) Inspection system, control method and program of inspection equipment
US5790400A (en) Object inspection apparatus
JP2006059276A (en) Source code evaluating system
CN206332009U (en) No ink spot wafer appearance inspecting system
JP2009174977A (en) Inspection device and inspection program for electronic component
JPH0669700A (en) Visual inspection system for printed board unit
CN109540467A (en) Optical fiber automatic test system based on industry internet platform
TWI769688B (en) A method and system for remote optical overhaul of printed circuit board
CN113888772B (en) MES-based information input emergency system and processing method thereof
TWI807426B (en) Literal image defect detection method, computer device, and storage medium
JPH09289396A (en) Maintenance method for installation
CN216870414U (en) Device for detecting appearance defects of whole plate element
JP2002373087A (en) Quality control system

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent