CN115184381A - PCB detection device based on image recognition and image recognition method - Google Patents

PCB detection device based on image recognition and image recognition method Download PDF

Info

Publication number
CN115184381A
CN115184381A CN202210937799.1A CN202210937799A CN115184381A CN 115184381 A CN115184381 A CN 115184381A CN 202210937799 A CN202210937799 A CN 202210937799A CN 115184381 A CN115184381 A CN 115184381A
Authority
CN
China
Prior art keywords
image
pcb
pixel
initial image
initial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210937799.1A
Other languages
Chinese (zh)
Inventor
唐金洲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huayan Tianchuang (Zhuhai) Technology Co.,Ltd.
Original Assignee
Shenzhen Huayan Tianchuang Testing Equipment Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Huayan Tianchuang Testing Equipment Co ltd filed Critical Shenzhen Huayan Tianchuang Testing Equipment Co ltd
Priority to CN202210937799.1A priority Critical patent/CN115184381A/en
Publication of CN115184381A publication Critical patent/CN115184381A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/95Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/956Inspecting patterns on the surface of objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65GTRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G35/00Mechanical conveyors not otherwise provided for
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65GTRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G47/00Article or material-handling devices associated with conveyors; Methods employing such devices
    • B65G47/74Feeding, transfer, or discharging devices of particular kinds or types
    • B65G47/90Devices for picking-up and depositing articles or materials
    • B65G47/91Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers
    • B65G47/917Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers control arrangements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65GTRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G47/00Article or material-handling devices associated with conveyors; Methods employing such devices
    • B65G47/74Feeding, transfer, or discharging devices of particular kinds or types
    • B65G47/90Devices for picking-up and depositing articles or materials
    • B65G47/91Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers
    • B65G47/918Devices for picking-up and depositing articles or materials incorporating pneumatic, e.g. suction, grippers with at least two picking-up heads
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/89Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles
    • G01N21/892Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles characterised by the flaw, defect or object feature examined
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65GTRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G2201/00Indexing codes relating to handling devices, e.g. conveyors, characterised by the type of product or load being conveyed or handled
    • B65G2201/02Articles
    • B65G2201/0214Articles of special size, shape or weigh
    • B65G2201/022Flat
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G01N2021/8887Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/95Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/956Inspecting patterns on the surface of objects
    • G01N2021/95638Inspecting patterns on the surface of objects for PCB's
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30141Printed circuit board [PCB]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Analytical Chemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biochemistry (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Textile Engineering (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a PCB detection device based on image recognition and an image recognition method, wherein the method comprises the following steps: if a detection instruction is received, acquiring an initial image of the PCB acquired by an image acquisition device; performing pixel dissolution on the initial image to determine a circuit line profile corresponding to the initial image; screening a non-continuous area from the circuit line outline according to a preset outline screening rule; acquiring a region image of a discontinuous region in an initial image; and respectively carrying out uniformity identification on each region image to obtain an identification result of whether the initial image meets a preset uniformity condition. According to the image identification method, the initial image of the PCB can be acquired through the image acquisition device and intelligently identified, so that the identification result of whether the corresponding condition is met is obtained, and the defect of the PCB is not judged in a manual mode, so that the detection efficiency of the PCB is greatly improved.

Description

PCB detection device based on image recognition and image recognition method
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a PCB detection device based on image recognition and an image recognition method.
Background
The PCB detection device can be used for detecting various types of PCBs to detect whether flaws exist on the PCBs, the conventional PCB detection device collects images of the PCBs through an image collection device and stores the images for inspection by detection personnel, the detection personnel judge whether the PCBs are qualified or not by checking the images corresponding to each PCB, and the unqualified PCBs are independently stored according to the judgment result of the detection personnel; however, this technical method requires the inspector to carefully check each high-definition image, and manually classify and store the PCB according to the qualified determination result, so that the inspection efficiency and the transfer and storage efficiency of the PCB are low, and a lot of manpower is consumed. Therefore, the PCB detecting device in the prior art has the problem of low efficiency when detecting the PCB.
Disclosure of Invention
The embodiment of the invention provides a PCB detection device based on image recognition and an image recognition method, and aims to solve the problem that the PCB detection device in the prior art is low in efficiency when used for detecting a PCB.
In a first aspect, an embodiment of the present invention provides a PCB detection device based on image recognition, where the detection device includes an image acquisition device assembled on an installation support, a support slide rail arranged on the installation support, and a transfer device assembled on the support slide rail;
the transfer device comprises a transfer driver assembled on the support sliding rail and a magnetic transfer plate fixedly connected with the lower end of the transfer driver through a connecting plate; the transfer driver drives the magnetic transfer plate to slide along the direction of the support sliding rail through the connecting plate;
the lower end surface of the magnetic transfer plate is provided with a plurality of suckers, the top end of each sucker is provided with a magnetic suction assembly, and the suckers are fixed on the lower end surface of the magnetic transfer plate through magnetic attraction between the magnetic suction assemblies and the magnetic transfer plate;
the image acquisition device and the transfer driver are electrically connected with a controller of the detection device; the controller receives the PCB image collected by the image collecting device for detection and sends a control signal to control the transfer driver; and the transfer driver transfers the sucked PCB to a placing position corresponding to the control signal according to the control signal.
In a second aspect, an embodiment of the present invention further provides an image recognition method, where the method is applied to a controller of a PCB detection apparatus based on image recognition as described in the first aspect, and the method includes:
if a detection instruction is received, acquiring an initial image of the PCB acquired by the image acquisition device;
performing pixel dissolution on the initial image to determine a circuit line profile corresponding to the initial image;
screening the circuit line outline according to a preset outline screening rule to obtain a discontinuous area;
acquiring a region image of the discontinuous region in the initial image;
and respectively carrying out uniformity identification on each region image to obtain an identification result of whether the initial image meets a preset uniformity condition.
In a third aspect, an embodiment of the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor implements the image recognition method according to the second aspect when executing the computer program.
In a fourth aspect, the present invention further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and the computer program, when executed by a processor, causes the processor to execute the image recognition method according to the second aspect.
The embodiment of the invention provides a PCB detection device based on image recognition and an image recognition method. The method comprises the following steps: if a detection instruction is received, acquiring an initial image of the PCB acquired by the image acquisition device; performing pixel dissolution on the initial image to determine a circuit line profile corresponding to the initial image; screening a non-continuous area from the circuit line outline according to a preset outline screening rule; acquiring a region image of the discontinuous region in the initial image; and respectively carrying out uniformity identification on each region image to obtain an identification result of whether the initial image meets a preset uniformity condition. According to the method, the initial image of the PCB can be acquired through the image acquisition device and intelligently identified, the identification result of whether the corresponding condition is met is obtained, and the condition that whether the PCB has flaws or not is judged in a manual mode, so that the detection efficiency of the PCB is greatly improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
Fig. 1 is an overall structural diagram of a PCB detection apparatus based on image recognition according to an embodiment of the present invention;
fig. 2 is a partial structural diagram of a PCB detection apparatus based on image recognition according to an embodiment of the present invention;
fig. 3 is another partial structural diagram of a PCB panel inspection apparatus based on image recognition according to an embodiment of the present invention;
FIG. 4 is a partial block diagram of a transfer device provided in accordance with an embodiment of the present invention;
FIG. 5 is a circuit connection structure diagram of a PCB inspection apparatus based on image recognition according to an embodiment of the present invention;
FIG. 6 is a flowchart illustrating an image recognition method according to an embodiment of the present invention;
FIG. 7 is a sub-flow diagram of an image recognition method according to an embodiment of the present invention;
FIG. 8 is a schematic view of another sub-flow chart of an image recognition method according to an embodiment of the present invention;
FIG. 9 is a schematic flow chart of an image recognition method according to an embodiment of the present invention;
FIG. 10 is a schematic view of another sub-flowchart of an image recognition method according to an embodiment of the present invention;
FIG. 11 is a schematic block diagram of a computer device provided by an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items and includes such combinations.
Referring to fig. 1, an embodiment of the present application discloses a PCB detection device based on image recognition, wherein the PCB detection device 1 includes a transmission mechanism 10, a mounting bracket 20 disposed on an upper side of the transmission mechanism 10, and an illumination lamp 30 fixed on an upper side of the transmission mechanism 10; the PCB detection apparatus 1 further comprises an image acquisition device 31 assembled on the mounting bracket 20, a bracket slide rail 21 disposed on the mounting bracket 20, and a transfer device 4 assembled on the bracket slide rail 21. Wherein, the image capturing device 31 may be installed at one side of the illumination lamp 30. The conveying mechanism 10 is used for horizontally conveying the PCB to be detected, meanwhile, the illuminating lamp 30 irradiates the PCB to be detected, the image acquisition device 31 acquires light reflected by the PCB to realize imaging, an initial image of the PCB is obtained, and the initial image acquired by the image acquisition device 31 is analyzed, so that flaws in the PCB can be intelligently detected.
Specifically, as shown in fig. 2 to 5, the embodiment of the present application discloses a PCB detection apparatus based on image recognition, wherein the transfer apparatus 4 includes a transfer driver 41 assembled on the support slide rail 21, and a magnetic transfer plate 43 fixedly connected to a lower end of the transfer driver 41 through a connection plate 42; the transfer driver 41 drives the magnetic transfer plate 43 to slide along the direction of the support slide rail 21 through the connecting plate 42; a plurality of suckers 432 are arranged on the lower end surface of the magnetic transfer plate 43, a magnetic attraction component (not shown in the figure) is arranged at the top end of each sucker 432, and the suckers 432 are fixed on the lower end surface of the magnetic transfer plate 43 through the magnetic attraction force between the magnetic attraction components and the magnetic transfer plate 43; the image acquisition device 31 and the transfer driver 41 are electrically connected with the controller 45 of the detection device; the controller 45 receives the PCB image collected by the image collecting device 31 for detection, and sends a control signal to control the transfer driver 41; the transfer driver 41 transfers the sucked PCB to a placing position corresponding to the control signal according to the control signal.
Specifically, as shown in fig. 2, a first placing table 11 and a second placing table 12 are disposed on two sides of the tail end of the transmission mechanism 10, the long axis direction of the support slide rail 21 can be perpendicular to the direction in which the transmission mechanism 10 transmits the PCB, the PCB can be placed on the first placing table 11 and the second placing table 12, the transmission mechanism 10 detects defects of the PCB placed on the transmission mechanism 10 when the PCB passes through the lower side of the searchlight 30 and the image acquisition device 31, and the transfer device 4 is used for sucking the PCB on which the defect detection is completed on the transmission mechanism 10 and transferring the PCB to the first placing table 11 or the second placing table 12. Because the specific embodiment of the present application focuses on describing classified transportation of PCBs to corresponding placement positions, the terminal in the embodiment of the present application describes the transportation device 4 disposed at the end of the transmission mechanism 10, that is, the end of the transmission mechanism 10 is the downstream direction of the transmission mechanism 10 for transmitting PCBs, and the upstream direction of the transmission mechanism 10 may also be disposed with the transportation device 4, for example, the transportation device 4 disposed in the upstream direction of the transmission mechanism 10 transports the PCB to be detected to the upper end surface of the transmission mechanism 10.
The specific use process of transfer device 4 does, the not circuit area of location PCB board, generally speaking, the not circuit area in the PCB board of same type (same specification) is all the same, manual removal sucking disc 432 adsorbs in the position of terminal surface under magnetism transport plate 43, so that sucking disc 432 moves to the position that corresponds with the non-circuit area in the PCB board, transport driver 41 drive transport plate 43 pushes down, transport plate 43 down the fixed sucking disc 432 of terminal surface can absorb the PCB board of treating the transfer, sucking disc 432 is fixed in the not circuit area in the PCB board this moment.
Specifically, the lower end of the suction cup 432 is provided with a flexible cavity, the flexible cavity is connected with a negative pressure generator (not shown in the figure) through a connecting pipe 4322, when the flexible cavity at the lower end of the suction cup 432 contacts a PCB, the negative pressure generator (such as a vacuum pump) is started, air in the flexible cavity can be pumped out through the connecting pipe 4322, so that the flexible cavity generates negative pressure and is tightly pressed on the PCB, and the suction cup 432 can suck the PCB; when the transfer driver 41 drives the transfer board 43 to slide along the rack rail 21, the PCB board sucked by the lower side of the suction cup 432 can be transferred.
The controller 45 may send a control signal to the transfer driver 41, for example, the controller 45 may send a first control signal to the transfer driver 41 to control the transfer driver 41 to drive the magnetic transfer plate 43 to move onto the first placing table 11 according to the first control signal; the controller 45 may also send a second control signal to the transfer driver 41 to control the transfer driver 41 to drive the magnetic transfer plate 43 to move onto the second placing table 12 according to the second control signal; thereby realize transporting the driver and transporting the PCB board of absorption to the place position that corresponds with control signal according to control signal.
The image acquisition device 31 outputs the acquired initial image of the PCB to the controller 45, the controller 45 analyzes the initial image to determine whether the PCB corresponding to the initial image has defects, and obtains an identification result of the PCB, the controller 45 sends a corresponding control signal to the transfer driver 41 according to the identification result, and the transfer driver 41 transfers the sucked PCB to a placement position corresponding to the control signal according to the control signal.
In an embodiment, the transferring driver 41 includes a first driving motor 411 and a second driving motor 412, and the first driving motor 411 is mounted on the rack rail 21 and can slide along the rack rail 21; the second driving motor 412 is slidably connected to a connecting rod 413, and the upper end of the connecting rod 413 is fixed to the first driving motor 411; the second driving motor 412 slides in a radial direction of the connection rod 413; the magnetic transfer plate 43 is fixedly connected to the lower end of the second driving motor 412 through the connecting plate 42. Specifically, the transfer driver 41 further includes a housing 414, and the housing 414 covers the outer sides of the first driving motor 411 and the second driving motor 412.
Specifically, transport driver 41 includes first driving motor 411 and second driving motor 412, controller 45 is connected with first driving motor 411 and second driving motor 412 simultaneously and electrically, first wheat motor 411 drives so that second driving motor 412 and the magnetic transfer board 43 that is connected with second drive circuit carry out horizontal slip along support slide rail 21, second driving motor 412 drives magnetic transfer board 43 and carries out vertical slip along connecting rod 413, through this mode of setting, realize that magnetic transfer board 43 descends in order to absorb the PCB board, then rise, rethread first driving motor 411 drives magnetic transfer board 43 and translates, thereby the PCB board of absorption transports.
Referring to fig. 6, an embodiment of the present application further discloses an image recognition method, where the method is applied to a controller 45 of the PCB detection apparatus 1, the image recognition method is executed by application software installed in the controller 45, and the controller 45 is a control device, such as an MCU chip, for executing the image recognition method to intelligently analyze an initial image of a PCB and control a transfer apparatus to transfer and store the PCB in a classified manner; the controller 45 may also send control signals to the various functional components in the PCB inspection apparatus 1 to control the various functional components. As shown in fig. 6, the method includes steps S110 to S150.
And S110, if a detection instruction is received, acquiring an initial image of the PCB acquired by the image acquisition device.
And receiving a detection instruction, and acquiring an initial image of the PCB acquired by the image acquisition device. If the controller receives a detection instruction input by a user, the controller can send a collection instruction to the image collection device, and the image collection device can collect images of the PCB transmitted through the transmission mechanism, so that initial images of the PCB collected by the image collection device are obtained.
And S120, performing pixel dissolution on the initial image to determine a circuit line profile corresponding to the initial image.
Performing pixel dissolution on the initial image to determine a circuit line profile corresponding to the initial image. The initial image can be subjected to pixel dissolution, so that a corresponding circuit line profile is obtained from the initial image, and the circuit line profile is profile information corresponding to the circuit line in the initial image.
In an embodiment, as shown in fig. 7, step S120 includes sub-steps S121, S122, S123 and S124.
S121, obtaining pixel points with pixel values in a preset pixel range from the initial image to obtain an initial pixel area.
The method comprises the steps that pixel points with pixel values within a preset pixel range can be obtained from an initial image, each pixel point in the initial image correspondingly comprises the pixel values of three color channels (RGB, red, green and blue), the pixel range correspondingly comprises the pixel value ranges corresponding to the three color channels, whether the pixel values of each pixel point in the initial image in the three color channels are all within the pixel range can be judged, and all the pixel points within the pixel range are obtained to form an initial pixel area. For example, the circuit lines on the PCB are usually copper wires, and the pixel range can be set to a pixel value range close to the copper wires, so that the obtained initial pixel area is the pixel area close to the pixel value of the copper wires.
And S122, calculating contrast values between the pixel points at the edge of the initial pixel region and other surrounding pixel points.
The method comprises the steps of obtaining pixel points at the edge of an initial pixel area, calculating the contrast value between each pixel point at the edge and other surrounding pixel points, specifically, calculating the difference value between the pixel values of the other surrounding pixels and the pixel points at the edge, and then averaging to obtain the contrast value of the pixel points.
For example, the specific calculation formula may be as shown in formula (1).
Figure BDA0003784164300000071
Wherein x is i The pixel value, x, of the ith pixel point around the edge pixel point 0 The pixel value of a certain pixel point on the edge, and M is the total number of the peripheral pixel points. Wherein, other peripheral pixel points can be the pixel point of the first circle at the periphery of a certain pixel point at the edge, and then M =8; other peripheral pixels can be pixels in the first circle and the second circle of the periphery of a certain pixel in the edge, and then M =24.
And S123, acquiring edge pixel points with the contrast value larger than a preset contrast threshold in the initial pixel region as target contour points.
And judging the contrast value of the edge pixel point in the initial pixel region and a preset contrast threshold value, and acquiring the edge pixel point with the contrast value larger than the contrast threshold value from the initial pixel region as a target contour point according to a judgment result.
And S124, performing pixel dissolution on the initial image according to the target contour point to obtain a circuit line contour corresponding to the initial image.
After the target contour point is obtained, pixel dissolution can be carried out on the initial image according to the target contour point, namely other pixel points of non-target contour points are removed from the initial image, and the remaining pixel points after the pixel dissolution are connected to obtain a corresponding circuit contour line, wherein the circuit contour line is a binary image, the pixel points corresponding to the target contour point form contour information in the circuit contour line, and other areas are blank.
Because the obtained pixel range of the initial pixel area is wide, the outer edge profile of the circuit line cannot be accurately determined, so that the accurate circuit line profile in the initial pixel area can be determined by calculating the pixel value of the edge pixel point and judging whether the pixel value is greater than the contrast threshold value.
And S130, screening the circuit line outline according to a preset outline screening rule to obtain a discontinuous area.
And screening the circuit line contour according to the contour screening rule, thereby screening out a discontinuous region in the circuit contour. Whether the distance between the contour line in the circuit line contour and another contour line along the normal distance is smaller than the distance threshold value in the contour screening rule can be judged. For example, if the normal direction of one of the two adjacent and parallel contour lines is the horizontal direction, the distance between the two contour lines in the horizontal direction may be obtained and it may be determined whether the distance is smaller than the distance threshold.
If the distance is smaller than the distance threshold value, the circuit line comprises a discontinuous circuit line, and the area around the discontinuous circuit line is determined to be a discontinuous area.
S140, acquiring a region image of the discontinuous region in the initial image.
The discontinuous area is a partial image area in the contour of the circuit line, and an image corresponding to the position of the discontinuous area in the initial image can be determined as an area image according to the position of the discontinuous area, wherein the area image is an image containing corresponding colors, namely, an actual color image corresponding to the binarized discontinuous area is obtained.
S150, respectively carrying out uniformity identification on each area image to obtain an identification result of whether the initial image meets a preset uniformity condition.
And respectively carrying out uniformity identification on each area image acquired from the initial image so as to obtain an identification result corresponding to the initial image. Respectively carrying out uniformity identification on the obtained regional images, and if the uniformity of each regional image of the initial image meets a uniformity condition, indicating that the initial image does not contain a defective region needing important attention, namely obtaining an initial image non-defective identification result; if the uniformity of any region image of the initial image does not meet the uniformity condition, it is indicated that the initial image contains a defect region needing important attention, that is, a recognition result of the defect of the initial image is obtained.
In one embodiment, as shown in FIG. 8, step S150 includes sub-steps S151 and S152.
S151, acquiring uniformity characteristic information of the area image; s152, judging whether the uniformity characteristic information of each region image is within the numerical range of the uniformity condition so as to obtain the identification result of whether the initial image meets the preset uniformity condition.
Specifically, the uniformity characteristic information of each region image may be obtained, and whether the uniformity characteristic information of each region image is within a value range of a uniformity condition is determined, where the uniformity characteristic information includes a pixel value standard deviation, a pixel value range, a pixel median difference value, and the like, where the pixel value range is a pixel difference value between a pixel value maximum pixel point and a pixel value minimum pixel point in the region image, and the pixel median difference value is a difference value between a pixel average value and a pixel median value in the region image.
Judging whether all the numerical values contained in the uniformity characteristic information are in the numerical range of the uniformity condition, if all the numerical values are in the numerical range of the uniformity condition, the uniformity characteristic information of the area image meets the preset uniformity condition; if the various numerical unevenness are within the numerical range of the uniformity condition, the uniformity characteristic information of the image in the area does not meet the preset uniformity condition. If all the regional images of the initial image meet the uniform condition, obtaining the identification result that the initial image meets the uniform condition, namely the initial image is flawless; if the area image of the initial image does not meet the uniform condition, obtaining the identification result that the initial image does not meet the uniform condition, namely the initial image has defects.
In an embodiment, as shown in fig. 9, step S160 is further included after step S150.
And S160, sending a corresponding control signal to the transfer driver according to the identification result so that the transfer driver can classify and place the sucked PCB according to the identification result.
And sending a corresponding control signal to the transfer driver according to the identification result so that the transfer driver can classify and place the sucked PCB according to the identification result. The controller 45 may also send a control signal to the transfer driver, so that the transfer driver classifies the currently sucked PCB according to the recognition result. For example, if the recognition result is that the uniform condition is satisfied, a first control signal is sent to the transfer driver to store the PCB board to the first placing table 11; if the identification result is that the uniform condition is not satisfied, a second control signal is sent to the transfer driver to store the PCB board to the second placing table 12.
In one embodiment, as shown in fig. 10, step S160 includes sub-steps S161 and S162.
S161, determining a corresponding translation transfer direction according to the identification result; and S162, generating a corresponding control signal according to the determined translation transfer direction and sending the control signal to the transfer driver.
Specifically, the corresponding translation and transportation direction is determined according to the identification result, for example, the translation and transportation direction may be the left translation and transportation to the transport mechanism 10 or the right translation and transportation to the transport mechanism 10, and if the identification result meets the uniform condition, the translation and transportation direction is determined as the left translation and transportation direction; and if the identification result is that the uniform condition is not met, determining the translation transport direction on the right side.
And generating a corresponding control signal according to the determined translation transferring direction, correspondingly generating a first control signal if the translation transferring direction on the left side is the left side, correspondingly generating a second control signal if the translation transferring direction on the right side is the right side, and sending the generated control signal to a transferring driver, so that the transferring driver can be controlled to transfer the PCB to a placing position corresponding to the control signal.
In the image recognition method provided by the embodiment of the invention, the method comprises the following steps: if a detection instruction is received, acquiring an initial image of the PCB acquired by the image acquisition device; performing pixel dissolution on the initial image to determine a circuit line profile corresponding to the initial image; screening a non-continuous area from the circuit line outline according to a preset outline screening rule; acquiring a region image of the discontinuous region in the initial image; and respectively carrying out uniformity identification on each region image to obtain an identification result of whether the initial image meets a preset uniformity condition. According to the method, the initial image of the PCB can be acquired through the image acquisition device and intelligently identified, the identification result of whether the corresponding condition is met is obtained, and the defect of the PCB is not judged in a manual mode, so that the detection efficiency of the PCB is greatly improved.
The image recognition method may be implemented in the form of a computer program, and the controller 45 may be implemented in the form of a computer device, which may be run on the computer device as shown in fig. 11.
Referring to fig. 11, fig. 11 is a schematic block diagram of a computer device according to an embodiment of the present invention. The computer device may be a controller 45 for performing an image recognition method for intelligent detection of defects in the PCB board.
Referring to fig. 11, the computer device 500 includes a processor 502, memory, and a network interface 505 connected by a system bus 501, where the memory may include a storage medium 503 and an internal memory 504.
The storage medium 503 may store an operating system 5031 and a computer program 5032. The computer program 5032, when executed, may cause the processor 502 to perform an image recognition method, wherein the storage medium 503 may be a volatile storage medium or a non-volatile storage medium.
The processor 502 is used to provide computing and control capabilities that support the operation of the overall computer device 500.
The internal memory 504 provides an environment for the operation of the computer program 5032 in the storage medium 503, and when the computer program 5032 is executed by the processor 502, the processor 502 can be enabled to execute the image recognition method.
The network interface 505 is used for network communication, such as providing transmission of data information. Those skilled in the art will appreciate that the configuration shown in fig. 11 is a block diagram of only a portion of the configuration associated with aspects of the present invention and is not intended to limit the computing device 500 to which aspects of the present invention may be applied, and that a particular computing device 500 may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
The processor 502 is configured to run the computer program 5032 stored in the memory to implement the corresponding functions in the image recognition method.
Those skilled in the art will appreciate that the embodiment of a computer device illustrated in fig. 11 does not constitute a limitation on the particular configuration of the computer device, and in other embodiments, the computer device may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. For example, in some embodiments, the computer device may only include a memory and a processor, and in such embodiments, the structures and functions of the memory and the processor are consistent with those of the embodiment shown in fig. 11, and are not described herein again.
It should be understood that, in the present embodiment, the Processor 502 may be a Central Processing Unit (CPU), and the Processor 502 may also be other general purpose processors, digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field-Programmable Gate arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, etc. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
In another embodiment of the present invention, a computer-readable storage medium is provided. The computer readable storage medium may be a volatile or non-volatile computer readable storage medium. The computer-readable storage medium stores a computer program, wherein the computer program, when executed by a processor, implements the steps included in the image recognition method described above.
It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the above-described devices, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the several embodiments provided in the present invention, it should be understood that the disclosed apparatus, device and method may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only a logical division, and there may be other divisions when the actual implementation is performed, or units having the same function may be grouped into one unit, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may also be an electrical, mechanical or other form of connection.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiments of the present invention.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention essentially or partly contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a computer readable storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the embodiments of the present invention. And the aforementioned computer-readable storage medium comprises: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a magnetic disk, or an optical disk, and various media capable of storing program codes.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (10)

1. The PCB detecting device based on image recognition is characterized by comprising an image acquisition device assembled on a mounting bracket, a bracket slide rail arranged on the mounting bracket and a transfer device assembled on the bracket slide rail;
the transfer device comprises a transfer driver assembled on the support sliding rail and a magnetic transfer plate fixedly connected with the lower end of the transfer driver through a connecting plate; the transfer driver drives the magnetic transfer plate to slide along the direction of the support sliding rail through the connecting plate;
the lower end surface of the magnetic transfer plate is provided with a plurality of suckers, the top end of each sucker is provided with a magnetic attraction assembly, and the sucker is fixed on the lower end surface of the magnetic transfer plate through the magnetic attraction force between the magnetic attraction assembly and the magnetic transfer plate;
the image acquisition device and the transfer driver are electrically connected with a controller of the detection device; the controller receives the PCB image collected by the image collecting device for detection and sends a control signal to control the transfer driver; and the transfer driver transfers the sucked PCB to a placing position corresponding to the control signal according to the control signal.
2. The PCB detection device based on image recognition is characterized in that the transfer driver comprises a first driving motor and a second driving motor, wherein the first driving motor is assembled on the support sliding rail and can slide along the support sliding rail;
the second driving motor is connected with a connecting rod in a sliding mode, and the upper end of the connecting rod is fixed on the first driving motor; the second driving motor slides along the radial direction of the connecting rod;
the magnetic transfer plate is fixedly connected with the lower end of the second driving motor through the connecting plate.
3. The PCB board detection device based on image recognition of claim 2, wherein the transfer driver further comprises a housing, and the housing is covered on the outer side of the first driving motor and the second driving motor.
4. An image recognition method applied to the controller of the PCB board detection device based on the image recognition according to any one of claims 1 to 3, wherein the method comprises the following steps:
if a detection instruction is received, acquiring an initial image of the PCB acquired by the image acquisition device;
performing pixel dissolution on the initial image to determine a circuit line profile corresponding to the initial image;
screening the circuit line outline according to a preset outline screening rule to obtain a discontinuous area;
acquiring a region image of the discontinuous region in the initial image;
and respectively carrying out uniformity identification on each region image to obtain an identification result of whether the initial image meets a preset uniformity condition.
5. The image recognition method of claim 4, wherein the performing pixel dissolution on the initial image to determine a circuit line profile corresponding to the initial image comprises:
acquiring pixel points with pixel values within a preset pixel range from the initial image to obtain an initial pixel area;
calculating the contrast value between the pixel point at the edge of the initial pixel region and other surrounding pixel points;
acquiring edge pixel points with the contrast value larger than a preset contrast threshold value in the initial pixel area as target contour points;
and carrying out pixel dissolution on the initial image according to the target outline point so as to obtain a circuit line outline corresponding to the initial image.
6. The image recognition method according to claim 4, wherein the performing uniformity recognition on each of the region images to obtain a recognition result of whether the initial image satisfies a preset uniformity condition comprises:
acquiring uniformity characteristic information of the area image;
and judging whether the uniformity characteristic information of each region image is within the numerical range of the uniformity condition or not so as to obtain the identification result of whether the initial image meets the preset uniformity condition or not.
7. The image recognition method according to claim 4, wherein after the respectively performing the homogeneity recognition on each of the area images to obtain a recognition result of whether the initial image satisfies a preset homogeneity condition, the method further comprises:
and sending a corresponding control signal to the transfer driver according to the identification result so that the transfer driver can classify and place the sucked PCB according to the identification result.
8. The image recognition method according to claim 7, wherein the sending out a corresponding control signal to the transfer driver according to the recognition result comprises:
determining a corresponding translation and transportation direction according to the identification result;
and generating a corresponding control signal according to the determined translation transfer direction and sending the control signal to the transfer driver.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the image recognition method according to any one of claims 4 to 8 when executing the computer program.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when executed by a processor, implements the image recognition method according to any one of claims 4-8.
CN202210937799.1A 2022-08-05 2022-08-05 PCB detection device based on image recognition and image recognition method Pending CN115184381A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210937799.1A CN115184381A (en) 2022-08-05 2022-08-05 PCB detection device based on image recognition and image recognition method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210937799.1A CN115184381A (en) 2022-08-05 2022-08-05 PCB detection device based on image recognition and image recognition method

Publications (1)

Publication Number Publication Date
CN115184381A true CN115184381A (en) 2022-10-14

Family

ID=83522457

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210937799.1A Pending CN115184381A (en) 2022-08-05 2022-08-05 PCB detection device based on image recognition and image recognition method

Country Status (1)

Country Link
CN (1) CN115184381A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116500050A (en) * 2023-06-28 2023-07-28 四川托璞勒科技有限公司 PCB visual inspection system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116500050A (en) * 2023-06-28 2023-07-28 四川托璞勒科技有限公司 PCB visual inspection system
CN116500050B (en) * 2023-06-28 2024-01-12 四川托璞勒科技有限公司 PCB visual inspection system

Similar Documents

Publication Publication Date Title
KR101149334B1 (en) An abnormality detecting apparatus for detecting abnormarlity at interface portion of contact arm, An electronic device testing apparatus and An electronic device testing system with the same, and An abnormality detecting method
CN115165925A (en) PCB detection device with marking function, marking method, equipment and medium
WO2017032308A1 (en) Pcb board detection method and apparatus
CN115184381A (en) PCB detection device based on image recognition and image recognition method
KR102104936B1 (en) Semiconductor manufacturing apparatus and method for manufacturing semiconductor device
CN111982933A (en) Coating defect detection system and device
EP3232211A1 (en) Method for inspecting terminal of component formed on substrate and substrate inspection apparatus
CN1677095A (en) Automatic optical detection system of membrane type or belt type printed circuit board and processing method thereof
CN109870463B (en) Electronic chip fault detection device
US20130235186A1 (en) Apparatus and Method for Inspecting Chip Defects
CN115311257A (en) PCB detection method, device, equipment and medium with wireless transmission function
KR102640295B1 (en) wafer measurement apparatus
CN114720473A (en) Defect detection method of vehicle-mounted screen backboard based on machine vision
CN116229856B (en) Automatic control screen detection system and method for computer
JP2002243655A (en) Method and equipment for visual inspection of electronic component
TW202314231A (en) Apparatus for hair inspection on substrate and method for hair inspection on substrate
JP2003224353A (en) Method for mounting substrate of electronic component
CN115308227A (en) PCB detection device with double-sided marking function and marking method
CN112987356A (en) Method and device for false detection and filtering of foreign matters at bottom of liquid crystal panel
CN115092690B (en) PCB (printed circuit board) transferring method, device, equipment and medium based on image recognition
CN112129700A (en) Image detection method and detection device for flexible circuit board
CN111273921A (en) Chip burning method, system and computer readable storage medium
CN111725086A (en) Semiconductor manufacturing apparatus and method for manufacturing semiconductor device
KR102005345B1 (en) An automobile junction box terminal vision inspection method using line scan camera
JP4371883B2 (en) Illumination light source unit for inspection and surface defect inspection apparatus using the light source unit

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20230913

Address after: Room 101, 201, 301, 401, Building 5, No. 1099 Jinzhou Road, Tangjiawan Town, High tech Zone, Zhuhai City, Guangdong Province, 519000

Applicant after: Huayan Tianchuang (Zhuhai) Technology Co.,Ltd.

Address before: Room 301, No. 4, Second Industrial Zone, Langxia Community, Songgang Street, Bao'an District, Shenzhen, Guangdong 518000

Applicant before: Shenzhen Huayan Tianchuang Testing Equipment Co.,Ltd.

TA01 Transfer of patent application right