CN115272381B - Metal wire segmentation method and device, electronic equipment and storage medium - Google Patents
Metal wire segmentation method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN115272381B CN115272381B CN202211186435.0A CN202211186435A CN115272381B CN 115272381 B CN115272381 B CN 115272381B CN 202211186435 A CN202211186435 A CN 202211186435A CN 115272381 B CN115272381 B CN 115272381B
- Authority
- CN
- China
- Prior art keywords
- metal wire
- metal line
- path
- determining
- detected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000002184 metal Substances 0.000 title claims abstract description 400
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000011218 segmentation Effects 0.000 title claims abstract description 25
- 238000001514 detection method Methods 0.000 claims abstract description 42
- 238000003466 welding Methods 0.000 claims abstract description 31
- 238000004590 computer program Methods 0.000 claims description 16
- 238000000605 extraction Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 abstract description 14
- 230000000875 corresponding effect Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 239000004065 semiconductor Substances 0.000 description 8
- 238000003709 image segmentation Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000011179 visual inspection Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000007797 corrosion Effects 0.000 description 1
- 238000005260 corrosion Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000012535 impurity Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 229910000679 solder Inorganic materials 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30136—Metal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30152—Solder
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a metal wire segmentation method, a metal wire segmentation device, electronic equipment and a storage medium. The method comprises the following steps: acquiring an image to be detected, and extracting at least one metal wire area image in the image to be detected; determining the coordinates of the starting point of a target metal wire in the metal wire area image based on the coordinates of the position of a sample welding point, traversing the metal wire area in the metal wire area image based on the coordinates of the starting point, and obtaining the path of the metal wire to be detected in the metal wire area image; and determining a target metal line path according to the metal line path to be detected. The method has the advantages that the target metal wire path is segmented from the metal wire area by traversing the metal wire area in the metal wire area image by taking the starting point coordinate of the target metal wire as the starting point, so that the segmentation of the metal wire is realized, the problem of high detection difficulty of the metal wire in a cross state in the product detection process is solved, the metal wire state is convenient to detect, and the metal wire detection difficulty is reduced.
Description
Technical Field
The present invention relates to the field of semiconductor visual inspection technologies, and in particular, to a metal line segmentation method and apparatus, an electronic device, and a storage medium.
Background
The metal wire crossing is a phenomenon widely existing in the visual inspection of the semiconductor, and can directly cause the whole chip to fail or seriously affect the reliability of the chip.
At present, the reasons for causing the metal wire intersection are mainly as follows: 1. welding spots fall off due to more impurities, corrosion and the like of the bonding pad, so that the metal wire is in a metal wire crossing state formed by connecting flying wires with the metal wire beside; 2. the process parameter setting metal lines are in a crossed state. In the product detection process, because the metal wire is crossed, the detection difficulty is higher when detecting the defects of the bending of the metal wire, whether the metal wire is connected with a welding spot or not and the like. Therefore, when a product is detected, the crossed metal wires need to be segmented to reduce the detection difficulty.
Disclosure of Invention
The invention provides a metal wire segmentation method, a metal wire segmentation device, electronic equipment and a storage medium, and aims to solve the problem that the detection difficulty of a metal wire in a cross state is high in the product detection process.
According to an aspect of the present invention, there is provided a metal line dividing method including:
acquiring an image to be detected, and extracting at least one metal wire area image in the image to be detected;
determining the coordinates of the starting point of a target metal wire in the metal wire area image based on the coordinates of the welding point position of the sample, traversing the metal wire area in the metal wire area image based on the coordinates of the starting point, and obtaining the path of the metal wire to be detected in the metal wire area image;
and determining a target metal line path according to the to-be-detected metal line path.
According to another aspect of the present invention, there is provided a metal line dividing apparatus including:
the metal wire area image extraction module is used for acquiring an image to be detected and extracting at least one metal wire area image in the image to be detected;
the to-be-detected metal line path determining module is used for determining the coordinates of the starting point of a target metal line in the metal line area image based on the position coordinates of the sample welding points, traversing the metal line area in the metal line area image based on the coordinates of the starting point, and obtaining the to-be-detected metal line path in the metal line area image;
and the target metal line path determining module is used for determining a target metal line path according to the metal line path to be detected.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the method of wire segmentation according to any of the embodiments of the present invention.
According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a processor to implement the metal wire segmentation method according to any one of the embodiments of the present invention when the computer instructions are executed.
According to the technical scheme of the embodiment of the invention, the target metal wire path is segmented from the metal wire area by traversing the metal wire area in the metal wire area image by taking the starting point coordinate of the target metal wire as the starting point, so that the metal wire segmentation is realized, the problem of high detection difficulty of the metal wire in a cross state in the product detection process is solved, the metal wire state is convenient to detect, and the metal wire detection difficulty is reduced.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present invention, nor do they necessarily limit the scope of the invention. Other features of the present invention will become apparent from the following description.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart of a metal line dividing method according to an embodiment of the present invention.
Fig. 2 is a diagram of a semiconductor chip according to an embodiment of the invention.
Fig. 3 is a metal line area diagram of a second embodiment of the invention, in which two metal lines intersect.
Fig. 4 is a schematic structural diagram of a metal line dividing apparatus according to a third embodiment of the present invention.
Fig. 5 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention.
Reference numerals are as follows:
a circuit board 10; a chip 20; a solder joint 30; and a metal line 40.
Detailed Description
In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first predetermined number", "second predetermined number", and the like in the description and claims of the present invention and the above-mentioned drawings are used for distinguishing similar objects and not necessarily for describing a particular sequence or order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in other sequences than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example one
Fig. 1 is a flowchart of a metal line segmentation method according to an embodiment of the present invention, which is applicable to a case where crossing metal lines are detected in semiconductor visual inspection, and the method can be performed by a metal line segmentation apparatus, which can be implemented in hardware and/or software, and can be configured in the electronics provided in the embodiment of the present invention. As shown in fig. 1, the method includes:
s110, obtaining an image to be detected, and extracting at least one metal wire area image in the image to be detected.
In this embodiment, the image to be detected may be a semiconductor chip image of a product to be detected obtained based on an X-ray imaging technology, for example, fig. 2 is a semiconductor chip diagram provided in an embodiment of the present invention, as shown in fig. 2, a chip 20 is connected to a circuit board 10 through metal lines 40, each metal line 40 corresponds to two pads 30, one pad 30 is located on the chip 20, and the other pad 30 is located on the circuit board 10; when the number of the metal lines is multiple, a situation that the multiple metal lines share one welding point may exist, in this case, the intersection between the metal lines belongs to process intersection, and the reliability of the metal lines is not affected by the intersection. Based on this, in this embodiment, whether the intersection between the metal lines in the image to be detected is the process intersection is determined by extracting the metal line path, so as to realize the identification of the reliability of the metal lines. The metal line path can be extracted through a metal line area image, the metal line area image refers to an area image of one metal line or one group of crossed metal lines in the image to be detected, specifically, in the image to be detected, the metal line and an area where a welding point corresponding to the metal line is located are extracted to obtain a metal line area image, and if the metal line in a crossed state exists in the image to be detected, the crossed metal line and an area where the welding point corresponding to the crossed metal line is located are extracted to obtain a metal line area image. In this embodiment, an image to be detected of a product to be detected may be obtained based on an X-ray imaging technology, and at least one metal line region image is extracted from the image to be detected by using a preset image segmentation method, where the preset image extraction method includes, but is not limited to, a threshold-based image segmentation method, a region-based image segmentation method, an edge-based image segmentation method, and the like, and is not limited herein.
S120, determining the coordinates of the starting point of the target metal wire in the metal wire area image based on the coordinates of the position of the sample welding point, traversing the metal wire area in the metal wire area image based on the coordinates of the starting point, and obtaining the path of the metal wire to be detected in the metal wire area image.
The sample welding point position coordinates refer to welding point position coordinates of all metal wires in a positive sample with the same model as a product to be detected, and the welding point position coordinates of all metal wires of a semiconductor chip in the positive sample can be marked in a manual marking mode before a metal wire path in an image to be detected corresponding to the product to be detected is extracted. When a product to be detected is detected, acquiring the position coordinates of each group of welding points in a positive sample through the positive sample of the product to be detected; the target metal line is a metal line to be divided into metal line paths from the metal line region, and specifically, the metal line region includes at least one metal line, and when the metal line in the metal line region image is a cross metal line, any one metal line can be selected from the cross metal line as the target metal line.
In this embodiment, the welding point position coordinates of each metal line in the positive sample are obtained and stored according to the positive sample with the same model as the product to be measured, the welding point position coordinates of the target metal line in the extracted metal line area image are determined according to the stored sample welding point position coordinates, one welding point position coordinate is selected from the welding point position coordinates of the target metal line as a starting point coordinate, the metal line area in the metal line area image is traversed by taking the position of the starting point coordinate as a starting point, and at least one metal line path to be measured of the target metal line in the metal line area image is obtained. And determining the position coordinates of the welding point of the product to be detected according to the position coordinates of the welding point of the positive sample, so that the obtained position coordinates of the welding point are the coordinates of the welding point in a standard state, and the accuracy of the divided metal circuit path is improved.
In the process of traversing the metal wire area, if the metal wire area has an intersection point, randomly selecting a metal wire area branch to continuously traverse the metal wire area, when the metal wire area branch traverses to a branch end point, determining that the metal wire area branch traverses and finishes, and taking a traversing path from a starting point to the metal wire area branch end point as a metal wire path to be detected; and returning to the previous intersection point, and traversing the branches of the rest metal wire areas until the whole metal wire area is traversed. At least one metal line path to be detected is obtained by traversing the metal line area, and then a target metal line path is screened out from the metal line paths to be detected, so that the metal lines are segmented, and the difficulty of metal line detection is reduced.
On the basis of the above embodiment, traversing the metal wire region in the metal wire region image based on the start point coordinate to obtain the metal wire path to be measured, includes: traversing pixel points in the metal wire area by taking the initial point coordinate as a starting point; and aiming at the traversed current pixel point, determining a current detection area according to the current pixel point and a preset detection area, determining a current cross point set based on the current detection area and the metal wire area, determining a subsequent traversal path based on the current cross point set, and determining the path of the metal wire to be detected until all pixel points in the metal wire area are traversed.
The current pixel point refers to a pixel point corresponding to the current traversal position, and illustratively, when the starting point of the metal wire region is traversed, the pixel point corresponding to the starting point is used as the current pixel point. The preset detection area is used for determining the current detection area, and the preset detection area may be a graphic area with a preset shape and a preset size, where the preset shape and the preset size may be set by those skilled in the art according to experience and requirements, and are not limited herein. For example, the preset detection area may be a circular ring with an inner diameter of a first preset value and an outer diameter of a second preset value; the current detection area is a detection area of the current pixel point obtained according to the current pixel point and a preset detection area, illustratively, if the current pixel point is taken as a circle center, the inner diameter is a first preset value, and a ring with the outer diameter being a second preset value is taken as the preset detection area, the current pixel point is taken as the circle center to create the ring with the inner diameter being the first preset value and the outer diameter being the second preset value as the current detection area; and (4) pixel points corresponding to the cross points in the current cross point set are current pixel points, and the traversal of the metal wire area is continued until the whole metal wire area is traversed, so that the path of the metal wire to be detected is determined. The traversing speed of the metal wire area is accelerated by presetting the detection area to traverse the metal wire area, and then the efficiency of metal wire segmentation is improved.
On the basis of the foregoing embodiment, optionally, the determining a subsequent traversal path based on the current set of intersection points includes: when the number of the intersections in the current intersection set is greater than a first preset number, taking the current intersection set as a branch intersection set, taking any intersection in the branch intersection set as a subsequent traversal starting point, and determining a subsequent traversal path based on the subsequent traversal starting point; or, when the number of the intersections in the current intersection set is less than a second preset number, acquiring the intersections in the branch intersection set which are not traversed as subsequent traversal starting points, and determining the subsequent traversal path based on the subsequent traversal starting points.
Specifically, in the process of traversing the metal line region, when the intersection region of the metal line region is traversed, a plurality of traversal paths exist, correspondingly, the current detection region intersects the metal line region to obtain a plurality of intersections, and each intersection corresponds to a traversal path. In this embodiment, in the process of traversing the metal line area, when the number of intersections in the current intersection set is greater than a first preset number, it indicates that the intersection area has been traversed, an intersection is arbitrarily selected from the current intersection set as a starting point of subsequent traversal, and a pixel point in the metal line area on the traversal path corresponding to the starting point is traversed with the subsequent traversal starting point as the starting point; and when the number of the cross points in the current cross point set is less than or equal to a second preset number, the end point of the current traversal path of the metal wire area is shown, the non-traversed cross points in the branch cross point set are obtained as the subsequent traversal starting points, and the pixel points in the metal wire area on the starting traversal path are traversed by taking the subsequent traversal starting points as the starting points. The first preset number and the second preset number are determined by a person skilled in the art according to a preset detection area, and are not limited herein; illustratively, the first predetermined number is 1 and the second predetermined number is 0. The method comprises the steps of obtaining at least one metal line path to be detected by performing branch operation on a metal line area, and further screening a target metal line path from the obtained at least one metal line path to be detected to realize the segmentation of the metal line.
On the basis of the foregoing embodiment, optionally, the determining the path of the metal line to be measured includes: and taking the communicated traversal path as the path of the metal line to be detected.
In this embodiment, when the number of intersections in the current intersection set is less than the second preset number, it indicates that the intersection has traversed to the end point of the current traversal path, and the pixel points traversed from the start point to the end point of the current traversal path are communicated to serve as the metal line paths to be detected, where the number of the metal line paths to be detected is positively correlated with the number of the traversal paths.
And S130, determining a target metal line path according to the to-be-detected metal line path.
In this embodiment, the target metal line path is a path of a target metal line to be divided from the metal line region, and in the case that the to-be-detected metal line path satisfies a metal line dividing condition, the target metal line path is screened from the obtained to-be-detected metal line paths. The metal wire dividing condition may be that the terminal coordinate of the metal wire to be measured matches the terminal coordinate of the target metal wire, which is not limited herein.
On the basis of the foregoing embodiment, optionally, determining the target metal line path according to the metal line path to be detected includes: determining the terminal point coordinates of a target metal wire in the metal wire area image based on the position coordinates of the sample welding points, and determining the terminal point coordinates of each metal wire path to be detected based on each metal wire path to be detected; and comparing the terminal coordinates of the target metal wire with the terminal coordinates of each metal line path to be detected, and determining the metal line path to be detected as the target metal line path under the condition that the terminal coordinates of the target metal wire are matched with the terminal coordinates of the metal line path to be detected.
After traversing a metal wire area to obtain a metal wire path to be detected, determining the end point coordinate of a target metal wire in a metal wire area image through the position coordinate of a sample welding point in a positive sample, acquiring the end point coordinate of each metal wire path to be detected according to each obtained metal wire path to be detected, respectively comparing the end point coordinate of each metal wire path to be detected with the end point coordinate of the target metal wire, and if the end point coordinate of the metal wire path to be detected is matched with the end point coordinate of the target metal wire, determining the metal wire path to be detected as the target metal wire path. And acquiring the terminal coordinates of the target metal wire through the positive sample, and matching the terminal coordinates of the target metal wire with the terminal coordinates of the metal wires to be detected, so as to determine the path of the target metal wire and realize the segmentation of the metal wires.
It should be noted that, if the obtained end point coordinates of all the paths of the metal line to be tested are not matched with the end point coordinates of the target metal line, it is determined that the target metal line has fallen off from the welding point corresponding to the end point coordinates of the target metal line.
On the basis of the foregoing embodiment, optionally, after the determining the target metal line path based on the metal line path to be measured, the method further includes: obtaining a sample metal line path of a positive sample; and comparing the target metal line path with the sample metal line path, and if the target metal line path is not matched with the sample metal line path, determining that the target metal line is in a state to be adjusted.
The sample metal line path refers to a path of a sample metal line corresponding to a target metal line in a positive sample. In the embodiment, after the target metal wire is determined, a sample metal wire path corresponding to the target metal wire is obtained through a positive sample with the same type as a product to be detected, the target metal wire path is compared with the sample metal wire path, and if the target metal wire path is not matched with the sample metal wire, the target metal wire is marked to be in a state to be adjusted; otherwise, the target metal line is marked as a normal state. The state of the target metal line path is judged by matching the sample metal line path in the positive sample with the target metal line path, so that the metal line is divided, and the metal line detection difficulty is reduced.
According to the technical scheme, the target metal wire path is segmented from the metal wire area in a mode of traversing the metal wire area in the metal wire area image by taking the starting point coordinate of the target metal wire as the starting point, so that the metal wire is segmented, the problem that the metal wire in a cross state is difficult to detect in the product detection process is solved, the metal wire state is convenient to detect, and the difficulty of metal wire detection is reduced.
Example two
Fig. 3 is a metal line area diagram of two metal lines intersecting according to a second embodiment of the present invention. The present embodiment is a preferred embodiment provided on the basis of the above-described embodiments.
In this embodiment, taking intersection of two metal lines as an example, as shown in fig. 3, a metal line region in a metal line region image is a metal line region where two metal lines intersect, one metal line is arbitrarily selected as a target metal line, and assuming that the target metal line is a-B, a metal line path of the target metal line a-B is divided from the metal line region by the following steps:
step 1, taking the point A as a starting point, taking the point A as a circle center, creating a circular ring with a radius of a preset radius, intersecting the whole metal wire region, performing connected domain processing on the points obtained by intersection, and taking a set of the intersecting points as a current intersecting point set of the point A, namely a candidate point set of the next point.
In this example, there is only one next point of point a, that is, there is only one candidate point in the candidate point set of the next point.
Step 2, acquiring the next point (marked as a) from the candidate point set i ) Recording A points and a by an array i Coordinates of points and in i And (3) creating a circular ring with the radius of a preset radius as the center of the circle, and repeating the step 1.
In this example, the coordinates of the traversed points are recorded by an array, the number of intersection points of the circular ring and the metal line area is 2, the traversed points cannot be used as candidate points, the intersection points are screened, each intersection point is compared with the recorded points, and if the intersection points appear in the record point set, the intersection points lose candidate qualification; storing the screened candidate points into a next point candidate point set;
step 3, repeating the step 2 until the number of candidate points of the next candidate point set is more than 1, performing branch processing on the metal line path, and randomly selecting one branch path; step 4, selecting a candidate point corresponding to the selected branch path from the candidate point set as a starting point, repeating the step 1-2 until the number of candidate points in the candidate point set of the next point becomes 0, indicating that the selected branch path traverses to the end point of the branch path, and determining the traversal path from the point A to the end point of the branch path as a metal line path to be tested;
step 5, returning to the part of the candidate points, selecting another branch path, and repeating the step 4 until all the candidate points are traversed, thereby obtaining three paths A-B, A-C and A-D of the metal line to be tested;
and 6, knowing that the terminal point coordinate of the target metal wire A-B is B, and screening the target metal wire paths A-B of the target metal wire A-B from the three metal wire paths to be detected.
The metal line paths C to D of the metal lines C to D are divided in the same manner.
According to the embodiment of the invention, the target metal wire path is segmented from the metal wire area by traversing the metal wire area in the metal wire area image, so that the segmentation of the metal wire is realized, the state of the metal wire is convenient to detect, and the difficulty in metal wire detection is reduced.
EXAMPLE III
Fig. 4 is a schematic structural diagram of a metal line dividing apparatus according to a third embodiment of the present invention. As shown in fig. 4, the apparatus includes:
the metal wire area image extraction module 210 is configured to obtain an image to be detected, and extract at least one metal wire area image in the image to be detected;
the to-be-detected metal line path determining module 220 is configured to determine a starting point coordinate of a target metal line in the metal line region image based on the sample welding point position coordinate, and traverse the metal line region in the metal line region image based on the starting point coordinate to obtain a to-be-detected metal line path in the metal line region image;
the target metal line path determining module 230 is configured to determine a target metal line path according to the metal line path to be detected.
Optionally, the to-be-tested metal line path determining module 220 is configured to traverse the pixel points in the metal line region with the starting point coordinate as a starting point; and aiming at the traversed current pixel point, determining a current detection area according to the current pixel point and a preset detection area, determining a current cross point set based on the current detection area and the metal wire area, determining a subsequent traversal path based on the current cross point set, and determining the path of the metal wire to be detected until all pixel points in the metal wire area are traversed.
Optionally, the to-be-tested metal wire path determining module 220 is further configured to, when the number of intersections in the current intersection set is greater than a first preset number, use the current intersection set as a branch intersection set, use any intersection in the branch intersection set as a subsequent traversal starting point, and determine the subsequent traversal path based on the subsequent traversal starting point; or when the number of the intersection points in the current intersection point set is smaller than a second preset number, acquiring the intersection points which are not traversed in the current intersection point set as a subsequent traversal starting point, and determining the subsequent traversal path based on the subsequent traversal starting point.
Optionally, the to-be-tested metal line path determining module 220 is further configured to use the connected traversal path as the to-be-tested metal line path.
Optionally, the target metal line path determining module 230 is configured to determine a terminal coordinate of a target metal line in the metal line region image based on the sample welding point position coordinate, and determine a terminal coordinate of each metal line path to be detected based on each metal line path to be detected; and comparing the terminal coordinates of the target metal wire with the terminal coordinates of each metal line path to be detected, and determining the metal line path to be detected as the target metal line path under the condition that the terminal coordinates of the target metal wire are matched with the terminal coordinates of the metal line path to be detected.
Optionally, after the target metal line path is determined based on the metal line path to be detected, the apparatus further includes a target metal line detection module, where the target metal line detection module is configured to obtain a sample metal line path of a positive sample; and comparing the target metal line path with the sample metal line path, and if the target metal line path is not matched with the sample metal line path, determining that the target metal line is in a state to be adjusted.
The metal wire segmentation device provided by the embodiment of the invention can execute the metal wire segmentation method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
Example four
FIG. 5 illustrates a schematic diagram of an electronic device 100 that may be used to implement embodiments of the present invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing devices, cellular phones, smart phones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 5, the electronic device 100 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, and the like, wherein the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various suitable actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM13, various programs and data necessary for the operation of the electronic apparatus 100 can also be stored. The processor 11, the ROM12, and the RAM13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.
A plurality of components in the electronic apparatus 100 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, or the like; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 100 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The processor 11 performs the various methods and processes described above, such as the metal line segmentation method.
In some embodiments, the wire segmentation method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 100 via the ROM12 and/or the communication unit 19. When the computer program is loaded into the RAM13 and executed by the processor 11, one or more steps of the above described metal line segmentation method may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the wire segmentation method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. A computer program can execute entirely on a machine, partly on a machine, as a stand-alone software package partly on a machine and partly on a remote machine or entirely on a remote machine or server.
EXAMPLE five
An embodiment of the present invention further provides a computer-readable storage medium, in which computer instructions are stored, and the computer instructions are used to enable a processor to execute a metal wire segmentation method, where the method includes:
acquiring an image to be detected, and extracting at least one metal wire area image in the image to be detected; determining the coordinates of the starting point of a target metal wire in the metal wire area image based on the coordinates of the positions of the sample welding points, traversing the metal wire area in the metal wire area image based on the coordinates of the starting point, and obtaining the path of the metal wire to be detected in the metal wire area image; and determining the target metal line path according to the metal line path to be detected.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired result of the technical solution of the present invention can be achieved.
The above-described embodiments should not be construed as limiting the scope of the invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (7)
1. A metal line dividing method, comprising:
acquiring an image to be detected, and extracting at least one metal wire area image in the image to be detected;
determining the coordinates of the starting point of a target metal wire in the metal wire area image based on the coordinates of the position of a sample welding point, traversing the metal wire area in the metal wire area image based on the coordinates of the starting point, and obtaining the path of the metal wire to be detected in the metal wire area image;
determining a target metal line path according to the to-be-detected metal line path;
traversing the metal wire area in the metal wire area image based on the starting point coordinate to obtain a metal wire path to be measured, wherein the method comprises the following steps:
traversing pixel points in the metal wire area by taking the starting point coordinate as a starting point;
aiming at traversed current pixel points, determining a current detection area according to the current pixel points and a preset detection area, determining a current cross point set based on the current detection area and the metal wire area, determining a subsequent traversal path based on the current cross point set, and determining the path of the metal wire to be detected until all pixel points in the metal wire area are traversed;
the determining a subsequent traversal path based on the current set of intersection points comprises:
when the number of the intersections in the current intersection set is greater than a first preset number, taking the current intersection set as a branch intersection set, taking any intersection in the branch intersection set as a subsequent traversal starting point, and determining a subsequent traversal path based on the subsequent traversal starting point; or,
and when the number of the intersection points in the current intersection point set is smaller than a second preset number, acquiring the intersection points which are not traversed in the branch intersection point set as subsequent traversal starting points, and determining the subsequent traversal path based on the subsequent traversal starting points.
2. The method according to claim 1, wherein the determining the metal wire path to be tested comprises:
and taking the communicated traversal path as the path of the metal line to be detected.
3. The method of claim 1, wherein determining a target metal line path from the metal line path to be tested comprises:
determining the terminal coordinates of a target metal wire in the metal wire area image based on the position coordinates of the sample welding spots, and determining the terminal coordinates of each metal wire path to be detected based on each metal wire path to be detected;
and comparing the terminal coordinates of the target metal wire with the terminal coordinates of each metal line path to be detected, and determining the metal line path to be detected as the target metal line path under the condition that the terminal coordinates of the target metal wire are matched with the terminal coordinates of the metal line path to be detected.
4. The method according to claim 1, wherein after the determining the target metal line path based on the metal line path to be tested, the method further comprises:
obtaining a sample metal line path of a positive sample;
and comparing the target metal line path with the sample metal line path, and if the target metal line path is not matched with the sample metal line path, determining that the target metal line is in a state to be adjusted.
5. A metal wire dividing apparatus, comprising:
the metal wire area image extraction module is used for acquiring an image to be detected and extracting at least one metal wire area image in the image to be detected;
the to-be-detected metal line path determining module is used for determining the coordinates of the starting point of a target metal line in the metal line area image based on the position coordinates of the sample welding points, traversing the metal line area in the metal line area image based on the coordinates of the starting point, and obtaining the to-be-detected metal line path in the metal line area image;
the target metal line path determining module is used for determining a target metal line path according to the metal line path to be detected;
the to-be-tested metal line path determining module is also used for traversing pixel points in the metal line area by taking the initial point coordinate as a starting point; aiming at traversed current pixel points, determining a current detection area according to the current pixel points and a preset detection area, determining a current cross point set based on the current detection area and the metal wire area, determining a subsequent traversal path based on the current cross point set, and determining the path of the metal wire to be detected until all pixel points in the metal wire area are traversed;
wherein the determining a subsequent traversal path based on the current set of intersection points comprises:
when the number of the intersections in the current intersection set is greater than a first preset number, taking the current intersection set as a branch intersection set, taking any intersection in the branch intersection set as a subsequent traversal starting point, and determining a subsequent traversal path based on the subsequent traversal starting point; or,
and when the number of the intersection points in the current intersection point set is less than a second preset number, acquiring the intersection points which are not traversed in the branch intersection point set as subsequent traversal starting points, and determining the subsequent traversal path based on the subsequent traversal starting points.
6. An electronic device, characterized in that the electronic device comprises:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-4.
7. A computer-readable storage medium storing computer instructions for causing a processor to perform the segmentation method of any one of claims 1-4 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211186435.0A CN115272381B (en) | 2022-09-28 | 2022-09-28 | Metal wire segmentation method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211186435.0A CN115272381B (en) | 2022-09-28 | 2022-09-28 | Metal wire segmentation method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115272381A CN115272381A (en) | 2022-11-01 |
| CN115272381B true CN115272381B (en) | 2023-02-03 |
Family
ID=83756128
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211186435.0A Active CN115272381B (en) | 2022-09-28 | 2022-09-28 | Metal wire segmentation method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115272381B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117595032B (en) * | 2024-01-18 | 2024-04-16 | 深圳市志泽科技有限公司 | Data line assembly production process |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010054289A (en) * | 2008-08-27 | 2010-03-11 | Omron Corp | Visual inspection system |
| CN102542555A (en) * | 2010-12-17 | 2012-07-04 | 北京大学 | Method and system for generating edge seam path and edge seam topological structure of raster image |
| CN108154516A (en) * | 2018-01-30 | 2018-06-12 | 北京进化者机器人科技有限公司 | Towards the point cloud topology dividing method and device of enclosure space |
-
2022
- 2022-09-28 CN CN202211186435.0A patent/CN115272381B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010054289A (en) * | 2008-08-27 | 2010-03-11 | Omron Corp | Visual inspection system |
| CN102542555A (en) * | 2010-12-17 | 2012-07-04 | 北京大学 | Method and system for generating edge seam path and edge seam topological structure of raster image |
| CN108154516A (en) * | 2018-01-30 | 2018-06-12 | 北京进化者机器人科技有限公司 | Towards the point cloud topology dividing method and device of enclosure space |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115272381A (en) | 2022-11-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112597837A (en) | Image detection method, apparatus, device, storage medium and computer program product | |
| CN112560862A (en) | Text recognition method and device and electronic equipment | |
| CN115272381B (en) | Metal wire segmentation method and device, electronic equipment and storage medium | |
| CN115205291B (en) | Circuit board detection method, device, equipment and medium | |
| CN116559177A (en) | Defect detection method, device, equipment and storage medium | |
| CN115331132A (en) | Detection method and device for automobile parts, electronic equipment and storage medium | |
| CN115937101A (en) | Quality detection method, device, equipment and storage medium | |
| CN115471476A (en) | Method, device, equipment and medium for detecting component defects | |
| CN117764975A (en) | Image detection method, device, equipment and medium | |
| CN116051558B (en) | Defect image labeling method, device, equipment and medium | |
| CN117274361A (en) | Material surface area measurement method and device, electronic equipment and medium | |
| CN115035481A (en) | Image object distance fusion method, device, equipment and storage medium | |
| CN115327497B (en) | Radar detection range determining method, radar detection range determining device, electronic equipment and readable medium | |
| CN114694138B (en) | Road surface detection method, device and equipment applied to intelligent driving | |
| CN115293096B (en) | Line generation method, device, electronic equipment and storage medium | |
| CN116714646B (en) | Line test sequence generation method, device, equipment and medium | |
| CN116309436B (en) | Fracture state detection method and device, electronic equipment and storage medium | |
| CN115578956A (en) | Method, device, equipment and medium for detecting defective pixel points of display panel | |
| CN113362297A (en) | Image processing method, apparatus and storage medium for printed circuit board | |
| CN118154500A (en) | Image definition evaluation method, device, equipment and storage medium | |
| CN117350995A (en) | Product defect detection method, device, equipment and storage medium | |
| CN117764964A (en) | Cross scratch processing method and device, electronic equipment and storage medium | |
| CN116106724A (en) | Method and device for testing circuit board, electronic equipment and storage medium | |
| CN117764961A (en) | Method and device for processing disconnection scratch connection, electronic equipment and storage medium | |
| CN117576077A (en) | Defect detection method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |