CN106815832B - A kind of steel mesh automatic image registration method and system of surface mounting technology - Google Patents

A kind of steel mesh automatic image registration method and system of surface mounting technology Download PDF

Info

Publication number
CN106815832B
CN106815832B CN201611187643.7A CN201611187643A CN106815832B CN 106815832 B CN106815832 B CN 106815832B CN 201611187643 A CN201611187643 A CN 201611187643A CN 106815832 B CN106815832 B CN 106815832B
Authority
CN
China
Prior art keywords
registration
image
point
steel mesh
rectangle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611187643.7A
Other languages
Chinese (zh)
Other versions
CN106815832A (en
Inventor
夏珉
杨克成
李微
章琦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huazhong University of Science and Technology
Original Assignee
Huazhong University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huazhong University of Science and Technology filed Critical Huazhong University of Science and Technology
Priority to CN201611187643.7A priority Critical patent/CN106815832B/en
Publication of CN106815832A publication Critical patent/CN106815832A/en
Application granted granted Critical
Publication of CN106815832B publication Critical patent/CN106815832B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/001Industrial image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30141Printed circuit board [PCB]

Landscapes

  • Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a kind of steel mesh automatic image registration methods of surface mounting technology, belong to image procossing and field of optical measurements.The special type that the inventive method is not influenced using the distance between image boundary rectangle and registration point by any placement position of steel mesh and angle, it is registrated using design registration point and design dot chart and steel mesh finished product image, the calculating of transmission feature matrix is converted to the translation, rotation, the calculating of 3 parameters of scaling calculated required for being on time registrated steel mesh with designed image progress affine transformation, it carries out being registrated automatic test after registration, carries out secondary registration after registration failure.The invention also achieves a kind of steel mesh automatic image registration systems of surface mounting technology simultaneously.Technical solution of the present invention is not influenced by the placement position of registration product and placement angle, is had the characteristics that registration accurately and fast and is simple and efficient, while effectively raising registration success rate.

Description

A kind of steel mesh automatic image registration method and system of surface mounting technology
Technical field
The invention belongs to image procossings and field of optical measurements, more particularly, to a kind of steel mesh of surface mounting technology Automatic image registration method.
Background technique
With the rapid development and progress of electronic technology, the integrated level and complexity of PCB circuit are also being continuously improved, patch Element has accounted for 50% to 90% in the component population of circuit board totality, and surface mounting technology (SMT) is current Electronic Assemblies A kind of most popular technology and technique in industry.Steel mesh is SMT particular manufacturing craft made of a kind of laser cutting, and major function is side Help the deposition of tin cream, it is therefore an objective to which the tin cream of accurate quantity is transferred to the accurate location on sky PCB.Now with processing technology with And the development of electronics industry is become better and better, the size of aperture is also smaller and smaller on SMT steel mesh, and quantity is more also at the increase of geometry Up to distribution of a pore sizes thousands of or even up to ten thousand from 0.1 micron to several centimeters.It is before this typically all by manually using putting Big mirror and other auxiliary tools with the naked eye carry out the quality in observation detection steel mesh hole one by one, and artificial vision's detection is a large amount of by consumption Time be difficult to ensure the accuracy of detection simultaneously.Therefore the automatic measurement technique based on machine vision will be the following steel mesh detection Inexorable trend.
Large format (600*600mm or more) steel mesh passes through single area array CCD and telecentric lens cooperate motor machine platform to carry out Snake scan imaging, image are spliced to form full width face image by precision and are registrated with vector design document by characteristic point, It calls detection algorithm to carry out defects detection and obtains quality inspection result.It is automatic and accurate how steel mesh image carries out with design document Before registration is the key that defects detection.Existing method for registering images usually needs the artificial characteristic point that clicks, and does not have automatic Property and high efficiency;Even if there is the method for autoregistration, existing autoregistration algorithm, which may be only available for steel mesh, to be put and lesser inclines Tiltedly and rotate.Be difficult to be suitable for steel mesh arbitrarily the stretcher strain of placement angle, steel mesh in process to registration success rate Influence, and do not have intelligent detection registration effect and Automatic Optimal adjustment is equipped with and improves the functions such as success rate.
Summary of the invention
In order to solve the above technological deficiency of the prior art and technical problem, the present invention provides a kind of surface mounting technologies Steel mesh automatic image registration method, its object is to choose matching characteristic point automatically;And the randomness of steel mesh placement angle is mentioned Reasonable usability methods are gone out;It joined internal automatic test matching effect and secondary registration.Thus existing steel mesh is solved to match The technical problems such as quasi- and defect inspection method low efficiency, poor for applicability and not smart enoughization.
To achieve the above object, according to one aspect of the present invention, a kind of steel mesh image of surface mounting technology is provided Autoegistration method, method includes the following steps:
(1) steel mesh design profile is obtained by steel mesh design document, seeks design profile minimum circumscribed rectangle, obtain rectangle four The coordinate on a vertex and the length of rectangle;
(2) area and barycentric coodinates of all intercommunicating pores in design profile are extracted, and generates design point according to barycentric coodinates System of battle formations picture;
(3) 4 design registration points successively are sought by 4 vertex of rectangle and design dot matrix image;
(4) finished product steel mesh high-contrast image is acquired, if finished product steel mesh is too big, the multiple topographies of steel mesh is acquired and carries out Splicing forms complete steel mesh image, reuses iterative method and carries out bilinear interpolation sub-pix Threshold segmentation processing image;It seeks locating Image-region minimum circumscribed rectangle and the coordinate on four vertex of rectangle and the length of rectangle are calculated after reason;
(5) area and barycentric coodinates in the steel mesh image connectivity hole after extraction process generates steel mesh by all barycentric coodinates Dot matrix image;
(6) 4 the first registration points successively are sought by 4 vertex of rectangle and steel mesh dot matrix image;
(7) it is found respectively in steel mesh dot matrix image away from 4 nearest focus points of 4 the first registration points as the second registration Point;
(8) 3 the first registration points for choosing 3 design registration points and corresponding position carry out affine transformation, and it is imitative to obtain feature Matrix is penetrated, design profile is covered on steel mesh image after converting by affine matrix;
(9) autoregistration test is carried out to the design profile converted by affine matrix, judges whether to be registrated successfully, if Then registration terminates;Otherwise the second registration point that failure registration point is changed to corresponding position is continued to be registrated.
Further, registration point finding process is divided into following sub-step in the step (3) and step (6):
(11) using a vertex of rectangle as the center of circle, with RdIt draws and justifies for radius, wherein Rd=kL, L are the length of rectangle, and k is First radius multiple;The value range of k is 5% < k < 20%, preferably k=10%;
(12) round and dot matrix image intersection is asked, judges whether there is focus point in intersection, has, obtain the center of gravity in intersection Coordinate, and execute step (34);It is no to then follow the steps (33);
(13) k=2k updates radius RdAnd circle is repainted, it executes step (32);
(14) distance for seeking all barycentric coodinates in rectangle vertex and intersection takes apart from the smallest barycentric coodinates as registration Point.
Further, iterative method progress bilinear interpolation sub-pix Threshold segmentation processing image is specific in the step (4) It is divided into following sub-step:
(41) each pixel of the transition portion between steel mesh display foreground and background is selected to carry out 10 × 10 interpolation;
(42) threshold value that steel mesh image is acquired using iterative method carries out Threshold segmentation to the steel mesh image after interpolation.
Further, autoregistration test is divided into following sub-step in the step (9):
(91) the connection hole area and barycentric coodinates for extracting design profile after affine matrix converts, are given birth to by all barycentric coodinates At registration dot matrix image;
(92) using 3 selected the first registration points one of them as the center of circle, with RcIt draws and justifies for radius, wherein Rc=jl, j are Second radius multiple;The value range of j is 1% < j < 10%, preferably j=3%;L is lie farthest away in 4 the first registration points The distance between two registration points;The focus point coordinate in circle and registration dot matrix image intersection is acquired, the first intersection point set is denoted as It closes;The focus point coordinate in round and steel mesh dot matrix image intersection is acquired, the second intersection point set is denoted as;
(93) successively compare in the first intersection point set internal coordinate point and the second intersection point set corresponding position coordinate points it Between distance, distance be greater than maximum allowable offset coordinate points be denoted as registration failed point, if registration failed point number be greater than match Quasi- threshold value, then current the first registration point as the center of circle of judgement is registrated failure, and is denoted as unsuccessfully registration point;Otherwise judgement is current makees It is registrated successfully for first registration point in the center of circle;Wherein, registration threshold value value range is intersection point set internal coordinate point sum 30% to 50%, preferably the 40% of intersection point set internal coordinate point sum;The value range of maximum allowable offset arrives for 50um 150um, preferably 100um;
(94) it repeats step (92) and (93) first registration point selected by 3 and all completes autoregistration to test, if 3 institutes It selects the first registration point to be all registrated success, is then registrated success;Otherwise registration failure.
It is another aspect of this invention to provide that a kind of steel mesh automatic image registration system of surface mounting technology is provided, it should System includes following part:
Design profile boundary rectangle extraction module is sought designing for obtaining steel mesh design profile by steel mesh design document Profile minimum circumscribed rectangle obtains the coordinate on four vertex of rectangle and the length of rectangle;
Dot matrix image extraction module is designed, for extracting the area and barycentric coodinates of all intercommunicating pores in design profile, and Design dot matrix image is generated according to barycentric coodinates;
Registration point extraction module is designed, for successively being sought 4 designs by 4 vertex of rectangle and design dot matrix image and being matched On schedule;
Steel mesh image boundary rectangle extraction module, for acquiring finished product steel mesh high-contrast image, if finished product steel mesh is too big, It then acquires the multiple topographies of steel mesh and carries out the complete steel mesh image of splicing composition, reuse iterative method and carry out bilinear interpolation Asia picture Plain Threshold segmentation handles image;It seeks image-region minimum circumscribed rectangle after processing and calculates the coordinate and square on four vertex of rectangle The length of shape;
Steel mesh dot matrix image extraction module, for the area and barycentric coodinates in the steel mesh image connectivity hole after extraction process, Steel mesh dot matrix image is generated by all barycentric coodinates;
First registration point extraction module is matched for successively seeking 4 first by 4 vertex of rectangle and steel mesh dot matrix image On schedule;
Second registration point extraction module, for found respectively in steel mesh dot matrix image away from 4 the first registration points it is nearest 4 A focus point is as the second registration point;
Registration module, 3 the first registration points for choosing 3 design registration points and corresponding position carry out affine transformation, Feature affine matrix is obtained, design profile is covered on steel mesh image after converting by affine matrix;
It is registrated test module, for carrying out autoregistration test to the design profile converted by affine matrix, judgement is It is no to be registrated successfully, if then registration terminates;Otherwise the second registration point that failure registration point is changed to corresponding position is continued to be registrated.
Further, registration point finding process point in the design registration point extraction module and the first registration point extraction module For following submodule:
Dumpling made of glutinous rice flour module is drawn, for a vertex using rectangle as the center of circle, with RdIt draws and justifies for radius, wherein Rd=kL, L are square The length of shape, k are the first radius multiple;The value range of k is 5% < k < 20%, preferably k=10%;
Seek common ground submodule, for asking the intersection of round and dot matrix image, judges whether there is focus point in intersection, has, obtain Barycentric coodinates in intersection, and execute step (34);It is no to then follow the steps (33);
Dumpling made of glutinous rice flour module is updated, for updating k=2k, updates radius RdAnd circle is repainted, it executes step (32);
Registration point submodule is sought, for seeking the distance of all barycentric coodinates in rectangle vertex and intersection, is taken apart from the smallest Barycentric coodinates are as registration point.
Further, iterative method carries out bilinear interpolation sub-pix threshold value in the steel mesh image boundary rectangle extraction module Dividing processing image is specifically divided into following submodule:
Interpolation submodule, for select the transition portion between steel mesh display foreground and background each pixel carry out 10 × 10 interpolation;
Threshold segmentation submodule, for acquiring the threshold value of steel mesh image using iterative method, to the steel mesh image after interpolation into Row threshold division.
Further, autoregistration test is divided into following submodule in the registration test module:
It is registrated dot matrix image and generates submodule, for extracting the connection hole area and again of design profile after affine matrix transformation Heart coordinate generates registration dot matrix image by all barycentric coodinates;
Be registrated intersection submodule, for using 3 selected the first registration points one of them as the center of circle, with RcFor radius picture Circle, wherein Rc=jl, j are the second radius multiple;The value range of j is 1% < j < 10%, preferably j=3%;L is 4 the The distance between two registration points of lie farthest away in one registration point;The focus point acquired in circle and registration dot matrix image intersection is sat Mark, is denoted as the first intersection point set;The focus point coordinate in round and steel mesh dot matrix image intersection is acquired, the second intersection point set is denoted as It closes;
Registration point judging submodule, for successively comparing in the first intersection point set internal coordinate point and the second intersection point set The distance between corresponding position coordinate points, the coordinate points that distance is greater than maximum allowable offset are denoted as registration failed point, if registration loses The number lost a little is greater than registration threshold value, then current the first registration point as the center of circle of judgement is registrated failure, and is denoted as and is unsuccessfully registrated Point;Otherwise current the first registration point as the center of circle of judgement is registrated successfully;Wherein, registration threshold value value range is all intersection points 30% to the 50% of sum, the 40% of preferably all intersection point sums;The value range of maximum allowable offset arrives for 50um 150um, preferably 100um;
It is registrated judging submodule, for repeating step registration intersection submodule and registration point judging submodule until 3 institutes It selects the first registration point all to complete autoregistration test, if the first registration point selected by 3 is all registrated success, is registrated success;Otherwise Registration failure.
In general, through the invention it is contemplated above technical scheme is compared with the prior art, have following technology special Sign and the utility model has the advantages that
(1) minimum circumscribed rectangle using figure of the invention can with arbitrary placement position and angle phase The variation answered, but registration features point and the constant property feature of the absolute minimum range in rectangle vertex, can effectively solve arbitrarily to revolve Turn the influence to registration effect.
(2) dividing between image and image with operation and the automatic search range that increases cleverly is utilized in the present invention Characteristic area greatly reduces the calculation amount and complexity for finding characteristic point.By using iterative method selected threshold and bilinearity The segmentation of interpolation sub-pix ensure that the precision and detection accuracy later of registration.It can be than classics under the premise of guaranteeing accuracy Sub-pixel Edge Detection faster completes contours extract.
(3) technical solution of the present invention in view of practical steel mesh in process there may be stretch and heating power deformation with Other influences for being difficult to expect, by testing the mechanism with adjust automatically registration point and secondary registration automatically, compared to existing Technology registration has higher success rate.
Detailed description of the invention
Fig. 1 is the method for the present invention flow chart;
Fig. 2 design profile file and its minimum circumscribed rectangle and 4 vertex schematic diagrames;
Fig. 3 is the minimum range registration point schematic diagram searched as the center of circle with dot chart intersection using the 1st vertex;
Fig. 4 is steel mesh image sub-pix Threshold segmentation schematic diagram;
Fig. 5 is the steel mesh image arbitrarily put and its minimum circumscribed rectangle and 4 vertex schematic diagrames;
Fig. 6 is the first registration point and potential interference the second registration point schematic diagram in image;
Fig. 7 is partial schematic diagram after steel mesh image is registrated with file;
Fig. 8 is that steel mesh image is registrated failure schematic diagram with file;
Fig. 9 be registrated unsuccessfully tested secondary registration automatically after success schematic diagram;
Figure 10 is that there are the schematic diagrames of hole location offset after steel mesh image is registrated with design document.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and It is not used in the restriction present invention.As long as in addition, technical characteristic involved in the various embodiments of the present invention described below Not constituting a conflict with each other can be combined with each other.
As shown in Figure 1, the method for the present invention process is as follows:
(1) it reads steel mesh and processes Gerber file, the information such as parsing hole site, shape size obtain steel mesh contour vector text Part is simultaneously shown as shown in Figure 2;
It seeks the minimum circumscribed rectangle of entire file area and rectangle upper left, upper right, lower-left, the top of bottom right four is calculated The coordinate of point and the length of rectangle, as shown in rectangle frame in Fig. 2 and 4 dots.The step of seeking the minimum circumscribed rectangle of image are as follows: Successively each column of scan image find the starting point coordinate (x1, y1) of each column target and terminal point coordinate (x2, y2) obtains in this column Barycentric coodinates be (x, y), calculate each column barycentric coodinates (xi, yi) using least square method carry out straight line fitting obtain horizontal master Axis linear equation y=k1x+b1.Row center of gravity and vertical major y=k2x+b2 similarly are asked to each row.Real center of gravity is horizontal main The intersection point of axis and vertical major.The constant downward translation in horizontal spindle direction is kept to find whether straight line intersects with target, last Lower boundary of the linear position of secondary intersection as boundary rectangle.It similarly can be in the hope of the upper and right boundary of boundary rectangle as just Beginning boundary rectangle.Then initial rectangular is rotated by certain direction of rotation and rotation angle interval, finds the smallest external square of area Shape is as preferred target.The mutually perpendicular four edges of rectangle are indicated with linear equation, and the intersection point of straight line is then external square 4 vertex of shape.
(2) intercommunicating pore is extracted according to the method for seeking center of gravity in step (1) to all connection bore regions of design profile file Area and center of gravity coordinate, and barycentric coodinates point generate a width design dot chart, as the dot in Fig. 3 show design Dot chart.
(3) using 4 vertex of rectangle as the center of circle, radius initial value is 10% long picture circle of rectangle, asks friendship with design dot chart Collection, and obtain the point of the barycentric coodinates in intersection.If one times of radius of circle automatic increase, duplicate picture circle asks friendship without intersection Collection is until having focus point in intersection.Barycentric coodinates are sought in intersection at a distance from current rectangle vertex, and take minimum range Corresponding coordinate points are a registration features point.4 registration points nearest with 4 vertex distances of rectangle are obtained, design is denoted as Registration point.As shown in figure 3, quadrant is the circle drawn using top left corner apex as the center of circle, cross corresponding point in figure For with top left corner apex apart from nearest registration point.
(4) bilinear interpolation sub-pix threshold value point is carried out using iterative method to the high contrast steel mesh image that acquisition has been spliced It cuts as shown in Figure 4.The transition portion between steel mesh display foreground and background is selected to carry out interpolation.Thus each pixel is carried out The interpolation of 10*10 carries out Threshold segmentation to the image after interpolation using the calculated threshold value of iterative method.Seek whole image region The length of interior minimum circumscribed rectangle and coordinate and rectangle that four vertex of rectangle are calculated.Such as rectangle frame in Fig. 5 and 4 dots It is shown,
(5) coordinate of the area to the image zooming-out hole after the segmentation of steel mesh sub-pix and center of gravity, all barycentric coodinates points The image for generating a width dot matrix, is denoted as steel mesh dot chart, as shown in Fig. 6 dot.
(6) 4 vertex of image boundary rectangle are the center of circle, and radius initial value is 10% long picture circle of rectangle, with steel mesh dot matrix Figure seeks common ground, and obtains the point of the barycentric coodinates in intersection.If without intersection, one times of radius of circle automatic increase, duplicate picture Circle seeks common ground until having intersection.Barycentric coodinates are sought in intersection at a distance from current rectangle vertex, and take minimum range institute Corresponding coordinate points are a registration features point.Obtain 4 first registration points nearest with 4 vertex distances of rectangle.In Fig. 6 The corresponding point of cross is with top left corner apex apart from nearest registration point.Steel mesh is put in the presence of randomness, and angle tilt is difficult to Avoid, the minimum circumscribed rectangle of image also can with the inclined degree put corresponding change, but most with rectangle vertex distance What the absolute property of small feature focus point was no variation in, thus the method can be adapted for the random inclination of placement angle.
(7) consider steel mesh during cutting processing as the number of open cell content and closeness increase can be cold due to heat expansion Contracting and stretching cause a degree of deformation of global shape.If having neighbor point and rectangle vertex distance near the first registration point It is very close with the first registration point minimum range, then it is backed up using neighbor point as potential interference point, as possible second Registration point.Conduct potential interference point as circle is irised out in Fig. 6 is backed up.
(8) coordinate for finding out 3 the first registration points of 3 design registration points and corresponding position carries out affine transformation, obtains Feature affine matrix.Design profile file by affine matrix convert after displacement, rotation angle and scaling all with steel mesh figure As consistent and coordinate unification.
(9) registration result is tested automatically.To the face of the design profile file drawing holes after step (8) affine transformation Long-pending and center of gravity coordinate, generates all barycentric coodinates points the image of the new dot matrix of one width, is denoted as registration dot chart.With step (8) 3 selected the first registration points are the center of circle in, and a length of radius of 3% rectangle bevel edge draws circle, acquire circle and registration dot matrix image Focus point coordinate in intersection is denoted as the first intersection point set;The focus point coordinate in round and steel mesh dot matrix image intersection is acquired, It is denoted as the second intersection point set;Corresponding position in the first intersection point set internal coordinate point and the second intersection point set is successively compared to sit The distance between punctuate, coordinate points of the distance greater than 100um are denoted as registration failed point, if the number of registration failed point is greater than intersection The 40% of point set internal coordinate point sum, then current the first registration point as the center of circle of judgement is registrated failure, and is denoted as failure and matches On schedule;Otherwise current the first registration point as the center of circle of judgement is registrated successfully;First registration point selected by 3 all completes autoregistration After test, if the first registration point selected by 3 is all registrated success, it is registrated success, as shown in Figure 8;If failure, as shown in fig. 7, First registration point of registration failure is changed to after the second registration point repeatedly autoregistration and tested and continues to be registrated.Images after registration office Portion is as shown in figure 9, obviously can see that steel mesh makes defect by registration result.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention Made any modifications, equivalent replacements, and improvements etc., should all be included in the protection scope of the present invention within mind and principle.

Claims (8)

1. a kind of steel mesh automatic image registration method of surface mounting technology, which is characterized in that method includes the following steps:
(1) steel mesh design profile is obtained by steel mesh design document, seeks design profile minimum circumscribed rectangle, obtain 4, rectangle tops The coordinate of point and the length of rectangle;
(2) area and barycentric coodinates of all intercommunicating pores in design profile are extracted, and generates design dot chart according to barycentric coodinates Picture;
(3) 4 design registration points successively are sought by 4 vertex of rectangle and design dot matrix image;
(4) finished steel net image is acquired, iterative method is reused and carries out bilinear interpolation sub-pix Threshold segmentation processing image;It seeks Image-region minimum circumscribed rectangle and the coordinate on 4 vertex of finished product image boundary rectangle and the length of rectangle are calculated after processing;
(5) area and barycentric coodinates in the steel mesh image connectivity hole after extraction process generates steel mesh dot matrix by all barycentric coodinates Image;
(6) 4 the first registration points successively are sought by 4 vertex of finished product image boundary rectangle and steel mesh dot matrix image;
(7) it is found respectively in steel mesh dot matrix image away from 4 nearest focus points of 4 the first registration points as the second registration point;
(8) 3 the first registration points for choosing 3 design registration points and corresponding position carry out affine transformation, obtain the affine square of feature Battle array, design profile are covered on steel mesh image after being converted by affine matrix;
(9) autoregistration test is carried out to the design profile converted by affine matrix, judges whether to be registrated successfully, if then matching Standard terminates;Otherwise the second registration point that failure registration point is changed to corresponding position is continued to be registrated.
2. a kind of steel mesh automatic image registration method of surface mounting technology according to claim 1, which is characterized in that institute It states registration point finding process in step (3) and step (6) and is divided into following sub-step:
(11) using a vertex of rectangle as the center of circle, with RdIt draws and justifies for radius, wherein Rd=kL, L are the length of rectangle, k first Radius multiple;
(12) round and dot matrix image intersection is asked, judges whether there is focus point in intersection, has, obtain the barycentric coodinates in intersection, And execute step (14);It is no to then follow the steps (13);
(13) k=2k updates radius RdAnd circle is repainted, it executes step (12);
(14) distance for seeking all barycentric coodinates in rectangle vertex and intersection takes apart from the smallest barycentric coodinates as registration point.
3. a kind of steel mesh automatic image registration method of surface mounting technology according to claim 1, which is characterized in that institute It states iterative method progress bilinear interpolation sub-pix Threshold segmentation processing image in step (4) and is specifically divided into following sub-step:
(41) each pixel of the transition portion between steel mesh display foreground and background is selected to carry out 10 × 10 interpolation;
(42) threshold value that steel mesh image is acquired using iterative method carries out Threshold segmentation to the steel mesh image after interpolation.
4. a kind of steel mesh automatic image registration method of surface mounting technology according to claim 1, which is characterized in that institute It states autoregistration test in step (9) and is divided into following sub-step:
(91) the connection hole area and barycentric coodinates for extracting design profile after affine matrix converts, are matched by the generation of all barycentric coodinates Quasi- dot matrix image;
(92) using 3 selected the first registration points one of them as the center of circle, with RcIt draws and justifies for radius, wherein Rc=jl, j second Radius multiple;L is the distance between two registration points of lie farthest away in 4 the first registration points;Acquire circle and registration dot matrix image Focus point coordinate in intersection is denoted as the first intersection point set;The focus point coordinate in round and steel mesh dot matrix image intersection is acquired, It is denoted as the second intersection point set;
(93) it successively compares in the first intersection point set internal coordinate point and the second intersection point set between corresponding position coordinate points Distance, the coordinate points that distance is greater than maximum allowable offset are denoted as registration failed point, if the number of registration failed point is greater than registration threshold Value, then current the first registration point as the center of circle of judgement is registrated failure, and is denoted as unsuccessfully registration point;Otherwise judgement is currently as circle First registration point of the heart is registrated successfully;
(94) it repeats step (92) and (93) first registration point selected by 3 and all completes autoregistration to test, if the selected by 3 One registration point is all registrated success, then is registrated success;Otherwise registration failure.
5. a kind of steel mesh automatic image registration system of surface mounting technology, which is characterized in that the system includes following part:
Design profile boundary rectangle extraction module seeks design profile for obtaining steel mesh design profile by steel mesh design document Minimum circumscribed rectangle obtains the coordinate on 4 vertex of rectangle and the length of rectangle;
Dot matrix image extraction module is designed, for extracting the area and barycentric coodinates of all intercommunicating pores in design profile, and according to Barycentric coodinates generate design dot matrix image;
Registration point extraction module is designed, for successively seeking 4 design registrations by 4 vertex of rectangle and design dot matrix image Point;
Steel mesh image boundary rectangle extraction module reuses iterative method and carries out bilinear interpolation for acquiring finished steel net image Sub-pix Threshold segmentation handles image;It seeks image-region minimum circumscribed rectangle after handling and calculates finished product image boundary rectangle 4 The coordinate on a vertex and the length of rectangle;
Steel mesh dot matrix image extraction module, for the area and barycentric coodinates in the steel mesh image connectivity hole after extraction process, by institute There are barycentric coodinates to generate steel mesh dot matrix image;
First registration point extraction module, for successively seeking 4 by 4 vertex of finished product image boundary rectangle and steel mesh dot matrix image A first registration point;
Second registration point extraction module, for finding 4 weights nearest away from 4 the first registration points respectively in steel mesh dot matrix image The heart o'clock is as the second registration point;
Registration module, 3 the first registration points for choosing 3 design registration points and corresponding position carry out affine transformation, obtain Feature affine matrix, design profile are covered on steel mesh image after being converted by affine matrix;
It is registrated test module, for carrying out autoregistration test to the design profile converted by affine matrix, judges whether to match Quasi- success, if then registration terminates;Otherwise the second registration point that failure registration point is changed to corresponding position is continued to be registrated.
6. a kind of steel mesh automatic image registration system of surface mounting technology according to claim 5, which is characterized in that institute It states registration point finding process in design registration point extraction module and the first registration point extraction module and is divided into following submodule:
Dumpling made of glutinous rice flour module is drawn, for a vertex using rectangle as the center of circle, with RdIt draws and justifies for radius, wherein Rd=kL, L are rectangle Long, k is the first radius multiple;
Seek common ground submodule, for asking the intersection of round and dot matrix image, judges whether there is focus point in intersection, has, obtain intersection Interior barycentric coodinates, and execute and seek registration point submodule;Otherwise it executes and updates dumpling made of glutinous rice flour module;
Dumpling made of glutinous rice flour module is updated, for updating k=2k, updates radius RdAnd circle is repainted, execute the submodule that seeks common ground;
Registration point submodule is sought, for seeking the distance of all barycentric coodinates in rectangle vertex and intersection, is taken apart from the smallest center of gravity Coordinate is as registration point.
7. a kind of steel mesh automatic image registration system of surface mounting technology according to claim 5, which is characterized in that institute Iterative method progress bilinear interpolation sub-pix Threshold segmentation processing image in steel mesh image boundary rectangle extraction module is stated specifically to divide For following submodule:
Interpolation submodule, for selecting each pixel of the transition portion between steel mesh display foreground and background to carry out 10 × 10 Interpolation;
Threshold segmentation submodule carries out threshold to the steel mesh image after interpolation for acquiring the threshold value of steel mesh image using iterative method Value segmentation.
8. a kind of steel mesh automatic image registration system of surface mounting technology according to claim 5, which is characterized in that institute It states autoregistration test in registration test module and is divided into following submodule:
It is registrated dot matrix image and generates submodule, sat for extracting the connection hole area of design profile and center of gravity after affine matrix converts Mark generates registration dot matrix image by all barycentric coodinates;
Be registrated intersection submodule, for using 3 selected the first registration points one of them as the center of circle, with RcIt draws and justifies for radius, In, Rc=jl, j are the second radius multiple;L is the distance between two registration points of lie farthest away in 4 the first registration points;It acquires Focus point coordinate in circle and registration dot matrix image intersection, is denoted as the first intersection point set;Round and steel mesh dot matrix image is acquired to hand over Focus point coordinate in collection is denoted as the second intersection point set;
Registration point judging submodule, it is corresponding in the first intersection point set internal coordinate point and the second intersection point set for successively comparing The distance between position coordinates point, the coordinate points that distance is greater than maximum allowable offset are denoted as registration failed point, if registration failed point Number be greater than registration threshold value, then first registration point registration of the judgement currently as the center of circle fails, and is denoted as unsuccessfully registration point;It is no Then current the first registration point as the center of circle of judgement is registrated successfully;
It is registrated judging submodule, first is matched selected by 3 for repeating to be registrated intersection submodule and registration point judging submodule Autoregistration test is all completed on schedule, if the first registration point selected by 3 is all registrated success, is registrated success;Otherwise registration failure.
CN201611187643.7A 2016-12-20 2016-12-20 A kind of steel mesh automatic image registration method and system of surface mounting technology Active CN106815832B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611187643.7A CN106815832B (en) 2016-12-20 2016-12-20 A kind of steel mesh automatic image registration method and system of surface mounting technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611187643.7A CN106815832B (en) 2016-12-20 2016-12-20 A kind of steel mesh automatic image registration method and system of surface mounting technology

Publications (2)

Publication Number Publication Date
CN106815832A CN106815832A (en) 2017-06-09
CN106815832B true CN106815832B (en) 2019-05-21

Family

ID=59109099

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611187643.7A Active CN106815832B (en) 2016-12-20 2016-12-20 A kind of steel mesh automatic image registration method and system of surface mounting technology

Country Status (1)

Country Link
CN (1) CN106815832B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108416773A (en) * 2018-03-08 2018-08-17 凌云光技术集团有限责任公司 A kind of the PCB aperture method of inspection and system of the over-determined systems based on registration point
CN108986181B (en) * 2018-06-15 2023-05-26 广东数相智能科技有限公司 Dot-based image processing method, device and computer readable storage medium
CN110766735B (en) 2019-10-21 2020-06-26 北京推想科技有限公司 Image matching method, device, equipment and storage medium
CN113242652B (en) * 2021-05-20 2022-04-01 上海望友信息科技有限公司 Spraying graph generation method and system, electronic equipment and storage medium
CN113888558B (en) * 2021-09-26 2024-05-28 武汉钢铁有限公司 Ladle slag surface image correction method
CN114429416B (en) * 2022-02-21 2024-06-21 合肥龙旗智能科技有限公司 Method, device, system and equipment for processing attachment of dial plate and bezel

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103177444A (en) * 2013-03-08 2013-06-26 中国电子科技集团公司第十四研究所 Automatic SAR (synthetic-aperture radar) image rectification method
CN103778626A (en) * 2013-12-31 2014-05-07 北京理工大学 Quick image registration method based on visual remarkable area
CN103854276A (en) * 2012-12-04 2014-06-11 株式会社东芝 Image registration device and method, image segmentation device and method and medical image device
CN104318568A (en) * 2014-10-24 2015-01-28 武汉华目信息技术有限责任公司 Method and system for image registration
CN104463866A (en) * 2014-12-04 2015-03-25 无锡日联科技有限公司 Local shape matching method based on outline random sampling
CN105389815A (en) * 2015-10-29 2016-03-09 武汉联影医疗科技有限公司 Breast image registration method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103854276A (en) * 2012-12-04 2014-06-11 株式会社东芝 Image registration device and method, image segmentation device and method and medical image device
CN103177444A (en) * 2013-03-08 2013-06-26 中国电子科技集团公司第十四研究所 Automatic SAR (synthetic-aperture radar) image rectification method
CN103778626A (en) * 2013-12-31 2014-05-07 北京理工大学 Quick image registration method based on visual remarkable area
CN104318568A (en) * 2014-10-24 2015-01-28 武汉华目信息技术有限责任公司 Method and system for image registration
CN104463866A (en) * 2014-12-04 2015-03-25 无锡日联科技有限公司 Local shape matching method based on outline random sampling
CN105389815A (en) * 2015-10-29 2016-03-09 武汉联影医疗科技有限公司 Breast image registration method and device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于机器视觉的SMT钢网质量检测技术研究;刘今越 等;《仪器仪表学报》;20090630;第30卷(第6期);第431-434页
基于轮廓特征的目标匹配算法研究;杨林杰;《中国优秀硕士学位论文全文数据库 信息科技辑》;20160815;第2016年卷(第8期);第I138-I340页

Also Published As

Publication number Publication date
CN106815832A (en) 2017-06-09

Similar Documents

Publication Publication Date Title
CN106815832B (en) A kind of steel mesh automatic image registration method and system of surface mounting technology
CN106340044B (en) Join automatic calibration method and caliberating device outside video camera
CN104268857B (en) A kind of fast sub-picture element rim detection and localization method based on machine vision
CN104981105B (en) A kind of quickly accurate detection and method for correcting error for obtaining element central and deflection angle
CN114897864B (en) Workpiece detection and defect judgment method based on digital-analog information
CN101493942B (en) Level set image segmentation method based on spacing moment
CN110246100B (en) Image restoration method and system based on angle sensing block matching
CN102496161B (en) Method for extracting contour of image of printed circuit board (PCB)
CN115170669B (en) Identification and positioning method and system based on edge feature point set registration and storage medium
CN107369204B (en) Method for recovering basic three-dimensional structure of scene from single photo
CN108921864A (en) A kind of Light stripes center extraction method and device
CN111354047B (en) Computer vision-based camera module positioning method and system
CN106846352A (en) A kind of edge of a knife image acquisition method and device for camera lens parsing power test
CN104751458B (en) A kind of demarcation angular-point detection method based on 180 ° of rotation operators
CN108447094B (en) Method and system for estimating attitude of monocular color camera
CN110322403A (en) A kind of more supervision Image Super-resolution Reconstruction methods based on generation confrontation network
CN108966500A (en) The pcb board of view-based access control model tracking is secondary and multiple accurate drilling method
CN105701776A (en) Lens distortion correcting method and system used for automatic optical detection
CN104574312A (en) Method and device of calculating center of circle for target image
CN103778607B (en) A kind of method for correcting image
CN105354816B (en) Electronic component positioning method and device
CN110807459A (en) License plate correction method and device and readable storage medium
CN114998571B (en) Image processing and color detection method based on fixed-size markers
CN114419045A (en) Method, device and equipment for detecting defects of photoetching mask plate and readable storage medium
CN103236056B (en) Based on the image partition method of template matches

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant