CN103544473A - Electronic connector detection method based on machine vision - Google Patents
Electronic connector detection method based on machine vision Download PDFInfo
- Publication number
- CN103544473A CN103544473A CN201310426395.7A CN201310426395A CN103544473A CN 103544473 A CN103544473 A CN 103544473A CN 201310426395 A CN201310426395 A CN 201310426395A CN 103544473 A CN103544473 A CN 103544473A
- Authority
- CN
- China
- Prior art keywords
- image
- copper core
- detection method
- theta
- punching press
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Image Analysis (AREA)
Abstract
The invention discloses an electronic connector detection method based on machine vision, and belongs to the technical field of computer program design comprising image acquisition, analysis and processing. Actual targeted images are processed by various methods of image smoothing, image segmentation, image matching, edge extraction and color recognition, complete geometrical characteristics of defects of the electronic connector are acquired, and automatic detection can be realized. According to experiments, system detecting results is consistent with visual detecting results, accuracy of the detection is guaranteed, and detecting efficiency of the electronic connector is improved greatly.
Description
Technical field
The invention belongs to the technical field of computer programming, relate in particular to the electric power connector context of detection of machine vision.
Background technology
Electric power connector is a kind of organ with Electric connection characteristic, its major function is between device and assembly, assembly and rack, system and subsystem, to play a part electrical connection and signal transmission, is to form circuitry system electrical to connect one of requisite base components.It has been widely used in the fields such as aviation/space flight, military equipment, communication, computing machine, automobile, industry, household electrical appliance, and existing oneself develops into one of mainstay industry of current electronics and information infrastructure product.
In recent years along with low-cost area is shifted in Consumption of China electronics, network design, telecom terminal product output rapid growth and the production of world's electric power connector element, global link device productive capacity constantly shifts to China, at present, oneself increases fast and the most maximum market through becoming global link device China, and the Si great connector company of whole world maximum has all set up factory in China's Mainland successively since 20 end of the centurys.
With Guangdong Wei Li, the said firm of company of Electronics Factory, be mainly engaged in and produce various electric power connectors, the electric power connector great majority of its production export to abroad for automobile making, therefore very high to the quality requirements of electric power connector.In order to guarantee the quality of electric power connector, the said firm has dropped into a big chunk human and material resources in the quality testing of electric power connector, therefore develop a set of electric power connector detection system based on machine vision the human and material resources of saving to a great extent the said firm are enhanced productivity simultaneously, promote the automated process of the sector.
Electric power connector is of a great variety, be mainly because electric wire and splicing ear of a great variety, but manufacture process is consistent substantially, generally can be divided into three phases: stripping glue, punching press, assembling.
Stripping glue: the rubber at electric wire two ends is peeled off, exposed copper core bundle;
Punching press: splicing ear is stamped into electric wire two ends;
Assembling: the good electric wire of punching press is inserted on plastics cassette holder.
In the process of stripping glue, copper core may be cut off to the electric conductivity have influence on connector, in the process of punching press, splicing ear is easy to that punching press is not in place or punching press is bad, has influence on the quality of connector.If have sequence requirement (electric wire of the corresponding particular color of each jack) in the process of assembling, before must make correct judgement to the color of electric wire.
Summary of the invention
The present invention is mainly in order to replace artificial vision to check product quality by machine vision, thereby saves more human and material resources, enhances productivity.
An electric power connector detection method for machine vision, comprise image collection, number copper core, whether punching press puts in place and differentiates electric wire color to detect splicing ear.
When several copper core, first by the profile of copper core area of beam, obtain the approximate region of copper core bundle, then by fixed threshold method, copper core bundle is split and stretch processing is carried out in the region splitting, spacing between copper core and copper core is widened, finally the image after stretching is cut apart with watershed segmentation algorithm.
When detecting splicing ear punching press put in place, first by determining based on the relevant Fast Match Algorithm of normalizing eliminate indigestion, need the station that detects, then by extracting edge, judge that connection works as side-play amount and the deflection angle of front terminal, whether punching press puts in place.
When differentiating electric wire color, first build the neural network of three layers and train, then by the sorter of training, electric wire color is differentiated.
Its main functional module can be divided into 3 aspects:
1, visual information collection: gather original visual information by visual information acquisition system (camera, camera lens, light source etc.), for ensuing Vision information processing and analysis are prepared.
2, Vision information processing and analysis: according to the concrete feature of product and actual production environment, by studying following correlation technique content, comprise: pre-service, the image of visual pattern cut apart, images match, feature extraction, pattern discrimination etc., propose effective technical scheme, thereby judge that whether current production quality is qualified.
3, synchronize with Machinery Control System: detection system coordinates with Machinery Control System, thereby complete more rationally and effectively whole production run.
The workflow of system, after the cementing bundle of stripping, by one group of collecting device, gather present image, then by the processing of present image and analysis have been judged whether to copper core is cut off, and judged result is fed back to Machinery Control System, last Machinery Control System is according to the result decision-making of feedback, execution corresponding actions.After stamped terminals finishes, by another group collecting device, gather present image, then by Treatment Analysis judge splicing ear whether punching press put in place and electric wire color whether correct, and judged result is fed back to Machinery Control System to make next step action.
Beneficial effect of the present invention is:
1. built the electric power connector detection method framework based on machine vision, for the Machine Vision Detection of multitude of different ways is laid a good foundation;
2. in order to count accurately the number of copper core, the present invention utilizes watershed algorithm combining image stretching scheduling algorithm to Image Segmentation Using, makes segmentation effect more accurate.
3. in order accurately judge terminal, whether punching press puts in place, and first the present invention needs by determining based on the relevant Fast Match Algorithm of normalizing eliminate indigestion the station that detects, and whether punching press puts in place then by extraction edge, to judge splicing ear.Its fast operation, accuracy of judgement.
4. in order accurately to judge the color of electric wire, first the present invention builds the neural network of three layers and trains, and then by the sorter of training, electric wire color is differentiated.
The technology providing by us, our designed system has reached the object that improves the accuracy rate of eye state analysis and the speed of whole fatigue detecting.
Accompanying drawing explanation
The workflow of Fig. 1 system;
Fig. 2 copper core segmentation effect figure;
The three-layer neural network figure that Fig. 3 builds.
Embodiment
When several copper core, first we obtain the approximate region of copper core bundle by the profile of copper core area of beam, and using this region as area-of-interest.Then by fixed threshold method, copper core bundle is split, stretch processing is carried out in the region splitting, the spacing between copper core and copper core is widened, for preparing ensuing cutting apart.Image after stretching is cut apart to (as shown in Figure 2) with watershed segmentation algorithm.Watershed segmentation method, it is a kind of dividing method of the mathematical morphology based on topological theory, its basic thought is that image is regarded as to a pair " topomap ", wherein the more intense regional pixel value of brightness is larger, and darker regional pixel value is smaller, by finding " ”He“ watershed divide, catchment basin boundary ", to Image Segmentation Using.Watershed algorithm is often to connect together to be difficult to cut apart this class problem for the treatment of the target object in image, and conventionally can obtain reasonable effect.Cut apart after end, if still have not separated copper core bundle, by area, judge.
When detecting bonder terminal punching press puts in place, first first we adopted the Fast Match Algorithm based on normalizing eliminate indigestion relevant (NCC), and matching score is the normalized crosscorrelation coefficient between masterplate image t and image i to be matched:
Wherein n is pixel number, m
tand m
ibe respectively the average of masterplate image and image to be matched,
with
be respectively the variance of masterplate image and image to be matched.Allow image to be detected mate to obtain corresponding deflection angle and displacement with template image.
Normalized crosscorrelation (NCC) is used as estimating of 2 image similarities conventionally.The advantage of normalized crosscorrelation is insensitive to the illumination change in 2 width images.In order to improve the speed of coupling, this project is first converted to gray-scale map by colored RGB image, and then mates.Compare with the matching algorithm based on shape, the image matching algorithm based on normalizing eliminate indigestion relevant (NCC) more has superiority in this project.Because the matching algorithm based on shape mates by profile, and the profile of splicing ear more complicated often, this can make matching score very low conventionally.In addition, due to often deflection to some extent of splicing ear, so that coupling is often inaccurate.
By mating us, can obtain side-play amount and the deflection angle when front terminal, the side-play amount that utilization obtains and deflection angle are done affined transformation to photo current just can be made it the terminal correction in present image to align with the terminal in template image.
When side-play amount and the deflection angle of front terminal, the side-play amount of establishing in horizontal direction and vertical direction is respectively dx and dy, and deflection angle is θ, and the pixel (x, y) of original image is transformed to through affined transformation
?
Due to the regional location that has needed in clear and definite template image before this project to detect when creating masterplate, so in present image, the detection position of terminal has also just been determined.Location adopts different detection methods for different surveyed areas after finishing.
Detect splicing ear whether punching press to put in place be mainly that length by judgement copper core realizes, due to some gap often between copper core, these gap incident lights are difficult to therefrom reflect, and copper core is metal material, more intense to reflection of light ability, what therefore in image, show is chequered with black and white striped.For this feature, we adopt the method for edge extracting to extract the edge that direction is consistent with copper core direction, owing to having corresponding relation between edge and copper core, therefore can judge that by the edge extracting whether copper core is long or too short.The method of extracting edge is a lot, for example Roberts operator:
Sobel operator:
Deng, comparing Canny with them uses strict mathematical method to analyze this problem, the best edge of deriving by 4 linear combination of exponential functions forms extracts operator net, the essence of its algorithm is to do level and smooth computing with an accurate Gaussian function, then with the single order differential location derivative maximal value with direction, Canny operator edge detection is a kind of practical edge detection operator, has good rim detection performance.Canny edge detection method utilizes the single order differential of Gaussian function, and it can obtain good balance between squelch and rim detection.Here we adopt Canny operator extraction edge.
When judgement electric wire color, we have adopted the neural network of multilayer perceptron to carry out color classification.Neural network is that a kind of application class is similar to the mathematical model that structure that cerebral nerve cynapse connects is carried out information processing.Neural network is a kind of operational model, by a large amount of node (or claim neuron) and between be coupled to each other formation.Each node represents a kind of specific output function, is called excitation function.Every two internodal connections all represent that one is referred to as weight for by the weighted value of this connection signal, and this is equivalent to the memory of artificial neural network.The output of network is according to the connected mode of network, the difference of weighted value and excitation function and difference.And network self is all to the approaching of certain algorithm of nature or function conventionally, may be also the expression to a kind of logic strategy.
First we build the neural network (as shown in Figure 3) of three layers, and input node has three, is respectively the RGB three-component of color, and implicit this project of node is made as 20, the kind number that output node number is all colours, the numbering that Output rusults is color.
Then the sample learning by some show that a desirable neural network identifies for ensuing color.Study is an important content of neural network research, and its adaptability realizes by study.According to the variation of environment, weights are adjusted, improve the behavior of system.Effectively learning algorithm, makes neural network to construct the intrinsic representation of objective world by connecting the adjustment of weights, forms characteristic information processing method, and information Storage and Processing is embodied in the connection of network.Different according to academic environment, the mode of learning of neural network can be divided into supervised learning and unsupervised learning.Here we adopt supervised learning mode, in supervised learning, the data of training sample are added to network input end, corresponding desired output is compared with network output simultaneously, obtain error signal, with this, control the adjustment of weights strength of joint, through repeatedly converging to definite weights after training.When sample situation changes, through study, can revise weights to adapt to new environment.
Claims (3)
1. the electric power connector detection method based on machine vision, comprise image collection, number copper core, whether punching press puts in place and differentiates electric wire color to detect splicing ear, it is characterized in that:
When several copper core, first by the profile of copper core area of beam, obtain the approximate region of copper core bundle, then by fixed threshold method, copper core bundle is split and stretch processing is carried out in the region splitting, spacing between copper core and copper core is widened, finally the image after stretching is cut apart with watershed segmentation algorithm;
When detecting splicing ear punching press put in place, first by determining based on the relevant Fast Match Algorithm of normalizing eliminate indigestion, need the station that detects, then by extracting edge, judge that connection works as side-play amount and the deflection angle of front terminal, whether punching press puts in place;
When differentiating electric wire color, first build the neural network of three layers and train, then by the sorter of training, electric wire color is differentiated.
2. detection method according to claim 1, is characterized in that based on the relevant Fast Match Algorithm of normalizing eliminate indigestion, and matching score is the normalized crosscorrelation coefficient between masterplate image t and image i to be matched:
3. detection method according to claim 1, it is characterized in that side-play amount and deflection angle when front terminal, the side-play amount of establishing in horizontal direction and vertical direction is respectively dx and dy, and deflection angle is θ, the pixel (x, y) of original image is transformed to through affined transformation
?
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310426395.7A CN103544473B (en) | 2013-09-17 | 2013-09-17 | A kind of electronic connector detection method based on machine vision |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310426395.7A CN103544473B (en) | 2013-09-17 | 2013-09-17 | A kind of electronic connector detection method based on machine vision |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103544473A true CN103544473A (en) | 2014-01-29 |
CN103544473B CN103544473B (en) | 2016-09-07 |
Family
ID=49967908
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310426395.7A Expired - Fee Related CN103544473B (en) | 2013-09-17 | 2013-09-17 | A kind of electronic connector detection method based on machine vision |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103544473B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105300280A (en) * | 2015-09-30 | 2016-02-03 | 广州超音速自动化科技股份有限公司 | Connector dimension vision measurement method |
CN107730492A (en) * | 2017-10-16 | 2018-02-23 | 东莞早川电子有限公司 | A kind of data wire connecting portion and the visible detection method of color matching |
CN107895362A (en) * | 2017-10-30 | 2018-04-10 | 华中师范大学 | A kind of machine vision method of miniature binding post quality testing |
CN108693441A (en) * | 2018-04-16 | 2018-10-23 | 华北电力大学(保定) | A kind of electric transmission line isolator recognition methods and system |
CN109060832A (en) * | 2018-07-05 | 2018-12-21 | 上海徕木电子股份有限公司 | A kind of electric power connector contact pin defective workmanship visible detection method |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7738702B2 (en) * | 2004-12-17 | 2010-06-15 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method capable of executing high-performance processing without transmitting a large amount of image data to outside of the image processing apparatus during the processing |
CN101825451A (en) * | 2009-03-06 | 2010-09-08 | 上海辰铁工业自动化设备有限公司 | Detecting device for electronic connector |
-
2013
- 2013-09-17 CN CN201310426395.7A patent/CN103544473B/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7738702B2 (en) * | 2004-12-17 | 2010-06-15 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method capable of executing high-performance processing without transmitting a large amount of image data to outside of the image processing apparatus during the processing |
CN101825451A (en) * | 2009-03-06 | 2010-09-08 | 上海辰铁工业自动化设备有限公司 | Detecting device for electronic connector |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105300280A (en) * | 2015-09-30 | 2016-02-03 | 广州超音速自动化科技股份有限公司 | Connector dimension vision measurement method |
CN105300280B (en) * | 2015-09-30 | 2018-06-01 | 广州超音速自动化科技股份有限公司 | Connector size vision measuring method |
CN107730492A (en) * | 2017-10-16 | 2018-02-23 | 东莞早川电子有限公司 | A kind of data wire connecting portion and the visible detection method of color matching |
CN107895362A (en) * | 2017-10-30 | 2018-04-10 | 华中师范大学 | A kind of machine vision method of miniature binding post quality testing |
CN107895362B (en) * | 2017-10-30 | 2021-05-14 | 华中师范大学 | Machine vision method for detecting quality of miniature wiring terminal |
CN108693441A (en) * | 2018-04-16 | 2018-10-23 | 华北电力大学(保定) | A kind of electric transmission line isolator recognition methods and system |
CN109060832A (en) * | 2018-07-05 | 2018-12-21 | 上海徕木电子股份有限公司 | A kind of electric power connector contact pin defective workmanship visible detection method |
Also Published As
Publication number | Publication date |
---|---|
CN103544473B (en) | 2016-09-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105718945B (en) | Apple picking robot night image recognition method based on watershed and neural network | |
CN109118479A (en) | Defects of insulator identification positioning device and method based on capsule network | |
CN111611874B (en) | Face mask wearing detection method based on ResNet and Canny | |
CN103544473B (en) | A kind of electronic connector detection method based on machine vision | |
CN106971152A (en) | A kind of method of Bird's Nest in detection transmission line of electricity based on Aerial Images | |
CN108985170A (en) | Transmission line of electricity hanger recognition methods based on Three image difference and deep learning | |
CN103473571A (en) | Human detection method | |
CN111401188B (en) | Traffic police gesture recognition method based on human body key point characteristics | |
CN113205063A (en) | Visual identification and positioning method for defects of power transmission conductor | |
CN112966736B (en) | Vehicle re-identification method based on multi-view matching and local feature fusion | |
CN110647875A (en) | Method for segmenting and identifying model structure of blood cells and blood cell identification method | |
CN108876781A (en) | Surface defect recognition method based on SSD algorithm | |
CN101726498B (en) | Intelligent detector and method of copper strip surface quality on basis of vision bionics | |
CN103440035A (en) | Gesture recognition system in three-dimensional space and recognition method thereof | |
CN102184404B (en) | Method and device for acquiring palm region in palm image | |
CN108960142B (en) | Pedestrian re-identification method based on global feature loss function | |
CN103456013A (en) | Method for expressing ultrapixels and measuring similarity between ultrapixels | |
CN108734691A (en) | A kind of transmission line of electricity defect image recognition methods | |
CN111402224A (en) | Target identification method for power equipment | |
CN108960412A (en) | Image-recognizing method, device and computer readable storage medium | |
CN103673991B (en) | Based on the electric power connector manufacture process monitoring method of machine vision | |
Liu et al. | Development of a machine vision algorithm for recognition of peach fruit in a natural scene | |
CN112560880A (en) | Object classification method, object classification apparatus, and computer-readable storage medium | |
CN103034868B (en) | Classification method aiming at small sample and high dimensional images | |
CN105160285A (en) | Method and system for recognizing human body tumble automatically based on stereoscopic vision |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160907 Termination date: 20180917 |