CN103325106A - Moving workpiece sorting method based on LabVIEW - Google Patents

Moving workpiece sorting method based on LabVIEW Download PDF

Info

Publication number
CN103325106A
CN103325106A CN2013101293679A CN201310129367A CN103325106A CN 103325106 A CN103325106 A CN 103325106A CN 2013101293679 A CN2013101293679 A CN 2013101293679A CN 201310129367 A CN201310129367 A CN 201310129367A CN 103325106 A CN103325106 A CN 103325106A
Authority
CN
China
Prior art keywords
workpiece
algorithm
workpieces
camera
mechanical arm
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013101293679A
Other languages
Chinese (zh)
Other versions
CN103325106B (en
Inventor
徐建明
朱海涛
何德峰
张健
陈张雷
陆群
丁毅
杨金桥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University of Technology ZJUT
Original Assignee
Zhejiang University of Technology ZJUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University of Technology ZJUT filed Critical Zhejiang University of Technology ZJUT
Priority to CN201310129367.9A priority Critical patent/CN103325106B/en
Publication of CN103325106A publication Critical patent/CN103325106A/en
Application granted granted Critical
Publication of CN103325106B publication Critical patent/CN103325106B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Manipulator (AREA)
  • Image Analysis (AREA)

Abstract

Provided is a moving workpiece sorting method based on LabVIEW. The moving workpiece sorting method based on the LabVIEW comprises the following steps of (1) an image processing algorithm for video streams, wherein the image processing algorithm for the video stream is used for detecting the positions and the postures of moving workpieces from collected video, (2) a calibration algorithm for a camera, wherein the calibration algorithm for the camera is used for converting pixel coordinates of the moving workpieces in images of the camera into physical coordinates of the workpieces in a world coordinate system, (3) a correction algorithm for radial distortion of the camera, wherein the correction algorithm for the radial distortion of the camera is used for eliminating radial distortion of images introduced by a wide-angle lens, (4) a Kalman prediction algorithm, wherein the Kalman prediction algorithm is used for carrying out prediction on the positions of the moving workpieces to obtain the workpiece positions without the time lag, (5) a workpiece type recognition algorithm, wherein when the workpieces are conveyed through a conveyor belt, the camera collects the images of the workpieces, recognition is carried out on the types of the workpieces, and classification is facilitated, and (6) a motion control method for a mechanical arm, wherein the motion control method for the mechanical arm comprises a track planning method and a track control method, and the mechanical arm can select an optimal path to rapidly sort the workpieces.

Description

Moving Workpieces method for sorting based on LabVIEW
Technical field
This patent relates to the method for sorting technical field based on machine vision, relates in particular to a kind of visible detection method and product sorting method.
Background technology
Mechanical arm is as a new technology that occurs in the automation field, and its great function also just progressively is familiar with by people: the first, mechanical arm can replace part manually to finish some repeated manual labors; The second, mechanical arm can fulfil assignment fast according to the predefined flow high efficiency of people; Three, mechanical arm has improved workman's working condition greatly, raises labour productivity significantly, has accelerated the paces of industrial production automation.
Along with the fast development of economy, competition among enterprises is more and more fierce, and for raising the efficiency, reducing production costs, travelling belt is widely used.Travelling belt is widely used in industrial production system, and the labour has not only been saved in the application of travelling belt, has improved production efficiency, and has reduced production cost, has brought into play huge effect in commercial production.No matter be that carrying, assembling, workpiece quality detect and all need first target to be grasped, therefore, the classification crawl function of target on the travelling belt there is very high demand.
Traditional industrial robot generally adopts the mode of teaching or off-line programing that processing tasks is carried out path planning and movement programming, the action that just repeats simply in the process to programme in advance and set, therefore traditional industrial robot control technology can't sort Moving Workpieces.
Summary of the invention
A purpose of this patent provides the Moving Workpieces detection method that a kind of accuracy of detection is high, can adapt to the illumination condition variation.
Another purpose of this patent provide a kind of automaticity high, can realize than multiple types workpiece classification, workpiece method for sorting that reliability is higher.
The Moving Workpieces method for sorting of this patent may further comprise the steps:
1) image processing algorithm of video flowing detects position and the attitude of workpiece the motion in the middle of the video that gathers with this algorithm;
2) calibration algorithm of video camera is converted into the pixel coordinate of Moving Workpieces in camera review with this calibration algorithm the physical coordinates of workpiece in the world coordinate system.
3) the Lens Distortion Correction algorithm of video camera is in order to eliminate the radial distortion of the image of introducing because of wide-angle lens.
4) Kalman Prediction algorithm is predicted in order to the position to Moving Workpieces, obtains the location of workpiece without time lag.
5) the type identification algorithm of workpiece, when workpiece from the travelling belt through out-of-date, the camera acquisition workpiece image is identified the workpiece type, is convenient to classification.
6) motion control method of mechanical arm comprises method for planning track, and method for controlling trajectory makes mechanical arm can select optimal path, sorts rapidly workpiece.
Wherein, the algorithm of image processing comprises the extraction of moving target, the attitude detection of Moving Workpieces.This patent adopts the background subtraction point-score to obtain the image coordinate of Moving Workpieces.The background subtraction point-score is a kind of method that adopts present frame in the image sequence and reference background model relatively to detect moving object, and its performance depends on employed background modeling technology.Because background model is constantly being upgraded, so it can adapt to the variation of light, and general threshold method must change its threshold value when light environment changes.Definition image (x, y) is present frame, and acc (x, y) is background model, and frimage (x, y) is the prospect frame, and α is the context update rate, and its scope is 0-1, and acc (x, y) is initialized as 0.
acc ( x , y ) = α * image ( x , y ) + ( 1 - α ) * acc ( x , y )
frimage ( x , y ) = image ( x , y ) - acc ( x , y )
According to the foreground image that separates, detect the location of workpiece at last.The attitude detection of Moving Workpieces is processed by gray scale first, seeks at the selected detection side Grad that makes progress to surpass the point of threshold value again, and these points are carried out fitting a straight line, calculates angle.
Wherein, the calibration algorithm of video camera is mainly for the demarcation of monocular two-dimensional visual system.Video camera is installed perpendicular to working face.World coordinate system is positioned on the working face, and the Z axis vertical plane is downward, and only there are translation relation in camera coordinate system and world coordinate system without spin, so rotation matrix R=I (unit matrix) and translation matrix P=[0 0 d are arranged] T, d is camera optical axis central point O cDistance to working face.
x c y c z c 1 = R P 0 1 x w y w z w 1 = x w y w d 1
In the formula: (x c, y c, z c) be the coordinate of scene point under camera coordinate system, (x w, y w, z w) be the coordinate of scene point under world coordinate system.Can obtain the coordinate of scene point under camera coordinate system by following formula, be easy to get x c=x w, y c=y w, the coordinate z of Moving Workpieces on working face w=0.
u v 1 = k x 0 u 0 0 k y v 0 0 0 1 x c / z c y c / z c 1
k xd = u 2 - u 1 x w 2 - x w 1 k yd = v 2 - v 1 y w 2 - y w 1
Wherein (u, v) is the image coordinate of reference point; (u 1, v 1) be a P 1Image coordinate, (x W1, y W1) be a some P 1The two-dimensional world coordinate; (u 2, v 2) be a P 2Image coordinate, (x W2, y W2) be a some P 2The two-dimensional world coordinate; (u 0, v 0) be the image coordinate at camera optical axis center; k Xd=k xD, k Yd=k yD is the camera parameters that calibrates.
x wi = x w 1 + ( u i - u 1 ) / k xd y wi = y w 1 + ( v i - v 1 ) / k yd
In the formula: (u i, v i) be any point P iImage coordinate, (x Wi, y Wi) be a some P iThe two-dimensional world coordinate.
Wherein, because wide-angle camera has distortion, and wherein obvious with radial distortion, so we carry out Lens Distortion Correction to camera.Simulated the radial distortion matrix of video camera in this patent with the method for linear regression (LR).The distortion equation of given first radial distortion:
u ′ = a 00 + a 10 u + a 01 v + a 11 uv + a 20 u 2 + a 02 v 2 v ′ = b 00 + b 10 u + b 10 v + b 11 uv + b 20 u 2 + b 02 v 2
u ′ v ′ = a 00 a 10 a 01 a 11 a 20 a 02 b 00 b 10 b 01 b 11 b 20 b 02 1 u v uv u 2 v 2
In the formula: (u, v) is the image coordinate of reference point, and (u', v') is the image coordinate behind the reference point distortion correction, a St, b StBe correction coefficient, s, t=0,1,2.
Wherein, the speed of Moving Workpieces is unknown, and position prediction adopts the Kalman Prediction algorithm.Gather respectively two two field pictures, interval 1s, the changes delta x of the location of workpiece is estimated velocity amplitude.Set up system model, then the Moving Workpieces two-dimensional world coordinate that calculates with above-described scaling method is as the position detection value, simultaneously with the speed that estimates as velocity measurement, form observation vector, calculate Kalman filter to the optimum prediction value of workpiece motion s state.
Wherein, the type identification of workpiece will gather the sample of various workpiece, and each sample is carried out feature detection, and the training shapes model, sets up the workpiece sample database.Then clarification of objective in the area-of-interest (ROI) of realtime graphic is detected, and mate with model in the database, calculate matching value, choose the highest result of matching value as the output of sorter.
Wherein, the motion control method of mechanical arm comprises trajectory planning, the TRAJECTORY CONTROL of mechanical arm, the crawl of electronic jaw control.The mechanical arm controller carries out trajectory planning according to the Work position information of host computer prediction to mechanical arm, and the control mechanical arm is adjusted the jaw attitude simultaneously by the expectation orbiting motion, the Moving Workpieces on the crawl travelling belt.Last as requested dissimilar workpiece the classification puts, and then carries out the sorting of next round workpiece.
Description of drawings
Fig. 1 is method of difference context update schematic diagram;
Fig. 2 is workpiece sorter schematic diagram;
Fig. 3 is the theory diagram of Kalman Prediction system;
Fig. 4 is predicted position and observation position Relations Among figure;
Fig. 5 is predicted position and observation position Error Graph.
Fig. 6 is mechanical arm servocontrol trajectory planning schematic diagram.
Fig. 7 is mechanical arm servocontrol process flow diagram.
Embodiment
Be further described below in conjunction with the technical scheme of drawings and Examples to this patent.
Embodiment:
Adopt the background subtraction point-score to extract moving target and at first will carry out modeling to background.Background model is constantly updated, just can be adapted to the variation of ambient light.Fig. 1 is the context update schematic diagram of system, and background frames upgrades according to the loop iteration in the schematic diagram.
acc ( x , y ) = α * image ( x , y ) + ( 1 - α ) * acc ( x , y )
frimage ( x , y ) = image ( x , y ) - acc ( x , y )
Wherein image (x, y) is present frame, and acc (x, y) is background model, and frimage (x, y) is the prospect frame, and α is the context update rate, chooses α=0.15, and acc (x, y) is initialized as 0.According to the foreground image that separates, detect the location of workpiece at last.
The attitude detection of workpiece is carried out colour picture first the gray scale processing, and the ultimate range that measuring workpieces vertical direction and horizontal direction are shared judges that the attitude of workpiece is tending towards vertically or level.If be tending towards then rim detection from left to right of vertical attitude; If be tending towards then rim detection from top to bottom of horizontal attitude.Rim detection need to detect the point that on selected direction Grad surpasses threshold value, again these points is carried out fitting a straight line, calculates angle.
Workpiece identification on the streamline requires to provide at short notice classification results, the shape of workpiece, and Texture eigenvalue is relatively simple, therefore, directly carries out Model Matching, the schematic diagram of sorter such as Fig. 2 in top view.
At first, the sample of the various workpiece of input carries out feature detection to each sample in the pattern of LabVIEW classify program, and the training shapes model, sets up the workpiece sample database.Then clarification of objective in the area-of-interest (ROI) of realtime graphic is detected, and mate with model in the database, calculate matching value, choose the highest result of matching value as the output of sorter.
Distortion correction implementation process: in order to calculate 12 parameters in the Method for Camera Radial Distortion matrix, need at least the image coordinate of 6 point calibrations front and back.Gather a scaling board picture, threshold value is set, reference point can be detected, we select 12 points of required correcting area, record respectively its image coordinate (u i, v i) and (u i', v i'), i=1~12 see Table, and the equation shown in the formula composed as follows solves parameter a, b.
u ′ v ′ = a 00 a 10 a 01 a 11 a 20 a 02 b 00 b 10 b 01 b 11 b 20 b 02 1 1 1 u 1 u 2 u 12 v 1 v 2 . . . . v 12 u 1 v 1 u 2 v 2 . . . . u 12 v 12 u 1 2 u 2 2 u 12 2 v 1 2 v 2 2 v 12 2
The point order 1 2 3 4 5 6 7 8 9 10 11 12
u(pixel) 538.1 626.67 536.94 625.82 537.88 627.1 538.59 627.4 569.88 599.41 598.97 569.74
v(pixel) 330.81 325.28 190.68 192.61 225.62 225.48 296.06 292.15 260.09 259.49 225.48 294.81
u’(pixel) 550.9 653.71 551.16 653.94 551.22 653.83 551.14 653.87 585.58 620.01 620.11 585.55
v’(pixel) 348.46 347.99 210.82 210.58 244.95 245.01 314.02 314.02 279.49 279.76 244.98 314.12
The correction matrix of trying to achieve is:
a 00 a 10 a 01 a 11 a 20 a 02 b 00 b 10 b 01 b 11 b 20 b 02 = 253.137 0.11401 - 0.168791 3.66461 E - 5 0.00088723 3 0.00026485 94.3187 - 0.131471 0.666474 0.00060478 1 - 4.54589 E - 6 - 1.97698 E - 5
Monocular two-dimensional visual system calibrating implementation process: choose image coordinate and world coordinates thereof after 2 reference point are proofreaied and correct on the scaling board, some P 1: (u 1', v 1')=(454.62,194.04), (x 1, y 1)=(280.70,2.41); Point P 2: (u 2', v 2')=(324.29,280.64), (x 2, y 2)=(69.89,142.48).According to monocular two-dimensional visual system principle noted earlier, programming realizes the demarcation of camera parameters.
The Kalman Prediction algorithm implementation: model system model, the Moving Workpieces two-dimensional world coordinate that then calculates with above-described scaling method be as the position detection value, simultaneously with the speed that estimates as velocity measurement, form observation vector.So obtained the optimum prediction value of Kalman filter, Fig. 3 is the prognoses system theory diagram.Set up following system model:
dx / dt = 0 1 0 0 0 1 0 0 0 x ( t ) + 0 0 1 u ( t ) + 1 0 0 0 1 0 0 0 1 w ( t )
y ( t ) = 1 0 0 0 1 0 x ( t ) + 0 0 u ( t ) + v ( t )
In this model, first equation is system state equation, and x (t) is the position x by the directions X workpiece, speed v x, acceleration a xThe state vector that forms, u (t) is the controlled quentity controlled variable of kinematic system.If u (t)=0 o'clock, system's acceleration was 0, is uniform motion, w (t) is system noise, and generally being made as average is zero white Gaussian noise.Second equation is output equation, the output valve of define system, the output valve y of this system (t) is defined as the vector (measured value will be consistent with the output valve type) that is comprised of position and speed, and v (t) is zero white Gaussian noise for measuring noise, also being made as average.
The programming of Kalman Prediction algorithm realizes: gather respectively two two field pictures, and interval 1s, the changes delta x of the location of workpiece is estimated velocity amplitude, as initial velocity v 0Input Kalman wave filter.According to system model, the observation vector that position, speed form, Kalman filter calculates the optimal estimation value of motion state.Fig. 4 is position prediction value X(solid line) and position detection value X ' (dotted line) between graph of a relation.Such as figure, because the velocity estimation value has certain deviation, cause that certain deviation is arranged between X and the X ', but because the continuous renewal of Kalman Prediction model makes predicted value X approach gradually X ', both errors converge to zero gradually.Fig. 5 is the error between predicted value X and the observed reading X ', and the figure mid point is mixed and disorderly, is owing to there being observation noise, but finds out easily that error amount becomes and zero.
The crawl control of the electronic jaw of SMC LEFH32K2-32-R16N3: write the crawl control program by the programming software of jaw, set action 0 and action 1.Action 0 is crawl, and action 1 is for discharging.Then the I/O mouth by EPSON mechanical arm controller sends coded signal to the SMC controller, realizes the control of jaw.Mechanical arm programming software " Out1,208 " instruction namely sends binary code 11010000, replacement jaw from port one." Out1,144 " instruction namely sends binary code 10010000, write activity 0." Out1,176 " instruction namely sends binary code 10110000, with drive position 1, carries out grasping movement.Similarly, " Out1,145 " write action 1, and " Out1,177 " carry out release movement.
The servocontrol of EPSON SCARA-G6 mechanical arm: PC connects by the controller of ICP/IP protocol and mechanical arm, set the IP address of controller #201 network interface and PC under same subnet, use again the corresponding network interface of " OpenNet#201 " instruction unpack, " Read#201; data1; 12 " reads the movable information that receives and comprises X, Y, V, deg (angle), the motion of " MOVE " instruction control mechanical arm.System does not adopt the mode of real-time follow-up, because mechanical arm can shelter from Moving Workpieces.Assigned address x of default 0=211(is with reference to the mechanical arm coordinate system), when the x of workpiece coordinate arrives x 0After, mechanical arm is carried out trajectory planning, and the control mechanical arm is by the expectation orbiting motion, order the jaw grabbing workpiece again, on request workpiece is grabbed to desired location, transmitted signal discharges workpiece again, carry out the crawl of next round, whole servocontrol schematic diagram is seen Fig. 6, and the servocontrol process flow diagram is seen Fig. 7.

Claims (6)

1. workpiece method for sorting based on machine vision technique may further comprise the steps:
1) image processing algorithm of video flowing detects position and the attitude of workpiece the motion in the middle of the video that gathers with this algorithm;
2) calibration algorithm of video camera is converted into the pixel coordinate of Moving Workpieces in camera review with this calibration algorithm the physical coordinates of workpiece in the world coordinate system.
3) the Lens Distortion Correction algorithm of video camera is in order to eliminate the radial distortion of the image of introducing because of wide-angle lens.
4) Kalman Prediction algorithm is predicted in order to the position to Moving Workpieces, obtains the location of workpiece without time lag.5) the type identification algorithm of workpiece, when workpiece from the travelling belt through out-of-date, the camera acquisition workpiece image is identified the workpiece type, is convenient to classification.
6) motion control method of mechanical arm comprises method for planning track, and method for controlling trajectory makes mechanical arm can select optimal path, sorts rapidly workpiece.
2. the image processing algorithm of video flowing according to claim 1 is characterized in that detecting the background subtraction point-score of Moving Workpieces position and the method for detection workpiece attitude, may further comprise the steps:
1) video flowing that gathers is carried out background modeling:
acc(x,y)=α*image(x,y)+(1-α)*acc(x,y)
Wherein image (x, y) is present frame, and acc (x, y) is background model (being initialized as 0), and α is the context update rate, and its scope is 0-1, and system chooses α=0.15.
2) separate the prospect two field picture, detect the location of workpiece:
frimage(x,y)=image(x,y)-acc(x,y)
Wherein frimage (x, y) is the prospect frame.
3) colour picture being carried out gray scale processes.
4) with detecting workpiece vertical direction and the shared ultimate range of horizontal direction, judge that the attitude of workpiece is tending towards vertically or level.Then choose from left to right rim detection if be tending towards vertical attitude; Then choose from top to bottom rim detection if be tending towards horizontal attitude.Detection Grad on selected direction surpasses the point of threshold value, and these points are carried out fitting a straight line, calculates angle.
3. the Lens Distortion Correction algorithm of video camera according to claim 1 is characterized in that the method with linear regression (LR) has simulated the radial distortion matrix of video camera.May further comprise the steps:
1) sets up the Lens Distortion Correction model.
u ′ = a 00 + a 10 u + a 01 v + a 11 uv + a 20 u 2 + a 02 v 2 v ′ = b 00 + b 10 u + b 01 v + b 11 uv + b 20 u 2 + b 02 v 2
In the formula: (u, v) is the image coordinate of reference point, and (u', v') is the image coordinate behind the reference point distortion correction, a St, b StBe correction coefficient, s, t=0,1,2.
2) obtain the image coordinate that 12 reference point are proofreaied and correct front and back, ask for the radial distortion matrix.
4. Kalman Prediction algorithm according to claim 1 is characterized in that need not to detect by scrambler the speed of travelling belt, and its prediction may further comprise the steps:
1) estimates workpiece motion s speed.
2) calculate optimum state estimation value according to observation signal and model estimated signal.
5. workpiece kind identification method according to claim 1 is characterized in that can realizing classification than the multiple types workpiece based on the workpiece sorter of LabVIEW visual development module (VDM), and directly the 3D workpiece sample that gathers is carried out the sorter training.May further comprise the steps:
1) sample of the various workpiece of input in the pattern of LabVIEW classify program carries out feature detection to each sample, and the training shapes model, sets up the workpiece sample database.
2) clarification of objective in the area-of-interest (ROI) of realtime graphic is detected, and mate with model in the database, calculate matching value, choose the highest result of matching value as the output of sorter.
6. workpiece automatic sorting method according to claim 1 is characterized in that EPSON SCARA-G6 mechanical arm trajectory planning and track following, makes its continuously grabbing workpiece.May further comprise the steps:
1) according to the Work position information of host computer prediction, mechanical arm is carried out trajectory planning.
2) the control mechanical arm moves according to desired trajectory.
3) adjust the jaw attitude, the Moving Workpieces on the crawl travelling belt.Last as requested dissimilar workpiece the classification puts, and then makes manipulator motion to holding point, waits for the sorting of next round workpiece.
CN201310129367.9A 2013-04-15 2013-04-15 Based on the Moving Workpieces method for sorting of LabVIEW Active CN103325106B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310129367.9A CN103325106B (en) 2013-04-15 2013-04-15 Based on the Moving Workpieces method for sorting of LabVIEW

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310129367.9A CN103325106B (en) 2013-04-15 2013-04-15 Based on the Moving Workpieces method for sorting of LabVIEW

Publications (2)

Publication Number Publication Date
CN103325106A true CN103325106A (en) 2013-09-25
CN103325106B CN103325106B (en) 2015-11-25

Family

ID=49193829

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310129367.9A Active CN103325106B (en) 2013-04-15 2013-04-15 Based on the Moving Workpieces method for sorting of LabVIEW

Country Status (1)

Country Link
CN (1) CN103325106B (en)

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104148300A (en) * 2014-01-24 2014-11-19 北京聚鑫跃锋科技发展有限公司 Garbage sorting method and system based on machine vision
CN104268602A (en) * 2014-10-14 2015-01-07 大连理工大学 Shielded workpiece identifying method and device based on binary system feature matching
CN105159248A (en) * 2015-08-05 2015-12-16 东莞理工学院 Machine vision based method for classifying industrial products
CN105225225A (en) * 2015-08-31 2016-01-06 臻雅科技温州有限公司 A kind of leather system for automatic marker making method and apparatus based on machine vision
CN105405139A (en) * 2015-11-12 2016-03-16 深圳市傲视检测技术有限公司 Monocular CCD (Charge Coupled Device) based method and system for rapidly positioning feeding of small-sized glass panel
CN105728328A (en) * 2016-05-13 2016-07-06 杭州亚美利嘉科技有限公司 Goods sorting system and method
CN107111739A (en) * 2014-08-08 2017-08-29 机器人视觉科技股份有限公司 The detection and tracking of article characteristics
CN107671008A (en) * 2017-11-13 2018-02-09 中国科学院合肥物质科学研究院 A kind of part stream waterline automatic sorting boxing apparatus of view-based access control model
CN108160530A (en) * 2017-12-29 2018-06-15 苏州德创测控科技有限公司 A kind of material loading platform and workpiece feeding method
CN108188039A (en) * 2018-01-15 2018-06-22 苏州工业园区服务外包职业学院 A kind of fruit Automated Sorting System and method
CN108406780A (en) * 2018-05-18 2018-08-17 苏州吉成智能科技有限公司 pharmacy fault scanning method
CN108458655A (en) * 2017-02-22 2018-08-28 上海理工大学 Support the data configurableization monitoring system and method for vision measurement
CN108782797A (en) * 2018-06-15 2018-11-13 广东工业大学 The control method and arm-type tea frying machine of arm-type tea frying machine stir-frying tealeaves
CN109279325A (en) * 2018-10-16 2019-01-29 深圳市正和忠信股份有限公司 A kind of automatic feeding system
CN109863002A (en) * 2016-10-21 2019-06-07 通快机床两合公司 Workpiece collects dot element and the method for auxiliary work-piece processing
CN109927033A (en) * 2019-04-01 2019-06-25 杭州电子科技大学 A kind of target object dynamic adaptation method applied to conveyer belt sorting
CN110180799A (en) * 2019-06-28 2019-08-30 中船黄埔文冲船舶有限公司 A kind of part method for sorting and system based on machine vision
CN110711701A (en) * 2019-09-16 2020-01-21 华中科技大学 Grabbing type flexible sorting method based on RFID space positioning technology
CN110861076A (en) * 2019-12-11 2020-03-06 深圳市盛世鸿恩科技有限公司 Hand eye calibration device of mechanical arm
CN110936372A (en) * 2018-09-21 2020-03-31 许昌学院 Control system of cigarette carton stacking robot
CN111346829A (en) * 2020-02-28 2020-06-30 西安电子科技大学 PYNQ-based binocular camera three-dimensional sorting system and method
CN112525157A (en) * 2020-10-13 2021-03-19 江苏三立液压机械有限公司 Hydraulic oil cylinder size measurement and pose estimation method and system based on video image
CN113814986A (en) * 2021-11-23 2021-12-21 广东隆崎机器人有限公司 Method and system for controlling SCARA robot based on machine vision
CN114749981A (en) * 2022-05-27 2022-07-15 中迪机器人(盐城)有限公司 Feeding and discharging control system and method based on multi-axis robot
CN114798505A (en) * 2022-04-21 2022-07-29 无锡比益特科技有限公司 Cargo sorting device capable of achieving self-adaptive adjustment of cargo pose
CN114888851A (en) * 2022-05-30 2022-08-12 北京航空航天大学杭州创新研究院 Moving object robot grabbing device based on visual perception
CN116423528A (en) * 2023-06-13 2023-07-14 国网浙江省电力有限公司宁波供电公司 Transformer oil sample sorting method and system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1253309A (en) * 1998-11-10 2000-05-17 富士摄影胶片株式会社 Posture regulating device and classifying device for use on photographic film set with lens
CN1806940A (en) * 2006-01-23 2006-07-26 湖南大学 Defective goods automatic sorting method and equipment for high-speed automated production line
CN101402199A (en) * 2008-10-20 2009-04-08 北京理工大学 Hand-eye type robot movable target extracting method with low servo accuracy based on visual sensation
CN102151661A (en) * 2010-11-24 2011-08-17 季广厚 Method and equipment for sorting test tube samples
CN102171531A (en) * 2008-10-08 2011-08-31 本田技研工业株式会社 Device for estimating shape of work and method for estimating shape of work
CN102207988A (en) * 2011-06-07 2011-10-05 北京邮电大学 Efficient dynamic modeling method for multi-degree of freedom (multi-DOF) mechanical arm
CN102430530A (en) * 2010-08-31 2012-05-02 株式会社安川电机 Robot system
CN102692618A (en) * 2012-05-23 2012-09-26 浙江工业大学 RFID (radio frequency identification) positioning method based on RSSI (received signal strength indicator) weight fusion
CN102914967A (en) * 2012-09-21 2013-02-06 浙江工业大学 Autonomous navigation and man-machine coordination picking operating system of picking robot

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1253309A (en) * 1998-11-10 2000-05-17 富士摄影胶片株式会社 Posture regulating device and classifying device for use on photographic film set with lens
CN1806940A (en) * 2006-01-23 2006-07-26 湖南大学 Defective goods automatic sorting method and equipment for high-speed automated production line
CN102171531A (en) * 2008-10-08 2011-08-31 本田技研工业株式会社 Device for estimating shape of work and method for estimating shape of work
CN101402199A (en) * 2008-10-20 2009-04-08 北京理工大学 Hand-eye type robot movable target extracting method with low servo accuracy based on visual sensation
CN102430530A (en) * 2010-08-31 2012-05-02 株式会社安川电机 Robot system
CN102151661A (en) * 2010-11-24 2011-08-17 季广厚 Method and equipment for sorting test tube samples
CN102207988A (en) * 2011-06-07 2011-10-05 北京邮电大学 Efficient dynamic modeling method for multi-degree of freedom (multi-DOF) mechanical arm
CN102692618A (en) * 2012-05-23 2012-09-26 浙江工业大学 RFID (radio frequency identification) positioning method based on RSSI (received signal strength indicator) weight fusion
CN102914967A (en) * 2012-09-21 2013-02-06 浙江工业大学 Autonomous navigation and man-machine coordination picking operating system of picking robot

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
彭艳芳: "《视频运动目标检测与跟踪算法研究》", 《中国优秀硕士学位论文全文数据库》, 15 December 2010 (2010-12-15) *
戴剑锋: "《摄像头径向畸变自动校正系统》", 《中国优秀硕士学位论文全文数据库》, 15 March 2011 (2011-03-15) *
钞萌: "《基于机器人视觉的定位》", 《中国优秀硕士学位论文全文数据库》, 15 November 2010 (2010-11-15) *

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104148300B (en) * 2014-01-24 2017-02-15 北京聚鑫跃锋科技发展有限公司 Garbage sorting method and system based on machine vision
CN104148300A (en) * 2014-01-24 2014-11-19 北京聚鑫跃锋科技发展有限公司 Garbage sorting method and system based on machine vision
CN107111739A (en) * 2014-08-08 2017-08-29 机器人视觉科技股份有限公司 The detection and tracking of article characteristics
CN104268602A (en) * 2014-10-14 2015-01-07 大连理工大学 Shielded workpiece identifying method and device based on binary system feature matching
CN105159248A (en) * 2015-08-05 2015-12-16 东莞理工学院 Machine vision based method for classifying industrial products
CN105159248B (en) * 2015-08-05 2019-01-29 东莞理工学院 A method of classifying to industrial products based on machine vision
CN105225225B (en) * 2015-08-31 2017-12-22 温州城电智能科技有限公司 A kind of leather system for automatic marker making method and apparatus based on machine vision
CN105225225A (en) * 2015-08-31 2016-01-06 臻雅科技温州有限公司 A kind of leather system for automatic marker making method and apparatus based on machine vision
CN105405139A (en) * 2015-11-12 2016-03-16 深圳市傲视检测技术有限公司 Monocular CCD (Charge Coupled Device) based method and system for rapidly positioning feeding of small-sized glass panel
CN105728328A (en) * 2016-05-13 2016-07-06 杭州亚美利嘉科技有限公司 Goods sorting system and method
CN109863002A (en) * 2016-10-21 2019-06-07 通快机床两合公司 Workpiece collects dot element and the method for auxiliary work-piece processing
CN108458655A (en) * 2017-02-22 2018-08-28 上海理工大学 Support the data configurableization monitoring system and method for vision measurement
CN107671008A (en) * 2017-11-13 2018-02-09 中国科学院合肥物质科学研究院 A kind of part stream waterline automatic sorting boxing apparatus of view-based access control model
CN108160530A (en) * 2017-12-29 2018-06-15 苏州德创测控科技有限公司 A kind of material loading platform and workpiece feeding method
CN108188039A (en) * 2018-01-15 2018-06-22 苏州工业园区服务外包职业学院 A kind of fruit Automated Sorting System and method
CN108406780A (en) * 2018-05-18 2018-08-17 苏州吉成智能科技有限公司 pharmacy fault scanning method
CN108782797A (en) * 2018-06-15 2018-11-13 广东工业大学 The control method and arm-type tea frying machine of arm-type tea frying machine stir-frying tealeaves
CN110936372A (en) * 2018-09-21 2020-03-31 许昌学院 Control system of cigarette carton stacking robot
CN109279325A (en) * 2018-10-16 2019-01-29 深圳市正和忠信股份有限公司 A kind of automatic feeding system
CN109279325B (en) * 2018-10-16 2024-04-26 深圳市正和忠信股份有限公司 Automatic feeding system
CN109927033A (en) * 2019-04-01 2019-06-25 杭州电子科技大学 A kind of target object dynamic adaptation method applied to conveyer belt sorting
CN110180799A (en) * 2019-06-28 2019-08-30 中船黄埔文冲船舶有限公司 A kind of part method for sorting and system based on machine vision
CN110711701A (en) * 2019-09-16 2020-01-21 华中科技大学 Grabbing type flexible sorting method based on RFID space positioning technology
CN110861076A (en) * 2019-12-11 2020-03-06 深圳市盛世鸿恩科技有限公司 Hand eye calibration device of mechanical arm
CN111346829A (en) * 2020-02-28 2020-06-30 西安电子科技大学 PYNQ-based binocular camera three-dimensional sorting system and method
CN112525157A (en) * 2020-10-13 2021-03-19 江苏三立液压机械有限公司 Hydraulic oil cylinder size measurement and pose estimation method and system based on video image
CN113814986A (en) * 2021-11-23 2021-12-21 广东隆崎机器人有限公司 Method and system for controlling SCARA robot based on machine vision
CN114798505A (en) * 2022-04-21 2022-07-29 无锡比益特科技有限公司 Cargo sorting device capable of achieving self-adaptive adjustment of cargo pose
CN114798505B (en) * 2022-04-21 2024-02-20 无锡比益特科技有限公司 Cargo sorting device capable of realizing cargo pose self-adaptive adjustment
CN114749981A (en) * 2022-05-27 2022-07-15 中迪机器人(盐城)有限公司 Feeding and discharging control system and method based on multi-axis robot
CN114888851A (en) * 2022-05-30 2022-08-12 北京航空航天大学杭州创新研究院 Moving object robot grabbing device based on visual perception
CN116423528A (en) * 2023-06-13 2023-07-14 国网浙江省电力有限公司宁波供电公司 Transformer oil sample sorting method and system
CN116423528B (en) * 2023-06-13 2023-10-17 国网浙江省电力有限公司宁波供电公司 Transformer oil sample sorting method and system

Also Published As

Publication number Publication date
CN103325106B (en) 2015-11-25

Similar Documents

Publication Publication Date Title
CN103325106B (en) Based on the Moving Workpieces method for sorting of LabVIEW
CN104841593B (en) Control method of robot automatic spraying system
CN109365318B (en) Multi-robot cooperation sorting method and system
CN109344882B (en) Convolutional neural network-based robot control target pose identification method
CN107992881B (en) Robot dynamic grabbing method and system
US8923602B2 (en) Automated guidance and recognition system and method of the same
CN113814986B (en) Method and system for controlling SCARA robot based on machine vision
CN104325268A (en) Industrial robot three-dimensional space independent assembly method based on intelligent learning
CN106485746A (en) Visual servo mechanical hand based on image no demarcation and its control method
CN112102368B (en) Deep learning-based robot garbage classification and sorting method
Husain et al. Realtime tracking and grasping of a moving object from range video
Hsu et al. Development of a faster classification system for metal parts using machine vision under different lighting environments
CN116872216B (en) Robot vision servo operation method based on finite time control
CN113334380A (en) Robot vision calibration method, control system and device based on binocular vision
CN113245094B (en) Robot spraying system and method for automobile brake drum
Gao et al. An automatic assembling system for sealing rings based on machine vision
CN109079777A (en) A kind of mechanical arm hand eye coordination operating system
CN113808206B (en) Typesetting system and method based on vision tracking robot
Zhou et al. Visual servo control system of 2-DOF parallel robot
CN113843797B (en) Automatic disassembly method for part hexagonal bolt under non-structural environment based on single-binocular hybrid vision
KR102452315B1 (en) Apparatus and method of robot control through vision recognition using deep learning and marker
Zhang et al. Intelligent sorting method for assembly line based on visual positioning and model predictive control of robotic arm
CN114926531A (en) Binocular vision based method and system for autonomously positioning welding line of workpiece under large visual field
CN107609473A (en) A kind of 3D visual identifying systems and its recognition methods
CN112200821A (en) Detection and positioning method for assembly line multi-partition subpackage targets

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant