WO2020087909A1 - 一种基于多相机的光伏电池串定位方法 - Google Patents
一种基于多相机的光伏电池串定位方法 Download PDFInfo
- Publication number
- WO2020087909A1 WO2020087909A1 PCT/CN2019/087239 CN2019087239W WO2020087909A1 WO 2020087909 A1 WO2020087909 A1 WO 2020087909A1 CN 2019087239 W CN2019087239 W CN 2019087239W WO 2020087909 A1 WO2020087909 A1 WO 2020087909A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- photovoltaic cell
- cell string
- camera
- long
- robot
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000004891 communication Methods 0.000 claims abstract description 4
- 239000011159 matrix material Substances 0.000 claims description 9
- 238000013519 translation Methods 0.000 claims description 9
- 230000036544 posture Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000003384 imaging method Methods 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 abstract description 4
- 230000000007 visual effect Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 2
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000010248 power generation Methods 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 238000003466 welding Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/181—Segmentation; Edge detection involving edge growing; involving edge linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L21/00—Processes or apparatus adapted for the manufacture or treatment of semiconductor or solid state devices or of parts thereof
- H01L21/67—Apparatus specially adapted for handling semiconductor or electric solid state devices during manufacture or treatment thereof; Apparatus specially adapted for handling wafers during manufacture or treatment of semiconductor or electric solid state devices or components ; Apparatus not specifically provided for elsewhere
- H01L21/68—Apparatus specially adapted for handling semiconductor or electric solid state devices during manufacture or treatment thereof; Apparatus specially adapted for handling wafers during manufacture or treatment of semiconductor or electric solid state devices or components ; Apparatus not specifically provided for elsewhere for positioning, orientation or alignment
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L21/00—Processes or apparatus adapted for the manufacture or treatment of semiconductor or solid state devices or of parts thereof
- H01L21/67—Apparatus specially adapted for handling semiconductor or electric solid state devices during manufacture or treatment thereof; Apparatus specially adapted for handling wafers during manufacture or treatment of semiconductor or electric solid state devices or components ; Apparatus not specifically provided for elsewhere
- H01L21/68—Apparatus specially adapted for handling semiconductor or electric solid state devices during manufacture or treatment thereof; Apparatus specially adapted for handling wafers during manufacture or treatment of semiconductor or electric solid state devices or components ; Apparatus not specifically provided for elsewhere for positioning, orientation or alignment
- H01L21/681—Apparatus specially adapted for handling semiconductor or electric solid state devices during manufacture or treatment thereof; Apparatus specially adapted for handling wafers during manufacture or treatment of semiconductor or electric solid state devices or components ; Apparatus not specifically provided for elsewhere for positioning, orientation or alignment using optical controlling means
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L31/00—Semiconductor devices sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation; Processes or apparatus specially adapted for the manufacture or treatment thereof or of parts thereof; Details thereof
- H01L31/18—Processes or apparatus specially adapted for the manufacture or treatment of these devices or of parts thereof
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L31/00—Semiconductor devices sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation; Processes or apparatus specially adapted for the manufacture or treatment thereof or of parts thereof; Details thereof
- H01L31/18—Processes or apparatus specially adapted for the manufacture or treatment of these devices or of parts thereof
- H01L31/1876—Particular processes or apparatus for batch treatment of the devices
- H01L31/188—Apparatus specially adapted for automatic interconnection of solar cells in a module
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E10/00—Energy generation through renewable energy sources
- Y02E10/50—Photovoltaic [PV] energy
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P70/00—Climate change mitigation technologies in the production process for final industrial or consumer products
- Y02P70/50—Manufacturing or production processes characterised by the final manufactured product
Definitions
- the invention relates to a material automatic positioning method, in particular to a photovoltaic cell string positioning method based on multiple cameras.
- solar energy as a renewable energy source, has the characteristics of inexhaustible, inexhaustible, clean and environmental protection, and Gradually used.
- solar power generation and as the main carrier of photovoltaics, silicon crystal solar cells have to go through string welding and typesetting processes in the process of being produced by units.
- the typesetting process is to arrange the rows of serially welded single-row batteries neatly in parallel to splice and package them into components.
- the photovoltaic industry generally has high requirements for the neatness of typesetting (usually the deviation does not exceed 0.1mm); traditional typesetting is performed by manual, with the help of special mechanical devices Typesetting; but this method of purely relying on mechanical positioning cannot guarantee the accuracy of positioning, and manual contact will cause contact loss to the battery; in recent years, with the development of robot technology, industrial robots have begun to apply to typesetting; this avoids Direct manual contact, but the absolute positioning accuracy of the robot often fails to meet the requirements of typesetting accuracy;
- multi-camera positioning methods based on camera self-calibration. Although it can be extended to determine the pose of objects in three-dimensional space, the operation process of self-calibration methods is cumbersome and the accuracy is low, generally -20mm; In addition, there is a multi-camera positioning method using image stitching technology, which improves the resolution of the image, but the positioning accuracy depends on the effect of camera distortion correction.
- the Chinese invention patent application CN107611073A discloses a positioning method for solar cell string layout.
- a backlight and camera solution is used to locate the characteristic points of the photovoltaic cell through a conveyor belt with light transmission properties, and two points are used to confirm a straight line.
- Scheme calculate the deviation of the photovoltaic cell string from the standard cell string.
- the equipment solution has certain limitations and high requirements on the mechanical structure. In practical applications, it affects the accuracy of positioning and reduces the working cycle.
- the image stitching technology mainly uses the stitching of multiple pictures into one large picture.
- the image stitching algorithm has a long execution time, and the stitching algorithm has high requirements for image feature extraction, and the photovoltaic cell string features are few.
- the stitched visual pictures The accuracy is much worse, and according to the actual application, the photovoltaic cell string positioning is realized based on the splicing technology, which cannot meet the requirements of the scene in terms of accuracy and performance.
- the problem to be solved by the present invention is to overcome the shortcomings of the prior art, and propose a multi-camera-based photovoltaic cell string positioning method, which uses localization features such as fitting, weight calculation, and deduction calculation to improve accuracy while improving accuracy , So that the on-site photovoltaic positioning accuracy can reach within 0.1mm, improving work efficiency.
- the multi-camera photovoltaic cell string positioning method of the present invention has the following steps:
- An angle camera is arranged above one corner of the tested photovoltaic cell string of the transmission device, and a long edge camera is arranged above the long edge of the tested photovoltaic cell string.
- the field of view of the angle camera is opposite to one corner of the measured photovoltaic cell string, used to obtain the corner image of the photovoltaic cell string, and the field of view of the long edge camera is opposite to one long edge of the photovoltaic cell string, used to obtain Image of the long side of a photovoltaic cell string.
- Establish the robot reference coordinate system r use the three-point method to teach three robot points r 0 (x 0 , y 0 , z 0 , a 0 , b 0 , c 0 ), r 1 (x 1 , y 1 , z 0 , a 0 , b 0 , c 0 ), r 2 (x 2 , y 2 , z 0 , a 0 , b 0 , c 0 ), using the rotational translation equation R
- T to establish the reference coordinates of the robot Department r.
- R represents the rotation matrix
- T represents the translation matrix.
- the robot points r 0 , r 1 , and r 2 have different x-axis and y-axis coordinates, the z-axis coordinate z 0 is the same, and the robot postures a 0 , b 0 , c 0 are the same.
- (x 0 , y 0 ), (x 1 , y 1 ), (x 2 , y 2 ) represent the coordinates of the robot.
- X 0 , X 1 , X 2 represent the camera row coordinate value
- Y 0 , Y 1 , Y 2 represent the camera column coordinate
- Step 1 Calculate the standard layout position c 3 (X 3 , Y 3 , a 3 ) of the photovoltaic cell string and the position c 4 (X 4 , Y 4 , a 4 ) of the photovoltaic cell string obtained by the long-side camera.
- Step 1.1 The robot grabs the photovoltaic cell string and places it under the long-side camera and angular camera.
- the corresponding point coordinates of the robot are: r 6 (x 6 , y 6 , z 6 , a 6 , b 6 , c 6 ),
- the long-side camera positions the boundary of the photovoltaic cell string, and the angular position camera positions the boundary and intersection of the photovoltaic cell string boundary line.
- Step 1.2 The corner camera captures the two boundaries of the corners of the photovoltaic cell string, and uses the sub-pixel-level edge fitting method to find the straight lines L1 and L2 of the corners of the corners of the photovoltaic cell string, of which the long side edge straight line L2
- the angle with the standard line is a 3
- the intersection point c 3 (X 3 , Y 3 , a 3 ) of the straight lines L1 and L2 at the edge of the corner of the photovoltaic cell string is the standard layout position of the photovoltaic cell string.
- the straight line formed by c 0 (X 0 , Y 0 ) and c 1 (X 1 , Y 1 ) is the standard straight line.
- Step 1.3 Each long-side camera captures the long-side boundary of the photovoltaic cell string, and uses sub-pixel-level edge fitting to find L3 of the straight line of the long-edge edge of the photovoltaic cell string.
- a 4 , intersection point c 4 (X 4 , Y 4 , a 4 ) is the position of the photovoltaic cell string obtained by the long-side camera.
- Step 2 Calculate the difference between the position of the photovoltaic cell string and the standard layout position of the photovoltaic cell string (Dx, Dy, Da).
- Step 2.1 Measure half of the length and width of the photovoltaic cell string as l 1 and l 2 respectively .
- Step 2.2 Calculate the rotation center of the photovoltaic cell string:
- DX and DY indicate how many millimeters a pixel represents.
- Step 2.3 The robot grabs a new photovoltaic cell string, shoots it with a long-side camera and an angular camera, and calculates the standard layout position c31 (x 31 , y 31 , a 31 ) of the new photovoltaic cell string and the photovoltaic obtained by the long-side camera
- the battery string position c41 (x 41 , y 41 , a 41 ).
- i the starting counting position of the corner coordinate
- i 2
- N the number of cameras.
- Step 2.4 Use Ethernet communication to send the data to the typesetting robot.
- the robot adds [Dx, Dy, Da] on the basis of point r6 and executes.
- the two long-edge cameras are set at different positions on the same long edge or different long edges of the photovoltaic cell string (one long-edge camera is provided for each of the two long edges).
- the field of view of the edge camera is directly on the long side of the photovoltaic cell string.
- step 1.3 the second long-side positioning criterion is added.
- the long-side camera captured the boundary of the photovoltaic cell string, and used the sub-pixel-level edge fitting method to find the straight line L5.
- the angle between the straight line L5 and the standard straight line is a 5
- the coordinate of the intersection point is c5 (x 5 , y 5 , a 5 ).
- Step 2.3 Robot 3 grabs the new photovoltaic cell string, and uses the sum of the two long-side camera and angular camera to calculate the new intersection point and angle c31 (x 31 , y 31 , a 31 ) and c41 (x 41 , y 41 , a 41 ), c51 (x 51 , y 51 , a 51 ).
- Da ((a 3 -a 31 ) + (a 4 -a 41 ) + (a 5 -a 51 )) / 3
- the boundary of the battery string is positioned by straight line fitting through a multi-camera solution, and the straight line fitting solution at the sub-pixel level is used to increase the accuracy of edge positioning.
- Calculate the angle change of the photovoltaic cell string use the weight to calculate Da, and calculate Da by the multi-angle angle change to reduce the interference of the battery string burr.
- Vision locates the straight line of the local boundary and calculates the intersection point c 3 (X 3 , Y 3 ), and calculates the deviation (Dx, Dy) of the position of the battery string from the standard layout position of the battery string through the model form. (The angle deviation is calculated first, and then the position deviation is calculated.) The tempo has been doubled.
- FIG. 1 is a schematic diagram of a device system in which a robot grabs a photovoltaic cell string with a light source between the camera and the photovoltaic cell string.
- Fig. 2 is a schematic diagram of an equipment system where a light source is below a photovoltaic cell string and a robot grabs the photovoltaic cell string.
- FIG. 3 is a schematic diagram of the equipment system of the photovoltaic cell string with the light source above the belt line.
- Figure 4 shows the characteristic parameters to be calculated for the long-side camera and the angular camera.
- Figure 5 is the robot three-point relationship to establish the coordinate system r.
- Fig. 6 is a visual three-point relationship to establish a coordinate system A. Among them, a is the robot point and b is the visual point.
- Embodiment 1 An embodiment of an angle camera and a long side camera.
- the on-site tooling solution is divided into the belt line 1 incoming, visually positioned and grabbed by the robot 3. Another solution is that the robot grabs the photovoltaic cell string and is visually positioned.
- the on-site tooling scheme is shown in Figures 1, 2, and 3. The difference between Figure 1 and Figure 2 is that Figure 1 selects an open-hole light source (2.1, 5.1), and Figure 2 can select a backlight (2.2, 5.2)
- Figure 3 is a belt line with a robot to grab a string of photovoltaic cells.
- the angle camera 2 is used to locate the corner of the photovoltaic cell string, and its field of view 2.3 is located at one corner of the photovoltaic cell string 4, that is, the intersection of the two sides.
- the long side camera 5 is used to locate the long side of the photovoltaic cell string, and its field of view 5.3 covers the long side position of the photovoltaic cell string.
- the length of the photovoltaic cell string is 2 * l 1 because of the installation of the angle camera 2 and the long side camera 5 distance is generally less than 2 * l 1, at greater than l 1/3.
- the reference coordinate system r of the robot and the reference coordinate system A of the angular camera 2 are established, and the relationship between r and A is horizontal and vertical.
- the establishment of the robot reference coordinate system r As shown in Figures 5 and 6, the establishment of the robot reference coordinate system r.
- R represents the rotation matrix and T represents the translation matrix.
- T represents the translation matrix.
- the difference between the robot points r 0 , r 1 , and r 2 is that the x-axis and y-axis coordinates are different, the z-axis coordinate z 0 is the same, and the robot postures a 0 , b 0 , c 0 are the same.
- (x 0 , y 0 ), (x 1 , y 1 ), (x 2 , y 2 ) represent the coordinates of the robot.
- Step 1 As shown in Fig. 4, calculating the standard layout position c 3 (X 3 , Y 3 , a 3 ) of the photovoltaic cell string in the angular camera 2 includes the following steps:
- Step 1.1 The robot grabs the battery slice under the long-side camera 5 and the angular camera 2.
- the corresponding point coordinates of the robot 3 are: r 6 (x 6 , y 6 , z 6 , a 6 , b 6 , c 6 ),
- the long-side camera 5 locates the boundary of the photovoltaic cell string
- the angular camera 2 locates the boundary and intersection of the boundary line of the photovoltaic cell string.
- Step 1.2 The angle camera 2 captures the boundary of the photovoltaic cell string, and uses the sub-pixel-level edge fitting method to find the straight line L1 and the straight line L2.
- the angle of the straight line L2 and the standard straight line is a 3 , L1 and L2
- the intersection point is c 3 (X 3 , Y 3 , a 3 ), as shown in Figure 3.
- Step 1.3 The long-side camera 5 captures the boundary of the photovoltaic cell string, and uses the sub-pixel-level edge fitting method to find the straight line L3.
- the angle between the straight line L3 and the standard straight line is a 4
- the coordinates of the intersection point are
- the c 4 (X 4 , Y 4 , a 4 ) standard straight line is the reference straight line in the long-side camera 5, and the standard straight line can be defined as a straight line formed by c0 and c1, as shown in FIG. 3.
- Step 2 Calculate the difference between the position of the photovoltaic cell string and the standard layout position of the photovoltaic cell string (Dx, Dy, Da).
- Step 2.1 Measurement confirms that half of the length and width of the photovoltaic cell string are l 1 and l 2, respectively .
- Step 2.2 Calculate the rotation center of the photovoltaic cell string:
- DX and DY indicate how many millimeters a pixel represents.
- Step 2.3 The robot 3 grabs the new photovoltaic cell string 4, and uses the long-side camera 5 and the angular camera 2 to calculate new intersection points and angles c31 (x 31 , y 31 , a 31 ) and c41 (x 41 , y 41 , a 41 ).
- Step 2.4 Use Ethernet communication to send the data to the typesetting robot.
- the robot adds [Dx, Dy, Da] on the basis of point r6 and executes.
- Embodiment 2 One camera is used to locate the angular position, and two cameras are used to locate the long side. The implementation steps are the same as in case 1. Only the weight of calculating Da is different.
- step 1.3 the standard for long-side positioning is added.
- the standard straight line is the reference straight line in the long-side camera.
- the standard straight line can be defined as the straight line composed of c0 and c1, as shown in Figure 3.
- Step 2.3 Robot 3 grabs the new photovoltaic cell string, and uses the sum of the two long-side camera and angular camera to calculate the new intersection point and angle c31 (x 31 , y 31 , a 31 ) and c41 (x 41 , y 41 , a 41 ), c51 (x 51 , y 51 , a 51 ).
- Da ((a 3 -a 31 ) + (a 4 -a 41 ) + (a 5 -a 51 )) / 3
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Manufacturing & Machinery (AREA)
- Theoretical Computer Science (AREA)
- Power Engineering (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Computer Hardware Design (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- Electromagnetism (AREA)
- Sustainable Energy (AREA)
- Sustainable Development (AREA)
- Life Sciences & Earth Sciences (AREA)
- Manipulator (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Container, Conveyance, Adherence, Positioning, Of Wafer (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (6)
- 一种基于多相机的光伏电池串定位方法,其步骤如下:在传送装置被测光伏电池串一个边角上方设置一个角位相机,在被测光伏电池串长边上方设置一个长边位相机;所述角位相机的视野正对被测光伏电池串一个边角,用于获取光伏电池串的角部图像,所述长边位相机的视野正对光伏电池串的一个长边,用于获取光伏电池串长边的图像;建立机器人参考坐标系r;步骤1.计算光伏电池串标准排版位置c 3(X 3,Y 3,a 3)和长边位相机获取的光伏电池串位置c 4(X 4,Y 4,a 4);步骤2计算光伏电池串位置与光伏电池串标准排版位置的差异(Dx,Dy,Da);利用以太网的通讯,将数据发给排版机器人,机器人在点位r6的基础上,加上[Dx,Dy,Da],并执行;所述点位r6是,机器人抓取光伏电池串放置在长边位相机和角位相机下方时,机器人对应的点位,其坐标是:r 6(x 6,y 6,z 6,a 6,b 6,c 6)。
- 根据权利要求1所述的基于多相机的光伏电池串定位方法,其特征是:设置两个长边位相机,两个长边位相机设置在光伏电池串同一长边的不同位置或不同的长边上,所述长边位相机的视野正对光伏电池串的一个长边;在步骤1.3中,增加第二个长边定位的标准:长边位相机拍摄到光伏电池串的边界,采用亚像素级别的边缘拟合的方法,找出直线的L5,直线L5与标准直线之间的角度为a 5,交点的坐标是c5(x 5,y 5,a 5);步骤2.3:机器人抓取新的光伏电池串,利用两个长边位相机和角位相机和,计算新 的交点和角度c31(x 31,y 31,a 31)和c41(x 41,y 41,a 41),c51(x 51,y 51,a 51):Da=((a 3-a 31)+(a 4-a 41)+(a 5-a 51))/3。
- 根据权利要求1所述的基于多相机的光伏电池串定位方法,其特征是:所述建立机器人参考坐标系r是,利用三点法,在空间中示教三个机器人点r 0(x 0,y 0,z 0,a 0,b 0,c 0),r 1(x 1,y 1,z 0,a 0,b 0,c 0),r 2(x 2,y 2,z 0,a 0,b 0,c 0),利用旋转平移方程R|T,建立机器人的参考坐标系r,其中R表示旋转矩阵,T表示平移矩阵;机器人点r 0,r 1,r 2的x轴、y轴坐标不同,z轴的坐标z 0相同,机器人的姿态a 0,b 0,c 0相同;(x 0,y 0),(x 1,y 1),(x 2,y 2)表示机器人的坐标。
- 根据权利要求1所述的基于多相机的光伏电池串定位方法,其特征是:所述建立角位相机参考坐标系A是,将机器人切换到机器人参考坐标系r中,在空间中顺序走三个点r 3(x 3,y 3,z 1,a 1,b 1,c 1),r 4(x 3,y 4,z 1,a 1,b 1,c 1),r 5(x 4,y 3,z 1,a 1,b 1,c 1),在角位相机中成像的坐标分别为:c 0(X 0,Y 0),c 1(X 1,Y 1),c 2(X 2,Y 2),利用旋转平移方程R1|T1,建立的角位相机参考坐标系A,其中:r 3,r 4,r 5的关系是,r 3和r 4在机器人x轴上的坐标相同,r 3和r 5在机器人y轴上的坐标相同,z轴的坐标z 1相同,机器人的姿态a 1,b 1,c 1相同;R 1|T 1坐标系的叉乘表示:其中:X 0,X 1,X 2表示相机行坐标值,Y 0,Y 1,Y 2表示相机的列坐标;
- 根据权利要求1所述的基于多相机的光伏电池串定位方法,其特征是:所述步骤1.计算光伏电池串标准排版位置c 3(X 3,Y 3,a 3)和长边位相机获取的光伏电池串位置c 4(X 4,Y 4,a 4):步骤1.1机器人抓取光伏电池串放置在长边位相机和角位相机下方,机器人对应的点位坐标是:r 6(x 6,y 6,z 6,a 6,b 6,c 6),长边位相机定位的是光伏电池串边界,角位相机定位的是光伏电池串边界线的边界和交点;步骤1.2角位相机拍摄到光伏电池串角部位置的两个边界,采用亚像素级别的边缘拟合的方法,找出光伏电池串角部边缘直线L1、L2,其中,其中长边边缘直线L2与标准直线的夹角为a 3,光伏电池串角部边缘直线L1和L2的交点c 3(X 3,Y 3,a 3),即是光伏电池串标准排版位置;c 0(X 0,Y 0)和c 1(X 1,Y 1)构成的直线为所述标准直线;步骤1.3各个长边位相机拍摄到光伏电池串的长边边界,采用亚像素级别的边缘拟合的方法,找出光伏电池串长边边缘直线的L3,直线L3与标准直线之间的角度为a 4,交点c 4(X 4,Y 4,a 4)即是长边位相机获取的光伏电池串位置。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811282155.3A CN111127553B (zh) | 2018-10-31 | 2018-10-31 | 一种基于多相机的光伏电池串定位方法 |
CN201811282155.3 | 2018-10-31 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020087909A1 true WO2020087909A1 (zh) | 2020-05-07 |
Family
ID=70462029
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/087239 WO2020087909A1 (zh) | 2018-10-31 | 2019-05-16 | 一种基于多相机的光伏电池串定位方法 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN111127553B (zh) |
WO (1) | WO2020087909A1 (zh) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114739254A (zh) * | 2022-04-01 | 2022-07-12 | 山西漳山发电有限责任公司 | 一种可在线测量尺寸的标尺 |
CN115797310A (zh) * | 2022-12-13 | 2023-03-14 | 无锡海纳智能科技有限公司 | 一种光伏电站组串倾角的确定方法及电子设备 |
WO2023060511A1 (zh) * | 2021-10-14 | 2023-04-20 | 宁德时代新能源科技股份有限公司 | 确定电池箱的位置的方法及拆换电池箱的方法 |
CN116360467A (zh) * | 2023-06-01 | 2023-06-30 | 中国科学院自动化研究所 | 光伏板列无人清扫装置自主巡行系统及自主巡行方法 |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113043334B (zh) * | 2021-02-23 | 2022-12-06 | 上海埃奇机器人技术有限公司 | 一种基于机器人的光伏电池串定位方法 |
CN114882023B (zh) * | 2022-07-07 | 2022-11-18 | 苏州小牛自动化设备有限公司 | 电池串位姿校正方法、装置、控制设备及系统 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103692447A (zh) * | 2013-12-27 | 2014-04-02 | 西安航天精密机电研究所 | 一种基于俯视和侧视相机的电动汽车电池定位方法 |
CN106934813A (zh) * | 2015-12-31 | 2017-07-07 | 沈阳高精数控智能技术股份有限公司 | 一种基于视觉定位的工业机器人工件抓取实现方法 |
US20180222055A1 (en) * | 2017-02-03 | 2018-08-09 | Abb Schweiz Ag | Calibration article for a 3d vision robotic system |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5227985A (en) * | 1991-08-19 | 1993-07-13 | University Of Maryland | Computer vision system for position monitoring in three dimensions using non-coplanar light sources attached to a monitored object |
CN204290879U (zh) * | 2014-12-31 | 2015-04-22 | 苏州巨能图像检测技术有限公司 | 电池串的定位检测装置 |
CN107611073B (zh) * | 2017-09-15 | 2023-11-21 | 苏州宏瑞达新能源装备有限公司 | 太阳能电池串排版的定位方法 |
-
2018
- 2018-10-31 CN CN201811282155.3A patent/CN111127553B/zh active Active
-
2019
- 2019-05-16 WO PCT/CN2019/087239 patent/WO2020087909A1/zh active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103692447A (zh) * | 2013-12-27 | 2014-04-02 | 西安航天精密机电研究所 | 一种基于俯视和侧视相机的电动汽车电池定位方法 |
CN106934813A (zh) * | 2015-12-31 | 2017-07-07 | 沈阳高精数控智能技术股份有限公司 | 一种基于视觉定位的工业机器人工件抓取实现方法 |
US20180222055A1 (en) * | 2017-02-03 | 2018-08-09 | Abb Schweiz Ag | Calibration article for a 3d vision robotic system |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023060511A1 (zh) * | 2021-10-14 | 2023-04-20 | 宁德时代新能源科技股份有限公司 | 确定电池箱的位置的方法及拆换电池箱的方法 |
CN114739254A (zh) * | 2022-04-01 | 2022-07-12 | 山西漳山发电有限责任公司 | 一种可在线测量尺寸的标尺 |
CN115797310A (zh) * | 2022-12-13 | 2023-03-14 | 无锡海纳智能科技有限公司 | 一种光伏电站组串倾角的确定方法及电子设备 |
CN116360467A (zh) * | 2023-06-01 | 2023-06-30 | 中国科学院自动化研究所 | 光伏板列无人清扫装置自主巡行系统及自主巡行方法 |
CN116360467B (zh) * | 2023-06-01 | 2023-08-15 | 中国科学院自动化研究所 | 光伏板列无人清扫装置自主巡行系统及自主巡行方法 |
Also Published As
Publication number | Publication date |
---|---|
CN111127553B (zh) | 2023-04-28 |
CN111127553A (zh) | 2020-05-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020087909A1 (zh) | 一种基于多相机的光伏电池串定位方法 | |
CN105234943B (zh) | 一种基于视觉识别的工业机器人示教装置及方法 | |
CN107192331A (zh) | 一种基于双目视觉的工件抓取方法 | |
JP6860180B2 (ja) | 太陽光パネル清掃ロボットの測位装置及びその測位方法 | |
CN106272426A (zh) | 太阳能电池片串焊前视觉定位及角度检测设备及检测方法 | |
WO2021004416A1 (zh) | 一种基于视觉信标建立信标地图的方法、装置 | |
CN110470238A (zh) | 一种手持激光三维扫描仪、扫描方法及装置 | |
CN201707034U (zh) | 一种基于多像机多视场的轨距检测系统定标装置 | |
WO2018145632A1 (zh) | 用于太阳能面板清扫机器人的导航系统及其导航方法 | |
CN114705122B (zh) | 一种大视场立体视觉标定方法 | |
CN113043334B (zh) | 一种基于机器人的光伏电池串定位方法 | |
CN106060399A (zh) | 一种双摄像头自动aa的方法及装置 | |
CN109798867B (zh) | 一种跨越式清洗车的定日镜异常姿态检测方法及装置 | |
CN111896032B (zh) | 一种单目散斑投射器位置的标定系统及方法 | |
CN111126381A (zh) | 一种基于r-dfpn算法的绝缘子倾斜定位与识别方法 | |
WO2023206020A1 (zh) | 电池极片的Overhang检测方法、装置、设备、存储介质 | |
CN105488807A (zh) | 一种远心镜头的标定和矫正方法 | |
CN112101118A (zh) | 一种远景与近景图像结合的光伏组件定位与匹配方法 | |
CN112718555A (zh) | 一种硅太阳能电池分选工序测试系统 | |
CN104931421A (zh) | 液晶面板视觉检测系统的定位对焦方法 | |
CN106643735A (zh) | 一种室内定位方法、装置和移动终端 | |
CN104748714B (zh) | 一种星载索网可展开天线形面精度测量方法 | |
CN103322980A (zh) | 基于立体视觉的水果姿态检测方法 | |
CN108760023B (zh) | 两端支撑太阳翼的视觉振动测量装置及方法 | |
CN107917666A (zh) | 双目视觉装置及坐标标定方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19878664 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19878664 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19878664 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 07.01.2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19878664 Country of ref document: EP Kind code of ref document: A1 |