CN110166766B - Multi-line array CCD camera coplanar collinear imaging combined debugging method - Google Patents
Multi-line array CCD camera coplanar collinear imaging combined debugging method Download PDFInfo
- Publication number
- CN110166766B CN110166766B CN201910480255.5A CN201910480255A CN110166766B CN 110166766 B CN110166766 B CN 110166766B CN 201910480255 A CN201910480255 A CN 201910480255A CN 110166766 B CN110166766 B CN 110166766B
- Authority
- CN
- China
- Prior art keywords
- camera
- width
- imaging
- distance
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 58
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000001514 detection method Methods 0.000 claims description 29
- 239000011521 glass Substances 0.000 claims description 9
- 230000003287 optical effect Effects 0.000 claims description 9
- 239000000758 substrate Substances 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 7
- 238000009434 installation Methods 0.000 claims description 6
- 238000005286 illumination Methods 0.000 claims description 4
- 238000013519 translation Methods 0.000 claims description 3
- 230000001960 triggered effect Effects 0.000 claims description 3
- 238000001444 catalytic combustion detection Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 4
- 238000011900 installation process Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
技术领域technical field
本发明涉及机器视觉技术领域,尤其涉及一种多线阵CCD相机共面共线成像联合调试方法。The invention relates to the technical field of machine vision, in particular to a coplanar and collinear imaging joint debugging method of a multi-line array CCD camera.
背景技术Background technique
随着机器视觉行业的迅速发展,当采集大型物体图像时,需要使用多台线阵CCD相机同时采集,因此多台线阵CCD相机采集图像正确拼接有着重要的作用。线阵CCD相机采集的一帧图像是一行像素点。当使用多台线阵CCD时,需要调整多台线阵CCD相机的高度、位置、角度,使得多台相机同时采集的图像在物体上对应着同一行。因此,很多专家提出多种方法用来解决多台线阵CCD相机的联合调试。目前的线阵相机位姿校准方法主要分为基于光学校准的方法和基于校准物和图像处理的方法。光学校准法将被测物划分为若干区域,每个区域配备一组可独立调整的线阵相机和光学系统,通过对各相机逐一调整使其满足测量要求。此类方法主要针对光学测量需求,具有较高精度,但调节功能单一,过分依赖光学系统性能及硬件精度,成本高。基于校准物和图像处理的方法主要研究思路为设计特定校准板及图案,并结合图像处理算法和运动控制机构进行调节。此类方法具有一定灵活性,但存在运动控制精度高、质心提取及拟合等算法复杂、须精确动态成像等局限性,工业应用时可靠性不足。针对现有方法存在过分依赖硬件、复杂图像处理算法,本发明结合实际工业应用,提出一种简单高效的校准方法,兼顾了校准效率和精度要求。With the rapid development of the machine vision industry, when collecting images of large objects, it is necessary to use multiple linear CCD cameras to collect images at the same time. Therefore, the correct stitching of images collected by multiple linear CCD cameras plays an important role. A frame of image captured by a line-array CCD camera is a row of pixels. When using multiple line array CCDs, it is necessary to adjust the height, position and angle of the multiple line array CCD cameras, so that the images collected by the multiple cameras at the same time correspond to the same line on the object. Therefore, many experts propose a variety of methods to solve the joint debugging of multiple linear CCD cameras. The current line scan camera pose calibration methods are mainly divided into methods based on optical calibration and methods based on calibrators and image processing. The optical calibration method divides the measured object into several areas, each area is equipped with a set of independently adjustable line scan cameras and optical systems, and each camera is adjusted one by one to meet the measurement requirements. This type of method is mainly aimed at optical measurement requirements and has high accuracy, but has a single adjustment function, relies too much on the performance of the optical system and hardware accuracy, and is costly. The main research idea of the method based on calibrator and image processing is to design a specific calibration plate and pattern, and adjust it with the combination of image processing algorithm and motion control mechanism. Such methods have certain flexibility, but have limitations such as high motion control accuracy, complex algorithms for centroid extraction and fitting, and the need for accurate dynamic imaging, and are not reliable enough for industrial applications. Aiming at the existing methods that rely too much on hardware and complex image processing algorithms, the present invention proposes a simple and efficient calibration method in combination with practical industrial applications, taking into account the requirements of calibration efficiency and accuracy.
发明内容SUMMARY OF THE INVENTION
基于背景技术存在的技术问题,本发明提出了一种多线阵CCD相机共面共线成像联合调试方法。Based on the technical problems existing in the background art, the present invention proposes a coplanar and collinear imaging joint debugging method for a multi-line CCD camera.
本发明采用的技术方案是:The technical scheme adopted in the present invention is:
一种多线阵CCD相机共面共线成像联合调试方法,其特征在于,包括以下步骤:A coplanar and collinear imaging joint debugging method for a multi-line array CCD camera, characterized in that it includes the following steps:
(一)相机高度与相机位置(1) Camera height and camera position
(1)建立成像系统空间坐标系用于描述成像系统的空间位置信息,设dx、Ly、Lz分别为成像系统空间坐标系的三维基准线;Lx为检测对象TFT-LCD玻璃基板的左侧边缘,Ly为光源调节时描绘的水平基准线,Lz为经过直线Lx、Ly交叉点且垂直于检测对象所在基准面的一条垂直基准线;(1) Establish the imaging system spatial coordinate system to describe the spatial position information of the imaging system. Let dx, Ly, and Lz be the three-dimensional reference lines of the imaging system spatial coordinate system, respectively; Lx is the left edge of the detection object TFT-LCD glass substrate , Ly is the horizontal reference line drawn when the light source is adjusted, Lz is a vertical reference line that passes through the intersection of the straight lines Lx and Ly and is perpendicular to the reference plane where the detection object is located;
(2)在镜头标准放大倍率为n时,镜头工作距离为h毫米,即检测基准面T到镜头下端的距离为h毫米,由此可以确定高度基准线Lh位置;调节整体相机支架,在支架水平的条件下使相机1达到高度基准位置;此时以相机1上某一特征位置,记录相机1与支架的高度差参数h1;以h1为基准,通过调节相机底座,使另外3个相机与支架间的高度差参数等于h1;当h1=h2=h3=h4时,可以认为相机等高且符合镜头成像工作距离要求,每个相机的拍摄区域整体上相互分离,边缘区域两两交接;(2) When the standard magnification of the lens is n, the working distance of the lens is h mm, that is, the distance from the detection reference plane T to the lower end of the lens is h mm, so the position of the height reference line Lh can be determined; Make
(3)以检测面两侧边界为基准,通过铅锤线方法在相机支架上标记等高检测宽度范围OE,单个相机成像的相机视场宽度yv为w1毫米,检测区域宽度为lOE长度为w2毫米,成像系统的4个相机的视场范围完整覆盖OE;相机相互之间的位置间隔Δd设置为一个相同的数值,在玻璃基板检测平面T上,4个相机拍摄区域的三处视场重叠区域宽度v相等且相机视场宽度yv、重叠区域宽度v、相机安装位置间隔Δd间的关系式为:(3) Taking the borders on both sides of the detection surface as the benchmark, mark the detection width range OE of the same height on the camera bracket by the plumb line method. The width of the camera field of view yv for a single camera imaging is w 1 mm, and the width of the detection area is l OE length. W is 2 mm, the field of view of the four cameras of the imaging system completely covers the OE; the positional distance Δd between the cameras is set to the same value, and on the glass substrate detection plane T, the four cameras shoot at three locations in the area. The relationship between the width v of the overlapping area of the field of view and the width of the camera's field of view yv, the width of the overlapping area v, and the distance between the camera installation positions Δd is:
yv=Δd+v (1)yv=Δd+v (1)
此时,以O为原点,O表示支架起点,E表示支架终点,di表示相机i到O点的距离,de表示相机4到E点的距离,Δd表示相机i与相机i+1之间的间距;P1~P4点分别表示相机1~4投影到OE上的位置,相机i的位置Pi的Ly轴坐标值可以表示为:di=d1+(i-1)Δd或di=lOE-de-(4-i)Δd,其中i=1,2,3,4;此时等高检测宽度范围OE与相机间隔Δd间存在以下关系:At this time, take O as the origin, O represents the starting point of the bracket, E represents the end point of the bracket, d i represents the distance from camera i to point O, d e represents the distance from camera 4 to point E, and Δd represents the difference between camera i and camera i+1 The distance between the points; P1~P4 points respectively represent the positions of the
lOE=d1+3Δd+de (2)l OE =d 1 +3Δd+d e (2)
为方便后续图像处理,应保证每个相机的有效视场宽度相等,而当相机1和相机4有效视场宽度相同时显然有:则由公式(2)可得此时相机1~4在相机支架上的具体位置坐标就可以确定了,之后再按照标记位置平移相机即可;In order to facilitate subsequent image processing, the effective field of view width of each camera should be guaranteed to be equal, and when the effective field of view width of
检测范围内视场重叠区域的宽度:v=w1-Δd,由于相机成像系统具有对称性,每个相机都应在视场左右区域舍弃的视场宽度;The width of the overlapping area of the field of view in the detection range: v=w 1 -Δd, due to the symmetry of the camera imaging system, each camera should be discarded in the left and right areas of the field of view the width of the field of view;
(二)相机前后位置与平行问题(2) The front and rear position and parallelism of the camera
(1)各个相机分别置于用于调节相机倾角和俯仰角的相机底座上,成像区域是否平行与光照基准线作为调节相机平行的依据,调节相机的前后位置,使相机拍摄区域处于光照范围内;(1) Each camera is placed on the camera base for adjusting the camera inclination and pitch angle. Whether the imaging area is parallel to the light reference line is used as the basis for adjusting the parallelism of the camera, and the front and rear positions of the camera are adjusted so that the camera shooting area is within the light range. ;
(2)当被检测物体经过光电传感器触发位置S时,相机开始拍摄图像,设此时相机的倾斜角为θ,则拍摄区域所在直线l与光照基准线Ly间的夹角也为θ;当玻璃基板运动距离为Δs时,由于相机扫描速度恒定,因此在成像系统坐标系中,拍摄的图像区域I可通过平移直线l获得,平移距离为Δs;显然成像系统坐标系中,被检测物体的边界与图像起始边界夹角为θ;根据相机成像原理,在图像I中,被检测物体起始边界与图像边界夹角也为θ;通过不断调节相机的左右夹角,当:(2) When the detected object passes through the trigger position S of the photoelectric sensor, the camera starts to capture images. If the inclination angle of the camera is θ at this time, the angle between the straight line l where the shooting area is located and the illumination reference line Ly is also θ; when When the moving distance of the glass substrate is Δs, since the scanning speed of the camera is constant, in the imaging system coordinate system, the captured image area I can be obtained by translating the straight line l, and the translation distance is Δs; The angle between the boundary and the starting boundary of the image is θ; according to the principle of camera imaging, in image I, the angle between the starting boundary of the detected object and the image boundary is also θ; by continuously adjusting the left and right angles of the camera, when:
θ=0 (3)θ=0 (3)
时,当前相机则已与相机支架平行。将以上步骤分别用于各个相机,使各相机均与相机支架平行。, the current camera is already parallel to the camera stand. Use the above steps for each camera so that each camera is parallel to the camera stand.
(3)任意取相机1上某一特征点作为参考点,以其到相机支架的距离d1作为依据调节其他相机到相机支架的距离满足:(3) A certain feature point on
s1=s2=s3=s4 (4)s 1 =s 2 =s 3 =s 4 (4)
则此时各个相机每帧拍摄的图片处于平行状态。At this time, the pictures captured by each camera in each frame are in a parallel state.
(三)相机俯仰角(3) Camera pitch angle
(1)以各相机成像亮度为参考,当相机光轴接近垂直方向,则拍摄区域接近光照基准线,图像亮度增强,先用此标准初略调节相机俯仰角度,由于条形光源光照区域在一个矩形范围内亮度均匀,当调节相机俯仰角,使相机拍摄位置在该矩形区域内移动时,图像均为高亮且亮度变化不明显;(1) Taking the imaging brightness of each camera as a reference, when the optical axis of the camera is close to the vertical direction, the shooting area is close to the light reference line, and the image brightness is enhanced. First, use this standard to adjust the camera's pitch angle slightly. The brightness is uniform in the rectangular area. When the camera pitch angle is adjusted to move the camera shooting position within the rectangular area, the images are all highlighted and the brightness changes are not obvious;
(2)通过运动成像的方式对俯仰角进行进一步精确判别:通过调节相机1俯仰角,记录亮度高且无明显亮度变化的俯仰角范围θ1~θn,取中间值作为相机1的角度准确值,即:(2) Further accurate judgment of the pitch angle by means of motion imaging: by adjusting the pitch angle of
θm=(θ1+θn)/2θ m =(θ 1 +θ n )/2
将此时相机1的拍摄位置看做光照基准线所在位置;然后通过运动平台让4台相机同时对被检测物体成像;当被检测物体经过光电传感器触发位置S时,触发相机开始采集;被检测物体运动Δs时,以相机1拍摄得到的图像中的空白区域宽度x1为基准,当相机i的采集位置低于相机1采集位置时,其拍摄得到的图像中空白区域宽度xi>x1,反之当相机i的采集位置高于相机1采集位置时xi<x1;因此,当:The shooting position of
x1=x2=x3=x4 x 1 =x 2 =x 3 =x 4
时可使各相机成像位置处于十分接近且平行于光照基准线的同一直线上。At the same time, the imaging positions of each camera can be placed on the same line that is very close and parallel to the lighting reference line.
本发明的优点是:The advantages of the present invention are:
本发明解决了传统多线阵CCD相机共面共线拍摄联合调试方法难以兼顾校准效率和精度要求的问题,实现了校准效率高、精度高。The invention solves the problem that the traditional multi-line array CCD camera coplanar and collinear shooting joint debugging method is difficult to take into account the requirements of calibration efficiency and precision, and realizes high calibration efficiency and high precision.
附图说明Description of drawings
图1为相机高度与位置问题示意图。Figure 1 is a schematic diagram of the camera height and position problem.
图2为相机平行调节与前后位置问题示意图。Figure 2 is a schematic diagram of the problem of camera parallel adjustment and front and rear position.
图3为相机拍摄区域与照明区域位置关系。Figure 3 shows the positional relationship between the camera shooting area and the lighting area.
图4为倾斜相机成像原理。Figure 4 shows the imaging principle of the tilt camera.
图5为相机俯仰角问题示意图。Figure 5 is a schematic diagram of the camera pitch angle problem.
图6为相机俯仰调节中的运动成像示意图。FIG. 6 is a schematic diagram of motion imaging in camera pitch adjustment.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments.
实施例。Example.
一种多线阵CCD相机共面共线成像联合调试方法,线阵CCD相机的拍摄区域在检测基准面上可看做一条定长线段,安装相机时只能初略估计相机位置,而相机的准确位置、相机高度、前后位置、是否平行、俯仰角度等情况均需要进行进一步准确调节。因此,在照明系统调节完毕后,需要进行相机调节。A joint debugging method for coplanar and collinear imaging of multi-line CCD cameras. The shooting area of the line CCD camera can be regarded as a fixed-length line segment on the detection reference plane. The exact position, camera height, front-to-back position, parallelism, pitch angle, etc. need to be further adjusted accurately. Therefore, after the lighting system is adjusted, the camera adjustment needs to be performed.
(一)相机高度与相机位置(1) Camera height and camera position
相机安装过程中,只能初略估计相机高度,且各相机高度通过肉眼进行调整也容易出现高低不齐的情况。由于工业相机的镜头具有一个固定范围,当相机整体高度处在工作距离之外时,相机无法清晰成像;当相机高低不齐时,若完全通过调节焦距来使相机清晰成像,则镜头焦距容易产生较大差异。因此,需要事先调节并校准相机高度。During the installation of the camera, the height of the camera can only be roughly estimated, and the height of each camera is easily adjusted by the naked eye. Since the lens of an industrial camera has a fixed range, when the overall height of the camera is outside the working distance, the camera cannot image clearly; when the height of the camera is uneven, if the camera is completely adjusted to make a clear image, the focal length of the lens is easy to produce big difference. Therefore, the camera height needs to be adjusted and calibrated in advance.
如图1所示,为了描述成像系统的空间位置信息,需要建立成像系统空间坐标系。其中Lx、Ly、Lz分别为成像系统空间坐标系的三维基准线。Lx为检测对象TFT-LCD玻璃基板的左侧边缘,Ly为光源调节时描绘的水平基准线,Lz为经过直线Lx、Ly交叉点且垂直于检测对象所在基准面的一条垂直基准线。后续描述成像系统时也将延用此三维坐标系。As shown in Fig. 1, in order to describe the spatial position information of the imaging system, it is necessary to establish a spatial coordinate system of the imaging system. Among them, Lx, Ly, and Lz are the three-dimensional reference lines of the imaging system spatial coordinate system, respectively. Lx is the left edge of the TFT-LCD glass substrate of the detection object, Ly is the horizontal reference line drawn when the light source is adjusted, and Lz is a vertical reference line that passes through the intersection of the straight lines Lx and Ly and is perpendicular to the reference plane where the detection object is located. This three-dimensional coordinate system will also be used in subsequent descriptions of the imaging system.
根据镜头文档可知,在镜头标准放大倍率为n时,由此可以计算出镜头工作距离为h毫米,即检测基准面T到镜头下端的距离为h毫米。由此可以确定高度基准线Lh位置。调节整体相机支架,在支架水平的条件下使相机1达到高度基准位置。此时以相机1上某一特征位置,记录相机1与支架的高度差参数h1。以h1为基准,通过调节相机底座,使另外3个相机与支架间的高度差参数等于h1。当h1=h2=h3=h4时,可以认为相机等高且符合镜头成像工作距离要求。According to the lens documentation, when the standard magnification of the lens is n, it can be calculated that the working distance of the lens is h mm, that is, the distance from the detection reference plane T to the lower end of the lens is h mm. From this, the position of the height reference line Lh can be determined. Adjust the overall camera stand to make the
成像系统的4个相机间需要相互配合,以完成整个靶面的成像工作,因此每个相机的拍摄区域应该整体上相互分离,边缘区域两两交接。若相机位置摆放不合理,容易出现拍摄缺漏的区域,且事先调节相机位置也有利于后续的视场拼接工作。The four cameras of the imaging system need to cooperate with each other to complete the imaging of the entire target surface. Therefore, the shooting areas of each camera should be separated from each other as a whole, and the edge areas should be handed over in pairs. If the camera position is unreasonable, it is easy to have missing areas, and adjusting the camera position in advance is also conducive to the subsequent field of view stitching work.
以检测面两侧边界为基准,通过铅锤线方法在相机支架上标记等高检测宽度范围OE。由上节可知,单个相机成像的相机视场宽度yv为w1毫米,检测区域宽度为lOE长度为w2毫米。显然为达到检测目的,4台相机的视场范围应该完整覆盖OE。为方便相机视场拼接,相机相互之间的位置间隔Δd最好设置为一个相同的数值。而当相机安装位置的间隔距离Δd相同时,显然在玻璃基板检测平面T上,4台相机拍摄区域的三处视场重叠区域宽度v相等且相机视场宽度yv、重叠区域宽度v、相机安装位置间隔Δd间的关系式为:Based on the borders on both sides of the detection surface, the detection width range OE of the same height is marked on the camera bracket by the plumb line method. It can be seen from the previous section that the width of the camera's field of view for imaging by a single camera is w 1 mm, the width of the detection area is l, and the length of the OE is w 2 mm. Obviously, for the purpose of detection, the field of view of the four cameras should completely cover the OE. In order to facilitate the splicing of the camera's field of view, the position interval Δd between the cameras is preferably set to the same value. When the separation distance Δd of the camera installation positions is the same, it is obvious that on the glass substrate detection plane T, the overlapping area widths v of the three fields of view in the shooting areas of the four cameras are equal, and the camera field of view width yv, the overlapping area width v, the camera installation The relationship between the position interval Δd is:
yv=Δd+v (1)yv=Δd+v (1)
此时,以O为原点,O表示支架起点,E表示支架终点,di表示相机i到O点的距离,de表示相机4到E点的距离,Δd表示相机i与相机i+1之间的间距;P1~P4点分别表示相机1~4投影到OE上的位置,相机i的位置Pi的Ly轴坐标值可以表示为:di=d1+(i-1)Δd或di=lOE-de-(4-i)Δd,其中i=1,2,3,4;此时等高检测宽度范围OE与相机间隔Δd间存在以下关系:At this time, take O as the origin, O represents the starting point of the bracket, E represents the end point of the bracket, d i represents the distance from camera i to point O, d e represents the distance from camera 4 to point E, and Δd represents the difference between camera i and camera i+1 The distance between the points; P1~P4 points respectively represent the positions of the
lOE=d1+3Δd+de (2)l OE =d 1 +3Δd+d e (2)
为方便后续图像处理,应保证每个相机的有效视场宽度相等,而当相机1和相机4有效视场宽度相同时显然有:则由公式(2)可得此时相机1~4在相机支架上的具体位置坐标就可以确定了,之后再按照标记位置平移相机即可;In order to facilitate subsequent image processing, the effective field of view width of each camera should be guaranteed to be equal, and when the effective field of view width of
检测范围内视场重叠区域的宽度:v=w1-Δd,由于相机成像系统具有对称性,每个相机都应在视场左右区域舍弃的视场宽度;The width of the overlapping area of the field of view in the detection range: v=w 1 -Δd, due to the symmetry of the camera imaging system, each camera should be discarded in the left and right areas of the field of view the width of the field of view;
(二)相机前后位置与平行问题(2) The front and rear position and parallelism of the camera
机器视觉检测系统使用工业相机时,一般会先将相机安装于一个可调节多种角度的相机底座上,而后再将底座安装于相机支架上。本文用于调节相机倾角和俯仰角的相机底座为两层精密角位移台组合而成的符合型相机底座。When a machine vision inspection system uses an industrial camera, the camera is generally installed on a camera base that can be adjusted to various angles, and then the base is installed on the camera bracket. The camera base used in this article to adjust the camera tilt and pitch angle is a conforming camera base composed of two layers of precision angular displacement stages.
在安装过程中,并不能完全保证每个相机前后位置对齐,也无法判断相机相对于光照区域是否平行。当相机没有安装平行时,由于相机与其拍摄区域间是严格平行关系,因此相机拍摄区域将受到影响,与光照区域成一定角度倾斜。此时若不进行调节,4个相机将无法达到同一拍摄基准线(光照基准线),如图2所示:During the installation process, it is not completely guaranteed that the front and rear positions of each camera are aligned, nor can it be judged whether the cameras are parallel to the lighted area. When the camera is not installed in parallel, since the camera and its shooting area are strictly parallel, the camera shooting area will be affected and inclined at a certain angle to the lighting area. If no adjustment is made at this time, the four cameras will not be able to reach the same shooting baseline (lighting baseline), as shown in Figure 2:
图中l′i(i=1,2,3,4)为相机拍摄区域所在直线经平移至坐标原点形成的直线。相机安装过程中有轻微不平,就会使相机拍摄区域与光照区域无法完全匹配。In the figure, l′ i (i=1, 2, 3, 4) is a straight line formed by translating the straight line where the camera shooting area is located to the coordinate origin. A slight unevenness in the camera installation process will prevent the camera shooting area from being perfectly matched to the lighting area.
如图3所示,当相机前后位置接近合适位置,而相机存在左右倾斜时,就会出现图a、b所描述的情况。不考虑相机俯仰问题时,当相机太靠前或靠后就会出现图c、d所描述的情况。而图e所描述的成像方式是我们最终需要达成。As shown in Figure 3, when the front and rear position of the camera is close to the appropriate position, and the camera is tilted left and right, the situation described in Figures a and b will occur. When the camera pitch problem is not considered, the situation described in Figures c and d will occur when the camera is too far forward or backward. And the imaging method described in Figure e is what we finally need to achieve.
在解决相机不平行和前后不齐的问题时,我们应该首先解决相机不平行的问题。当相机处于平行状态时,我们可以随机选择相机上某一特征点,将该点与支架间的水平距离用于替代相机的前后位置坐标作为调节相机前后位置的参考。When solving the problem of camera non-parallel and front and rear, we should first solve the problem of camera non-parallel. When the camera is in a parallel state, we can randomly select a feature point on the camera, and use the horizontal distance between the point and the bracket to replace the front and rear position coordinates of the camera as a reference for adjusting the front and rear position of the camera.
由于相机与其成像区域是严格平行的,因此可以将成像区域是否平行与光照基准线作为调节相机平行的依据。而为使相机成像清晰且亮度合适,可以调节相机的前后位置,使相机拍摄区域能处于光照范围内。由于还存在俯仰角问题,此时相机的前后位置还不能作为最终结果,而是需要在相机平行问题解决后通过前文所述的校准方法进一步调节。Since the camera is strictly parallel to its imaging area, whether the imaging area is parallel to the light reference line can be used as the basis for adjusting the parallelism of the camera. In order to make the image of the camera clear and the brightness is appropriate, the front and rear positions of the camera can be adjusted so that the shooting area of the camera can be within the illumination range. Due to the problem of the pitch angle, the front and rear positions of the camera cannot be used as the final result at this time, but need to be further adjusted by the calibration method described above after the camera parallel problem is solved.
为调节相机平行,成像环节如图4(a)所示,当被检测物体经过光电传感器触发位置S时,相机开始拍摄图像。若此时相机的倾斜角为θ,则拍摄区域所在直线l与光照基准线Ly间的夹角也为θ。当玻璃基板运动距离为Δs时,由于相机扫描速度恒定,因此在成像系统坐标系中,拍摄的图像区域I可通过平移直线l获得,平移距离为Δs。显然成像系统坐标系中,被检测物体的边界与图像起始边界夹角为θ。根据相机成像原理,在图像I中,被检测物体起始边界与图像边界夹角也为θ;通过不断调节相机的左右夹角,当:In order to adjust the parallelism of the camera, the imaging process is shown in Figure 4(a). When the detected object passes the trigger position S of the photoelectric sensor, the camera starts to capture images. If the tilt angle of the camera is θ at this time, the angle between the straight line l where the shooting area is located and the lighting reference line Ly is also θ. When the moving distance of the glass substrate is Δs, since the scanning speed of the camera is constant, in the imaging system coordinate system, the captured image area I can be obtained by translating the straight line l, and the translation distance is Δs. Obviously, in the coordinate system of the imaging system, the angle between the boundary of the detected object and the starting boundary of the image is θ. According to the camera imaging principle, in image I, the angle between the starting boundary of the detected object and the image boundary is also θ; by continuously adjusting the left and right angles of the camera, when:
θ=0 (3)θ=0 (3)
时,当前相机则已与相机支架平行。将以上步骤分别用于各个相机,使各相机均与相机支架平行。, the current camera is already parallel to the camera stand. Use the above steps for each camera so that each camera is parallel to the camera stand.
此时虽然还未调节相机俯仰角,但各相机俯仰角本就比较小,因此对相机上的特征点前后位置影响极小,可以忽略不计。因此可以任意取相机1上某一特征点作为参考点,以其到相机支架的距离d1作为依据调节其他相机到相机支架的距离满足:Although the camera pitch angle has not been adjusted at this time, the pitch angle of each camera is relatively small, so the influence on the front and rear positions of the feature points on the camera is very small and can be ignored. Therefore, a certain feature point on the
s1=s2=s3=s4 (4)s 1 =s 2 =s 3 =s 4 (4)
则此时各个相机每帧拍摄的图片处于平行状态。At this time, the pictures captured by each camera in each frame are in a parallel state.
(三)相机俯仰角(3) Camera pitch angle
相机先后经过Lz方向上的高度调节,Ly方向上的安装位置调节,Lx方向上的前后位置调节,并使相机平行于光照基准线。此时,如图5(b)所示,理论上在成像系统Lx、Lz所在平面,4个相机的成像位置将会重合于垂直基准线Lz上某一点。由于相机俯仰角问题相机光轴与垂直基准线Lz将会行成一个极小的夹角。此时相机的拍摄情况如图5(a)所示。显然我们可以先以各相机成像亮度为参考,当相机光轴接近垂直方向,则拍摄区域接近光照基准线,图像亮度增强。此标准只能用于初略调节相机俯仰角度,由于条形光源光照区域在一个矩形范围内亮度均匀,当调节相机俯仰角,使相机拍摄位置在该矩形区域内移动时,图像均为高亮且亮度变化不明显。The camera is successively adjusted in height in the Lz direction, in the installation position in the Ly direction, and in the front and rear positions in the Lx direction, and make the camera parallel to the light reference line. At this time, as shown in Figure 5(b), theoretically, on the plane where the imaging systems Lx and Lz are located, the imaging positions of the four cameras will coincide at a certain point on the vertical reference line Lz. Due to the problem of camera pitch angle, the optical axis of the camera and the vertical reference line Lz will form a very small angle. The shooting situation of the camera at this time is shown in Fig. 5(a). Obviously, we can take the imaging brightness of each camera as a reference. When the optical axis of the camera is close to the vertical direction, the shooting area is close to the lighting baseline, and the image brightness is enhanced. This standard can only be used to adjust the tilt angle of the camera slightly. Since the illumination area of the strip light source has uniform brightness in a rectangular area, when the tilt angle of the camera is adjusted to move the camera shooting position within the rectangular area, the images are all highlighted. And the brightness change is not obvious.
此时应当通过运动成像的方式对俯仰角进行进一步精确判别。在此之前,我们可以通过调节相机1俯仰角,记录亮度高且无明显亮度变化的俯仰角范围θ1~θn,取中间值作为相机1的角度准确值,即:At this time, the pitch angle should be further accurately judged by means of motion imaging. Before that, we can record the pitch angle range θ 1 ~ θ n with high brightness and no obvious brightness change by adjusting the pitch angle of
θm=(θ1+θn)/2θ m =(θ 1 +θ n )/2
将此时相机1的拍摄位置看做光照基准线所在位置。然后通过运动平台让4台相机同时对被检测物体成像。其成像效果如图6所示。当被检测物体经过光电传感器触发位置S时,触发相机开始采集。被检测物体运动Δs时,以相机1拍摄得到的图像中的空白区域宽度x1为基准,当相机i的采集位置低于相机1采集位置时,其拍摄得到的图像中空白区域宽度xi>x1,反之当相机i的采集位置高于相机1采集位置时xi<x1。因此,当:The shooting position of the
x1=x2=x3=x4 x 1 =x 2 =x 3 =x 4
时可使各相机成像位置处于十分接近且平行于光照基准线的同一直线上。At the same time, the imaging positions of each camera can be placed on the same line that is very close and parallel to the lighting reference line.
以上所述,仅为本发明较佳的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,根据本发明的技术方案及其发明构思加以等同替换或改变,都应涵盖在本发明的保护范围之内。The above description is only a preferred embodiment of the present invention, but the protection scope of the present invention is not limited to this. The equivalent replacement or change of the inventive concept thereof shall be included within the protection scope of the present invention.
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910480255.5A CN110166766B (en) | 2019-06-04 | 2019-06-04 | Multi-line array CCD camera coplanar collinear imaging combined debugging method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910480255.5A CN110166766B (en) | 2019-06-04 | 2019-06-04 | Multi-line array CCD camera coplanar collinear imaging combined debugging method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110166766A CN110166766A (en) | 2019-08-23 |
CN110166766B true CN110166766B (en) | 2020-09-08 |
Family
ID=67627156
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910480255.5A Active CN110166766B (en) | 2019-06-04 | 2019-06-04 | Multi-line array CCD camera coplanar collinear imaging combined debugging method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110166766B (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114747198B (en) * | 2019-12-10 | 2024-04-02 | 深圳迈瑞生物医疗电子股份有限公司 | Cell image analysis device and camera installation parallelism verification method |
CN111327835B (en) * | 2020-03-20 | 2021-07-09 | 合肥埃科光电科技有限公司 | Multi-line time-sharing exposure processing method and system for camera |
CN111366531B (en) * | 2020-04-03 | 2023-02-17 | 湖南讯目科技有限公司 | Linear array camera adjusting auxiliary device and adjusting method |
CN112428264B (en) * | 2020-10-26 | 2021-12-07 | 中国计量大学 | Robot arm correction method and system |
CN112460414B (en) * | 2020-12-09 | 2024-07-02 | 广东龙天智能仪器股份有限公司 | Linear array camera group mounting mechanism |
CN112581547B (en) * | 2020-12-30 | 2022-11-08 | 安徽地势坤光电科技有限公司 | Rapid method for adjusting installation angle of imaging lens |
CN113364980B (en) * | 2021-05-31 | 2022-12-06 | 浙江大华技术股份有限公司 | Device control method, device, storage medium, and electronic apparatus |
CN116256909B (en) * | 2023-05-15 | 2023-08-08 | 苏州优备精密智能装备股份有限公司 | Real-time detection processing system and processing method for liquid crystal coating |
CN117241012B (en) * | 2023-11-16 | 2024-02-06 | 杭州百子尖科技股份有限公司 | Calibrating device, calibrating method and machine vision detection system of linear array camera |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106289106A (en) * | 2016-08-04 | 2017-01-04 | 北京航空航天大学 | Stereo vision sensor that a kind of line-scan digital camera and area array cameras combine and scaling method |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7708204B2 (en) * | 2005-02-07 | 2010-05-04 | Hamar Laser Instruments, Inc. | Laser alignment apparatus |
US7309161B1 (en) * | 2006-10-25 | 2007-12-18 | Agilent Technologies, Inc. | Method for determination of magnification in a line scan camera |
CN101419177B (en) * | 2007-10-25 | 2011-06-15 | 宝山钢铁股份有限公司 | Method for demarcating multi line scan video cameras |
CN106982370B (en) * | 2017-05-03 | 2018-07-06 | 武汉科技大学 | A kind of camera high-precision calibration scaling board and the method for realizing calibration |
CN107976146B (en) * | 2017-11-01 | 2019-12-10 | 中国船舶重工集团公司第七一九研究所 | Self-calibration method and measurement method of linear array CCD camera |
CN109724623B (en) * | 2018-12-26 | 2020-08-21 | 中国科学院长春光学精密机械与物理研究所 | A two-dimensional calibration method and device for azimuth elements in a surveying and mapping camera |
-
2019
- 2019-06-04 CN CN201910480255.5A patent/CN110166766B/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106289106A (en) * | 2016-08-04 | 2017-01-04 | 北京航空航天大学 | Stereo vision sensor that a kind of line-scan digital camera and area array cameras combine and scaling method |
Also Published As
Publication number | Publication date |
---|---|
CN110166766A (en) | 2019-08-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110166766B (en) | Multi-line array CCD camera coplanar collinear imaging combined debugging method | |
US10690492B2 (en) | Structural light parameter calibration device and method based on front-coating plane mirror | |
CN110006905B (en) | Large-caliber ultra-clean smooth surface defect detection device combined with linear area array camera | |
CN102023164B (en) | For detecting the apparatus and method of the local defect of transparent plate | |
CN105258710B (en) | A kind of high-precision principal point for camera scaling method | |
CN110259067B (en) | Robotic tile laying position recognition method and system | |
CN110596132A (en) | A system suitable for industrial image inspection | |
CN107683401B (en) | Shape measuring device and shape measuring method | |
CN109187637B (en) | Method and system for workpiece defect measurement based on infrared thermal imager | |
CN109462752B (en) | Method and device for measuring optical center position of camera module | |
WO2010084920A1 (en) | Pantograph height measuring device and calibration method therefor | |
CN109084959B (en) | An Optical Axis Parallelism Correction Method Based on Binocular Ranging Algorithm | |
JP2022171677A5 (en) | ||
CN108805940B (en) | Method for tracking and positioning zoom camera in zooming process | |
CN103453834A (en) | Novel upper light source inclined illumination type image collecting method for tile size detection | |
CN106595516B (en) | A kind of big depth of field structural light measurement method based on tight shot | |
CN103323216B (en) | A kind of device and method detecting parallax error of collimator | |
CN105758337A (en) | Method for obtaining included angel between a lens plane and an image sensor plane | |
Sueishi et al. | Mirror-based high-speed gaze controller calibration with optics and illumination control | |
CN113109259B (en) | Intelligent navigation method and device for image | |
JPH0820207B2 (en) | Optical 3D position measurement method | |
CN108709509A (en) | Profile camera, the mating contactless caliper of super-large diameter revolving body workpieces and contactless revolving body measurement method | |
CN114454177A (en) | A robot end position compensation method based on binocular stereo vision | |
CN110246121A (en) | A kind of electronic assemblies assembly accuracy detection method of view-based access control model | |
CN222213400U (en) | A calibration device for binocular camera |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |