CN116008177A - SMT component high defect identification method, system and readable medium thereof - Google Patents

SMT component high defect identification method, system and readable medium thereof Download PDF

Info

Publication number
CN116008177A
CN116008177A CN202211561975.2A CN202211561975A CN116008177A CN 116008177 A CN116008177 A CN 116008177A CN 202211561975 A CN202211561975 A CN 202211561975A CN 116008177 A CN116008177 A CN 116008177A
Authority
CN
China
Prior art keywords
smt
height
component
circuit board
threshold
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211561975.2A
Other languages
Chinese (zh)
Inventor
戴志伟
任飞舟
何海红
陈艳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Kerss Electronics Co ltd
Original Assignee
Guangzhou Kerss Electronics Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Kerss Electronics Co ltd filed Critical Guangzhou Kerss Electronics Co ltd
Priority to CN202211561975.2A priority Critical patent/CN116008177A/en
Publication of CN116008177A publication Critical patent/CN116008177A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Image Processing (AREA)

Abstract

The invention discloses a method, a system and a readable medium for identifying the height defect of an SMT (surface mounted technology) component, which are characterized in that a three-dimensional point cloud model image of the SMT circuit board to be tested is obtained, and the positioning information of the SMT component on the SMT circuit board is matched and inquired through an ICP algorithm; setting a plurality of identification areas on the SMT component according to the positioning information, and acquiring the height value of each identification area according to the SMT component area relation in the three-dimensional point cloud model image; and comparing the height value of the identification area with a preset height threshold value, and judging whether the SMT component has a height defect or not. The method and the device can be used for identifying and detecting the defects of the SMT components in the height direction such as the height direction and the tilting direction, and can be used for realizing comprehensive and high-precision automatic defect detection of the SMT patch by combining the existing two-dimensional surface detection technology.

Description

SMT元器件高度缺陷识别方法、系统及其可读介质SMT component height defect identification method, system and readable medium

技术领域technical field

本发明涉及STM贴片技术领域,特别涉及一种SMT元器件高度缺陷识别方法、系统及其可读介质。The invention relates to the technical field of STM patching, in particular to a method, system and readable medium for identifying height defects of SMT components.

背景技术Background technique

SMT是表面组装技术(表面贴装技术)(Surface Mounted Technology的缩写),是目前电子组装行业里最流行的一种技术和工艺。电子电路表面组装技术(Surface MountTechnology,SMT),称为表面贴装或表面安装技术。它是一种将无引脚或短引线表面组装元器件(简称SMC/SMD,中文称片状元器件)安装在印制集成STM元器件的电路板(PrintedCircuit Board,PCB)的表面或其它基板的表面上,通过再流焊或浸焊等方法加以焊接组装的电路装连技术。SMT is Surface Mount Technology (Surface Mount Technology) (abbreviation of Surface Mounted Technology), which is currently the most popular technology and process in the electronics assembly industry. Electronic circuit surface assembly technology (Surface Mount Technology, SMT), known as surface mount or surface mount technology. It is a method of mounting non-pin or short-lead surface mount components (SMC/SMD for short, Chinese chip components) on the surface of a printed circuit board (PCB) or other substrates that print integrated STM components. On the surface, it is a circuit assembly technology that is soldered and assembled by methods such as reflow soldering or dip soldering.

SMT技术出现后慢慢的取代了人工贴片,然而在贴片机进行焊接的过程中会出现一些残次品,进而检测技术就显得极为重要,一个高效的检测系统能够大大降低返厂率,有效提高工业生产的效率,常见的SMT贴片缺陷分为两类,第一类缺陷包括元件偏移、立件、异物、元件贴反等2D范围内的缺陷;第二类缺陷包括元件厚度出错、走线弯曲偏移、走线交叉等3D范围内的缺陷。为了检测第一类缺陷,AOI系统需要实时拼接获取的高分辨率SMT贴片局部图像,并运用机器视觉理论知识对拼接全景图进行定位检测。AOI原理是通过RGB三色光从三种不同的角度照射到元件上再反射回来,不同的焊点形态反射不同的色光,参考位置和设定参数对反射光的颜色和亮度等数据进行矢量分析。检测能力具有一定局限性,只能采取到二维的图像信息,无法得到元器件的高度,After the emergence of SMT technology, it gradually replaced manual placement. However, some defective products will appear during the welding process of the placement machine, so the detection technology is extremely important. An efficient detection system can greatly reduce the return rate. Effectively improve the efficiency of industrial production, common SMT patch defects are divided into two categories, the first type of defects include component offset, vertical parts, foreign objects, components reversed and other defects in the 2D range; the second type of defects include component thickness error, Defects in the 3D range such as trace bending offset, trace crossing, etc. In order to detect the first type of defects, the AOI system needs to splice the obtained high-resolution SMT patch partial images in real time, and use the theoretical knowledge of machine vision to perform positioning detection on the spliced panoramic images. The principle of AOI is to irradiate the component with RGB three-color light from three different angles and then reflect it back. Different shapes of solder joints reflect different color light, and vector analysis is performed on the color and brightness of the reflected light with reference to the position and set parameters. The detection ability has certain limitations, only two-dimensional image information can be taken, and the height of components cannot be obtained.

现有的2D检测手段难以识别SMT元器件的高度缺陷,这类缺陷会产生短路、虚焊等严重故障,而三维检测能够准确检测出元器件和焊锡的高度,进而对元器件进行进一步分析,能够极大的提高检测的准确率;因此需要开发SMT元器件高度缺陷识别方法。The existing 2D detection methods are difficult to identify the height defects of SMT components, such defects will cause serious faults such as short circuit and false soldering, while 3D detection can accurately detect the height of components and solder, and then further analyze the components, It can greatly improve the accuracy of detection; therefore, it is necessary to develop a method for identifying high defects of SMT components.

发明内容Contents of the invention

本发明要解决的技术问题是提供一种SMT元器件高度缺陷识别方法、系统及其可读介质,旨在解决现有的2D检测手段难以识别SMT元器件高度缺陷的技术问题。The technical problem to be solved by the present invention is to provide a method, system and readable medium for identifying height defects of SMT components, aiming to solve the technical problem that the existing 2D detection means are difficult to identify the height defects of SMT components.

为解决上述技术问题,本发明第一方面提出了一种SMT元器件高度缺陷识别方法,该方法包括:In order to solve the above-mentioned technical problems, the first aspect of the present invention proposes a method for identifying defects in the height of SMT components, the method comprising:

获取待测SMT电路板的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述SMT电路板上的定位信息;Obtain the three-dimensional point cloud model image of the SMT circuit board to be tested, and query the positioning information of the SMT components on the SMT circuit board through ICP algorithm matching;

根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值;Setting multiple identification areas on the SMT components according to the positioning information, and obtaining the height value of each identification area according to the regional relationship of the SMT components in the three-dimensional point cloud model image;

根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷。According to the comparison between the height value of the identification area and the preset height threshold, it is judged whether there is a height defect in the SMT component.

进一步的,所述方法还包括:Further, the method also includes:

预先获取合格SMT电路板的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述合格SMT电路板上的定位信息;Pre-acquire the three-dimensional point cloud model image of the qualified SMT circuit board, and query the positioning information of the SMT components on the qualified SMT circuit board through ICP algorithm matching;

根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取并存储每一个所述识别区域的高度阈值。A plurality of identification areas are set on the SMT component according to the positioning information, and a height threshold of each identification area is obtained and stored according to the regional relationship of the SMT component in the three-dimensional point cloud model image.

进一步的,所述获取待测SMT电路板的三维点云模型图像包括:Further, said acquisition of the three-dimensional point cloud model image of the SMT circuit board to be tested comprises:

对不同视角的待测SMT电路板图片通过RANSAC算法提纯得到特征匹配点,设两点云的特征点集分别为So和X;The pictures of the SMT circuit board to be tested from different angles of view are purified by the RANSAC algorithm to obtain the feature matching points, and the feature point sets of the two point clouds are respectively So and X;

设迭代次数为k,令k=0,利用RANSAC计算出的空间变换矩阵Ro和To对提纯后的特征点集So进行初始变换,建立特征点集X的Kd-tree;Set the number of iterations as k, let k=0, use the spatial transformation matrices Ro and To calculated by RANSAC to perform initial transformation on the purified feature point set So, and establish the Kd-tree of the feature point set X;

S1=R0S0+T0S 1 =R 0 S 0 +T 0 ,

寻找Sk在X中的最近的点Sk1利用特征匹配点集Sk和Sk1,计算坐标变换知阵Rk和Tk,利用以下公式进行特征点集的坐标变换:Find the nearest point Sk1 of Sk in X, use the feature matching point set Sk and Sk1, calculate the coordinate transformation matrix Rk and Tk, and use the following formula to perform the coordinate transformation of the feature point set:

Sk+1=RkSk+Tk S k+1 =R k S k +T k

判断距离误差D是否收敛,如果Dk-Dk+1<M,则收敛,其中M为设定的阈值,且M>0,否则,重新寻找Sk在X中的最近的点Sk1利用特征匹配点集Sk和Sk1。Determine whether the distance error D is convergent, if Dk-Dk+1<M, then converge, where M is the set threshold, and M>0, otherwise, re-find the nearest point Sk1 of Sk in X and use the feature matching point set Sk and Sk1.

进一步的,所述对不同视角的待测SMT电路板图形通过RANSAC算法提纯得到特征匹配点包括:Further, the feature matching points obtained by purifying the SMT circuit board graphics of different viewing angles through the RANSAC algorithm include:

利用SIFT算法对至少两幅不同视角的待测SMT电路板图片进行特征匹配,设置判断匹配的阈值0.6,找到N1对特征匹配点;Use the SIFT algorithm to perform feature matching on at least two pictures of the SMT circuit board to be tested from different viewing angles, set the threshold for judging matching to 0.6, and find N1 pairs of feature matching points;

同时设定一个A*A的识别区域,共找到N2对特征匹配点,将所述N2对特征匹配点用RANSAC算法进行计算,阈值设置为0.8,即至少需有80%的特征点能满足求解出的旋转矩阵和平移向量,得到旋转矩阵Ro和平移向量To。At the same time, set an A*A recognition area, find N2 pairs of feature matching points in total, calculate the N2 pairs of feature matching points with the RANSAC algorithm, set the threshold to 0.8, that is, at least 80% of the feature points must be able to satisfy the solution The obtained rotation matrix and translation vector are obtained to obtain the rotation matrix Ro and translation vector To.

进一步的,所述根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值具体包括:Further, according to the positioning information, multiple identification areas are set on the SMT components, and the height value of each identification area is obtained according to the regional relationship of the SMT components in the three-dimensional point cloud model image. include:

所述根据所述定位信息在所述SMT元器件平面上下左右设置至少4个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系提取每一个所述识别区域内所有特征匹配点的高度值,并将所有特征匹配点的高度值的平均值作为所述识别区域的高度值。According to the positioning information, at least 4 identification areas are set up, down, left, and right on the plane of the SMT components, and all feature matches in each of the identification areas are extracted according to the regional relationship of the SMT components in the three-dimensional point cloud model image The height value of the point, and the average value of the height values of all feature matching points is used as the height value of the recognition area.

进一步,所述根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷包括:Further, comparing the height value of the identified area with the preset height threshold, judging whether there is a height defect in the SMT component includes:

设定SMT元器件的最低高度阈值Hl和最高高度阈值Hh,将所述识别区域的高度值与最低高度阈值Hl和最高高度阈值Hh比较,若低于最低高度阈值Hl,判定为“元件高度低”,若高于最高高度阈值Hh,判定为“元件高度高”。Set the minimum height threshold Hl and the highest height threshold Hh of SMT components, compare the height value of the identified area with the minimum height threshold Hl and the highest height threshold Hh, if it is lower than the minimum height threshold Hl, it is judged as "the component height is low ", if it is higher than the maximum height threshold Hh, it is judged as "the component height is high".

进一步的,所述根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷还包括:Further, comparing the height value of the identified area with the preset height threshold, judging whether there is a height defect in the SMT component also includes:

设定水平倾斜角度阈值TH,根据所述SMT元器件水平方向的所述识别区域之间的高度差获取水平倾斜角度T1,当所述SMT元器件的水平倾斜角度T1大于所述水平倾斜角度阈值TH,判定为“元件水平倾斜”;Set the horizontal inclination angle threshold TH, obtain the horizontal inclination angle T1 according to the height difference between the identification areas in the horizontal direction of the SMT components, when the horizontal inclination angle T1 of the SMT components is greater than the horizontal inclination angle threshold TH, judged as "component horizontal tilt";

设定竖直倾斜角度阈值TV,根据所述SMT元器件竖直方向的所述识别区域之间的高度差获取竖直倾斜角度T2,当所述SMT元器件的竖直倾斜角度T2大于所述竖直倾斜角度阈值TV,判定为“元件竖直倾斜”。Set the vertical inclination angle threshold TV, and obtain the vertical inclination angle T2 according to the height difference between the identification areas in the vertical direction of the SMT components, when the vertical inclination angle T2 of the SMT components is greater than the The vertical tilt angle threshold TV is determined as "the component is vertically tilted".

本发明第二方面提出了一种SMT元器件高度缺陷识别系统,包括:The second aspect of the present invention proposes a SMT component height defect identification system, comprising:

设置在工作台面的一组CCD摄像头、投影仪,通过所述CCD摄像头拍摄投影仪的光投射到待测SMT电路板表面的图形,并通过系统标定参数以及相位-高度映射关系获取待测SMT电路板的三维点云模型图像;A group of CCD cameras and projectors arranged on the worktable, through the CCD cameras, the light of the projector is projected onto the surface of the SMT circuit board to be tested, and the SMT circuit to be tested is obtained through the system calibration parameters and the phase-height mapping relationship 3D point cloud model image of the board;

图形处理终端,接收并存储所述待测SMT电路板的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述SMT电路板上的定位信息;根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值;根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷。A graphics processing terminal, receiving and storing the three-dimensional point cloud model image of the SMT circuit board to be tested, and matching and querying the location information of the SMT components on the SMT circuit board through the ICP algorithm; A plurality of identification areas are set on the component, and the height value of each identification area is obtained according to the regional relationship of the SMT component in the three-dimensional point cloud model image; according to the height value of the identification area and the preset height threshold By comparison, it is judged whether the SMT component has a high degree of defect.

进一步的,根据所述SMT结构光联合标定模型对系统进行标定,对待测SMT电路板表面的图形通过n步相移计算获得相对相位,利用多频外差相位解卷绕方法进行相对相位展开得到绝对相位,根据绝对相位和待测SMT电路板表面高度的对应得到待测SMT电路板的三维点云模型图像。Further, the system is calibrated according to the SMT structured light joint calibration model, and the relative phase is obtained by calculating the n-step phase shift of the graphics on the surface of the SMT circuit board to be tested, and the relative phase is unfolded by using the multi-frequency heterodyne phase unwrapping method to obtain Absolute phase, according to the correspondence between the absolute phase and the surface height of the SMT circuit board to be tested, the 3D point cloud model image of the SMT circuit board to be tested is obtained.

本发明第三方面提出了一种计算机可读存储介质,该计算机可读存储介质用于存储程序数据,程序数据在被处理器执行时,用于实现如上述的SMT元器件高度缺陷识别方法。The third aspect of the present invention provides a computer-readable storage medium, which is used to store program data, and when the program data is executed by a processor, it is used to implement the method for identifying high defects of SMT components as described above.

本发明技术方案的有益效果:The beneficial effects of the technical solution of the present invention:

本发明实施例的SMT元器件高度缺陷识别方法、系统及其可读介质,通过获取待测SMT电路板的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述SMT电路板上的定位信息;根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值;根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷。本申请能够实现对SMT元器件的高度、起翘等高度方向缺陷进行识别检测,结合现有二维表面检测技术组合能够实现SMT贴片的全面、高精度自动化缺陷检测。The SMT component height defect identification method, system and readable medium of the embodiment of the present invention obtain the three-dimensional point cloud model image of the SMT circuit board to be tested, and match and query the SMT components on the SMT circuit board through the ICP algorithm Positioning information; According to the positioning information, a plurality of identification areas are set on the SMT components, and the height value of each identification area is obtained according to the regional relationship of the SMT components in the three-dimensional point cloud model image; according to The height value of the identification area is compared with a preset height threshold to determine whether there is a height defect in the SMT component. This application can realize the identification and detection of height direction defects such as height and warping of SMT components, and combined with the existing two-dimensional surface detection technology combination can realize comprehensive and high-precision automatic defect detection of SMT patches.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without any creative effort.

图1是本发明实施例的SMT元器件高度缺陷识别方法流程示意图;Fig. 1 is a schematic flow chart of the SMT component height defect identification method of the embodiment of the present invention;

图2是本发明实施例的高度阈值建立方法流程示意图;2 is a schematic flow chart of a method for establishing a height threshold in an embodiment of the present invention;

图3是本发明实施例的SMT元器件高度缺陷识别系统硬件结构示意图;Fig. 3 is a schematic diagram of the hardware structure of the SMT component height defect identification system according to the embodiment of the present invention;

图4是本发明实施例的双目摄像机标定系统模型示意图;4 is a schematic diagram of a binocular camera calibration system model according to an embodiment of the present invention;

图5是本发明实施例的多频外差法原理图;Fig. 5 is the schematic diagram of the multi-frequency heterodyne method of the embodiment of the present invention;

图6是本发明实施例的三频外差相位展开过程的流程示意图;FIG. 6 is a schematic flow chart of a three-frequency heterodyne phase unwrapping process according to an embodiment of the present invention;

具体实施方式Detailed ways

下面结合附图对本发明的具体实施方式作进一步说明。在此需要说明的是,对于这些实施方式的说明用于帮助理解本发明,但并不构成对本发明的限定。此外,下面所描述的本发明各个实施方式中所涉及的技术特征只要彼此之间未构成冲突就可以相互组合。The specific embodiments of the present invention will be further described below in conjunction with the accompanying drawings. It should be noted here that the descriptions of these embodiments are used to help understand the present invention, but are not intended to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below may be combined with each other as long as they do not constitute a conflict with each other.

实施例1Example 1

如图1所示,本发明实施例提供了一种SMT元器件高度缺陷识别方法,该方法包括:As shown in Figure 1, an embodiment of the present invention provides a method for identifying a height defect of an SMT component, the method comprising:

S101、获取待测SMT电路板的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述SMT电路板上的定位信息;S101. Obtain the three-dimensional point cloud model image of the SMT circuit board to be tested, and query the positioning information of the SMT components on the SMT circuit board through ICP algorithm matching;

具体的,所述获取待测SMT电路板的三维点云模型图像包括:Specifically, the acquisition of the three-dimensional point cloud model image of the SMT circuit board to be tested includes:

对不同视角的待测SMT电路板图片通过RANSAC算法提纯得到特征匹配点,设两点云的特征点集分别为So和X;The pictures of the SMT circuit board to be tested from different angles of view are purified by the RANSAC algorithm to obtain the feature matching points, and the feature point sets of the two point clouds are respectively So and X;

设迭代次数为k,令k=0,利用RANSAC计算出的空间变换矩阵Ro和To对提纯后的特征点集So进行初始变换,建立特征点集X的Kd-tree;Set the number of iterations as k, let k=0, use the spatial transformation matrices Ro and To calculated by RANSAC to perform initial transformation on the purified feature point set So, and establish the Kd-tree of the feature point set X;

S1=R0S0+T0S 1 =R 0 S 0 +T 0 ,

寻找Sk在X中的最近的点Sk1利用特征匹配点集Sk和Sk1,计算坐标变换知阵Rk和Tk,利用以下公式进行特征点集的坐标变换:Find the nearest point Sk1 of Sk in X, use the feature matching point set Sk and Sk1, calculate the coordinate transformation matrix Rk and Tk, and use the following formula to perform the coordinate transformation of the feature point set:

Sk+1=RkSk+Tk S k+1 =R k S k +T k

判断距离误差D是否收敛,如果Dk-Dk+1<M,则收敛,其中M为设定的阈值,且M>0,否则,重新寻找Sk在X中的最近的点Sk1利用特征匹配点集Sk和Sk1。Determine whether the distance error D is convergent, if Dk-Dk+1<M, then converge, where M is the set threshold, and M>0, otherwise, re-find the nearest point Sk1 of Sk in X and use the feature matching point set Sk and Sk1.

实现对通过RANSAC技术提纯后的特征匹配点,对使用该ICP算法进行统计求解。因为前面确立的旋转矩阵和平移矢量的初值有很大的准确性ICP算法也只是通过对初值的优化,得出了更精确的旋转矩阵R和平移矢量T。这样可将不同视角获得的点云进行匹配,实现了对三维SMT贴片的三维重建和匹配三维元器件。Realize the feature matching points purified by RANSAC technology, and use the ICP algorithm to perform statistical calculations. Because the initial values of the rotation matrix and translation vector established earlier have great accuracy, the ICP algorithm only obtains a more accurate rotation matrix R and translation vector T through the optimization of the initial values. In this way, the point clouds obtained from different viewing angles can be matched, and the 3D reconstruction of the 3D SMT patch and the matching of 3D components can be realized.

具体的,所述对不同视角的待测SMT电路板图形通过RANSAC算法提纯得到特征匹配点包括:Specifically, the feature matching points obtained by purifying the SMT circuit board graphics of different viewing angles through the RANSAC algorithm include:

利用SIFT算法对至少两幅不同视角的待测SMT电路板图片进行特征匹配,设置判断匹配的阈值0.6,找到N1对特征匹配点;Use the SIFT algorithm to perform feature matching on at least two pictures of the SMT circuit board to be tested from different viewing angles, set the threshold for judging matching to 0.6, and find N1 pairs of feature matching points;

同时设定一个A*A的识别区域,共找到N2对特征匹配点,将所述N2对特征匹配点用RANSAC算法进行计算,阈值设置为0.8,即至少需有80%的特征点能满足求解出的旋转矩阵和平移向量,得到旋转矩阵Ro和平移向量To。At the same time, set an A*A recognition area, find N2 pairs of feature matching points in total, calculate the N2 pairs of feature matching points with the RANSAC algorithm, set the threshold to 0.8, that is, at least 80% of the feature points must be able to satisfy the solution The obtained rotation matrix and translation vector are obtained to obtain the rotation matrix Ro and translation vector To.

S102、根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值;S102. Set multiple identification areas on the SMT component according to the positioning information, and obtain the height value of each identification area according to the regional relationship of the SMT component in the three-dimensional point cloud model image;

具体的,所述根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值具体包括:Specifically, setting multiple identification areas on the SMT components according to the positioning information, and obtaining the height value of each identification area according to the regional relationship of the SMT components in the three-dimensional point cloud model image include:

所述根据所述定位信息在所述SMT元器件平面上下左右设置至少4个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系提取每一个所述识别区域内所有特征匹配点的高度值,并将所有特征匹配点的高度值的平均值作为所述识别区域的高度值。According to the positioning information, at least 4 identification areas are set up, down, left, and right on the plane of the SMT components, and all feature matches in each of the identification areas are extracted according to the regional relationship of the SMT components in the three-dimensional point cloud model image The height value of the point, and the average value of the height values of all feature matching points is used as the height value of the recognition area.

S103、根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷。S103. According to the comparison between the height value of the identification area and the preset height threshold, it is judged whether there is a height defect in the SMT component.

具体的,所述根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷包括:Specifically, comparing the height value of the identified area with a preset height threshold, judging whether there is a height defect in the SMT component includes:

设定SMT元器件的最低高度阈值Hl和最高高度阈值Hh,将所述识别区域的高度值与最低高度阈值Hl和最高高度阈值Hh比较,若低于最低高度阈值Hl,判定为“元件高度低”,若高于最高高度阈值Hh,判定为“元件高度高”。Set the minimum height threshold Hl and the highest height threshold Hh of SMT components, compare the height value of the identified area with the minimum height threshold Hl and the highest height threshold Hh, if it is lower than the minimum height threshold Hl, it is judged as "the component height is low ", if it is higher than the maximum height threshold Hh, it is judged as "the component height is high".

具体的,所述根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷还包括:Specifically, the comparison of the height value of the identified area with the preset height threshold, and judging whether there is a height defect in the SMT component also includes:

设定水平倾斜角度阈值TH,根据所述SMT元器件水平方向的所述识别区域之间的高度差获取水平倾斜角度T1,当所述SMT元器件的水平倾斜角度T1大于所述水平倾斜角度阈值TH,判定为“元件水平倾斜”;Set the horizontal inclination angle threshold TH, obtain the horizontal inclination angle T1 according to the height difference between the identification areas in the horizontal direction of the SMT components, when the horizontal inclination angle T1 of the SMT components is greater than the horizontal inclination angle threshold TH, judged as "component horizontal tilt";

设定竖直倾斜角度阈值TV,根据所述SMT元器件竖直方向的所述识别区域之间的高度差获取竖直倾斜角度T2,当所述SMT元器件的竖直倾斜角度T2大于所述竖直倾斜角度阈值TV,判定为“元件竖直倾斜”。Set the vertical inclination angle threshold TV, and obtain the vertical inclination angle T2 according to the height difference between the identification areas in the vertical direction of the SMT components, when the vertical inclination angle T2 of the SMT components is greater than the The vertical tilt angle threshold TV is determined as "the component is vertically tilted".

如图2所示,所述方法还包括:As shown in Figure 2, the method also includes:

S201、预先获取合格SMT电路板的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述合格SMT电路板上的定位信息;S201. Pre-acquire the three-dimensional point cloud model image of the qualified SMT circuit board, and query the positioning information of the SMT components on the qualified SMT circuit board through ICP algorithm matching;

S202、根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取并存储每一个所述识别区域的高度阈值。S202. Set multiple identification areas on the SMT component according to the positioning information, and acquire and store a height threshold of each identification area according to the area relationship of the SMT component in the 3D point cloud model image.

实施例2Example 2

如图3所示,本发明实施例还提出了一种SMT元器件高度缺陷识别系统,包括:As shown in Figure 3, the embodiment of the present invention also proposes a SMT component height defect identification system, including:

设置在工作台面40的一组CCD摄像头10、投影仪20,通过所述CCD摄像头10拍摄投影仪20的光投射到待测SMT电路板50表面的图形,并通过系统标定参数以及相位-高度映射关系获取待测SMT电路板50的三维点云模型图像;A group of CCD cameras 10 and projector 20 arranged on the worktable 40, through which the light of the projector 20 is projected onto the surface of the SMT circuit board 50 to be tested by the CCD cameras 10, and through the system calibration parameters and phase-height mapping Relational acquisition of the three-dimensional point cloud model image of the SMT circuit board 50 to be tested;

图形处理终端30,接收并存储所述待测SMT电路板50的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述SMT电路板上的定位信息;根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值;根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷。The graphics processing terminal 30 receives and stores the three-dimensional point cloud model image of the SMT circuit board 50 to be tested, and matches and queries the location information of the SMT components on the SMT circuit board through the ICP algorithm; A plurality of identification areas are set on the SMT components, and the height value of each identification area is obtained according to the regional relationship of the SMT components in the three-dimensional point cloud model image; according to the height value of the identification area and the preset The height threshold is compared to determine whether the SMT component has a height defect.

其中,根据所述SMT结构光联合标定模型对系统进行标定,对待测SMT电路板表面的图形通过n步相移计算获得相对相位,利用多频外差相位解卷绕方法进行相对相位展开得到绝对相位,根据绝对相位和待测SMT电路板表面高度的对应得到待测SMT电路板的三维点云模型图像。Among them, the system is calibrated according to the SMT structured light joint calibration model, and the relative phase is obtained by calculating the n-step phase shift of the graphics on the surface of the SMT circuit board to be tested. Phase, according to the correspondence between the absolute phase and the surface height of the SMT circuit board to be tested, the three-dimensional point cloud model image of the SMT circuit board to be tested is obtained.

具体的,采用双目摄像头同时采集物体的三维信息,利用两幅图像之间参数和其他约束条件解出两个图像坐标系的映射关系。但在该集成系统中两者属于不同的坐标系根据绝对相位和被测物体表面高度的对应性关系,可以由绝对相位得到被测物体的三维图像。Specifically, the binocular camera is used to collect the three-dimensional information of the object at the same time, and the mapping relationship between the two image coordinate systems is solved by using the parameters and other constraints between the two images. However, in this integrated system, the two belong to different coordinate systems. According to the corresponding relationship between the absolute phase and the surface height of the measured object, the three-dimensional image of the measured object can be obtained from the absolute phase.

但在该集成系统中两者属于不同的坐标系,如图4所示,QL-XLYLZL为左相机坐标系,QC-XCYCZC为右相机坐标系,左相机图像平面的像素点坐标(u,v)与右相机坐标系中标记点的坐标(xl,yl,zl)之间的转换如下所示:But in this integrated system, the two belong to different coordinate systems, as shown in Figure 4, Q L -X L Y L Z L is the left camera coordinate system, Q C -X C Y C Z C is the right camera coordinate system, The conversion between the pixel point coordinates (u, v) of the left camera image plane and the coordinates (xl, yl, zl) of the marker point in the right camera coordinate system is as follows:

Figure BDA0003985071440000071
Figure BDA0003985071440000071

其中,Φ和Δ是两个摄像机坐标系转换的旋转矩阵和平移向量,完成对双摄像机系统的联合标定,其中摄像机内参数等可通过摄像机标定得到,一旦找到了每张联合拍照图片的三维对象点与其二维投影坐标的关系,即对应棋盘角点的世界坐标和像素坐标后,联立上述公式建立空间变换关系,可以计算出两个摄像机之间的坐标转换矩阵。Among them, Φ and Δ are the rotation matrix and translation vector of the transformation of the two camera coordinate systems, and the joint calibration of the dual camera system is completed. The internal parameters of the camera can be obtained through camera calibration. Once the 3D object of each joint photographed picture is found The relationship between the point and its two-dimensional projection coordinates, that is, the world coordinates and pixel coordinates corresponding to the corner points of the chessboard, and the above formulas are used to establish the space transformation relationship, and the coordinate transformation matrix between the two cameras can be calculated.

要得到三维物体的面形数据,就必须向被测量物表面投射一面形结构光。在相位检测轮廓技术中,一般把一个光强分布成标准正弦分布的光栅图像,视为平面结构光路。当光栅投影在三维的物体表面上时,被投影的物体由于受到正弦光栅的调制作用,所表现的光强如下式所示:To obtain the surface shape data of a three-dimensional object, it is necessary to project a surface structured light onto the surface of the measured object. In phase detection profile technology, a grating image whose light intensity is distributed into a standard sinusoidal distribution is generally regarded as a planar structured light path. When the grating is projected on the surface of a three-dimensional object, the projected object is modulated by the sinusoidal grating, and the light intensity shown is as follows:

Figure BDA0003985071440000072
Figure BDA0003985071440000072

其中,Ii(x,y)为对应于第i幅干涉条纹的光强度,δi是为第i次相移量,A(x,y)为背景光强,B(x,y)为条纹的调制深度,Φ(x,y)为待测的相位。A(x,y)、B(x,y)和Φ(x,y)为三个未知数,因此计算Φ(x,y)至少需要三个图像。Among them, Ii(x,y) is the light intensity corresponding to the i-th interference fringe, δi is the i-th phase shift amount, A(x,y) is the background light intensity, B(x,y) is the fringe Modulation depth, Φ(x, y) is the phase to be measured. A(x,y), B(x,y) and Φ(x,y) are three unknowns, so calculating Φ(x,y) requires at least three images.

假设三个光栅图像所选择的相对位移分别是:-2π/3,0,2π/3,则其相对光强表达式分别为:Assuming that the relative displacements selected by the three grating images are: -2π/3, 0, 2π/3, then the relative light intensity expressions are:

Figure BDA0003985071440000073
Figure BDA0003985071440000073

其中,A表示图像自然光强的背景值,B为投射的条纹光强背景值,将上式展开如下:Among them, A represents the background value of the natural light intensity of the image, and B is the background value of the projected stripe light intensity. The above formula is expanded as follows:

Figure BDA0003985071440000081
Figure BDA0003985071440000081

进一步转换如下:Further conversion is as follows:

Figure BDA0003985071440000086
Figure BDA0003985071440000086

上面是相位移选为-2π/3,0,2π/3的情况,选择合适的相位移可以简化计算。三步相移法所要收集的图像数量较小,而且数据处理时速度快。The above is the case where the phase shift is selected as -2π/3, 0, 2π/3, and choosing an appropriate phase shift can simplify the calculation. The number of images to be collected by the three-step phase shift method is small, and the data processing speed is fast.

在我们计算点的三维高度信息时,我们需要物体高度的绝对相位,但我们通过相移法却无法得到物体的绝对相位,只能得到相应的相对相位,它是以连续2π为周期的不连续函数。所以获得相对相位后,并不能直接计算出空间一三维点的三维信息,需要对相对相位值进行处理以获得和高度信息一一对应的绝对相位值,这个过程称为相位展开,或者相位解卷绕。When we calculate the three-dimensional height information of a point, we need the absolute phase of the height of the object, but we cannot get the absolute phase of the object through the phase shift method, only the corresponding relative phase, which is discontinuous with a continuous period of 2π function. Therefore, after the relative phase is obtained, the three-dimensional information of a three-dimensional point in space cannot be directly calculated. The relative phase value needs to be processed to obtain the absolute phase value corresponding to the height information. This process is called phase unwrapping, or phase unwrapping around.

本申请实施例利用多频外差相位解卷绕方法进行相位展开的实验计算,多频外差基本原理为利用不同频率相位函数Φ1(X)和Φ2叠加到频率更低相位函数Φ(X)中去,如图5所示,其中λ1、λ2、λb分别是相位函数Φ1(X)、Φ2和Φ(X)的频率,λb可由λ1、λ2计算得到新的频率λb:The embodiment of the present application uses the multi-frequency heterodyne phase unwrapping method to carry out the experimental calculation of phase unwrapping. The basic principle of multi-frequency heterodyne is to use different frequency phase functions Φ1(X) and Φ2 to superimpose to the lower frequency phase function Φ(X) As shown in Figure 5, where λ1, λ2, and λb are the frequencies of the phase functions Φ1(X), Φ2, and Φ(X) respectively, and λb can be calculated from λ1 and λ2 to obtain a new frequency λb:

Figure BDA0003985071440000084
Figure BDA0003985071440000084

新的相位Φb:New phase Φb:

Figure BDA0003985071440000085
Figure BDA0003985071440000085

多频外差法采用了三角函数的积化和差准则,由于叠加得到的频谱较低,所以使得整个检测范围都在较低频谱信号的同一个周期内,从而确定了绝对干涉相位。The multi-frequency heterodyne method uses the product and difference criterion of trigonometric functions. Since the spectrum obtained by superimposition is low, the entire detection range is within the same period of the low spectrum signal, thereby determining the absolute interference phase.

按三种频率的光栅进行测量,使用三种不同频率的光栅Φ1、Φ2、Φ3;如图6所示,则由Φ1-Φ2和Φ2-Φ3得到Φ12和Φ23,最终生成频率为1的光栅,获得最终连续的绝对相位,从而实现相对相位到绝对相位的计算。Measure according to gratings of three frequencies, using gratings Φ1, Φ2, and Φ3 of three different frequencies; Obtain the final continuous absolute phase, thereby realizing the calculation from relative phase to absolute phase.

实施例3Example 3

本发明实施例还提供了一种计算机可读存储介质,该计算机可读存储介质上存储有SMT元器件高度缺陷识别程序,所述SMT元器件高度缺陷识别程序被处理器执行时,实现上述SMT元器件高度缺陷识别方法的步骤。The embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores an SMT component height defect recognition program, and when the SMT component height defect recognition program is executed by a processor, the above-mentioned SMT is realized. Steps of a method for identifying a component height defect.

可以理解的,本实施例中的计算机可读存储介质可以应用于服务器,其具体的实施可以参考上述实施例,这里不再赘述。It can be understood that the computer-readable storage medium in this embodiment can be applied to a server, and its specific implementation can refer to the above-mentioned embodiments, which will not be repeated here.

本发明实施例的SMT元器件高度缺陷识别方法、系统及其可读介质,通过获取待测SMT电路板的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述SMT电路板上的定位信息;根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值;根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷。本申请能够实现对SMT元器件的高度、起翘等高度方向缺陷进行识别检测,结合现有二维表面检测技术组合能够实现SMT贴片的全面、高精度自动化缺陷检测。The SMT component height defect identification method, system and readable medium of the embodiment of the present invention obtain the three-dimensional point cloud model image of the SMT circuit board to be tested, and match and query the SMT components on the SMT circuit board through the ICP algorithm Positioning information; According to the positioning information, a plurality of identification areas are set on the SMT components, and the height value of each identification area is obtained according to the regional relationship of the SMT components in the three-dimensional point cloud model image; according to The height value of the identification area is compared with a preset height threshold to determine whether there is a height defect in the SMT component. This application can realize the identification and detection of height direction defects such as height and warping of SMT components, and combined with the existing two-dimensional surface detection technology combination can realize comprehensive and high-precision automatic defect detection of SMT patches.

Claims (10)

1.一种SMT元器件高度缺陷识别方法,其特征在于,所述方法包括:1. A kind of SMT components and parts height defect recognition method, it is characterized in that, described method comprises: 获取待测SMT电路板的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述SMT电路板上的定位信息;Obtain the three-dimensional point cloud model image of the SMT circuit board to be tested, and query the positioning information of the SMT components on the SMT circuit board through ICP algorithm matching; 根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值;Setting multiple identification areas on the SMT components according to the positioning information, and obtaining the height value of each identification area according to the regional relationship of the SMT components in the three-dimensional point cloud model image; 根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷。According to the comparison between the height value of the identification area and the preset height threshold, it is judged whether there is a height defect in the SMT component. 2.根据权利要求1所述的SMT元器件高度缺陷识别方法,其特征在于,所述方法还包括:2. The SMT component height defect identification method according to claim 1, is characterized in that, described method also comprises: 预先获取合格SMT电路板的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述合格SMT电路板上的定位信息;Pre-acquire the three-dimensional point cloud model image of the qualified SMT circuit board, and query the positioning information of the SMT components on the qualified SMT circuit board through ICP algorithm matching; 根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取并存储每一个所述识别区域的高度阈值。A plurality of identification areas are set on the SMT component according to the positioning information, and a height threshold of each identification area is obtained and stored according to the regional relationship of the SMT component in the three-dimensional point cloud model image. 3.根据权利要求1所述的SMT元器件高度缺陷识别方法,其特征在于,所述获取待测SMT电路板的三维点云模型图像包括:3. the SMT component height defect identification method according to claim 1, is characterized in that, the three-dimensional point cloud model image that described obtaining SMT circuit board to be tested comprises: 对不同视角的待测SMT电路板图片通过RANSAC算法提纯得到特征匹配点,设两点云的特征点集分别为So和X;The pictures of the SMT circuit board to be tested from different angles of view are purified by the RANSAC algorithm to obtain the feature matching points, and the feature point sets of the two point clouds are respectively So and X; 设迭代次数为k,令k=0,利用RANSAC计算出的空间变换矩阵Ro和To对提纯后的特征点集So进行初始变换,建立特征点集X的Kd-tree;Set the number of iterations as k, let k=0, use the spatial transformation matrices Ro and To calculated by RANSAC to perform initial transformation on the purified feature point set So, and establish the Kd-tree of the feature point set X; S1=R0S0+T0S 1 =R 0 S 0 +T 0 , 寻找Sk在X中的最近的点Sk1利用特征匹配点集Sk和Sk1,计算坐标变换知阵Rk和Tk,利用以下公式进行特征点集的坐标变换:Find the nearest point Sk1 of Sk in X, use the feature matching point set Sk and Sk1, calculate the coordinate transformation matrix Rk and Tk, and use the following formula to perform the coordinate transformation of the feature point set: Sk+1=RkSk+Tk S k+1 =R k S k +T k 判断距离误差D是否收敛,如果Dk-Dk+1<M,则收敛,其中M为设定的阈值,且M>0,否则,重新寻找Sk在X中的最近的点Sk1利用特征匹配点集Sk和Sk1。Determine whether the distance error D is convergent, if Dk-Dk+1<M, then converge, where M is the set threshold, and M>0, otherwise, re-find the nearest point Sk1 of Sk in X and use the feature matching point set Sk and Sk1. 4.根据权利要求3所述的SMT元器件高度缺陷识别方法,其特征在于,所述对不同视角的待测SMT电路板图形通过RANSAC算法提纯得到特征匹配点包括:4. the SMT component height defect identification method according to claim 3, is characterized in that, described to the SMT circuit board figure to be tested of different viewing angles is purified by RANSAC algorithm and obtains feature matching point and comprises: 利用SIFT算法对至少两幅不同视角的待测SMT电路板图片进行特征匹配,设置判断匹配的阈值0.6,找到N1对特征匹配点;Use the SIFT algorithm to perform feature matching on at least two pictures of the SMT circuit board to be tested from different viewing angles, set the threshold for judging matching to 0.6, and find N1 pairs of feature matching points; 同时设定一个A*A的识别区域,共找到N2对特征匹配点,将所述N2对特征匹配点用RANSAC算法进行计算,阈值设置为0.8,即至少需有80%的特征点能满足求解出的旋转矩阵和平移向量,得到旋转矩阵Ro和平移向量To。At the same time, set an A*A recognition area, find N2 pairs of feature matching points in total, calculate the N2 pairs of feature matching points with the RANSAC algorithm, set the threshold to 0.8, that is, at least 80% of the feature points must be able to satisfy the solution The obtained rotation matrix and translation vector are obtained to obtain the rotation matrix Ro and translation vector To. 5.根据权利要求1所述的SMT元器件高度缺陷识别方法,其特征在于,所述根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值具体包括:5. The SMT component height defect recognition method according to claim 1, characterized in that, according to the positioning information, a plurality of identification areas are set on the SMT component, according to the three-dimensional point cloud model image The acquisition of the height value of each of the identification areas specifically includes: 所述根据所述定位信息在所述SMT元器件平面上下左右设置至少4个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系提取每一个所述识别区域内所有特征匹配点的高度值,并将所有特征匹配点的高度值的平均值作为所述识别区域的高度值。According to the positioning information, at least 4 identification areas are set up, down, left, and right on the plane of the SMT components, and all feature matches in each of the identification areas are extracted according to the regional relationship of the SMT components in the three-dimensional point cloud model image The height value of the point, and the average value of the height values of all feature matching points is used as the height value of the recognition area. 6.根据权利要求1所述的SMT元器件高度缺陷识别方法,其特征在于,所述根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷包括:6. The method for identifying height defects of SMT components according to claim 1, characterized in that, comparing the height value of the identified area with a preset height threshold value, it is judged whether there is a height defect in the SMT components include: 设定SMT元器件的最低高度阈值Hl和最高高度阈值Hh,将所述识别区域的高度值与最低高度阈值Hl和最高高度阈值Hh比较,若低于最低高度阈值Hl,判定为“元件高度低”,若高于最高高度阈值Hh,判定为“元件高度高”。Set the minimum height threshold Hl and the highest height threshold Hh of SMT components, compare the height value of the identified area with the minimum height threshold Hl and the highest height threshold Hh, if it is lower than the minimum height threshold Hl, it is judged as "the component height is low ", if it is higher than the maximum height threshold Hh, it is judged as "the component height is high". 7.根据权利要求1所述的SMT元器件高度缺陷识别方法,其特征在于,所述根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷还包括:7. The method for identifying height defects of SMT components according to claim 1, characterized in that, comparing the height value of the identification area with a preset height threshold value, it is judged whether there is a height defect in the SMT components Also includes: 设定水平倾斜角度阈值TH,根据所述SMT元器件水平方向的所述识别区域之间的高度差获取水平倾斜角度T1,当所述SMT元器件的水平倾斜角度T1大于所述水平倾斜角度阈值TH,判定为“元件水平倾斜”;Set the horizontal inclination angle threshold TH, obtain the horizontal inclination angle T1 according to the height difference between the identification areas in the horizontal direction of the SMT components, when the horizontal inclination angle T1 of the SMT components is greater than the horizontal inclination angle threshold TH, judged as "component horizontal tilt"; 设定竖直倾斜角度阈值TV,根据所述SMT元器件竖直方向的所述识别区域之间的高度差获取竖直倾斜角度T2,当所述SMT元器件的竖直倾斜角度T2大于所述竖直倾斜角度阈值TV,判定为“元件竖直倾斜”。Set the vertical inclination angle threshold TV, and obtain the vertical inclination angle T2 according to the height difference between the identification areas in the vertical direction of the SMT components, when the vertical inclination angle T2 of the SMT components is greater than the The vertical tilt angle threshold TV is determined as "the component is vertically tilted". 8.一种SMT元器件高度缺陷识别系统,其特征在于,所述系统包括:8. A high defect identification system for SMT components, characterized in that the system comprises: 设置在工作台面的一组CCD摄像头、投影仪,通过所述CCD摄像头拍摄投影仪的光投射到待测SMT电路板表面的图形,并通过系统标定参数以及相位-高度映射关系获取待测SMT电路板的三维点云模型图像;A group of CCD cameras and projectors arranged on the worktable, through the CCD cameras, the light of the projector is projected onto the surface of the SMT circuit board to be tested, and the SMT circuit to be tested is obtained through the system calibration parameters and the phase-height mapping relationship 3D point cloud model image of the board; 图形处理终端,接收并存储所述待测SMT电路板的三维点云模型图像,并通过ICP算法匹配查询SMT元器件在所述SMT电路板上的定位信息;根据所述定位信息在所述SMT元器件上设置多个识别区域,根据所述三维点云模型图像中所述SMT元器件区域关系获取每一个所述识别区域的高度值;根据所述识别区域的高度值与预设的高度阈值比对,判断所述SMT元器件是否存在高度缺陷。A graphics processing terminal, receiving and storing the three-dimensional point cloud model image of the SMT circuit board to be tested, and matching and querying the location information of the SMT components on the SMT circuit board through the ICP algorithm; A plurality of identification areas are set on the component, and the height value of each identification area is obtained according to the regional relationship of the SMT component in the three-dimensional point cloud model image; according to the height value of the identification area and the preset height threshold By comparison, it is judged whether the SMT component has a high degree of defect. 9.根据权利要求8所述的SMT元器件高度缺陷识别系统,其特征在于,根据所述SMT结构光联合标定模型对系统进行标定,对待测SMT电路板表面的图形通过n步相移计算获得相对相位,利用多频外差相位解卷绕方法进行相对相位展开得到绝对相位,根据绝对相位和待测SMT电路板表面高度的对应得到待测SMT电路板的三维点云模型图像。9. The SMT component height defect recognition system according to claim 8, characterized in that, the system is calibrated according to the SMT structured light joint calibration model, and the figure on the surface of the SMT circuit board to be measured is obtained by n-step phase shift calculation For the relative phase, the relative phase is unwrapped using the multi-frequency heterodyne phase unwinding method to obtain the absolute phase, and the three-dimensional point cloud model image of the SMT circuit board to be tested is obtained according to the correspondence between the absolute phase and the surface height of the SMT circuit board to be tested. 10.一种计算机可读存储介质,其特征在于,所述计算机可读存储介质用于存储程序数据,程序数据在被处理器执行时,用于实现如权利要求1-7任意一项所述的SMT元器件高度缺陷识别方法的步骤。10. A computer-readable storage medium, characterized in that the computer-readable storage medium is used to store program data, and when the program data is executed by a processor, it is used to implement any one of claims 1-7. The steps of the SMT component height defect identification method.
CN202211561975.2A 2022-12-07 2022-12-07 SMT component high defect identification method, system and readable medium thereof Pending CN116008177A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211561975.2A CN116008177A (en) 2022-12-07 2022-12-07 SMT component high defect identification method, system and readable medium thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211561975.2A CN116008177A (en) 2022-12-07 2022-12-07 SMT component high defect identification method, system and readable medium thereof

Publications (1)

Publication Number Publication Date
CN116008177A true CN116008177A (en) 2023-04-25

Family

ID=86023834

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211561975.2A Pending CN116008177A (en) 2022-12-07 2022-12-07 SMT component high defect identification method, system and readable medium thereof

Country Status (1)

Country Link
CN (1) CN116008177A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117670887A (en) * 2024-02-01 2024-03-08 湘潭大学 Tin soldering height and defect detection method based on machine vision

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109523501A (en) * 2018-04-28 2019-03-26 江苏理工学院 One kind being based on dimensionality reduction and the matched battery open defect detection method of point cloud data
CN112001955A (en) * 2020-08-24 2020-11-27 深圳市建设综合勘察设计院有限公司 Point cloud registration method and system based on two-dimensional projection plane matching constraint
CN112950562A (en) * 2021-02-22 2021-06-11 杭州申昊科技股份有限公司 Fastener detection algorithm based on line structured light
CN113689420A (en) * 2021-09-03 2021-11-23 凌云光技术股份有限公司 Method and device for detecting welding spot defects of circuit board and detection equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109523501A (en) * 2018-04-28 2019-03-26 江苏理工学院 One kind being based on dimensionality reduction and the matched battery open defect detection method of point cloud data
CN112001955A (en) * 2020-08-24 2020-11-27 深圳市建设综合勘察设计院有限公司 Point cloud registration method and system based on two-dimensional projection plane matching constraint
CN112950562A (en) * 2021-02-22 2021-06-11 杭州申昊科技股份有限公司 Fastener detection algorithm based on line structured light
CN113689420A (en) * 2021-09-03 2021-11-23 凌云光技术股份有限公司 Method and device for detecting welding spot defects of circuit board and detection equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117670887A (en) * 2024-02-01 2024-03-08 湘潭大学 Tin soldering height and defect detection method based on machine vision
CN117670887B (en) * 2024-02-01 2024-04-09 湘潭大学 A soldering height and defect detection method based on machine vision

Similar Documents

Publication Publication Date Title
JP6457072B2 (en) Integration of point clouds from multiple cameras and light sources in 3D surface shape measurement
CN111739104B (en) Calibration method and device of laser calibration system and laser calibration system
Huang et al. A fast and flexible projector-camera calibration system
TWI414749B (en) Apparatus for measurement of surface profile
CN106643555B (en) Connector recognition methods based on structured light three-dimensional measurement system
CN109862345B (en) Method and system for testing field angle
CN107271445B (en) Defect detection method and device
CN111256628A (en) Wall surface flatness detection method and device, computer equipment and storage medium
JP2021135300A (en) Substrate measuring system and substrate measuring method
CN114742853B (en) Feature fitting-based sheet metal part rectangular contour three-dimensional measurement method and system
JP7266070B2 (en) Board wiring measurement system and method
CN112361991A (en) Three-dimensional scanning method and device, computer equipment and storage medium
KR101766468B1 (en) Method for 3D shape measuring using of Triple Frequency Pattern
CN116008177A (en) SMT component high defect identification method, system and readable medium thereof
CN110044266B (en) Photogrammetry system based on speckle projection
CN114693807A (en) Method and system for reconstructing mapping data of power transmission line image and point cloud
Tehrani et al. A new approach to 3D modeling using structured light pattern
CN109741384B (en) Multi-distance detection device and method for depth camera
CN118334239A (en) Pipeline three-dimensional reconstruction method and equipment based on stripe projection measurement
CN117452347A (en) Precision testing method of depth camera, related device and storage medium
JP2005172640A (en) Mounting inspection device and mounting inspection method
JP2009079934A (en) Three-dimensional measuring method
KR101765257B1 (en) Method for acquiring three dimensional image information, and computing device implementing the samemethod
Chien et al. An enhanced depth estimation system using RGB-D cameras and gyroscopes
Drouin1&2 et al. An energy formulation for establishing the correspondence used in projector calibration

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination