CN107131837A - A kind of rocker arm of coal mining machine mining height vision measuring method - Google Patents
A kind of rocker arm of coal mining machine mining height vision measuring method Download PDFInfo
- Publication number
- CN107131837A CN107131837A CN201710442853.4A CN201710442853A CN107131837A CN 107131837 A CN107131837 A CN 107131837A CN 201710442853 A CN201710442853 A CN 201710442853A CN 107131837 A CN107131837 A CN 107131837A
- Authority
- CN
- China
- Prior art keywords
- mrow
- msub
- msup
- receptive field
- mfrac
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005065 mining Methods 0.000 title claims abstract description 32
- 239000003245 coal Substances 0.000 title claims abstract description 17
- 238000000034 method Methods 0.000 title claims abstract description 13
- 238000011946 reduction process Methods 0.000 claims 2
- 230000015572 biosynthetic process Effects 0.000 claims 1
- 230000000452 restraining effect Effects 0.000 claims 1
- 238000012545 processing Methods 0.000 abstract description 6
- 238000005259 measurement Methods 0.000 abstract description 5
- 230000000007 visual effect Effects 0.000 abstract description 4
- 238000005516 engineering process Methods 0.000 abstract description 3
- 230000003287 optical effect Effects 0.000 description 6
- 238000001514 detection method Methods 0.000 description 5
- 238000007781 pre-processing Methods 0.000 description 5
- 230000003044 adaptive effect Effects 0.000 description 3
- 239000003550 marker Substances 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 2
- 238000000691 measurement method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
- G01B11/022—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness by means of tv-camera scanning
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/26—Measuring arrangements characterised by the use of optical techniques for measuring angles or tapers; for testing the alignment of axes
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Other Investigation Or Analysis Of Materials By Electrical Means (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
本发明公开了一种采煤机摇臂采高视觉测量方法,分别在采煤机摇臂和机身上安装方形定位标识,并通过摄像机对采煤机进行图像采集;对采集得到的目标图像进行降噪处理,提取降噪处理后图像中的定位标识;对每个定位标识进行边缘直线拟合,得到每个定位标识的四个顶点坐标;根据步骤三得到的定位标识各自顶点坐标得到两个定位标识之间的夹角,根据摇臂臂长和两个定位标识之间的夹角采煤机的摇臂采高。本发明利用非接触式的视觉测量技术,能够自动测量出采煤机视频图像中摇臂相对于机身的倾角,测量结果准确度高,为煤矿井下采煤机摇臂采高测量提供必要的技术支持,具有显著的经济效益和较高的工程应用价值。
The invention discloses a method for visually measuring the mining height of the rocker arm of a coal shearer. A square positioning mark is respectively installed on the rocker arm of the coal shearer and the machine body, and the image of the shearer is collected by a camera; the collected target image is Carry out noise reduction processing, and extract the positioning marks in the image after the noise reduction processing; carry out edge straight line fitting on each positioning mark, and obtain the four vertex coordinates of each positioning mark; The included angle between the two positioning marks is based on the length of the rocker arm and the angle between the two positioning marks, and the rocker mining height of the shearer. The invention uses non-contact visual measurement technology to automatically measure the inclination angle of the rocker arm relative to the fuselage in the video image of the coal mining machine. Technical support, with significant economic benefits and high engineering application value.
Description
技术领域technical field
本发明属于矿用设备运行状态监测领域,尤其涉及一种采煤机摇臂采高视觉测量方法。The invention belongs to the field of mining equipment operation state monitoring, and in particular relates to a visual measurement method for mining height of a rocker arm of a coal mining machine.
背景技术Background technique
采煤机采高是采煤机工况的重要参数,因此采煤机摇臂倾角检测非常必要。目前的采煤机采高的测量一般都采用接触式的测量方法,其中,采用旋转编码器对其摇臂倾角测量,这种方法安装困难;还有使用磁伸缩式传感器对摇臂油缸位移测量间接计算摇臂的倾角,但由于采煤机的摇臂在工作时有较大的受迫振动,这两种传感器的使用寿命都很短,严重限制了采煤机的智能控制的发展。The mining height of the shearer is an important parameter of the working condition of the shearer, so the detection of the inclination angle of the rocker arm of the shearer is very necessary. At present, the mining height measurement of coal mining machines generally adopts contact measurement methods, among which, the rotary encoder is used to measure the inclination angle of its rocker arm, which is difficult to install; there is also the use of magnetic telescopic sensors to measure the displacement of the rocker arm cylinder. The inclination angle of the rocker arm is calculated indirectly, but because the rocker arm of the shearer has a large forced vibration when it is working, the service life of these two sensors is very short, which seriously limits the development of intelligent control of the shearer.
发明内容Contents of the invention
针对现有制备技术的缺陷和不足,本发明的目的是提供一种采煤机摇臂采高视觉测量方法,解决了现有检测方法存在检测装置安装困难和检测精度不高的问题。Aiming at the defects and deficiencies of the existing preparation technology, the purpose of the present invention is to provide a method for visually measuring the mining height of the rocker arm of a coal shearer, which solves the problems of difficulty in installing the detection device and low detection accuracy in the existing detection method.
为了实现上述目的,本发明采用如下技术方案予以实现:In order to achieve the above object, the present invention adopts the following technical solutions to achieve:
一种采煤机摇臂采高视觉测量方法,包括以下步骤:A method for visually measuring the mining height of a rocker arm of a coal shearer, comprising the following steps:
步骤一:分别在采煤机摇臂和机身上安装方形定位标识,并通过摄像机对采煤机进行图像采集;Step 1: Install square positioning marks on the rocker arm and body of the shearer respectively, and collect images of the shearer through the camera;
步骤二:对采集得到的目标图像进行降噪处理,提取降噪处理后图像中的定位标识;Step 2: Perform noise reduction processing on the acquired target image, and extract the positioning mark in the image after the noise reduction processing;
步骤三:对每个定位标识进行边缘直线拟合,得到每个定位标识的四个顶点坐标,具体步骤为:Step 3: Perform edge straight line fitting for each positioning mark to obtain the four vertex coordinates of each positioning mark. The specific steps are:
步骤3.1:对第j个定位标识按照设定的中心间距和大小分布感受野,采用(r*2+1)*(r*2+1)的掩模,j=1,2,N为定位标识板的个数,r为感受野细胞半径,掩模中心与感受野细胞中心重合;Step 3.1: Distribute the receptive field for the jth positioning mark according to the set center distance and size, use the mask of (r*2+1)*(r*2+1), j=1, 2, N is the positioning The number of identification plates, r is the radius of the receptive field cell, and the center of the mask coincides with the center of the receptive field cell;
步骤3.2:利用梯度算子计算每个感受野掩模梯度方向,通过掩模梯度方向对每个感受野方向进行定性判断,从而分别划分出定位标识的上边缘、下边缘、左边缘和右边缘上分布的感受野细胞;Step 3.2: Use the gradient operator to calculate the gradient direction of each receptive field mask, and make a qualitative judgment on each receptive field direction through the gradient direction of the mask, so as to divide the upper edge, lower edge, left edge and right edge of the positioning mark respectively Receptive field cells distributed on
步骤3.3:利用感受野模型,计算上边缘方向各个感受野的响应值,根据单个感受野内像素点形成的对比边缘位置与感受野中心距离的关系,确定每个感受野中心到感受野内对比边缘到感受野中心的距离,然后利用带约束的最小二乘法模型拟合出标识板上边缘所在直线;Step 3.3: Use the receptive field model to calculate the response value of each receptive field in the direction of the upper edge, and determine the relationship between the center of each receptive field and the contrast edge in the receptive field to Feel the distance from the center of the field, and then use the constrained least squares model to fit the straight line where the edge of the signboard is located;
步骤3.4:重复步骤3.3,分别对定位标识的下边缘、左边缘、右边缘所在直线进行拟合;Step 3.4: Repeat step 3.3 to fit the straight lines where the lower edge, left edge, and right edge of the positioning mark are located;
步骤3.5:根据拟合的上边缘、下边缘、左边缘和右边缘四条直线方程,得到第j个定位标识的四个顶点坐标;Step 3.5: Obtain the coordinates of the four vertices of the jth positioning mark according to the four straight line equations of the fitted upper edge, lower edge, left edge and right edge;
步骤3.6:重复步骤3.1~步骤3.5,得到所有定位标识的四个顶点坐标。Step 3.6: Repeat steps 3.1 to 3.5 to obtain the four vertex coordinates of all positioning marks.
步骤四:根据步骤三得到的定位标识各自顶点坐标得到两个定位标识之间的夹角,通过下式(1)和(2)计算采煤机摇臂的采高hStep 4: According to the vertex coordinates of the positioning marks obtained in step 3, the angle between the two positioning marks is obtained, and the mining height h of the rocker arm of the shearer is calculated by the following formulas (1) and (2)
h=L*sin(θ-θ0) (1)h=L*sin(θ-θ 0 ) (1)
其中,L为摇臂的臂长,θ为两个定位标识之间的夹角;Among them, L is the arm length of the rocker arm, and θ is the angle between the two positioning marks;
nj为第j个定位标识的顶点ξ和顶点υ形成的向量,j=1,2,i=1,2,3,4,将每个定位标识左上角的顶点作为第一个坐标P1,其余坐标按顺时针方向依次分布,ξ∈i,υ∈i,ξ≠υ;(xji,yji)为第j个定位标识顶点的第i个顶点的图像坐标,(Xji,Yji,Zji)为第j个定位标识顶点的第i个顶点的光心坐标;n j is the vector formed by the vertex ξ and the vertex υ of the jth positioning mark, j=1, 2, i=1, 2, 3, 4, and the vertex at the upper left corner of each positioning mark is taken as the first coordinate P 1 , the remaining coordinates are distributed in a clockwise direction, ξ∈i,υ∈i, ξ≠υ; (x ji ,y ji ) is the image coordinate of the i-th vertex of the j-th location identification vertex, (X ji ,Y ji , Z ji ) are the optical center coordinates of the i-th vertex of the j-th location identification vertex;
Bj1=xj2yj3-xj4yj3+xj4yj2-xj2yj4+xj3yj4-xj3yj2 B j1 = x j2 y j3 -x j4 y j3 +x j4 y j2 -x j2 y j4 +x j3 y j4 -x j3 y j2
Bj2=xj3yj4-xj4yj3-xj1yj4-xj4yj1+xj1yj3-xj3yj1 B j2 = x j3 y j4 -x j4 y j3 -x j1 y j4 -x j4 y j1 +x j1 y j3 -x j3 y j1
Bj3=xj1yj2-xj4yj2-xj2yj1-xj1yj4+xj4yj1-xj2yj4 B j3 =x j1 y j2 -x j4 y j2 -x j2 y j1 -x j1 y j4 +x j4 y j1 -x j2 y j4
Bj4=xj3yj2-xj2yj3+xj1yj3-xj2yj1-xj1yj2-xj3yj1 B j4 =x j3 y j2 -x j2 y j3 +x j1 y j3 -x j2 y j1 -x j1 y j2 -x j3 y j1
其中,lj为第j个定位标识的顶点ξ和顶点υ之间的距离,C为摄像机的有效焦距。Among them, l j is the distance between the vertex ξ and the vertex υ of the jth positioning mark, and C is the effective focal length of the camera.
进一步的,所述的步骤二包括:Further, the second step includes:
步骤2.1:对采集得到的每帧目标图像进行自适应二值化预处理;Step 2.1: Perform adaptive binarization preprocessing on each frame of the acquired target image;
步骤2.2:利用基于连通分量的方法对预处理后的目标图像中的定位标识进行提取。Step 2.2: Using a method based on connected components to extract the location markers in the preprocessed target image.
与现有技术相比,本发明的有益效果是:Compared with prior art, the beneficial effect of the present invention is:
本发明利用非接触式的视觉测量技术,能够自动测量出采煤机视频图像中摇臂相对于机身的倾角,测量结果准确度高,为煤矿井下采煤机摇臂采高测量提供必要的技术支持,具有显著的经济效益和较高的工程应用价值。The invention uses non-contact visual measurement technology to automatically measure the inclination angle of the rocker arm relative to the fuselage in the video image of the coal mining machine. Technical support, with significant economic benefits and high engineering application value.
附图说明Description of drawings
图1为本发明的流程图。Fig. 1 is a flowchart of the present invention.
图2为本发明定位标识在采煤机中的安装位置图。Fig. 2 is a diagram of the installation position of the positioning mark of the present invention in the coal shearer.
图3为本发明方法采集的图像及其处理后的图像,(a)原始图像,(b)二值化预处理后的图像,(c)提取的定位标识。Fig. 3 is the image collected by the method of the present invention and the processed image thereof, (a) the original image, (b) the image after binarization preprocessing, and (c) the extracted positioning mark.
以下结合实施例对本发明的具体内容作进一步详细解释说明。The specific content of the present invention will be further explained in detail below in conjunction with the examples.
具体实施方式detailed description
本发明首先对文中使用的坐标系作以说明:The present invention first explains the coordinate system used in the text:
光心坐标系(相机坐标系):以相机的光心为坐标原点,X轴、Y轴分别平行于CCD平面的两条垂直边,Z轴与相机的光轴重合;图像坐标系:坐标原点在CCD图像平面的中心,X轴、Y轴分别平行于CCD平面的两条垂直边;像素坐标系:坐标原点在CCD图像平面的左上角,U轴、V轴分别平行于图像坐标的X轴、Y轴。Optical center coordinate system (camera coordinate system): take the optical center of the camera as the coordinate origin, the X-axis and Y-axis are parallel to the two vertical sides of the CCD plane, and the Z-axis coincides with the optical axis of the camera; image coordinate system: coordinate origin At the center of the CCD image plane, the X-axis and Y-axis are parallel to the two vertical sides of the CCD plane; pixel coordinate system: the coordinate origin is at the upper left corner of the CCD image plane, and the U-axis and V-axis are parallel to the X-axis of the image coordinates , Y axis.
本发明的一种采煤机摇臂采高视觉测量方法,包括以下步骤:A method for visually measuring the mining height of a rocker arm of a coal mining machine according to the present invention comprises the following steps:
步骤一:分别在采煤机摇臂和机身销轴上安装方形定位标识,并通过摄像机对采煤机进行图像采集,一般将摄像机安装在采煤机上,具体见图2;Step 1: Install a square positioning mark on the rocker arm and the pin shaft of the fuselage of the shearer respectively, and collect images of the shearer through a camera. Generally, the camera is installed on the shearer, see Figure 2 for details;
步骤二:对采集得到的目标图像进行降噪处理,提取预处理后图像中的定位标识,其中,每幅图像中有两个定位标识;Step 2: Perform noise reduction processing on the collected target image, and extract the positioning marks in the pre-processed image, where there are two positioning marks in each image;
步骤2.1:对采集得到的每帧目标图像进行自适应二值化预处理;Step 2.1: Perform adaptive binarization preprocessing on each frame of the acquired target image;
步骤2.2:利用基于连通分量的方法对预处理后的目标图像中的定位标识进行提取;Step 2.2: using a method based on connected components to extract the location markers in the preprocessed target image;
步骤三:对每个定位标识进行边缘直线拟合,得到每个定位标识的四个顶点坐标,具体为:Step 3: Perform edge straight line fitting for each positioning mark to obtain the four vertex coordinates of each positioning mark, specifically:
步骤3.1:对第j个定位标识按照设定的中心间距和大小分布感受野,采用(r*2+1)*(r*2+1)的掩模,j=1,2,r为感受野细胞半径,掩模中心与感受野细胞中心重合;Step 3.1: Distribute the receptive field for the jth positioning mark according to the set center distance and size, and use the mask of (r*2+1)*(r*2+1), j=1, 2, r is the receptive field Field cell radius, the center of the mask coincides with the center of the receptive field cell;
步骤3.2:利用梯度算子计算每个感受野掩模梯度方向;Step 3.2: Use the gradient operator to calculate the gradient direction of each receptive field mask;
通过掩模梯度方向对每个感受野方向进行定性判断,从而分别划分出定位标识的上边缘、下边缘、左边缘和右边缘上分布的感受野细胞;Qualitatively judge the direction of each receptive field through the gradient direction of the mask, so as to divide the receptive field cells distributed on the upper edge, lower edge, left edge and right edge of the positioning mark;
步骤3.3:利用感受野模型,计算上边缘方向各个感受野的响应值S,Step 3.3: Using the receptive field model, calculate the response value S of each receptive field in the direction of the upper edge,
S=S1-S2 (2)S=S 1 -S 2 (2)
其中,σD=rD/4,σS=rS/4;rD和rS分别表示感受野的中心区和外周区(也包含中心区的大圆)的半径,h(u,v,η)表示对比刺激覆盖率为η时,位于像素(u,v)的像素点刺激强度,对于二值图像中像素值为255的点取值为1,像素值为0的点取值为0;Among them, σ D =r D /4, σ S =r S /4; r D and r S represent the radii of the central area and the peripheral area (also including the great circle of the central area) of the receptive field respectively, h(u,v, η) represents the stimulus intensity of the pixel point located in the pixel (u, v) when the contrast stimulus coverage rate is η, the value of the point with a pixel value of 255 in the binary image is 1, and the value of a point with a pixel value of 0 is 0 ;
S1为感受野中心区响应值,S2为感受野周边区域的响应值,Dl为位于感受野中心区的像素点,Se为位于感受野周边区域的像素点,l=0,1,2,...,f,e=1,2,...,m,f为位于感受野中心区的像素点,m为位于感受野周边区域的像素点个数。S 1 is the response value of the central area of the receptive field, S 2 is the response value of the surrounding area of the receptive field, D l is the pixel point located in the central area of the receptive field, Se is the pixel point located in the peripheral area of the receptive field, l=0,1 ,2,...,f, e=1,2,...,m, f is the pixel located in the center of the receptive field, m is the number of pixels located in the peripheral area of the receptive field.
根据单个感受野内像素点形成的对比边缘位置与感受野中心距离的关系,确定每个感受野中心到感受野内拟合对比边缘的距离dh,h=1,2,...,n,其中n表示感受野细胞个数。According to the relationship between the contrast edge position formed by the pixels in a single receptive field and the distance from the center of the receptive field, determine the distance d h from the center of each receptive field to the fitted contrast edge in the receptive field, h=1,2,...,n, where n represents the number of receptive field cells.
假设边缘所在直线方程(a,b)(u,v)T+c=0,根据点到直线的距离公式:Assuming that the line equation of the edge is (a,b)(u,v) T +c=0, according to the distance formula from the point to the line:
其中,(uh,vh)为感受野中心在像素坐标系上的坐标点。Among them, (u h , v h ) is the coordinate point of the center of the receptive field on the pixel coordinate system.
利用带约束的最小二乘法模型对该边缘所在直线进行拟合;Fit the straight line where the edge is located using a constrained least squares model;
其中,L(a,b,c,λ)表示拉格朗日函数,λ为参数;a,b,c为拟合的边缘所在直线方程系数,U、V均表示由感受野细胞中心的像素坐标组成的n*1矩阵,D表示dh组成的n*1矩阵;Among them, L(a, b, c, λ) represents the Lagrangian function, λ is a parameter; a, b, c are the coefficients of the line equation where the fitted edge is located, and U and V represent the pixel at the center of the receptive field cell An n*1 matrix composed of coordinates, D represents an n*1 matrix composed of d h ;
在约束条件a2+b2=1下,找到a,b,c最优解(a*,b*,c*);Under the constraint condition a 2 +b 2 =1, find the optimal solution of a, b, c (a * , b * , c * );
步骤3.4:重复步骤3.3,分别对定位标识的下边缘、左边缘、右边缘所在直线进行拟合;Step 3.4: Repeat step 3.3 to fit the straight lines where the lower edge, left edge, and right edge of the positioning mark are located;
步骤3.5:根据拟合的上边缘、下边缘、左边缘和右边缘四条直线方程,得到第j个定位标识的四个顶点坐标;Step 3.5: Obtain the coordinates of the four vertices of the jth positioning mark according to the four straight line equations of the fitted upper edge, lower edge, left edge and right edge;
步骤3.6:重复步骤3.1~步骤3.5,得到两个定位标识的顶点坐标;Step 3.6: Repeat steps 3.1 to 3.5 to obtain the vertex coordinates of the two positioning marks;
步骤四:根据步骤三得到的两个定位标识的各自顶点坐标得到两个定位标识之间的夹角,根据摇臂臂长和两个定位标识之间的夹角采煤机的摇臂采高。Step 4: According to the respective vertex coordinates of the two positioning marks obtained in step 3, the angle between the two positioning marks is obtained, and the rocking arm mining height of the shearer is obtained according to the length of the rocker arm and the angle between the two positioning marks .
步骤4.1:将步骤三得到定位标识的四个顶点坐标转化为图像坐标(xji,yji),根据图像坐标与光心坐标(Xji,Yji,Zji)的关系,计算第j个定位标识中顶点ξ和顶点υ形成的向量nj;Step 4.1: Convert the coordinates of the four vertices obtained in Step 3 into the image coordinates (x ji , y ji ), and calculate the jth one according to the relationship between the image coordinates and the optical center coordinates (X ji , Y ji , Z ji ). Vector n j formed by vertex ξ and vertex υ in the positioning mark;
其中,nj为第j个定位标识的顶点ξ和顶点υ形成的向量,j=1,2,i=1,2,3,4,ξ∈i,υ∈i,ξ≠υ;(xji,yji)为第j个定位标识顶点的第i个顶点的图像坐标,(Xji,Yji,Zji)为第j个定位标识顶点的第i个顶点的光心坐标,将每个定位标识左上角的顶点作为第一个坐标P1,其余坐标按顺时针方向依次分布,如图2所示;Among them, n j is the vector formed by the vertex ξ and the vertex υ of the jth location marker, j=1,2, i=1,2,3,4, ξ∈i,υ∈i, ξ≠υ; (x ji ,y ji ) is the image coordinates of the i-th vertex of the j-th location marker vertex, (X ji ,Y ji , Z ji ) is the optical center coordinate of the i-th vertex of the j-th location marker vertex, and each The vertex in the upper left corner of a positioning mark is taken as the first coordinate P 1 , and the rest of the coordinates are distributed in a clockwise direction, as shown in Figure 2;
Bj1=xj2yj3-xj4yj3+xj4yj2-xj2yj4+xj3yj4-xj3yj2 B j1 = x j2 y j3 -x j4 y j3 +x j4 y j2 -x j2 y j4 +x j3 y j4 -x j3 y j2
Bj2=xj3yj4-xj4yj3-xj1yj4-xj4yj1+xj1yj3-xj3yj1 B j2 = x j3 y j4 -x j4 y j3 -x j1 y j4 -x j4 y j1 +x j1 y j3 -x j3 y j1
Bj3=xj1yj2-xj4yj2-xj2yj1-xj1yj4+xj4yj1-xj2yj4 B j3 =x j1 y j2 -x j4 y j2 -x j2 y j1 -x j1 y j4 +x j4 y j1 -x j2 y j4
Bj4=xj3yj2-xj2yj3+xj1yj3-xj2yj1-xj1yj2-xj3yj1 B j4 =x j3 y j2 -x j2 y j3 +x j1 y j3 -x j2 y j1 -x j1 y j2 -x j3 y j1
其中,lj为第j个定位标识的顶点ξ和顶点υ之间的距离,C为摄像机的有效焦距;Wherein, l j is the distance between the vertex ξ and the vertex υ of the jth positioning mark, and C is the effective focal length of the camera;
步骤4.2:通过下式(1)和(2)计算采煤机摇臂的采高h,Step 4.2: Calculate the mining height h of the rocker arm of the shearer through the following formulas (1) and (2),
h=L*sin(θ-θ0) (1)h=L*sin(θ-θ 0 ) (1)
其中,L为摇臂的臂长,θ为采煤机的摇臂在运动过程中,两个定位标识之间的夹角,θ0为采煤机的摇臂轴线与采煤机机身轴线平行时,两个定位标识之间的夹角。Among them, L is the arm length of the rocker arm, θ is the angle between the two positioning marks during the movement of the rocker arm of the shearer, and θ0 is the axis of the rocker arm of the shearer and the axis of the body of the shearer When parallel, the angle between two positioning marks.
以下给出本发明的具体实施例,需要说明的是本发明并不局限于以下具体实施例,凡在本申请技术方案基础上做的等同变换均落入本发明的保护范围。Specific embodiments of the present invention are provided below, and it should be noted that the present invention is not limited to the following specific embodiments, and all equivalent transformations done on the basis of the technical solutions of the present application all fall within the scope of protection of the present invention.
实施例Example
本实施例给出一种采煤机摇臂采高视觉测量检测方法,包括:This embodiment provides a method for visual measurement and detection of the mining height of the rocker arm of a coal mining machine, including:
分别在采煤机摇臂和机身上安装方形定位标识,当采煤机的摇臂与机身平行时,通过安装在采煤机机身上的摄像机对采煤机进行图像采集,如图2所示,通过一横杆将摄像机悬挂在两个定位标识之间机身的某一位置,使摄像机能同时拍摄到两个定位标识,摇臂的长度为500mm。Install square positioning marks on the rocker arm and the fuselage of the shearer respectively. When the rocker arm of the shearer is parallel to the fuselage, the image acquisition of the shearer is carried out through the camera installed on the shearer body, as shown in the figure As shown in 2, the camera is suspended on a certain position of the fuselage between the two positioning marks through a cross bar, so that the camera can capture the two positioning marks at the same time, and the length of the rocker arm is 500mm.
对采集得到的每帧目标图像进行自适应二值化预处理,处理结果如图3(a)所示;提取二值化预处理后的液压支架图像中的连通分量;利用连通分量的长短轴比和面积信息提取与分割液压支架图像中的定位标识,提取后的图像如图3(b);Adaptive binarization preprocessing is performed on each frame of target image acquired, and the processing result is shown in Figure 3(a); the connected components in the hydraulic support image after binarization preprocessing are extracted; the long and short axes of the connected components are used to Ratio and area information extraction and segmentation of positioning marks in the hydraulic support image, the extracted image is shown in Figure 3(b);
利用梯度算子计算每个感受野掩模梯度方向,通过梯度方向,对每个感受野方向进行定性判断,从而分别划分出定位标识上任一边缘上分布的感受野细胞,如图3(c)所示;利用感受野模型,计算定位标识边缘方向各个感受野的响应值,根据单个感受野内像素点形成的对比边缘位置与感受野中心距离的关系,确定每个感受野中心到感受野内拟合对比边缘的距离;Use the gradient operator to calculate the gradient direction of each receptive field mask, and make a qualitative judgment on each receptive field direction through the gradient direction, so as to divide the receptive field cells distributed on any edge of the positioning mark, as shown in Figure 3(c) As shown; using the receptive field model, calculate the response value of each receptive field in the edge direction of the positioning mark, and determine the fitting from the center of each receptive field to the receptive field according to the relationship between the contrast edge position formed by a single receptive field pixel and the distance from the receptive field center Compare the distance of the edge;
利用带约束的最小二乘法模型对该边缘所在直线进行拟合;根据拟合的上边缘、下边缘、左边缘和右边缘四条直线方程,计算掘进机图像中定位标识的四个顶点的像素坐标。Use the constrained least squares model to fit the straight line where the edge is located; calculate the pixel coordinates of the four vertices of the positioning marks in the roadheader image according to the four straight line equations of the fitted upper edge, lower edge, left edge and right edge .
利用上述计算公式(1)至(5)计算得到摇臂与机身平行时,两个定位标识的夹角为1.5413°;Using the above calculation formulas (1) to (5), when the rocker arm is parallel to the fuselage, the angle between the two positioning marks is 1.5413°;
调整采煤机摇臂,当摇臂抬升19.1892°,采高为164.3443mm时,进行图像采集,重复上述步骤,计算出此时采煤机上两个定位标识的夹角为20.6979°,考虑到初始夹角为1.5413°,最终得到采煤机摇臂与机身的实际夹角为19.1566°,采高为164.0756mm,此数值与实际数值很接近,因此,本发明方法能较好的为煤矿井下采煤机摇臂采高测量提供必要的技术支持。Adjust the rocker arm of the shearer. When the rocker arm is raised by 19.1892° and the mining height is 164.3443mm, carry out image acquisition, repeat the above steps, and calculate that the angle between the two positioning marks on the shearer is 20.6979°. Considering the initial The included angle is 1.5413°, and finally the actual included angle between the rocker arm and the fuselage of the shearer is 19.1566°, and the mining height is 164.0756mm. This value is very close to the actual value. The mining height measurement of the rocker arm of the coal mining machine provides the necessary technical support.
Claims (2)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710442853.4A CN107131837B (en) | 2017-06-13 | 2017-06-13 | A kind of rocker arm of coal mining machine mining height vision measuring method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710442853.4A CN107131837B (en) | 2017-06-13 | 2017-06-13 | A kind of rocker arm of coal mining machine mining height vision measuring method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107131837A true CN107131837A (en) | 2017-09-05 |
CN107131837B CN107131837B (en) | 2018-05-18 |
Family
ID=59734680
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710442853.4A Active CN107131837B (en) | 2017-06-13 | 2017-06-13 | A kind of rocker arm of coal mining machine mining height vision measuring method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107131837B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111127406A (en) * | 2019-12-10 | 2020-05-08 | 创维集团智能装备有限公司 | Back plate machining position adjusting method, terminal, system and storage medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN201433792Y (en) * | 2009-07-17 | 2010-03-31 | 西安煤矿机械有限公司 | Real-time monitoring system for mining height of coal mining machine |
CN101975061A (en) * | 2010-09-30 | 2011-02-16 | 三一重型装备有限公司 | Coal winning machine and mining height system thereof |
CN102287186A (en) * | 2011-07-16 | 2011-12-21 | 西安煤矿机械有限公司 | Self-positioning system and self-positioning method for coal mining machine |
CN205593503U (en) * | 2016-02-17 | 2016-09-21 | 神华集团有限责任公司 | A high detecting system is adopted to rocking arm that is used for single cylinder shortwall coal -winning machine |
CN106568424A (en) * | 2016-10-27 | 2017-04-19 | 西安科技大学 | Machine vision-based coal cutter rocker arm mining height detection method |
-
2017
- 2017-06-13 CN CN201710442853.4A patent/CN107131837B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN201433792Y (en) * | 2009-07-17 | 2010-03-31 | 西安煤矿机械有限公司 | Real-time monitoring system for mining height of coal mining machine |
CN101975061A (en) * | 2010-09-30 | 2011-02-16 | 三一重型装备有限公司 | Coal winning machine and mining height system thereof |
CN102287186A (en) * | 2011-07-16 | 2011-12-21 | 西安煤矿机械有限公司 | Self-positioning system and self-positioning method for coal mining machine |
CN205593503U (en) * | 2016-02-17 | 2016-09-21 | 神华集团有限责任公司 | A high detecting system is adopted to rocking arm that is used for single cylinder shortwall coal -winning machine |
CN106568424A (en) * | 2016-10-27 | 2017-04-19 | 西安科技大学 | Machine vision-based coal cutter rocker arm mining height detection method |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111127406A (en) * | 2019-12-10 | 2020-05-08 | 创维集团智能装备有限公司 | Back plate machining position adjusting method, terminal, system and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN107131837B (en) | 2018-05-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107316330B (en) | Underground hydraulic support frame group pose and verticality measuring method based on more image sequences | |
CN107292926B (en) | Crusing robot movement locus verticality measuring method based on more image sequences | |
CN113379712B (en) | A computer vision-based method and system for detection of steel bridge bolt diseases | |
CN107316288B (en) | A kind of boom-type roadheader cutterhead pose vision measuring method | |
CN102673106B (en) | Silk screen print positioning equipment and method for photovoltaic solar silicon chip | |
CN103266559B (en) | The method of BP bridge security inspection car and face, acquisition bridge surface phase | |
CN109969736A (en) | An intelligent detection method for deviation fault of large carrying belt | |
CN105699399B (en) | A kind of detection device and method of SMT masterplates quality | |
CN108986082A (en) | A kind of profile of steel rail detection method and system based on EPNP | |
CN110009617A (en) | An online quality inspection method for shaft parts | |
CN105891220B (en) | A kind of pavement marker line defect detection device and its detection method | |
CN106326894A (en) | Adverse state detection method of transverse pins of rotation double lugs of high-speed rail overhead contact line equipment | |
CN106935683A (en) | A kind of solar battery sheet SPEED VISION positioning and correction system and its method | |
CN115619738A (en) | Detection method for module side seam welding after welding | |
CN113012098A (en) | Iron tower angle steel punching defect detection method based on BP neural network | |
CN107314807A (en) | A kind of method of steel wire rope horizontal space vibration measurement | |
CN103962394A (en) | Online detection method for hot mill roller rolling direction offset | |
CN112053333B (en) | Square billet detection method, system, equipment and medium based on machine vision | |
CN104897463A (en) | Real-time detection apparatus and real-time detection method of steel-concrete combination member deformation due to force applying | |
CN103322928A (en) | Similar model displacement field measuring system and method based on grid dot matrix | |
CN111452840B (en) | Railway steel rail crawling displacement detection method based on monocular vision measurement technology | |
CN111967323B (en) | Electric power live working safety detection method based on deep learning algorithm | |
CN107131837B (en) | A kind of rocker arm of coal mining machine mining height vision measuring method | |
CN111784779A (en) | Checkerboard image recognition and positioning system and method based on convolutional neural network and nested contour recognition | |
CN105856241B (en) | A kind of difference scale electronic liquid crystal display positioning grasping means |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |