CN107131837A - A kind of rocker arm of coal mining machine mining height vision measuring method - Google Patents

A kind of rocker arm of coal mining machine mining height vision measuring method Download PDF

Info

Publication number
CN107131837A
CN107131837A CN201710442853.4A CN201710442853A CN107131837A CN 107131837 A CN107131837 A CN 107131837A CN 201710442853 A CN201710442853 A CN 201710442853A CN 107131837 A CN107131837 A CN 107131837A
Authority
CN
China
Prior art keywords
mrow
msub
msup
receptive field
mfrac
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710442853.4A
Other languages
Chinese (zh)
Other versions
CN107131837B (en
Inventor
张旭辉
杨文娟
刘永伟
毛清华
谢亚洲
谭厚志
张超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian University of Science and Technology
Original Assignee
Xian University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian University of Science and Technology filed Critical Xian University of Science and Technology
Priority to CN201710442853.4A priority Critical patent/CN107131837B/en
Publication of CN107131837A publication Critical patent/CN107131837A/en
Application granted granted Critical
Publication of CN107131837B publication Critical patent/CN107131837B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/02Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
    • G01B11/022Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness by means of tv-camera scanning
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/26Measuring arrangements characterised by the use of optical techniques for measuring angles or tapers; for testing the alignment of axes

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Other Investigation Or Analysis Of Materials By Electrical Means (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

本发明公开了一种采煤机摇臂采高视觉测量方法,分别在采煤机摇臂和机身上安装方形定位标识,并通过摄像机对采煤机进行图像采集;对采集得到的目标图像进行降噪处理,提取降噪处理后图像中的定位标识;对每个定位标识进行边缘直线拟合,得到每个定位标识的四个顶点坐标;根据步骤三得到的定位标识各自顶点坐标得到两个定位标识之间的夹角,根据摇臂臂长和两个定位标识之间的夹角采煤机的摇臂采高。本发明利用非接触式的视觉测量技术,能够自动测量出采煤机视频图像中摇臂相对于机身的倾角,测量结果准确度高,为煤矿井下采煤机摇臂采高测量提供必要的技术支持,具有显著的经济效益和较高的工程应用价值。

The invention discloses a method for visually measuring the mining height of the rocker arm of a coal shearer. A square positioning mark is respectively installed on the rocker arm of the coal shearer and the machine body, and the image of the shearer is collected by a camera; the collected target image is Carry out noise reduction processing, and extract the positioning marks in the image after the noise reduction processing; carry out edge straight line fitting on each positioning mark, and obtain the four vertex coordinates of each positioning mark; The included angle between the two positioning marks is based on the length of the rocker arm and the angle between the two positioning marks, and the rocker mining height of the shearer. The invention uses non-contact visual measurement technology to automatically measure the inclination angle of the rocker arm relative to the fuselage in the video image of the coal mining machine. Technical support, with significant economic benefits and high engineering application value.

Description

一种采煤机摇臂采高视觉测量方法A visual measurement method for mining height of rocker arm of coal mining machine

技术领域technical field

本发明属于矿用设备运行状态监测领域,尤其涉及一种采煤机摇臂采高视觉测量方法。The invention belongs to the field of mining equipment operation state monitoring, and in particular relates to a visual measurement method for mining height of a rocker arm of a coal mining machine.

背景技术Background technique

采煤机采高是采煤机工况的重要参数,因此采煤机摇臂倾角检测非常必要。目前的采煤机采高的测量一般都采用接触式的测量方法,其中,采用旋转编码器对其摇臂倾角测量,这种方法安装困难;还有使用磁伸缩式传感器对摇臂油缸位移测量间接计算摇臂的倾角,但由于采煤机的摇臂在工作时有较大的受迫振动,这两种传感器的使用寿命都很短,严重限制了采煤机的智能控制的发展。The mining height of the shearer is an important parameter of the working condition of the shearer, so the detection of the inclination angle of the rocker arm of the shearer is very necessary. At present, the mining height measurement of coal mining machines generally adopts contact measurement methods, among which, the rotary encoder is used to measure the inclination angle of its rocker arm, which is difficult to install; there is also the use of magnetic telescopic sensors to measure the displacement of the rocker arm cylinder. The inclination angle of the rocker arm is calculated indirectly, but because the rocker arm of the shearer has a large forced vibration when it is working, the service life of these two sensors is very short, which seriously limits the development of intelligent control of the shearer.

发明内容Contents of the invention

针对现有制备技术的缺陷和不足,本发明的目的是提供一种采煤机摇臂采高视觉测量方法,解决了现有检测方法存在检测装置安装困难和检测精度不高的问题。Aiming at the defects and deficiencies of the existing preparation technology, the purpose of the present invention is to provide a method for visually measuring the mining height of the rocker arm of a coal shearer, which solves the problems of difficulty in installing the detection device and low detection accuracy in the existing detection method.

为了实现上述目的,本发明采用如下技术方案予以实现:In order to achieve the above object, the present invention adopts the following technical solutions to achieve:

一种采煤机摇臂采高视觉测量方法,包括以下步骤:A method for visually measuring the mining height of a rocker arm of a coal shearer, comprising the following steps:

步骤一:分别在采煤机摇臂和机身上安装方形定位标识,并通过摄像机对采煤机进行图像采集;Step 1: Install square positioning marks on the rocker arm and body of the shearer respectively, and collect images of the shearer through the camera;

步骤二:对采集得到的目标图像进行降噪处理,提取降噪处理后图像中的定位标识;Step 2: Perform noise reduction processing on the acquired target image, and extract the positioning mark in the image after the noise reduction processing;

步骤三:对每个定位标识进行边缘直线拟合,得到每个定位标识的四个顶点坐标,具体步骤为:Step 3: Perform edge straight line fitting for each positioning mark to obtain the four vertex coordinates of each positioning mark. The specific steps are:

步骤3.1:对第j个定位标识按照设定的中心间距和大小分布感受野,采用(r*2+1)*(r*2+1)的掩模,j=1,2,N为定位标识板的个数,r为感受野细胞半径,掩模中心与感受野细胞中心重合;Step 3.1: Distribute the receptive field for the jth positioning mark according to the set center distance and size, use the mask of (r*2+1)*(r*2+1), j=1, 2, N is the positioning The number of identification plates, r is the radius of the receptive field cell, and the center of the mask coincides with the center of the receptive field cell;

步骤3.2:利用梯度算子计算每个感受野掩模梯度方向,通过掩模梯度方向对每个感受野方向进行定性判断,从而分别划分出定位标识的上边缘、下边缘、左边缘和右边缘上分布的感受野细胞;Step 3.2: Use the gradient operator to calculate the gradient direction of each receptive field mask, and make a qualitative judgment on each receptive field direction through the gradient direction of the mask, so as to divide the upper edge, lower edge, left edge and right edge of the positioning mark respectively Receptive field cells distributed on

步骤3.3:利用感受野模型,计算上边缘方向各个感受野的响应值,根据单个感受野内像素点形成的对比边缘位置与感受野中心距离的关系,确定每个感受野中心到感受野内对比边缘到感受野中心的距离,然后利用带约束的最小二乘法模型拟合出标识板上边缘所在直线;Step 3.3: Use the receptive field model to calculate the response value of each receptive field in the direction of the upper edge, and determine the relationship between the center of each receptive field and the contrast edge in the receptive field to Feel the distance from the center of the field, and then use the constrained least squares model to fit the straight line where the edge of the signboard is located;

步骤3.4:重复步骤3.3,分别对定位标识的下边缘、左边缘、右边缘所在直线进行拟合;Step 3.4: Repeat step 3.3 to fit the straight lines where the lower edge, left edge, and right edge of the positioning mark are located;

步骤3.5:根据拟合的上边缘、下边缘、左边缘和右边缘四条直线方程,得到第j个定位标识的四个顶点坐标;Step 3.5: Obtain the coordinates of the four vertices of the jth positioning mark according to the four straight line equations of the fitted upper edge, lower edge, left edge and right edge;

步骤3.6:重复步骤3.1~步骤3.5,得到所有定位标识的四个顶点坐标。Step 3.6: Repeat steps 3.1 to 3.5 to obtain the four vertex coordinates of all positioning marks.

步骤四:根据步骤三得到的定位标识各自顶点坐标得到两个定位标识之间的夹角,通过下式(1)和(2)计算采煤机摇臂的采高hStep 4: According to the vertex coordinates of the positioning marks obtained in step 3, the angle between the two positioning marks is obtained, and the mining height h of the rocker arm of the shearer is calculated by the following formulas (1) and (2)

h=L*sin(θ-θ0) (1)h=L*sin(θ-θ 0 ) (1)

其中,L为摇臂的臂长,θ为两个定位标识之间的夹角;Among them, L is the arm length of the rocker arm, and θ is the angle between the two positioning marks;

nj为第j个定位标识的顶点ξ和顶点υ形成的向量,j=1,2,i=1,2,3,4,将每个定位标识左上角的顶点作为第一个坐标P1,其余坐标按顺时针方向依次分布,ξ∈i,υ∈i,ξ≠υ;(xji,yji)为第j个定位标识顶点的第i个顶点的图像坐标,(Xji,Yji,Zji)为第j个定位标识顶点的第i个顶点的光心坐标;n j is the vector formed by the vertex ξ and the vertex υ of the jth positioning mark, j=1, 2, i=1, 2, 3, 4, and the vertex at the upper left corner of each positioning mark is taken as the first coordinate P 1 , the remaining coordinates are distributed in a clockwise direction, ξ∈i,υ∈i, ξ≠υ; (x ji ,y ji ) is the image coordinate of the i-th vertex of the j-th location identification vertex, (X ji ,Y ji , Z ji ) are the optical center coordinates of the i-th vertex of the j-th location identification vertex;

Bj1=xj2yj3-xj4yj3+xj4yj2-xj2yj4+xj3yj4-xj3yj2 B j1 = x j2 y j3 -x j4 y j3 +x j4 y j2 -x j2 y j4 +x j3 y j4 -x j3 y j2

Bj2=xj3yj4-xj4yj3-xj1yj4-xj4yj1+xj1yj3-xj3yj1 B j2 = x j3 y j4 -x j4 y j3 -x j1 y j4 -x j4 y j1 +x j1 y j3 -x j3 y j1

Bj3=xj1yj2-xj4yj2-xj2yj1-xj1yj4+xj4yj1-xj2yj4 B j3 =x j1 y j2 -x j4 y j2 -x j2 y j1 -x j1 y j4 +x j4 y j1 -x j2 y j4

Bj4=xj3yj2-xj2yj3+xj1yj3-xj2yj1-xj1yj2-xj3yj1 B j4 =x j3 y j2 -x j2 y j3 +x j1 y j3 -x j2 y j1 -x j1 y j2 -x j3 y j1

其中,lj为第j个定位标识的顶点ξ和顶点υ之间的距离,C为摄像机的有效焦距。Among them, l j is the distance between the vertex ξ and the vertex υ of the jth positioning mark, and C is the effective focal length of the camera.

进一步的,所述的步骤二包括:Further, the second step includes:

步骤2.1:对采集得到的每帧目标图像进行自适应二值化预处理;Step 2.1: Perform adaptive binarization preprocessing on each frame of the acquired target image;

步骤2.2:利用基于连通分量的方法对预处理后的目标图像中的定位标识进行提取。Step 2.2: Using a method based on connected components to extract the location markers in the preprocessed target image.

与现有技术相比,本发明的有益效果是:Compared with prior art, the beneficial effect of the present invention is:

本发明利用非接触式的视觉测量技术,能够自动测量出采煤机视频图像中摇臂相对于机身的倾角,测量结果准确度高,为煤矿井下采煤机摇臂采高测量提供必要的技术支持,具有显著的经济效益和较高的工程应用价值。The invention uses non-contact visual measurement technology to automatically measure the inclination angle of the rocker arm relative to the fuselage in the video image of the coal mining machine. Technical support, with significant economic benefits and high engineering application value.

附图说明Description of drawings

图1为本发明的流程图。Fig. 1 is a flowchart of the present invention.

图2为本发明定位标识在采煤机中的安装位置图。Fig. 2 is a diagram of the installation position of the positioning mark of the present invention in the coal shearer.

图3为本发明方法采集的图像及其处理后的图像,(a)原始图像,(b)二值化预处理后的图像,(c)提取的定位标识。Fig. 3 is the image collected by the method of the present invention and the processed image thereof, (a) the original image, (b) the image after binarization preprocessing, and (c) the extracted positioning mark.

以下结合实施例对本发明的具体内容作进一步详细解释说明。The specific content of the present invention will be further explained in detail below in conjunction with the examples.

具体实施方式detailed description

本发明首先对文中使用的坐标系作以说明:The present invention first explains the coordinate system used in the text:

光心坐标系(相机坐标系):以相机的光心为坐标原点,X轴、Y轴分别平行于CCD平面的两条垂直边,Z轴与相机的光轴重合;图像坐标系:坐标原点在CCD图像平面的中心,X轴、Y轴分别平行于CCD平面的两条垂直边;像素坐标系:坐标原点在CCD图像平面的左上角,U轴、V轴分别平行于图像坐标的X轴、Y轴。Optical center coordinate system (camera coordinate system): take the optical center of the camera as the coordinate origin, the X-axis and Y-axis are parallel to the two vertical sides of the CCD plane, and the Z-axis coincides with the optical axis of the camera; image coordinate system: coordinate origin At the center of the CCD image plane, the X-axis and Y-axis are parallel to the two vertical sides of the CCD plane; pixel coordinate system: the coordinate origin is at the upper left corner of the CCD image plane, and the U-axis and V-axis are parallel to the X-axis of the image coordinates , Y axis.

本发明的一种采煤机摇臂采高视觉测量方法,包括以下步骤:A method for visually measuring the mining height of a rocker arm of a coal mining machine according to the present invention comprises the following steps:

步骤一:分别在采煤机摇臂和机身销轴上安装方形定位标识,并通过摄像机对采煤机进行图像采集,一般将摄像机安装在采煤机上,具体见图2;Step 1: Install a square positioning mark on the rocker arm and the pin shaft of the fuselage of the shearer respectively, and collect images of the shearer through a camera. Generally, the camera is installed on the shearer, see Figure 2 for details;

步骤二:对采集得到的目标图像进行降噪处理,提取预处理后图像中的定位标识,其中,每幅图像中有两个定位标识;Step 2: Perform noise reduction processing on the collected target image, and extract the positioning marks in the pre-processed image, where there are two positioning marks in each image;

步骤2.1:对采集得到的每帧目标图像进行自适应二值化预处理;Step 2.1: Perform adaptive binarization preprocessing on each frame of the acquired target image;

步骤2.2:利用基于连通分量的方法对预处理后的目标图像中的定位标识进行提取;Step 2.2: using a method based on connected components to extract the location markers in the preprocessed target image;

步骤三:对每个定位标识进行边缘直线拟合,得到每个定位标识的四个顶点坐标,具体为:Step 3: Perform edge straight line fitting for each positioning mark to obtain the four vertex coordinates of each positioning mark, specifically:

步骤3.1:对第j个定位标识按照设定的中心间距和大小分布感受野,采用(r*2+1)*(r*2+1)的掩模,j=1,2,r为感受野细胞半径,掩模中心与感受野细胞中心重合;Step 3.1: Distribute the receptive field for the jth positioning mark according to the set center distance and size, and use the mask of (r*2+1)*(r*2+1), j=1, 2, r is the receptive field Field cell radius, the center of the mask coincides with the center of the receptive field cell;

步骤3.2:利用梯度算子计算每个感受野掩模梯度方向;Step 3.2: Use the gradient operator to calculate the gradient direction of each receptive field mask;

通过掩模梯度方向对每个感受野方向进行定性判断,从而分别划分出定位标识的上边缘、下边缘、左边缘和右边缘上分布的感受野细胞;Qualitatively judge the direction of each receptive field through the gradient direction of the mask, so as to divide the receptive field cells distributed on the upper edge, lower edge, left edge and right edge of the positioning mark;

步骤3.3:利用感受野模型,计算上边缘方向各个感受野的响应值S,Step 3.3: Using the receptive field model, calculate the response value S of each receptive field in the direction of the upper edge,

S=S1-S2 (2)S=S 1 -S 2 (2)

其中,σD=rD/4,σS=rS/4;rD和rS分别表示感受野的中心区和外周区(也包含中心区的大圆)的半径,h(u,v,η)表示对比刺激覆盖率为η时,位于像素(u,v)的像素点刺激强度,对于二值图像中像素值为255的点取值为1,像素值为0的点取值为0;Among them, σ D =r D /4, σ S =r S /4; r D and r S represent the radii of the central area and the peripheral area (also including the great circle of the central area) of the receptive field respectively, h(u,v, η) represents the stimulus intensity of the pixel point located in the pixel (u, v) when the contrast stimulus coverage rate is η, the value of the point with a pixel value of 255 in the binary image is 1, and the value of a point with a pixel value of 0 is 0 ;

S1为感受野中心区响应值,S2为感受野周边区域的响应值,Dl为位于感受野中心区的像素点,Se为位于感受野周边区域的像素点,l=0,1,2,...,f,e=1,2,...,m,f为位于感受野中心区的像素点,m为位于感受野周边区域的像素点个数。S 1 is the response value of the central area of the receptive field, S 2 is the response value of the surrounding area of the receptive field, D l is the pixel point located in the central area of the receptive field, Se is the pixel point located in the peripheral area of the receptive field, l=0,1 ,2,...,f, e=1,2,...,m, f is the pixel located in the center of the receptive field, m is the number of pixels located in the peripheral area of the receptive field.

根据单个感受野内像素点形成的对比边缘位置与感受野中心距离的关系,确定每个感受野中心到感受野内拟合对比边缘的距离dh,h=1,2,...,n,其中n表示感受野细胞个数。According to the relationship between the contrast edge position formed by the pixels in a single receptive field and the distance from the center of the receptive field, determine the distance d h from the center of each receptive field to the fitted contrast edge in the receptive field, h=1,2,...,n, where n represents the number of receptive field cells.

假设边缘所在直线方程(a,b)(u,v)T+c=0,根据点到直线的距离公式:Assuming that the line equation of the edge is (a,b)(u,v) T +c=0, according to the distance formula from the point to the line:

其中,(uh,vh)为感受野中心在像素坐标系上的坐标点。Among them, (u h , v h ) is the coordinate point of the center of the receptive field on the pixel coordinate system.

利用带约束的最小二乘法模型对该边缘所在直线进行拟合;Fit the straight line where the edge is located using a constrained least squares model;

其中,L(a,b,c,λ)表示拉格朗日函数,λ为参数;a,b,c为拟合的边缘所在直线方程系数,U、V均表示由感受野细胞中心的像素坐标组成的n*1矩阵,D表示dh组成的n*1矩阵;Among them, L(a, b, c, λ) represents the Lagrangian function, λ is a parameter; a, b, c are the coefficients of the line equation where the fitted edge is located, and U and V represent the pixel at the center of the receptive field cell An n*1 matrix composed of coordinates, D represents an n*1 matrix composed of d h ;

在约束条件a2+b2=1下,找到a,b,c最优解(a*,b*,c*);Under the constraint condition a 2 +b 2 =1, find the optimal solution of a, b, c (a * , b * , c * );

步骤3.4:重复步骤3.3,分别对定位标识的下边缘、左边缘、右边缘所在直线进行拟合;Step 3.4: Repeat step 3.3 to fit the straight lines where the lower edge, left edge, and right edge of the positioning mark are located;

步骤3.5:根据拟合的上边缘、下边缘、左边缘和右边缘四条直线方程,得到第j个定位标识的四个顶点坐标;Step 3.5: Obtain the coordinates of the four vertices of the jth positioning mark according to the four straight line equations of the fitted upper edge, lower edge, left edge and right edge;

步骤3.6:重复步骤3.1~步骤3.5,得到两个定位标识的顶点坐标;Step 3.6: Repeat steps 3.1 to 3.5 to obtain the vertex coordinates of the two positioning marks;

步骤四:根据步骤三得到的两个定位标识的各自顶点坐标得到两个定位标识之间的夹角,根据摇臂臂长和两个定位标识之间的夹角采煤机的摇臂采高。Step 4: According to the respective vertex coordinates of the two positioning marks obtained in step 3, the angle between the two positioning marks is obtained, and the rocking arm mining height of the shearer is obtained according to the length of the rocker arm and the angle between the two positioning marks .

步骤4.1:将步骤三得到定位标识的四个顶点坐标转化为图像坐标(xji,yji),根据图像坐标与光心坐标(Xji,Yji,Zji)的关系,计算第j个定位标识中顶点ξ和顶点υ形成的向量njStep 4.1: Convert the coordinates of the four vertices obtained in Step 3 into the image coordinates (x ji , y ji ), and calculate the jth one according to the relationship between the image coordinates and the optical center coordinates (X ji , Y ji , Z ji ). Vector n j formed by vertex ξ and vertex υ in the positioning mark;

其中,nj为第j个定位标识的顶点ξ和顶点υ形成的向量,j=1,2,i=1,2,3,4,ξ∈i,υ∈i,ξ≠υ;(xji,yji)为第j个定位标识顶点的第i个顶点的图像坐标,(Xji,Yji,Zji)为第j个定位标识顶点的第i个顶点的光心坐标,将每个定位标识左上角的顶点作为第一个坐标P1,其余坐标按顺时针方向依次分布,如图2所示;Among them, n j is the vector formed by the vertex ξ and the vertex υ of the jth location marker, j=1,2, i=1,2,3,4, ξ∈i,υ∈i, ξ≠υ; (x ji ,y ji ) is the image coordinates of the i-th vertex of the j-th location marker vertex, (X ji ,Y ji , Z ji ) is the optical center coordinate of the i-th vertex of the j-th location marker vertex, and each The vertex in the upper left corner of a positioning mark is taken as the first coordinate P 1 , and the rest of the coordinates are distributed in a clockwise direction, as shown in Figure 2;

Bj1=xj2yj3-xj4yj3+xj4yj2-xj2yj4+xj3yj4-xj3yj2 B j1 = x j2 y j3 -x j4 y j3 +x j4 y j2 -x j2 y j4 +x j3 y j4 -x j3 y j2

Bj2=xj3yj4-xj4yj3-xj1yj4-xj4yj1+xj1yj3-xj3yj1 B j2 = x j3 y j4 -x j4 y j3 -x j1 y j4 -x j4 y j1 +x j1 y j3 -x j3 y j1

Bj3=xj1yj2-xj4yj2-xj2yj1-xj1yj4+xj4yj1-xj2yj4 B j3 =x j1 y j2 -x j4 y j2 -x j2 y j1 -x j1 y j4 +x j4 y j1 -x j2 y j4

Bj4=xj3yj2-xj2yj3+xj1yj3-xj2yj1-xj1yj2-xj3yj1 B j4 =x j3 y j2 -x j2 y j3 +x j1 y j3 -x j2 y j1 -x j1 y j2 -x j3 y j1

其中,lj为第j个定位标识的顶点ξ和顶点υ之间的距离,C为摄像机的有效焦距;Wherein, l j is the distance between the vertex ξ and the vertex υ of the jth positioning mark, and C is the effective focal length of the camera;

步骤4.2:通过下式(1)和(2)计算采煤机摇臂的采高h,Step 4.2: Calculate the mining height h of the rocker arm of the shearer through the following formulas (1) and (2),

h=L*sin(θ-θ0) (1)h=L*sin(θ-θ 0 ) (1)

其中,L为摇臂的臂长,θ为采煤机的摇臂在运动过程中,两个定位标识之间的夹角,θ0为采煤机的摇臂轴线与采煤机机身轴线平行时,两个定位标识之间的夹角。Among them, L is the arm length of the rocker arm, θ is the angle between the two positioning marks during the movement of the rocker arm of the shearer, and θ0 is the axis of the rocker arm of the shearer and the axis of the body of the shearer When parallel, the angle between two positioning marks.

以下给出本发明的具体实施例,需要说明的是本发明并不局限于以下具体实施例,凡在本申请技术方案基础上做的等同变换均落入本发明的保护范围。Specific embodiments of the present invention are provided below, and it should be noted that the present invention is not limited to the following specific embodiments, and all equivalent transformations done on the basis of the technical solutions of the present application all fall within the scope of protection of the present invention.

实施例Example

本实施例给出一种采煤机摇臂采高视觉测量检测方法,包括:This embodiment provides a method for visual measurement and detection of the mining height of the rocker arm of a coal mining machine, including:

分别在采煤机摇臂和机身上安装方形定位标识,当采煤机的摇臂与机身平行时,通过安装在采煤机机身上的摄像机对采煤机进行图像采集,如图2所示,通过一横杆将摄像机悬挂在两个定位标识之间机身的某一位置,使摄像机能同时拍摄到两个定位标识,摇臂的长度为500mm。Install square positioning marks on the rocker arm and the fuselage of the shearer respectively. When the rocker arm of the shearer is parallel to the fuselage, the image acquisition of the shearer is carried out through the camera installed on the shearer body, as shown in the figure As shown in 2, the camera is suspended on a certain position of the fuselage between the two positioning marks through a cross bar, so that the camera can capture the two positioning marks at the same time, and the length of the rocker arm is 500mm.

对采集得到的每帧目标图像进行自适应二值化预处理,处理结果如图3(a)所示;提取二值化预处理后的液压支架图像中的连通分量;利用连通分量的长短轴比和面积信息提取与分割液压支架图像中的定位标识,提取后的图像如图3(b);Adaptive binarization preprocessing is performed on each frame of target image acquired, and the processing result is shown in Figure 3(a); the connected components in the hydraulic support image after binarization preprocessing are extracted; the long and short axes of the connected components are used to Ratio and area information extraction and segmentation of positioning marks in the hydraulic support image, the extracted image is shown in Figure 3(b);

利用梯度算子计算每个感受野掩模梯度方向,通过梯度方向,对每个感受野方向进行定性判断,从而分别划分出定位标识上任一边缘上分布的感受野细胞,如图3(c)所示;利用感受野模型,计算定位标识边缘方向各个感受野的响应值,根据单个感受野内像素点形成的对比边缘位置与感受野中心距离的关系,确定每个感受野中心到感受野内拟合对比边缘的距离;Use the gradient operator to calculate the gradient direction of each receptive field mask, and make a qualitative judgment on each receptive field direction through the gradient direction, so as to divide the receptive field cells distributed on any edge of the positioning mark, as shown in Figure 3(c) As shown; using the receptive field model, calculate the response value of each receptive field in the edge direction of the positioning mark, and determine the fitting from the center of each receptive field to the receptive field according to the relationship between the contrast edge position formed by a single receptive field pixel and the distance from the receptive field center Compare the distance of the edge;

利用带约束的最小二乘法模型对该边缘所在直线进行拟合;根据拟合的上边缘、下边缘、左边缘和右边缘四条直线方程,计算掘进机图像中定位标识的四个顶点的像素坐标。Use the constrained least squares model to fit the straight line where the edge is located; calculate the pixel coordinates of the four vertices of the positioning marks in the roadheader image according to the four straight line equations of the fitted upper edge, lower edge, left edge and right edge .

利用上述计算公式(1)至(5)计算得到摇臂与机身平行时,两个定位标识的夹角为1.5413°;Using the above calculation formulas (1) to (5), when the rocker arm is parallel to the fuselage, the angle between the two positioning marks is 1.5413°;

调整采煤机摇臂,当摇臂抬升19.1892°,采高为164.3443mm时,进行图像采集,重复上述步骤,计算出此时采煤机上两个定位标识的夹角为20.6979°,考虑到初始夹角为1.5413°,最终得到采煤机摇臂与机身的实际夹角为19.1566°,采高为164.0756mm,此数值与实际数值很接近,因此,本发明方法能较好的为煤矿井下采煤机摇臂采高测量提供必要的技术支持。Adjust the rocker arm of the shearer. When the rocker arm is raised by 19.1892° and the mining height is 164.3443mm, carry out image acquisition, repeat the above steps, and calculate that the angle between the two positioning marks on the shearer is 20.6979°. Considering the initial The included angle is 1.5413°, and finally the actual included angle between the rocker arm and the fuselage of the shearer is 19.1566°, and the mining height is 164.0756mm. This value is very close to the actual value. The mining height measurement of the rocker arm of the coal mining machine provides the necessary technical support.

Claims (2)

1. a kind of rocker arm of coal mining machine mining height vision measuring method, it is characterised in that comprise the following steps:
Step one:Square positioning mark is installed on rocker arm of coal mining machine and fuselage respectively, and coal-winning machine carried out by video camera IMAQ;
Step 2:Noise reduction process is carried out to the target image collected, the positioning mark after noise reduction process in image is extracted;
Step 3:Edge lines fitting is carried out to each positioning mark, four apex coordinates of each positioning mark are obtained, specifically Step is:
Step 3.1:To center spacing and size distribution receptive field of j-th of positioning mark according to setting, using (r*2+1) * (r* Mask 2+1), j=1,2, N be the number of positioning marking plate, and r is receptive field cell radius, mask center and receptive field cell Center superposition;
Step 3.2:Each receptive field mask gradient direction is calculated using gradient operator, by mask gradient direction to each impression Wild direction is qualitatively judged, and is distributed so as to be respectively divided out on top edge, lower edge, left hand edge and the right hand edge of positioning mark Receptive field cell;
Step 3.3:Using receptive field model, the response of each receptive field of top edge direction is calculated, according in single receptive field The relation of contrast fringes position and the receptive field centre distance of pixel formation, it is determined that each receptive field center is to right in receptive field Than the distance at edge to receptive field center, then marking plate top edge place is fitted using the LEAST SQUARES MODELS FITTING of belt restraining Straight line;
Step 3.4:Repeat step 3.3, is fitted to straight line where the lower edge, left hand edge, right hand edge of positioning mark respectively;
Step 3.5:According to the top edge of fitting, lower edge, four linear equations of left hand edge and right hand edge, j-th of positioning is obtained Four apex coordinates of mark;
Step 3.6:3.1~step 3.5 of repeat step, obtains four apex coordinates of all positioning marks.
Step 4:The positioning obtained according to step 3 identifies respective apex coordinate and obtains two angles positioned between mark, leads to Cross following formula (1) and (2) calculate the mining height h of rocker arm of coal mining machine
H=L*sin (θ-θ0) (1)
<mrow> <mi>&amp;theta;</mi> <mo>=</mo> <msup> <mi>cos</mi> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </msup> <mrow> <mo>(</mo> <mfrac> <mrow> <mover> <msub> <mi>n</mi> <mn>1</mn> </msub> <mo>&amp;RightArrow;</mo> </mover> <mo>*</mo> <mover> <msub> <mi>n</mi> <mn>2</mn> </msub> <mo>&amp;RightArrow;</mo> </mover> </mrow> <mrow> <mo>|</mo> <mover> <msub> <mi>n</mi> <mn>1</mn> </msub> <mo>&amp;RightArrow;</mo> </mover> <mo>|</mo> <mo>*</mo> <mo>|</mo> <mover> <msub> <mi>n</mi> <mn>2</mn> </msub> <mo>&amp;RightArrow;</mo> </mover> <mo>|</mo> </mrow> </mfrac> <mo>)</mo> </mrow> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>2</mn> <mo>)</mo> </mrow> </mrow>
Wherein, L is the brachium of rocking arm, and θ is the angle between two positioning marks;
njThe vector formed for the summit ξ and summit υ of j-th of positioning mark, j=1,2, i=1,2,3,4, it will each position mark The summit in the upper left corner is used as first coordinate P1, remaining coordinate is sequentially distributed in the direction of the clock, ξ ∈ i, υ ∈ i, ξ ≠ υ;(xji, yji) for j-th positioning mark summit i-th of summit image coordinate, (Xji,Yji,Zji) identify summit for j-th of positioning The photocentre coordinate on i-th of summit;
<mrow> <msub> <mi>X</mi> <mrow> <mi>j</mi> <mi>i</mi> </mrow> </msub> <mo>=</mo> <mfrac> <mrow> <msub> <mi>t</mi> <mrow> <mi>j</mi> <mi>i</mi> </mrow> </msub> <msub> <mi>x</mi> <mrow> <mi>j</mi> <mi>i</mi> </mrow> </msub> </mrow> <mi>C</mi> </mfrac> <mo>,</mo> <msub> <mi>Y</mi> <mrow> <mi>j</mi> <mi>i</mi> </mrow> </msub> <mo>=</mo> <mfrac> <mrow> <msub> <mi>t</mi> <mrow> <mi>j</mi> <mi>i</mi> </mrow> </msub> <msub> <mi>y</mi> <mrow> <mi>j</mi> <mi>i</mi> </mrow> </msub> </mrow> <mi>C</mi> </mfrac> <mo>,</mo> <msub> <mi>Z</mi> <mrow> <mi>j</mi> <mi>i</mi> </mrow> </msub> <mo>=</mo> <msub> <mi>t</mi> <mrow> <mi>j</mi> <mi>i</mi> </mrow> </msub> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>5</mn> <mo>)</mo> </mrow> </mrow>
<mrow> <msub> <mi>t</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>=</mo> <mfrac> <mrow> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <msub> <mi>Cl</mi> <mi>j</mi> </msub> </mrow> <msqrt> <mrow> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <msub> <mi>x</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <msub> <mi>x</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <msub> <mi>y</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <msub> <mi>y</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <msup> <mi>C</mi> <mn>2</mn> </msup> </mrow> </msqrt> </mfrac> </mrow> 1
<mrow> <msub> <mi>t</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>=</mo> <mfrac> <mrow> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <msub> <mi>Cl</mi> <mi>j</mi> </msub> </mrow> <msqrt> <mrow> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <msub> <mi>x</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <msub> <mi>x</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <msub> <mi>y</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <msub> <mi>y</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <msup> <mi>C</mi> <mn>2</mn> </msup> </mrow> </msqrt> </mfrac> </mrow>
<mrow> <msub> <mi>t</mi> <mrow> <mi>j</mi> <mn>3</mn> </mrow> </msub> <mo>=</mo> <mfrac> <mrow> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>3</mn> </mrow> </msub> <msub> <mi>Cl</mi> <mi>j</mi> </msub> </mrow> <msqrt> <mrow> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <msub> <mi>x</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <msub> <mi>x</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <msub> <mi>y</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <msub> <mi>y</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <msup> <mi>C</mi> <mn>2</mn> </msup> </mrow> </msqrt> </mfrac> </mrow>
<mrow> <msub> <mi>t</mi> <mrow> <mi>j</mi> <mn>4</mn> </mrow> </msub> <mo>=</mo> <mfrac> <mrow> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>4</mn> </mrow> </msub> <msub> <mi>Cl</mi> <mi>j</mi> </msub> </mrow> <msqrt> <mrow> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <msub> <mi>x</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <msub> <mi>x</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <msub> <mi>y</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <msub> <mi>y</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>2</mn> </mrow> </msub> <mo>-</mo> <msub> <mi>B</mi> <mrow> <mi>j</mi> <mn>1</mn> </mrow> </msub> <mo>)</mo> </mrow> <mn>2</mn> </msup> <msup> <mi>C</mi> <mn>2</mn> </msup> </mrow> </msqrt> </mfrac> </mrow>
Bj1=xj2yj3-xj4yj3+xj4yj2-xj2yj4+xj3yj4-xj3yj2
Bj2=xj3yj4-xj4yj3-xj1yj4-xj4yj1+xj1yj3-xj3yj1
Bj3=xj1yj2-xj4yj2-xj2yj1-xj1yj4+xj4yj1-xj2yj4
Bj4=xj3yj2-xj2yj3+xj1yj3-xj2yj1-xj1yj2-xj3yj1
Wherein, ljThe distance between summit ξ and summit υ for j-th of positioning mark, C are the effective focal length of video camera.
2. rocker arm of coal mining machine mining height vision measuring method as claimed in claim 1, it is characterised in that:Described step two is wrapped Include:
Step 2.1:Self-adaption binaryzation pretreatment is carried out to the every frame target image collected;
Step 2.2:The positioning mark in pretreated target image is extracted using the method based on connected component.
CN201710442853.4A 2017-06-13 2017-06-13 A kind of rocker arm of coal mining machine mining height vision measuring method Active CN107131837B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710442853.4A CN107131837B (en) 2017-06-13 2017-06-13 A kind of rocker arm of coal mining machine mining height vision measuring method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710442853.4A CN107131837B (en) 2017-06-13 2017-06-13 A kind of rocker arm of coal mining machine mining height vision measuring method

Publications (2)

Publication Number Publication Date
CN107131837A true CN107131837A (en) 2017-09-05
CN107131837B CN107131837B (en) 2018-05-18

Family

ID=59734680

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710442853.4A Active CN107131837B (en) 2017-06-13 2017-06-13 A kind of rocker arm of coal mining machine mining height vision measuring method

Country Status (1)

Country Link
CN (1) CN107131837B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111127406A (en) * 2019-12-10 2020-05-08 创维集团智能装备有限公司 Back plate machining position adjusting method, terminal, system and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201433792Y (en) * 2009-07-17 2010-03-31 西安煤矿机械有限公司 Real-time monitoring system for mining height of coal mining machine
CN101975061A (en) * 2010-09-30 2011-02-16 三一重型装备有限公司 Coal winning machine and mining height system thereof
CN102287186A (en) * 2011-07-16 2011-12-21 西安煤矿机械有限公司 Self-positioning system and self-positioning method for coal mining machine
CN205593503U (en) * 2016-02-17 2016-09-21 神华集团有限责任公司 A high detecting system is adopted to rocking arm that is used for single cylinder shortwall coal -winning machine
CN106568424A (en) * 2016-10-27 2017-04-19 西安科技大学 Machine vision-based coal cutter rocker arm mining height detection method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201433792Y (en) * 2009-07-17 2010-03-31 西安煤矿机械有限公司 Real-time monitoring system for mining height of coal mining machine
CN101975061A (en) * 2010-09-30 2011-02-16 三一重型装备有限公司 Coal winning machine and mining height system thereof
CN102287186A (en) * 2011-07-16 2011-12-21 西安煤矿机械有限公司 Self-positioning system and self-positioning method for coal mining machine
CN205593503U (en) * 2016-02-17 2016-09-21 神华集团有限责任公司 A high detecting system is adopted to rocking arm that is used for single cylinder shortwall coal -winning machine
CN106568424A (en) * 2016-10-27 2017-04-19 西安科技大学 Machine vision-based coal cutter rocker arm mining height detection method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111127406A (en) * 2019-12-10 2020-05-08 创维集团智能装备有限公司 Back plate machining position adjusting method, terminal, system and storage medium

Also Published As

Publication number Publication date
CN107131837B (en) 2018-05-18

Similar Documents

Publication Publication Date Title
CN107316330B (en) Underground hydraulic support frame group pose and verticality measuring method based on more image sequences
CN107292926B (en) Crusing robot movement locus verticality measuring method based on more image sequences
CN113379712B (en) A computer vision-based method and system for detection of steel bridge bolt diseases
CN107316288B (en) A kind of boom-type roadheader cutterhead pose vision measuring method
CN102673106B (en) Silk screen print positioning equipment and method for photovoltaic solar silicon chip
CN103266559B (en) The method of BP bridge security inspection car and face, acquisition bridge surface phase
CN109969736A (en) An intelligent detection method for deviation fault of large carrying belt
CN105699399B (en) A kind of detection device and method of SMT masterplates quality
CN108986082A (en) A kind of profile of steel rail detection method and system based on EPNP
CN110009617A (en) An online quality inspection method for shaft parts
CN105891220B (en) A kind of pavement marker line defect detection device and its detection method
CN106326894A (en) Adverse state detection method of transverse pins of rotation double lugs of high-speed rail overhead contact line equipment
CN106935683A (en) A kind of solar battery sheet SPEED VISION positioning and correction system and its method
CN115619738A (en) Detection method for module side seam welding after welding
CN113012098A (en) Iron tower angle steel punching defect detection method based on BP neural network
CN107314807A (en) A kind of method of steel wire rope horizontal space vibration measurement
CN103962394A (en) Online detection method for hot mill roller rolling direction offset
CN112053333B (en) Square billet detection method, system, equipment and medium based on machine vision
CN104897463A (en) Real-time detection apparatus and real-time detection method of steel-concrete combination member deformation due to force applying
CN103322928A (en) Similar model displacement field measuring system and method based on grid dot matrix
CN111452840B (en) Railway steel rail crawling displacement detection method based on monocular vision measurement technology
CN111967323B (en) Electric power live working safety detection method based on deep learning algorithm
CN107131837B (en) A kind of rocker arm of coal mining machine mining height vision measuring method
CN111784779A (en) Checkerboard image recognition and positioning system and method based on convolutional neural network and nested contour recognition
CN105856241B (en) A kind of difference scale electronic liquid crystal display positioning grasping means

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant