CN108052950A - A kind of segmentation of electric melting magnesium furnace dynamic flame and feature extracting method based on MIA - Google Patents
A kind of segmentation of electric melting magnesium furnace dynamic flame and feature extracting method based on MIA Download PDFInfo
- Publication number
- CN108052950A CN108052950A CN201711293082.3A CN201711293082A CN108052950A CN 108052950 A CN108052950 A CN 108052950A CN 201711293082 A CN201711293082 A CN 201711293082A CN 108052950 A CN108052950 A CN 108052950A
- Authority
- CN
- China
- Prior art keywords
- mrow
- msub
- flame
- image
- mtd
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
- G06F18/2135—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V10/267—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
本发明的一种基于MIA的电熔镁炉动态火焰分割及特征提取方法,包括:采集火焰的视频图像,将RGB图像转换成二维矩阵;采用PCA法对二维矩阵进行降维;将降维后的矩阵归一化到[0,255]之间,获得得分柱状图;将不同工况的得分柱状图进行对比,找出图中变化明显的区域并进行标记处理,将被标记的区域映射回原始RGB图像,获得火焰分割图像;借助得分柱状图中被标记区域分别计算火焰亮度区域大小、火焰颜色种类数、火焰区域颜色平均值、整幅图像颜色平均值以及火焰亮度值5种特征数据。该方法能够对火焰区域进行有效的分割,其分割效果好,通过对分割的图像计算5种特征数据,并将结果应用于工况分类模型上,获得较高的分类准确率。
A MIA-based dynamic flame segmentation and feature extraction method of an electric fused magnesium furnace of the present invention comprises: collecting video images of the flame, converting the RGB image into a two-dimensional matrix; adopting the PCA method to reduce the dimension of the two-dimensional matrix; After dimensioning, the matrix is normalized to [0,255] to obtain a score histogram; compare the score histograms of different working conditions, find out the areas with obvious changes in the figure and mark them, and map the marked areas back to The flame segmentation image was obtained from the original RGB image; five characteristic data including the size of the flame brightness area, the number of flame color types, the average color of the flame area, the average color of the entire image, and the flame brightness value were calculated by using the marked area in the score histogram. This method can effectively segment the flame area, and its segmentation effect is good. By calculating five kinds of feature data for the segmented image, and applying the result to the working condition classification model, a higher classification accuracy is obtained.
Description
技术领域technical field
本发明属于模式识别与人工智能技术领域,特别提出一种基于MIA的电熔镁炉动态火焰分割及特征提取方法。The invention belongs to the technical field of pattern recognition and artificial intelligence, and in particular proposes an MIA-based method for dynamic flame segmentation and feature extraction of an electric fused magnesium furnace.
背景技术Background technique
电熔镁砂具有纯度高、熔点高、绝缘性能强及结构致密的特性,在化工、建筑、家电、冶金、军事等多种行业和领域被广泛使用,是很好的耐火原材料。Fused magnesia has the characteristics of high purity, high melting point, strong insulation performance and compact structure. It is widely used in various industries and fields such as chemical industry, construction, home appliances, metallurgy, and military affairs. It is a good refractory raw material.
使用电弧炉熔炼生产电熔镁砂时,对应熔炼工况、加料工况、排气工况、欠烧工况的炉口火焰的亮度、颜色、形态变化均不一样。其中,熔炼工况下,火焰亮度适中,火焰颜色比较丰富,火焰形态变化一般;加料工况下,火焰亮度比较暗,火焰颜色一般,形态变化较慢;排气工况下,火焰亮度比较亮,火焰颜色比较单一,火焰形态变化较快。所以炉口火焰的变化情况是工况判别的一个重要依据。When electric arc furnace is used to smelt and produce fused magnesia, the brightness, color, and shape changes of the flame at the furnace mouth corresponding to smelting conditions, feeding conditions, exhaust conditions, and under-burning conditions are all different. Among them, under the smelting condition, the flame brightness is moderate, the flame color is relatively rich, and the flame shape changes generally; under the feeding condition, the flame brightness is relatively dark, the flame color is average, and the shape change is slow; under the exhaust condition, the flame brightness is relatively bright , the color of the flame is relatively simple, and the shape of the flame changes quickly. Therefore, the change of the flame at the furnace mouth is an important basis for judging the working conditions.
目前,炉口火焰中蕴含的信息需要人工巡检的方式,前往生产一线通过“看火”的经验获取。但是人工巡检存在以下问题:1)判断的准确性与操作人员的经验和状态的相关,容易漏检、误检;2)现场生产环境恶劣(强光、高温、灰尘等),劳动强度大,危险性高,不适于工人长时间现场巡检;3)炉口火焰与周围烟雾粉尘边界模糊,“看火”过程容易受干扰。所以企业需要一种能够将炉口火焰区域从图像中分割出来,并以具体数字表示火焰颜色、亮度、形态等特征信息,并用于后续的工况判别中。At present, the information contained in the flame at the furnace mouth needs to be manually inspected and obtained through the experience of "watching the fire" when going to the production line. However, there are the following problems in manual inspection: 1) The accuracy of the judgment is related to the experience and status of the operator, and it is easy to miss or misdetect; 2) The on-site production environment is harsh (strong light, high temperature, dust, etc.), and the labor intensity is high , high risk, not suitable for long-term on-site inspection by workers; 3) The boundary between the flame at the furnace mouth and the surrounding smoke and dust is blurred, and the process of "watching the fire" is easily disturbed. Therefore, enterprises need a method that can separate the flame area of the furnace mouth from the image, and express the characteristic information such as flame color, brightness, shape, etc. in specific numbers, and use it in the subsequent identification of working conditions.
随着工业相机的应用,视频图像采集的精度逐渐提高,运用工业相机采集工业生产中的图像,然后经过图像分割方法获得感兴趣区域,并计算该区域的特征数据。该过程已经在天然气燃油质量监控、回转窑燃烧状况等工业生产中得到了广泛的应用。但是由于火焰是动态的,没有固定的规则的形态,针对不同的工业背景,火焰的变化频率、颜色、亮度等特征也是很难确定的,单独某一个工业过程中,动态火焰图像都是以多种形式存在的,而且与背景环境结合紧密,所以很难采用阈值法的思想,使图像分割算法适用于所有工况。With the application of industrial cameras, the accuracy of video image acquisition is gradually improving. Industrial cameras are used to collect images in industrial production, and then the region of interest is obtained through image segmentation methods, and the characteristic data of the region are calculated. This process has been widely used in industrial production such as natural gas fuel oil quality monitoring and rotary kiln combustion status. However, because the flame is dynamic and has no fixed and regular shape, it is difficult to determine the characteristics of the flame such as the frequency of change, color, and brightness for different industrial backgrounds. In a single industrial process, dynamic flame images are based on multiple It exists in one form and is closely combined with the background environment, so it is difficult to use the idea of threshold method to make the image segmentation algorithm suitable for all working conditions.
发明内容Contents of the invention
本发明实施例提供一种基于MIA的电熔镁炉动态火焰分割及特征提取方法,能够对动态火焰区域进行有效的分割,通过对分割的图像计算5种特征数据,并将结果应用于后续的工况分类模型上,获得较高的分类准确率。The embodiment of the present invention provides a dynamic flame segmentation and feature extraction method of an electric fused magnesium furnace based on MIA, which can effectively segment the dynamic flame area, calculate 5 kinds of feature data for the segmented image, and apply the result to the subsequent On the working condition classification model, a higher classification accuracy is obtained.
本发明提供一种基于MIA的电熔镁炉动态火焰分割及特征提取方法,包括以下步骤:The invention provides a method for dynamic flame segmentation and feature extraction of an electric fused magnesium furnace based on MIA, comprising the following steps:
步骤1:采集火焰的视频图像,并将单帧的RGB图像转换成二维矩阵;Step 1: Collect the video image of the flame, and convert the RGB image of a single frame into a two-dimensional matrix;
步骤2:采用主成份分析法对所述二维矩阵进行降维处理,并通过图像重构技术将选取的主元映射回RGB图像空间进行验证,以保证降维后的图像能够代替原始图像;Step 2: Carry out dimensionality reduction processing on the two-dimensional matrix by principal component analysis, and map the selected principal elements back to the RGB image space for verification through image reconstruction technology, so as to ensure that the dimensionality-reduced image can replace the original image;
步骤3:将降维后的具有两列向量的矩阵归一化到[0,255]之间,然后以矩阵中每行数据的两个值作为XY坐标系下的位置信息,统计该矩阵具有同一坐标值的像素个数,从而获得得分柱状图;Step 3: Normalize the matrix with two columns of vectors after dimension reduction to [0,255], then use the two values of each row of data in the matrix as the position information in the XY coordinate system, and count the matrix with the same coordinates The number of pixels of the value, so as to obtain the score histogram;
步骤4:针对不同工况的单帧的RGB图像重复步骤1-3,将获得的不同工况的得分柱状图进行对比,找出不同工况的得分柱状图中变化明显的区域,对变化明显的区域进行标记处理,并将所述得分柱状图中被标记的区域映射回原始RGB图像,以获得火焰分割图像;Step 4: Repeat steps 1-3 for single-frame RGB images of different working conditions, compare the obtained score histograms of different working conditions, and find out the areas with obvious changes in the score histograms of different working conditions The area marked is processed, and the marked area in the score histogram is mapped back to the original RGB image to obtain the flame segmentation image;
步骤5:对得分柱状图中被标记的区域进行微调,以获得确定的标记区域和精确的火焰分割图像,并依据确定的标记区域对视频图像中所有的单帧RGB图像进行分割获得每帧的火焰分割图像;Step 5: Fine-tune the marked area in the score histogram to obtain the determined marked area and accurate flame segmentation image, and segment all single-frame RGB images in the video image according to the determined marked area to obtain the Flame segmentation image;
步骤6:通过特征提取公式,借助得分柱状图中被标记区域分别计算火焰亮度区域大小、火焰颜色种类数、火焰区域颜色平均值、整幅图像颜色平均值以及火焰亮度值5种特征数据。Step 6: Through the feature extraction formula, the five characteristic data of the size of the flame brightness area, the number of flame color types, the average color of the flame area, the average color of the entire image, and the flame brightness value are calculated respectively with the help of the marked area in the score histogram.
本发明的一种基于MIA的电熔镁炉动态火焰分割及特征提取方法,利用工业相机获取电熔镁生产现场过程图像,采用固定窗口剔除图像中离火焰较远的无关区域,然后运用多变量图像分析(MIA)方法,将感兴趣火焰区域从背景中分割出来,并计算相关特征数据。该方法能够对炉口火焰区域进行有效的分割,其分割效果比基于阈值法的分割效果要好很多,通过对分割的图像计算5种特征数据,并将结果应用于后续的工况分类模型上,获得较高的分类准确率。The MIA-based dynamic flame segmentation and feature extraction method of the fused magnesium furnace of the present invention uses an industrial camera to obtain the process image of the fused magnesium production site, uses a fixed window to eliminate irrelevant areas far away from the flame in the image, and then uses multivariable Image Analysis (MIA) method, which segments the flame area of interest from the background and calculates the relevant characteristic data. This method can effectively segment the flame area of the furnace mouth, and its segmentation effect is much better than that based on the threshold method. By calculating 5 kinds of characteristic data for the segmented image, and applying the result to the subsequent working condition classification model, obtain higher classification accuracy.
附图说明Description of drawings
图1为本发明的一种基于MIA的电熔镁炉动态火焰分割及特征提取方法的流程图;Fig. 1 is the flowchart of a kind of MIA-based electric fused magnesium furnace dynamic flame segmentation and feature extraction method of the present invention;
图2为本发明的第一种工况的火焰图像;Fig. 2 is the flame image of the first working condition of the present invention;
图3为本发明的第二种工况的火焰图像;Fig. 3 is the flame image of the second working condition of the present invention;
图4为本发明的第三种工况的火焰图像;Fig. 4 is the flame image of the third working condition of the present invention;
图5为本发明的第四种工况的火焰图像;Fig. 5 is the flame image of the fourth working condition of the present invention;
图6为本发明的第一种工况的得分柱状图;Fig. 6 is the scoring histogram of the first working condition of the present invention;
图7为本发明的第二种工况的得分柱状图;Fig. 7 is the scoring histogram of the second working condition of the present invention;
图8为本发明的第三种工况的得分柱状图;Fig. 8 is the scoring histogram of the third working condition of the present invention;
图9为本发明的第四种工况的得分柱状图;Fig. 9 is the scoring histogram of the fourth working condition of the present invention;
图10为在得分柱状图的确定的标记区域进行标注的示意图;Fig. 10 is a schematic diagram of marking in the determined marked area of the score histogram;
图11为在得分柱状图的确定的标记区域的附件区域进行标注的示意图;Fig. 11 is a schematic diagram of marking in the attachment area of the determined marked area of the score histogram;
图12为采用得分柱状图中确定的标记区域的进行标注映射回原始RGB图像的示意图;Fig. 12 is a schematic diagram of marking and mapping back to the original RGB image using the marked region determined in the score histogram;
图13为采用确定的标记区域附件的标记区域进行标注映射回原始RGB图像的示意图;Fig. 13 is a schematic diagram of labeling and mapping back to the original RGB image using the marked area attached to the determined marked area;
图14为本发明的一种基于MIA的电熔镁炉动态火焰分割及特征提取方法分割一组图像获得的火焰分割图像;14 is a flame segmentation image obtained by segmenting a group of images based on MIA-based dynamic flame segmentation and feature extraction method of the fused magnesium furnace of the present invention;
图15为本发明的一种基于MIA的电熔镁炉动态火焰分割及特征提取方法所提取的5种特征数据变化趋势图。Fig. 15 is a trend diagram of five kinds of feature data extracted by the MIA-based dynamic flame segmentation and feature extraction method of the fused magnesium furnace of the present invention.
具体实施方式Detailed ways
本文提出一种基于多变量图像分析法(Multivariate Image Analysis,MIA)的电熔镁炉炉口动态火焰图像分割及特征提取方法。利用工业相机获取电熔镁生产现场过程图像,采用固定窗口剔除图像中离火焰较远的无关区域,然后运用多变量图像分析(MIA)方法,将感兴趣火焰区域从背景中分割出来,并计算相关特征数据。This paper proposes a method based on multivariate image analysis (Multivariate Image Analysis, MIA) for the dynamic flame image segmentation and feature extraction method of the fused magnesium furnace mouth. Use the industrial camera to obtain the process image of the fused magnesium production site, use a fixed window to eliminate the irrelevant areas far away from the flame in the image, and then use the multivariate image analysis (MIA) method to segment the flame area of interest from the background and calculate related feature data.
如图1所示本发明的一种基于MIA的电熔镁炉动态火焰分割及特征提取方法包括以下步骤:A kind of MIA-based electric fused magnesium furnace dynamic flame segmentation and feature extraction method of the present invention as shown in Figure 1 comprises the following steps:
步骤1:采集火焰的视频图像,并将单帧的RGB图像转换成二维矩阵;步骤1具体包括:Step 1: Collect the video image of the flame, and convert the RGB image of a single frame into a two-dimensional matrix; Step 1 specifically includes:
步骤1.1:将工业相机采集到的视频图像进行固定窗口分割,剔除火焰外围区域对图像分割造成的干扰,同时降低计算机运行成本,提高单帧图形处理速度;Step 1.1: Segment the video image collected by the industrial camera with a fixed window, eliminate the interference caused by the peripheral area of the flame to the image segmentation, reduce the operating cost of the computer, and increase the single-frame graphics processing speed;
步骤1.2:通过矩阵变换将单帧火焰RGB图像变换为二维空间下的矩阵。Step 1.2: Transform a single flame RGB image into a matrix in a two-dimensional space through matrix transformation.
经过固定窗口分割后的图像在RGB空间具有3个通道,即维度为m×n×3,将每个通道进行按行拉伸,例如R通道,拉伸之后成为mn行的数据,则三个通道拉伸之后成为mn×3的矩阵,即 The image after the fixed window segmentation has 3 channels in the RGB space, that is, the dimension is m×n×3, and each channel is stretched row by row, such as the R channel, which becomes mn rows of data after stretching, then three After the channel is stretched, it becomes a matrix of mn×3, namely
其中,I(m,n,3)表示原始的RGB图像,I1(m,n,3)表示将I(m,n,3)展开为二维后的矩阵。Among them, I (m,n,3) represents the original RGB image, and I 1(m,n,3) represents the matrix after expanding I (m,n,3) into two dimensions.
步骤2:采用主成份分析法(principal component analysis,PCA)对所述二维矩阵进行降维处理,并通过图像重构技术将选取的主元映射回RGB图像空间进行验证,以保证降维后的图像能够代替原始图像;所述步骤2具体包括:Step 2: Use principal component analysis (PCA) to reduce the dimensionality of the two-dimensional matrix, and map the selected principal components back to the RGB image space for verification through image reconstruction technology, so as to ensure that after dimensionality reduction The image can replace the original image; the step 2 specifically includes:
步骤2.1:通过主成份分析法将上述mn×3二维矩阵进行降维,选取一定量的主元数量保证降维后的矩阵能够表征原始数据99%的信息;Step 2.1: Reduce the dimension of the above mn×3 two-dimensional matrix by principal component analysis, and select a certain number of principal components to ensure that the matrix after dimensionality reduction can represent 99% of the information of the original data;
主成份分析法的核心算法如下:The core algorithm of principal component analysis is as follows:
其中,PC为主元个数,pa表示加载向量,ta表示得分向量即降维后的矩阵。Among them, PC is the number of main components, p a represents the loading vector, and t a represents the score vector, which is the matrix after dimensionality reduction.
在求取pa=(1,...,PC)、ta(a=1,...,PC)的过程中,需要考虑行维数过大的问题,一个mn=512×512的图像空间对应262144行,针对多变量图像展开之后形成的如此多的行维数矩阵,需要借助一个核心算法来简化计算。上述算法的核心思想是对展开后的图像,首先针对每个属性进行去均值化,然后构建一个核矩阵I1 TI1,对得到的低维矩阵C(3,3)进行奇异值分解(singular value decomposition,SVD),将特征向量按对应特征值大小从大到小排列成矩阵,得到的特征向量矩阵的每一列即为加载向量pa=(1,...,PC)。在此基础上根据ta=I1pa,计算得分向量ta(a=1,...,PC)。In the process of finding p a = (1,...,PC), t a (a=1,...,PC), the problem of too large row dimension needs to be considered, a mn=512×512 The image space corresponds to 262,144 rows. For so many row-dimensional matrices formed after multivariate image expansion, a core algorithm is needed to simplify the calculation. The core idea of the above algorithm is to de-meanize the expanded image first for each attribute, then construct a kernel matrix I 1 T I 1 , and perform singular value decomposition on the obtained low-dimensional matrix C(3,3) ( Singular value decomposition, SVD), arrange the eigenvectors into a matrix according to the size of the corresponding eigenvalues from large to small, and each column of the obtained eigenvector matrix is the loading vector p a =(1,...,PC). On this basis, the score vector t a (a=1,...,PC) is calculated according to t a =I 1 p a .
步骤2.2:通过图像重构技术将选取的主元映射回RGB图像空间,通过观察比对,确定降维后的图像能够代替原始的图像。Step 2.2: Map the selected pivots back to the RGB image space through image reconstruction technology, and confirm that the dimensionality-reduced image can replace the original image through observation and comparison.
具体实施时,可以通过下式确定主元的值,以满足降维后的数据大于需要的原始图片信息,确定降维后的图像能够代替原始的图像,其中PC(PC≤3)为主元个数,λk为经过主成份分析处理时求得协方差矩阵的特征值。In specific implementation, the value of the pivot can be determined by the following formula, so that the data after dimension reduction is greater than the required original image information, and it is determined that the image after dimension reduction can replace the original image, where PC (PC≤3) is the principal element λ k is the eigenvalue of the covariance matrix obtained through principal component analysis.
其中,g为阈值表示选择的主元能够表征原始图像信息的百分比,一般取g≥0.95。针对得分向量ta(a=1,...,PC),t1中包含的原始图形信息最多,t2包含的信息次最多,以此类推。选择前PC个占主导地位的主成份对原始多变量图像进行重构,而残差矩阵E被忽略,从而将原始图像大部分无结构的噪声中消除掉。Among them, g is the threshold value, indicating the percentage of the selected pivot that can represent the original image information, and generally takes g≥0.95. For the score vector t a (a=1,...,PC), t 1 contains the most original graphics information, t 2 contains the most information, and so on. The first PC dominant principal components are selected to reconstruct the original multivariate image, while the residual matrix E is ignored, thereby eliminating most of the unstructured noise in the original image.
在完成上述运算之后,可以通过如下公式,根据得分向量ta和加载向量pa对原始图像进行重构获得新的RGB图像矩阵,通过结果对比观察压缩后的图像失真情况。After the above operations are completed, the original image can be reconstructed according to the score vector t a and loading vector p a to obtain a new RGB image matrix through the following formula, and the image distortion after compression can be observed by comparing the results.
分别使用前两个主元、第一个主元、第二个主元及第三个主元进行图像重构。对原始炉口火焰图像进行PCA处理后,取前两个特征值带入计算,结果显示大于99.5%,即根据前两个主元进行重构的结果包含原始图像99.5%以上的信息。然后根据每一个主元进行重构,它们的重构图像表征原始图像信息的大小正如它们特征值大小一样从大到小。其中,前两个主元重构结果与原始图像非常接近,包含的信息最多。第一个主元、第二个主元和第三个主元对应原始图像失真情况越来越严重。当选择前两个主元表征原始信息时,那么第三个主元对应的数值就是残差矩阵E。Use the first two pivots, the first pivot, the second pivot and the third pivot for image reconstruction. After PCA processing on the original furnace mouth flame image, the first two eigenvalues are taken into the calculation, and the result shows that it is greater than 99.5%, that is, the result of reconstruction based on the first two principal elements contains more than 99.5% of the information of the original image. Then reconstruct according to each pivot, and their reconstructed images represent the size of the original image information just as their eigenvalues are from large to small. Among them, the first two principal component reconstruction results are very close to the original image and contain the most information. The first pivot, the second pivot and the third pivot correspond to the increasingly serious distortion of the original image. When the first two pivots are selected to represent the original information, then the value corresponding to the third pivot is the residual matrix E.
步骤3:将降维后的具有两列向量的矩阵归一化到[0,255]之间,然后以矩阵中每行数据的两个值作为XY坐标系下的位置信息,统计该矩阵具有同一坐标值的像素个数,从而获得得分柱状图;Step 3: Normalize the matrix with two columns of vectors after dimension reduction to [0,255], then use the two values of each row of data in the matrix as the position information in the XY coordinate system, and count the matrix with the same coordinates The number of pixels of the value, so as to obtain the score histogram;
具体实施时,采用下式将降维后的具有两列向量的矩阵归一化到[0,255]之间:During specific implementation, the matrix with two column vectors after dimensionality reduction is normalized to [0,255] by the following formula:
其中,si表示归一化后的两列向量,ti表示归一化前的两列向量,ti,min表示列向量ti中最小的元素,ti,max表示列向量ti中最大的元素。Among them, s i represents the two column vectors after normalization, t i represents the two column vectors before normalization, t i, min represents the smallest element in the column vector t i , t i, max represents the column vector t i largest element.
具体实施时,采用下式获得得分柱状图:During specific implementation, the following formula is used to obtain the score histogram:
其中,TTx,y为得分柱状图中坐标为(x,y)的同样像素点的个数,b为矩阵的某行,s1,b表示向量s1第b行的元素,s2,b表示向量s2第b行的元素。Among them, TT x, y is the number of the same pixel points whose coordinates are (x, y) in the score histogram, b is a certain row of the matrix, s 1, b represents the element of the bth row of the vector s 1 , s 2, b represents the element of row b of vector s2 .
步骤4:针对不同工况的单帧的RGB图像重复步骤1-3,将获得的不同工况的得分柱状图进行对比,找出不同工况的得分柱状图中变化明显的区域,对变化明显的区域进行标记处理,并将所述得分柱状图中被标记的区域映射回原始RGB图像,以获得火焰分割图像;Step 4: Repeat steps 1-3 for single-frame RGB images of different working conditions, compare the obtained score histograms of different working conditions, and find out the areas with obvious changes in the score histograms of different working conditions The area marked is processed, and the marked area in the score histogram is mapped back to the original RGB image to obtain the flame segmentation image;
以下将以电熔镁炉生产过程中的炉口火焰为例进行验证。The following will take the furnace mouth flame in the production process of the electric fused magnesium furnace as an example for verification.
首先,根据操作员的经验,我们从大量视频数据中选取4种典型镁炉炉口火焰形态,分别代表加料,正常熔炼,欠烧,排气4种工况。如图2至图5所示。First of all, according to the operator's experience, we selected 4 typical flame shapes of the magnesium furnace mouth from a large amount of video data, representing 4 working conditions of feeding, normal smelting, under-firing and exhaust respectively. As shown in Figure 2 to Figure 5.
然后,重复步骤1-3分别得到4种工况的得分柱状图如图6至图9所示。上述四张图分别是炉口火焰在经过MIA处理之后在xy坐标系下的投影,其中x轴对应的为s1,y轴对应的为s2,它们反映了炉口火焰颜色亮度信息在二维空间的聚集情况,颜色越亮的区域表示炉口具有这种颜色的个数越多。Then, repeat steps 1-3 to obtain the score histograms of the four working conditions, as shown in Figures 6 to 9. The above four pictures are the projections of the flame at the furnace mouth in the xy coordinate system after MIA processing, where the x-axis corresponds to s 1 , and the y-axis corresponds to s 2 , which reflect the color and brightness information of the flame at the furnace mouth in two The clustering situation in the three-dimensional space, the brighter the color area, the more the number of furnace mouths with this color.
最后,通过比较四张得分柱状图中密度图的分布情况,我们发现在x轴[0~50]、y轴[0~200]的区域内,得分柱状图变化随着图片颜色和亮度的变化最为明显。Finally, by comparing the distribution of density maps in the four score histograms, we found that in the area of x-axis [0-50] and y-axis [0-200], the change of the score histogram changes with the color and brightness of the picture most obvious.
步骤5:对得分柱状图中被标记的区域进行微调,以获得确定的标记区域和精确的火焰分割图像,并依据确定的标记区域对视频图像中所有的单帧RGB图像进行分割获得每帧的火焰分割图像;所述步骤5包括:Step 5: Fine-tune the marked area in the score histogram to obtain the determined marked area and accurate flame segmentation image, and segment all single-frame RGB images in the video image according to the determined marked area to obtain the Flame segmentation image; said step 5 includes:
步骤5.1:对得分柱状图中被标记的区域进行微调,并获得新的火焰分割图像,若分割效果有明显的改善,则保留新的标记区域,通过多次调整获得确定的标记区域和精确的火焰分割图像;Step 5.1: Fine-tune the marked area in the score histogram, and obtain a new flame segmentation image. If the segmentation effect is significantly improved, keep the new marked area, and obtain a definite marked area and an accurate flame through multiple adjustments. Flame segmentation image;
步骤5.2:通过验证法在所述确定的标记区域周围标记一块验证区域,将验证区域映射回原始RGB图像,若验证区域对应的分割图像位于火焰图像的周围,则表明所述确定的标记区域符合火焰分割的要求。Step 5.2: mark a verification area around the determined marked area by the verification method, map the verified area back to the original RGB image, if the segmented image corresponding to the verified area is located around the flame image, it indicates that the determined marked area conforms to Flame splitting requirements.
具体实施时,为了验证步骤5.1得到的区域即为感兴趣的火焰区域,我们在得分柱状图上标记另外一个区域,接近之前的感兴趣的区域,同时在原图像中显现标记的颜色区域。图10所示在得分柱状图上标记一块s1[0,50]区间和s2[0,200]的区间,图12所示为映射回原始图像的结果,即分割结果图像,图11为在图10中标记的区域附近,重新标记一块多边形区域,映射回原图像得到图13,即火焰周围的烟雾图像。若验证区域对应的分割图像位于火焰图像的周围,则表明所述确定的标记区域符合火焰分割的要求。During the specific implementation, in order to verify that the area obtained in step 5.1 is the flame area of interest, we mark another area on the score histogram, which is close to the previous area of interest, and at the same time show the marked color area in the original image. As shown in Figure 10, mark a s1[0,50] interval and s2[0,200] interval on the score histogram, and Figure 12 shows the result of mapping back to the original image, that is, the segmentation result image, and Figure 11 shows the results in Figure 10 Near the marked area, re-mark a polygonal area, and map it back to the original image to get Figure 13, which is the smoke image around the flame. If the segmentation image corresponding to the verification area is located around the flame image, it indicates that the determined marked area meets the requirements of flame segmentation.
步骤6:通过特征提取公式,借助得分柱状图中被标记区域分别计算火焰亮度区域大小、火焰颜色种类数、火焰区域颜色平均值、整幅图像颜色平均值以及火焰亮度值5种特征数据。Step 6: Through the feature extraction formula, the five characteristic data of the size of the flame brightness area, the number of flame color types, the average color of the flame area, the average color of the entire image, and the flame brightness value are calculated respectively with the help of the marked area in the score histogram.
其中,火焰亮度区域大小是指经过分割后所得感兴趣区域的大小,原始RGB图像的每一个像素值都被投影到得分柱状图中,所以感兴趣区域大小在得分柱状图中即为标记区域中所有数值之和,根据下式计算火焰亮度区域大小:Among them, the size of the flame brightness region refers to the size of the region of interest obtained after segmentation. Each pixel value of the original RGB image is projected into the score histogram, so the size of the region of interest in the score histogram is the marked region The sum of all values calculates the size of the flame brightness area according to the following formula:
其中,A表示火焰亮度区域大小,TTx,y为得分柱状图中坐标为(x,y)的同样像素点的个数,Mi,j=1对应得分柱状图中的标记区域。Among them, A represents the size of the flame brightness area, TT x, y is the number of the same pixel points whose coordinates are (x, y) in the score histogram, M i,j = 1 corresponds to the marked area in the score histogram.
步骤6中得分柱状图中的标记区域中的数值大于1的每一个坐标均对应原始RGB图像的一种颜色,火焰颜色种类数为得分柱状图中的标记区域中的数值大于0的坐标个数和,根据下式求火焰颜色种类数:Each coordinate with a value greater than 1 in the marked area in the score histogram in step 6 corresponds to a color of the original RGB image, and the number of flame colors is the number of coordinates with a value greater than 0 in the marked area in the score histogram and, calculate the number of flame colors according to the following formula:
其中,C表示火焰颜色种类数,TTx,y为得分柱状图中坐标为(x,y)的同样像素点的个数,Mi,j=1对应得分柱状图中的标记区域。Among them, C represents the number of flame colors, TT x, y is the number of the same pixel points whose coordinates are (x, y) in the score histogram, M i,j = 1 corresponds to the marked area in the score histogram.
步骤6中根据下式计算火焰区域颜色平均值:In step 6, the average value of the color of the flame area is calculated according to the following formula:
其中,sf表示火焰区域颜色平均值,TTx,y为得分柱状图中坐标为(x,y)的同样像素点的个数,A表示火焰亮度区域大小;Among them, s f represents the average value of the color of the flame area, TT x, y is the number of the same pixel points whose coordinates are (x, y) in the score histogram, and A represents the size of the flame brightness area;
根据下式计算整幅图像颜色平均值:Calculate the color average of the entire image according to the following formula:
其中,sm为整幅图像颜色平均值,TTx,y为得分柱状图中坐标为(x,y)的同样像素点的个数,M×N为整幅图像的尺寸。Among them, s m is the average color of the entire image, TT x, y is the number of the same pixel points with coordinates (x, y) in the score histogram, and M×N is the size of the entire image.
步骤6中计算火焰亮度值具体为:The flame brightness value calculated in step 6 is specifically:
首先,根据下列公式将得分柱状图还原成RGB图像:First, restore the score histogram to an RGB image according to the following formula:
其中,t1,max代表列向量t1中最大的元素,t1,min代表列向量t1中最小的元素,t2,max代表列向量t2中最大的元素,t2,min代表列向量t2中最小的元素,p1为加载向量pa=(1,...,PC)的第一列,p2为加载向量pa=(1,...,PC)的第二列。Among them, t 1,max represents the largest element in the column vector t 1 , t 1,min represents the smallest element in the column vector t 1 , t 2,max represents the largest element in the column vector t 2 , t 2,min represents the column The smallest element in vector t 2 , p 1 is the first column of loading vector p a =(1,...,PC), p 2 is the second column of loading vector p a =(1,...,PC) List.
其次,根据下式计算灰度图像:Second, the grayscale image is calculated according to the following formula:
Lxy=[R,G,B]xy[0.299,0.587,0.114]T (13)L xy =[R,G,B] xy [0.299,0.587,0.114] T (13)
最后,根据下式计算火焰亮度值:Finally, the flame brightness value is calculated according to the following formula:
其中,TTx,y为得分柱状图中坐标为(x,y)的同样像素点的个数。Among them, TT x, y is the number of the same pixel points whose coordinates are (x, y) in the score histogram.
使用本发明的基于MIA的电熔镁炉动态火焰分割及特征提取方法处理一段约58秒的电熔镁炉生产视频数据,将分割得到的1500张图像保存下来,其中分割得到的感兴趣区域部分即每帧的火焰图像结果如图14所示。与常用的图像分类方法对比,采用发明的基于MIA的电熔镁炉动态火焰分割及特征提取方法,实现感兴趣图像区域分割结果效果要更好。针对每一帧图像的得分柱状图中被标记的区域,使用公式(6)(7)(8)(9)(14)进行特征数据计算,得到5种火焰特征数据的趋势图如图15所示。对应视频图像及感兴趣区域图像,观察曲线变化情况,发现这5种特征数据变化趋势与视频图像变化情况具有很强的相关性。具体体现在现场环境下电熔镁炉几种工况是呈现周期性变化的,而分割所得的感兴趣图像的大小、颜色、形态也是呈现周期性的变化,而这种变化更为直观的体现是在5种特征数据趋势图的近似周期性的变化。所以这5种特征数据在后续采用机器学习进行分类确保较高的精度具有重要的意义。Use the MIA-based dynamic flame segmentation and feature extraction method of the fused magnesia furnace of the present invention to process a section of about 58 seconds of fused magnesia furnace production video data, and save the 1500 images obtained by segmentation, and the region of interest obtained by segmentation That is, the flame image result of each frame is shown in Figure 14. Compared with the commonly used image classification methods, the MIA-based dynamic flame segmentation and feature extraction method of the fused magnesium furnace is used to achieve better segmentation results of the image area of interest. For the marked area in the score histogram of each frame image, use the formula (6) (7) (8) (9) (14) to calculate the characteristic data, and get the trend diagram of the five flame characteristic data as shown in Figure 15 Show. Corresponding to the video image and the image of the region of interest, observing the change of the curve, it is found that the change trend of these five characteristic data has a strong correlation with the change of the video image. Specifically reflected in the on-site environment, several working conditions of the fused magnesium furnace show periodic changes, and the size, color, and shape of the image of interest obtained by segmentation also show periodic changes, and this change is more intuitive. It is an approximate periodic change in the five characteristic data trend graphs. Therefore, these five types of feature data are of great significance for subsequent classification using machine learning to ensure high accuracy.
以上所述仅为本发明的较佳实施例,并不用以限制本发明的思想,凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the idea of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention should be included in the present invention. within the scope of protection.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711293082.3A CN108052950B (en) | 2017-12-08 | 2017-12-08 | MIA-based fused magnesia furnace dynamic flame segmentation and feature extraction method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711293082.3A CN108052950B (en) | 2017-12-08 | 2017-12-08 | MIA-based fused magnesia furnace dynamic flame segmentation and feature extraction method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108052950A true CN108052950A (en) | 2018-05-18 |
CN108052950B CN108052950B (en) | 2021-06-11 |
Family
ID=62122516
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711293082.3A Expired - Fee Related CN108052950B (en) | 2017-12-08 | 2017-12-08 | MIA-based fused magnesia furnace dynamic flame segmentation and feature extraction method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108052950B (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109886231A (en) * | 2019-02-28 | 2019-06-14 | 重庆科技学院 | A method for identifying the flame combustion state of a waste incineration plant |
CN110057820A (en) * | 2019-04-15 | 2019-07-26 | 中南大学 | Method, system and the storage medium of on-line checking hydrogen chloride synthetic furnace chlorine hydrogen proportion |
CN110660096A (en) * | 2019-10-08 | 2020-01-07 | 珠海格力电器股份有限公司 | Curve consistency detection method and storage medium |
CN111598905A (en) * | 2020-05-13 | 2020-08-28 | 云垦智能科技(上海)有限公司 | Method for identifying type of blast furnace flame by using image segmentation technology |
CN112669369A (en) * | 2021-01-20 | 2021-04-16 | 中国科学院广州能源研究所 | Quantitative determination method for degree of yellow flame of hydrocarbon flame |
CN115880490A (en) * | 2022-11-21 | 2023-03-31 | 广东石油化工学院 | Flame segmentation method based on isolated forest |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1668920A (en) * | 2002-07-11 | 2005-09-14 | 麦克马斯特大学 | On-line measurement method of molten state |
CN102023160A (en) * | 2009-09-15 | 2011-04-20 | 财团法人工业技术研究院 | Measure method of combustible quality based on image |
CN102598025A (en) * | 2009-08-25 | 2012-07-18 | 福瑞托-雷北美有限公司 | Method for real time detection of defects in a food product |
CN103020496A (en) * | 2012-11-05 | 2013-04-03 | 王少夫 | Digital watermark encryption realization method |
KR101309407B1 (en) * | 2012-11-20 | 2013-09-17 | 신현기 | The thermal and image of block image-based composite camera fire detector, fire detection system and method |
CN103971114A (en) * | 2014-04-23 | 2014-08-06 | 天津航天中为数据系统科技有限公司 | Forest fire detection method based on aerial remote sensing |
-
2017
- 2017-12-08 CN CN201711293082.3A patent/CN108052950B/en not_active Expired - Fee Related
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1668920A (en) * | 2002-07-11 | 2005-09-14 | 麦克马斯特大学 | On-line measurement method of molten state |
CN102598025A (en) * | 2009-08-25 | 2012-07-18 | 福瑞托-雷北美有限公司 | Method for real time detection of defects in a food product |
CN102023160A (en) * | 2009-09-15 | 2011-04-20 | 财团法人工业技术研究院 | Measure method of combustible quality based on image |
CN103020496A (en) * | 2012-11-05 | 2013-04-03 | 王少夫 | Digital watermark encryption realization method |
KR101309407B1 (en) * | 2012-11-20 | 2013-09-17 | 신현기 | The thermal and image of block image-based composite camera fire detector, fire detection system and method |
CN103971114A (en) * | 2014-04-23 | 2014-08-06 | 天津航天中为数据系统科技有限公司 | Forest fire detection method based on aerial remote sensing |
Non-Patent Citations (3)
Title |
---|
G. SZATVANYI AND C. DUCHESNE,AT AL: "Multivariate Image Analysis of Flames for Product Quality and Combustion", 《AMERICAN CHEMICAL SOCIETY》 * |
李帷韬: "水泥回转窑烧成状态识别与熟料质量指标软测量的研究", 《中国博士学位论文全文数据库 工程科技Ⅰ辑》 * |
郭小玉: "炉口火焰序列图像颜色特征提取方法", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109886231A (en) * | 2019-02-28 | 2019-06-14 | 重庆科技学院 | A method for identifying the flame combustion state of a waste incineration plant |
CN110057820A (en) * | 2019-04-15 | 2019-07-26 | 中南大学 | Method, system and the storage medium of on-line checking hydrogen chloride synthetic furnace chlorine hydrogen proportion |
CN110057820B (en) * | 2019-04-15 | 2021-04-30 | 中南大学 | Method, system and storage medium for on-line detection of chlorine-hydrogen ratio of hydrogen chloride synthesis furnace |
CN110660096A (en) * | 2019-10-08 | 2020-01-07 | 珠海格力电器股份有限公司 | Curve consistency detection method and storage medium |
CN111598905A (en) * | 2020-05-13 | 2020-08-28 | 云垦智能科技(上海)有限公司 | Method for identifying type of blast furnace flame by using image segmentation technology |
CN112669369A (en) * | 2021-01-20 | 2021-04-16 | 中国科学院广州能源研究所 | Quantitative determination method for degree of yellow flame of hydrocarbon flame |
CN115880490A (en) * | 2022-11-21 | 2023-03-31 | 广东石油化工学院 | Flame segmentation method based on isolated forest |
CN115880490B (en) * | 2022-11-21 | 2023-10-27 | 广东石油化工学院 | A flame segmentation method based on isolated forest |
Also Published As
Publication number | Publication date |
---|---|
CN108052950B (en) | 2021-06-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108052950A (en) | A kind of segmentation of electric melting magnesium furnace dynamic flame and feature extracting method based on MIA | |
CN106875373B (en) | Mobile phone screen MURA defect detection method based on convolutional neural network pruning algorithm | |
CN108562589B (en) | Method for detecting surface defects of magnetic circuit material | |
CN109389591B (en) | Color Image Quality Evaluation Method Based on Color Descriptor | |
CN108229458A (en) | A kind of intelligent flame recognition methods based on motion detection and multi-feature extraction | |
CN106203334A (en) | A method for flame detection in indoor scenes | |
CN106228150A (en) | Smog detection method based on video image | |
CN113221881B (en) | A multi-level smartphone screen defect detection method | |
CN106097366A (en) | A kind of image processing method based on the Codebook foreground detection improved | |
CN113205136A (en) | Real-time high-precision detection method for appearance defects of power adapter | |
CN118674685B (en) | Movable pin hole plugging defect detection system and method | |
CN116843581B (en) | Image enhancement method, system, device and storage medium for multi-scene graph | |
CN117372339A (en) | PCB defect detection and identification method based on YOLO-SEE | |
CN105488475A (en) | Method for detecting human face in mobile phone | |
CN107330441A (en) | Flame image foreground extraction algorithm | |
CN110427868A (en) | A kind of pedestrian identify again in feature extracting method | |
CN119274001B (en) | Quantitative recognition method of test paper color change based on improved MSRCR and random forest | |
CN118967690B (en) | A defect detection method based on deep contrastive learning | |
CN111080754A (en) | Character animation production method and device for connecting characteristic points of head and limbs | |
CN112560672A (en) | Fire image recognition method based on SVM parameter optimization | |
Nugroho et al. | Negative content filtering for video application | |
JP5006839B2 (en) | Trimming rule learning apparatus and method, and program | |
CN117670755A (en) | Detection method and device for lifting hook anti-drop device, storage medium and electronic equipment | |
CN116206301A (en) | Recognition Method of Flexible and Deformable Objects in Complex Background Based on Convolutional Neural Network | |
CN107452039B (en) | Method and device for compressing RGB color space |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20210611 |
|
CF01 | Termination of patent right due to non-payment of annual fee |