CN115293030A - Bearing residual service life prediction method based on deep mutual learning and dynamic feature construction - Google Patents

Bearing residual service life prediction method based on deep mutual learning and dynamic feature construction Download PDF

Info

Publication number
CN115293030A
CN115293030A CN202210847076.2A CN202210847076A CN115293030A CN 115293030 A CN115293030 A CN 115293030A CN 202210847076 A CN202210847076 A CN 202210847076A CN 115293030 A CN115293030 A CN 115293030A
Authority
CN
China
Prior art keywords
bearing
model
dml
service life
degradation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210847076.2A
Other languages
Chinese (zh)
Inventor
朱红求
王佳宁
黄子怡
张英杰
周灿
程菲
陆碧良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Central South University
Original Assignee
Central South University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Central South University filed Critical Central South University
Priority to CN202210847076.2A priority Critical patent/CN115293030A/en
Publication of CN115293030A publication Critical patent/CN115293030A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • G06F30/27Design optimisation, verification or simulation using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2119/00Details relating to the type or aim of the analysis or the optimisation
    • G06F2119/02Reliability analysis or reliability optimisation; Failure analysis, e.g. worst case scenario performance, failure mode and effects analysis [FMEA]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2119/00Details relating to the type or aim of the analysis or the optimisation
    • G06F2119/04Ageing analysis or optimisation against ageing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Testing Of Devices, Machine Parts, Or Other Structures Thereof (AREA)

Abstract

The invention belongs to the field of bearing service life prediction, and discloses a method for predicting the residual service life of a bearing based on deep mutual learning and dynamic feature construction, wherein a more stable bearing feature RRMS is selected, firstly, a convolutional neural network improved by DML is used for automatically extracting features in a first stage to indicate the health condition of the bearing, when the bearing degrades to 50 percent (the output is less than 0.5), the last 50 percent of the bearing is predicted through a length memory network, and finally, the results of the two stages are combined to obtain a service life degradation curve of the bearing, the model output obtained by the method can be directly used for calculating RUL, the method avoids the selection of a bearing failure threshold, in the whole prediction process, CNN and LSTM are respectively used in different stages of the bearing degradation, and the existing full-life data and the current bearing historical data are utilized to the maximum extent to improve the accuracy of the model.

Description

Bearing residual service life prediction method based on deep mutual learning and dynamic feature construction
Technical Field
The invention belongs to the field of bearing service life prediction, and particularly relates to a method for predicting the residual service life of a bearing based on deep mutual learning and dynamic feature construction.
Background
Rolling bearings are widely used in various industrial fields as rotating parts of mechanical equipment. However, the complexity of the industrial environment and the long-term uninterrupted operation make the bearings highly susceptible to failure, which causes abnormal operation of the mechanical system, as a critical component of the rotating machinery. The RUL prediction of the rolling bearing can avoid the situation, reduce unnecessary shutdown and casualties and provide basis for making an optimal maintenance strategy.
The mechanism-based RUL prediction method is modeled based on the degradation modulation of a single fault; it requires a large amount of a priori knowledge. Furthermore, the process of degradation of the bearing is very complex. Therefore, it is difficult to establish an accurate physical model. Currently, the data-driven RUL prediction method has achieved a great deal of success. Still from the problems, first, it is a rather complicated process to construct a feature set that can describe the bearing degradation trend. Second, the highly subjective construction of degenerate labels is not a uniform standard, but rather creates a great deal of randomness in the setting of failure thresholds. The method aims at the problems of complexity, changeability, high subjectivity in degradation index selection and the like in feature set construction in the field of bearing service life prediction at present.
Disclosure of Invention
The invention aims to provide a method for predicting the residual service life of a bearing based on deep mutual learning and dynamic characteristic construction, so as to solve the problems in the prior art in the background technology.
In order to achieve the purpose, the invention adopts the following technical scheme:
the method for predicting the residual service life of the bearing based on deep mutual learning and dynamic characteristic construction comprises the following steps:
step one, establishing an experimental data set: it comprises a training set consisting of bearing data for bearing 1 and bearing 3 and a test set consisting of bearing data for bearing 2 and bearing 4;
step two, building a DML model: preprocessing the bearing data, performing FFT (fast Fourier transform) on a vibration signal of the bearing, converting a time domain signal into a frequency domain signal, and inputting the obtained FFT data into a CNN (computer network node) model enhanced by DML (digital multiplex) technology;
step three, RUL calculation: taking the first 1024-dimensional data in the frequency domain signals as the input of a DML model, and comparing the output of the DML model; if the output of the model is more than 0.5, directly using the output result of the DML to calculate the RUL; otherwise, the output result of the DML model is input into a subsequent LSTM model, and the output of the LSTM model is finally used for calculating the RUL;
step four, obtaining a service life degradation curve of the bearing: and comparing the convergence speed and the accuracy of the LSTM model under different step lengths, and then combining the predicted output results of the two stages to obtain a degradation curve.
Furthermore, the device comprises an alternating current motor, a bearing 1, a bearing 2, a bearing 3, a bearing 4 and a vibration sensor during data acquisition of the training set and the test set; the sampling frequency is 20KHz, 20480 sampling points are collected in each sampling, and the time interval of each sampling is 10 minutes; then, determining a degradation starting point and a failure point of each bearing, establishing a training label and a testing label, and then performing FFT processing on the original signal.
Further, the life cycle of the bearing is divided into four phases, namely a healthy phase, a slow degradation phase, a fast degradation phase and a failure phase after a failure point. The time corresponding to the start of degradation is denoted t d The time corresponding to the point of failure is t f Determining t by thresholding d And t f The threshold values are 1.1 and 5;the RMS values of different bearings are different and therefore a more stable characteristic RRMS is chosen, so that the same threshold can be applied to different bearings, the RRMS being expressed as:
Figure BDA0003735995910000021
wherein RMS norm Is the average effective value of the data points 200 to 300;
fitting the RRMS of the bearing according to an exponential function λ (t) to determine the full life λ of the bearing t As shown in formula:
λ(t)=y 0 +αt β
wherein the parameter y 0 α, β are determined by the ordinary least squares method, and t f Can be determined by λ (t) = 5.
Further, applying DML to the field of RUL prediction, the CNN output of DML being used to indicate the health of the bearing, and when the bearing degrades to 50%, performing a second stage of prediction comprising:
the output of CNN based on DML is used for indicating the health condition of the bearing, the DML model is realized by mutual learning of two CNNs, the optimization targets of the two CNNs are respectively formula (1) and formula (2), and the DML is applied to the RUL prediction field to prevent overfitting of the model and further improve the prediction precision;
Loss net1 =L y +D KL (p 2 ||p 1 ) (1)
Loss net2 =L y +D KL (p 1 ||p 2 ) (2)。
further, one-dimensional CNN is used to process time series data, the last layer uses sigmoid as an activation function, and the learning rate is set to 0.01;
when the output of the DML model is greater than 0.5, i.e., when the degree of degradation is less than 50%, the output of the DML can be directly used to calculate the RUL;
when the output of the DML model is less than 0.5, namely when the degradation degree is more than 50%, the output result of the DML model is input into the LSTM model to carry out the prediction of the second stage.
Further, the CNN and the LSTM are respectively used in different stages of bearing degradation, and the existing full-life data and the current bearing historical data are utilized to the maximum extent to improve the accuracy of the model, and the method comprises the following steps:
inputting the output result of the DML model into the LSTM model for second-stage prediction;
the RUL is calculated using the output of the LSTM model, and in this way the RUL for the bearing at different stages of life can be predicted.
Furthermore, the LSTM adopts 24 steps, so that the training speed of the model is ensured while the prediction precision is ensured.
Further, the DML model also comprises model training, including loss prediction and loss simulation.
Further, in the prediction loss, the optimization goal of CNN is to minimize the difference between the true value and the predicted value, given an input vector
Figure BDA0003735995910000041
I.e., n samples, the feature extractor will
Figure BDA0003735995910000042
Mapping to d-dimensional space, then mapping d-dimensional vector to 1-dimensional by full-connected layer, and outputting H t Predicting the loss L y MSE is used, as shown in formula;
Figure BDA0003735995910000043
further, in the loss of imitability, the distribution difference between models can be reduced by minimizing the loss of imitations, and the MSE can enable the models to be completely fitted to the training data; increasing the simulation loss of the distribution difference between the measurement models, and then optimizing the model by minimizing the loss, before training the model, a training label should be constructed, and during the bearing degradation, the time t is characterized by
Figure BDA0003735995910000044
Will be provided with
Figure BDA0003735995910000045
Inputting health index to train model, and during training, each sample X t Label y of t Given by the formula:
Figure BDA0003735995910000046
in the formula, actRIL t Is the RUL of the bearing at time t, can pass through f T is obtained, RUL 0 Is the total life of the bearing, can pass t f -t d Thus obtaining the product.
The invention has the technical effects and advantages that: compared with the prior art, the method for predicting the residual service life of the bearing based on the deep mutual learning and dynamic characteristic construction has the following advantages:
according to the method, a more stable bearing characteristic RRMS is selected, firstly, a convolution neural network improved by DML is used for automatically extracting characteristics in a first stage to indicate the health condition of a bearing, when the bearing degrades to 50% (the output is less than 0.5), the later 50% is predicted through a long-time and short-time memory network, finally, the results of the two stages are combined to obtain a life degradation curve of the bearing, the model output obtained through the method can be directly used for calculating the RUL, the method avoids the selection of a bearing failure threshold value, in the whole prediction process, a CNN and an LSTM are respectively used in different stages of the bearing degradation, and the accuracy of the model is improved by utilizing the existing full-life data and the current bearing historical data to the maximum extent.
Drawings
FIG. 1 is a flow chart of a prediction method of the present invention;
FIG. 2 is a schematic diagram comparing the characteristics of RMS and RRMS in accordance with the present invention;
FIG. 3 is a schematic representation of the fitting results for a bearing of the present invention;
FIG. 4 is a schematic diagram of a convolutional neural network structure of the present invention;
FIG. 5 is a schematic diagram of the LSTM cell structure of the present invention;
FIG. 6 is a schematic diagram of the structure of the depth reciprocity model (DML) of the present invention;
FIG. 7 is a schematic representation of a full life cycle signal for a bearing of the present invention;
FIG. 8 is a graph showing the loss of the LSTM model of the present invention at different step sizes;
FIG. 9 is a graph illustrating the results of different health indicators according to the present invention;
FIG. 10 is a schematic view of a prediction result scatter plot according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The specific embodiments described herein are merely illustrative of the invention and do not delimit the invention. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
The invention provides a bearing residual service life prediction method based on deep mutual learning and dynamic feature construction as shown in figure 1, and a two-stage RUL prediction method is constructed by adopting DML and dynamic features.
Specifically, S1, establishing an experimental data set: it comprises a training set consisting of bearing data for bearing 1 and bearing 3 and a test set comprising bearing data for bearing 2 and bearing 4;
s2, establishing a DML model: preprocessing the bearing data, performing FFT (fast Fourier transform) on a vibration signal of the bearing, converting a time domain signal into a frequency domain signal, and inputting the obtained FFT data into a CNN (CNN) model enhanced by DML (digital signal library);
s3, calculating RUL: taking the first 1024-dimensional data in the frequency domain signal as the input of a DML model, and comparing the output of the DML model; if the output of the model is more than 0.5, directly using the output result of the DML to calculate the RUL; otherwise, inputting the output result of the DML model into a subsequent LSTM model, and finally calculating the RUL by using the output of the LSTM model;
s4, obtaining a service life degradation curve of the bearing: and comparing the convergence speed and the accuracy of the LSTM model under different step lengths, and then combining the predicted output results of the two stages to obtain a degradation curve.
During the healthy phase, the RMS values of the different bearings are different. Therefore, in the proposed method, a more stable bearing characteristic RRMS is selected, and the input signal is a frequency domain signal; training labels proportional to RUL were used. The method divides the degradation process of the bearing into two stages. The previous stage uses the output of the CNN modified by the DML to indicate the current RUL. When its output indicates a RUL of less than a certain percentage, the next stage of prediction is started. In the latter stage, the LSTM network is used to predict RUL, the input of which is the output of the previous stage. Finally, a comparison experiment is designed, the method is compared with other methods, a conclusion is drawn according to a comparison result, and the superiority of the method is proved.
The two-stage bearing residual life prediction method specifically comprises the following step that the life cycle of the bearing is divided into four stages, namely a healthy stage, a slow degradation stage, a rapid degradation stage and a failure stage after a failure point.
The time corresponding to the start of Degradation (DSP) is denoted t d The time corresponding to the point of failure is t f . The embodiment adopts a threshold value method to determine t d And t f
During the healthy phase, the RMS values of the different bearings are different. Therefore, the present invention selects a more stable characteristic RRMS, allowing different bearings to apply the same threshold. RRMS is represented by the formula
Figure BDA0003735995910000061
The proposed method comprises three modules: data preprocessing, first-stage prediction and second-stage prediction.
First, in data preprocessing, a time domain signal is converted into a frequency domain signal after being subjected to Fast Fourier Transform (FFT). In data preprocessing. The purpose of this processing is to facilitate the input of data into the network.
And secondly, applying the DML to the RUL prediction field to prevent overfitting of the model and further improve the prediction accuracy. During the DML process, network 1 and network 2 are trained forward, respectively. Relative entropy measures the difference p between two network predictions 1 And p 2 (ii) a This difference is added as a loss function of the back propagation. Here, the relative entropy uses Kullback Leibler (KL) divergence to measure the difference between the two distributions. The expression of KL divergence is shown in the formula. The whole feature extraction process is automatically completed by CNN, and the degraded label is directly represented by RUL. The method simplifies the process of feature extraction and the construction of the degradation index.
Figure BDA0003735995910000071
In the first stage prediction, the output of the CNN based on the DML is used to indicate the health of the bearing. Where one-dimensional CNN is used to process time series data, the last layer uses sigmoid as an activation function, and the learning rate is set to 0.01. The DML model is realized by mutual learning of two CNNs, and the optimization targets of the two CNNs are respectively formula (3) and formula (4).
Loss net1 =L y +D KL (p 2 ||p 1 ) (3)
Loss net2 =L y +D KL (p 1 ||p 2 ) (4);
Then, when the bearing degrades to 50% (output less than 0.5), LSTM is used to predict the last 50% based on CNN output. Finally, the results of the two stages are combined to obtain a life degradation curve of the bearing.
The value corresponding to each point on the degradation curve is in direct proportion to the RUL corresponding to the point, so that a quantitative relation exists between the constructed degradation curve and the RUL.
In conclusion, according to the method for predicting the residual life of the bearing, provided by the invention, in the whole prediction process, the CNN and the LSTM are respectively used in different stages of bearing degradation, and the precision of a model is improved by utilizing the existing full-life data and the current historical data of the bearing to the maximum extent.
Taking bearing data provided by an intelligent maintenance system (IMF) center of the university of Xinxina as an example, classifying the data and designing an experiment, and training a model by using the obtained data to obtain output results of different models. And analyzing and drawing a conclusion based on the obtained result. The specific embodiment is implemented as follows:
1. construction of an Experimental dataset
The experimental data come from the center of the Intelligent Maintenance System (IMS) of the Xinxinacati university, and a bearing data acquisition system of the IMS comprises an alternating current motor (the speed is 2000 RPM), four bearings (Rexnord ZA-2115 double-row bearings) and a vibration sensor, wherein the sampling frequency of the system is 20KHz, 20480 sampling points are collected in each sampling process, and the time interval of each sampling process is 10 minutes. The vibration signal of the bearing at the full life cycle is shown in fig. 7 (a). In the present invention, the frequency domain signal obtained by FFT (as shown in fig. 7 (b)) can retain the original information of the bearing as much as possible. Furthermore, the present invention indicates that the model works well when the first 1024 dimensions are selected. Therefore, the invention takes the first 1024 dimensions of the frequency domain signal as the input of the model to improve the training speed of the model.
The present invention uses four bearing datasets. The data obtained in one sample is treated as one sample. The number of samples for the four bearing data sets is shown in table 1. Bearing 1 and bearing 3 were selected as the training set and bearing 2 and bearing 4 were selected as the test set. In the experiment, the DSP and the fault point of each bearing are firstly determined, and a training label and a testing label are established. The original signal is then FFT processed.
Table 1 summary of four bearing data:
Figure BDA0003735995910000081
Figure BDA0003735995910000091
the life cycle of the bearing is divided into four stages, namely a healthy stage, a slow degradation stage, a fast degradation stage and a failure stage after a failure point. The time corresponding to the start of Degradation (DSP) is denoted t d The time corresponding to the point of failure is t f . The invention adopts a threshold value method to determine t d And t f . As shown in fig. 2 (a), during the healthy phase, the RMS values of different bearings are different. Thus, the present invention selects a more stable characteristic RRMS (see fig. 3). Wherein RMS norm Is the average valid value of the data points 200 to 300 (stable phase). The thresholds chosen in the present invention are 1.1 and 5. However, the RRMS of bearing 1 and bearing 2 did not reach 5. To this end, the invention fits the RRMS of the bearing with an exponential function λ (t) to determine the full life λ of the bearing t Is shown as the formula:
λ(t)=y 0 +αt β (5);
wherein the parameter y 0 α, β are determined by the ordinary least squares method (OLS). The fitted graph is shown in fig. 3. And t is f It can be determined by λ (t) = 5.
2. Data set enhancement
In data preprocessing, in order to input data into a network conveniently, a time domain vibration signal is converted into a frequency domain vibration signal through fast Fourier transform. The feature extraction of the invention is automatically completed by CNN, and the degraded label is directly represented by RUL. The method simplifies the process of feature extraction and the construction of the degradation index. The structure of the CNN is shown in FIG. 4. The CNN can be used as a powerful feature extractor and has super-strong performance in feature extraction. It consists of three layers: convolutional layers, pooling layers, and full-link layers. The convolution layer and the pool layer are used for feature extraction; the former extracts high-dimensional features, and the latter reduces the dimensionality of the features to a classification task. CNN usually uses cross entropy function as loss function, softmax and sigmoid as common function, softmax is generally used for multi-classification task; its output is input x i Probability belonging to each class. The sigmoid function is used for binary tasks, the output of which is a value between 0 and 1. The expression of sigmoid is as follows:
Figure BDA0003735995910000101
although CNN performs well in feature extraction, shallow CNN networks have limited effectiveness for complex bearing degradation features. The DML provided by the invention on the basis of knowledge extraction can obtain more complex characteristics. The DML can obtain features that a single model cannot learn each other through mutual learning among a plurality of learning models, thereby improving the effect of the models. The principle of DML is shown in fig. 6. The invention applies DML to the field of RUL prediction to prevent overfitting of the model and further improve the prediction precision.
3. Model training and parameter selection
CNN networks have excellent performance in feature extraction. It consists of three layers: convolutional layers, pooling layers, and full-link layers. The function of convolutional and pooling layers is feature extraction. The structure of CNN is shown in fig. 4, and the more detailed CNN parameter settings are shown in the following table.
Table 2 CNN detailed parameter configuration
Figure BDA0003735995910000102
The hidden layer of LSTM is set to 12 nodes. The step size of the LSTM may affect the Mean Square Error (MSE) loss of the model. Thus, the present invention discusses the loss of different steps under 300 characterizations. Fig. 8 details that the model can converge at different step sizes, but the convergence speed and accuracy are affected by the step size. When the step length becomes longer, the loss of the LSTM is reduced; however, when the step length is larger than a certain value, the model is not easy to converge with the increase of the step length. In the invention, LSTM adopts 24 steps, thereby ensuring the training speed of the model while ensuring the prediction precision.
Before model training, custom loss functions are required.
For DML networks, the loss consists of two parts: predicted loss and modeled loss. For LSTM networks, the loss is a predicted loss.
1) And (6) predicting loss. The optimization goal of CNN is to minimize the difference between the true and predicted values. Given an input vector
Figure BDA0003735995910000111
(n samples), the feature extractor will
Figure BDA0003735995910000112
To a d-dimensional space and then the fully connected layer maps the d-dimensional vector to 1-dimensional. According to the output H t Predicting the loss L y MSE is used, as shown in the formula:
Figure BDA0003735995910000113
2) Loss of imitability. The distribution differences between models can be reduced by minimizing the simulation loss. MSE may fit the model to the training data completely; but this will result in an overfitting because the distribution of the test data and the training data is not exactly the same. Therefore, it is necessary to increase the simulation loss that measures the distribution difference between models and then optimize the models by minimizing this loss. The mimicry loss is represented by the KL divergence in the formula.
Before training the model, training labels should be constructed. During the bearing degradation, time t is characterized by
Figure BDA0003735995910000114
Will be provided with
Figure BDA0003735995910000115
Health indicators are input to train the model. During the training process, each sample X t Label y of t Given by the formula:
Figure BDA0003735995910000116
in the formula, actRIL t Is the RUL of the bearing at time t, can pass through f -t is obtained. RUL 0 Is the total life of the bearing, can pass t f -t d Thus obtaining the compound.
The training process is divided into two parts. DML model training and LSTM model training. The output of the previous model is the input of the next model. The strategy training model can make full use of the existing bearing life data and bearing historical data.
In the model training process, the vibration signal (training data set) is first subjected to FFT, and then the FFT data is input into the DML model. The output of the DML model can be used to describe the degree of degradation of the bearing. And finally, when the prediction result of the DML model is less than 0.5, training the prediction model at the later stage. The specific method is to input the output value (> 0.5) of the DML model into the LSTM model. The DML model is implemented by mutual learning of two CNNs. The optimization goals for the two CNNs are (7) and (8), respectively. The optimization goal of the LSTM model is (6)
During model testing (predicting the RUL of a bearing), the degree of degradation of the bearing at a certain time is obtained by the DML model. When the degree of degradation is less than 50% (i.e., the output of the DML model is greater than 0.5), the output of the DML can be used directly to calculate the RUL. When the DML judges that the degradation degree of the bearing at the moment is 50 percent (namely the output of the DML model is less than 0.5), firstly, the FFT signal of the bearing at the next moment is input into the DML model, and then the output result of the DML model is input into the LSTM model. In this case, the output of the LSTM model can be used to calculate RUL. In this way, the RUL of the bearing at different stages of life can be predicted. The reason for this two-stage approach is that the DML model fits its degradation curve well at early stages of the bearing life, while the vibration signal of the bearing fluctuates greatly at later stages of degradation. In this case, the degradation characteristics of the bearing are complex and variable. Although DML can extract complex features well, its role is still limited at later stages of bearing degradation. The present invention adds LSTM based DML, considering that LSTM can well describe sequence data with spatio-temporal correlation.
The invention carries out experiments according to the parameters to obtain a trained model, and selects a test set which is divided in advance to carry out model tests.
4. Analysis of Experimental results
In the present invention, the outputs of the different models are used as health indicators for the bearings. These models include the CNN model, the LSTM model, the CNN-LSTM (combination of CNN and LSTM) model, and the DML model (consisting of two CNNs). Furthermore, the method proposed by the present invention was compared with DML. Fig. 9 shows the results of different health indicators for the bearing 2 and the bearing 4. The results in fig. 9 cannot be used directly to compare the performance of the health indicators. However, it can be seen that the outputs of the four health indicators do not have a significant tendency to degrade later in the life cycle of the bearing and are far from the true RUL. The method employed by the present invention is based on this situation. Experimental results show that the method can improve the later prediction precision. In addition, DMLs may learn more bearing degradation characteristics, which may be confirmed by comparison of DMLs to CNN, LSTM and CNN-LSTM.
Fig. 10 is a scatter plot consisting of label values and predicted values, which can visually demonstrate the prediction effect of the proposed method, and it can be clearly seen that the prediction accuracy of the azimuth 2 is higher than that of the azimuth 4. In order to quantitatively compare the performances of the methods, the invention uses more detailed indexes comprising correlation, root mean square error and average absolute error so as to measure the prediction effect of the methods. The correlation may be used to measure a linear correlation between the health indicator and time. The closer the value is to 1, the higher the linear correlation between the two.
RMSE and MAE can be used to describe the error between predicted and observed values; while MAE is sensitive to mean values. The evaluation expressions of RMSE and MAE are shown in the formula (9) respectively.
Figure BDA0003735995910000131
Figure BDA0003735995910000132
Table 3 shows the values of the three above-mentioned criteria in the test set. From the table, it can be concluded that CNN, LSTM and CNN-LSTM have respective advantages in three different criteria. DML is an improvement over CNN, with better performance. Compared with the four different health indexes, the method provided by the invention has the best effect. The reason is that it is difficult to track the complicated degradation process with a single method. Particularly, in the later stage of the bearing degradation (as shown in fig. 9), the proposed method makes full use of the historical data of the bearing and combines the memory function of the LSTM, thereby effectively predicting the degradation trend of the bearing in the later stage.
TABLE 3 prediction results of various methods
Figure BDA0003735995910000141
The value of the health indicator can be used to calculate the RUL of the bearing, which at a certain time t can be calculated by the equation.
Figure BDA0003735995910000142
In the formula, H t Is the output of the health indicator at time t. The predicted results are shown in table 4. Here, the 120 th and 180 th points (calculated by the DSP) are selected as predicted points for the bearings 2 and 4, respectively. In the present invention, a percentage error, er, was introduced to evaluate the performance of the predicted results. Er of the predicted point i, the calculation formula is as follows.
Figure BDA0003735995910000151
As can be seen from Table 4, er of CNN-LSTM is smaller than those of CNN and LSTM, and DML further improves the prediction accuracy of CNN. Furthermore, it can be concluded that the health indicators constructed by the proposed method can predict the RUL of the bearing with the highest accuracy.
TABLE 4 comparison of RUL prediction results for different methods
Figure BDA0003735995910000152
According to the method, a more stable bearing characteristic RRMS is selected, firstly, a convolution neural network improved by DML is used for automatically extracting characteristics in a first stage to indicate the health condition of a bearing, when the bearing degrades to 50% (the output is less than 0.5), the later 50% is predicted through a long-time and short-time memory network, finally, the results of the two stages are combined to obtain a life degradation curve of the bearing, the model output obtained through the method can be directly used for calculating the RUL, the method avoids the selection of a bearing failure threshold value, in the whole prediction process, a CNN and an LSTM are respectively used in different stages of the bearing degradation, and the accuracy of the model is improved by utilizing the existing full-life data and the current bearing historical data to the maximum extent.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that modifications may be made to the embodiments or portions thereof without departing from the spirit and scope of the invention.

Claims (10)

1. The method for predicting the residual service life of the bearing based on deep mutual learning and dynamic feature construction is characterized by comprising the following steps of:
step one, establishing an experimental data set: it comprises a training set consisting of bearing data for bearing 1 and bearing 3 and a test set consisting of bearing data for bearing 2 and bearing 4;
step two, building a DML model: preprocessing the bearing data, performing FFT (fast Fourier transform) on a vibration signal of the bearing, converting a time domain signal into a frequency domain signal, and inputting the obtained FFT data into a CNN (computer network node) model enhanced by DML (digital multiplex) technology;
step three, RUL calculation: taking the first 1024-dimensional data in the frequency domain signal as the input of a DML model, and comparing the output of the DML model; if the output of the model is more than 0.5, directly using the output result of the DML to calculate the RUL; otherwise, the output result of the DML model is input into a subsequent LSTM model, and the output of the LSTM model is finally used for calculating the RUL;
step four, obtaining a service life degradation curve of the bearing: and comparing the convergence speed and the accuracy of the LSTM model under different step lengths, and then combining the predicted output results of the two stages to obtain a degradation curve.
2. The method for predicting the residual service life of the bearing based on deep mutual learning and dynamic feature construction as claimed in claim 1, wherein: the device comprises an alternating current motor, a bearing 1, a bearing 2, a bearing 3, a bearing 4 and a vibration sensor when data of a training set and a test set are acquired; the sampling frequency is 20KHz, 20480 sampling points are collected in each sampling, and the time interval of each sampling is 10 minutes; then, determining a degradation starting point and a failure point of each bearing, establishing a training label and a testing label, and then performing FFT processing on the original signal.
3. The method for predicting the residual service life of the bearing based on deep mutual learning and dynamic feature construction as claimed in claim 2, wherein: the life cycle of a bearing is divided into four phases, namely a healthy phase, a slow degradation phase, a fast degradation phase and a failure phase after a failure point. The time corresponding to the start of degradation is denoted t d The time corresponding to the fail point is t f Determining t by thresholding d And t f The threshold values are 1.1 and 5; the RMS values of the different bearings are different and therefore a more stable characteristic RRMS is chosen, so that the same threshold can be applied for the different bearings, the expression for RRMS being as follows:
Figure FDA0003735995900000021
wherein RMS norm Is the average effective value of the data points 200 to 300;
fitting the RRMS of the bearing according to an exponential function λ (t) to determine the full life λ of the bearing t As shown in formula:
λ(t)=y 0 +αt β
wherein the parameter y 0 α, β are determined by the ordinary least squares method, and t f Can be determined by λ (t) = 5.
4. The method for predicting the residual service life of the bearing based on deep mutual learning and dynamic feature construction as claimed in claim 3, wherein: applying DML to the field of RUL prediction, the output of CNN of DML being used to indicate the health of the bearing, when the bearing degrades to 50%, making a second stage of prediction comprising:
the output of CNN based on DML is used for indicating the health condition of the bearing, the DML model is realized by mutual learning of two CNNs, the optimization targets of the two CNNs are respectively formula (1) and formula (2), and the DML is applied to the RUL prediction field to prevent overfitting of the model and further improve the prediction precision;
Loss net1 =L y +D KL (p 2 ||p 1 ) (1)
Loss net2 =L y +D KL (p 1 ||p 2 ) (2)。
5. the method for predicting the residual service life of the bearing based on deep mutual learning and dynamic feature construction as claimed in claim 4, wherein: one-dimensional CNN is used for processing time series data, the last layer uses sigmoid as an activation function, and the learning rate is set to 0.01;
when the output of the DML model is greater than 0.5, i.e., when the degree of degradation is less than 50%, the output of the DML can be directly used to calculate the RUL;
when the output of the DML model is less than 0.5, namely when the degradation degree is more than 50%, the output result of the DML model is input into the LSTM model to carry out the second stage of prediction.
6. The method for predicting the residual service life of the bearing based on deep mutual learning and dynamic feature construction as claimed in claim 5, wherein: the CNN and the LSTM are respectively used for different stages of bearing degradation, existing full-life data and current bearing historical data are utilized to the maximum extent to improve the accuracy of the model, and the method comprises the following steps:
inputting the output result of the DML model into the LSTM model for second-stage prediction;
the RUL is calculated using the output of the LSTM model, and in this way the RUL for the bearing at different stages of life can be predicted.
7. The method for predicting the residual service life of the bearing based on deep mutual learning and dynamic feature construction as claimed in claim 6, wherein: the LSTM adopts 24 steps, so that the training speed of the model is ensured while the prediction precision is ensured.
8. The method for predicting the residual service life of the bearing based on deep mutual learning and dynamic feature construction as claimed in claim 1, wherein: model training, including predicting loss and simulating loss, is also included in the DML model.
9. The method for predicting the residual service life of the bearing based on deep mutual learning and dynamic feature construction as claimed in claim 8, wherein: in the prediction loss, the optimization goal of CNN is to minimize the difference between the true value and the predicted value, and to give an input vector
Figure FDA0003735995900000031
I.e. n samples, the feature extractor will
Figure FDA0003735995900000032
Mapping to d-dimensional space, then mapping d-dimensional vector to 1-dimensional by full-connected layer, and outputting H t Predicting the loss L y MSE is used, as shown in formula;
Figure FDA0003735995900000033
10. the method for predicting the residual service life of the bearing based on deep mutual learning and dynamic feature construction as claimed in claim 9, wherein: in the imitative loss, the distribution difference between models can be reduced by minimizing the imitative loss, and the MSE can enable the models to be completely fitted to training data; increasing the simulation loss of the distribution difference between the measurement models, and then optimizing the model by minimizing the loss, before training the model, a training label should be constructed, and during the bearing degradation, the time t is characterized by
Figure FDA0003735995900000041
Will be provided with
Figure FDA0003735995900000042
Inputting health index to train model, and during training, each sample X t Label y of t Given by the formula:
Figure FDA0003735995900000043
in the formula, actRIL t Is the RUL of the bearing at time t, can pass through f T is obtained, RUL 0 Is the total life of the bearing, can pass t f -t d Thus obtaining the product.
CN202210847076.2A 2022-07-07 2022-07-07 Bearing residual service life prediction method based on deep mutual learning and dynamic feature construction Pending CN115293030A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210847076.2A CN115293030A (en) 2022-07-07 2022-07-07 Bearing residual service life prediction method based on deep mutual learning and dynamic feature construction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210847076.2A CN115293030A (en) 2022-07-07 2022-07-07 Bearing residual service life prediction method based on deep mutual learning and dynamic feature construction

Publications (1)

Publication Number Publication Date
CN115293030A true CN115293030A (en) 2022-11-04

Family

ID=83824123

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210847076.2A Pending CN115293030A (en) 2022-07-07 2022-07-07 Bearing residual service life prediction method based on deep mutual learning and dynamic feature construction

Country Status (1)

Country Link
CN (1) CN115293030A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118013244A (en) * 2024-04-07 2024-05-10 中核武汉核电运行技术股份有限公司 Bearing life prediction method and device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118013244A (en) * 2024-04-07 2024-05-10 中核武汉核电运行技术股份有限公司 Bearing life prediction method and device

Similar Documents

Publication Publication Date Title
Cheng et al. A convolutional neural network based degradation indicator construction and health prognosis using bidirectional long short-term memory network for rolling bearings
Zhang et al. A fault diagnosis method based on improved convolutional neural network for bearings under variable working conditions
Yang et al. A hybrid feature selection scheme for unsupervised learning and its application in bearing fault diagnosis
CN111562108A (en) Rolling bearing intelligent fault diagnosis method based on CNN and FCMC
Zhang et al. Early fault detection method of rolling bearing based on MCNN and GRU network with an attention mechanism
Gu et al. Partial discharge pattern recognition of power cable joints using extension method with fractal feature enhancement
CN106656357B (en) Power frequency communication channel state evaluation system and method
Wang et al. Construction of the efficient attention prototypical net based on the time–frequency characterization of vibration signals under noisy small sample
CN116226646A (en) Method, system, equipment and medium for predicting health state and residual life of bearing
Zhao et al. A novel deep fuzzy clustering neural network model and its application in rolling bearing fault recognition
CN114169091A (en) Method for establishing prediction model of residual life of engineering mechanical part and prediction method
Zhu et al. Res-HSA: Residual hybrid network with self-attention mechanism for RUL prediction of rotating machinery
CN114091525A (en) Rolling bearing degradation trend prediction method
Li et al. A 2-D long short-term memory fusion networks for bearing remaining useful life prediction
CN115293030A (en) Bearing residual service life prediction method based on deep mutual learning and dynamic feature construction
CN117473411A (en) Bearing life prediction method based on improved transducer model
CN117077327A (en) Bearing life prediction method and system based on digital twin
Fu et al. MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction
Pang et al. Discrete Cosine Transformation and Temporal Adjacent Convolutional Neural Network‐Based Remaining Useful Life Estimation of Bearings
Liu et al. Multi-Scale Fusion Attention Convolutional Neural Network for Fault Diagnosis of Aero-Engine Rolling Bearing
Bai et al. Fault diagnosis method research of mechanical equipment based on sensor correlation analysis and deep learning
Kong et al. Vibration fault analysis of hydropower units based on extreme learning machine optimized by improved sparrow search algorithm
CN117010442A (en) Equipment residual life prediction model training method, residual life prediction method and system
Li et al. High-accuracy gearbox health state recognition based on graph sparse random vector functional link network
CN115982621A (en) Rotary machine residual service life prediction method based on time convolution network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination