CN111539152A - Rolling bearing fault self-learning method based on two-stage twin convolutional neural network - Google Patents

Rolling bearing fault self-learning method based on two-stage twin convolutional neural network Download PDF

Info

Publication number
CN111539152A
CN111539152A CN202010066718.6A CN202010066718A CN111539152A CN 111539152 A CN111539152 A CN 111539152A CN 202010066718 A CN202010066718 A CN 202010066718A CN 111539152 A CN111539152 A CN 111539152A
Authority
CN
China
Prior art keywords
fault
network
training
self
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010066718.6A
Other languages
Chinese (zh)
Other versions
CN111539152B (en
Inventor
齐咏生
郭春雨
李永亭
刘利强
王林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inner Mongolia University of Technology
Original Assignee
Inner Mongolia University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inner Mongolia University of Technology filed Critical Inner Mongolia University of Technology
Priority to CN202010066718.6A priority Critical patent/CN111539152B/en
Publication of CN111539152A publication Critical patent/CN111539152A/en
Application granted granted Critical
Publication of CN111539152B publication Critical patent/CN111539152B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M13/00Testing of machine parts
    • G01M13/04Bearings
    • G01M13/045Acoustic or vibration analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T90/00Enabling technologies or technologies with a potential or indirect contribution to GHG emissions mitigation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Mathematical Physics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Acoustics & Sound (AREA)
  • Testing Of Devices, Machine Parts, Or Other Structures Thereof (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)

Abstract

The invention discloses a rolling bearing fault self-learning method based on a two-stage twin convolutional neural network, which uses incomplete data to perform two-stage modeling: the first stage implements fault type identification. The second stage realizes fault damage degree classification, performs short-time Fourier transform on the signals of the identified fault types to obtain a sliding window time-frequency diagram, and extracts the slight differences of the faults with different damage degrees; and (3) taking the time-frequency diagram as the input of the second-stage S-CNN2, and designing a classifier based on the target space distance to realize classification and self-learning of the same fault damage degree. The method is applied to the rolling fault data acquired by the fault experimental platform, and the result shows that the method not only can finish accurate division of fault types and damage grades, but also can realize self-learning of faults and self-growth of a fault library under the condition of incomplete data modeling, and the intelligence of the classification process is enhanced.

Description

Rolling bearing fault self-learning method based on two-stage twin convolutional neural network
Technical Field
The invention relates to an intelligent diagnosis method for rolling bearing faults, in particular to an intelligent diagnosis method for rolling bearing faults, which can realize accurate classification of bearing faults and self-learning of models and enhance the intelligence of a classification process when a traditional mode identification method is difficult to establish an effective diagnosis model aiming at the problem that a large amount of label-free data in the current industrial production.
Background
With the rapid development of modern industry, in order to meet the production requirements of the current society, domestic and foreign mechanical equipment develops rapidly in the directions of intellectualization, complication, automation, precision and high speed, so that the connection among all components is tighter, and in addition, the complex working environment of the equipment, the mechanical equipment is easy to break down, the operation and maintenance are difficult, and the faults of some key parts can cause the normal operation of the whole equipment, thereby causing serious property loss and casualties.
Rolling bearings, which are common elements of mechanical equipment, play an important role not only in industrial production but also in daily life, and are most likely to fail in mechanical equipment because they are used in operating environments of high-speed rotation, alternating load, and high temperature for a long time. According to statistics of relevant data, 40% of faults in the faults of the mechanical equipment are caused by the faults of the bearing, so that the rolling bearings are accurately identified and classified, major accidents can be effectively avoided, the maintenance cost is reduced, according to statistics, 25% -50% of maintenance cost and 75% of accident rate can be reduced by diagnosing and identifying the faults of the rolling bearings, the working potential of the bearing is furthest exerted, and the expenditure is saved. The traditional fault diagnosis method for the rolling bearing mainly comprises a wavelet analysis method, a support vector machine, a neural network and the like, and the bearing fault data obtained on site is usually incomplete and label-free. Along with the expansion of the application of the information acquisition system, the monitoring range and depth of the large-scale bearing state are continuously enhanced, and the generated data are in mass characteristics. However, the feature extraction process is a time-consuming and labor-intensive task and has a great influence on the final result. The traditional feature extraction and selection method has certain complexity and uncertainty, and the problems cause that a large amount of data in the field cannot be effectively utilized. And a deep network represented by a Convolutional Neural Network (CNN) provides an effective method capable of automatically extracting original data features, and can solve the problems of large data volume, difficulty in feature extraction and the like. The invention combines CNN and twin structure, provides a semi-supervised self-learning network of twin structure CNN (S-CNN) based on similarity measurement, for untrained new fault and new damage grade of the rolling bearing, in a target space, the S-CNN can quickly separate the rolling bearing from the known grade or fault and quickly aggregate with the same grade or fault, finally generate new fault or new damage grade, and solve the problem of fault self-learning. The method has good practical significance for solving the classification of a large amount of label-free fault data in the current industrial production.
Disclosure of Invention
Aiming at the problem that the fault data acquired on site is often incomplete and label-free, so that an effective diagnosis model is difficult to establish by the traditional mode identification method, the invention provides a rolling bearing fault self-learning method based on a two-stage twin convolutional Neural network (S-CNN), as shown in FIG. 1, the method is a general block diagram of the algorithm of the invention, and the general description of the method is as follows: firstly, combining a twin structure with similarity measurement with CNN to construct an S-CNN network structure; . Then, based on the constructed S-CNN network structure, establishing a first-level fault type identification network S-CNN 1: (1) removing part of noise by using the morphological enhancement pulse characteristics; (2) extracting the signal fault type common characteristics by applying S transformation, and constructing a time-frequency diagram; (3) inputting the time-frequency diagram sample into a first-stage S-CNN, training the time-frequency diagram sample to finally form a first-stage fault type identification network S-CNN1 (the trained network can realize identification and self-learning of fault types of the rolling bearing by utilizing the characteristics of convergence and separation of faults of the same type in a target space by the network); and finally, establishing a second-level fault damage degree classification network S-CNN 2: (1) amplifying differences of different damage degrees of the same type of faults by using short-time Fourier transform (STFT) with a sliding window to obtain a sliding time-frequency diagram sample; (2) inputting the obtained time-frequency pattern into a second-stage S-CNN, training the time-frequency pattern, and finally forming a second-stage fault damage degree classification network S-CNN2 (the trained network is a classifier based on target space distance, and can realize self-learning and self-lengthening of fault damage degrees).
The specific technical scheme and the implementation steps of the invention are as follows:
1. combining twin structure with CNN to construct S-CNN network structure
The first step of the present invention is to construct a network structure (S-CNN) in which a twin structure is combined with a Convolutional Neural Network (CNN), the structure of which is shown in fig. 10. The constructed S-CNN structure is a similarity measurement method in essence. As can be seen from FIG. 10, the input is two time-frequency graphs x1And x2At the time of model training, they have a known label Y (where Y is a binary label (0 or 1)). When the time-frequency diagram x is input1And x2When belonging to the same class, Y is 0; otherwise, Y is 1, and the label is used for network training. Then, Gw (x)1) And Gw (x)2) Are respectively x1And x2Corresponding outputs over two CNN networks, which will be x1And x2To two points in a low dimensional space. Where w is the shared parameter to be learned by the two CNN networks. Then, the outputs Gw (x) of the two networks are combined1) And Gw (x)2) And (3) performing operation to obtain a similarity measurement index Ew, wherein the index is called an energy function. The energy function Ew (x)1,x2) The following can be defined:
Ew(x1,x2)=||Gw(x1)-Gw(x2)|| (1)
the basic structure of the constructed S-CNN is obtained, and then different S-CNN networks can be trained by inputting different training samples, so that the S-CNN networks have different classification or identification functions. Specifically, in the second step, the input part of rolling bearing different fault type samples train the S-CNN1 network to become a network for identifying the fault type of the bearing and have a self-learning function; in the third step, the S-CNN2 network is trained by inputting samples of the same fault type and different fault damage grades of partial rolling bearings, so that the S-CNN2 network becomes a network for identifying the fault damage grades of the bearings and has a self-learning function. And finally, in the S-CNN network training process, the output of the whole S-CNN network is expanded into a target space mainly according to a method for training network parameters layer by Back Propagation (BP), and the final output value of the network is the position in the target space.
2. Establishing a first-level S-CNN1 fault type self-learning network
(a) Data preprocessing: assuming an unknown fault type X and a plurality of known fault types Xi(i is more than or equal to 2), all original vibration signals are subjected to mathematical morphology filtering, partial background noise is removed, data are divided according to Q sampling points in each group to be used as input samples, then each group is subjected to S transformation processing to obtain a time-frequency graph of each group of vibration data, the time-frequency graph correspondingly comprises time domain and frequency domain information, then the time-frequency graph is converted into an n × n matrix, 80% of all signal data are used as training set data, and 20% of all signal data are used as test set data.
(b) Parameter selection: selecting network parameters, wherein the two same CNN network parameters adopted by the first-stage S-CNN1 network are selected as follows: selecting 5 layers of convolution networks, a first layer of 16 convolution kernels, a second layer of 32 convolution kernels, a third layer of 64 convolution kernels, a fourth layer of 128 convolution kernels and a fifth layer of 256 convolution kernels, wherein the sizes of the convolution kernels are 5 multiplied by 5, selecting Adam by an optimization algorithm, selecting the Adam to have good robustness on super parameters (learning rate, regularization coefficients and the like), and setting the maximum training times to be 4000.
(c) Training process, after the network parameters are determined, taking the time-frequency diagram (n × n matrix) of the training set in the step (a) as the input of the S-CNN1, and calculating the corresponding Gw (x)1)、Gw(x2) And energy function Ew (x)1,x2) And utilizing the known label Y of the training set to the S-CNN network structureAnd (5) training. The training process mainly trains parameters of each layer of the network layer by layer according to Back Propagation (BP), and finally the trained network structure S-CNN1 is obtained.
The detailed training process is as follows: first, a loss function l is defined, whose size is dependent only on the inputs and parameters of the network via an "energy function Ew", which is defined as:
Figure BDA0002376185210000051
L(W,(Y,x1,x2)i)=(1-Y)LG(EW(x1,x2)i)+YLI(EW(x1,x2)i) (3)
LG(EW(x1,x2)i)=||Gw(x1)-Gw(x2)||2(4)
Figure BDA0002376185210000052
wherein (Y, x)1,x2)iRepresents the ith sample pair, (Y, x)1,x2)iComprising a pair of images and a known label Y, LGRepresents the part of the loss function when Y is 0 (true pair), LIRepresenting the part of the loss function when Y is 1 (false pair), P represents the number of training samples. Design such LGAnd LIIn order to reduce the energy of a true pair and increase the energy of a false pair, training layer by layer according to Back Propagation (BP) is carried out to minimize the energy of l, and when the energy of l is minimum, the training is finished, and the parameters of each layer of the network are trained.
(d) After the network is trained, a test set time-frequency diagram (n × n matrix) in the step (a) is used as the input of the S-CNN1 trained in the step (c), the time-frequency diagram of each fault vibration signal can obtain a coordinate value (x, y) mapped to a target space through the last layer of the S-CNN1, and the same type of fault can be known according to the principle of a twin structureThe barriers will be closer and closer in the target space, while different types of faults will be further and further. After 4000 times of training, finally, the two types of faults can be converged into two clusters which are not overlapped in the target space, and the learning process of the network on different characteristics is completed. Calculating the mass center of each type of fault in the training set in the target space set, and recording the mass center of the ith type in the target space as T _ rainCi
(e) Minimum clustering radius (T _ M) of each class in target spacemin) Is a very important parameter, and directly influences the classification and the quality of the fault self-growth result. Determining the radius T _ M from a scatter plot Based on a Density-Based Spatial Clustering of applications with noise (DBSCAN)minThe value of (c).
(f) And mapping the data of the test set to a target space through S-CNN1 to obtain the coordinates of the test set in the target space, and calculating the centroid of the test set as T _ testC. T _ testC in test set and T _ trainC in training set are solvediEuclidean distance between T _ testC and I-th failed T _ trainCiIs less than T _ MminJudging that the unknown fault in the test set belongs to the ith fault type in the training set; when T _ testC and all T _ trainCs in the training setiIs not less than T _ MminAnd judging that the unknown fault in the test set belongs to a new fault type, thereby realizing the classification and self-learning process of the fault type.
3 establishing a second-stage S-CNN2 fault damage level self-learning network
(a) Data preprocessing: and restoring the samples of the identified fault types (namely the data identified by the S-CNN1 network) into original vibration signal data, and then carrying out fault damage level judgment and self-learning. Firstly, carrying out overlapping segmentation pretreatment on the data, and dividing the data into input samples according to Q sampling points of each segment; and then, carrying out STFT (space time transformation) processing on each section to obtain a time-frequency graph containing time domain and frequency domain information corresponding to each group of vibration data, and then compressing the time-frequency graph to convert the time-frequency graph into an n multiplied by n matrix.
(b) Parameter selection: selecting network parameters, wherein the two same CNN network parameters adopted by the second-level S-CNN2 network are selected as follows: the method comprises the steps of selecting 3 layers of convolutional networks from the CNN, selecting 64 convolutional kernels on the first layer, 128 convolutional kernels on the second layer and 256 convolutional kernels on the third layer, wherein the convolutional kernels are 3 x 3, selecting Adam Optimizer by an optimization algorithm, and setting the maximum training frequency to 20000 times.
(c) Training process, after the network parameters are determined, taking the time-frequency diagram (n × n matrix) of the training set in the step (a) as the input of the S-CNN2, and calculating the corresponding Gw (x)1)、Gw(x2) And energy function Ew (x)1,x2) And training the S-CNN network structure by using the known label Y of the training set. The training process mainly trains parameters of each layer of the network layer by layer according to Back Propagation (BP), and finally the trained network structure S-CNN2 is obtained. The whole training process is similar to the S-CNN1 network training process and is not described in detail.
(d) Determining a network structure, then taking a matrix of a test set n × n in the step (1) as input of S-CNN2, obtaining a coordinate value (x, y) mapped to a target space by a time-frequency diagram of each fault vibration signal through the last layer of S-CNN2, training 20000 times, calculating the mass center of each fault degree of the training set in the target space set, and recording the mass center of the ith class in the target space as L _ train Ci
(e) Similar to the previous network, determining the radius second-level network L _ M according to the scatter diagram of the DBSCANminThe value of (c).
(f) And mapping the data of the test set to a target space through S-CNN2 to obtain the coordinates of the test set in the target space, and calculating the centroid of the test set as L _ testC. L _ testC in test set and L _ trainC in training setiEuclidean distance between the two classes, when L _ testC and i-th class damage degree L _ trainCiIs less than L _ MminJudging that the unknown fault in the test set belongs to the i-th damage degree; when the distance between the L _ testC and all the damage degrees in the training set is not less than the L _ MminAnd judging that the unknown fault in the test set belongs to the new type of damage degree, thereby realizing the classification and self-learning process of the fault damage degree.
Advantageous effects
The general algorithm flow chart of the invention is shown in fig. 2. The invention provides a rolling bearing fault intelligent learning method based on two-stage S-CNN, which provides a better solution for solving the problem of data self-learning in the current industrial production and has certain practical value.
Drawings
FIG. 1 is a general block diagram of the algorithm.
Figure 2 is a general algorithm flow diagram.
Fig. 3 morphological filtering process.
FIG. 4 is a S-transform time-frequency spectrum of an original signal.
Fig. 5 is a time-frequency diagram obtained by performing S transform after morphological filtering of the original signal.
Fig. 6S-CNN 1 shows the partial results of the results of each failure mapped to the target space.
FIG. 7 is a time-frequency diagram obtained after STFT is performed on the original data.
8S-CNN 2 each fault maps to a partial result of the target space.
Fig. 9S-CNN 2 illustrates partial results of mapping of various failures to the target space.
FIG. 10 is a schematic diagram of a twin structure of the similarity metric.
Detailed Description
The invention is described in detail below with reference to the figures and examples.
In order to show the effectiveness of the method, a bearing fault experiment platform is adopted to collect data for algorithmic verification, and the experiment aims at a two-horsepower motor bearing, and the model is 6205-2RS JEM SKF. Through the electric spark machining technology, single-point faults are respectively arranged on a rolling body, an inner ring and an outer ring of the bearing, the fault damage grades comprise 0.007inch, 0.014inch and 0.021inch, a vibration acceleration signal of the fault bearing is collected through an acceleration sensor arranged on a bearing seat at the driving end of the motor, the sampling frequency is 12kHz, and experimental data are shown in Table 1.
TABLE 1 bearing failure data
Figure BDA0002376185210000091
1. Fault type classification model self-learning
First, level _1, level _2 and level _3 are defined to represent the failure of the rolling bearing with damage sizes of 0.007in, 0.014in and 0.021in, respectively. Capital letters I, O and B are used to represent fault types of the inner ring, the outer ring and the balls respectively, if I _ level _1 represents the fault of the bearing of the inner ring with the damage degree of 0.007inch, N represents the normal state of the bearing, and subsequent expressions are similar to the above and are not repeated. When the fault type self-learning is verified, a data set is constructed as follows: and (3) incomplete data training is used, two faults are arbitrarily selected from each group of experiments as known types, different experiments are designed in each group, one fault is optionally selected from each experiment as an unknown fault, and whether the fault belongs to a known fault or a new type of unknown fault is determined through a judgment result. Table 2 shows the selected combinations of fault types for each group and each experiment.
Table 2 fault type classification self-growth experimental grouping
Figure BDA0002376185210000092
Figure BDA0002376185210000101
As shown in fig. 3, the filtering result of the morphological on operation is the vibration signal, the upper dotted line is the original signal, and the lower solid line is the filtered signal. The figure can find that the shape opening operation is the lower envelope of the signal, and the shape filter can effectively enhance the pulse characteristic of the signal and inhibit partial noise. As shown in fig. 4, a time-frequency diagram obtained by S-transforming 3 kinds of original fault data is shown. As can be seen from fig. 4, there is similarity between the spectrograms of the same fault type signals after S-conversion, but it can be found from the graphs that there is similarity between the pulse waveforms in the time-frequency graphs of the inner circle (fig. 4(d)) and the outer circle (fig. 4(f)), and it is obvious that certain misjudgment is caused for the following classification identification. To solve the problem, morphological filtering is added before S transformation to remove interference of partial noise. As can be seen from fig. 5, after the morphological filtering, the S transform is performed to obtain a spectrogram, the same fault has stronger similarity, and different faults have larger differences. Therefore, it is necessary to add morphological filtering preprocessing before S transform.
The analysis is performed by taking the group 2 experiment as an example, the training sets in the group 2 are B _ level _1 and O _ level _1, and the classification result in the target space is shown in fig. 6. FIG. 6a shows the output of the last layer of network with test sets B _ level _1 (experiment 7) and O _ level _1 (experiment 8), where the upper right corner in the figure is the position of O _ level _ 1in the target space, and the lower left corner is the position of B _ level _1, and it can be seen that S-CNN1 has the characteristic of converging similar faults and separating different types of faults. In fig. 6a, all the frequency spectrum graphs obtained by applying the above-mentioned preprocessing method to the fault data are frequency spectrum graphs, and for easier identification, the time frequency graph of each fault is replaced by a number, where the number "2" represents B _ level _1, the number "4" represents O _ level _1, and fig. 6B is obtained by replacing the number in fig. 6 a. FIG. 6c shows the positions of the centroids of the training sets B _ level _1 and O _ level _1 at the target spatial coordinates.
In order to enable each fault to have a reference object in the target space, the convergence and separation characteristics in the target space are better embodied. Meanwhile, the test sets B _ level _1, O _ level _1, and B _ level _3 (i.e., experiment 7, experiment 8, and experiment 9) are mapped to the target space, and the result is shown in fig. 6d, where the numeral "5" represents B _ level _ 3. In the figure, it can be obviously seen that "2" and "5" converge in the target space, which indicates that B _ level _1 and B _ level _3 are the same type of fault, and have stronger similarity in the time-frequency diagram, and the two samples are fused to the lower left corner of the target space. Meanwhile, mapping the test sets B _ level _1, O _ level _1, and O _ level _3 (i.e., experiment 7, experiment 8, and experiment 12) to the target space, the result is shown in fig. 8e, where the numeral "5" represents O _ level _ 3. Similar to FIG. 8d, "4" and "5" merge into the upper right corner of the target space, since O _ level _1 and O _ level _3 are the same type of fault. By the above example, it can be shown that the S-CNN1 has strong identification capability for the same type of failure with different damage degrees which are not learned.
Meanwhile, the test sets B _ level _1, O _ level _1, and I _ level _3 (i.e., experiment 7, experiment 8, and experiment 11) are output in the target space, and the result is shown in fig. 6f, where the numeral "5" represents I _ level _ 3. It can be seen that the graphs collectively form 3 cluster sets, that is, since B _ level _1, O _ level _1 and I _ level _3 have no similarity in the time-frequency graph, they respectively form a cluster after being mapped to the target space. It can be seen from the figure that the S-CNN1 has good identification capability for different types of unknown faults which are not learned.
Analyzing the mapping result of the training set in the target space, and determining the minimum clustering radius (T _ M) according to the scatter diagram of the DBSCANmin) The value of (c). By calculating T _ Mmin=1.5。
TABLE 3 distance of centroid coordinates in target space and classification results
(a) The test set is the classification result of B _ level _1 and I _ level _2
Figure BDA0002376185210000121
(b) The test set is the classification result of B _ level _1 and O _ level _1
Figure BDA0002376185210000122
(c) The test set is the classification result of I _ level _3 and O _ level _1
Figure BDA0002376185210000123
And calculating Euclidean distances (T _ D) between the training set and each centroid in the test set. The coordinates and distances of each centroid in the training set and the test set are shown in table 3. According to the discriminant rule (if the distance T _ D between the unknown fault in the test set and the i-th type fault of the known fault type in the training setit<T_MminUnknown fault belongs to the known fault) to identify the fault type for each test sample. The results of all experiments are shown in Table 3, where "NEW" represents a NEW classType i fault. As can be seen from Table 3, the classification accuracy of each experiment is very high, which shows that the method can realize self-learning of fault types and self-growth of fault libraries under the condition of incomplete data modeling, and the effectiveness of the proposed algorithm is verified.
2. Fault damage degree classification model self-learning
The second-level network is used for searching the differences of the same type of faults with different damage degrees, and the S transformation can find the similarity of the same type of faults with different damage degrees in the time-frequency domain more easily according to the work, so that different preprocessing strategies are adopted in the first-level network. STFT is to observe the signal through a sliding window of fixed size, which is more sensitive to small changes in the signal and makes it easier to detect the differences between different signals.
Table 4 fault damage degree classification self-growth experimental grouping
Figure BDA0002376185210000131
The vibration data is subjected to overlapping segmentation preprocessing, and then each segment of data is subjected to STFT to obtain a time-frequency diagram as shown in FIG. 7. As can be seen from the graph, the time-frequency graphs of the same type of faults with different damage degrees have obvious differences. Therefore, it is reasonable to adopt this preprocessing method for the second-level network. Next, 6 sets of experiments were constructed as shown in table 4. Groups 4-6 are classification and learning processes for the case where normal signals and a fault damage level signal are known, and groups 7-9 are further classification and learning processes for the case where two fault damage level signals are known.
(1) A process of identifying the extent of damage is known: the training sets in group 6 are N and O _ level _1, and their spatial distribution in the target is shown in fig. 8. FIG. 8a shows the output of the last layer network of the training set N and O _ level _1, where the number "1" represents N, the number "4" represents O _ level _1, N converges at the lower left corner of the graph at the target spatial coordinate value, and O _ level _1 converges at the upper right corner of the graph.
In order to facilitate observation of the distribution of each fault in the target space, the test sets N and N are simultaneously combinedThe mapping of O _ level _1 (i.e., experiment 27 and experiment 28) to the target space results in FIG. 8 b. The test set samples are also more centrally distributed in two regions of the target space, almost coinciding with where the samples of the training set are located. It is shown that S-CNN2 can be used to identify known damage levels. Meanwhile, mapping the test sets N, O _ level _1 and O _ level _2 (i.e. experiment 27, experiment 28 and experiment 29) to the target space results are shown in FIG. 8 c. Because O _ level _1 and O _ level _2 are the same fault type and have similarity in time frequency spectrum, the fault damage level signal O _ level _2 of the test set is closer to O _ level _1, but the two types of damage levels can still be clearly found or separated into two clusters. FIG. 8d shows the output result obtained by mapping the test sets N, O _ level _1 and O _ level _2 (i.e. experiment 27, experiment 28, and experiment 30) to the target space at the same time, where O _ level _3 (indicated by "5" in the figure) is closer to O _ level _ 1in the target space but effectively separated into two clusters because O _ level _1 and O _ level _3 are the same fault type signals. Analyzing the training set in a target space, and determining the minimum clustering radius (L _ M) according to the scatter diagram of the DBSCANmin) The value of (c). By calculating L _ Mmin0.1. The Euclidean distance (L _ D) between each centroid of the training set and the test set is calculated. According to the discriminant rule (if the distance L _ D between the unknown fault degree in the test set and the ith fault degree of the known fault degree in the training setit<L_Mmin1Unknown fault level belongs to the known fault level) to identify the fault damage level of each test sample. All experimental results are listed in table 5, where "NEW" represents a NEW type of failure; "L-1" is represented as a first type of lesion grade. As can be seen from table 5, the classification accuracy of each experiment was high.
TABLE 5 distance of centroid coordinates in target space and classification results
(a) Training set N and B _ level _1 classification result
Figure BDA0002376185210000151
(b) Training set N and I _ level _1 classification result
Figure BDA0002376185210000152
(c) Training set N and O _ level _1 classification result
Figure BDA0002376185210000153
(2) When two fault damage grades are known, self-learning and grade self-growth of a third fault damage degree are realized: the training sets in group 7 are B _ level _1 and B _ level _2, and the spatial distribution of the training sets in the target is shown in FIG. 9. FIG. 9a shows the outputs of the last layer networks of training sets B _ level _1 and B _ level _2, where B _ level _1 (indicated by "2" in the figure) converges at the upper left corner of the figure at the target spatial coordinate value and B _ level _2 (indicated by "3" in the figure) converges at the lower right corner of the figure.
Meanwhile, mapping the test sets B _ level _1 and B _ level _2 (i.e. experiment 31 and experiment 32) to the target space, and the result is shown in fig. 9B. Fig. 9c shows that B _ level _3 is represented by "5" in the target space mapping result graph by using the test sets B _ level _1, B _ level _2, and B _ level _3 (experiment 31, experiment 32, and experiment 33), and it can be clearly seen that three damage levels are distributed in the target space as three cluster sets, which are easily divided into three types.
Analyzing the training set in a target space, and determining the minimum clustering radius (L _ M) according to the scatter diagram of the DBSCANmin2) The value of (c). By calculating L _ Mmin21.5. According to similar discrimination rules, classification and self-learning of 3 fault damage degrees can be realized. The results of all experiments are shown in Table 6, where "L-2" represents the second type of injury rating. As can be seen from table 6, the classification accuracy of each experiment was high.
The above experiments are combined to show that the method can realize the self-learning of fault damage levels, and indirectly show that the method can continuously carry out the self-growth of classification when the damage degree is further increased, so that certain learning intelligence is embodied.
TABLE 6 distance of centroid coordinates in target space and classification results
(a) Training the classification result of B _ level _1 and B _ level _2
Figure BDA0002376185210000161
(b) Training set I _ level _1 and I _ level _2 classification results
Figure BDA0002376185210000162
(c) The classification results of the training sets O _ level _1 and O _ level _2
Figure BDA0002376185210000163
Figure BDA0002376185210000171

Claims (4)

1. A rolling bearing fault self-learning method based on a two-stage twin convolutional neural network is characterized by comprising the following steps: firstly, combining a twin structure with similarity measurement with CNN to construct an S-CNN network structure; then, based on the constructed S-CNN network structure, establishing a first-level fault type identification network S-CNN 1: (1) removing part of noise by using the morphological enhancement pulse characteristics; (2) extracting the signal fault type common characteristics by applying S transformation, and constructing a time-frequency diagram; (3) inputting the time-frequency diagram sample into a first-stage S-CNN, training the time-frequency diagram sample to finally form a first-stage fault type identification network S-CNN1, wherein the trained network realizes identification and self-learning of the fault type of the rolling bearing by utilizing the characteristics of convergence and separation of the same type of faults and different types of faults in a target space;
and finally, establishing a second-stage fault damage degree classification network S-CNN 2: (1) amplifying differences of different damage degrees of the same type of faults by using short-time Fourier transform (STFT) with a sliding window to obtain a sliding time-frequency diagram sample; (2) inputting the obtained time-frequency pattern into a second-stage S-CNN, training the time-frequency pattern to finally form a second-stage fault damage degree classification network S-CNN2, wherein the trained network is a classifier based on target space distance, and self-learning and self-increasing of fault damage degree are realized.
2. The self-learning method for the faults of the rolling bearing based on the two-stage twin convolutional neural network as claimed in claim 1, wherein the self-learning method comprises the following steps: the S-CNN structure is essentially a similarity measurement method, and two time-frequency graphs x are input1And x2At the time of model training, they have a known label Y, where Y is a binary label; when the time-frequency diagram x is input1And x2When belonging to the same class, Y is 0; otherwise, Y is 1, and the label is used for network training; then, Gw (x)1) And Gw (x)2) Are respectively x1And x2Through the corresponding output of the two CNN networks, the two CNN networks will x1And x2Mapping to two points in a low dimensional space; wherein, w is a shared parameter to be learned by two CNN networks; then, the outputs Gw (x) of the two networks are combined1) And Gw (x)2) Calculating to obtain a similarity measurement index Ew, and calling the index as an energy function; the energy function Ew (x)1,x2) The definition is as follows:
Ew(x1,x2)=||Gw(x1)-Gw(x2)||(1)
the above is the constructed S-CNN basic structure, and then different S-CNN networks are trained by inputting different training samples.
3. The self-learning method for the faults of the rolling bearing based on the two-stage twin convolutional neural network as claimed in claim 1, wherein the self-learning method comprises the following steps: the specific process of establishing the first stage S-CNN1 fault type self-learning network is as follows,
(a) data preprocessing: assuming that there is one unknown fault type X and several known fault types XiIf i is more than or equal to 2, performing mathematical morphology filtering on all original vibration signals, removing part of background noise, and dividing data according to each group of Q sampling points to be used as an input sample;then, each group is subjected to S transformation processing to obtain a time-frequency graph corresponding to each group of vibration data and containing time domain and frequency domain information, and then the time-frequency graph is converted into an n × n matrix, wherein 80% of all signal data are taken as training set data, and 20% of all signal data are taken as test set data;
(b) parameter selection: selecting network parameters, wherein the two same CNN network parameters adopted by the first-stage S-CNN1 network are selected as follows: selecting 5 layers of convolution networks, namely a first layer of 16 convolution kernels, a second layer of 32 convolution kernels, a third layer of 64 convolution kernels, a fourth layer of 128 convolution kernels and a fifth layer of 256 convolution kernels, wherein the sizes of the convolution kernels are 5 multiplied by 5, selecting Adam by an optimization algorithm, selecting the hyper-parameters by the Adam to have good robustness, and training the maximum times to be 4000 times;
(c) in the training process, after the network parameters are determined, a time-frequency diagram, namely an n × n matrix, of the training set in the step (a) is used as the input of the S-CNN1, and the corresponding Gw (x) is calculated1)、Gw(x2) And an energy function Ew (x)1,x2) Training the S-CNN network structure by using the known label Y of the training set; the training process is mainly based on parameters of each layer of a backward propagation layer-by-layer training network, and a trained network structure S-CNN1 is finally obtained;
(d) testing and self-learning process, namely after network training is finished, taking a test set time-frequency graph (n × n matrix) in the step (a) as the input of the S-CNN1 trained in the step (c), obtaining a coordinate value (x, y) mapped to a target space by the time-frequency graph of each fault vibration signal through the last layer of S-CNN1, knowing that faults of the same type are closer and further in the target space and faults of different types are further and further away according to the principle of a twin structure, after 4000 times of training, finally converging the two types of faults into two clusters which are not coincident respectively in the target space to finish the learning process of different characteristics by the network, calculating the mass center of each type of faults in the target space set of the training set, and marking the mass center of the ith type in the target space as T _ train Ci
(e) Determining radius T _ M from a scatter plot with noise based on a density clustering methodminA value of (d);
(f) mapping the data of the test set to a target space through S-CNN1 to obtain the coordinates of the test set in the target spaceCalculating the centroid of the test set as T _ testC; solving T _ testC in test set and T _ trainC in training setiEuclidean distance between T _ testC and I-th failed T _ trainCiIs less than T _ MminJudging that the unknown fault in the test set belongs to the ith fault type in the training set; when T _ testC and all T _ trainCs in the training setiIs not less than T _ MminAnd judging that the unknown fault in the test set belongs to a new fault type, thereby realizing the classification and self-learning process of the fault type.
4. The self-learning method for the faults of the rolling bearing based on the two-stage twin convolutional neural network as claimed in claim 1, wherein the self-learning method comprises the following steps: the specific process of establishing the second stage S-CNN2 fault damage level self-learning network is as follows,
(a) data preprocessing: restoring the identified fault type, namely the sample of the data identified by the S-CNN1 network into original vibration signal data, and then carrying out fault damage grade discrimination and self-learning; firstly, carrying out overlapping segmentation pretreatment on the data, and dividing the data into input samples according to Q sampling points of each segment; then, each section is subjected to STFT (space time Fourier transform) conversion to obtain a time-frequency graph which corresponds to each group of vibration data and contains time domain and frequency domain information, and then the time-frequency graph is compressed and converted into an n multiplied by n matrix;
(b) parameter selection: selecting network parameters, wherein the two same CNN network parameters adopted by the second-level S-CNN2 network are selected as follows: selecting 3 layers of convolution networks from the CNN, wherein the first layer comprises 64 convolution kernels, the second layer comprises 128 convolution kernels, and the third layer comprises 256 convolution kernels, the convolution kernels are 3 x 3, the optimization algorithm selects an Adam Optimizer, and the maximum training frequency is 20000 times;
(c) in the training process, after the network parameters are determined, the time-frequency graph n × n matrix of the training set in the step (a) is used as the input of the S-CNN2, and the corresponding Gw (x) is calculated1)、Gw(x2) And an energy function Ew (x)1,x2) Training the S-CNN network structure by using the known label Y of the training set; wherein the training process is based on parameters of each layer of the backward propagation layer-by-layer training network to finally obtain the trainingA refined network structure S-CNN 2;
(d) the testing and self-learning process comprises the steps of determining a network structure, using a matrix of a test set n × n as input of S-CNN2, obtaining a coordinate value (x, y) mapped to a target space through the last layer of S-CNN2 of a time-frequency graph of each fault vibration signal, training 20000 times, calculating the mass center of each fault degree of the training set in the target space set, and recording the mass center of the ith class in the target space as L _ train Ci
(e) Determining radius second-level network L _ M according to scatter diagram of DBSCANminA value of (d);
(f) mapping the test set data to a target space through S-CNN2 to obtain the coordinates of the test set in the target space, and calculating the centroid of the test set as L _ testC; solving L _ testC in test set and L _ train C in training setiEuclidean distance between the two classes, when L _ testC and i-th class damage degree L _ trainCiIs less than L _ MminJudging that the unknown fault in the test set belongs to the i-th damage degree; when the distance between the L _ testC and all the damage degrees in the training set is not less than the L _ MminAnd judging that the unknown faults in the test set belong to the new type of damage degree, thereby realizing the classification and self-learning process of the fault damage degree.
CN202010066718.6A 2020-01-20 2020-01-20 Rolling bearing fault self-learning method based on two-stage twin convolutional neural network Active CN111539152B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010066718.6A CN111539152B (en) 2020-01-20 2020-01-20 Rolling bearing fault self-learning method based on two-stage twin convolutional neural network

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010066718.6A CN111539152B (en) 2020-01-20 2020-01-20 Rolling bearing fault self-learning method based on two-stage twin convolutional neural network

Publications (2)

Publication Number Publication Date
CN111539152A true CN111539152A (en) 2020-08-14
CN111539152B CN111539152B (en) 2022-08-26

Family

ID=71976663

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010066718.6A Active CN111539152B (en) 2020-01-20 2020-01-20 Rolling bearing fault self-learning method based on two-stage twin convolutional neural network

Country Status (1)

Country Link
CN (1) CN111539152B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112115999A (en) * 2020-09-15 2020-12-22 燕山大学 Wind turbine generator fault diagnosis method of space-time multi-scale neural network
CN112881018A (en) * 2021-01-07 2021-06-01 西北工业大学 Intelligent fault diagnosis method of aeroengine control system sensor based on improved mode gradient spectral entropy
CN112881017A (en) * 2021-01-07 2021-06-01 西北工业大学 Intelligent fault diagnosis method for aeroengine control system sensor based on mode gradient spectral entropy
CN113050602A (en) * 2021-03-26 2021-06-29 杭州电子科技大学 Industrial process fault method based on robust semi-supervised discriminant analysis
CN113138080A (en) * 2021-04-22 2021-07-20 东北大学 Rolling bearing intelligent fault diagnosis method based on vibration twinning and extreme learning
CN113405799A (en) * 2021-05-20 2021-09-17 新疆大学 Bearing early fault detection method based on health state index construction and fault early warning limit self-learning
CN114157552A (en) * 2021-10-29 2022-03-08 国网河南省电力公司漯河供电公司 Distribution network fault detection method based on twin timing diagram network
WO2024045555A1 (en) * 2022-08-30 2024-03-07 山东建筑大学 Fault diagnosis method and system based on standard self-learning data enhancement
CN117997690A (en) * 2024-04-03 2024-05-07 厦门大学 Class comparison learning type underwater sound signal modulation recognition system and recognition method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106874957A (en) * 2017-02-27 2017-06-20 苏州大学 A kind of Fault Diagnosis of Roller Bearings
CN107421741A (en) * 2017-08-25 2017-12-01 南京信息工程大学 A kind of Fault Diagnosis of Roller Bearings based on convolutional neural networks
CN107957551A (en) * 2017-12-12 2018-04-24 南京信息工程大学 Stacking noise reduction own coding Method of Motor Fault Diagnosis based on vibration and current signal
CN109632309A (en) * 2019-01-17 2019-04-16 燕山大学 Based on the rolling bearing fault intelligent diagnosing method for improving S-transformation and deep learning
CN109765053A (en) * 2019-01-22 2019-05-17 中国人民解放军海军工程大学 Utilize the Fault Diagnosis of Roller Bearings of convolutional neural networks and kurtosis index
CN110132598A (en) * 2019-05-13 2019-08-16 中国矿业大学 Slewing rolling bearing fault noise diagnostics algorithm
CN110490218A (en) * 2019-06-10 2019-11-22 内蒙古工业大学 A kind of rolling bearing fault self-learning method based on two-stage DBN

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106874957A (en) * 2017-02-27 2017-06-20 苏州大学 A kind of Fault Diagnosis of Roller Bearings
CN107421741A (en) * 2017-08-25 2017-12-01 南京信息工程大学 A kind of Fault Diagnosis of Roller Bearings based on convolutional neural networks
CN107957551A (en) * 2017-12-12 2018-04-24 南京信息工程大学 Stacking noise reduction own coding Method of Motor Fault Diagnosis based on vibration and current signal
CN109632309A (en) * 2019-01-17 2019-04-16 燕山大学 Based on the rolling bearing fault intelligent diagnosing method for improving S-transformation and deep learning
CN109765053A (en) * 2019-01-22 2019-05-17 中国人民解放军海军工程大学 Utilize the Fault Diagnosis of Roller Bearings of convolutional neural networks and kurtosis index
CN110132598A (en) * 2019-05-13 2019-08-16 中国矿业大学 Slewing rolling bearing fault noise diagnostics algorithm
CN110490218A (en) * 2019-06-10 2019-11-22 内蒙古工业大学 A kind of rolling bearing fault self-learning method based on two-stage DBN

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
BING LI等: "Feature extraction for rolling element bearing fault diagnosis utilizing generalized S transform and two-dimensional non-negative matrix factorization", 《JOURNAL OF SOUND AND VIBRATION》 *
CHEN LU等: "Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification", 《ADVANCED ENGINEERING INFORMATICS》 *
师芳: "基于两级DBN的滚动轴承故障自学习方法", 《中国优秀硕士学位论文全文数据库 工程科技Ⅱ辑》 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112115999A (en) * 2020-09-15 2020-12-22 燕山大学 Wind turbine generator fault diagnosis method of space-time multi-scale neural network
CN112881018A (en) * 2021-01-07 2021-06-01 西北工业大学 Intelligent fault diagnosis method of aeroengine control system sensor based on improved mode gradient spectral entropy
CN112881017A (en) * 2021-01-07 2021-06-01 西北工业大学 Intelligent fault diagnosis method for aeroengine control system sensor based on mode gradient spectral entropy
CN113050602A (en) * 2021-03-26 2021-06-29 杭州电子科技大学 Industrial process fault method based on robust semi-supervised discriminant analysis
CN113050602B (en) * 2021-03-26 2022-08-09 杭州电子科技大学 Industrial process fault classification method based on robust semi-supervised discriminant analysis
CN113138080A (en) * 2021-04-22 2021-07-20 东北大学 Rolling bearing intelligent fault diagnosis method based on vibration twinning and extreme learning
CN113405799A (en) * 2021-05-20 2021-09-17 新疆大学 Bearing early fault detection method based on health state index construction and fault early warning limit self-learning
CN114157552A (en) * 2021-10-29 2022-03-08 国网河南省电力公司漯河供电公司 Distribution network fault detection method based on twin timing diagram network
CN114157552B (en) * 2021-10-29 2024-04-05 国网河南省电力公司漯河供电公司 Distribution network fault detection method based on twin time sequence diagram network
WO2024045555A1 (en) * 2022-08-30 2024-03-07 山东建筑大学 Fault diagnosis method and system based on standard self-learning data enhancement
CN117997690A (en) * 2024-04-03 2024-05-07 厦门大学 Class comparison learning type underwater sound signal modulation recognition system and recognition method

Also Published As

Publication number Publication date
CN111539152B (en) 2022-08-26

Similar Documents

Publication Publication Date Title
CN111539152B (en) Rolling bearing fault self-learning method based on two-stage twin convolutional neural network
AU2020103923A4 (en) Fault diagnosis method and system for gear bearing based on multi-source information fusion
CN110849626B (en) Self-adaptive sparse compression self-coding rolling bearing fault diagnosis system
CN110070060B (en) Fault diagnosis method for bearing equipment
CN111562108A (en) Rolling bearing intelligent fault diagnosis method based on CNN and FCMC
CN112257530B (en) Rolling bearing fault diagnosis method based on blind signal separation and support vector machine
CN111222458A (en) Rolling bearing fault diagnosis method based on ensemble empirical mode decomposition and convolutional neural network
CN110647830B (en) Bearing fault diagnosis method based on convolutional neural network and Gaussian mixture model
CN114358123B (en) Generalized open set fault diagnosis method based on deep countermeasure migration network
CN111753891B (en) Rolling bearing fault diagnosis method based on unsupervised feature learning
Zhang et al. Multi-model ensemble deep learning method for intelligent fault diagnosis with high-dimensional samples
CN112557826A (en) Ship electric power system fault diagnosis method
CN114429152A (en) Rolling bearing fault diagnosis method based on dynamic index antagonism self-adaption
CN114169377A (en) G-MSCNN-based fault diagnosis method for rolling bearing in noisy environment
CN114118138A (en) Bearing composite fault diagnosis method based on multi-label field self-adaptive model
CN114462480B (en) Multi-source sensor rolling mill fault diagnosis method based on unbalanced data set
CN112101445B (en) Continuous casting billet subcutaneous slag inclusion defect real-time forecasting method based on supervision neural network
CN112766182A (en) Method for identifying wear state of broaching tool
Liao et al. Research on a rolling bearing fault detection method with wavelet convolution deep transfer learning
CN114548199A (en) Multi-sensor data fusion method based on deep migration network
CN115859077A (en) Multi-feature fusion motor small sample fault diagnosis method under variable working conditions
CN114997211A (en) Cross-working-condition fault diagnosis method based on improved countermeasure network and attention mechanism
CN115587290A (en) Aero-engine fault diagnosis method based on variational self-coding generation countermeasure network
Zhang et al. Multi-scale and multi-pooling sparse filtering: a simple and effective representation learning method for intelligent fault diagnosis
CN111783941B (en) Mechanical equipment diagnosis classification method based on probability confidence convolutional neural network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant