CN105183659A - Software system behavior anomaly detection method based on multi-level mode predication - Google Patents

Software system behavior anomaly detection method based on multi-level mode predication Download PDF

Info

Publication number
CN105183659A
CN105183659A CN201510674007.6A CN201510674007A CN105183659A CN 105183659 A CN105183659 A CN 105183659A CN 201510674007 A CN201510674007 A CN 201510674007A CN 105183659 A CN105183659 A CN 105183659A
Authority
CN
China
Prior art keywords
window
model
transition probability
probability model
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510674007.6A
Other languages
Chinese (zh)
Other versions
CN105183659B (en
Inventor
陈德来
沈琪骏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Tongron Information Technology Co Ltd
Original Assignee
Shanghai Tongron Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Tongron Information Technology Co Ltd filed Critical Shanghai Tongron Information Technology Co Ltd
Priority to CN201510674007.6A priority Critical patent/CN105183659B/en
Publication of CN105183659A publication Critical patent/CN105183659A/en
Application granted granted Critical
Publication of CN105183659B publication Critical patent/CN105183659B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention provides a software system behavior anomaly detection method based on multi-level mode predication. According to the method, through establishment of multi-level behavior prediction models, including a window state transition probability model and a behavior mode transition probability model, probabilistic modeling is conducted on the changing mode of system monitoring indexes, and anomaly detection is performed according to the principle that a small probability event is judged as a system behavior anomaly. The method has the advantages that the prediction models are utilized for predicting the state transition probability and comparing the predicted result with an actual system state, thereby judging whether the current system is in a small probability system state, namely a behavior anomaly mode, or not; the method can be applied to occasions with higher real-time requirements, and the model update of an algorithm can be performed in a real-time manner with data acquisition, so that the adaptability of the algorithm to window behavior anomaly detection problems can be further improved.

Description

Based on the software systems abnormal behavior detection method of multilevel mode prediction
Technical field
The present invention relates to computer system abnormality detection, particularly, relate to the software systems abnormal behavior detection method based on multilevel mode prediction.
Background technology
Along with the development of current infotech, modem computer systems all becomes to become increasingly complex in self structure and design attributes or the using forestland of system.Particularly universal and the tremendous lifting of computer process ability and the constantly perfect of Intel Virtualization Technology of High speed network in recent years, cloud computing concept is day by day burning hot, becomes current very important a kind of computer system use-pattern.How to ensure that cloud platform stable is run to become to become more and more important, and the system anomaly detection of robotization, alarm and even prediction are the bases of safeguarding the normal operation of cloud platform and abnormal quick restoring.This patent proposes a kind of system action Outlier Detection Algorithm based on pattern learning and prediction, by on-line study systematic state transfer rule, and then carries out predicting and comparing, finally judges that whether system is for abnormal behavior state fast.
Existing algorithm mainly focuses on and carries out the abnormal application scenarios automatically detected to the behavior pattern of complete cycle, and therefore these algorithms are needing to a great extent to wait for that the data that supervisory system gathered in complete behavior pattern cycle just can be carried out for detecting when whether current system behavior pattern belongs to abnormal behaviour pattern.In the computer system monitoring work of reality, also have the use-case that important, detect in current one shorter period whether occur that system action is abnormal exactly in real time.The requirement of real-time of this abnormality detection is stronger, needs automatically to detect for local system behavior instead of the exception in whole behavior pattern cycle.
Summary of the invention
For defect of the prior art, the object of this invention is to provide a kind of software systems abnormal behavior detection method based on multilevel mode prediction.
According to the software systems abnormal behavior detection method based on multilevel mode prediction provided by the invention, comprise the steps:
Step 1: modeling is carried out to the system action pattern in detection window, thus build the system action model in corresponding window;
Step 2: modeling is carried out to the metastatic rule between the system action pattern in system action model, obtains behavior pattern transition probability model;
Step 3: initial construction Window state transition probability model, and join in the middle of behavior pattern transition probability model;
Step 4: when there being new monitor data, moving window also obtains new Window state, and utilize behavior pattern transition probability model to find forecast model from Window state transition probability model, judge whether current window state belongs to abnormality according to forecast model;
If meet the prediction of forecast model, then illustrate that this forecast model is effective, upgrade Window state transition probability model according to new Window state;
If the difference between the prediction of forecast model and the Window state of reality is greater than the threshold value T of setting, then judge it is that Window state occurs abnormal conditions or occurs new behavior pattern;
When abnormal conditions only occur once, represent that system action occurs abnormal;
When there are abnormal conditions continuously, representing and occurring new Window state metastatic rule, new Window state transition probability model need be built;
Step 5: after Window state transition probability model completes and detects and upgrade, behavior pattern transition probability model is by detecting the accuracy of forecast model prediction and whether the newly-built renewal carrying out self of Window state transition probability model occurring.
Preferably, described step 3 comprises:
A: build Window state transition probability model, comprise the steps:
Steps A 1: note moving window size is W, and monitor data dimension D, monitor data is [S 1, S 2, S 3... S d], S i=[(y 1, t 1), (y 2, t 2) ..., (y n, t n) ...] represent i-th monitoring period sequence flows, t nrepresent sampling instant point, y nrepresent at t nthe desired value of instance sample, then the valid data in a moving window are:
In formula: S i, 1... S i,wrepresent W data sampled point in a moving window in i-th monitoring period sequence, 1≤i≤D;
Steps A 2: data acquisition sampling point is carried out sate discretization, discretize function is as follows:
In formula: M i,jrepresent the numerical value after i-th monitoring period sequence j instance sample value discretize, M i,j∈ [1,2 ..., N], 1≤i≤D, 1≤j≤W, N represents the interval number of discretize, and minimum represents minimum sampled value, and maximum represents maximum sampled value;
Steps A 3: the state M obtaining the current sliding window mouth of discretize:
In formula: M i,jvalue calculated by the formula in steps A 2,1≤i≤D, 1≤j≤W;
Steps A 4: the Window state transition probability model P of the transfer process between Window state states, and its computing formula is as follows:
P (M i| M j)=from M jstate transfers to M ishape probability of state;
Wherein, M jand M irepresent two kinds of different Window states;
B: build behavior pattern transition probability model, comprise the steps:
Step B1: marking all Window state transition probability model set is and n is the number of model in the set of this moment; P irepresent the Window state transition probability model of certain, 1≤i≤N;
Step B2: set up behavior pattern transition probability model R:
R (P i| P j, M)=when there is Window state M, from P jp used instead by model ithe probability of model;
In formula: P jand P irepresent two different Window state transition probability models, M represents current sliding window mouth state;
C: when new Window state transition probability model will be increased, comprise the steps:
If now total N number of Window state transition probability model, marking new Window state transition probability model is P n, then new behavior pattern transition probability model is R e, the formula of foundation is as follows:
R e ( P i | P N , M ) = 100 % 2 W × D ;
R e ( P i | P j , M ) = { Σ j ∈ [ 1 , N ] j ≠ N βR e ( P i | P j , M ) i = N ( 1 - β ) R e ( P i | P j , M ) i ≠ N ;
In formula: 2 w × Drepresent state sum in state space, β (0≤β≤1) represents the undated parameter of behavior pattern transfering state model, and W represents moving window size, and D represents monitor data dimension, P iand P jrepresent two different Window state transition probability models, M represents current sliding window mouth state; Wherein, the R on the right of equation e(P i| P j, M) and represent current behavior pattern transition probability model, the R on the equation left side e(P i| P j, M) and represent the behavior pattern transition probability model upgraded;
D: when moving window moves, comprises following treatment step:
If the state of current window is M, Window state is M from M transfer iprobability be P e(M i| M), in the moving window of subsequent time, state is M e, then the computing formula of Window state transition probability is as follows:
P e ( M i | M ) = ( 1 - α ) P e ( M i | M ) + α i = e P e ( M i | M ) - α ( 1 - P e ( M e | M ) ) P e ( M i | M ) ( 1 - P e ( M e | M ) ) i ≠ e
In formula: α (0≤α≤1) represents the undated parameter of Window state transition probability model; P wherein on the right of equation e(M i| M) represent the state transition probability model of current window, the P on the equation left side e(M i| M) represent the state transition probability model of window upgraded;
Regeneration behavior mode shifts state model R e, computing formula is as follows:
R e ( P i | P j , M ) = ( 1 - γ ) R e ( P i | P j , M ) + γ i = N P e ( P i | P j , M ) - γ ( 1 - P e ( P i | P N , M ) ) P e ( P i | P j , M ) ( 1 - P e ( P i | P N , M ) ) i ≠ N ;
In formula: γ represents the undated parameter of behavior pattern transfering state model, wherein, 0≤γ≤1.
Preferably,
Initial construction Window state transition probability model, if state adds up to 2 in state space w × D, then, in initialization procedure, the transition probability between all states is all set to mean value by Window state transition probability model, namely
Preferably, described step 4 comprises: predicting the outcome and difference between the Window state of reality of computational prediction model, and described difference is compared with threshold value T, for judging the stability of Window state transition probability model.
Preferably, the abnormal situation referring to the small probability event occurred in behavior pattern transition probability model of the Window state in described step 4, or the change of current window state does not meet the prediction of system action mode shifts probability model.
Preferably, described step 4 comprises:
Step 4.1: when there being new monitor data, moving window also obtains new Window state, and utilizes behavior pattern transition probability model to find forecast model from Window state transition probability model;
Step 4.2: judge whether current window state belongs to abnormality according to forecast model;
If meet the prediction of forecast model, then illustrate that this forecast model is effective, upgrade Window state transition probability model according to new Window state;
If the difference between the prediction of forecast model and the Window state of reality is greater than the threshold value T of setting, then judge it is that Window state occurs abnormal conditions or occurs new behavior pattern further;
When abnormal conditions only occur once, represent that system action occurs abnormal;
When there are abnormal conditions continuously, build brand-new Window state transition probability model;
Step 4.3: regeneration behavior mode shifts probability model, for Window state abnormality detection next time.
Compared with prior art, the present invention has following beneficial effect:
1, method proposed by the invention relative to other based on sorter and statistical method, it is advantageous that the training data without the need to label and supervised learning process, and label training supervision Data Collection on Large Scale Computer System resolution system is abnormal just automatically pinpoint the problems in the process of the most difficult realization, therefore the method in the present invention has evaded this difficult problem, solves the abnormality detection problem of computer system better.
2, another advantage of method proposed by the invention by new data Renewal model, thus can realize automatic detectability to new abnormal patterns when system normal behaviour pattern constantly changes.
Accompanying drawing explanation
By reading the detailed description done non-limiting example with reference to the following drawings, other features, objects and advantages of the present invention will become more obvious:
Fig. 1 is the functional-block diagram of the software systems abnormal behavior detection method based on multilevel mode prediction provided by the invention;
Fig. 2 is the schematic flow sheet of the software systems abnormal behavior detection method based on multilevel mode prediction provided by the invention.
Embodiment
Below in conjunction with specific embodiment, the present invention is described in detail.Following examples will contribute to those skilled in the art and understand the present invention further, but not limit the present invention in any form.It should be pointed out that to those skilled in the art, without departing from the inventive concept of the premise, some distortion and improvement can also be made.These all belong to protection scope of the present invention.
According to the software systems abnormal behavior detection method based on multilevel mode prediction provided by the invention, comprise the steps:
Step 1: modeling is carried out to the system action pattern in detection window, thus build the system action model in corresponding window;
Step 2: modeling is carried out to the metastatic rule between the system action pattern in system action model, obtains behavior pattern transition probability model;
Step 3: initial construction Window state transition probability model, and join in the middle of behavior pattern transition probability model;
Step 4: when there being new monitor data, moving window also obtains new Window state, and utilize behavior pattern transition probability model to find forecast model from Window state transition probability model, judge whether current window state belongs to abnormality according to forecast model;
If meet the prediction of forecast model, then illustrate that this forecast model is effective, upgrade Window state transition probability model according to new Window state;
If the difference between the prediction of forecast model and the Window state of reality is greater than the threshold value T of setting, then judge it is that Window state occurs abnormal conditions or occurs new behavior pattern;
When abnormal conditions only occur once, represent that system action occurs abnormal;
When there are abnormal conditions continuously, representing and occurring new Window state metastatic rule, new Window state transition probability model need be built;
Step 5: after Window state transition probability model completes and detects and upgrade, behavior pattern transition probability model is by detecting the accuracy of forecast model prediction and whether the newly-built renewal carrying out self of Window state transition probability model occurring.
Described step 3 comprises:
A: build Window state transition probability model, comprise the steps:
Steps A 1: note moving window size is W, and monitor data dimension D, monitor data is [S 1, S 2, S 3... S d], S i=[(y 1, t 1), (y 2, t 2) ..., (y n, t n) ...] represent i-th monitoring period sequence flows, t nrepresent sampling instant point, y nrepresent at t nthe desired value of instance sample, then the valid data in a moving window are:
In formula: S i, 1... S i,wrepresent W data sampled point in a moving window in i-th monitoring period sequence, 1≤i≤D;
Steps A 2: data acquisition sampling point is carried out sate discretization, discretize function is as follows:
In formula: M i,jrepresent the numerical value after i-th monitoring period sequence j instance sample value discretize, M i,j∈ [1,2 ..., N], 1≤i≤D, 1≤j≤W, N represents the interval number of discretize, and minimum represents minimum sampled value, and maximum represents maximum sampled value;
Steps A 3: the state M obtaining the current sliding window mouth of discretize:
In formula: M i,jvalue calculated by the formula in steps A 2,1≤i≤D, 1≤j≤W;
Steps A 4: the Window state transition probability model P of the transfer process between Window state states, and its computing formula is as follows:
P (M i| M j)=from M jstate transfers to M ishape probability of state;
Wherein, M jand M irepresent two kinds of different Window states;
B: build behavior pattern transition probability model, comprise the steps:
Step B1: marking all Window state transition probability model set is and n is the number of model in the set of this moment; P irepresent the Window state transition probability model of certain, 1≤i≤N;
Step B2: set up behavior pattern transition probability model R:
R (P i| P j, M)=when there is Window state M, from P jp used instead by model ithe probability of model;
In formula: P jand P irepresent two different Window state transition probability models, M represents current sliding window mouth state;
C: when new Window state transition probability model will be increased, comprise the steps:
If now total N number of Window state transition probability model, marking new Window state transition probability model is P n, then new behavior pattern transition probability model is R e, the formula of foundation is as follows:
R e ( P i | P N , M ) = 100 % 2 W × D ;
R e ( P i | P j , M ) = { Σ j ∈ [ 1 , N ] j ≠ N βR e ( P i | P j , M ) i = N ( 1 - β ) R e ( P i | P j , M ) i ≠ N ;
In formula: 2 w × Drepresent state sum in state space, β (0≤β≤1) represents the undated parameter of behavior pattern transfering state model, and W represents moving window size, and D represents monitor data dimension, P iand P jrepresent two different Window state transition probability models, M represents current sliding window mouth state; Wherein, the R on the right of equation e(P i| P j, M) and represent current behavior pattern transition probability model, the R on the equation left side e(P i| P j, M) and represent the behavior pattern transition probability model upgraded;
D: when moving window moves, comprises following treatment step:
Regeneration behavior mode shifts state model R e, computing formula is as follows:
R e ( P i | P j , M ) = ( 1 - γ ) R e ( P i | P j , M ) + γ i = N P e ( P i | P j , M ) - γ ( 1 - P e ( P i | P N , M ) ) P e ( P i | P j , M ) ( 1 - P e ( P i | P N , M ) ) i ≠ N ;
In formula: γ represents the undated parameter of behavior pattern transfering state model, wherein, 0≤γ≤1.
Initial construction Window state transition probability model, if state adds up to 2 in state space w × D, then, in initialization procedure, the transition probability between all states is all set to mean value by Window state transition probability model, namely
Described step 4 comprises: predicting the outcome and difference between the Window state of reality of computational prediction model, and described difference is compared with threshold value T, for judging the stability of Window state transition probability model.
The abnormal situation referring to the small probability event occurred in behavior pattern transition probability model of Window state in described step 4, or the change of current window state does not meet the prediction of system action mode shifts probability model.
Described step 4 also comprises:
Step 4.1: when there being new monitor data, moving window also obtains new Window state, and utilizes behavior pattern transition probability model to find forecast model from Window state transition probability model;
Step 4.2: judge whether current window state belongs to abnormality according to forecast model;
If meet the prediction of forecast model, then illustrate that this forecast model is effective, upgrade Window state transition probability model according to new Window state;
If the difference between the prediction of forecast model and the Window state of reality is greater than the threshold value T of setting, then judge it is that Window state occurs abnormal conditions or occurs new behavior pattern further;
When abnormal conditions only occur once, represent that system action occurs abnormal;
When there are abnormal conditions continuously, build brand-new Window state transition probability model;
Step 4.3: regeneration behavior mode shifts probability model, for Window state abnormality detection next time.
More specifically, the software systems abnormal behavior detection method based on multilevel mode prediction provided by the invention comprises:
Steps A: modeling is carried out to the system action pattern in detection window, thus build the system action model in corresponding window; Particularly, due to the complicacy of Large Scale Computer System in design and use pattern, cause behavior pattern to change along with application, service and the change of time, needing to build multiple model to the behavior pattern that may occur in time window carries out learning model building;
Step B: modeling is carried out to the metastatic rule between system action pattern; Particularly, in system operation, the operational mode of system in fact shifts between multiple window behavior pattern, needs to learn and modeling transfer mode, sets up system action mode shifts probability model and Window state transition probability model;
Step C: initial construction Window state transition probability model, and join in the middle of behavior pattern transition probability model;
Step D: arrive when there being new monitor data, moving window also obtains new Window state, first usage behavior mode shifts probability model finds forecast model from Window state transition probability model, and judges whether current window state belongs to abnormality according to the probabilistic forecasting of this model.If meet the prediction of model, then illustrate that model is effective, can upgrade Window state transition probability model according to new Window state.If the difference between model prediction and the Window state of reality is greater than the threshold value T (measured value is 15% by experiment) of setting, then judge it is that Window state occurs abnormal conditions or occurs new behavior pattern further.When abnormal conditions only occur once, represent that system action occurs abnormal; When occurring abnormal continuously, select to build brand-new Window state transition probability model;
Step e: after Window state transition probability model completes and detects and upgrade, behavior pattern transition probability model is by detecting the accuracy of forecast model prediction and whether the newly-built renewal carrying out self of Window state transition probability model occurring.
Particularly, as shown in Figure 1, ground floor, algorithm carries out probability model modeling to the system action pattern in detection window, thus builds the system action state model in corresponding window.Due to the complicacy of Large Scale Computer System in design and use pattern, its usage behavior pattern is also along with application and service, and the change of time and having greatly changed.Therefore, ground floor needs to build multiple model, carries out learning model building to the behavior pattern that may occur in a period of time window.The second layer, carries out modeling to the metastatic rule between system action pattern.In system operation, the operational mode of system in fact shifts between multiple window behavior pattern.Such as system enters low load model from high capacity pattern, is that center of gravity such as to transfer to centered by consume network bandwidth resource at the situation from consumption calculations resource.The second layer learns and modeling this changing pattern.Algorithm often processes a sampled point, is just undertaken predicting whether the window to be detected at also this sampled point place of comparison meets the prediction of model, if matching degree is lower, then illustrative system may be in abnormality by original behavior pattern model.After completing the detection of current window, algorithm carries out renewal or the reconstruction of ground floor model and second layer model according to new moving window, to ensure the ageing of behavior pattern model.
Particularly, overall flow as shown in Figure 2.In order to the convenience illustrated, hereafter will refer to Window state transition probability model with state model, refer to behavior pattern transition probability model with pattern model.
First build a Window state transition probability model in initialization procedure, and join in the middle of behavior pattern transition probability model.Subsequently whenever having new monitor data to arrive, moving window moves and obtains new Window state.This algorithm first usage behavior pattern model finds forecast model the most suitable in the middle of state model, and judges whether current window state belongs to abnormality according to the probabilistic forecasting of this model.If meet the prediction of model, so illustrate that model is effective, state model can be upgraded according to new Window state.And if model prediction is larger with actual Window state difference, so may for two kinds of reasons, the first time Window state really for abnormal conditions, its two be current model also do not completed for this pattern study or have selected the state model of mistake.A Main Basis due to algorithm is in normal operating condition at the computer system most of the time, therefore when algorithm is judged to be abnormal, there are two kinds of tupes equally, when algorithm carries out the classification of mistake continuously, select to build brand-new state model and this section of historical data initialization, otherwise attempt using original model to be learnt by renewal.After state model completes and detects and upgrade, pattern model, by its feedback, comprises the accuracy of detection and whether the newly-built of state model occurs, carrying out the renewal of self.
Above specific embodiments of the invention are described.It is to be appreciated that the present invention is not limited to above-mentioned particular implementation, those skilled in the art can make various distortion or amendment within the scope of the claims, and this does not affect flesh and blood of the present invention.

Claims (6)

1., based on a software systems abnormal behavior detection method for multilevel mode prediction, it is characterized in that, comprise the steps:
Step 1: modeling is carried out to the system action pattern in detection window, thus build the system action model in corresponding window;
Step 2: modeling is carried out to the metastatic rule between the system action pattern in system action model, obtains behavior pattern transition probability model;
Step 3: initial construction Window state transition probability model, and join in the middle of behavior pattern transition probability model;
Step 4: when there being new monitor data, moving window also obtains new Window state, and utilize behavior pattern transition probability model to find forecast model from Window state transition probability model, judge whether current window state belongs to abnormality according to forecast model;
If meet the prediction of forecast model, then illustrate that this forecast model is effective, upgrade Window state transition probability model according to new Window state;
If the difference between the prediction of forecast model and the Window state of reality is greater than the threshold value T of setting, then judge it is that Window state occurs abnormal conditions or occurs new behavior pattern;
When abnormal conditions only occur once, represent that system action occurs abnormal;
When there are abnormal conditions continuously, representing and occurring new Window state metastatic rule, new Window state transition probability model need be built;
Step 5: after Window state transition probability model completes and detects and upgrade, behavior pattern transition probability model is by detecting the accuracy of forecast model prediction and whether the newly-built renewal carrying out self of Window state transition probability model occurring.
2. the software systems abnormal behavior detection method based on multilevel mode prediction according to claim 1, it is characterized in that, described step 3 comprises:
A: build Window state transition probability model, comprise the steps:
Steps A 1: note moving window size is W, and monitor data dimension D, monitor data is [S 1, S 2, S 3... S d], S i=[(y 1, t 1), (y 2, t 2) ..., (y n, t n) ... ] represent i-th monitoring period sequence flows, t nrepresent sampling instant point, y nrepresent at t nthe desired value of instance sample, then the valid data in a moving window are:
In formula: S i, 1s i,wrepresent W data sampled point in a moving window in i-th monitoring period sequence, 1≤i≤D;
Steps A 2: data acquisition sampling point is carried out sate discretization, discretize function is as follows:
In formula: M i,jrepresent the numerical value after i-th monitoring period sequence j instance sample value discretize, M i,j∈ [1,2 ..., N], 1≤i≤D, 1≤j≤W, N represents the interval number of discretize, and minimum represents minimum sampled value, and maximum represents maximum sampled value;
Steps A 3: the state M obtaining the current sliding window mouth of discretize:
In formula: M i,jvalue calculated by the formula in steps A 2,1≤i≤D, 1≤j≤W;
Steps A 4: the Window state transition probability model P of the transfer process between Window state states, and its computing formula is as follows:
P (M i| M j)=from M jstate transfers to M ishape probability of state;
Wherein, M jand M irepresent two kinds of different Window states;
B: build behavior pattern transition probability model, comprise the steps:
Step B1: marking all Window state transition probability model set is and n is the number of model in the set of this moment; P irepresent the Window state transition probability model of certain, 1≤i≤N;
Step B2: set up behavior pattern transition probability model R:
R (P i| P j, M)=when there is Window state M, from P jp used instead by model ithe probability of model;
In formula: P jand P irepresent two different Window state transition probability models, M represents current sliding window mouth state;
C: when new Window state transition probability model will be increased, comprise the steps:
If now total N number of Window state transition probability model, marking new Window state transition probability model is P n, then new behavior pattern transition probability model is R e, the formula of foundation is as follows:
R e ( P i | P N , M ) = 100 % 2 W × D
R e ( P i | P j , M ) = Σ j ∈ [ 1 , N ] j ≠ N βR e ( P i | P j , M ) i = N ( 1 - β ) R e ( P i | P j , M ) i ≠ N ;
In formula: 2 w × Drepresent state sum in state space, β (0≤β≤1) represents the undated parameter of behavior pattern transfering state model, and W represents moving window size, and D represents monitor data dimension, P iand P jrepresent two different Window state transition probability models, M represents current sliding window mouth state; Wherein, the R on the right of equation e(P i| P j, M) and represent current behavior pattern transition probability model, the R on the equation left side e(P i| P j, M) and represent the behavior pattern transition probability model upgraded;
D: when moving window moves, comprises following treatment step:
If the state of current window is M, Window state is M from M transfer iprobability be P e(M i| M), in the moving window of subsequent time, state is M e, then the computing formula of Window state transition probability is as follows:
P e ( M i | M ) = ( 1 - α ) P e ( M i | M ) + α i = e P e ( M i | M ) - α ( 1 - P e ( M e | M ) ) P e ( M i | M ) ( 1 - P e ( M e | M ) ) i ≠ e
In formula: α (0≤α≤1) represents the undated parameter of Window state transition probability model; P wherein on the right of equation e(M i| M) represent the state transition probability model of current window, the P on the equation left side e(M i| M) represent the state transition probability model of window upgraded;
Regeneration behavior mode shifts state model R e, computing formula is as follows:
R e ( P i | P j , M ) = ( 1 - γ ) R e ( P i | P j , M ) + γ i = N P e ( P i | P j , M ) - γ ( 1 - P e ( P i | P N , M ) ) P e ( P i | P j , M ) ( 1 - P e ( P i | P N , M ) ) i ≠ N ;
In formula: γ represents the undated parameter of behavior pattern transfering state model, wherein, 0≤γ≤1, P e(P i| P j, M) and represent that the state of current window is M, Window state P jp used instead by model ithe probability of model.
3. the software systems abnormal behavior detection method based on multilevel mode prediction according to claim 2, is characterized in that
Initial construction Window state transition probability model, if state adds up to 2 in state space w × D, then, in initialization procedure, the transition probability between all states is all set to mean value by Window state transition probability model, namely
4. the software systems abnormal behavior detection method based on multilevel mode prediction according to claim 1, it is characterized in that, described step 4 comprises: predicting the outcome and difference between the Window state of reality of computational prediction model, and described difference is compared with threshold value T, for judging the stability of Window state transition probability model.
5. the software systems abnormal behavior detection method based on multilevel mode prediction according to claim 1, it is characterized in that, the abnormal situation referring to the small probability event occurred in behavior pattern transition probability model of Window state in described step 4, or the change of current window state does not meet the prediction of system action mode shifts probability model.
6. the software systems abnormal behavior detection method based on multilevel mode prediction according to claim 4, it is characterized in that, described step 4 comprises:
Step 4.1: when there being new monitor data, moving window also obtains new Window state, and utilizes behavior pattern transition probability model to find forecast model from Window state transition probability model;
Step 4.2: judge whether current window state belongs to abnormality according to forecast model;
If meet the prediction of forecast model, then illustrate that this forecast model is effective, upgrade Window state transition probability model according to new Window state;
If the difference between the prediction of forecast model and the Window state of reality is greater than the threshold value T of setting, then judge it is that Window state occurs abnormal conditions or occurs new behavior pattern further;
When abnormal conditions only occur once, represent that system action occurs abnormal;
When there are abnormal conditions continuously, build brand-new Window state transition probability model;
Step 4.3: regeneration behavior mode shifts probability model, for Window state abnormality detection next time.
CN201510674007.6A 2015-10-16 2015-10-16 Software systems abnormal behavior detection method based on multilevel mode prediction Active CN105183659B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510674007.6A CN105183659B (en) 2015-10-16 2015-10-16 Software systems abnormal behavior detection method based on multilevel mode prediction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510674007.6A CN105183659B (en) 2015-10-16 2015-10-16 Software systems abnormal behavior detection method based on multilevel mode prediction

Publications (2)

Publication Number Publication Date
CN105183659A true CN105183659A (en) 2015-12-23
CN105183659B CN105183659B (en) 2018-07-24

Family

ID=54905751

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510674007.6A Active CN105183659B (en) 2015-10-16 2015-10-16 Software systems abnormal behavior detection method based on multilevel mode prediction

Country Status (1)

Country Link
CN (1) CN105183659B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106953766A (en) * 2017-03-31 2017-07-14 北京奇艺世纪科技有限公司 A kind of alarm method and device
CN107341074A (en) * 2017-07-25 2017-11-10 广东欧珀移动通信有限公司 One kind upgrades abnormal restorative procedure, upgrading exception prosthetic device and intelligent terminal
CN108304315A (en) * 2017-12-14 2018-07-20 国家计算机网络与信息安全管理中心 A kind of sorting technique and system of software aging abnormal behaviour
CN109213616A (en) * 2018-09-25 2019-01-15 江苏润和软件股份有限公司 A kind of micro services software systems method for detecting abnormality based on calling map analysis
CN112162911A (en) * 2020-10-14 2021-01-01 中国民航信息网络股份有限公司 Abnormal business operation behavior detection method, device, equipment and readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040078181A1 (en) * 2002-10-16 2004-04-22 Allen Richard Craig Method for providing access to the internal signals of a dynamic system model from outside the modeling environment
CN103201754A (en) * 2010-11-18 2013-07-10 索尼公司 Data processing device, data processing method, and program
CN103399817A (en) * 2013-08-13 2013-11-20 清华大学 System detection device based on module modeling and model checking integration

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040078181A1 (en) * 2002-10-16 2004-04-22 Allen Richard Craig Method for providing access to the internal signals of a dynamic system model from outside the modeling environment
CN103201754A (en) * 2010-11-18 2013-07-10 索尼公司 Data processing device, data processing method, and program
CN103399817A (en) * 2013-08-13 2013-11-20 清华大学 System detection device based on module modeling and model checking integration

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
安景琦等: "一种基于隐Markov模型的异常检测技术", 《计算机应用》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106953766A (en) * 2017-03-31 2017-07-14 北京奇艺世纪科技有限公司 A kind of alarm method and device
CN107341074A (en) * 2017-07-25 2017-11-10 广东欧珀移动通信有限公司 One kind upgrades abnormal restorative procedure, upgrading exception prosthetic device and intelligent terminal
CN108304315A (en) * 2017-12-14 2018-07-20 国家计算机网络与信息安全管理中心 A kind of sorting technique and system of software aging abnormal behaviour
CN109213616A (en) * 2018-09-25 2019-01-15 江苏润和软件股份有限公司 A kind of micro services software systems method for detecting abnormality based on calling map analysis
CN112162911A (en) * 2020-10-14 2021-01-01 中国民航信息网络股份有限公司 Abnormal business operation behavior detection method, device, equipment and readable storage medium
CN112162911B (en) * 2020-10-14 2024-03-29 中国民航信息网络股份有限公司 Abnormal business operation behavior detection method, device, equipment and readable storage medium

Also Published As

Publication number Publication date
CN105183659B (en) 2018-07-24

Similar Documents

Publication Publication Date Title
Wu et al. Data-driven remaining useful life prediction via multiple sensor signals and deep long short-term memory neural network
CN109308522B (en) GIS fault prediction method based on recurrent neural network
Xie et al. Prognostic for fuel cell based on particle filter and recurrent neural network fusion structure
WO2020259421A1 (en) Method and apparatus for monitoring service system
Capozzoli et al. Fault detection analysis using data mining techniques for a cluster of smart office buildings
CN105183659A (en) Software system behavior anomaly detection method based on multi-level mode predication
WO2023109370A1 (en) Fault detection method and equipment for drainage pipe network, server, and storage medium
CN112000015B (en) Intelligent BIT design method for heavy-duty gas turbine control system controller module based on LSTM and bio-excitation neural network
Di Maio et al. Ensemble-approaches for clustering health status of oil sand pumps
CN107786369A (en) Based on the perception of IRT step analyses and LSTM powerline network security postures and Forecasting Methodology
CN103197983A (en) Service component reliability online time sequence predicting method based on probability graph model
CN108052092A (en) A kind of subway electromechanical equipment abnormal state detection method based on big data analysis
He et al. A new hierarchical belief-rule-based method for reliability evaluation of wireless sensor network
Nguyen et al. Applications of anomaly detection using deep learning on time series data
Entezami et al. On continuous health monitoring of bridges under serious environmental variability by an innovative multi-task unsupervised learning method
Hu et al. Deep reinforcement learning based valve scheduling for pollution isolation in water distribution network
Li et al. Tailings pond risk prediction using long short-term memory networks
Irofti et al. Fault handling in large water networks with online dictionary learning
Lou et al. Classification-based prediction of network connectivity robustness
Li et al. The updating strategy for the safe control Bayesian network model under the abnormity in the thickening process of gold hydrometallurgy
CN117036103A (en) Electric power system operation situation prediction method based on LSTM (least squares) circulating neural network
Dang et al. seq2graph: Discovering dynamic non-linear dependencies from multivariate time series
CN105260304A (en) /Software reliability prediction method based on QBGSA RVR (Quantum-inspired Binary Gravitational Search Algorithm-Relevance Vector Machine)
CN116484219A (en) Water supply network water quality abnormal pollution source identification method based on gate control graph neural network
CN115459982A (en) Power network false data injection attack detection method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant