CN105279386B - Method and device for determining index abnormal data - Google Patents
Method and device for determining index abnormal data Download PDFInfo
- Publication number
- CN105279386B CN105279386B CN201510786205.1A CN201510786205A CN105279386B CN 105279386 B CN105279386 B CN 105279386B CN 201510786205 A CN201510786205 A CN 201510786205A CN 105279386 B CN105279386 B CN 105279386B
- Authority
- CN
- China
- Prior art keywords
- index
- evaluated
- data
- abnormal
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000002159 abnormal effect Effects 0.000 title claims abstract description 121
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000002547 anomalous effect Effects 0.000 claims 2
- 238000012544 monitoring process Methods 0.000 claims 2
- 238000004458 analytical method Methods 0.000 abstract description 4
- 230000000737 periodic effect Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 11
- 238000004590 computer program Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000005856 abnormality Effects 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
Landscapes
- Alarm Systems (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses a method and a device for determining index abnormal data, wherein the method comprises the steps of obtaining current index data of an index to be evaluated by determining the index to be evaluated, obtaining historical data of the index to be evaluated according to statistical time corresponding to the current index data, sequentially determining the average level and fluctuation level of the index to be evaluated according to the historical data of the index to be evaluated, and determining the abnormal coefficient of the index to be evaluated according to the average level of the index to be evaluated and the fluctuation level of the index to be evaluated. The historical data of the index to be evaluated in the same time period of the arrival of the data points are extracted periodically and used as analysis samples, the periodic influence of the data can be eliminated, the abnormal coefficient is dynamically given by integrating the average level and the fluctuation level of the index to be evaluated, and workers can know the abnormal degree of the current index to be evaluated only by comparing the abnormal coefficient of the index to be evaluated with the constant 1/-1.
Description
Technical Field
The invention relates to the technical field of data analysis, in particular to a method and a device for determining index abnormal data.
Background
The abnormal data of one index is judged by setting a highest threshold and a lowest threshold, and the data which is not in the range of the highest threshold and the lowest threshold can be judged as the abnormal data.
In the prior art, the data sizes of different indexes are different, so that a threshold value needs to be set for each index, and the implementation of a threshold value judgment mode is difficult; meanwhile, even if the same index is used, the set thresholds of the indexes possibly corresponding to different times are different, so that the difficulty of the threshold judgment mode is further increased, and the judgment of abnormal data is inaccurate if the set threshold is unreasonable.
Disclosure of Invention
The embodiment of the invention provides a method and a device for determining index abnormal data, which are used for determining the abnormal degree of a current index to be evaluated.
The method for determining the index abnormal data provided by the embodiment of the invention comprises the following steps:
determining an index to be evaluated;
acquiring current index data of the index to be evaluated;
acquiring historical data of the index to be evaluated according to the statistical moment corresponding to the current index data;
sequentially determining the average level and the fluctuation level of the index to be evaluated according to the historical data of the index to be evaluated;
and determining an abnormal coefficient of the index to be evaluated according to the average level of the index to be evaluated and the fluctuation level of the index to be evaluated, wherein the abnormal coefficient is used for indicating whether the current index data of the index to be evaluated is abnormal data.
Preferably, the method further comprises the following steps:
counting abnormal coefficients of m continuous current index data, wherein m is more than or equal to 0;
determining the abnormal trend of the index to be evaluated according to the abnormal coefficients of the continuous m current index data;
and alarming according to the abnormal trend.
Preferably, the obtaining the historical data of the index to be evaluated according to the statistical time corresponding to the current index data includes:
determining a preset time period taking the statistical time corresponding to the current index data as a center, and acquiring historical data of the index to be evaluated in the preset time period; the preset time period is determined according to the period of the index to be evaluated.
Preferably, the average level of the index to be evaluated is determined according to formula (1); determining the fluctuation level of the index to be evaluated according to a formula (2);
the formula (1) is:
where μ is the average level of the index to be evaluated, xiN is more than or equal to 0, i is more than or equal to 0 and less than or equal to n;
the formula (2) is:
wherein, sigma is the fluctuation level of the index to be evaluated, and xiThe index data is the ith index data in the historical data of the index to be evaluated, mu is the average level of the index to be evaluated, n is more than or equal to 0, and i is more than or equal to 0 and less than or equal to n.
Preferably, determining an abnormal coefficient of the index to be evaluated according to the formula (3);
the formula (3) is:
wherein m is an abnormal coefficient of the index to be evaluated, x is current index data, sigma is a fluctuation level of the index to be evaluated, and mu is an average level of the index to be evaluated;
and m is more than 1 or m is less than-1, and the current index data of the index to be evaluated is abnormal data.
Preferably, determining the abnormal trend of the index to be evaluated according to the formula (4);
the formula (4) is:
wherein t is the abnormal trend of the index to be evaluated, c is a constant, 0 is more than α and less than 1, xjIs the jth current index data, m is more than or equal to 0, and j is more than or equal to 0 and less than or equal to m.
Correspondingly, an embodiment of the present invention further provides an apparatus for determining abnormal data, including:
the first determination unit is used for determining the index to be evaluated;
the first acquisition unit is used for acquiring current index data of the index to be evaluated;
the second obtaining unit is used for obtaining the historical data of the index to be evaluated according to the statistical moment corresponding to the current index data;
the second determining unit is used for sequentially determining the average level and the fluctuation level of the index to be evaluated according to the historical data of the index to be evaluated;
and a third determining unit, configured to determine an abnormal coefficient of the to-be-evaluated index according to the average level of the to-be-evaluated index and the fluctuation level of the to-be-evaluated index, where the abnormal coefficient is used to indicate whether current index data of the to-be-evaluated index is abnormal data.
Preferably, the method further comprises the following steps: an alarm unit;
the alarm unit is specifically configured to:
counting abnormal coefficients of m continuous index data, wherein m is more than or equal to 0;
determining the abnormal trend of the index to be evaluated according to the abnormal coefficients of the continuous m index data;
and alarming according to the abnormal trend.
Preferably, the second obtaining unit is specifically configured to:
determining a preset time period taking the statistical time corresponding to the current index data as a center, and acquiring historical data of the index to be evaluated in the preset time period; the preset time period is determined according to the period of the index to be evaluated.
Preferably, the second determining unit is specifically configured to:
determining the average level of the index to be evaluated according to a formula (1); determining the fluctuation level of the index to be evaluated according to a formula (2);
the formula (1) is:
where μ is the average level of the index to be evaluated, xiN is more than or equal to 0, i is more than or equal to 0 and less than or equal to n;
the formula (2) is:
wherein, sigma is the fluctuation level of the index to be evaluated, and xiThe index data is the ith index data in the historical data of the index to be evaluated, mu is the average level of the index to be evaluated, n is more than or equal to 0, and i is more than or equal to 0 and less than or equal to n.
Preferably, the third determining unit is specifically configured to:
determining an abnormal coefficient of the index to be evaluated according to the formula (3);
the formula (3) is:
wherein m is an abnormal coefficient of the index to be evaluated, x is current index data, sigma is a fluctuation level of the index to be evaluated, and mu is an average level of the index to be evaluated;
and m is more than 1 or m is less than-1, and the current index data of the index to be evaluated is abnormal data.
Preferably, the alarm unit is specifically configured to:
determining the abnormal trend of the index to be evaluated according to the formula (4);
the formula (4) is:
wherein t is the abnormal trend of the index to be evaluated, c is a constant, 0 is more than α and less than 1, xjIs the jth current index data, m is more than or equal to 0, and j is more than or equal to 0 and less than or equal to m.
The embodiment of the invention shows that the current index data of the index to be evaluated is obtained by determining the index to be evaluated, the historical data of the index to be evaluated is obtained according to the statistical moment corresponding to the current index data, the average level and the fluctuation level of the index to be evaluated are sequentially determined according to the historical data of the index to be evaluated, and the abnormal coefficient of the index to be evaluated is determined according to the average level of the index to be evaluated and the fluctuation level of the index to be evaluated. The historical data of the index to be evaluated in the same time period of the arrival of the data points are extracted periodically and used as analysis samples, the periodic influence of the data can be eliminated, the abnormal coefficient is dynamically given by integrating the average level and the fluctuation level of the index to be evaluated, and workers can know the abnormal degree of the current index to be evaluated only by comparing the abnormal coefficient of the index to be evaluated with the constant 1/-1. For each real-time index data, the abnormal condition of each index data is evaluated in real time by combining the historical index data at the statistical moment corresponding to the index data, so that the accuracy of evaluating the abnormality and the timeliness of evaluation are improved; meanwhile, the average level and the fluctuation level of historical data are combined, so that the evaluation accuracy is further improved
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a schematic flowchart of a method for determining abnormal index data according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating a threshold setting provided by the prior art;
FIG. 3 is a diagram illustrating a threshold setting according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an apparatus for determining index abnormal data according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 illustrates a flow of index abnormal data determination provided by an embodiment of the present invention, which may be performed by an apparatus for index abnormal data determination.
As shown in fig. 1, the specific steps of the process include:
step 101, determining an index to be evaluated.
And 102, acquiring current index data of the index to be evaluated.
Step 103, obtaining historical data of the index to be evaluated according to the statistical time corresponding to the current index data.
And step 104, sequentially determining the average level and the fluctuation level of the index to be evaluated according to the historical data of the index to be evaluated.
And 105, determining an abnormal coefficient of the index to be evaluated according to the average level of the index to be evaluated and the fluctuation level of the index to be evaluated.
In step 101, an index to be evaluated needs to be determined among a plurality of indexes, and the index to be evaluated may be an index that needs to be monitored.
In step 102, after the index to be evaluated is determined, when index data of one index to be evaluated arrives at present, current index data of the index to be evaluated is obtained, and the statistical time corresponding to the current index data is recorded.
In step 103, a preset time period centered on the statistical time corresponding to the current index data is first determined, and then the historical data of the index to be evaluated within the preset time period is obtained. The preset time period is determined according to the period of the index to be evaluated. The period of the index to be evaluated can be set according to experience, the period can be one day, one week or one month, and the period is set according to experience in practical application.
The preset time period is in a certain proportion to the period of the index to be evaluated, and if the period of the index to be evaluated is one day, the preset time period can be 20 minutes, which accounts for 1.4% of the period of the index to be evaluated. If the statistical time corresponding to the current index data of the index to be evaluated is 12 points, and the preset time period is 20 minutes, the 12 points are taken as the center, and the time period from 11 points 50 minutes to 12 points 10 minutes is the time period in which the historical data of the index to be evaluated needs to be acquired, so that the historical data of the index to be evaluated in the preset time period, namely all the historical data of the index to be evaluated between 11 points 50 minutes to 12 points 10 minutes, are acquired.
The periodic influence of the data can be eliminated by extracting the historical data of the indexes to be evaluated at the same time period according to the period as an analysis sample.
In step 104, after the historical data of the index to be evaluated is obtained in step 103, the average level of the index to be evaluated is determined according to the formula (1).
The above formula (1) is:
where μ is the average level of the index to be evaluated, xiN is more than or equal to 0, and i is more than or equal to 0 and less than or equal to n.
After the average level of the index to be evaluated is determined, the fluctuation level of the index to be evaluated can be determined according to the average level of the index to be evaluated, the historical data of the index to be evaluated and the formula (2).
The above formula (2) is:
wherein, sigma is the fluctuation level of the index to be evaluated, and xiThe index data is the ith index data in the historical data of the index to be evaluated, mu is the average level of the index to be evaluated, n is more than or equal to 0, and i is more than or equal to 0 and less than or equal to n.
In step 105, according to the average level of the index to be evaluated and the fluctuation level of the index to be evaluated, which are determined in step 104, an abnormal coefficient of the index to be evaluated may be determined, where the abnormal coefficient may be used to indicate whether the current index data of the index to be evaluated is abnormal data. If the abnormal coefficient is larger than 1, the current index data of the index to be evaluated is large; and if the abnormal coefficient is less than-1, the current index data of the index to be evaluated is small in abnormality, and if the abnormal coefficient is more than 1 or the abnormal coefficient is less than-1, the current index data of the index to be evaluated is abnormal data. The staff can judge whether the current index data of the index to be evaluated is abnormal data according to the abnormal coefficient, and if the current index data is abnormal data, the abnormality can be weakened through a tail averaging method.
The abnormal coefficient of the index to be evaluated can be determined by formula (3).
The above equation (3) is:
wherein m is an abnormal coefficient of the index to be evaluated, x is current index data, sigma is a fluctuation level of the index to be evaluated, and mu is an average level of the index to be evaluated. And m is more than 1 or m is less than-1, and the current index data of the index to be evaluated is abnormal data.
According to the embodiment of the invention, the abnormal coefficient is dynamically given by integrating the average level and the fluctuation level of the index to be evaluated, and a worker can know the abnormal degree of the current index to be evaluated only by comparing the abnormal coefficient of the index to be evaluated with the constant 1/-1.
And when determining the abnormal coefficients of the m continuous current index data, counting the abnormal coefficients of the m continuous current index data. And determining the abnormal trend of the index to be evaluated according to the abnormal coefficients of the continuous m current index data. And then alarming according to the abnormal trend, and alarming when the abnormal trend exceeds an alarm threshold value. The embodiment of the invention can provide alarm modes such as short messages, Hipchat and the like, and also can render abnormal information of indexes in real time in a webpage, for example, abnormal data points are marked with red.
The abnormal trend of the index to be evaluated can be determined according to the formula (4).
The formula (4) is:
wherein t is the abnormal trend of the index to be evaluated, c is a constant, 0 is more than α and less than 1, xjIs the jth current index data, m is more than or equal to 0, and j is more than or equal to 0 and less than or equal to m.
As can be seen from equation (4), the larger α, the better the timeliness, and the more the abnormal trend of the nearest data point can be reflected.
The embodiment of the invention monitors indexes such as the calling amount and the calling duration of interfaces such as a web master station for ordering food, a back-end RPC service and the like, and plays a good alarm role in detecting accidents such as interface overtime, posting and the like.
In the prior art, a common method for determining abnormal data of an index is to set a highest threshold and a lowest threshold, as shown in fig. 2, an upper straight line and a lower straight line are the set highest threshold and the set lowest threshold, and index data which is not within the range of the highest threshold and the lowest threshold can be determined as abnormal data. As shown in fig. 3, the embodiment of the present invention may provide a dynamic threshold value of index data, so that it is not necessary to set a threshold value for each index.
The embodiment of the invention shows that the current index data of the index to be evaluated is obtained by determining the index to be evaluated, the historical data of the index to be evaluated is obtained according to the statistical moment corresponding to the current index data, the average level and the fluctuation level of the index to be evaluated are sequentially determined according to the historical data of the index to be evaluated, and the abnormal coefficient of the index to be evaluated is determined according to the average level of the index to be evaluated and the fluctuation level of the index to be evaluated. The method has the advantages that the historical data of the index to be evaluated in the same period of time is taken as an analysis sample according to the arrival of the data points of the periodically extracted index, the periodic influence of the data can be eliminated, the abnormal coefficient is given according to the normal distribution principle and the average level and fluctuation level dynamics of the index to be evaluated, and the abnormal degree of the current index to be evaluated can be known only by comparing the abnormal coefficient of the index to be evaluated with the constant 1/-1.
Based on the same technical concept, fig. 4 shows a structure of an apparatus for determining index abnormal data, which is provided by an embodiment of the present invention and can execute a flow of determining index abnormal data.
As shown in fig. 4, the apparatus specifically includes:
a first determining unit 401, configured to determine an index to be evaluated;
a first obtaining unit 402, configured to obtain current index data of the index to be evaluated;
a second obtaining unit 403, configured to obtain historical data of the to-be-evaluated indicator according to a statistical time corresponding to the current indicator data;
a second determining unit 404, configured to sequentially determine an average level and a fluctuation level of the to-be-evaluated indicator according to historical data of the to-be-evaluated indicator;
a third determining unit 405, configured to determine an abnormal coefficient of the to-be-evaluated indicator according to the average level of the to-be-evaluated indicator and the fluctuation level of the to-be-evaluated indicator, where the abnormal coefficient is used to indicate whether current indicator data of the to-be-evaluated indicator is abnormal data.
Preferably, the method further comprises the following steps: an alarm unit;
the alarm unit is specifically configured to:
counting abnormal coefficients of m continuous index data, wherein m is more than or equal to 0;
determining the abnormal trend of the index to be evaluated according to the abnormal coefficients of the continuous m index data;
and alarming according to the abnormal trend.
Preferably, the second obtaining unit 403 is specifically configured to:
determining a preset time period taking the statistical time corresponding to the current index data as a center, and acquiring historical data of the index to be evaluated in the preset time period; the preset time period is determined according to the period of the index to be evaluated.
Preferably, the second determining unit 404 is specifically configured to:
determining the average level of the index to be evaluated according to a formula (1); determining the fluctuation level of the index to be evaluated according to a formula (2);
the formula (1) is:
where μ is the average level of the index to be evaluated, xiN is more than or equal to 0, i is more than or equal to 0 and less than or equal to n;
the formula (2) is:
wherein, sigma is the fluctuation level of the index to be evaluated, and xiThe index data is the ith index data in the historical data of the index to be evaluated, mu is the average level of the index to be evaluated, n is more than or equal to 0, and i is more than or equal to 0 and less than or equal to n.
Preferably, the third determining unit 405 is specifically configured to:
determining an abnormal coefficient of the index to be evaluated according to the formula (3);
the formula (3) is:
wherein m is an abnormal coefficient of the index to be evaluated, x is current index data, sigma is a fluctuation level of the index to be evaluated, and mu is an average level of the index to be evaluated;
and m is more than 1 or m is less than-1, and the current index data of the index to be evaluated is abnormal data.
Preferably, the alarm unit is specifically configured to:
determining the abnormal trend of the index to be evaluated according to the formula (4);
the formula (4) is:
wherein t is the abnormal trend of the index to be evaluated, c is a constant, 0 is more than α and less than 1, xjIs the jth current index data, m is more than or equal to 0, and j is more than or equal to 0 and less than or equal to m.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. A method of determining anomalous data, comprising:
determining an index to be evaluated;
acquiring current index data of the index to be evaluated; the current index data of the index to be evaluated is obtained by monitoring a Web master station or a back-end Remote Procedure Call (RPC) service interface of the order;
acquiring historical data of the index to be evaluated according to the statistical moment corresponding to the current index data;
sequentially determining the average level and the fluctuation level of the index to be evaluated according to the historical data of the index to be evaluated;
determining an abnormal coefficient of the index to be evaluated according to the average level of the index to be evaluated and the fluctuation level of the index to be evaluated, wherein the abnormal coefficient is used for indicating whether the current index data of the index to be evaluated is abnormal data;
the method further comprises the following steps:
counting abnormal coefficients of m continuous current index data, wherein m is more than or equal to 0;
determining the abnormal trend of the index to be evaluated according to the abnormal coefficients of the continuous m current index data;
alarming according to the abnormal trend;
determining the abnormal trend of the index to be evaluated according to a formula (4);
the formula (4) is:
wherein t is the abnormal trend of the index to be evaluated, c is a constant, 0 is more than α and less than 1, xjIs the jth current index data, m is more than or equal to 0, and j is more than or equal to 0 and less than or equal to m.
2. The method of claim 1, wherein the obtaining the historical data of the index to be evaluated according to the statistical time corresponding to the current index data comprises:
determining a preset time period taking the statistical time corresponding to the current index data as a center, and acquiring historical data of the index to be evaluated in the preset time period; the preset time period is determined according to the period of the index to be evaluated.
3. The method of claim 1, wherein the average level of the metric to be evaluated is determined according to equation (1); determining the fluctuation level of the index to be evaluated according to a formula (2);
the formula (1) is:
where μ is the average level of the index to be evaluated, xiN is more than or equal to 0, i is more than or equal to 0 and less than or equal to n;
the formula (2) is:
wherein, sigma is the fluctuation level of the index to be evaluated, and xiThe index data is the ith index data in the historical data of the index to be evaluated, mu is the average level of the index to be evaluated, n is more than or equal to 0, and i is more than or equal to 0 and less than or equal to n.
4. The method according to claim 1, characterized in that the abnormal coefficient of the index to be evaluated is determined according to formula (3);
the formula (3) is:
wherein m is an abnormal coefficient of the index to be evaluated, x is current index data, sigma is a fluctuation level of the index to be evaluated, and mu is an average level of the index to be evaluated;
and m is more than 1 or m is less than-1, and the current index data of the index to be evaluated is abnormal data.
5. An apparatus for determining anomalous data, comprising:
the first determination unit is used for determining the index to be evaluated;
the first acquisition unit is used for acquiring current index data of the index to be evaluated; the current index data of the index to be evaluated is obtained by monitoring a Web master station or a back-end Remote Procedure Call (RPC) service interface of the order;
the second obtaining unit is used for obtaining the historical data of the index to be evaluated according to the statistical moment corresponding to the current index data;
the second determining unit is used for sequentially determining the average level and the fluctuation level of the index to be evaluated according to the historical data of the index to be evaluated;
a third determining unit, configured to determine an abnormal coefficient of the to-be-evaluated indicator according to the average level of the to-be-evaluated indicator and the fluctuation level of the to-be-evaluated indicator, where the abnormal coefficient is used to indicate whether current indicator data of the to-be-evaluated indicator is abnormal data;
further comprising: an alarm unit;
the alarm unit is specifically configured to:
counting abnormal coefficients of m continuous index data, wherein m is more than or equal to 0;
determining the abnormal trend of the index to be evaluated according to the abnormal coefficients of the continuous m index data;
alarming according to the abnormal trend;
the alarm unit is specifically configured to:
determining the abnormal trend of the index to be evaluated according to a formula (4);
the formula (4) is:
wherein t is the abnormal trend of the index to be evaluated, c is a constant, 0 is more than α and less than 1, xjIs the jth current index data, m is more than or equal to 0, and j is more than or equal to 0 and less than or equal to m.
6. The apparatus of claim 5, wherein the second obtaining unit is specifically configured to:
determining a preset time period taking the statistical time corresponding to the current index data as a center, and acquiring historical data of the index to be evaluated in the preset time period; the preset time period is determined according to the period of the index to be evaluated.
7. The apparatus of claim 5, wherein the second determining unit is specifically configured to:
determining the average level of the index to be evaluated according to a formula (1); determining the fluctuation level of the index to be evaluated according to a formula (2);
the formula (1) is:
where μ is the average level of the index to be evaluated, xiN is more than or equal to 0, i is more than or equal to 0 and less than or equal to n;
the formula (2) is:
wherein, sigma is the fluctuation level of the index to be evaluated, and xiThe index data is the ith index data in the historical data of the index to be evaluated, mu is the average level of the index to be evaluated, n is more than or equal to 0, and i is more than or equal to 0 and less than or equal to n.
8. The apparatus of claim 5, wherein the third determining unit is specifically configured to:
determining an abnormal coefficient of the index to be evaluated according to a formula (3);
the formula (3) is:
wherein m is an abnormal coefficient of the index to be evaluated, x is current index data, sigma is a fluctuation level of the index to be evaluated, and mu is an average level of the index to be evaluated;
and m is more than 1 or m is less than-1, and the current index data of the index to be evaluated is abnormal data.
9. A computer-readable storage medium having computer-executable instructions stored thereon for causing a computer to perform the method of any one of claims 1 to 4.
10. A computer device, comprising:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510786205.1A CN105279386B (en) | 2015-11-16 | 2015-11-16 | Method and device for determining index abnormal data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510786205.1A CN105279386B (en) | 2015-11-16 | 2015-11-16 | Method and device for determining index abnormal data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105279386A CN105279386A (en) | 2016-01-27 |
| CN105279386B true CN105279386B (en) | 2019-08-16 |
Family
ID=55148389
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510786205.1A Active CN105279386B (en) | 2015-11-16 | 2015-11-16 | Method and device for determining index abnormal data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105279386B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105956935B (en) * | 2016-05-06 | 2017-08-25 | 泉州亿兴电力有限公司 | A kind of power distribution network transformer threshold value update method and system |
| CN106293976A (en) * | 2016-08-15 | 2017-01-04 | 东软集团股份有限公司 | Application performance Risk Forecast Method, device and system |
| CN107888435B (en) * | 2016-09-29 | 2020-11-17 | 华为技术有限公司 | Threshold setting method and device for alarm monitoring |
| CN107202604B (en) * | 2017-03-02 | 2019-09-03 | 湖南工业大学 | A kind of alert processing method and system |
| CN108334417B (en) * | 2018-01-26 | 2021-03-02 | 创新先进技术有限公司 | Method and device for determining data exception |
| CN109740099A (en) * | 2018-12-30 | 2019-05-10 | 北京奇艺世纪科技有限公司 | A kind of data exception localization method and device |
| CN113420816B (en) * | 2021-06-24 | 2024-09-06 | 北京市生态环境监测中心 | Data outlier determining method for full-spectrum water quality monitoring equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013254337A (en) * | 2012-06-06 | 2013-12-19 | Ntt Data Corp | Virtualization device, virtualization control method and virtualization device control program |
| CN103823980A (en) * | 2014-02-26 | 2014-05-28 | 浙江水利水电学院 | Method for detecting abnormal dam monitoring data based on entropy theory |
| CN104462794A (en) * | 2014-11-26 | 2015-03-25 | 北京金水永利科技有限公司 | Algorithm for finding abnormal data of environmental monitoring based on comparative statistic analysis |
| CN104536868A (en) * | 2014-11-26 | 2015-04-22 | 北京广通信达科技有限公司 | Dynamic threshold analysis method for operation index of IT system |
| CN105046075A (en) * | 2015-07-10 | 2015-11-11 | 中国农业大学 | Analyzing-processing method and device for dam quality monitoring data |
-
2015
- 2015-11-16 CN CN201510786205.1A patent/CN105279386B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013254337A (en) * | 2012-06-06 | 2013-12-19 | Ntt Data Corp | Virtualization device, virtualization control method and virtualization device control program |
| CN103823980A (en) * | 2014-02-26 | 2014-05-28 | 浙江水利水电学院 | Method for detecting abnormal dam monitoring data based on entropy theory |
| CN104462794A (en) * | 2014-11-26 | 2015-03-25 | 北京金水永利科技有限公司 | Algorithm for finding abnormal data of environmental monitoring based on comparative statistic analysis |
| CN104536868A (en) * | 2014-11-26 | 2015-04-22 | 北京广通信达科技有限公司 | Dynamic threshold analysis method for operation index of IT system |
| CN105046075A (en) * | 2015-07-10 | 2015-11-11 | 中国农业大学 | Analyzing-processing method and device for dam quality monitoring data |
Non-Patent Citations (1)
| Title |
|---|
| 数据流中异常模式的提取与趋势监测;宋国杰 等;《计算机研究与发展》;20041031;第41卷(第10期);第1754-1759页 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105279386A (en) | 2016-01-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105279386B (en) | Method and device for determining index abnormal data | |
| CN107871190B (en) | Service index monitoring method and device | |
| CN106485805B (en) | A kind of pipeline inspection management method and system | |
| CN110377491A (en) | A kind of data exception detection method and device | |
| EP2565656A3 (en) | Systems, methods, and apparatus for locating faults on an electrical distribution network | |
| CN107742417B (en) | Vehicle accident alarm method and device | |
| CN107547266B (en) | Method and device for detecting online quantity abnormal point, computer equipment and storage medium | |
| CN116308305A (en) | Bridge health monitoring data management system | |
| CN114155692A (en) | Equipment fault reporting method, device and storage medium | |
| CN111122817A (en) | Pipeline bubble monitoring method and device, storage medium and analysis equipment | |
| CN110795324A (en) | Data processing method and device | |
| CN110166972B (en) | Intelligent sensing system with block chain module | |
| EP3289370A1 (en) | Methods and systems for alerting a user to the presence of a fault in an electromechanical system in a railway infrastructure | |
| CN106033643A (en) | Data processing method and data processing device | |
| WO2002095633A3 (en) | Method and apparatus for determining the health of a component using condition indicators | |
| CN109921955B (en) | Traffic monitoring method, system, computer device and storage medium | |
| CN112781556A (en) | Well lid transaction monitoring method and device based on multi-data fusion filtering | |
| DE102018218655A1 (en) | FIRE DETECTORS | |
| CN117824808A (en) | State detection method and device of detection equipment, storage medium and electronic equipment | |
| CN117391913A (en) | Passenger traffic prediction method, device, equipment and storage medium | |
| CN109773586B (en) | Bilateral scissors crankshaft temperature detection method and device, and dry oil lubrication method and device | |
| CN107124290B (en) | alarm threshold value generation method and device | |
| CN111695735A (en) | Railway bow net real-time early warning method, system and device based on flow calculation | |
| CN111555917A (en) | Alarm information processing method and device based on cloud platform | |
| CN114001887B (en) | Bridge damage assessment method based on deflection monitoring |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |