CN108088916B - A kind of method for improving and system of oil dissolved gas online monitoring data quality - Google Patents
A kind of method for improving and system of oil dissolved gas online monitoring data quality Download PDFInfo
- Publication number
- CN108088916B CN108088916B CN201711269974.XA CN201711269974A CN108088916B CN 108088916 B CN108088916 B CN 108088916B CN 201711269974 A CN201711269974 A CN 201711269974A CN 108088916 B CN108088916 B CN 108088916B
- Authority
- CN
- China
- Prior art keywords
- data
- online monitoring
- value
- monitoring data
- oil dissolved
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 95
- 238000000034 method Methods 0.000 title claims abstract description 52
- 239000007789 gas Substances 0.000 claims abstract description 51
- 230000008569 process Effects 0.000 claims description 17
- 230000009467 reduction Effects 0.000 claims description 15
- 230000002159 abnormal effect Effects 0.000 claims description 8
- 238000004880 explosion Methods 0.000 claims description 5
- 230000008030 elimination Effects 0.000 claims description 4
- 238000003379 elimination reaction Methods 0.000 claims description 4
- 238000001514 detection method Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 abstract description 11
- 238000009499 grossing Methods 0.000 abstract description 9
- 238000005457 optimization Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 241001269238 Data Species 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012806 monitoring device Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
- 239000010913 used oil Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N30/00—Investigating or analysing materials by separation into components using adsorption, absorption or similar phenomena or using ion-exchange, e.g. chromatography or field flow fractionation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/26—Oils; viscous liquids; paints; inks
- G01N33/28—Oils, i.e. hydrocarbon liquids
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
Abstract
The invention discloses the method for improving and system of a kind of oil dissolved gas online monitoring data quality, method obtains the online monitoring data of the Oil Dissolved Gases Concentration of transformer comprising steps of S1；S2 is removed the exceptional value in online monitoring data, and is replaced using null value；S3 carries out completion to null value using cubic spline interpolation；S4 is differentiated the singular value in online monitoring data using 3 σ rules and is replaced using mode；S5 is smoothed to remove the random noise and white noise in online monitoring data using low-pass filter；S6, output carry out the data after quality of data promotion by S1 to S5.System includes acquiring unit, replacement unit, unit of filling a vacancy, culling unit, smooth unit and output unit.The present invention is by the way that original online monitoring data progress data are filled a vacancy, singular value is rejected, data smoothing processing, so that treated, data can more characterize actual Oil Dissolved Gases Concentration variation tendency.
Description
Technical field
The present invention relates to transformer oil chromatographic on-line monitoring technique field, specifically a kind of oil dissolved gas is online
The method for improving and system of monitoring data quality.
Background technique
For transformer as important power transmission and transforming equipment, operational reliability is directly related to the safety fortune of entire electric system
Row.For the safe and stable operation for ensureing transformer, it is often used oil dissolved gas on-line monitoring system and equipment state is supervised
It surveys.At the scene in actual operation, due to the particularity of monitoring device running environment, monitoring device working condition it is unstable
Property, in the unstability of transmission line and acquisition transmission process the factors such as noise jamming influence, can go out in Monitoring data flow
Existing loss of data, clear data, unreasonable data and some abnormal conditions that outrange data etc..The presence of these abnormal datas
The application effect of on-line monitoring system is leveraged, therefore by corresponding method, to collected oil dissolved gas number
According to quality promoted, for improve on-line monitoring system reliability be of great significance.
Recent domestic had some researchs for online quality of data promotion, such as:
In patent " a kind of comprehensive promotion system of grid data quality " (Wuhu university) switch estimation module according to breaker,
Route where disconnecting link, the data for the conductive equipment being connected with breaker, disconnecting link are analyzed, and then to pick out breaker, knife
The state of lock and amendment；State estimation module be a variety of algorithm for estimating are blended externally provide presence estimation service and from
Line state estimation service；The on-line identification of parameter estimation module realization electrical network parameter comprising parameter identification, estimation and assessment.
It switchs estimation module in the patent to stress to recognize the data of breaker, disconnecting link, to recognize its operating status, state is estimated
Meter module, which is laid particular emphasis on, to be carried out prediction to data based on existing data and is estimated based on existing data to state at this time
Meter, parameter Estimation, which is then laid particular emphasis on, is modified the parameter of electric network model.
Patent " a kind of audio data quality optimization method " (Hangzhou Lian Hui digital technology Co., Ltd) discloses a kind of sound
Frequency is according to quality optimization method, detailed process are as follows: the timestamp for first calculating each frame audio data counts, then adjacent two frames sound
Timestamp count difference value of the frequency between is repaired if difference is greater than 5 times of normal difference using timeliness optimization algorithm
Just；If difference is greater than 1.5 times of normal difference and less than 5 times, corrected using quality priority algorithm；If difference is less than just
1.5 times of normal difference, then without amendment.The different difference situations between audio data that the patent is stabbed based on adjacent time
The exceptional value of appearance is handled, to improve the quality of audio data.
Patent " the main website quality of data optimization method of smart grid-oriented supporting system technology " (Beijing Ke Dong electric power
Control system Co., Ltd) quality of data optimization side, main website of smart grid-oriented supporting system technology a kind of is disclosed
Method compares the data source that the data obtained from the higher data source of priority are periodically generated with scene, if normal then not
It optimizing, the data for calling the higher data source of next priority to obtain if abnormal are verified with field data,
Verification is compared by above-mentioned steps, until check results are normal.The patent carries out redundant data and live reference data
Comparison verification, until select with the consistent data of reference data, to select suitable data source.A kind of patent " energy monitor
The optimization device and its optimization method of data " data processing optimization module is received from collection analysis module in (State Grid Corporation of China)
Every power quality index data, and pass through compression, the every power quality index data of optimization；Compress every power quality index
The algorithm of data are as follows: basic value × index value ÷ coefficient is applied in compression.Data-optimized module in the patent is by the rule of data
Mould is compressed, and is not related to the processing of abnormal data.
In conclusion existing online quality of data promotion is not involved with and monitors on-line to Oil Dissolved Gases Concentration
The increased quality measure of data.
Summary of the invention
In view of the deficiencies of the prior art, the invention proposes a kind of promotions of oil dissolved gas online monitoring data quality
Method and system, be able to solve Dissolved Gas Content in Transformer Oil online monitoring data it is of low quality to influence to change
The technical issues of operating status of depressor is judged.
The present invention solves its technical problem and adopts the technical scheme that:
On the one hand, the method for improving of a kind of oil dissolved gas online monitoring data quality provided in an embodiment of the present invention,
It the following steps are included:
S1 obtains the online monitoring data of the Oil Dissolved Gases Concentration of transformer；
S2 is removed the exceptional value in online monitoring data, and is replaced using null value；
S3 carries out completion to null value using cubic spline interpolation；
S4 is differentiated the singular value in online monitoring data using 3 σ rules and is replaced using mode；
S5 is smoothed to remove the random noise and white noise in online monitoring data using low-pass filter；
S6, output carry out the data after quality of data promotion by S1 to S5.
As a kind of possible implementation of the present embodiment, the detailed process of the step S1 are as follows: periodically acquisition transformation
The Oil Dissolved Gases Concentration of device is filled when there is the not record of online monitoring data in a certain period using null value.
As a kind of possible implementation of the present embodiment, the detailed process of the step S2 are as follows: work as online monitoring data
In there is negative value, maximum or the data removed and are replaced using null value when outranging value.
As a kind of possible implementation of the present embodiment, the detailed process of the step S3 are as follows: will be adjacent with null value
Thus two end data real values calculate the corresponding cubic spline function of the air explosion loading as endpoint, and take cubic spline function pair
The value answered replaces the null value.
As a kind of possible implementation of the present embodiment, the detailed process of the step S4 are as follows: to by cubic spline
Data set X after interpolation method is filled a vacancy is calculated, and the desired value E (X), standard deviation SD (X) and mode of data set X is obtained, right
Arbitrary data X (i) is judged in data set, if (X (i)-E (X)) >=3 × SD (X), then it is assumed that X (i) is singular value,
And singular value X (i) is substituted using the mode of data set X.
As a kind of possible implementation of the present embodiment, the detailed process of the step S5 are as follows:
To by data fill a vacancy and abnormal value elimination after data set X=(x1+x2+...+xn), it is slided using shown in following formula
It moves average method and obtains new data set Y=(y1+y2+...+yn), the formula of the method acquisition of the sliding average are as follows:
Meanwhile the data of step point edge position are handled using following formula using the method for reducing smooth region:
For both ends endpoint, formula x is utilizedi=xiCarry out reduction smooth region:
For both ends time endpoint, formula is utilizedCarry out reduction smooth region:
For intermediate point, formula is utilizedCarry out reduction smooth region:
Wherein, xiFor the data of step point edge position.
On the other hand, the promotion system of a kind of oil dissolved gas online monitoring data quality provided in an embodiment of the present invention
System, it includes:
Acquiring unit: for obtaining the online monitoring data of the Oil Dissolved Gases Concentration of transformer；
Replacement unit: it is replaced for removing the exceptional value in online monitoring data, and using null value；
Fill a vacancy unit: for using cubic spline interpolation to null value progress completion；
Culling unit: for differentiating the singular value in online monitoring data using 3 σ rules and being replaced using mode；
Smooth unit: the random noise in online monitoring data is removed for being smoothed using low-pass filter
And white noise；
Output unit: for exporting the data after carrying out quality of data promotion.
As a kind of possible implementation of the present embodiment, the acquiring unit includes:
Obtain module: for periodically acquiring the Oil Dissolved Gases Concentration of transformer；
Complementary module: for filling work using null value when there is the not record of online monitoring data in a certain period
For the online monitoring data in the period.
As a kind of possible implementation of the present embodiment, the replacement unit includes:
Detection module, for detecting in online monitoring data with the presence or absence of exceptional value；
Replacement module, for replacing the exceptional value detected using null value.
As a kind of possible implementation of the present embodiment, the unit of filling a vacancy includes:
Cubic spline function computing module, for thus calculating using the two end data real values adjacent with null value as endpoint
The corresponding cubic spline function of the air explosion loading；
It fills a vacancy module, for taking the corresponding value of cubic spline function to replace the null value.
As a kind of possible implementation of the present embodiment, the culling unit includes:
Computing module obtains data set for calculating the data set X after filling a vacancy by cubic spline interpolation
Desired value E (X), standard deviation SD (X) and the mode of X；
Module is rejected, for judging for arbitrary data X (i) in data set, if (X (i)-E (X)) >=3 × SD
(X), then it is assumed that X (i) is singular value, and substitutes singular value X (i) using the mode of data set X.
As a kind of possible implementation of the present embodiment, the smooth unit includes:
Leveling Block, for being smoothed using low-pass filter, at by fill a vacancy unit and culling unit
Data set X after reason, obtains new data set Y are as follows:
Edge data Leveling Block is carried out for the data for step point edge position using smooth region method is reduced
Processing:
For both ends endpoint, formula x is utilizedi=xiCarry out reduction smooth region:
For both ends time endpoint, formula is utilizedCarry out reduction smooth region:
For intermediate point, formula is utilizedCarry out reduction smooth region:
Wherein, xiFor the data of step point edge position.
What the technical solution of the embodiment of the present invention can have has the beneficial effect that:
Technical solution of the embodiment of the present invention obtains the online monitoring data of the Oil Dissolved Gases Concentration of transformer first；So
The exceptional value that is removed in online monitoring data afterwards is simultaneously replaced using null value, is mended using cubic spline interpolation to null value
Entirely, the singular value in online monitoring data is differentiated using 3 σ rules and replaced using mode, carried out using low-pass filter
Smoothing processing removes a series of processing such as random noise and white noise in online monitoring data, and finally output carries out data matter
Data after amount promotion.Technical solution of the embodiment of the present invention by original online monitoring data carry out data fill a vacancy, it is odd
Different value is rejected, data smoothing is handled, so that treated, data can more characterize actual Oil Dissolved Gases Concentration and change
Gesture is solved since when monitoring on-line to Dissolved Gas Content in Transformer Oil, sensor is by existing in the related technology
Electromagnetic interference influence or sensor failure, and caused by online monitoring data exceptional value it is more, the quality of data is not high
The technical issues of.
Technical solution of the embodiment of the present invention includes acquiring unit, replacement unit, unit of filling a vacancy, culling unit, smooth unit
And output unit, to obtain transformer Oil Dissolved Gases Concentration online monitoring data carry out data are filled a vacancy, singular value is picked
It removes, a series of processing such as data smoothing, so that treated, data can more characterize actual Oil Dissolved Gases Concentration variation
Trend is solved due in the related technology when monitoring on-line to Dissolved Gas Content in Transformer Oil, sensor by
Scene electromagnetic interference influence or sensor failure, and caused by online monitoring data exceptional value it is more, the quality of data is not
High technical problem.
Detailed description of the invention
Fig. 1 is a kind of promotion side of oil dissolved gas online monitoring data quality shown according to an exemplary embodiment
The flow chart of method；
Fig. 2 is a kind of initial data tendency chart shown according to an exemplary embodiment；
Fig. 3 be to Fig. 2 shows initial data carry out data fill a vacancy after data trend figure；
Fig. 4 be to Fig. 2 shows initial data carry out singular value rejecting after data trend figure；
Fig. 5 be to Fig. 2 shows initial data carry out data smoothing before and after data trend figure, wherein Fig. 5 (a) is several
The data trend figure of (enlarged drawing of the data trend figure after the rejecting of singular value shown in Fig. 4), Fig. 5 (b) are that data are flat before smooth
Data trend figure after cunning；
Fig. 6 is a kind of promotion system of oil dissolved gas online monitoring data quality shown according to an exemplary embodiment
The schematic diagram of system.
Specific embodiment
In order to clarify the technical characteristics of the invention, below by specific embodiment, and its attached drawing is combined, to this hair
It is bright to be described in detail.Following disclosure provides many different embodiments or example is used to realize different knots of the invention
Structure.In order to simplify disclosure of the invention, hereinafter the component of specific examples and setting are described.In addition, the present invention can be with
Repeat reference numerals and/or letter in different examples.This repetition is that for purposes of simplicity and clarity, itself is not indicated
Relationship between various embodiments and/or setting is discussed.It should be noted that illustrated component is not necessarily to scale in the accompanying drawings
It draws.Present invention omits the descriptions to known assemblies and treatment technology and process to avoid the present invention is unnecessarily limiting.
Fig. 1 is a kind of promotion side of oil dissolved gas online monitoring data quality shown according to an exemplary embodiment
The flow chart of method.As shown in Figure 1, a kind of promotion of oil dissolved gas online monitoring data quality provided in an embodiment of the present invention
Method, it the following steps are included:
S1 obtains the online monitoring data of the Oil Dissolved Gases Concentration of transformer；
S2 is removed the exceptional value in online monitoring data, and is replaced using null value；
S3 carries out completion to null value using cubic spline interpolation；
S4 is differentiated the singular value in online monitoring data using 3 σ rules and is replaced using mode；
S5 is smoothed to remove the random noise and white noise in online monitoring data using low-pass filter；
S6, output carry out the data after quality of data promotion by S1 to S5.
In one possible implementation, the detailed process of the step S1 are as follows: periodically in the oil of acquisition transformer
Dissolved gas content is filled when there is the not record of online monitoring data in a certain period using null value.Solution gas in oil
The collection period of body on-line monitoring system under normal conditions be one day, i.e., daily record one collection value, therefore, acquisition it is adjacent
Oil Dissolved Gases Concentration data interval also should be equal to the period, if occur in a certain period without record data the case where
When, Ying Liyong null value is filled.When the period is not one, processing method is similar.
In one possible implementation, the detailed process of the step S2 are as follows: when being born in online monitoring data
The data are removed and are replaced using null value by value, maximum or while outranging value.It is possible that negative value in online monitoring data
The case where, this is not inconsistent in actual operating condition, therefore this partial value is removed, and is replaced using null value；Online monitoring data
In some maximum may also occur, these maximum even already exceed monitoring sensor range, this is in the operation of time
Situation is not inconsistent, therefore this partial value is removed, and is replaced using null value.
Such as: the H of collected 2013 Nian Yinian of on-line monitoring system of certain transformer is obtained in the present embodiment altogether2Contain
Amount data totally 314, data are as shown in table 1, from real data it can be found that the on-line monitoring system only collects 314, lose
Lose 51.The trend chart of initial data is drawn as shown in Fig. 2, occurring as can be seen from Figure 2 at the 310th day or so obvious
Singular value.
Table 1:
It is possible that the case where negative value and occurring unreasonable maximum (as being more than range) in online monitoring data,
These data are not met with practical situation.Therefore the negative value detected is replaced using null value, outrange the exceptional values such as data.This
The value for negative value do not occur in the data that embodiment is chosen and outranging does not have in the size for the singular value that the 310th day or so occurs
Have more than 200 μ L/L, still within the acquisition range of oil colours spectrum sensor, therefore its should be considered as due to noise etc. influence and
The singular value of generation, rather than exceptional value.
In one possible implementation, the detailed process of the step S3 are as follows: by two end datas adjacent with null value
Thus real value calculates the corresponding cubic spline function of the air explosion loading as endpoint, and take cubic spline function corresponding value generation
For the null value.Data variation trend of the present embodiment after carrying out data and filling a vacancy is as shown in figure 3, as seen from Figure 3, utilize
Data can be carried out completion in the case where not changing initial data variation tendency by cubic spline interpolation.
In one possible implementation, the detailed process of the step S4 are as follows: mended to by cubic spline interpolation
Data set X after lacking is calculated, and the desired value E (X), standard deviation SD (X) and mode of data set X is obtained, for data set
Middle arbitrary data X (i) is judged, if (X (i)-E (X)) >=3 × SD (X), then it is assumed that X (i) is singular value, and uses number
Singular value X (i) is substituted according to the mode of collection X.
Data trend after singular value rejecting and replacement is carried out to the data of the present embodiment as shown in figure 4, can be with by Fig. 4
Find out, can be in the case where not changing other data based on 3 σ rules, effectively abnormal value elimination.
In one possible implementation, the detailed process of the step S5 are as follows:
To by data fill a vacancy and abnormal value elimination after data set X=(x1+x2+...+xn), it is slided using shown in following formula
It moves average method and obtains new data set Y=(y1+y2+...+yn), the formula of the method acquisition of the sliding average are as follows:
Meanwhile the data of step point edge position are handled using following formula using the method for reducing smooth region:
For both ends endpoint, formula x is utilizedi=xiCarry out reduction smooth region:
For both ends time endpoint, formula is utilizedCarry out reduction smooth region:
For intermediate point, formula is utilizedCarry out reduction smooth region:
Wherein, xiFor the data of step point edge position.
In the present embodiment, by by data fill a vacancy and singular value reject after data carry out smooth, smooth front and back becomes
Gesture is as shown in Figure 5.As shown in Figure 5, can be good at removing random fluctuation, but whole data variation trend after data smoothing
It does not change.When choosing index of the coefficient of variation as one of evaluation data fluctuations situation, it is known that flat in data
Before cunning, the coefficient of variation of data set is 4.486%, and is 3.38% by the coefficient of variation of data set after data smoothing, i.e.,
The coefficient of variation substantially reduces.
The present embodiment obtains the online monitoring data of the Oil Dissolved Gases Concentration of transformer first；Then it is removed
Exceptional value and use null value in line monitoring data replace, carry out completion to null value using cubic spline interpolation, utilize 3 σ methods
Then differentiate the singular value in online monitoring data and replaced using mode, be smoothed and made a return journey using low-pass filter
Except the random noise and a series of processing such as white noise in online monitoring data, finally output is carried out after quality of data promotion
Data.Technical solution of the embodiment of the present invention by carrying out to original online monitoring data, fill a vacancy, singular value is rejected, data by data
Smoothing processing, so that treated, data can more characterize actual Oil Dissolved Gases Concentration variation tendency, solve due to
In the related technology when being monitored on-line to Dissolved Gas Content in Transformer Oil, electromagnetic interference shadow of the sensor by scene
Loud or sensor failure, and caused by online monitoring data exceptional value it is more, the not high technical problem of the quality of data.
Fig. 6 is a kind of promotion system of oil dissolved gas online monitoring data quality shown according to an exemplary embodiment
The schematic diagram of system.As shown in fig. 6, a kind of promotion of oil dissolved gas online monitoring data quality provided in an embodiment of the present invention
System, it includes:
Acquiring unit: for obtaining the online monitoring data of the Oil Dissolved Gases Concentration of transformer；
Replacement unit: it is replaced for removing the exceptional value in online monitoring data, and using null value；
Fill a vacancy unit: for using cubic spline interpolation to null value progress completion；
Culling unit: for differentiating the singular value in online monitoring data using 3 σ rules and being replaced using mode；
Smooth unit: the random noise in online monitoring data is removed for being smoothed using low-pass filter
And white noise；
Output unit: for exporting the data after carrying out quality of data promotion.
In one possible implementation, the acquiring unit includes:
Obtain module: for periodically acquiring the Oil Dissolved Gases Concentration of transformer；
Complementary module: for filling work using null value when there is the not record of online monitoring data in a certain period
For the online monitoring data in the period.
In one possible implementation, the replacement unit includes:
Detection module, for detecting in online monitoring data with the presence or absence of exceptional value；
Replacement module, for replacing the exceptional value detected using null value.
In one possible implementation, the unit of filling a vacancy includes:
Cubic spline function computing module, for thus calculating using the two end data real values adjacent with null value as endpoint
The corresponding cubic spline function of the air explosion loading；
It fills a vacancy module, for taking the corresponding value of cubic spline function to replace the null value.
In one possible implementation, the culling unit includes:
Computing module obtains data set for calculating the data set X after filling a vacancy by cubic spline interpolation
Desired value E (X), standard deviation SD (X) and the mode of X；
Module is rejected, for judging for arbitrary data X (i) in data set, if (X (i)-E (X)) >=3 × SD
(X), then it is assumed that X (i) is singular value, and substitutes singular value X (i) using the mode of data set X.
In one possible implementation, the smooth unit includes:
Leveling Block, for being smoothed using low-pass filter, at by fill a vacancy unit and culling unit
Data set X after reason, obtains new data set Y are as follows:
Edge data Leveling Block is carried out for the data for step point edge position using smooth region method is reduced
Processing:
For both ends endpoint, formula x is utilizedi=xiCarry out reduction smooth region:
For both ends time endpoint, formula is utilizedCarry out reduction smooth region:
For intermediate point, formula is utilizedCarry out reduction smooth region:
Wherein, xiFor the data of step point edge position.
The present embodiment includes acquiring unit, replacement unit, unit of filling a vacancy, culling unit, smooth unit and output unit, right
Obtain the Oil Dissolved Gases Concentration of transformer online monitoring data carry out data fill a vacancy, singular value rejecting, data smoothing etc.
A series of processing, so that treated, data can more characterize actual Oil Dissolved Gases Concentration variation tendency, solve by
In when monitoring on-line to Dissolved Gas Content in Transformer Oil, sensor is by live electromagnetic interference in the related technology
Influence or sensor failure, and caused by online monitoring data exceptional value it is more, the not high technical problem of the quality of data.
The above is the preferred embodiment of the present invention, for those skilled in the art,
Without departing from the principles of the invention, several improvements and modifications can also be made, these improvements and modifications are also regarded as this hair
Bright protection scope.
Claims (8)
1. a kind of method for improving of oil dissolved gas online monitoring data quality, characterized in that the following steps are included:
S1 obtains the online monitoring data of the Oil Dissolved Gases Concentration of transformer；
S2 is removed the exceptional value in online monitoring data, and is replaced using null value；
S3 carries out completion to null value using cubic spline interpolation；
S4 is differentiated the singular value in online monitoring data using 3 σ rules and is replaced using mode；
S5 is smoothed to remove the random noise and white noise in online monitoring data using low-pass filter；
S6, output carry out the data after quality of data promotion by S1 to S5；
The detailed process of the step S4 are as follows: the data set X after filling a vacancy by cubic spline interpolation is calculated, is obtained
Desired value E (X), standard deviation SD (X) and the mode of data set X, judges arbitrary data X (i) in data set, if (X
(i)-E (X)) >=3 × SD (X), then it is assumed that X (i) is singular value, and substitutes singular value X (i) using the mode of data set X；
The detailed process of the step S5 are as follows:
To by data fill a vacancy and abnormal value elimination after data set X=(x1+x2+...+xn), it is flat using sliding shown in following formula
Equal method obtains new data set Y=(y1+y2+...+yn), the formula of the method acquisition of the sliding average are as follows:
Meanwhile the data of step point edge position are handled using the method for reducing smooth region:
For both ends endpoint, formula x is utilizedi=xiCarry out reduction smooth region:
For both ends time endpoint, formula is utilizedCarry out reduction smooth region:
For intermediate point, formula is utilizedCarry out reduction smooth region:
Wherein, xiFor the data of step point edge position.
2. a kind of method for improving of oil dissolved gas online monitoring data quality as described in claim 1, characterized in that institute
State the detailed process of step S1 are as follows: the periodically Oil Dissolved Gases Concentration of acquisition transformer does not have when in the appearance a certain period
When the record of online monitoring data, filled using null value.
3. a kind of method for improving of oil dissolved gas online monitoring data quality as described in claim 1, characterized in that institute
State the detailed process of step S2 are as follows: the data are removed when occurring negative value, maximum in online monitoring data or outranging value
And it is replaced using null value.
4. a kind of method for improving of oil dissolved gas online monitoring data quality as described in claim 1, characterized in that institute
State the detailed process of step S3 are as follows: using the two end data real values adjacent with null value as endpoint, thus calculate the air explosion loading pair
The cubic spline function answered, and the corresponding value of cubic spline function is taken to replace the null value.
5. a kind of lifting system of oil dissolved gas online monitoring data quality, characterized in that include:
Acquiring unit: for obtaining the online monitoring data of the Oil Dissolved Gases Concentration of transformer；
Replacement unit: it is replaced for removing the exceptional value in online monitoring data, and using null value；
Fill a vacancy unit: for using cubic spline interpolation to null value progress completion；
Culling unit: for differentiating the singular value in online monitoring data using 3 σ rules and being replaced using mode；
Smooth unit: random noise in online monitoring data and white is removed for being smoothed using low-pass filter
Noise；
Output unit: for exporting the data after carrying out quality of data promotion.
6. a kind of lifting system of oil dissolved gas online monitoring data quality as claimed in claim 5, characterized in that institute
Stating replacement unit includes:
Detection module, for detecting in online monitoring data with the presence or absence of exceptional value；
Replacement module, for replacing the exceptional value detected using null value.
7. a kind of lifting system of oil dissolved gas online monitoring data quality as claimed in claim 5, characterized in that institute
Stating unit of filling a vacancy includes:
Cubic spline function computing module, for thus calculating the sky using the two end data real values adjacent with null value as endpoint
It is worth the corresponding cubic spline function in region；
It fills a vacancy module, for taking the corresponding value of cubic spline function to replace the null value.
8. a kind of lifting system of oil dissolved gas online monitoring data quality as described in claim 5-7 any one,
It is characterized in that the culling unit includes:
Computing module obtains data set X's for calculating the data set X after filling a vacancy by cubic spline interpolation
Desired value E (X), standard deviation SD (X) and mode；
Module is rejected, for judging for arbitrary data X (i) in data set, if (X (i)-E (X)) >=3 × SD (X),
Then think that X (i) is singular value, and substitutes singular value X (i) using the mode of data set X.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711269974.XA CN108088916B (en) | 2017-12-05 | 2017-12-05 | A kind of method for improving and system of oil dissolved gas online monitoring data quality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711269974.XA CN108088916B (en) | 2017-12-05 | 2017-12-05 | A kind of method for improving and system of oil dissolved gas online monitoring data quality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108088916A CN108088916A (en) | 2018-05-29 |
| CN108088916B true CN108088916B (en) | 2019-06-04 |
Family
ID=62173860
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711269974.XA Active CN108088916B (en) | 2017-12-05 | 2017-12-05 | A kind of method for improving and system of oil dissolved gas online monitoring data quality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108088916B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110674622B (en) * | 2018-07-03 | 2022-12-20 | 百度在线网络技术（北京）有限公司 | Visual chart generation method and system, storage medium and electronic equipment |
| CN109187809A (en) * | 2018-10-27 | 2019-01-11 | 国网山东省电力公司电力科学研究院 | A kind of Gases Dissolved in Transformer Oil data generate in real time and analysis system |
| CN109541096A (en) * | 2018-11-09 | 2019-03-29 | 福建和盛高科技产业有限公司 | 220kV Gases Dissolved in Transformer Oil volume fraction dynamic early-warning method |
| CN110704409A (en) * | 2019-09-21 | 2020-01-17 | 广东毓秀科技有限公司 | Method for optimizing rail transit data quality through data triangular prism algorithm |
| CN110596595A (en) * | 2019-09-25 | 2019-12-20 | 广东毓秀科技有限公司 | Method for predicting RUL of rail-traffic lithium battery through big data |
| CN110907544B (en) * | 2019-11-05 | 2022-06-24 | 国网江苏省电力有限公司南通供电分公司 | Identification method for abnormal step data of content of dissolved gas in transformer oil |
| CN111537704B (en) * | 2020-05-20 | 2022-08-02 | 四川大学 | Online measurement device and method for concentration of dissolved oxygen in fuel oil |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004055858A (en) * | 2002-07-22 | 2004-02-19 | Hitachi Ltd | Diagnostic system for deterioration/remaining life of oil transformer |
| CN105550700A (en) * | 2015-12-08 | 2016-05-04 | 国网山东省电力公司电力科学研究院 | Time series data cleaning method based on correlation analysis and principal component analysis |
| CN106649579A (en) * | 2016-11-17 | 2017-05-10 | 苏州航天系统工程有限公司 | Time-series data cleaning method for pipe net modeling |
| CN107145624A (en) * | 2017-03-28 | 2017-09-08 | 浙江大学 | Gases Dissolved in Transformer Oil online monitoring data antidote based on artificial neural network |
| CN107741984A (en) * | 2017-10-20 | 2018-02-27 | 上海泓戟信息科技有限公司 | Acquisition server, system and method for online monitoring data collection uniformity |
-
2017
- 2017-12-05 CN CN201711269974.XA patent/CN108088916B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004055858A (en) * | 2002-07-22 | 2004-02-19 | Hitachi Ltd | Diagnostic system for deterioration/remaining life of oil transformer |
| CN105550700A (en) * | 2015-12-08 | 2016-05-04 | 国网山东省电力公司电力科学研究院 | Time series data cleaning method based on correlation analysis and principal component analysis |
| CN106649579A (en) * | 2016-11-17 | 2017-05-10 | 苏州航天系统工程有限公司 | Time-series data cleaning method for pipe net modeling |
| CN107145624A (en) * | 2017-03-28 | 2017-09-08 | 浙江大学 | Gases Dissolved in Transformer Oil online monitoring data antidote based on artificial neural network |
| CN107741984A (en) * | 2017-10-20 | 2018-02-27 | 上海泓戟信息科技有限公司 | Acquisition server, system and method for online monitoring data collection uniformity |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108088916A (en) | 2018-05-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108088916B (en) | A kind of method for improving and system of oil dissolved gas online monitoring data quality | |
| CN109633368B (en) | VMD and DFA-based power quality disturbance detection method for power distribution network with distributed power supplies | |
| CN108446864B (en) | Big data analysis-based fault early warning system and method for rail transit equipment | |
| CN116703183B (en) | Novel power distribution network system power load assessment method | |
| CN106096313B (en) | A kind of envelope Analysis Method based on unusual spectral factorization and spectrum kurtosis | |
| CN111459061A (en) | Electric power safety monitoring system based on 5G network | |
| CN103837777B (en) | Electric power system electricity quality evaluation method and system | |
| CN107733737A (en) | A kind of abnormal method of monitoring traffic in network | |
| CN111371188A (en) | Real-time early warning system for abnormal power consumption data | |
| CN113836756B (en) | Intelligent monitoring method and system for annealing process of three-dimensional wound core transformer | |
| CN116828070A (en) | Intelligent power grid data optimization transmission method | |
| CN105718748A (en) | Online monitoring data processing method | |
| CN103941116A (en) | Data compression method for fault recording indicator | |
| CN109581270A (en) | Method based on multi-scale wavelet transform Fast Identification CVT failure | |
| CN110995153A (en) | Abnormal data detection method and device for photovoltaic power station and electronic equipment | |
| CN117407700A (en) | Method for monitoring working environment in live working process | |
| CN106154025A (en) | A kind of combining unit rejects the method for single-point abnormal data | |
| CN102467556A (en) | Power quality intelligent information system and method | |
| CN111178690A (en) | Electricity stealing risk assessment method for electricity consumers based on wind control scoring card model | |
| CN110927497A (en) | Point switch fault detection method and device | |
| CN102707222B (en) | Abnormal frequency point identification method based on character string comparison | |
| CN110995396B (en) | Compression method of communication messages of electricity consumption information acquisition system based on hierarchical structure | |
| CN115078892B (en) | State remote monitoring system for single-machine large-transmission frequency converter | |
| CN116739829A (en) | Big data-based power data analysis method, system and medium | |
| CN106845763B (en) | Power grid reliability analysis method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |