CN101795138A - Compressing method for high density time sequence data in WAMS (Wide Area Measurement System) of power system - Google Patents
Compressing method for high density time sequence data in WAMS (Wide Area Measurement System) of power system Download PDFInfo
- Publication number
- CN101795138A CN101795138A CN 201010034265 CN201010034265A CN101795138A CN 101795138 A CN101795138 A CN 101795138A CN 201010034265 CN201010034265 CN 201010034265 CN 201010034265 A CN201010034265 A CN 201010034265A CN 101795138 A CN101795138 A CN 101795138A
- Authority
- CN
- China
- Prior art keywords
- data
- curve
- point
- sequence
- sparse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000005259 measurement Methods 0.000 title claims abstract description 6
- 238000007906 compression Methods 0.000 claims abstract description 59
- 230000006835 compression Effects 0.000 claims abstract description 58
- 238000006243 chemical reaction Methods 0.000 claims abstract description 45
- 238000007667 floating Methods 0.000 claims abstract description 32
- 238000012545 processing Methods 0.000 claims abstract description 21
- 238000003672 processing method Methods 0.000 claims abstract description 19
- 230000006837 decompression Effects 0.000 claims abstract description 6
- 238000004458 analytical method Methods 0.000 claims description 14
- 230000008569 process Effects 0.000 claims description 14
- 230000009467 reduction Effects 0.000 claims description 5
- 241001269238 Data Species 0.000 claims description 3
- 238000007781 pre-processing Methods 0.000 abstract description 4
- 238000013144 data compression Methods 0.000 description 6
- 238000013500 data storage Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Landscapes
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
The invention relates to a preprocessing method for high density time sequence data in WAMS (Wide Area Measurement System) of a power system before compressed by a dictionary algorithm and a sparse processing method for high density curve data. The preprocessing method means the fixed point and increased processing of floating point data to be compressed, and comprises the following steps of defining conversion coefficients of each measure according to the precision requirement of WAMS data, and forming an integer fixed point data sequence after multiplying all the floating point data with the conversion coefficients; making subtraction to adjacent points of the fixed point data sequence to obtain an increased data sequence; and compressing the increased data sequence with an LZW (Lempel Ziv Welch ) algorithm, and reversely processing in order during decompression. The sparse processing method for high density curve data comprises the following steps of: extracting a data sequence when the curve data exceed a certain point number; compressing the data sequence with a swinging door compression algorithm; processing time scales according to key point values obtained by compression and the number of compressed points among key points; and drawing an original curve when the curve is scaled to the range below the point number limit.
Description
Technical field
The invention belongs to the dispatching automation of electric power systems field, particularly relate to a kind of compression processing method of dynamic security observation process middle-high density time series data.
Background technology
The cover dispatch automated system that electrical power system wide-area measuring system (hereinafter to be referred as WAMS) is made up of the monitoring main website of PMU and control centre.This system can provide the dynamic process of operation of power networks for dispatcher and operating analysis personnel.Along with popularization and the practicability construction that WAMS uses, the WAMS data have become the necessary information that grid event is analyzed, and stale data is required to store fully, and event data even be required longer-term storage is for ex-post analysis and research.
Because the dynamic data of WAMS has at a high speed, high density, high-precision characteristics, on average 50 frames are transmitted each second in each monitoring point, even 100 frame dynamic datas, for big electrical network, the data that produce are magnanimity, if these data are directly stored, will take a large amount of disk spaces.Simultaneously, because high density, the high accuracy of data, the data of being stored have a lot of repeated characteristics, therefore, and efficient storage WAMS dynamic data how, and to realize analyzing efficiently retrieval be a technology that is worth research.The patent of application before the applicant " dynamic data compression storage method in the electrical network WAMS (WAMS) " (patent publication No.: 200710179274) once proposed dynamic data lossless compress storage means, this method has become the necessary means of WAMS dynamic data storage, but, development along with the WAMS construction, data volume is more and more huger, huge data volume is to data access efficiency, compression ratio, and the drafting of data and curves is all had higher requirement.
The present invention is based on practice and accumulation, proposed to realize the method for high compression rate, efficient drawing data curve.
Summary of the invention
The objective of the invention is not lose under the prerequisite of original precision, treat packed data and carry out preliminary treatment, further improve compression ratio and compression efficiency in WAMS data available accuracy claimed range.Its specific implementation method is as follows:
Processing method of data to be compressed among a kind of electrical power system wide-area measuring system WAMS, described method comprises that treating packed data carries out floating data fixed point and the processing of fixed-point data increment in turn, the incremental data sequence obtains fixing a point, compress, store by lossless compression algorithm again, during decompress(ion), handle by increment reduction and conversion coefficient reduction, obtain original floating-point numerical value; It is characterized in that, the treating method comprises following steps:
(1) according to the requirement of WAMS accuracy in measurement, conversion coefficient is set.Conversion coefficient is a constant that is used for realizing numerical value conversion between floating data to be compressed and the integer fixed-point number, floating data to be compressed is multiplied by conversion coefficient and rounds, can obtain the integer fixed-point number, the integer fixed-point number removes last conversion coefficient, can obtain floating number, the value of conversion coefficient is the key factor that guarantees whether the floating data precision loses before and after conversion, and conversion coefficient is got the inverse of WAMS accuracy in measurement index among the present invention, precision index as frequency is 0.001Hz, and conversion coefficient should be 1000;
(2) the electrical power system wide-area measuring system is measured floating number to be compressed in the data and be multiplied by separately conversion coefficient one by one, round numbers is a significant figure, gives up decimal;
(3) with the integer that obtains with the time be designated as preface and form integer fixed-point data sequence;
(4) to integer fixed-point data sequence since second number, poor to previous numerical value in turn, obtain sequence of differences;
(5) integer fixed-point data sequence first number and sequence of differences are formed increment fixed-point data sequence;
(6) with the increment fixed-point data sequence input dictionary compression algorithm that obtains, finish compression;
(7) Frame that described conversion coefficient and compression algorithm are returned is formed the result data that is used for storing;
(8) the index management address data memory of forming by data ID and data markers deposits result data in file.
Wherein said conversion coefficient becomes the part of the result data that deposits data file in.
To being through the decompress(ion) step of described pretreated data after compression, storage:
According to data ID and data markers search index address data memory, extract the result data of storage, be put into the data processing buffer memory;
With being decomposed into conversion coefficient and data DATA in the metadata cache, data DATA is carried out data decompression with the decompression algorithm of lossless compress, the incremental data sequence obtains fixing a point;
Second number in the incremental data sequence is added first number, obtain the integer fixed-point value of second number, the 3rd integer fixed-point number that adds second number obtains the integer fixed-point number of the 3rd number, finishes the conversion of all incremental datas to original integer fixed-point number successively;
After the integer fixed-point number that obtains removed last conversion coefficient, be converted to floating number, obtain available initial data.
The invention also discloses the sparse processing method of a kind of electrical power system wide-area measuring system (WAMS) middle-high density time series data curve plotting.By the lossy compression method method, under the prerequisite that keeps curvilinear characteristic, the high density data curve is carried out sparse drafting, the low-density data and curves is drawn fully, satisfies quick tracing analysis demand.Described sparse processing method is specifically by the following technical solutions:
The sparse processing method of a kind of electrical power system wide-area measuring system middle-high density time series data curve, described method is carried out rarefaction to the curve data that surpasses the set point number restriction and is handled, adopt the revolving door algorithm to compress, and the key point data that compression obtains are put original markers, draw key point data sequence curve as the sparse curve of high density;
It is characterized in that described sparse processing method may further comprise the steps:
(1) according to the tracing analysis demand, set sparse threshold value, promptly count the restriction and the compression accuracy threshold value;
(2) according to described compression accuracy threshold value, surpass when counting restriction counting of curve data sequence, adopt the revolving door algorithm to compress, being no more than the restriction of counting and then data not compressed; The result that compression obtains comprises curve key point data sequence and number of compressed points among key points sequence;
(3) according to by the continuous time scale information of sparse curve and number of compressed points among key points sequence, to key point data sequence replacement markers, the time be designated as the corresponding markers of initial data;
(4) draw sparse curve with the sparse band markers key point data sequence that obtains;
(5) amplify when showing when selecting curve zone, sparse back to carry out regional curve, when it counts less than described sparse threshold value, directly use the primitive curve before the compression selected zone in, otherwise, the curve that compresses after sparse used.
According to sparse threshold value, i.e. the restriction of counting can switch sparse curve and initial data curve, makes things convenient for trend analysis and the accurately selection of process analysis procedure analysis.
The WAMS dynamic data compression processing method that the present invention proposes can improve the compression ratio and the compression efficiency of Electrical Power System Dynamic storage, and the sparse processing means of dynamic data curve plotting are provided, and has improved the speed of curve plotting and analysis.
Description of drawings
The present invention is further described in more detail below in conjunction with accompanying drawing and concrete exemplifying embodiment.
Fig. 1 comprises the compression process of fixed point and increment preprocessing process;
The sparse handling process of Fig. 2 high density curve;
Fig. 3 data store organisation schematic diagram;
Embodiment
Floating number is through after calculating and changing, the residual value at random that can have position, the error of calculation and decimal end, therefore, floating number can not equate usually, often judge equating of floating number less than a very little numerical value in the mathematical computations with difference, here the similitude that these characteristics is defined as floating number is poor, and the similitude difference is brought very big influence to lossless compression algorithm.With dictionary class compression algorithms such as LZW is example, and when the data similarity difference, compression is handled can increase statistics and cycle-index exponentially, thereby reduces compression ratio and compression efficiency.The collection link of WAMS data has the full accuracy requirement to data, as frequency accuracy be ± 0.001Hz, the 4th frequency numerical value is not in fact in the required precision scope behind the decimal point, and it is insincere, if reject the 4th later decimal, can not influence the service precision of WAMS data, and can improve data similarity greatly.Therefore, (conversion coefficient is a constant that is used for realizing numerical value conversion between floating data to be compressed and the integer fixed-point number, and floating data to be compressed is multiplied by conversion coefficient and rounds, and can obtain the integer fixed-point number by conversion coefficient in the present invention, the integer fixed-point number can obtain floating number divided by conversion coefficient.The value of conversion coefficient is the key factor that guarantees whether the floating data precision loses before and after conversion, conversion coefficient is got the inverse of WAMS accuracy in measurement index among the present invention, precision index as frequency is 0.001Hz, conversion coefficient should be 1000) floating data of sampling is converted to the integer fixed-point number, generate the fixed-point data sequence, effectively improved the similarity of data.
Except that required precision, another feature of WAMS data is: under stable situation, the increment of continuous sampling data is similar often.In the power system operation, most of data belong to steady state data, and therefore, the similitude of the increment of adjacent data is very high.The present invention obtains increment fixed-point data sequence by the fixed-point data sequence is carried out the increment processing, has further improved the data similarity.
After carrying out fixed point and increment processing at the same time, the increment fixed-point data sequence that obtains is compressed with dictionary class compression algorithms such as LZW, compression ratio and compression efficiency can be largely increased owing to the raising of data similarity.
Fig. 1 dynamic data access procedure schematic diagram.As shown in Figure 1, preprocessing to-be-compressed data is as follows in the electrical power system wide-area measuring system (WAMS):
(1) obtains initial data;
(2) initial data is carried out the fixed point conversion process by conversion coefficient: floating number to be compressed is multiplied by separately conversion coefficient one by one, and round numbers is a significant figure, gives up decimal; With the integer that obtains with the time be designated as preface and form integer fixed-point data sequence;
(3) the fixed-point data sequence is carried out the increment processing:, poor to previous numerical value in turn to integer fixed-point data sequence since second number, obtain sequence of differences; Integer fixed-point data sequence first number and sequence of differences are formed increment fixed-point data sequence;
(4) fixed point incremental data sequence is compressed with the LZW compression algorithm;
(5) data ID and markers TIMESTAMP are formed index, the data DATA framing that data transaction coefficient COEFF and compression are obtained;
(6) cross the index management address data memory that data ID and data markers are formed, deposit result data in file.
The dynamic data storage process has adopted the processing method of the single flow direction, finish fixed point and increment preliminary treatment, data compression, data organization, storage in turn, advantages of simplicity and high efficiency is handled and have been guaranteed high-speed, high accuracy, highdensity dynamic data storage efficient.The process serial process of when data are used, then using according to data query, data parsing, data decompression, incremental data recovery, floating data recovery, data.
Electric power system data has dynamic continuity, can be along with the time changes continuously, variation between the consecutive points is similar often, in WAMS, data sampling has the certain precision restriction, is 0.001Hz as the frequency full accuracy, still, in numeric representation and handling, floating number also can be owing to the error of calculation except the precision as the 0.001Hz of frequency, the residual value of factor generation＜0.001Hz such as transformed error is when representing floating number with byte, to cause the position, end different, this can influence the similar dictionary compression algorithm of LZW, influences dictionary size, influences statistical operation number of times etc., thereby influence compression ratio and compression efficiency, simultaneously, the changing value between the continuous data consecutive points is close, obtain changing value after, the similitude of data sequence also can improve, original data sequence then can't reach the similarity of changing value, therefore, if can eliminate useless residual value, and make good use of changing value between consecutive points, to very meaningful based on the similar dictionary compression algorithm of LZW.The present invention sums up this rule, adopts following method to realize the processing of data to be compressed:
(1) finds initial data corresponding conversion coefficient;
(2) floating number is multiplied by conversion coefficient one by one, round numbers is a significant figure, gives up decimal;
(3) with the integer that obtains with the time be designated as preface and form integer fixed-point data sequence;
(4) to integer fixed-point data sequence since second number, poor to previous numerical value in turn, obtain sequence of differences;
(5) integer fixed-point data sequence first number and sequence of differences are formed the incremental data sequence;
(6) with the increment fixed-point data sequence input dictionary compression algorithm that obtains, finish compression;
(7) Frame that described conversion coefficient and compression algorithm are returned is formed the result data that is used for storing;
(8) the index management address data memory of forming by data ID and data markers deposits result data in file.
The invention also discloses the sparse processing method of a kind of electrical power system wide-area measuring system (WAMS) middle-high density time series data curve plotting.High density is one of characteristics of WAMS data and curves, is example with the uploading rate of per second 50 frames, and curve had 3000 points in 1 minute, tended to use tens of minutes in actual applications, even the curve of a few hours, counting of needing to draw will reach hundreds thousand of more than.If be plotted to fully in the curve chart, curve plotting efficient can be very low, and actual curve is when analyzing, what the high density curve was more paid close attention to is curvilinear trend, only needs to see crucial curvilinear characteristic, therefore, curve data is carried out sparse the permission, also is necessary.
To data are sparse two kinds of methods are arranged, a kind of is uniformly-spaced to get a little, and another kind is to get a little by the algorithm unequal interval.Uniformly-spaced get and to calculate simply, and processing time sequence data markers is very convenient, but the curve key feature can uniformly-spaced not occur, and therefore, the present invention selects unequal interval to get a method to carry out sparse.Except that the key point feature, the markers of WAMS data and curves also is to consider that this requires Corresponding Sparse Algorithm not only can provide the data sequence of key point, and will conveniently recover the key point markers.The revolving door algorithm is a kind of bathmometry, this algorithm is in the dead zone range of setting, with the data linearisation, and with the data outside the dead band as linearizing flex point, from flex point, data sequence becomes another kind of slope, enter next section linearisation, flex point is exactly the key point in the curve, just can satisfy the sparse requirement of curve, therefore, the present invention is based on the revolving door algorithm, realized a kind ofly can finding out the key point data sequence, and, obtained sparse processing method with markers key point data sequence according to number of compressed points among key points processing time scales information.
When the high density curve data by after sparse, tracing analysis may need to select certain change point wherein to carry out labor, if the local curve of labor still adopts sparse data, then easily explication de texte is impacted, therefore, when select count less than some (can set) time, primitive curve is directly drawn in the no longer sparse processing of curve data.
Fig. 2 is the sparse process chart of high density curve.The WAMS high density time sequence data, data volume is big, and the markers requirement is arranged, and when formation curve is analyzed, following requirement is arranged:
1) curve plotting speed is fast;
2) the high density curve is paid close attention to crucial variation characteristic, and crucial variation characteristic can not be lost;
3) explication de texte keeps the feature of initial data.
As shown in Figure 2, the process of data compression is as follows:
(1) according to the tracing analysis demand, set sparse threshold value, promptly count the restriction and the compression accuracy threshold value;
(2) according to described compression accuracy threshold value, surpass when counting restriction counting of curve data sequence, adopt the revolving door algorithm to compress, be no more than threshold value and then data do not compressed; The result that compression obtains comprises curve key point data sequence and number of compressed points among key points sequence;
(3) according to by the continuous time scale information of sparse curve and number of compressed points among key points sequence, to key point data sequence replacement markers, the time be designated as the corresponding markers of initial data;
(4) draw sparse curve with the sparse band markers key point data sequence that obtains;
(5) amplify when showing when selecting curve zone, sparse back to carry out regional curve, when it counts less than described sparse threshold value, directly use the primitive curve before the compression selected zone in, otherwise, the curve that compresses after sparse used;
For the curve of counting above certain scale, any curve plotting method all can't resolve speed issue, therefore, must curve data point be carried out sparsely by special treatment method, algorithm of the present invention is the revolving door algorithm, it is a kind of lossy compression method algorithm rapidly and efficiently, this algorithm with curve linearization, keeps crucial variation characteristic in the required precision scope, obtaining the flex point curve, is to realize the sparse preferably selection of curve.The characteristics that the present invention is based on the requirement of WAMS data precise time label and this algorithm are improved on standard revolving door algorithm basis, have following characteristics after the improvement:
1) can export the floating data sequence of flex point;
2) can export and be compressed the shaping data sequence of counting between flex point;
3), each data point of floating data sequence is given for change accurate markers based on two data sequences and initial data markers.
Data compression is returned a float type data sequence and an int type data sequence to treat that all sparse curve data sequence serves as that processing is compressed in input, comes into operation after the processing time scales, and realization flow is as follows:
(1) needing to obtain sparse curve data sequence and swinging door compression algorithm precision threshold value;
(2) according to required precision the curve data sequence is compressed, obtained compression result, the result comprises curve key point data sequence and number of compressed points among key points sequence;
(3) according to by the continuous time scale information of sparse curve and number of compressed points among key points sequence, to key point data sequence replacement markers, the time be designated as the corresponding markers of initial data;
(4) draw coefficient curve with the sparse band markers key point data sequence that obtains.
When using, not all curve all needs to carry out sparse processing, therefore, needs sparse threshold value of counting of definition, when counting above threshold value, adopts sparse processing, otherwise, directly use primitive curve.
Fig. 3 is that the data preliminary treatment is after the data store organisation schematic diagram after the lzw algorithm compression.The WAMS data have that the information content is simple, high speed and three characteristics of magnanimity, and these three characteristics have very high requirement to storage efficiency, and the present invention has adopted the file memory method based on the B+ tree algorithm, and this method mainly comprises following characteristics:
1) adopt the B+ tree algorithm to carry out storage and visit;
2) adopt keyword to store in order, keyword can be data structure arbitrarily;
3) support is to the constant step velocity of data query, insertion, deletion.
Referring to Fig. 3, KEY is a data structure, in the WAMS dynamic data, needs two information of ID and TIMESTAMP at least, and the structure of KEY is as follows in implementation process:
Struct?KEY_DATA
{
int?iDataID；
int?iMinute；
}；
Wherein, iDataID is data directory ID value, and iMinute is data time sign TIMESTAMP.
According to use experience, dynamic data each minute compression once is best, and therefore for packed data, per minute carries out index with a KEY, and according to iDataID and two information stores of iMinute and data query, the B+ tree algorithm is adopted in storage and inquiry.
In data store organisation, COEFF is used for representing the data transaction coefficient, and this information is used for reduction numerical value transformation result when data read, and fixed-point data is reverted to floating data, DATA then is through the packet after the data compression, and this packet has only through using behind the compression algorithm decompress(ion).
It more than is the following detailed description of the embodiment of the present invention.Although shown in and described exemplary embodiments be expressed as most preferably, be understood that in not breaking away from the scope of the present disclosure that following claim limits and can carry out various changes and modification.
Claims (5)
1. processing method of data to be compressed among the electrical power system wide-area measuring system WAMS, described method comprises that treating packed data carries out floating data fixed point and the processing of fixed-point data increment in turn, the incremental data sequence obtains fixing a point, compress, store by lossless compression algorithm again, when decompress(ion), handle by increment reduction and conversion coefficient reduction, obtain original floating-point numerical value; It is characterized in that, the treating method comprises following steps:
(1) according to the requirement of WAMS accuracy in measurement, conversion coefficient is set: described conversion coefficient is a constant that is used for realizing numerical value conversion between floating data to be compressed and the integer fixed-point number, floating data to be compressed is multiplied by conversion coefficient and rounds, can obtain the integer fixed-point number, the integer fixed-point number can obtain floating number divided by conversion coefficient;
(2) the electrical power system wide-area measuring system is measured floating number to be compressed in the data and be multiplied by separately conversion coefficient one by one, round numbers is a significant figure, gives up decimal;
(3) with the integer that obtains with the time be designated as preface and form integer fixed-point data sequence;
(4) to integer fixed-point data sequence since second number, poor to previous numerical value in turn, obtain sequence of differences;
(5) integer fixed-point data sequence first number and sequence of differences are formed increment fixed-point data sequence;
(6) with the increment fixed-point data sequence input dictionary compression algorithm that obtains, finish compression;
(7) Frame that described conversion coefficient and compression algorithm are returned is formed the result data that is used for storing;
(8) the index management address data memory of forming by data ID and data markers deposits result data in file.
2. processing method of data to be compressed according to claim 1, wherein said conversion coefficient becomes the part of the result data that deposits data file in.
3. according to the described processing method of data to be compressed of claim 1-2, the decompress(ion) step of the data after the described processing of process after compression, storage is:
According to data ID and data markers search index address data memory, extract the result data of storage, be put into the data processing buffer memory;
The data processing buffer memory is decomposed into conversion coefficient and data DATA, data DATA is carried out data decompression with the decompression algorithm of lossless compress, the incremental data sequence obtains fixing a point;
Second number in the incremental data sequence is added first number, obtain the integer fixed-point value of second number, the 3rd integer fixed-point number that adds second number obtains the integer fixed-point number of the 3rd number, finishes the conversion of all incremental datas to original integer fixed-point number successively;
With the integer fixed-point number that obtains divided by conversion coefficient after, be converted to floating number, obtain available initial data.
4. sparse processing method of electrical power system wide-area measuring system middle-high density time series data curve, described method is carried out rarefaction to the curve data that surpasses the set point number restriction and is handled, adopt the revolving door algorithm to compress, and the key point data that compression obtains are put original markers, draw key point data sequence curve as the sparse curve of high density; It is characterized in that described sparse processing method may further comprise the steps:
(1), sets sparse threshold value, promptly count restriction and compression accuracy threshold value according to the tracing analysis demand;
(2) adopt the revolving door algorithm to compress according to described compression accuracy threshold value to the curve data sequence, obtain compression result, the result comprises curve key point data sequence and number of compressed points among key points sequence;
(3) according to by the continuous time scale information of sparse curve and number of compressed points among key points sequence, to key point data sequence replacement markers, the time be designated as the corresponding markers of initial data;
(4) draw sparse curve with the sparse band markers key point data sequence that obtains;
(5) amplify when showing when selecting curve zone, sparse back to carry out regional curve, if it when counting less than described sparse threshold value, directly uses the primitive curve before the compression selected zone in, otherwise, use the curve that compresses after sparse.
5. the sparse processing method of high density time sequence curve data according to claim 4 is characterized in that: according to sparse threshold value, i.e. the restriction of counting can switch sparse curve and initial data curve, makes things convenient for trend analysis and the accurately selection of process analysis procedure analysis.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010034265 CN101795138B (en) | 2010-01-19 | 2010-01-19 | Compressing method for high density time sequence data in WAMS (Wide Area Measurement System) of power system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010034265 CN101795138B (en) | 2010-01-19 | 2010-01-19 | Compressing method for high density time sequence data in WAMS (Wide Area Measurement System) of power system |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210307848.XA Division CN102811062B (en) | 2010-01-19 | 2010-01-19 | Curve sparse processing method for high-density time sequence data in power system wide-area measurement system (WAMS) |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101795138A true CN101795138A (en) | 2010-08-04 |
| CN101795138B CN101795138B (en) | 2013-01-16 |
Family
ID=42587585
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010034265 Active CN101795138B (en) | 2010-01-19 | 2010-01-19 | Compressing method for high density time sequence data in WAMS (Wide Area Measurement System) of power system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101795138B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104637089A (en) * | 2015-02-15 | 2015-05-20 | 腾讯科技（深圳）有限公司 | Three-dimensional model data processing method and device |
| CN105024702A (en) * | 2015-07-08 | 2015-11-04 | 西安理工大学 | Floating-point-type data lossless compression method for scientific calculation |
| CN105259756A (en) * | 2015-10-20 | 2016-01-20 | 广东电网有限责任公司电力科学研究院 | Power plant control loop model identification method and system |
| CN105593774A (en) * | 2013-10-25 | 2016-05-18 | 发纮电机株式会社 | Programmable display device, and program |
| CN105718218A (en) * | 2016-01-19 | 2016-06-29 | 国电南瑞三能电力仪表(南京)有限公司 | Compressed storage method and system applicable for load records of electric energy meter or concentrator |
| CN108021650A (en) * | 2017-11-30 | 2018-05-11 | 冶金自动化研究设计院 | A kind of efficient storage of time series data and reading system |
| CN108984723A (en) * | 2018-07-10 | 2018-12-11 | 阿里巴巴集团控股有限公司 | Creation index, data query method, apparatus and computer equipment |
| CN111651490A (en) * | 2020-06-04 | 2020-09-11 | 深圳前海微众银行股份有限公司 | Data screening method, device, equipment and computer storage medium |
| CN112380268A (en) * | 2020-10-27 | 2021-02-19 | 国网宁夏电力有限公司经济技术研究院 | Method, device, equipment and storage medium for compressing equally spaced time series |
| CN113078908A (en) * | 2021-03-10 | 2021-07-06 | 杭州又拍云科技有限公司 | Simple encoding and decoding method suitable for time sequence database |
| CN113505774A (en) * | 2021-07-14 | 2021-10-15 | 青岛全掌柜科技有限公司 | Novel policy identification model size compression method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4049793B2 (en) * | 2003-09-02 | 2008-02-20 | 日本電信電話株式会社 | Floating point signal lossless encoding method, decoding method, apparatus thereof, program, and recording medium thereof |
| CA2580146A1 (en) * | 2004-09-13 | 2006-03-23 | Expway | Method for compressing and decompressing a sequence of floating point numbers |
-
2010
- 2010-01-19 CN CN 201010034265 patent/CN101795138B/en active Active
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105593774A (en) * | 2013-10-25 | 2016-05-18 | 发纮电机株式会社 | Programmable display device, and program |
| CN104637089A (en) * | 2015-02-15 | 2015-05-20 | 腾讯科技（深圳）有限公司 | Three-dimensional model data processing method and device |
| CN105024702A (en) * | 2015-07-08 | 2015-11-04 | 西安理工大学 | Floating-point-type data lossless compression method for scientific calculation |
| CN105259756A (en) * | 2015-10-20 | 2016-01-20 | 广东电网有限责任公司电力科学研究院 | Power plant control loop model identification method and system |
| CN105259756B (en) * | 2015-10-20 | 2018-05-04 | 广东电网有限责任公司电力科学研究院 | Power plant's control loop identification Method and system |
| CN105718218A (en) * | 2016-01-19 | 2016-06-29 | 国电南瑞三能电力仪表(南京)有限公司 | Compressed storage method and system applicable for load records of electric energy meter or concentrator |
| CN108021650A (en) * | 2017-11-30 | 2018-05-11 | 冶金自动化研究设计院 | A kind of efficient storage of time series data and reading system |
| CN108984723A (en) * | 2018-07-10 | 2018-12-11 | 阿里巴巴集团控股有限公司 | Creation index, data query method, apparatus and computer equipment |
| CN111651490A (en) * | 2020-06-04 | 2020-09-11 | 深圳前海微众银行股份有限公司 | Data screening method, device, equipment and computer storage medium |
| CN112380268A (en) * | 2020-10-27 | 2021-02-19 | 国网宁夏电力有限公司经济技术研究院 | Method, device, equipment and storage medium for compressing equally spaced time series |
| CN112380268B (en) * | 2020-10-27 | 2022-03-18 | 国网宁夏电力有限公司经济技术研究院 | Method, device, equipment and storage medium for compressing equally spaced time series |
| CN113078908A (en) * | 2021-03-10 | 2021-07-06 | 杭州又拍云科技有限公司 | Simple encoding and decoding method suitable for time sequence database |
| CN113505774A (en) * | 2021-07-14 | 2021-10-15 | 青岛全掌柜科技有限公司 | Novel policy identification model size compression method |
| CN113505774B (en) * | 2021-07-14 | 2023-11-10 | 众淼创新科技(青岛)股份有限公司 | Policy identification model size compression method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101795138B (en) | 2013-01-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101795138B (en) | Compressing method for high density time sequence data in WAMS (Wide Area Measurement System) of power system | |
| CN109684352B (en) | Data analysis system, data analysis method, storage medium, and electronic device | |
| CN116192971B (en) | Intelligent cloud energy operation and maintenance service platform data management method | |
| CN100595596C (en) | Dynamic data compression storage method in electric network wide-area measuring systems (WAMS) | |
| JP7279266B2 (en) | Methods and apparatus for storing and querying time series data, and their servers and storage media | |
| CN102427369B (en) | Real-time holographic lossless compression method for productive time sequence data | |
| CN101923569B (en) | Storage method of structure type data of real-time database | |
| CN102510287B (en) | Method for rapidly compressing industrial real-time data | |
| Liakos et al. | Chimp: efficient lossless floating point compression for time series databases | |
| US20200185058A1 (en) | Gene sequencing data compression preprocessing, compression and decompression method, system, and computer-readable medium | |
| Kraus et al. | Optimal data compression techniques for smart grid and power quality trend data | |
| CN109582708A (en) | A kind of time series database system | |
| CN111859070A (en) | Mass internet news cleaning system | |
| CN116702708A (en) | Road pavement construction data management system | |
| CN102811062B (en) | Curve sparse processing method for high-density time sequence data in power system wide-area measurement system (WAMS) | |
| CN115913247A (en) | Deep lossless compression method and system for high-frequency power data | |
| CA2364820A1 (en) | Variable length encoding and decoding of ascending numerical sequences | |
| CN105005464A (en) | Burrows Wheeler Transform hardware processing apparatus | |
| CN115964347B (en) | Intelligent storage method for data of market supervision and monitoring center | |
| CN111930725A (en) | Distribution and utilization data compression and fusion method and device | |
| CN101196921A (en) | Long sequence data dimensionality reduction method used for approximate query | |
| CN115203290A (en) | Fault diagnosis method based on multi-dimensional prefix span algorithm | |
| Zhen et al. | Design and realization of data compression in real-time database | |
| Huang et al. | A lossless data compression algorithm for real-time database | |
| CN117251532B (en) | Large-scale literature mechanism disambiguation method based on dynamic multistage matching |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C53 | Correction of patent for invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: Xu Junde Inventor after: Wang Liang Inventor after: Yang Dong Inventor after: Wu Jingtao Inventor before: Yang Dong Inventor before: Xu Junde Inventor before: Wu Jingtao |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: YANG DONG XU JUNDE WU JINGTAO TO: XU JUNDE WANG LIANG YANG DONG WU JINGTAO |
|
| ASS | Succession or assignment of patent right |
Owner name: ELECTRIC POWER DISPATCH CONTROL CENTER OF GUIZHOU Free format text: FORMER OWNER: BEIJING SIFANG JIBAO ENGINEERING TECHNOLOGY CO., LTD. Effective date: 20140523 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20140523 Address after: 100085 Beijing city on the base of the information industry on the street, No. four, No. 9, Haidian District Patentee after: Beijing Sifang Jibao Automation Co., Ltd. Patentee after: Electric Power Dispatch Control Center of Guizhou Grid Corporation Address before: 100085 Beijing city on the base of the information industry on the street, No. four, No. 9, Haidian District Patentee before: Beijing Sifang Jibao Automation Co., Ltd. Patentee before: Beijing Sifang Jibao Engineering Technology Co., Ltd. |