CN111766471A - Power waveform compression algorithm - Google Patents
Power waveform compression algorithm Download PDFInfo
- Publication number
- CN111766471A CN111766471A CN202010594835.XA CN202010594835A CN111766471A CN 111766471 A CN111766471 A CN 111766471A CN 202010594835 A CN202010594835 A CN 202010594835A CN 111766471 A CN111766471 A CN 111766471A
- Authority
- CN
- China
- Prior art keywords
- data
- compression algorithm
- power waveform
- byte
- difference value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
- G01R31/08—Locating faults in cables, transmission lines, or networks
- G01R31/081—Locating faults in cables, transmission lines, or networks according to type of conductors
- G01R31/086—Locating faults in cables, transmission lines, or networks according to type of conductors in power transmission or distribution networks, i.e. with interconnected conductors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
- G01R31/08—Locating faults in cables, transmission lines, or networks
- G01R31/088—Aspects of digital computing
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
- H03M7/70—Type of the data to be coded, other than image and sound
Abstract
The invention discloses a power waveform compression algorithm, which specifically comprises the following steps: carrying out noise reduction processing on the acquired analog quantity data according to a set period, and carrying out filtering pretreatment on the analog quantity subjected to noise reduction processing to form a new sampling value; performing incremental calculation on the new sampling value and the old sampling value obtained in the previous sampling period until a minimum digit data sequence is obtained and storing the minimum digit data sequence; and performing later compression by adopting a conventional compression algorithm. The invention achieves higher compression ratio by organically combining the compression algorithm of incremental calculation with the traditional compression algorithm, the compression ratio can reach below 25% under the condition of steady-state power waveform, and the power waveform data of not less than one month can be continuously recorded and stored by combining the size of the storage module, thereby providing data support for the research and analysis of a power system.
Description
Technical Field
The invention relates to the technical field of data processing of power system operation equipment, in particular to a method for processing power waveform data.
Background
The fault diagnosis, the electric energy quality analysis and the research of the power grid operation state in the operation process of the power system all depend on power waveform recording data, and the collection of the power waveform is usually completed by wave recording equipment. However, because the operating frequency of the power system is relatively fixed, the sampling rate of a common wave recording device is far higher than the operating frequency of the system, the sampling resolution is generally 12 to 24 bits, and the increment of adjacent sampling points is small, the existing wave recording device can only record short-term data at the fault moment or store waveform data in a short time, and cannot provide support for research and analysis of the power system.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a power waveform compression algorithm with a high compression ratio to realize the storage of a large amount of power waveform data and provide data support for the research and analysis of a power system.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows.
A power waveform compression algorithm specifically comprises the following steps:
A. the acquired analog data is subjected to noise reduction processing according to a set period,
B. carrying out filtering pretreatment on the analog quantity subjected to noise reduction treatment to form a new sampling value;
C. performing incremental calculation on the new sampling value and the old sampling value obtained in the previous sampling period until a minimum digit data sequence is obtained and storing the minimum digit data sequence;
D. and performing later compression by adopting a conventional compression algorithm.
In the above power waveform compression algorithm, the incremental calculation method in step C includes: subtracting the data of the previous sampling point from the original data of the current sampling point to obtain a first difference value; and subtracting the previous difference value from the current difference value to obtain data of a second difference value, wherein the second difference value sequence of the group of data is the finally obtained minimum digit data sequence.
In the above power waveform compression algorithm, in the step C, the minimum number of bits is represented by 4 bits, the highest bit in the 4-bit byte is a deviation out-of-range bit, the deviation out-of-range bit is an extended data byte followed by the extended data byte, the highest bit of the extended data byte is 1, which indicates that the next byte is still an extended byte, and the highest bit is 0, which indicates that the next byte is no longer an extended byte.
The power waveform compression algorithm is characterized in that the conventional compression algorithm in the step D adopts an LZ77 compression algorithm.
Due to the adoption of the technical scheme, the technical progress of the invention is as follows.
The invention is suitable for the optimized compression of power waveforms, achieves higher compression ratio by organically combining the compression algorithm of incremental calculation with the traditional compression algorithm, can achieve the compression ratio of below 25% under the condition of steady-state power waveforms, can continuously record and store power waveform data for not less than one month by combining the size of the storage module, is convenient for fault integrity analysis, daily information rule summary analysis, pre-judgment on impending faults and the like, and has great significance for the safe and stable operation of a power system.
Drawings
FIG. 1 is a flow chart of the compression algorithm of the present invention.
Detailed Description
In order to make the technical solution of the present invention better understood, the technical solution of the present invention will be clearly and completely described below with reference to the specific embodiments and the accompanying drawings.
The power waveform compression algorithm is suitable for data processing of power waveforms, and a flow diagram of the compression algorithm is shown in fig. 1 and specifically comprises the following steps.
A. And carrying out noise reduction processing on the acquired analog quantity data according to a set period. The invention adopts a mode of adding an active low-pass filter on an analog quantity acquisition hardware circuit to carry out noise reduction processing on the acquired analog quantity data.
B. And carrying out amplitude limiting average filtering pretreatment on the analog quantity subjected to the noise reduction treatment to form a new sampling value. And the new data sampled every time is firstly subjected to amplitude limiting processing and then is sent to a queue for recursive average filtering processing, so that the accidental impulsive interference is eliminated.
C. And performing incremental calculation on the new sampling value and the old sampling value obtained in the previous sampling period until a minimum digit data sequence is obtained and storing.
Subtracting the data of the previous sampling point from the current sampling point of the original data to obtain a first difference value; and subtracting the previous difference value from the current difference value to obtain data of a second difference value, wherein the second difference value sequence of the group of data is the finally obtained expected minimum digit data sequence, and the group of minimum digit data sequence is compressed to obtain the ideal compression ratio.
The first data of each channel keeps original data; the input sequence is set as: a1, a2, A3, … … An;
the first step output sequence of the encoding calculation is as follows: b1, B2, B3, … … Bn.
Wherein, B1 is A1; b2 ═ a2-a 1; b3 ═ A3-a 2; b4 ═ a 4-A3; … … Bn is An-A (n-1).
The second step of coding calculation output sequence is as follows: c1, C2, C3, … … Cn.
Wherein, C1 ═ B1; c2 ═ B2-B1; c3 ═ B3-B2; c4 ═ B4-B3; … … Cn ═ Bn-B (n-1).
In the embodiment, 13-bit fundamental wave data of 1024 sampling points are used for simulation, and 0.3 time of 3-order harmonic, 0.2 time of 5-order harmonic and 0.1 time of 7-order harmonic are added to obtain original data; specific coded data is shown in table 1.
TABLE 1
In this embodiment, the minimum-bit data sequence is represented by 4 bits from-7 to + 7; 1000 indicates that the deviation is out of range followed by an extended data byte, with the most significant bit of the extended data byte being 1 indicating that the next byte is still an extended byte and 0 indicating that the next byte is no longer an extended byte. As shown in table 2.
TABLE 2
Serial number | Data of | Binary system |
1 | -7 | 1001 |
2 | -6 | 1010 |
3 | -5 | 1011 |
4 | -4 | 1100 |
5 | -3 | 1101 |
6 | -2 | 1110 |
7 | -1 | 1111 |
8 | 0 | 0000 |
9 | 1 | 0001 |
10 | 2 | 0010 |
11 | 3 | 0011 |
12 | 4 | 0100 |
13 | 5 | 0101 |
14 | 6 | 0110 |
15 | 7 | 0111 |
The original data sequence is shown in table 3.
TABLE 3
Serial number | Data of | Binary system |
1 | -8191 | 1000 1100 0000 0000 0001 |
2 | -64 | 1000 1111 1111 0100 0000 |
3 | 64 | 1000 1000 0000 0100 0000 |
4 | 8191 | 1000 1011 1111 0111 1111 |
It can be seen that after two times of early compression, the data sequence with the minimum number of bits can be obtained; compared with the original data sequence, the compression rate is greatly improved.
D. And finally, performing later compression by adopting a conventional compression algorithm to obtain a better compression effect.
The algorithm of the invention has simple operation and low requirement on the processor, and is efficient and feasible from the aspects of CPU and hardware realization.
After the electric power waveform data stored by the invention is transmitted, the first decoding and the second decoding can be obtained according to the inverse operation, and the original data is finally obtained.
The decoding calculates the first step output sequence as: d1, D2, D3, … … Dn;
wherein, D1 ═ C1; d2 ═ D1+ C2; d3 ═ D2+ C3; d4 ═ D3+ C4; … … Dn is D (n-1) + Cn.
The second step of decoding calculation output sequence is: e1, E2, E3, … … En;
wherein, E1 ═ D1; e2 ═ E1+ D2; e3 ═ E2+ D3; e4 ═ E3+ D4; … … En ═ E (n-1) + Dn.
In this embodiment, data of the decoding process is shown in table 4.
TABLE 4
It can be seen from table 4 that the data after the second decoding is the same as the original data, which shows that the compression method of the present invention can improve the compression ratio on the basis of ensuring the integrity of the data, thereby providing more information amount for the storage space with fixed capacity.
The above detailed description of embodiments of the invention presented in the drawings is not intended to limit the scope of the invention as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
Claims (4)
1. The power waveform compression algorithm is characterized by comprising the following steps:
A. the acquired analog data is subjected to noise reduction processing according to a set period,
B. carrying out filtering pretreatment on the analog quantity subjected to noise reduction treatment to form a new sampling value;
C. performing incremental calculation on the new sampling value and the old sampling value obtained in the previous sampling period until a minimum digit data sequence is obtained and storing the minimum digit data sequence;
D. and performing later compression by adopting a conventional compression algorithm.
2. The power waveform compression algorithm of claim 1 wherein the incremental calculation method in step C is: subtracting the data of the previous sampling point from the original data of the current sampling point to obtain a first difference value; and subtracting the previous difference value from the current difference value to obtain data of a second difference value, wherein the second difference value sequence of the group of data is the finally obtained minimum digit data sequence.
3. The power waveform compression algorithm of claim 1 wherein the minimum number of bits in step C is represented by 4 bits, the highest bit in the 4-bit byte is the offset out-of-range bit followed by the extended data byte, the highest bit in the extended data byte being 1 indicating that the next byte is still an extended byte, the highest bit being 0 indicating that the next byte is no longer an extended byte.
4. The power waveform compression algorithm of claim 1, wherein the conventional compression algorithm of step D employs an LZ77 compression algorithm.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010594835.XA CN111766471A (en) | 2020-06-28 | 2020-06-28 | Power waveform compression algorithm |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010594835.XA CN111766471A (en) | 2020-06-28 | 2020-06-28 | Power waveform compression algorithm |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111766471A true CN111766471A (en) | 2020-10-13 |
Family
ID=72722128
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010594835.XA Pending CN111766471A (en) | 2020-06-28 | 2020-06-28 | Power waveform compression algorithm |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111766471A (en) |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1230274A (en) * | 1996-09-13 | 1999-09-29 | 塞瑞斯逻辑公司 | Period forcing filter for preprocessing sound samples for usage in wavetable synthesizer |
CN101083765A (en) * | 2006-07-18 | 2007-12-05 | 威盛电子股份有限公司 | System and method for video data compression |
CN102984517A (en) * | 2012-11-21 | 2013-03-20 | 华为技术有限公司 | Method, device, and system for video data compression and decompression |
CN103378863A (en) * | 2012-04-18 | 2013-10-30 | 董福田 | Method and device for spatial data compression, decompression and progressive transmission |
CN104834539A (en) * | 2015-03-02 | 2015-08-12 | 倪桂强 | Data increment updating method |
CN110044608A (en) * | 2019-04-19 | 2019-07-23 | 石家庄铁道大学 | Vibration signal compression sensing method based on MCKD |
CN110277998A (en) * | 2019-06-27 | 2019-09-24 | 中国电力科学研究院有限公司 | Electric network data lossless compression method and device |
CN111064472A (en) * | 2020-01-15 | 2020-04-24 | 洛阳乾禾仪器有限公司 | Method and device for compressing and decompressing indicator diagram data and computer readable storage medium |
-
2020
- 2020-06-28 CN CN202010594835.XA patent/CN111766471A/en active Pending
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1230274A (en) * | 1996-09-13 | 1999-09-29 | 塞瑞斯逻辑公司 | Period forcing filter for preprocessing sound samples for usage in wavetable synthesizer |
CN101083765A (en) * | 2006-07-18 | 2007-12-05 | 威盛电子股份有限公司 | System and method for video data compression |
CN103378863A (en) * | 2012-04-18 | 2013-10-30 | 董福田 | Method and device for spatial data compression, decompression and progressive transmission |
CN102984517A (en) * | 2012-11-21 | 2013-03-20 | 华为技术有限公司 | Method, device, and system for video data compression and decompression |
CN104834539A (en) * | 2015-03-02 | 2015-08-12 | 倪桂强 | Data increment updating method |
CN110044608A (en) * | 2019-04-19 | 2019-07-23 | 石家庄铁道大学 | Vibration signal compression sensing method based on MCKD |
CN110277998A (en) * | 2019-06-27 | 2019-09-24 | 中国电力科学研究院有限公司 | Electric network data lossless compression method and device |
CN111064472A (en) * | 2020-01-15 | 2020-04-24 | 洛阳乾禾仪器有限公司 | Method and device for compressing and decompressing indicator diagram data and computer readable storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Sayiner et al. | A level-crossing sampling scheme for A/D conversion | |
US9077360B2 (en) | Extension of ADC dynamic range using post-processing logic | |
CN105007079A (en) | Fully differential increment sampling method of successive approximation type analog-digital converter | |
Shinde et al. | The comparison of different transform based methods for ECG data compression | |
CN109655644B (en) | Method and device for reducing random wave signal output jitter | |
CN102082576A (en) | Data processing device for electric energy quality signal and data compression and decompression method thereof | |
CN111766471A (en) | Power waveform compression algorithm | |
CN102901855A (en) | De-noising method for ultra-high-voltage direct-current corona current signal | |
Mukhopadhyay et al. | An ECG data compression method via R-peak detection and ASCII character encoding | |
CN104320143A (en) | Method and device for compressing three-phase voltage and current signal waveform sample data | |
Liu et al. | Event-driven processing for hardware-efficient neural spike sorting | |
Cong et al. | Error detection and correction of TIADC based on GA optimization | |
Wei et al. | Compensation of dynamic nonlinear mismatches in time-interleaved analog-to-digital converter | |
CN110784229A (en) | MWC (wrap-through multi-carrier) rear-end signal reconstruction method with analog filter compensation based on fast Fourier transform | |
CN111596228B (en) | Electric leakage detection method and device | |
CN104639160B (en) | Numerically-controlled oscillator and magnetic resonance imaging system | |
CN111970003B (en) | Non-coherent sampling signal recovery method in ADC frequency spectrum test | |
CN114564684A (en) | Method for compressing detection signal data of missile-borne detector | |
CN115940960B (en) | Lossless compression method, system and medium for waveform data | |
CN113629711B (en) | Grid voltage feedforward control method and system of grid-connected inverter | |
Qiu et al. | Design of A Hybrid Compression Algorithm for High-fidelity Synchro-waveform Measurements | |
CN204988304U (en) | Full digital sensor based on USB transmission | |
CN1470850A (en) | Dynamic non-linear real-time correction system for sensor | |
Rui et al. | Compression method of power quality data based on wavelet transform | |
CN117526957B (en) | Analog-to-digital converter with optimal quantization bit number |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201013 |