CN102082576A - Data processing device for electric energy quality signal and data compression and decompression method thereof - Google Patents
Data processing device for electric energy quality signal and data compression and decompression method thereof Download PDFInfo
- Publication number
- CN102082576A CN102082576A CN2011100306920A CN201110030692A CN102082576A CN 102082576 A CN102082576 A CN 102082576A CN 2011100306920 A CN2011100306920 A CN 2011100306920A CN 201110030692 A CN201110030692 A CN 201110030692A CN 102082576 A CN102082576 A CN 102082576A
- Authority
- CN
- China
- Prior art keywords
- signal
- data
- module
- quality
- compression
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
The invention belongs to the technical field of an advanced measurement system in an intelligent grid, particularly relating to a data compression and storage method for an electric energy quality signal, wherein the compression and storage of the electric energy quality signal are realized through filtering, fragmenting, quick transformation and organizing and storage. The data compression and storage method for an electric energy quality signal provided by the invention finishes the decompression process through inverse transformation treatment. The invention further provides a data processing device for an electric energy quality signal based on the compression and storage and decompression method, comprising a data preprocessing module, a dynamic subframe module, a signal reference module, a compression precision ratio control module, a transform processing module, a data organizing and storage module and a decompression module. The compression and storage and decompression method for an electric energy quality signal and a processing device thereof disclosed by the invention have a relatively big compression ratio while ensuring high precision of signal reconstruction, and the compression ratio can be improved to more than 200 times.
Description
Technical field
The invention belongs to the technical field of the senior measurement system of intelligent grid, particularly relate to a kind of data processing equipment of compression storing data method, decompression method and a kind of quality of power supply signal of quality of power supply signal.
Background technology
Along with the application of a large amount of sensitiveness electronic equipments, power quality problem becomes increasingly conspicuous in the current electrical network, and the quality of power supply has become the focus of paying close attention to for electricity consumption each side.For high frequency transient quality of power supply information is carried out complete monitoring, the Power Quality Detection device need adopt very high sample frequency to come recording occurring continuously quality of power supply signal, this will seek survival storage and transmission lot of data.
In addition, aspect present electric power system fault record ripple, fault oscillograph all is to adopt the directly method of storage of data basically, and the memory space that equipment needs sharply increases, and has therefore increased the weight of the burden of storage.Simultaneously, so huge fault data amount active channel time when the control centre uploads is long, particularly causes data channel to block when a plurality of websites are uploaded data simultaneously easily.This makes the storage of electric power system fault signal and transmission face great challenge, and too much data have not only increased the transmission time simultaneously, have also reduced reliability of data transmission.
In order to solve this a series of difficult problem, must adopt compress technique that the electric energy quality monitoring data are handled.Quality of power supply signal compression algorithm has two classes at present: a class algorithm mainly adopts lossless compressiong, and with the online lossless compress of improved LZW (Lemple-Ziv-Welch) algorithm realization WAMS process data, compression ratio is generally less than 30%; Another kind of algorithm is realized compression to power quality data based on the lossy compression method method of Principle of Wavelet, such as based on gate method of wavelet conversion coefficient etc.Test shows, compression accuracy in 5% the time compression ratio can reach more than 10 times.
Summary of the invention
(1) technical problem
The present invention has overcome in the present quality of power supply Signal Compression technology and to have rebuild the shortcoming that precision is low, compression ratio is little, can improve the reconstruction precision of quality of power supply signal and compression ratio etc.
(2) technical scheme
On the one hand, the invention discloses a kind of compression storing data method of quality of power supply signal, may further comprise the steps:
Further, before original quality of power supply signal is carried out Filtering Processing, set compression parameters earlier, control compression accuracy and compression ratio.
The invention also discloses a kind of uncompressing data of quality of power supply signal, may further comprise the steps:
On the other hand, the invention discloses a kind of data processing equipment of quality of power supply signal, it is characterized in that, comprise successively the data preprocessing module that links to each other, dynamically divide frame module, conversion process module, data organization and memory module, with the signal referrer module that links to each other with described dynamic minute frame module
Described data preprocessing module is carried out Filtering Processing to quality of power supply signal, and the original Dynamic Signal that will obtain is sent to described dynamic minute frame module;
Described signal referrer module is used for the storage of electrical energy quality classification;
Described dynamic minute frame module is used for cutting apart described original Dynamic Signal according to described quality of power supply classification, and forms one group of signal frame set of being made up of at least one signal frame;
Described conversion process module is used for that described signal frame is carried out Fast transforms and handles, and obtains the frame data of described signal frame in transform domain, and described frame data are sent to described data organization and memory module organize and store.
Further, also comprise a compression accuracy ratio control module, described compression accuracy ratio control module links to each other with described conversion process module, by described compression accuracy ratio control module, set compression parameters, control the compression accuracy and the compression ratio of described conversion process module.
Further, also comprise a decompression module, the packed data that described decompression module is used for being stored in described data organization and memory module decompresses.
(3) beneficial effect
The characteristics that the present invention is directed to quality of power supply signal in the electric power system design corresponding compression algorithm, have bigger compression ratio when guaranteeing high signal reconstruction precision, compression ratio can be increased to more than 200 times.
Description of drawings
Fig. 1 is a kind of compression storing data method flow diagram of quality of power supply signal;
Fig. 2 is the compression storing data method flow diagram of another kind of quality of power supply signal;
Fig. 3 is the uncompressing data flow chart of quality of power supply signal;
Fig. 4 is a kind of data processing equipment structure composition of quality of power supply signal.
Embodiment
The compression storing data method of quality of power supply signal of the present invention, decompression method and quality of power supply signal data processing unit are described in detail as follows in conjunction with the accompanying drawings and embodiments.
As shown in Figure 1, the compression storing data method of a kind of quality of power supply signal disclosed by the invention may further comprise the steps:
Wherein, for step 1, it mainly is to utilize median filter to reject gross errors such as wild point that original electric power signal is carried out Filtering Processing, thereby improves the performance and the compression ratio of compressed encoding; For step 2, quality of power supply classification comprises that voltage interruption, voltage rise temporarily, voltage dip, voltage oscillation etc., by calculating the similarity of the original Dynamic Signal and quality of power supply classification, original Dynamic Signal can be cut apart based on different similarities, form the set of a signal frame; For step 3, according to the different quality of power supply classification under the signal frame, select corresponding mapping algorithm, as fast Fourier transform, fast wavelet transform etc., signal frame is carried out Fast transforms, realize the compression of signal frame; For step 4, mainly be to set up a data chained list, the frame data after the compression etc. are stored in this data link table successively.
Fig. 2 has described the compression storing data method of another kind of quality of power supply signal, wherein step 2 ', 3 ', 4 ', 5 ' corresponding process and function respectively with Fig. 1 in step 1,2,3,4 process is identical with function, difference is, method shown in Figure 2 is before carrying out Filtering Processing to original quality of power supply signal, can set compression parameters earlier, as compression accuracy and compression ratio, make step 4 ' can be based on compression accuracy and the compression ratio set, carry out Fast transforms to cutting apart the signal frame that obtains, step 3 shown in Figure 1 is then carried out the Fast transforms of signal frame based on default compression accuracy and compression ratio, thereby realized the artificial control of compression accuracy and ratio, enlarged the scope of application of this method.
The uncompressing data of a kind of quality of power supply signal disclosed by the invention may further comprise the steps as shown in Figure 3:
Step I reads and treats decompressed data;
Step II, identification are treated the quality of power supply classification of decompressed data correspondence,
Step II I treats that to stating decompressed data carries out inversion process, obtains the original Dynamic Signal rebuild, and decompress(ion) is finished.
Specifically, the implementation procedure of this method is: at first read and treat decompressed data, next discerns this quality of power supply for the treatment of decompressed data correspondence classification, utilize the decompression algorithm of the compression algorithm correspondence of this classification agreement at last, treat decompressed data and carry out inversion process, rebuild original Dynamic Signal, finish decompression.
Figure 4 shows that data processing equipment based on a kind of quality of power supply signal of quality of power supply signal data compression and storage method disclosed by the invention, this device comprises the data preprocessing module 101 that links to each other successively, dynamically divide frame module 102, conversion process module 103, data organization and memory module 104, decompression module 105, and also comprise the signal referrer module 106 that links to each other with dynamic minute frame module 102, with the compression accuracy ratio control module 107 that links to each other with conversion process module 103, wherein 101 pairs of quality of power supply signals of data preprocessing module carry out Filtering Processing, utilize median filter to reject gross errors such as wild point, and the original Dynamic Signal that will obtain is sent to dynamic minute frame module 102; Dynamically divide frame module 102, be used for according to signal referrer module 106 electric energy stored quality classifications, calculate the similarity of the original Dynamic Signal and quality of power supply classification, original Dynamic Signal can be cut apart based on different similarities, form the set of a signal frame, quality of power supply classification comprises that voltage interruption, voltage rise temporarily, voltage dip, voltage oscillation etc.; Conversion process module 103, based on the compression parameters of setting by compression accuracy ratio control module 107, as compression accuracy and compression ratio, according to the different quality of power supply classification under the signal frame, select corresponding mapping algorithm, as fast Fourier transform, fast wavelet transform etc., signal frame is carried out Fast transforms, realize the compression of signal frame; Data organization and memory module 104 mainly are by setting up a data chained list, store into frame data after the compression etc. in the data link table successively; Decompression module 105 at first reads from data organization and memory module 104 and treats decompressed data, discern this quality of power supply for the treatment of decompressed data correspondence classification, decompression algorithm based on the compression algorithm correspondence of this classification agreement, treat decompressed data and carry out inversion process, rebuild original Dynamic Signal, realize decompress(ion).
Above execution mode only is used to illustrate the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; under the situation that does not break away from the spirit and scope of the present invention; can also make various variations and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.
Claims (6)
1. the compression storing data method of a quality of power supply signal is characterized in that, said method comprising the steps of:
Step 1 is carried out Filtering Processing to original quality of power supply signal, eliminates the noise signal that mixes in the described original quality of power supply signal, obtains original Dynamic Signal;
Step 2 according to quality of power supply classification, is cut apart described original Dynamic Signal, forms one group of signal frame set, and described signal frame set comprises at least one signal frame;
Step 3 based on the quality of power supply classification of each described signal frame correspondence, is carried out Fast transforms to each described signal frame, obtains the frame data in the corresponding transform domain;
Step 4 is organized and is stored the frame data in the described transform domain.
2. the compression storing data method of quality of power supply signal according to claim 1 is characterized in that, before original quality of power supply signal is carried out Filtering Processing, sets compression parameters earlier, control compression accuracy and compression ratio.
3. the uncompressing data of a quality of power supply signal is characterized in that, said method comprising the steps of:
Step 1 reads and treats decompressed data;
Step 2 is discerned the described quality of power supply classification for the treatment of the decompressed data correspondence;
Step 3 is carried out inversion process to the described decompressed data for the treatment of, obtains the original Dynamic Signal of reconstruction, and decompress(ion) is finished.
4. the data processing equipment of a quality of power supply signal, it is characterized in that, comprise successively the data preprocessing module that links to each other, dynamically divide frame module, conversion process module, data organization and memory module, with the signal referrer module that links to each other with described dynamic minute frame module
Described data preprocessing module is carried out Filtering Processing to quality of power supply signal, and the original Dynamic Signal that will obtain is sent to described dynamic minute frame module;
Described signal referrer module is used for the storage of electrical energy quality classification;
Described dynamic minute frame module is used for cutting apart described original Dynamic Signal according to described quality of power supply classification, and forms one group of signal frame set of being made up of at least one signal frame;
Described conversion process module is used for that described signal frame is carried out Fast transforms and handles, and obtains the frame data of described signal frame in transform domain, and described frame data are sent to described data organization and memory module organize and store.
5. the data processing equipment of quality of power supply signal according to claim 4, it is characterized in that, also comprise a compression accuracy ratio control module, described compression accuracy ratio control module links to each other with described conversion process module, by described compression accuracy ratio control module, set compression parameters, control the compression accuracy and the compression ratio of described conversion process module.
6. according to the data processing equipment of claim 4 or 5 described quality of power supply signals, it is characterized in that also comprise a decompression module, the packed data that described decompression module is used for being stored in described data organization and memory module decompresses.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100306920A CN102082576A (en) | 2011-01-28 | 2011-01-28 | Data processing device for electric energy quality signal and data compression and decompression method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100306920A CN102082576A (en) | 2011-01-28 | 2011-01-28 | Data processing device for electric energy quality signal and data compression and decompression method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102082576A true CN102082576A (en) | 2011-06-01 |
Family
ID=44088341
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011100306920A Pending CN102082576A (en) | 2011-01-28 | 2011-01-28 | Data processing device for electric energy quality signal and data compression and decompression method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102082576A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102394657A (en) * | 2011-10-20 | 2012-03-28 | 国网电力科学研究院 | Real-time power quality data compression algorithm |
| CN102645603A (en) * | 2012-05-18 | 2012-08-22 | 北京博电新力电气股份有限公司 | Electric energy quality monitoring method |
| CN102684704A (en) * | 2012-05-28 | 2012-09-19 | 北京博电新力电气股份有限公司 | Power quality lossy compression method |
| CN103633742A (en) * | 2013-12-10 | 2014-03-12 | 国家电网公司 | Communication method for implementing synchronous online analysis in fault recording data transmission |
| CN106053917A (en) * | 2016-05-18 | 2016-10-26 | 国网福建省电力有限公司 | Super telemechanical technology of integrated small recording |
| CN106569063A (en) * | 2016-11-02 | 2017-04-19 | 海南电力技术研究院 | Power quality sampling data processing method and power quality sampling data processing system |
| CN106788449A (en) * | 2017-01-13 | 2017-05-31 | 重庆邮电大学 | A kind of real-time power quality data parametrization compression method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1961217A (en) * | 2004-04-01 | 2007-05-09 | 蓝线创新公司 | System and method for reading power meters |
| CN101006348A (en) * | 2004-04-18 | 2007-07-25 | 埃莱斯派克工程有限公司 | Power quality monitory |
| CN101038303A (en) * | 2007-02-07 | 2007-09-19 | 深圳市双合电脑系统股份有限公司 | Compression method for electric power waveform recording date |
| CN101339208A (en) * | 2008-08-12 | 2009-01-07 | 中国矿业大学 | Voltage quality monitoring and perturb automatic classification method based on analysis in time-domain |
-
2011
- 2011-01-28 CN CN2011100306920A patent/CN102082576A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1961217A (en) * | 2004-04-01 | 2007-05-09 | 蓝线创新公司 | System and method for reading power meters |
| CN101006348A (en) * | 2004-04-18 | 2007-07-25 | 埃莱斯派克工程有限公司 | Power quality monitory |
| CN101038303A (en) * | 2007-02-07 | 2007-09-19 | 深圳市双合电脑系统股份有限公司 | Compression method for electric power waveform recording date |
| CN101339208A (en) * | 2008-08-12 | 2009-01-07 | 中国矿业大学 | Voltage quality monitoring and perturb automatic classification method based on analysis in time-domain |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102394657A (en) * | 2011-10-20 | 2012-03-28 | 国网电力科学研究院 | Real-time power quality data compression algorithm |
| CN102645603A (en) * | 2012-05-18 | 2012-08-22 | 北京博电新力电气股份有限公司 | Electric energy quality monitoring method |
| CN102684704A (en) * | 2012-05-28 | 2012-09-19 | 北京博电新力电气股份有限公司 | Power quality lossy compression method |
| CN102684704B (en) * | 2012-05-28 | 2015-06-17 | 北京博电新力电气股份有限公司 | Power quality lossy compression method |
| CN103633742A (en) * | 2013-12-10 | 2014-03-12 | 国家电网公司 | Communication method for implementing synchronous online analysis in fault recording data transmission |
| CN103633742B (en) * | 2013-12-10 | 2015-10-21 | 国家电网公司 | Realize the means of communication of synchronous on-line analysis during fault recorder data transmission |
| CN106053917A (en) * | 2016-05-18 | 2016-10-26 | 国网福建省电力有限公司 | Super telemechanical technology of integrated small recording |
| CN106053917B (en) * | 2016-05-18 | 2019-03-08 | 国网福建省电力有限公司 | A kind of super telemechanical method integrating small recording |
| CN106569063A (en) * | 2016-11-02 | 2017-04-19 | 海南电力技术研究院 | Power quality sampling data processing method and power quality sampling data processing system |
| CN106788449A (en) * | 2017-01-13 | 2017-05-31 | 重庆邮电大学 | A kind of real-time power quality data parametrization compression method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102082576A (en) | Data processing device for electric energy quality signal and data compression and decompression method thereof | |
| Gadde et al. | Efficient compression of PMU data in WAMS | |
| CN103457609B (en) | Fault recorder data Lossless Compression, decompression method | |
| CN105356886B (en) | Power line noise compression method and device based on compressed sensing | |
| Khan et al. | Data denoising and compression for smart grid communication | |
| Jumar et al. | Comparison of lossless compression schemes for high rate electrical grid time series for smart grid monitoring and analysis | |
| CN107561416A (en) | A kind of local discharge signal acquisition system and method based on compressed sensing | |
| CN109462404A (en) | Adaptive Wave data compression method based on similarity segmentation | |
| CN114487894A (en) | System for carrying out real-time quality monitoring on vehicle-mounted power supply equipment | |
| CN113092899B (en) | Transformer electrical fault identification method, system, terminal and readable storage medium | |
| CN110995396B (en) | Compression method of communication messages of electricity consumption information acquisition system based on hierarchical structure | |
| Yan et al. | A real-time data compression & reconstruction method based on lifting scheme | |
| Qu et al. | Big data compression processing and verification based on Hive for smart substation | |
| Sun et al. | Development of Synchronized Waveform Measurement and Its Application on Fault Detection | |
| Li et al. | Instructions data compression for smart grid monitoring using wavelet domain singular value decomposition | |
| Jose et al. | Smart Grid Data Compression of Power Quality Events using Wavelet Transform | |
| CN108256368B (en) | Method and device for generating dual-port network | |
| CN113033889B (en) | High-voltage transmission line fault prediction method and device and terminal equipment | |
| Maazouz et al. | A DCT-based algorithm for multi-channel near-lossless EEG compression | |
| Truong et al. | Analysis of resonance and anti-resonance frequencies in a wireless power transfer system: analytical model and experiments | |
| CN103427845A (en) | Method for compressing and reconstructing harmonic data of power system on basis of two-dimensional block DCT (discrete cosine transformation) | |
| Sima et al. | A framework for automatically cleansing overvoltage data measured from transmission and distribution systems | |
| Acharya et al. | Exploiting network-induced correlation for efficient compression of PMU data | |
| CN102684704B (en) | Power quality lossy compression method | |
| Yan et al. | Robust data transmission upon compressive sensing for smart grid |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20110601 |