CN112328563A - Transient recording data compression method and device, electronic equipment and storage medium - Google Patents
Transient recording data compression method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112328563A CN112328563A CN202110000690.0A CN202110000690A CN112328563A CN 112328563 A CN112328563 A CN 112328563A CN 202110000690 A CN202110000690 A CN 202110000690A CN 112328563 A CN112328563 A CN 112328563A
- Authority
- CN
- China
- Prior art keywords
- data
- transient
- steady
- fundamental wave
- compressed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/174—Redundancy elimination performed by the file system
- G06F16/1744—Redundancy elimination performed by the file system using compression, e.g. sparse files
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R29/00—Arrangements for measuring or indicating electric quantities not covered by groups G01R19/00 - G01R27/00
- G01R29/26—Measuring noise figure; Measuring signal-to-noise ratio
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
The invention provides a transient recording data compression method, a transient recording data compression device, electronic equipment and a storage medium, wherein the method comprises the following steps: acquiring transient wave recording data; the transient recording data comprises transient data and steady fundamental wave data; the data in the first period of the transient recording data are steady fundamental wave data; filtering and down-sampling the steady-state fundamental wave data to obtain compressed steady-state fundamental wave data; subtracting the compressed steady-state fundamental wave data from the transient recording data to obtain first data to be detected; the first data to be detected comprises transient data; carrying out noise detection on the first data to be detected, and determining the starting time and the ending time of the transient data; and intercepting transient data from the first data to be detected according to the starting time and the ending time, and taking the intercepted transient data and the compressed steady-state fundamental wave data as compressed transient recording data. The invention realizes the purpose of compressing the transient recording data and can reduce the storage capacity of the transient recording data.
Description
Technical Field
The invention relates to the technical field of power systems, in particular to a transient recording data compression method and device, electronic equipment and a storage medium.
Background
The fault recording of the power system in China develops rapidly, the change conditions of various electrical quantities in the processes before and after the fault can be automatically and accurately recorded, the change phenomenon of the system frequency in the whole process can be recorded, the transient state information can be recorded, and a certain reference value is provided for the power fault occurrence reason through recording the information. However, as the voltage sampling rate increases, the disk space usage also increases dramatically.
In order to reduce the data volume of the power waveform data, a data compression method can be adopted for compression processing, so that the data size is reduced, the storage and the transmission are convenient, the occupied part of the transient part in the compressed file is smaller, the compression efficiency is higher, and the compression effect is better. At present, a common compression mode is to perform data compression at a data acquisition end, and redundant data which is meaningless to later-stage fault analysis in transient recording data is not considered, so that although the transient recording data is compressed to a certain extent, the practical significance to later-stage fault analysis is not great.
Disclosure of Invention
In view of the above, an object of the present invention is to provide a method, an apparatus, an electronic device and a storage medium for compressing transient recording data, so as to reduce the storage capacity of the transient recording data.
The technical scheme of the invention can be realized as follows:
in a first aspect, the present invention provides a method for compressing transient recording data, where the method includes: acquiring transient wave recording data; the transient recording data comprises transient data and steady fundamental wave data; the data in the first period of the transient recording data are steady fundamental wave data; performing filtering processing and down-sampling processing on the steady-state fundamental wave data to obtain the compressed steady-state fundamental wave data; subtracting the compressed steady-state fundamental wave data from the transient recording data to obtain first data to be detected; the first data to be detected comprises the transient data; carrying out noise detection on the first data to be detected, and determining the starting time and the ending time of the transient data; and intercepting the transient data from the first data to be detected according to the starting time and the ending time, and taking the intercepted transient data and the compressed steady-state fundamental wave data as the compressed transient recording data.
In a second aspect, the present invention provides a transient recording data compression apparatus, including: the acquisition module is used for acquiring transient recording data; the transient recording data comprises transient data and steady fundamental wave data; the data in the first period of the transient recording data are steady fundamental wave data; performing filtering processing and down-sampling processing on the steady-state fundamental wave data to obtain the compressed steady-state fundamental wave data; subtracting the steady-state fundamental wave data from the transient filtering data to obtain first data to be detected; the first data to be detected comprises the transient data; the detection module is used for carrying out noise detection on the first data to be detected and determining the starting time and the ending time of the transient data; and the compression module is used for intercepting the transient data from the first data to be detected according to the starting time and the ending time, and taking the intercepted transient data and the compressed steady-state fundamental wave data as the compressed transient recording data.
In a third aspect, the present invention provides an electronic device, including a processor and a memory, where the memory stores a computer program executable by the processor, and the processor can execute the computer program to implement the transient recording data compression method according to the first aspect.
In a fourth aspect, the present invention provides a storage medium having stored thereon a computer program which, when executed by a processor, implements the transient recording data compression method according to the first aspect.
The invention provides a transient recording data compression method, a transient recording data compression device, electronic equipment and a storage medium, wherein the method comprises the following steps: acquiring transient wave recording data; the transient recording data comprises transient data and steady fundamental wave data; the data in the first period of the transient recording data are steady fundamental wave data; performing filtering processing and down-sampling processing on the steady-state fundamental wave data to obtain the compressed steady-state fundamental wave data; subtracting the compressed steady-state fundamental wave data from the transient recording data to obtain first data to be detected; the first data to be detected comprises the transient data; carrying out noise detection on the first data to be detected, and determining the starting time and the ending time; and intercepting the transient data from the first data to be detected according to the starting time and the ending time, and taking the intercepted transient data and the compressed steady-state fundamental wave data as the compressed transient recording data. Unlike the prior art where the focus is the same for each portion of the data. The invention performs data compression on transient files, wherein fault waveforms are stripped, and fault data are retained without loss. The purpose of compressing the transient recording data is achieved, and the storage capacity of the transient recording data can be reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is an exemplary flowchart of a transient recording data compression method according to an embodiment of the present invention;
fig. 2 is a schematic waveform diagram of transient recording data according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a steady-state fundamental data filtered waveform provided by an embodiment of the present invention;
fig. 4 is a schematic waveform diagram of first data to be detected according to an embodiment of the present invention;
FIG. 5 is a schematic flow chart of one implementation of step S14 provided by an embodiment of the present invention;
fig. 6 is a schematic flowchart of an implementation manner of step S141 provided by the embodiment of the present invention;
fig. 7 is a schematic flowchart of another implementation manner of step S141 provided by the embodiment of the present invention;
fig. 8 is a schematic flowchart of an implementation manner of step S11 provided by the embodiment of the present invention;
fig. 9 is a schematic flow chart of another transient recording data compression method according to an embodiment of the present invention;
fig. 10 is a functional block diagram of a transient recording data compression apparatus according to an embodiment of the present invention;
fig. 11 is a block diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
In the description of the present invention, it should be noted that if the terms "upper", "lower", "inside", "outside", etc. indicate an orientation or a positional relationship based on that shown in the drawings or that the product of the present invention is used as it is, this is only for convenience of description and simplification of the description, and it does not indicate or imply that the device or the element referred to must have a specific orientation, be constructed in a specific orientation, and be operated, and thus should not be construed as limiting the present invention.
Furthermore, the appearances of the terms "first," "second," and the like, if any, are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.
It should be noted that the features of the embodiments of the present invention may be combined with each other without conflict.
Before describing the embodiments of the present invention, the related terms related to the embodiments of the present invention are explained:
and (3) steady state wave recording: the method refers to a stable state of the operation of the power system, wherein the stable state is an operation parameter, voltage, current, power and the like which are kept unchanged. However, in actual operation of a real power grid, such a steady state is rarely present and has a certain deviation, so that an operation parameter of a power system continuously changes around a certain average value and has a small change value, which is called steady state recording.
Transient wave recording: the transition from one stable operating state to another stable operating state is referred to, and the operating parameters of the transition are changed greatly and rapidly. This process of variation is referred to as transient recording.
The stable wave recording and the transient wave recording are different from whether the electric parameters of the power system are stable or not, the stable wave recording and the transient wave recording have certain correlation, and when the power system is in steady operation, after the power system is suddenly subjected to large disturbance under a certain operation condition, the operation parameters can be greatly changed, and then a new stable operation state is achieved.
In the embodiment of the invention, the two words of fault and transient can be used interchangeably.
With the rapid development of sensor technology, the electric power internet of things is increasingly popularized. Monitoring and perception of each environment of the power system are achieved, and therefore convenient and flexible intelligent service is the fundamental purpose of power internet of things construction. The monitoring of the voltage is one of the most basic monitoring quantities of the power internet of things, and is generally present in equipment such as a power transmission line and a transformer. The core purpose of monitoring the faults of the electric power equipment is to predict/identify the existing/impending faults of the electric power equipment by adopting various data analysis methods at the later stage. In order to completely depict/retain the fault waveform, an extremely high signal sampling rate and data of a long time before and after the fault occurrence moment are often needed, and due to the extremely high sampling rate and the low fault occurrence probability, the data are often transmitted in the form of file data (not in the form of data stream), and the file containing the fault waveform is called a transient file.
With the development of semiconductor technology, the sampling rate of an analog-to-digital conversion chip (ADC) has reached a level of hundreds of MHz or higher, and a large amount of useful steady-state (long-term) device information and information of various transient (instantaneous) voltage disturbance events (such as lightning stroke, short circuit, etc.) can be contained in voltage waveform data obtained at such a high sampling rate.
However, as the voltage sampling rate increases, the disk space usage also increases dramatically. In order to reduce the data volume of the power waveform data, a data compression method can be adopted for compression processing, so that the data size is reduced, and the storage and the transmission are convenient. At present, a common compression mode is to perform data compression at a data acquisition end, the attention degrees of fault data points and non-fault data points are the same, and redundant data which has no significance for later-stage fault analysis in transient recording data are not considered, so that the transient recording data are compressed to a certain extent, but the significance for later-stage fault analysis is not great.
In order to solve the technical problems, the inventor provides a transient recording data compression method, which is based on the basic idea that transient data containing fault waveform data often causes real fault waveform data to occupy only a small part in a whole waveform file, data except fault waveforms in the whole waveform is redundant signals (power frequency signals and noise), and later-stage data analysis is useless.
Referring to fig. 1, fig. 1 is a flowchart illustrating a transient recording data compression method according to an embodiment of the present invention, where the transient recording data compression method includes:
and S10, acquiring transient wave recording data.
For example, referring to fig. 2, fig. 2 is a waveform diagram of transient recording data according to an embodiment of the present invention. The transient recording data comprises transient data and steady fundamental wave data; the data in the first period of the transient recording data is steady-state fundamental wave data.
In one implementation, the power waveform data collected by the sensor may be received, and X (X is a real number greater than or equal to 1) cycles before and Y (Y is a real number greater than or equal to 2) cycles after the fault occurrence time are taken as the transient recording data, and the total of X + Y cycles are taken as the transient recording data. The number of data points collected in each period is consistent; for the later data analysis, in some possible embodiments, X is greater than or equal to 2, and Y is greater than or equal to 3, so that the data length of the transient data is concentrated in only one segment of waveform as far as possible, and if the length is the same, the transient part in the obtained compressed file occupies only a small part, which can improve the compression efficiency and improve the compression effect.
It will be appreciated that since it is difficult to determine the start time of the transient data, X and Y can generally be of a larger value to ensure that the transient recording data is obtained to include the fault data in its entirety, while including at least one non-fault data. And in the analysis of such transient events, the overall data is of primary value in the waveform details during and before the transient occurs.
And S11, filtering and down-sampling the steady-state fundamental wave data to obtain the compressed steady-state fundamental wave data.
In some possible embodiments, the steady-state fundamental data is shown in fig. 2, the filtered steady-state fundamental data may be shown in fig. 3, see fig. 3, and fig. 3 is a waveform diagram of the steady-state fundamental data after filtering according to an embodiment of the present invention.
It can be understood that, because the transient waveform is superimposed on the steady-state waveform, and the steady-state waveform is periodic, it is possible to use this feature to compress the steady-state fundamental wave data, and then obtain the first data to be detected based on the compressed steady-state fundamental wave data.
And S13, subtracting the compressed steady-state fundamental wave data from the transient recording data to obtain first data to be detected.
In some possible embodiments, the first to-be-detected data may be as shown in fig. 4, see fig. 4, where fig. 4 is a waveform diagram of the first to-be-detected data provided by the embodiment of the present invention.
It is understood that the first data to be detected contains transient data; and taking the first period data of the transient recording data as steady-state fundamental wave data. And subtracting the steady-state fundamental wave data from the data of each period of the whole data respectively, and taking the data obtained by subtracting the steady-state fundamental wave data from the data of each period as first data to be detected.
It can be understood that the waveform of X cycles before the fault occurrence time is stored in the generation process of the transient recording data file, and X > 1. The data of subtracting the first period from the data of each period can be regarded as a filtering power frequency signal, so that the risk that the filtering power frequency is complex under a high sampling rate is reduced, and the separation of the power frequency signal and the first waveform is realized.
In some possible embodiments, because the compressed data is of a different length than the original data per cycle. Therefore, before subtracting the transient recording data from the compressed steady-state fundamental wave data, interpolation processing can be performed on the compressed steady-state fundamental wave data, and subtraction operation is performed on the interpolated steady-state fundamental wave and the transient recording data to obtain first data to be detected.
And S14, carrying out noise detection on the first data to be detected, and determining the starting time and the ending time of the transient data.
It can be understood that, because the transient data only occupies a small portion of the entire transient recording data, and the entire transient recording data includes noise data besides the transient data, and these noise data are not useful for the post-analysis, the determination of the start time and the end time of the transient data can be realized by detecting the noise, and the transient data can be stripped from the entire recording data.
And S15, intercepting the transient data from the first data to be detected according to the starting time and the ending time of the transient data, and taking the intercepted transient data and the compressed steady-state fundamental wave data as compressed transient recording data.
It can be understood that the captured transient data, i.e., the fault data stripped from the transient recording data, does not contain other redundant data except the fault data, and thus the basic purpose of compressing the transient recording data is achieved.
The transient recording data compression method provided by the embodiment of the invention comprises the following steps: acquiring transient wave recording data; the transient recording data comprises transient data and steady fundamental wave data; the data in the first period of the transient recording data are steady fundamental wave data; performing filtering processing and down-sampling processing on the steady-state fundamental wave data to obtain compressed steady-state fundamental wave data; subtracting the compressed steady-state fundamental wave data from the transient recording data to obtain first data to be detected; the first data to be detected comprises transient data; carrying out noise detection on the first data to be detected, and determining the starting time and the ending time of the transient data; intercepting transient data from the first data to be detected according to the starting time and the ending time of the transient data; and taking the intercepted transient data and the compressed steady-state fundamental wave data as compressed transient recording data. Unlike the prior art where the focus is the same for each portion of the data. The invention performs data compression on transient files, wherein fault waveforms are stripped, and fault data are retained without loss. The basic purpose of compressing the transient recording data is achieved, and the storage capacity of the transient recording data is reduced.
Optionally, the compressed steady-state fundamental wave data, the compressed transient recording data, and the noise energy value obtained from the first data to be detected may be stored, so as to facilitate subsequent query or later data decompression processing.
Optionally, to facilitate understanding of the above implementation process for determining the start time and the end time of the transient data, please refer to fig. 5, where fig. 5 is a schematic flowchart of an implementation manner of step S14 provided by an embodiment of the present invention, and step S14 may include:
s141, dividing the first data to be detected into N data segments, and carrying out noise detection on the N data segments according to a time sequence order.
In some possible embodiments, the first to-be-detected data may be divided into N data segments according to the preset truncation step size M, and since the data amount of the first to-be-detected data is large, the value of N is also large. Where the value of M should be less than the fault waveform duration length and N > = M.
It will be appreciated that each data segment has a corresponding start time and end time, with a time sequence order between the data segments, and that after N data segments are obtained, data noise detection may be performed for each data segment in turn, starting with the first data segment.
And S142, if the nth data segment is determined to be the first non-pure noise data segment, taking the starting time of the nth data segment as the starting time of the transient data when the preset number of data segments after the first non-pure noise data segment are all non-pure noise data segments.
It will be appreciated that the first non-pure noise data segment referred to above is: the data segment may include noise data and data other than the noise data, or may include only data other than noise.
In some possible embodiments, when the nth data segment is determined to be the first non-pure noise data segment (denoted as D1), a longer fault waveform occurs after the fault occurrence time, and with this feature, a preset number of data segments after D1 is subjected to noise detection, where the preset number may be obtained according to ceil (N/M) calculation, for example, N is 100, M is 30, and the preset number value may be ceil (100/30) =4 data segments. If each of these data segments contains data other than noise, then the start time of D1 is considered to be the conservative relative start time of the entire fault event, recorded as t 0. Then t0 may be the starting time of the transient data.
And S143, if the n + m data segments are determined to be the first pure noise data segment, taking the ending time of the n + m data segments as the ending time of the transient data when the preset number of data segments after the first pure noise data segment are all the pure noise data segments.
It will be appreciated that the first pure noise data segment refers to: the data segment contains only noise data. After the start time of obtaining the transient data, the noise detection may be continued for N-N data segments from the start time, i.e. after the nth data segment (D1), to obtain the first pure noise data segment.
In some possible embodiments, when the n + m-th data segment is determined to be the first pure noise data segment (denoted as D2), noise detection is performed on a preset number of data segments after D2, which is obtained as shown in the above embodiment of step S122, and if each of these data segments is a pure noise data segment, the end time of the D2 data segment may be labeled as the conservative relative end time of the entire fault event and recorded as t 1. Then t1 may be the starting time of the transient data.
Alternatively, in the noise detection process, since there is no lag correlation characteristic in noise, but if there is both a fault signal and other signals in a segment of a signal, there is a lag correlation in the signal, based on this characteristic, noise detection can be performed on each segment of the signal by verifying the lag correlation, and an implementation of determining non-pure noise data segments and pure noise data segments is given below, referring to fig. 6, fig. 6 is a schematic flow chart of an implementation of step S141 provided by the embodiment of the present invention, and step S141 may include:
and S141-1a, calculating hysteresis autocorrelation test statistics corresponding to each data segment in the N data segments.
In some possible embodiments, any noise detection method may be used to detect noise for each data segment, for example, the Ljung-Box test method may be used.
It will be appreciated that in the process of verifying the late correlation, assuming a data segment of length T, the late autocorrelation test statistic Q(s) for the data segment of length T is calculated and for a given significance level a, if the value of Q is greater than the chi-squared distribution of significance a, the data segment is considered pure noise. Otherwise, the data segment is considered to be a non-pure noise data segment, and the calculation formula of the hysteresis autocorrelation test statistic q(s) can be as follows:
wherein Q(s) a hysteresis autocorrelation test statistic; s is a preset autocorrelation order, M is the data segment length,
is the autocorrelation coefficient of the ith order lag.
And S141-2a, when the autocorrelation test statistic of the nth data segment is larger than the chi-square distribution of the preset significance level, determining the non-pure noise data segment of the nth data segment.
It will be appreciated that the nth data segment is the first non-pure noisy data segment, i.e., the autocorrelation test statistics of the 1 st data segment through the (n-1) th data segment are all less than or equal to the chi-square distribution of the predetermined significance level.
And S141-3a, when the autocorrelation test statistic of the (n + m) th data segment is less than or equal to the chi-square distribution of the preset significant level, determining that the (n + m) th data segment is a pure noise data segment.
It will be appreciated that the n + m data segment is the first pure noisy data segment, that is, the detection continues from the n data segment until the autocorrelation test statistics of the n + m-1 data segment are all greater than the chi-squared distribution of the preset significance level.
Optionally, if the noise signal energy is known, noise detection may be performed according to a magnitude relationship between the variance of each data segment and the noise signal energy, another implementation manner is given below, referring to fig. 7, where fig. 7 is a schematic flowchart of another implementation manner of step S141 provided in the embodiment of the present invention, and step S141 may further include:
and S141-1b, obtaining a signal noise energy value according to the first data to be detected.
And S141-2b, calculating the corresponding variance of each data segment in the N data segments.
And S141-3b, when the variance of the nth data segment is larger than the signal noise energy value, determining the non-pure noise data segment of the nth data segment.
It is understood that the variance of the 1 st data segment to the n-1 st data segment is smaller than the noise energy value, and the n data segment is the data segment with the first variance larger than the signal noise energy value.
And S141-4b, when the variance of the n + m data segments is less than or equal to the chi-square distribution of the preset significant level, determining that the n + m data segments are pure noise data segments.
It is understood that the variance of each of the nth data segment to the (n + m-1) th data segment is greater than the signal noise energy value, and the (n + m) th data segment is the data segment whose first variance is less than the signal noise energy value.
Optionally, after the steady-state fundamental wave data is compressed, the steady-state fundamental wave data may be compressed again according to the characteristics of the compressed steady-state fundamental wave data, and a possible implementation manner of step S11 is given below on the basis of fig. 1, referring to fig. 8, where fig. 8 is a schematic flowchart of an implementation manner of step S11 provided by the embodiment of the present invention, and step S11 may include:
and S11a, performing filtering and down-sampling processing on the steady-state fundamental wave data, and taking the characteristic data of the sinusoidal wave data as the compressed steady-state fundamental wave data when the steady-state fundamental wave data subjected to filtering processing is sinusoidal wave data.
It is understood that, in the case where the steady-state fundamental wave data is close to the standard sine wave data, characteristic data such as phase, radian, frequency, and the like of the filtered steady-state fundamental wave data may be recorded, and as the compressed steady-state fundamental wave data, the data amount can be further compressed.
Optionally, after the transient data is compressed, an embodiment of the present invention further provides an implementation manner of data decompression, and a characteristic of data before decompression is fully maintained in a decompression process, where an implementation manner is given below in fig. 1, referring to fig. 9, where fig. 9 is a third schematic flow chart of another transient recording data compression method provided in an embodiment of the present invention, and the method may further include:
s16, obtaining a signal noise energy value according to the first data to be detected;
s17, performing interpolation processing on the steady-state fundamental wave data subjected to the down-sampling processing according to the sampling frequency of the transient recording data so as to enable the data length of the steady-state fundamental wave data subjected to the interpolation processing to be consistent with the data length of the transient recording data;
and S18, superposing the steady-state fundamental wave data subjected to interpolation processing with the signal noise energy value to obtain first superposed data.
It is to be understood that the first superimposed data may be power frequency signal data.
And S19, overlapping the first overlapped data with the intercepted transient data so as to decompress the compressed transient recording data.
In order to achieve the above steps and achieve the corresponding technical effects, an implementation manner of a transient recording data compression apparatus is provided below, referring to fig. 10, where fig. 10 is a functional block diagram of a transient recording data compression apparatus according to an embodiment of the present invention, where the transient recording data compression apparatus 30 includes: an acquisition module 301, a detection module 302 and a compression module 303.
An obtaining module 301, configured to obtain transient recording data; the transient recording data comprises transient data and steady fundamental wave data; the data in the first period of the transient recording data are steady fundamental wave data; performing filtering processing and down-sampling processing on the steady-state fundamental wave data to obtain compressed steady-state fundamental wave data; subtracting the compressed steady-state fundamental wave data from the transient recording data to obtain first data to be detected; the first data to be detected comprises transient data;
the detection module 302 is configured to perform noise detection on the first to-be-detected data, and determine a start time and an end time of the transient data;
the compressing module 303 is configured to intercept the transient data from the first data to be detected according to the starting time and the ending time of the transient data, and use the intercepted transient data and the compressed steady-state fundamental wave data as compressed transient recording data.
Optionally, the detection module 302 is specifically configured to: dividing first data to be detected into N data segments, and carrying out noise detection on the N data segments according to a time sequence; if the nth data segment is determined to be the first non-pure noise data segment, when the data segments of the preset number behind the first non-pure noise data segment are all non-pure noise data segments, taking the starting time of the nth data segment as the starting time of the transient data; and if the n + m data segments are determined to be the first pure noise data segment, taking the ending time of the n + m data segments as the ending time of the transient data when the preset number of data segments after the first pure noise data segment are all the pure noise data segments.
Optionally, the transient recording data compression apparatus 30 further includes a calculating module and a determining module, the calculating module is configured to calculate the hysteresis autocorrelation test statistic of the N data segments; the determination module is used for determining a non-pure noise data segment of the nth data segment when the autocorrelation test statistic of the nth data segment is greater than the chi-square distribution of the preset significance level; and when the autocorrelation test statistic of the (n + m) th data segment is less than or equal to the chi-square distribution of the preset significance level, determining that the (n + m) th data segment is a pure noise data segment.
Optionally, the transient recording data compression apparatus 30 further includes a calculation module and a determination module; the obtaining module 301 is further configured to obtain a signal noise energy value according to the first data to be detected; the calculation module is used for calculating the variance corresponding to each data segment in the N data segments; the determining module is used for determining the non-pure noise data segment of the nth data segment when the variance of the nth data segment is larger than the signal noise energy value; and when the variance of the n + m data segments is less than or equal to the signal noise energy value, determining that the n + m data segments are pure noise data segments.
Optionally, the transient recording data compressing apparatus 30 further includes a storage module, and the storage module is configured to store the compressed steady-state fundamental wave data, the compressed transient recording data, and the noise energy value.
Optionally, the obtaining module 301 is further configured to, when the steady-state fundamental wave data is sinusoidal wave data, use the feature data of the sinusoidal wave data as the compressed steady-state fundamental wave data.
Optionally, the apparatus further includes a decompression module, specifically configured to: acquiring a signal noise energy value according to first data to be detected; performing interpolation processing on the steady-state fundamental wave data subjected to the down-sampling processing according to the sampling frequency of the transient recording data so as to enable the data length of the steady-state fundamental wave data subjected to the interpolation processing to be consistent with the data length of the transient recording data; superposing the steady-state fundamental wave data subjected to interpolation processing with the signal noise energy value to obtain first superposed data; and superposing the first superposed data and the intercepted transient data so as to decompress the compressed transient filtering data.
Fig. 11 shows a block diagram of an electronic device according to an embodiment of the present invention, where fig. 11 is a block diagram of the electronic device according to the embodiment of the present invention. The electronic device 50 comprises a communication interface 501, a processor 502 and a memory 503. The processor 502, memory 503 and communication interface 501 are electrically connected to each other, directly or indirectly, to enable the transfer or interaction of data. For example, the components may be electrically connected to each other via one or more communication buses or signal lines. The memory 503 can be used for storing software programs and modules, such as program instructions/modules corresponding to the transient recording data compression method provided by the embodiment of the present invention, and the processor 502 executes various functional applications and data processing by executing the software programs and modules stored in the memory 503. The communication interface 501 may be used for communicating signaling or data with other node devices. The electronic device 500 may have a plurality of communication interfaces 501 in the present invention.
The memory 503 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a programmable read-only memory (PROM), an erasable read-only memory (EPROM), an electrically erasable read-only memory (EEPROM), and the like.
The processor 502 may be an integrated circuit chip having signal processing capabilities. The processor may be a general-purpose processor including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, etc.
It is understood that the modules of the transient recording data compression apparatus 30 may be stored in the form of software or Firmware (Firmware) in the memory 503 of the electronic device 50 and executed by the processor 502, and at the same time, data, codes of programs, etc. required for executing the modules may be stored in the memory 503.
An embodiment of the present invention provides a storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the transient recording data compression method according to any one of the foregoing embodiments. The computer readable storage medium may be, but is not limited to, various media that can store program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a PROM, an EPROM, an EEPROM, a magnetic or optical disk, etc.
The above description is only for the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (10)
1. A method for transient recording data compression, the method comprising:
acquiring transient wave recording data; the transient recording data comprises transient data and steady fundamental wave data; the data in the first period of the transient recording data is the steady-state fundamental wave data;
performing filtering processing and down-sampling processing on the steady-state fundamental wave data to obtain the compressed steady-state fundamental wave data;
subtracting the compressed steady-state fundamental wave data from the transient recording data to obtain first data to be detected; the first data to be detected comprises the transient data;
carrying out noise detection on the first data to be detected, and determining the starting time and the ending time of the transient data;
and intercepting the transient data from the first data to be detected according to the starting time and the ending time, and taking the intercepted transient data and the compressed steady-state fundamental wave data as the compressed transient recording data.
2. The transient recording data compression method of claim 1, wherein performing noise detection on the first data to be detected and determining the start time and the end time of the transient data comprises:
dividing the first data to be detected into N data segments, and carrying out noise detection on the N data segments according to a time sequence;
if the nth data segment is determined to be a first non-pure noise data segment, when the data segments of the preset number behind the first non-pure noise data segment are all non-pure noise data segments, taking the starting time of the nth data segment as the starting time of the transient data;
if the n + m data segments are determined to be the first pure noise data segment, taking the ending time of the n + m data segments as the ending time of the transient data when the preset number of data segments after the first pure noise data segment are all pure noise data segments.
3. The method of compressing transient recording data according to claim 2, wherein the step of dividing the first data to be detected into N data segments and performing noise detection on the N data segments in time sequence order comprises:
calculating lag autocorrelation test statistics for the N data segments;
when the autocorrelation test statistic of the nth data segment is greater than the chi-square distribution of a preset significance level, determining a non-pure noise data segment of the nth data segment;
and when the autocorrelation test statistic of the (n + m) th data segment is less than or equal to the chi-square distribution of the preset significance level, determining that the (n + m) th data segment is a pure noise data segment.
4. The method of compressing transient recording data according to claim 2, wherein the step of dividing the first data to be detected into N data segments and performing noise detection on the N data segments in time sequence order comprises:
acquiring a signal noise energy value according to the first data to be detected;
calculating the variance corresponding to each data segment in the N data segments;
when the variance of the nth data segment is larger than the signal noise energy value, determining a non-pure noise data segment of the nth data segment;
and when the variance of the n + m data segments is less than or equal to the signal noise energy value, determining that the n + m data segments are pure noise data segments.
5. The transient recording compression method of claim 4, wherein after the transient data are intercepted from the first data to be detected according to the starting time and the ending time, and the intercepted transient data and the compressed steady-state fundamental wave data are used as the compressed transient recording data, the method further comprises:
and storing the compressed steady-state fundamental wave data, the compressed transient recording data and the noise energy value.
6. The transient recording data compression method of claim 1, wherein the steady-state fundamental wave data is filtered and down-sampled, and after obtaining the compressed steady-state fundamental wave data, the method further comprises:
acquiring a signal noise energy value according to the first data to be detected;
performing interpolation processing on the steady-state fundamental wave data subjected to the down-sampling processing according to the sampling frequency of the transient recording data so as to enable the data length of the steady-state fundamental wave data subjected to the interpolation processing to be consistent with the data length of the transient recording data;
superposing the steady-state fundamental wave data subjected to interpolation processing with the signal noise energy value to obtain first superposed data;
and superposing the first superposed data and the compressed transient data so as to decompress the compressed transient recording data.
7. The transient recording data compression method of claim 1, wherein the filtering and downsampling the steady-state fundamental wave data to obtain the compressed steady-state fundamental wave data comprises:
and performing filtering and downsampling processing on the steady-state fundamental wave data, and when the steady-state fundamental wave data subjected to filtering processing is sine wave data, taking the characteristic data of the sine wave data as the compressed steady-state fundamental wave data.
8. A transient recording data compression apparatus, comprising:
the acquisition module is used for acquiring transient recording data; the transient recording data comprises transient data and steady fundamental wave data; the data in the first period of the transient recording data is the steady-state fundamental wave data; performing filtering processing and down-sampling processing on the steady-state fundamental wave data to obtain the compressed steady-state fundamental wave data; subtracting the compressed steady-state fundamental wave data from the transient recording data to obtain first data to be detected; the first data to be detected comprises the transient data;
the detection module is used for carrying out noise detection on the first data to be detected and determining the starting time and the ending time of the transient data;
and the compression module is used for intercepting the transient data from the first data to be detected according to the starting time and the ending time, and taking the intercepted transient data and the compressed steady-state fundamental wave data as the compressed transient recording data.
9. An electronic device comprising a processor and a memory, the memory storing a computer program executable by the processor, the processor being configured to execute the computer program to implement the transient recording data compression method of any of claims 1-7.
10. A storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the transient recording data compression method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110000690.0A CN112328563B (en) | 2021-01-04 | 2021-01-04 | Transient recording data compression method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110000690.0A CN112328563B (en) | 2021-01-04 | 2021-01-04 | Transient recording data compression method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112328563A true CN112328563A (en) | 2021-02-05 |
| CN112328563B CN112328563B (en) | 2021-05-18 |
Family
ID=74302457
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110000690.0A Active CN112328563B (en) | 2021-01-04 | 2021-01-04 | Transient recording data compression method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112328563B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117424606A (en) * | 2023-12-18 | 2024-01-19 | 成都行芯科技有限公司 | Waveform data compression method, device, electronic device and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5995532A (en) * | 1996-12-23 | 1999-11-30 | Stein Heurtey | Method using fuzzy logic for controlling a furnace |
| US20050285613A1 (en) * | 2004-06-24 | 2005-12-29 | Isakharov Arthur R | Mechanism to stabilize power delivered to a device under test |
| CN101038303A (en) * | 2007-02-07 | 2007-09-19 | 深圳市双合电脑系统股份有限公司 | Compression method for electric power waveform recording date |
| CN102520227A (en) * | 2011-12-14 | 2012-06-27 | 国电南瑞科技股份有限公司 | Fault recording data compression method based on disturbance indicator |
| CN105406596A (en) * | 2015-12-11 | 2016-03-16 | 国家电网公司 | Hybrid current criterion based non-invasive non-variable frequency air conditioner starting identification method |
| CN109239494A (en) * | 2018-09-21 | 2019-01-18 | 无锡风繁伟业科技有限公司 | A kind of non-intrusive electrical load alert detecting method and system |
| CN109814135A (en) * | 2019-03-13 | 2019-05-28 | 清华四川能源互联网研究院 | Time Registration Method based on GNSS device |
| CN109980784A (en) * | 2019-03-29 | 2019-07-05 | 国网江苏省电力有限公司扬州供电分公司 | A kind of distribution line current acquisition system, acquisition method and Fault Locating Method |
| CN111220876A (en) * | 2020-03-30 | 2020-06-02 | 厦门四信智慧电力科技有限公司 | Transient recording data compression method, device, equipment and storage medium |
-
2021
- 2021-01-04 CN CN202110000690.0A patent/CN112328563B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5995532A (en) * | 1996-12-23 | 1999-11-30 | Stein Heurtey | Method using fuzzy logic for controlling a furnace |
| US20050285613A1 (en) * | 2004-06-24 | 2005-12-29 | Isakharov Arthur R | Mechanism to stabilize power delivered to a device under test |
| CN101038303A (en) * | 2007-02-07 | 2007-09-19 | 深圳市双合电脑系统股份有限公司 | Compression method for electric power waveform recording date |
| CN102520227A (en) * | 2011-12-14 | 2012-06-27 | 国电南瑞科技股份有限公司 | Fault recording data compression method based on disturbance indicator |
| CN105406596A (en) * | 2015-12-11 | 2016-03-16 | 国家电网公司 | Hybrid current criterion based non-invasive non-variable frequency air conditioner starting identification method |
| CN109239494A (en) * | 2018-09-21 | 2019-01-18 | 无锡风繁伟业科技有限公司 | A kind of non-intrusive electrical load alert detecting method and system |
| CN109814135A (en) * | 2019-03-13 | 2019-05-28 | 清华四川能源互联网研究院 | Time Registration Method based on GNSS device |
| CN109980784A (en) * | 2019-03-29 | 2019-07-05 | 国网江苏省电力有限公司扬州供电分公司 | A kind of distribution line current acquisition system, acquisition method and Fault Locating Method |
| CN111220876A (en) * | 2020-03-30 | 2020-06-02 | 厦门四信智慧电力科技有限公司 | Transient recording data compression method, device, equipment and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| ARANTXA CONTRERAS-VALDES等: "Data compression based on discrete Wavelet transform and fault detection of short-circuit faults in transformers", 《2019 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING》 * |
| 庄明强: "基于数据压缩与GPRS的配变数据采集与监控系统研究", 《中国优秀硕士学位论文全文数据库 工程科技II辑》 * |
| 罗怿 等: "输变电设备故障大数据可视化分析方法研究", 《电力信息与通信技术》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117424606A (en) * | 2023-12-18 | 2024-01-19 | 成都行芯科技有限公司 | Waveform data compression method, device, electronic device and storage medium |
| CN117424606B (en) * | 2023-12-18 | 2024-04-16 | 成都行芯科技有限公司 | Waveform data compression method, device, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112328563B (en) | 2021-05-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9170986B2 (en) | Power quality meter and method of waveform anaylsis and compression | |
| US20140136002A1 (en) | Method for distributed waveform recording in a power distribution system | |
| CN110736899B (en) | Small current grounding fault positioning method and system, monitoring device, equipment and medium | |
| CN109307798B (en) | Power signal filtering method for switch event detection | |
| CN112328563B (en) | Transient recording data compression method and device, electronic equipment and storage medium | |
| CN112986754B (en) | Small current grounding system fault identification method and device based on data driving | |
| CN104136896A (en) | System for acquiring a vibratory signal of a rotary motor | |
| CN111521867A (en) | System and method for collecting load data | |
| JP2020030125A (en) | Abnormality diagnosis device and abnormality diagnosis method | |
| CN111751645A (en) | Transformer direct-current magnetic bias monitoring method, device, equipment and system | |
| CN116896064B (en) | Power utilization characteristic analysis system and method for power utilization load | |
| CN111525202A (en) | Method, system, equipment and medium for monitoring DCR in lithium ion battery cycle | |
| CN110618338A (en) | Electric energy quality transient measurement method, device and equipment | |
| CN115951824A (en) | Sampling data processing method, device and nonvolatile storage medium | |
| CN110188961B (en) | Method, system and computer readable storage medium for predicting health of power distribution system | |
| CN107102195B (en) | Electric quantity processing and network transmission method of intelligent transformer terminal | |
| CN115754812A (en) | Method and device for detecting internal short circuit fault of stator winding of variable-speed pumped storage unit | |
| CN113805050B (en) | Phase selection closing angle monitoring method and device, computer equipment and storage medium | |
| CN115343579A (en) | Power grid fault analysis method and device and electronic equipment | |
| CN115208308A (en) | Photovoltaic system direct-current fault arc detection method and related equipment | |
| CN108802493A (en) | A kind of Voltage Drop intelligent detecting method | |
| CN114527321A (en) | Anti-transient interference voltage sag detection method and device suitable for SSTS | |
| TW201224473A (en) | Electricity feature identification device and method thereof | |
| CN112000543A (en) | Method, device and equipment for detecting time delay performance of storage system | |
| Wang et al. | Lcl: Light contactless low-delay load monitoring via compressive attentional multi-label learning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |