CN112702340B - Historical message compression method and system, computing equipment and storage medium thereof - Google Patents
Historical message compression method and system, computing equipment and storage medium thereof Download PDFInfo
- Publication number
- CN112702340B CN112702340B CN202011536848.8A CN202011536848A CN112702340B CN 112702340 B CN112702340 B CN 112702340B CN 202011536848 A CN202011536848 A CN 202011536848A CN 112702340 B CN112702340 B CN 112702340B
- Authority
- CN
- China
- Prior art keywords
- measurement data
- message
- messages
- data messages
- compressing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000007906 compression Methods 0.000 title claims description 38
- 230000006835 compression Effects 0.000 title claims description 38
- 238000005259 measurement Methods 0.000 claims abstract description 252
- 238000004891 communication Methods 0.000 claims abstract description 11
- 230000003068 static effect Effects 0.000 claims description 52
- 238000004590 computer program Methods 0.000 claims description 10
- 238000005070 sampling Methods 0.000 claims description 6
- 238000001914 filtration Methods 0.000 claims description 4
- 238000000605 extraction Methods 0.000 claims description 3
- 238000012806 monitoring device Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention relates to a method and a system for compressing historical messages, a computing device and a storage medium, wherein the method comprises the following steps: periodically acquiring first measurement data messages from a plurality of RTUs; respectively carrying out data combination on a plurality of measurement data in a data sequence in each first measurement data message to obtain a plurality of second measurement data messages; if the difference value of any two measurement data is smaller than the preset error, combining the two measurement data into one measurement data; compressing the plurality of second measurement data messages to obtain a plurality of third measurement data messages; if at least two second measurement data messages belong to the same RTU and are on the same day, compressing the at least two second measurement data messages into a third measurement data message; and storing the plurality of third measurement data messages according to the communication addresses allocated by the RTUs corresponding to the third measurement data messages. In the invention, partial measurement data in the same measurement data message are combined, so that the data size is reduced, and the storage space resource is saved.
Description
Technical Field
The invention relates to the technical field of unmanned aerial vehicle route planning, in particular to a historical message compression method and a system, computer equipment and a computer readable storage medium thereof.
Background
The power telecontrol system is a special automatic system in the power industry, has the advantages of complete information, improved efficiency, correct grasping of the running state of the system, quickening of decision, helping to quickly diagnose the fault state of the system and the like, and is an indispensable tool for power dispatching. The data acquisition module is a core support module of the power telemechanical system. Such as for example the grid: various measurement data and information such as voltage, current, power, electric power, frequency, phase and the like are collected by RTU (Remote Terminal Unit) and transmitted to a computer master station through a communication port, so that the monitoring of a power grid is realized. Various dispatching commands of the power grid are sent to the RTU by the computer master station and executed by the RTU, so that automation of power grid control is realized. The connection of a computer master to a plurality of monitoring devices (i.e., RTUs) makes the amount of information exchanged between the computer master and the monitoring devices very large. For the requirement of power grid operation management, the interaction information of the computer master station and the monitoring equipment needs to be saved and backed up so as to provide a search query function for the information when required.
Disclosure of Invention
The invention aims to provide a historical message compression method and a system thereof, computer equipment and a computer readable storage medium so as to carry out compression backup of interaction information between a computer master station and monitoring equipment.
In order to achieve the above object, a first aspect of the present invention provides a method for compressing a history message, including:
periodically acquiring first measurement data messages from a plurality of RTUs;
respectively carrying out data combination on a plurality of measurement data in a data sequence in each first measurement data message to obtain a plurality of second measurement data messages; if the difference value of any two measurement data is smaller than the preset error, combining the two measurement data into one measurement data;
compressing the plurality of second measurement data messages to obtain a plurality of third measurement data messages; if at least two second measurement data messages belong to the same RTU and are on the same day, compressing the at least two second measurement data messages into a third measurement data message;
and storing the plurality of third measurement data messages according to the communication addresses allocated by the RTUs corresponding to the third measurement data messages.
Optionally, the measurement data type of the first measurement data packet of each RTU includes at least voltage, current, power, frequency, and phase; the data sequence in one first measurement data message corresponds to one measurement data type, and the data sequence in one first measurement data message comprises a plurality of measurement data of the same type, and the measurement data of the same type respectively correspond to different sampling moments.
Optionally, if the difference between every two of the plurality of measurement data is smaller than the preset error, the plurality of measurement data are combined into one measurement data, and the value of the one measurement data is an average value of the plurality of measurement data.
Optionally, the compressing the plurality of second measurement data packets to obtain a plurality of third measurement data packets specifically includes:
respectively extracting the dynamic information and the static information of each second measurement data message to obtain the dynamic information and the static information of all the second measurement data messages;
respectively storing the dynamic information of all second measurement data messages with the same static information into a dynamic storage structure, and storing the same static information into a static storage structure to obtain an optimized measurement data message structure; the optimized measurement data message structure comprises the dynamic storage structure and the static storage structure; thereby obtaining a plurality of optimized measurement data message structures;
and compressing the optimized measurement data message structures to obtain a corresponding plurality of third measurement data messages.
The second aspect of the present invention proposes a system for compressing a history message, comprising:
the message acquisition unit is used for periodically acquiring first measurement data messages from a plurality of RTUs;
the message filtering unit is used for respectively carrying out data combination on a plurality of measurement data in the data sequence in each first measurement data message to obtain a plurality of second measurement data messages; if the difference value of any two measurement data is smaller than the preset error, combining the two measurement data into one measurement data;
the message compression unit is used for compressing the plurality of second measurement data messages to obtain a plurality of third measurement data messages; if at least two second measurement data messages belong to the same RTU and are on the same day, compressing the at least two second measurement data messages into a third measurement data message; and
and the message storage unit is used for storing the plurality of third measurement data messages according to the communication addresses allocated by the RTUs corresponding to the third measurement data messages.
Optionally, the measurement data type of the first measurement data packet of each RTU includes at least voltage, current, power, frequency, and phase; the data sequence in one first measurement data message corresponds to one measurement data type, and the data sequence in one first measurement data message comprises a plurality of measurement data of the same type, and the measurement data of the same type respectively correspond to different sampling moments.
Optionally, if the difference between every two of the plurality of measurement data is smaller than the preset error, the plurality of measurement data are combined into one measurement data, and the value of the one measurement data is an average value of the plurality of measurement data.
Optionally, the message compression unit includes:
the dynamic and static information extraction unit is used for respectively extracting the dynamic information and the static information of each second measurement data message to obtain the dynamic information and the static information of all the second measurement data messages;
the message structure optimizing unit is used for respectively storing the dynamic information of all second measurement data messages with the same static information into a dynamic storage structure, and storing the same static information into the static storage structure to obtain an optimized measurement data message structure; the optimized measurement data message structure comprises the dynamic storage structure and the static storage structure; thereby obtaining a plurality of optimized measurement data message structures; and
and the compression execution unit is used for compressing the optimized measurement data message structures to obtain a corresponding plurality of third measurement data messages.
A third aspect of the present invention proposes a computer device comprising: the history message compression system according to the second aspect; alternatively, a memory and a processor, the memory having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the method for history message compression according to the first aspect.
A fourth aspect of the invention proposes a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method of history message compression according to the first aspect.
In summary, the present invention provides a method and a system for compressing a history message, a computer device, and a computer readable storage medium, which have at least the following advantages:
the method is realized based on the computer master station, and the data messages are synchronously acquired when the computer master station receives the data messages; then, respectively carrying out data combination on a plurality of measurement data in the data sequence in each first measurement data message to obtain a plurality of second measurement data messages; if the difference value of any two measurement data is smaller than the preset error, combining the two measurement data into one measurement data; compressing the plurality of second measurement data messages to obtain a plurality of third measurement data messages; if at least two second measurement data messages belong to the same RTU and are on the same day, compressing the at least two second measurement data messages into a third measurement data message; and storing the plurality of third measurement data messages according to the communication addresses allocated by the RTUs corresponding to the third measurement data messages. In the embodiment of the invention, partial measurement data in the same measurement data message is combined according to the set rule, so that the size of the data is reduced, and the storage space resource of a computer master station is saved.
Additional features and advantages of the invention will be set forth in the description which follows.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart of a method for compressing a history message according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of a history message compression system according to an embodiment of the invention.
Fig. 3 is a schematic structural diagram of a computer device according to an embodiment of the invention.
Detailed Description
Various exemplary embodiments, features and aspects of the disclosure will be described in detail below with reference to the drawings. In addition, numerous specific details are set forth in the following examples in order to provide a better illustration of the invention. It will be understood by those skilled in the art that the present invention may be practiced without some of these specific details. In some instances, well known means have not been described in detail in order to not obscure the present invention.
Referring to fig. 1, an embodiment of the present invention provides a method for compressing a history message, where the method is implemented based on a computer master station, and includes the following steps:
step S1, periodically acquiring first measurement data messages from a plurality of RTUs;
specifically, in the power telemechanical system, a computer master station is connected with a plurality of monitoring devices, namely a remote terminal unit RTU; the first measurement data message in the implementation step S1 of the present invention can be directly used as the first measurement data message in the implementation step S1 after the computer master station receives the measurement data generated by the RTU, or can be input after being processed by the computer master station, for example, the first measurement data message in the implementation step S1 of the present invention is obtained after the data format conversion processing;
in general, RTUs typically transmit these data to the computer master at intervals, such as every 3, 5, 10 or 15 minutes;
step S2, respectively carrying out data combination on a plurality of measurement data in a data sequence in each first measurement data message to obtain a plurality of second measurement data messages; if the difference value of any two measurement data is smaller than the preset error, combining the two measurement data into one measurement data;
optionally, the measurement data type of the first measurement data packet of each RTU includes at least voltage, current, power, frequency, and phase; wherein, a first measurement data message corresponds to a measurement data type, a data sequence in the first measurement data message comprises a plurality of measurement data of the same type, and the measurement data of the same type respectively correspond to different sampling moments;
taking the voltage data of a high-voltage line measured by a certain RTU as an example for explanation, in this example, the standard voltage is 11KV, and voltage data messages are collected and sent at intervals of 10 minutes. Wherein the voltage data sequence is as follows:
1 11.21KV，
2 11.18KV，
3 11.14KV，
4 11.13KV，
5 11.07KV，
6 11.06KV，
7 11.01KV，
8 10.99KV，
9 10.98KV，
10 10.99KV；
1-10 above are used to represent time stamps for the voltage sequence data; because the voltage data is represented by floating point numbers, and the acquired voltage has errors, the two voltage values can be considered to be the same as long as the errors are allowed; assuming that the allowable error range is 0.04KV, comparing the adjacent voltage data, and considering that the voltages with the time marks of 1 and 2 are the same, the voltages with the time marks of 3 and 4 are the same, the voltages with the time marks of 5 and 6 are the same, and the voltages with the time marks of 7,8,9 and 10 are the same; the data content left after the same voltage data is removed is:
11.21KV，
11.14KV，
11.07KV，
11.01KV；
optionally, if the difference between every two of the plurality of measurement data is smaller than the preset error, merging the plurality of measurement data into one measurement data, wherein the value of the one measurement data is an average value of the plurality of measurement data;
the voltage data can also adopt the average value of a plurality of same adjacent voltages, and the data content left after the same voltage data is removed is as follows:
11.195KV，
11.135KV，
11.065KV，
10.993KV；
after the processing, the original 10 data only have 4 data, the data compression rate reaches 40%, and the method has considerable compression effect. In fact, the data collected by the electric remote control system can be compressed in such a way that the compression rate is 20% -70%;
s3, compressing the plurality of second measurement data messages to obtain a plurality of third measurement data messages; if at least two second measurement data messages belong to the same RTU and are on the same day, compressing the at least two second measurement data messages into a third measurement data message;
optionally, the step S3 specifically includes:
step S31, respectively extracting the dynamic information and the static information of each second measurement data message to obtain the dynamic information and the static information of all the second measurement data messages;
step S32, respectively storing the dynamic information of all second measurement data messages with the same static information into a dynamic storage structure, and storing the same static information into the static storage structure to obtain an optimized measurement data message structure; the optimized measurement data message structure comprises the dynamic storage structure and the static storage structure; thereby obtaining a plurality of optimized measurement data message structures;
step S33, compressing the optimized measurement data message structures to obtain a corresponding third measurement data message;
specifically, in the step, the message structure of the second measurement data message is optimized, so that the message structure comprises a static storage structure and a dynamic storage structure, and static information and dynamic information are respectively stored;
the measurement data message from the RTU contains a large amount of same static information, taking the voltage data of the high-voltage line measured by the RTU as an example, the standard voltage is 11KV, and the message of the voltage data is collected and sent at intervals of 10 minutes; each message contains static information such as RTU identification, time stamp and the like, and in addition, the messages also contain static information of 11KV standard voltage; if each message contains the same static information, a great deal of space resource waste is caused; therefore, the messages belonging to the same RTU can be integrated into an integral message structure, and the message structure comprises static information and dynamic information; the example of the C language code of its message structure is as follows:
in the above code example, the static statistical information is extracted into the volstatic structure, the difference between the actual voltage data and the standard voltage is put into the dynamic information structure volDynamic, and the difference between the actual time stamp and the data date is put into the dynamic information structure volDynamic; both the voltage data and the time stamp are represented in voldyananmic by a double-byte integer; vol at every 1 point in the dynamic information structure volDynamic represents 0.001KV; the actual voltage is the sum of the standard voltage volStand in the static information structure volStatic and the dynamic voltage represented by vol in the dynamic information structure volDynamic; the time stamp of the actual voltage data message is the sum of the date day of the data in the static information structure volStatic and the sil in the dynamic information structure volDynamic;
taking the voltage data of the high-voltage line collected by the RTU as an example, the standard voltage is 11KV, and the voltage data messages are collected and sent at intervals of 5 minutes; the volStand stored data in volStatic was 11000; when vol in volDynamic is denoted as 10, the voltage actually represented is: 11kv+0.001kv×10=11.01 KV; when vol in volDynamic is denoted as 720, the voltage actually represented is: 11kv+0.001kv×720=11.72 KV;
it should be noted that, examples of voltage measurement data are given herein, and other types of combination and compression of measurement data may be obtained by referring to examples of voltage measurement data, so that no further description is given herein;
specifically, in this embodiment, the structure of the measurement data packet belonging to the same RTU and being the same day is compressed by using a standard compression algorithm to obtain a corresponding third measurement data packet, where the standard compression algorithm is a lossless compression algorithm, and there are a plurality of standard lossless compression algorithms, preferably but not limited to huffman algorithm and LZW compression algorithm; compressing the messages belonging to the same RTU and the same day and carrying out the optimization process of the message structure, wherein based on the knowledge, the static information comprises an RTU identifier and a data date, so that the static information and the dynamic information in the messages which belong to the same RTU and are the same day are stored in an integral structure after the message structure is optimized;
it should be noted that, after the above statistical processing, the data content is greatly reduced; in the above example, the original message format requires 16 bytes for each message, a data sequence of 24 hours a day and 5 minutes at intervals, there are 288 messages in total in a day, and the total number of bytes required is: 16×288=4608; after statistical analysis, the required number of bytes is: static information is 16 bytes in total, and adding 4×288=1152 bytes of dynamic information, only 1168 bytes are needed in total; the compression ratio is: 1168/4608=25.3%; if the compression ratio after the previous message filtration is added with 40%, the compression ratio of 10.1% can be obtained; this is a considerable compression effect;
step S4, storing the plurality of third measurement data messages according to the communication addresses allocated by the RTUs corresponding to the third measurement data messages;
specifically, the plurality of third measurement data messages are respectively obtained by compression according to different RTU corresponding relations, in the step, the compressed messages are stored according to communication addresses corresponding to the RTU, historical message data are stored in a file mode, the compressed messages are stored according to the communication addresses, namely, different catalogues are opened up according to geographic positions of different monitoring devices, then the messages of the monitoring devices at the geographic positions are stored under the corresponding catalogues, and the storage mode can be convenient for searching.
Referring to fig. 2, another embodiment of the present invention further provides a system for compressing a history message, including:
a message obtaining unit 1, configured to periodically obtain first measurement data messages from a plurality of RTUs;
the message filtering unit 2 is configured to respectively perform data merging on a plurality of measurement data in the data sequence in each first measurement data message to obtain a plurality of second measurement data messages; if the difference value of any two measurement data is smaller than the preset error, combining the two measurement data into one measurement data;
the message compression unit 3 is configured to compress the plurality of second measurement data messages to obtain a plurality of third measurement data messages; if at least two second measurement data messages belong to the same RTU and are on the same day, compressing the at least two second measurement data messages into a third measurement data message; and
and the message storage unit 4 is used for storing the plurality of third measurement data messages according to the communication addresses allocated by the RTUs corresponding to the third measurement data messages.
Optionally, the measurement data type of the first measurement data packet of each RTU includes at least voltage, current, power, frequency, and phase; the data sequence in one first measurement data message corresponds to one measurement data type, and the data sequence in one first measurement data message comprises a plurality of measurement data of the same type, and the measurement data of the same type respectively correspond to different sampling moments.
Optionally, if the difference between every two of the plurality of measurement data is smaller than the preset error, the plurality of measurement data are combined into one measurement data, and the value of the one measurement data is an average value of the plurality of measurement data.
Optionally, the message compression unit 3 includes:
the dynamic and static information extraction unit is used for respectively extracting the dynamic information and the static information of each second measurement data message to obtain the dynamic information and the static information of all the second measurement data messages;
the message structure optimizing unit is used for respectively storing the dynamic information of all second measurement data messages with the same static information into a dynamic storage structure, and storing the same static information into the static storage structure to obtain an optimized measurement data message structure; the optimized measurement data message structure comprises the dynamic storage structure and the static storage structure; thereby obtaining a plurality of optimized measurement data message structures; and
and the compression execution unit is used for compressing the optimized measurement data message structures to obtain a corresponding plurality of third measurement data messages.
Also, the history message compression system according to the above embodiment may be stored in a computer-readable storage medium if implemented in the form of a software functional unit and sold or used as a separate product.
It should be noted that the above embodiment system corresponds to the above embodiment method, and therefore, relevant contents not described in detail in the above embodiment system may be obtained by referring to the contents of the above embodiment method, which are not described herein again.
Referring to fig. 3, another embodiment of the present invention further provides a computer device, including:
the history message compression system according to the above embodiment; or, a memory 10 and a processor 20, wherein the memory 10 stores computer readable instructions 101, and the computer readable instructions 101 when executed by the processor 20 cause the processor 20 to perform the steps of the history message compression method according to the above embodiment.
Of course, the computer device may also have a wired or wireless network interface, a keyboard, an input/output interface, and other components for implementing the functions of the device, which are not described herein.
Illustratively, the computer program may be partitioned into one or more units, which are stored in the memory and executed by the processor to accomplish the present invention. The one or more elements may be a series of computer program instruction segments capable of performing the specified functions, which instruction segments describe the execution of the computer program in the computer device.
The processor may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like that is a control center of the computer device, connecting various interfaces and lines throughout the various portions of the computer device.
The memory may be used to store the computer program and/or elements, and the processor may implement various functions of the computer device by running or executing the computer program and/or elements stored in the memory, and invoking data stored in the memory. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as a hard disk, memory, plug-in hard disk, smart Media Card (SMC), secure Digital (SD) Card, flash Card (Flash Card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.
Another embodiment of the present invention also proposes a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method for compressing a history message according to the above embodiment.
In particular, the computer-readable storage medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth.
The foregoing description of embodiments of the invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various embodiments described. The terminology used herein was chosen in order to best explain the principles of the embodiments, the practical application, or the technical improvements in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
Claims (8)
1. A method for compressing a history message, comprising:
periodically acquiring first measurement data messages from a plurality of RTUs; wherein, a first measurement data message corresponds to a measurement data type, a data sequence in the first measurement data message comprises a plurality of measurement data of the same type, and the measurement data of the same type respectively correspond to different sampling moments;
respectively carrying out data combination on a plurality of measurement data in a data sequence in each first measurement data message to obtain a plurality of second measurement data messages; if the difference value of any two measurement data is smaller than the preset error, combining the two measurement data into one measurement data;
compressing the plurality of second measurement data messages to obtain a plurality of third measurement data messages; if at least two second measurement data messages belong to the same RTU and are on the same day, compressing the at least two second measurement data messages into a third measurement data message;
storing the plurality of third measurement data messages according to the communication addresses allocated by the RTUs corresponding to the third measurement data messages;
wherein compressing the at least two second measurement data messages into a third measurement data message includes:
respectively extracting the dynamic information and the static information of each second measurement data message to obtain the dynamic information and the static information of all the second measurement data messages; respectively storing the dynamic information of all second measurement data messages with the same static information into a dynamic storage structure, and storing the same static information into a static storage structure to obtain an optimized measurement data message structure; the optimized measurement data message structure comprises the dynamic storage structure and the static storage structure; thereby obtaining a plurality of optimized measurement data message structures; and compressing the optimized measurement data message structures to obtain a corresponding plurality of third measurement data messages.
2. The method of claim 1, wherein the measurement data type of the first measurement data message of each RTU includes at least voltage, current, power, frequency, and phase.
3. The method of claim 2, wherein if the difference between two of the plurality of measurement data is smaller than a predetermined error, the plurality of measurement data are combined into one measurement data, and the value of the one measurement data is an average value of the plurality of measurement data.
4. A history message compression system, comprising:
the message acquisition unit is used for periodically acquiring first measurement data messages from a plurality of RTUs; wherein, a first measurement data message corresponds to a measurement data type, a data sequence in the first measurement data message comprises a plurality of measurement data of the same type, and the measurement data of the same type respectively correspond to different sampling moments;
the message filtering unit is used for respectively carrying out data combination on a plurality of measurement data in the data sequence in each first measurement data message to obtain a plurality of second measurement data messages; if the difference value of any two measurement data is smaller than the preset error, combining the two measurement data into one measurement data;
the message compression unit is used for compressing the plurality of second measurement data messages to obtain a plurality of third measurement data messages; if at least two second measurement data messages belong to the same RTU and are on the same day, compressing the at least two second measurement data messages into a third measurement data message; and
the message storage unit is used for storing the plurality of third measurement data messages according to the communication addresses allocated by the RTUs corresponding to the third measurement data messages;
the message compression unit comprises:
the dynamic and static information extraction unit is used for respectively extracting the dynamic information and the static information of each second measurement data message to obtain the dynamic information and the static information of all the second measurement data messages;
the message structure optimizing unit is used for respectively storing the dynamic information of all second measurement data messages with the same static information into a dynamic storage structure, and storing the same static information into the static storage structure to obtain an optimized measurement data message structure; the optimized measurement data message structure comprises the dynamic storage structure and the static storage structure; thereby obtaining a plurality of optimized measurement data message structures; and
and the compression execution unit is used for compressing the optimized measurement data message structures to obtain a corresponding plurality of third measurement data messages.
5. The system of claim 4, wherein the measurement data type of the first measurement data message of each RTU includes at least voltage, current, power, frequency, phase.
6. The system of claim 5, wherein if the difference between two of the plurality of measurement data is smaller than the predetermined error, the plurality of measurement data are combined into one measurement data, and the value of the one measurement data is an average value of the plurality of measurement data.
7. A computer device, comprising: a history message compression system according to any one of claims 4 to 6; or, a memory and a processor, the memory having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the method of history message compression according to any one of claims 1-3.
8. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the history message compression method according to any one of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011536848.8A CN112702340B (en) | 2020-12-23 | 2020-12-23 | Historical message compression method and system, computing equipment and storage medium thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011536848.8A CN112702340B (en) | 2020-12-23 | 2020-12-23 | Historical message compression method and system, computing equipment and storage medium thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112702340A CN112702340A (en) | 2021-04-23 |
| CN112702340B true CN112702340B (en) | 2023-12-19 |
Family
ID=75509301
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011536848.8A Active CN112702340B (en) | 2020-12-23 | 2020-12-23 | Historical message compression method and system, computing equipment and storage medium thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112702340B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102118293A (en) * | 2009-12-30 | 2011-07-06 | 上海可鲁系统软件有限公司 | Method for compressing and storing communication messages |
| CN111240594A (en) * | 2020-01-09 | 2020-06-05 | 深圳市东深电子股份有限公司 | Water conservation RTU-based encrypted compressed data storage method |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8244911B2 (en) * | 2008-07-22 | 2012-08-14 | International Business Machines Corporation | Method and apparatus for concurrent and stateful decompression of multiple compressed data streams |
| GB2477366B (en) * | 2009-11-12 | 2013-06-19 | Onzo Ltd | Data storage and transfer |
| CN102427369B (en) * | 2011-10-19 | 2014-01-01 | 广东电网公司电力科学研究院 | Real-time holographic lossless compression method for productive time sequence data |
| CN105375930A (en) * | 2015-04-09 | 2016-03-02 | 国家电网公司 | Energy storage power station massive data compression method and system |
| CN107894875B (en) * | 2017-11-20 | 2020-12-04 | 深圳市德传技术有限公司 | RTU data storage method |
| CN109582652A (en) * | 2018-11-01 | 2019-04-05 | 珠海云数科技有限公司 | A kind of storage method of distribution object-oriented data |
| CN110971492B (en) * | 2019-12-23 | 2021-07-13 | 国电南瑞科技股份有限公司 | RTU (remote terminal Unit) full-network simultaneous section generation method and system considering wide-area measurement time delay |
-
2020
- 2020-12-23 CN CN202011536848.8A patent/CN112702340B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102118293A (en) * | 2009-12-30 | 2011-07-06 | 上海可鲁系统软件有限公司 | Method for compressing and storing communication messages |
| CN111240594A (en) * | 2020-01-09 | 2020-06-05 | 深圳市东深电子股份有限公司 | Water conservation RTU-based encrypted compressed data storage method |
Non-Patent Citations (1)
| Title |
|---|
| 数据压缩技术在船舶电力监控系统中的应用;王永臻;孙亮清;;上海船舶运输科学研究所学报(01);第58-63页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112702340A (en) | 2021-04-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108696492B (en) | Method and device for processing IP message | |
| CN103209153B (en) | Message treatment method, Apparatus and system | |
| CN103379140A (en) | Log processing rule synchronization method and relative device and system | |
| CN107239232B (en) | Data storage method for electric energy meter | |
| CN106844432A (en) | Data processing method and device | |
| CN111241488B (en) | Distribution network protection fixed value setting system based on full information data flow | |
| CN112702340B (en) | Historical message compression method and system, computing equipment and storage medium thereof | |
| CN105556849A (en) | Method of making compressed data available by an electrical meter | |
| CN109829612B (en) | Scheduling automation device information checking method and device | |
| CN108768995B (en) | Substation self-adaptive master station access method | |
| CN112817926B (en) | File processing method and device, storage medium and electronic device | |
| CN112580825A (en) | Unsupervised data binning method and unsupervised data binning device | |
| CN106533958B (en) | Data consistency checking method for heterogeneous system of cross-network isolation device | |
| CN111931012A (en) | Data model self-adaption method and device based on fault management subsystem | |
| CN104065505A (en) | Monitoring System, Monitoring Server And Monitoring Method | |
| EP2385600A2 (en) | Remote communication system and method | |
| CN115080644A (en) | Power grid resource service middlebox and power grid information model construction method thereof | |
| US20220121626A1 (en) | Data compression method and data decompression method for electronic device, and electronic device | |
| CN109144635B (en) | Self-configured data display processing method for mobile super-capacitor energy storage equipment | |
| CN112510826B (en) | Method for determining configuration change boundary of modification and extension intelligent recorder | |
| KR20180108505A (en) | Method for transforming data for low volume transmission of meta model base protocol, and data transmitting system for low volume transmission of meta model base protocol | |
| CN113660286A (en) | Communication protocol fusion method combined with Kalman filtering data fusion and related equipment | |
| CN114022279A (en) | Service data error correction method, device, equipment and readable storage medium | |
| CN112260699A (en) | Attribute communication coding and decoding method, coding device, decoding device and system | |
| CN113821896B (en) | Dynamic loading method and system for topological data of power distribution network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |