CN112072783B - Method and device for transmitting second-level load data between end-side equipment and edge-side equipment - Google Patents
Method and device for transmitting second-level load data between end-side equipment and edge-side equipment Download PDFInfo
- Publication number
- CN112072783B CN112072783B CN202010746620.5A CN202010746620A CN112072783B CN 112072783 B CN112072783 B CN 112072783B CN 202010746620 A CN202010746620 A CN 202010746620A CN 112072783 B CN112072783 B CN 112072783B
- Authority
- CN
- China
- Prior art keywords
- load data
- load
- data
- edge
- side device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
- H02J13/00022—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment using wireless data transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E60/00—Enabling technologies; Technologies with a potential or indirect contribution to GHG emissions mitigation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S40/00—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them
- Y04S40/12—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them characterised by data transport means between the monitoring, controlling or managing units and monitored, controlled or operated electrical equipment
- Y04S40/126—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them characterised by data transport means between the monitoring, controlling or managing units and monitored, controlled or operated electrical equipment using wireless data transmission
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Signal Processing (AREA)
- Power Engineering (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and a device for transmitting second-level load data between end-side equipment and edge-side equipment, wherein the method comprises the following steps: the end-side equipment classifies the collected continuous load data according to the load change of the continuous load data in the sliding window and converts the continuous load data into segmented classified load data; the end-side equipment transmits the classified load data used by the edge-side equipment in calculation and analysis in the segmented classified load data to the edge-side equipment; the edge side device restores the received segmented classified load data into continuous load data for subsequent edge calculation. The invention has less data transmission quantity, can greatly reduce the data transmission pressure between the end-side equipment and the edge-side equipment, realizes the high-efficiency convergence of data from the end-side equipment to the edge-side equipment, and solves the contradiction between the requirement of the end-side data and the serious shortage of the edge-end network bandwidth when the edge-side equipment carries out edge calculation.
Description
Technical Field
The invention relates to the field of power data transmission, in particular to a method and a device for transmitting second-level load data between end-side equipment and edge-side equipment.
Background
With the technical progress, the power internet of things is greatly developed from clouds, pipes, edges and ends, under an ideal condition, the edge side sensing equipment can generate massive metering data and converge the data to the edge side equipment, the edge side equipment can realize an edge computing function by applying the edge side data, and can converge related data to the clouds, the cloud end equipment constructs power big data, and monitoring, management and optimization of a power grid are realized.
The current power data aggregation channel mainly comprises two parts, namely a channel from an end to an edge and a channel from the edge to a cloud. The channel from the edge to the cloud is mainly a 4G network at present and can be upgraded to a 5G network in the future, so that the bottleneck of bandwidth does not exist; the end-to-edge channel is mainly broadband power line carrier (HPLC), the bandwidth of the end-to-edge channel is much lower than that of a 4G network, meanwhile, since edge-side devices may face hundreds or even more of end-side devices, the end-side devices may generate massive load data, and as the application develops, more and more end-side load data need to be converged to the edge-side devices, and in such a background, the HPLC becomes a bottleneck in the power data convergence channel. The current power distribution and utilization field of the power system is developing from automation to intellectualization, the intellectualization needs to use massive load data as support, some key station areas are applied, such as station area user variation relation identification, line topology identification, lean line loss analysis, system error analysis and the like, the intelligent solution of the two needs to gather end-side second-level massive load data on edge-side equipment, and an HPLC channel cannot bear the massive data, so that how to construct the end-side second-level load data on the edge-side equipment through the existing HPLC channel becomes a problem which needs to be solved urgently at present.
Disclosure of Invention
The invention provides a method for transmitting second-level load data between an end side device and an edge side device, which adopts lossless transmission for load data used in quantitative calculation of the edge side device, adopts lossy transmission for load data used in qualitative analysis of the edge side device, and does not transmit load data which is not concerned by the edge side device, thereby solving the problem of constructing the second-level load data of the end side on the edge side device through an HPLC channel.
The technical scheme adopted by the invention is as follows:
a method for transmitting second-level load data between an end-side device and an edge-side device comprises the following steps:
the end-side equipment classifies the collected continuous load data according to the load change of the continuous load data in the sliding window and converts the continuous load data into segmented classified load data;
the end-side equipment transmits the classified load data used by the edge-side equipment in calculation and analysis in the segmented classified load data to the edge-side equipment;
the edge side device restores the received segmented classified load data into continuous load data for subsequent edge calculation.
Further, the end-side device classifies the collected continuous load data according to the load change of the collected continuous load data in the sliding window, and converts the collected continuous load data into segmented classified load data, and the method specifically comprises the following steps:
defining a sliding window, wherein the sliding window contains a plurality of load data of a set number of continuous time points, and in the sliding window, the abscissa of each point is time, the ordinate is load, and the load is power or current;
defining a load effective change threshold value Vh for judging load effective change and a load smooth fluctuation threshold value Vl for judging load smooth fluctuation;
the window slides, if the load change is larger than Vh in the sliding window, the load is in an effective change state in the sliding window, and effective change load data are generated; if the load change between every two continuous points is smaller than Vl in the sliding window, the load is in a smooth fluctuation state in the window, and smooth fluctuation load data are generated; if the load change is larger than Vl and smaller than Vh in the sliding window, the load is in a middle change state in the window, and middle change load data is generated.
Further, the smooth fluctuating load data used for qualitative analysis and the effective variable load data used for quantitative calculation are transmitted to the edge side device by the end side device.
Further, the smooth fluctuating load data comprises classification types, start timestamps, load point numbers and/or end timestamps, load values of start points and load values of end points;
the effective change load data comprises a classification type, a starting time stamp, a load point number and/or an ending time stamp, and a load value of all points;
the intermediate change load data is not transmitted and does not need to be recorded.
Further, when the window slides and generates the effective change load data, the smooth fluctuation load data and the middle change load data, the method also comprises the following steps:
when two adjacent sliding windows have different load change states, recording load data at the overlapping part of the adjacent sliding windows into classified load data at a higher level in the two adjacent sliding windows according to the priority level, wherein the priority level of the classified load data is as follows: effective variable load data > smooth fluctuating load data > intermediate variable load data;
when two adjacent sliding windows are smooth fluctuating load data, combining the two sections of data into one section of smooth fluctuating load data;
when two adjacent sliding windows are both effective variable load data, the two sections of data are merged into one section of effective variable load data or serve as two sections of independent effective variable load data.
Further, before the classified load data is transmitted from the end-side device to the edge-side device, the method further includes the steps of:
and carrying out original text transmission or lossless compression transmission on the effective variable load data.
Further, the edge device restores the received segmented classified load data to continuous load data, specifically including the steps of:
when the received classified load data is smooth fluctuating load data, using the load value of the initial point, the load value of the end point and the number of load points in the segmented data to recover the load data according to linear interpolation;
when the received classified load data is effective variable load data, if the segmented effective variable data is uncompressed transmission of an original text, directly recovering the original text; if the segmented effective change data is compressed and transmitted, the data is recovered after decompression;
and restoring the points which do not receive the load data to a meaningless set value to represent the point data as intermediate change data for subsequent edge calculation.
According to another aspect of the present invention, there is also provided an apparatus for transmitting second-level payload data between an edge-side device and an end-side device, including:
the load data classification module is used for classifying the continuous load data acquired by the end-side equipment according to the load change of the continuous load data in the sliding window and converting the continuous load data into segmented classified load data;
the load data transmission module is used for transmitting the classified load data used by the edge side equipment in calculation and analysis in the segmented classified load data to the edge side equipment by the end side equipment;
and the load data recovery module is used for recovering the received segmented classified load data into continuous load data by the edge side equipment so as to perform subsequent edge calculation.
According to another aspect of the present invention, there is also provided a storage medium, where the storage medium includes a stored program, and when the program runs, a device in which the storage medium is located is controlled to execute the method for transmitting the second-level load data between the end-side device and the edge-side device.
According to another aspect of the present invention, there is also provided an electronic device, including a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method for transmitting the second-level load data between the edge-side device and the edge-side device.
The invention has the following beneficial effects:
the method comprises the steps of classifying continuous load data acquired by end-side equipment according to load change of the continuous load data in a sliding window to convert the continuous load data into segmented classified load data; transmitting the classified load data required by the edge side equipment for edge calculation in the segmented classified load data to the edge side equipment by the end side equipment; and performing load data recovery on the edge side equipment according to the received classified load data so as to perform subsequent edge calculation. Compared with the prior transmission mode of directly transmitting data between the end-side equipment and the edge-side equipment, the invention has less data transmission amount, greatly reduces the transmission pressure between the end-side equipment and the edge-side equipment, realizes the high-efficiency convergence of the data from the end-side equipment to the edge-side equipment, and solves the contradiction between the requirement of the end-side data and the serious shortage of network bandwidth between the edges when the edge-side equipment carries out the edge calculation.
In addition to the objects, features and advantages described above, other objects, features and advantages of the present invention are also provided. The present invention will be described in further detail below with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic flow chart of a method for transmitting second-level load data between an end-side device and an edge-side device according to a preferred embodiment of the present invention.
FIG. 2 is a schematic diagram of the load change of the sliding window in a smooth fluctuating state of the apparatus according to the preferred embodiment of the present invention.
Fig. 3 is a schematic diagram of the load change of the sliding window in the intermediate change state of the apparatus according to the preferred embodiment of the present invention.
Fig. 4 is a schematic diagram of the load change of the sliding window when the device of the preferred embodiment of the present invention is in the active change state.
FIG. 5 is a schematic diagram of the classified load data record with the smooth fluctuation of the sliding window before and the effective change after in the preferred embodiment of the present invention.
FIG. 6 is a schematic diagram of the classified load data record with the sliding window effective change before and the smooth fluctuation after in accordance with the preferred embodiment of the present invention.
Fig. 7 is a block diagram of a device for transmitting second-level load data between an end-side device and an edge-side device according to a preferred embodiment of the present invention.
Detailed Description
It should be noted that, in the present application, the embodiments and features of the embodiments may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
Referring to fig. 1, a preferred embodiment of the present invention provides a method for transmitting second-level load data between an edge-side device and an end-side device, including the steps of:
s1, classifying the collected continuous load data according to the load change of the collected continuous load data in a sliding window by the end-side equipment, and converting the continuous load data into segmented classified load data;
s2, the end-side equipment transmits the classified load data used by the edge-side equipment in calculation and analysis in the segmented classified load data to the edge-side equipment;
and S3, the edge side equipment restores the received segmented classified load data into continuous load data so as to perform subsequent edge calculation.
In the method for transmitting second-level load data between the end-side device and the edge-side device provided by this embodiment, first, the end-side device classifies the collected continuous load data according to the load change thereof in the sliding window, and converts the continuous load data into segmented classified load data; then the end-side equipment transmits the classified load data used by the edge-side equipment in calculation and analysis in the segmented classified load data to the edge-side equipment; and finally, the edge side equipment restores the received segmented classified load data into continuous load data so as to carry out subsequent edge calculation. When the second-level load data are transmitted between the end-side equipment and the edge-side equipment, the end-side load data are firstly classified according to the load change of the end-side load data in a sliding window, lossless transmission is adopted for the load data used in quantitative calculation of the edge-side equipment, lossy transmission is adopted for the load data used in qualitative analysis of the edge-side equipment, and the load data which is not concerned by the edge-side equipment is not transmitted. For example, load data at the end side when large change occurs, especially load data at the second-level granularity, is widely applied to quantitative calculation of user variable relation recognition, line topology recognition, lean line loss analysis and system error analysis, and is subjected to lossless transmission, so that the calculation accuracy is guaranteed. Then, the edge side device recovers the load data of all the points according to the classified load data so as to carry out the next edge calculation, and the accuracy and the reliability of the calculation result are ensured. Compared with the existing transmission mode of directly transmitting data between the end-side device and the edge-side device, the data transmission amount of the embodiment is less, the transmission pressure between the end-side device and the edge-side device is greatly reduced, the efficient aggregation of the data from the end-side device to the edge-side device is realized, and the contradiction between the requirement of the end-side data and the serious shortage of the network bandwidth between the edges when the edge-side device performs edge calculation is solved.
In a preferred embodiment of the present invention, the end-side device classifies the collected continuous load data according to the load change thereof in the sliding window, and converts the collected continuous load data into segmented classified load data, specifically including the steps of:
s11, defining a sliding window, wherein the sliding window contains a plurality of load data of a set number of continuous time points, and in the sliding window, the abscissa of each point is time, the ordinate is load, and the load is power or current; sliding a window along a time axis, and calculating the change of the load in the window;
s12, defining a load effective change threshold Vh for judging the effective change of the load and a load smooth fluctuation threshold Vl for judging the smooth fluctuation of the load;
s13, sliding a window, and if the load change is larger than Vh in the sliding window, the load is in an effective change state in the sliding window to generate effective change load data; if the load change between every two continuous points is smaller than Vl in the sliding window, the load is in a smooth fluctuation state in the window, and smooth fluctuation load data are generated; if the load change is larger than Vl and smaller than Vh in the sliding window, the load is in a middle change state in the window, and middle change load data is generated.
The load data of the present embodiment is classified by time period and transmitted. The load is used as a judgment parameter for data classification, and the data recorded together can include, but is not limited to, current, voltage, electric quantity, power factor and the like. In the present embodiment, the sliding window is slid along the time axis, and as shown in fig. 2, since | v2-v1| < Vl and | v1-v0| < Vl, the device is in a smooth fluctuating state in the window t0, thereby generating smooth fluctuating load data. As shown in fig. 3, since | v3-v1| > Vl and | v3-v1| < Vh, the apparatus is in the intermediate change state at the window t1, thereby generating intermediate change load data; as shown in fig. 4, since | v4-v2| > Vl, the device is in a valid change state at the window t2, thereby generating valid change load data.
Specifically, the load data transmitted from the end-side device to the edge-side device includes smooth fluctuating load data for qualitative analysis and effective variable load data for quantitative calculation, and the load data of the intermediate variable type is not transmitted. For example, load data at the end side when large changes occur, especially load data with second-level granularity, the part of data is widely applied to quantitative calculation of user variable relationship recognition, line topology recognition, lean line loss analysis and system error analysis, the part of data is subjected to lossless transmission, the calculation accuracy is guaranteed, for example, the load data at the end side when smooth fluctuation occurs is widely applied to qualitative analysis of user variable relationship recognition, line topology recognition, lean line loss analysis and system error analysis, the part of data is subjected to lossy transmission, only load values at the starting point and the ending point of smooth fluctuation transmission are transmitted, the data transmission amount is greatly reduced while the effectiveness of the qualitative analysis is guaranteed, and for intermediate change data, the part of data is not transmitted because the part of data is less applied to calculation and analysis.
In the preferred embodiment of the present invention, in order to facilitate the edge device to perform load data recovery according to the received classified load data and further reduce the data transmission amount, the present embodiment performs necessary optimization on the data structure of each type of load data according to the characteristics of each type of load data, and only includes necessary data components on the basis of ensuring the data recoverability, thereby reducing the data transmission size. Along with the sliding of the window, the terminal converts continuous load data along a time axis into segmented classified load data, including smooth fluctuating load data, effective variable load data and intermediate variable load data, wherein the smooth fluctuating load data includes classification types, a starting timestamp, load point numbers and/or an ending timestamp, a load value of a starting point and a load value of an ending point, the load values of all the points are not required to be included, and the data volume is reduced; and the effective change load data comprises a classification type, a start time stamp, a load point number and/or an end time stamp, and a load value of all points; the intermediate change load data is not transmitted and does not need to be recorded, so that the data volume is reduced as much as possible.
In a preferred embodiment of the present invention, when the window slides and generates the effective varying load data, the smooth fluctuating load data, the intermediate varying load data, further comprises the steps of:
when two adjacent sliding windows have different load change states, recording load data at the overlapping part of the adjacent sliding windows into classified load data at a higher level in the two adjacent sliding windows according to the priority level, wherein the priority level of the classified load data is as follows: effective change load data > smooth fluctuation load data > intermediate change load data;
when two adjacent sliding windows are smooth fluctuation load data, combining the two sections of data into one section of smooth fluctuation data;
when two adjacent sliding windows are effective variable load data, the two sections of data are combined into one section of effective variable load data or used as two sections of independent effective variable load data.
In this embodiment, the priority order of the classified load data is sorted according to the importance of the data calculated in the edge device. The edge side equipment does not care about the intermediate variable load data, the intermediate variable load data is not transmitted to the edge side equipment to participate in edge calculation, and the priority of the intermediate variable load data is the lowest, so that the point where the intermediate variable load data is overlapped with other types of load data needs to be recorded into other types of load data with higher priority. Since the edge-side device mainly uses the payload data in the calculation, its priority is higher than the smooth-fluctuating payload data. Therefore, if points occur in adjacent sliding windows where the payload data overlaps with the smooth fluctuating payload data (such as the points collectively enclosed by the solid and dashed boxes in fig. 5 and 6), then these points are removed from the smooth fluctuating payload data while remaining in the payload data. When two adjacent sliding windows are smooth fluctuation load data, the two sections of data are merged into one section of smooth fluctuation data.
When two adjacent sliding windows are both effective variable load data, the two sections of data are merged into one section of effective variable load data or serve as two sections of independent effective variable load data.
The following describes the recording of classified load data, taking smooth fluctuations (dashed window, lower priority) + significant changes (solid window, higher priority) as an example:
as shown in fig. 5, in two windows, the smooth fluctuation is before and the effective change is after, in this case, according to the principle of priority of the effective change load data, the smooth fluctuation load data recorded in the dashed line window is recorded to the point (t 0, v 0), and the effective change load data recorded in the solid line window is recorded from the point (t 1, v 1).
As shown in fig. 6, in the two windows, the effective change is before and the smooth fluctuation is after, and at this time, the effective change load data generated by the solid line window is recorded to the point (t 5, v 5) and the smooth fluctuation load data recorded by the dotted line window is recorded from the point (t 6, v 6) according to the principle that the effective change load data takes precedence.
In the embodiment, continuous load data is converted into classified segmented load data, and lossless transmission, lossy transmission and non-transmission are respectively adopted for the segmented load data according to the importance of the segmented load data in calculation, so that the accuracy of quantitative calculation is ensured, the effectiveness of qualitative analysis is ensured, and the transmission quantity of the data is greatly reduced. For load data of the second level, in the case of no large-load electrical appliance start-stop, a longer time period is kept in a smooth fluctuation state, and particularly for some specific time periods, such as 0 to 5 nights, 9 to 11 am, and 2 to 5 pm.
In a preferred embodiment of the present invention, before the transmitting the classified load data from the edge-side device to the end-side device, the method further includes the steps of:
and carrying out original text transmission or lossless compression transmission on the effective variable load data.
In this embodiment, in order to save bandwidth, before the classified load data is transmitted from the end-side device to the edge-side device, the effective variable load data is first subjected to original text transmission or compressed transmission, whether compression is performed or not is determined according to the compression effect, if the data transmission amount cannot be reduced after compression, the original text transmission is adopted, otherwise, the effective variable load data is compressed first and then transmitted. Since the effective change load data is the most critical data required for performing the edge calculation, a lossless compression algorithm needs to be used for compression according to the characteristics of the power data. The electric power data has the following characteristics:
1) The storage is performed in data blocks, the data being arranged in a predictable manner, i.e. a unit of data blocks is a fixed physical quantity comprised, which may include, for example: voltage (2 bytes), current (4 bytes), power (4 bytes);
2) The data in the block is time-continuous, that is, the data of the previous unit and the data of the next unit are continuous in time, so that the value of the data in the partial second level is continuous.
Take the following data block as an example:
the composition of the data block is shown in table 1:
each row, i.e., a data cell, contains voltage (two bytes high and low), current (four bytes high and low and high and low), power (four bytes high and low)
TABLE 1
As shown in table 1, in the conventional horizontal compression method (compressing data unit by data unit), the original data is: 08D4000001320000028F-08CE00000130000002B1-08D10000071100000FD7-08D2000007EE000011C6-08D1000007F3000011FD-08D4000007EE-000011CF-08D2000007E9000011A8, the data repetition rate is not high, and the compression ratio is not high.
And, with a vertical compression (compression by a specific byte of a physical quantity), the original data is: 0808080808080808-D4 CED1D2D1D4D2-00000000000000-00000000000000-01010707070707-323011EEF3EEE9-00000000000000-00000000000000-02020F 11111111-8 FB1D7C6FDCFA8, the repetition rate of data is greatly improved, and the compression ratio of longitudinal compression is greatly improved under the condition of using the same compression algorithm.
In this embodiment, when compressing the effective variable load data shown in table 1, the data is preprocessed first, the data is read in a longitudinal manner according to bytes, and then the data is compressed by using a lossless compression algorithm such as mature dictionary compression, which can greatly improve the compression efficiency of the effective variable load data, further reduce the data transmission amount, and greatly reduce the transmission pressure between the end-side device and the edge-side device.
In a preferred embodiment of the present invention, the method for restoring the received segmented classified load data into continuous load data by the edge device specifically includes the steps of:
when the received classified load data is smooth fluctuating load data, recovering the load data according to linear interpolation by using the load value of the initial point, the load value of the end point and the number of load points in the segmented data;
when the received classified load data is effective variable load data, if the segmented effective variable data is uncompressed transmission of an original text, directly recovering the original text; if the segmented effective change data is compressed and transmitted, recovering the segmented effective change data after decompression;
for the point which does not receive the load data, the point is restored to a meaningless set value, such as-1, to represent the point data as intermediate change data, so as to distinguish the intermediate change data in the subsequent edge calculation.
According to the data structure characteristics of each classified load data, the load data of all the points are restored by adopting a corresponding method, the accuracy and the integrity of the load data participating in the edge calculation are ensured, the accuracy and the reliability of the subsequent edge calculation can be ensured by the restored load data, and the next edge calculation can be carried out after the load data of all the points are restored.
As shown in fig. 7, another embodiment of the present invention further provides an apparatus for transmitting second-level payload data between an end-side device and an edge-side device, including:
the load data classification module is used for classifying the continuous load data acquired by the end-side equipment according to the load change of the continuous load data in the sliding window and converting the continuous load data into segmented classified load data;
the load data transmission module is used for transmitting the classified load data used by the edge side equipment in calculation and analysis in the segmented classified load data to the edge side equipment by the end side equipment;
and the load data recovery module is used for recovering the received segmented classified load data into continuous load data by the edge side equipment so as to perform subsequent edge calculation.
The apparatus for transmitting second-level load data between the edge-side device and the end-side device in this embodiment corresponds to the above method embodiment, and specific control procedures may refer to the above method embodiment.
Another embodiment of the present invention provides a storage medium including a stored program, wherein when the program runs, a device in which the storage medium is located is controlled to perform a method of transmitting the second-level load data between the end-side device and the edge-side device.
Another embodiment of the present invention provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the program to implement the method for transmitting the second-level load data between the edge-side device and the end-side device.
The present invention performs a preliminary process on data on an end-side device and classifies the data into smooth fluctuating load data, intermediate varying load data, and effective varying load data. And converging the smooth fluctuating load data and the effective change load data to the edge side equipment. And on the edge side equipment, recovering the smooth fluctuating load data of each end side equipment according to linear interpolation, recovering the effective variable load data according to an actual value, and recovering the intermediate variable load data according to an abstract value.
It should be noted that the data recorded with the load according to the present invention may include, but is not limited to, current, voltage, power factor, etc. Other working condition data such as temperature and other analog quantities can also be transmitted by using the method.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
The functions of the method of the embodiment, if implemented in the form of software functional units and sold or used as independent products, may be stored in one or more storage media readable by the computing device. Based on such understanding, part of the contribution of the embodiments of the present invention to the prior art or part of the technical solution may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computing device (which may be a personal computer, a server, a mobile computing device, a network device, or the like) to execute all or part of the steps of the method described in the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In the present specification, the embodiments are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same or similar parts between the embodiments are referred to each other.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A method for transmitting second-level load data between an end-side device and an edge-side device, comprising the steps of:
the end-side equipment classifies the collected continuous load data according to the load change of the continuous load data in the sliding window and converts the continuous load data into segmented classified load data;
the end-side equipment respectively transmits the classified load data used by the edge-side equipment in quantitative calculation and qualitative analysis in the segmented classified load data to the edge-side equipment in a lossless transmission and a lossy transmission mode through a power carrier channel;
the edge side device restores the received segmented classified load data into continuous load data for subsequent edge calculation.
2. The method for transmitting the second-level load data between the end-side equipment and the edge-side equipment according to claim 1, wherein the end-side equipment classifies the collected continuous load data according to the load change of the collected continuous load data in a sliding window and converts the collected continuous load data into the segmented classified load data, and the method specifically comprises the following steps:
defining a sliding window, wherein the sliding window contains a plurality of load data of a set number of continuous time points, and in the sliding window, the abscissa of each point is time, the ordinate is load, and the load is power or current;
defining a load effective change threshold value Vh for judging the effective change of the load and a load smooth fluctuation threshold value Vl for judging the smooth fluctuation of the load;
the window slides, if the load change is larger than Vh in the sliding window, the load is in an effective change state in the sliding window, and effective change load data are generated; if the load change between every two continuous points is smaller than Vl in the sliding window, the load is in a smooth fluctuation state in the window, and smooth fluctuation load data are generated; if the load change is larger than Vl and smaller than Vh in the sliding window, the load is in a middle change state in the window, and middle change load data is generated.
3. The method for transmitting second-level load data between an end-side device and an edge-side device according to claim 2, wherein the transmission from the end-side device to the edge-side device comprises smooth fluctuating load data for qualitative analysis and effective varying load data for quantitative calculation.
4. The method for transmitting the second-level load data between the end-side device and the edge-side device according to claim 2, comprising:
the smooth fluctuation load data comprises a classification type, a starting time stamp, a load point number and/or an ending time stamp, a load value of a starting point and a load value of an ending point;
the effective change load data comprises a classification type, a starting timestamp, a load point number and/or an ending timestamp, and load values of all points;
the intermediate change load data is not transmitted and does not need to be recorded.
5. The method for transmitting the second-level load data between the end-side device and the edge-side device according to claim 2, wherein when the window slides and generates the effective variable load data, the smooth fluctuating load data and the middle variable load data, further comprising the steps of:
when two adjacent sliding windows have different load change states, recording load data at the overlapping part of the adjacent sliding windows into classified load data at a higher level in the two adjacent sliding windows according to the priority level, wherein the priority level of the classified load data is as follows: effective variable load data > smooth fluctuating load data > intermediate variable load data;
when two adjacent sliding windows are smooth fluctuating load data, merging the two sections of data into one section of smooth fluctuating load data;
when two adjacent sliding windows are both effective variable load data, the two sections of data are merged into one section of effective variable load data or serve as two sections of independent effective variable load data.
6. The method for transmitting the second-level load data between the edge-side device and the end-side device according to claim 3, wherein before the classified load data is transmitted from the end-side device to the edge-side device, the method further comprises the steps of:
and carrying out original text transmission or lossless compression transmission on the effective variable load data.
7. The method for transmitting second-level load data between an end-side device and an edge-side device according to claim 2, wherein the edge-side device restores the received segmented classified load data to continuous load data, and specifically comprises the steps of:
when the received classified load data is smooth fluctuating load data, recovering the load data according to linear interpolation by using the load value of the initial point, the load value of the end point and the number of load points in the segmented data;
when the received classified load data is effective variable load data, if the segmented effective variable data is uncompressed transmission of an original text, directly recovering the original text; if the segmented effective change data is compressed and transmitted, the data is recovered after decompression;
and restoring the points which do not receive the load data to a meaningless set value to represent the point data as intermediate change data for subsequent edge calculation.
8. An apparatus for transmitting second-level load data between an edge-side device and an edge-side device, comprising:
the load data classification module is used for classifying the continuous load data acquired by the end-side equipment according to the load change of the continuous load data in the sliding window and converting the continuous load data into segmented classified load data;
the load data transmission module is used for transmitting the classified load data used by the edge side equipment in calculation and analysis in the segmented classified load data to the edge side equipment by the end side equipment;
and the load data recovery module is used for recovering the received segmented classified load data into continuous load data by the edge side equipment so as to perform subsequent edge calculation.
9. A storage medium comprising a stored program, characterized in that when the program runs, the device on which the storage medium is located is controlled to execute the method for transmitting second-level load data between an end-side device and an edge-side device according to any one of claims 1 to 7.
10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements the method of transferring second level load data between an edge-side device and an edge-side device according to any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010746620.5A CN112072783B (en) | 2020-07-29 | 2020-07-29 | Method and device for transmitting second-level load data between end-side equipment and edge-side equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010746620.5A CN112072783B (en) | 2020-07-29 | 2020-07-29 | Method and device for transmitting second-level load data between end-side equipment and edge-side equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112072783A CN112072783A (en) | 2020-12-11 |
| CN112072783B true CN112072783B (en) | 2022-11-08 |
Family
ID=73657559
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010746620.5A Active CN112072783B (en) | 2020-07-29 | 2020-07-29 | Method and device for transmitting second-level load data between end-side equipment and edge-side equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112072783B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113376551B (en) * | 2021-06-23 | 2022-11-08 | 北京市腾河智慧能源科技有限公司 | Method, system, device and storage medium for detecting series fault arc |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006252015A (en) * | 2005-03-09 | 2006-09-21 | Nec Engineering Ltd | Data transfer controller |
| CN108596362A (en) * | 2018-03-22 | 2018-09-28 | 国网四川省电力公司经济技术研究院 | It polymerize approximate electric load curve form clustering method based on adaptive segmentation |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA3126601A1 (en) * | 2019-01-13 | 2020-07-16 | Strong Force Iot Portfolio 2016, Llc | Methods, systems, kits and apparatuses for monitoring and managing industrial settings |
| CN110504974B (en) * | 2019-08-20 | 2023-10-27 | 北京四方继保自动化股份有限公司 | D-PMU measurement data segmented slice hybrid compression storage method and device |
-
2020
- 2020-07-29 CN CN202010746620.5A patent/CN112072783B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006252015A (en) * | 2005-03-09 | 2006-09-21 | Nec Engineering Ltd | Data transfer controller |
| CN108596362A (en) * | 2018-03-22 | 2018-09-28 | 国网四川省电力公司经济技术研究院 | It polymerize approximate electric load curve form clustering method based on adaptive segmentation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112072783A (en) | 2020-12-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102143039B (en) | Data segmentation method and equipment for data compression | |
| CN103379136A (en) | Compression method and decompression method of log acquisition data, compression apparatus and decompression apparatus of log acquisition data | |
| CN111669372B (en) | Internet of things protocol fusion method for electricity acquisition master station | |
| CN112335202B (en) | Processing local area network diagnostic data | |
| CN110187838B (en) | Data IO information processing method, analysis method, device and related equipment | |
| CN102497450B (en) | Two-stage-system-based distributed data compression processing method | |
| CN112072783B (en) | Method and device for transmitting second-level load data between end-side equipment and edge-side equipment | |
| CN103888317A (en) | Protocol-independent network redundant flow eliminating method | |
| CN112637123A (en) | Data transmission method, system, terminal and storage medium for edge server | |
| CN112335203B (en) | Processing local area network diagnostic data | |
| CN113810489A (en) | Industrial internet control system and method | |
| EP4042307A1 (en) | Method, system, electronic device, and storage medium for storing and collecting temperature data | |
| CN102946443B (en) | Multitask scheduling method for realizing large-scale data transmission | |
| CN116567079A (en) | Data compression method and device | |
| US10211851B2 (en) | Method and system for compressing data from smart meter | |
| Parag et al. | Latency analysis for distributed storage | |
| CN111447229B (en) | Large-scale data acquisition method and device based on compressed sensing theory | |
| CN114401147B (en) | New energy power station communication message comparison method and system based on abstract algorithm | |
| CN105630999A (en) | Data compressing method and device of server | |
| CN114096006A (en) | Resource allocation and data compression joint optimization method in mobile edge computing system | |
| CN111131249B (en) | Data processing method and device | |
| Almagrabi et al. | Empirical Compression Features of Mobile Computing and Data Applications Using Deep Neural Networks | |
| CN215420317U (en) | High-speed baseband data processing device of radio terminal | |
| Venkatesh et al. | Data Reduction Techniques in Wireless Sensor Networks with Internet of Things | |
| CN116366731A (en) | Method and system for dynamically compressing time sequence data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |