CN117526959A

CN117526959A - Data compression method and device for panoramic monitoring of area

Info

Publication number: CN117526959A
Application number: CN202311471651.4A
Authority: CN
Inventors: 施展; 付佳佳; 李星南; 曾瑛
Original assignee: Guangdong Power Grid Co Ltd; Electric Power Dispatch Control Center of Guangdong Power Grid Co Ltd
Current assignee: Guangdong Power Grid Co Ltd; Electric Power Dispatch Control Center of Guangdong Power Grid Co Ltd
Priority date: 2023-11-07
Filing date: 2023-11-07
Publication date: 2024-02-06

Abstract

The invention discloses a data compression method and a device for panoramic monitoring of a platform area, which are characterized in that after first data and second data sent by a middleware are received, the second data are subjected to coding decompression to obtain third data, and the compression efficiency and the restoration precision of the current coding compression of the middleware are obtained through calculation according to the first data, the second data and the third data; optimizing the first compression dictionary according to the compression efficiency and the reduction precision to obtain a second compression dictionary; and sending the compression efficiency, the restoration precision and the second compression dictionary to the middleware, so that the middleware carries out aggregation updating on the locally stored compression dictionary, and carries out coding compression on the acquired original data according to the updated compression dictionary, thereby improving the compression efficiency of the panoramic monitoring data of the platform region, ensuring the efficient convergence and compression of important event data of the platform region, and realizing the efficient interaction and transmission of multidimensional information of panoramic monitoring of the operation of the low-voltage platform region.

Description

Data compression method and device for panoramic monitoring of area

Technical Field

The invention relates to the field of power monitoring management, in particular to a data compression method and device for panoramic monitoring of a platform area.

Background

The existing low-voltage transformer area panoramic monitoring method needs to collect and interact multidimensional information such as voltage, current, harmonic wave, temperature, humidity and carbon footprint, and real-time monitor, diagnose and analyze important events of the transformer area, so that massive monitoring data can be generated, and huge data transmission pressure is brought to communication of the existing power line carrier with limited capacity.

The existing information interaction method based on the power line carrier cannot optimally match the data of different important events according to the characteristics of the events, so that the data adaptability of the important events is poor, multidimensional redundant information cannot be fully processed, the information interaction efficiency is reduced, and the real-time performance, accuracy and reliability of panoramic monitoring of a platform area are affected. In addition, the existing middleware facing the panoramic monitoring of the platform area lacks a proper analysis mechanism, when the variety of the panoramic monitoring data of the platform area is continuously changed, the adopted compression method is poor in data matching degree with all important events, the optimization can not be carried out according to historical results, the reduction of data reduction precision and data compression efficiency can be caused, and the real-time monitoring of the panoramic monitoring of the platform area can not be realized.

Disclosure of Invention

The invention provides a data compression method and a data compression device for panoramic monitoring of a platform region, which solve the problem that the efficiency of carrier multidimensional information interaction transmission is low because the compression efficiency of important data for panoramic monitoring of the platform region is low by optimizing the efficiency of data compression.

In order to solve the technical problems, the invention provides a compression method for panoramic monitoring of a platform area, which comprises the following steps: when determining that the middleware is in an optimized state, receiving first data and second data sent by the middleware; the first data are acquired by the middleware according to a platform panoramic monitoring terminal; the second data is obtained by encoding and compressing the first data according to a preset first compression dictionary;

the second data is encoded and decompressed to obtain third data, and the compression efficiency and the reduction precision of the current encoding and compression of the middleware are calculated according to the first data, the second data and the third data;

optimizing the first compression dictionary according to the compression efficiency and the reduction precision to obtain a second compression dictionary;

The compression efficiency, the restoration precision and the second compression dictionary are sent to the middleware, so that the middleware carries out aggregation updating on the locally stored compression dictionary according to the compression efficiency, the restoration precision and the second compression dictionary, and carries out coding compression on the acquired original data according to the updated compression dictionary;

the data generated by the platform region panoramic monitoring terminal is received and processed, and the data compression efficiency is optimized, so that the compression efficiency of the platform region panoramic monitoring data can be improved, the huge pressure of massive data on the power line carrier is relieved, the efficient convergence and compression of important event data of the platform region are ensured, and the efficient interaction and transmission of multidimensional information of the low-voltage platform region operation panoramic monitoring are realized.

As a preferred solution, the compression efficiency and the restoration precision of the current coding compression of the middleware are calculated according to the first data, the second data and the third data, and specifically defined as follows:

the cloud server calculates compression efficiency before and after data compression through the first data and the second data, specifically:

wherein t is the time when the station panoramic monitoring terminal generates important data in carrier multidimensional information Etching, wherein eta (t) is the compression efficiency, size () is the storage space occupation size of the data, X (t) is the first data, and X _code (t) is the second data;

the cloud server calculates the restoration accuracy before and after data decompression through the first data and the third data, specifically:

wherein ψ (t) is the recovery precision, X (t) is the first data, X _unzip (t) is the third data;

the data compression efficiency and the recovery precision obtained by the method can intuitively see the optimization degree of the data compression efficiency, and can be used for adjusting the data compression efficiency optimization method more optimally later.

As a preferred solution, according to the compression efficiency and the restoration precision, the first compression dictionary is optimized to obtain a second compression dictionary, which is specifically defined in the following manner:

the first compression dictionary corresponding position codes and the pre-set position codes of the first compression dictionary corresponding position codes are subjected to head-to-tail splicing optimization to obtain the second compression dictionary, wherein the second compression dictionary comprises the following specific steps:

wherein,for the second compression dictionary, A _m For the first compression dictionary, +.>The front and back sections of codes are spliced end to end, delta represents taking A _m A pre-set bit encoding bit corresponding to the position encoding;

by specifically defining the method for optimizing the first compression dictionary by the compression efficiency and the restoration precision, a better data compression dictionary can be obtained and used for updating and optimizing the compression dictionary subsequently, and the data compression efficiency is improved.

As a preferred solution, the performing end-to-end splicing optimization on the first compression dictionary corresponding position code and the pre-preset position code of the first compression dictionary corresponding position code to obtain the second compression dictionary specifically includes:

and performing head-tail splicing optimization according to the following formula:

wherein Q (t) represents the previous Q (t) bit of the corresponding position code of the first compression dictionary, eta (t) represents the compression efficiency, phi (t) represents the reduction precision,represents taking an upward rounding, length (A _m (x) A maximum number of bits representing the first compression dictionary encoding;

the method for performing head-to-tail splicing optimization on the position codes corresponding to the first compression dictionary and the pre-set position codes corresponding to the first compression dictionary is specifically defined, so that a second compression dictionary with higher accuracy and finer optimization degree can be obtained, and the data compression efficiency is improved.

As a preferred solution, the middleware performs aggregation update on the locally stored compression dictionary according to the compression efficiency, the restoration precision and the second compression dictionary, specifically:

setting an aggregation weight and an aggregation weight threshold, and if the aggregation weight is larger than the aggregation weight threshold, updating the first compression dictionary according to the second compression dictionary; if the aggregation weight is smaller than the aggregation weight threshold, the first compression dictionary is not updated, specifically:

wherein, xi _m For the aggregation weight, η (t) represents the compression efficiency, ψ (t) represents the reduction accuracy, A _n For the first compression dictionary to be used,for the second compression dictionary, threshold _m Is the aggregate weight threshold;

according to the definition mode, when the reduction precision is poorer and the compression efficiency is lower, the aggregation weight is larger, and the aggregation optimization effect of the middleware on the compression dictionary is better, so that the data compression mode is continuously optimized, and the data compression efficiency is improved.

Preferably, when the middleware is in a non-optimized state, receiving second data sent by the middleware, and completing transmission of compressed data;

When the middleware is in a non-optimized state, the compression efficiency and the reduction precision of the data compression efficiency optimization method are up to meet the optimization requirement, the current data compression mode can be maintained as an optimal mode all the time, no further adjustment is needed, and the optimization requirement can be set through the condition of the actual situation; only the second data sent by the middleware is received at this time, so that the amount of data transmitted can be reduced, thereby reducing the network burden.

The invention also provides a compression method for panoramic monitoring of the area, which comprises the following steps:

when the middleware is determined to be in an optimized state, transmitting fourth data and fifth data to a cloud server so that the cloud server can decode and decompress the fifth data to obtain sixth data, calculating the compression efficiency and the restoration precision of the current encoding and compression of the middleware according to the fourth data, the fifth data and the sixth data, and optimizing a third compression dictionary according to the compression efficiency and the restoration precision to obtain a fourth compression dictionary; the fourth data are acquired according to the platform panoramic monitoring terminal; the fifth data is obtained by encoding and compressing the fourth data according to a preset third compression dictionary;

Receiving the compression efficiency, the restoration precision and the fourth compression dictionary sent by the cloud server, and carrying out aggregation updating on the locally stored compression dictionary according to the compression efficiency, the restoration precision and the fourth compression dictionary;

according to the updated compression dictionary, encoding and compressing the acquired original data;

the data generated by the platform region panoramic monitoring terminal is transmitted to the cloud server so as to optimize the data compression efficiency, so that the compression efficiency of the platform region panoramic monitoring data can be improved, the huge pressure of massive data on the power line carrier is relieved, the efficient convergence and compression of important event data of the platform region are ensured, and the efficient interaction and transmission of multidimensional information of the low-voltage platform region operation panoramic monitoring are realized.

As a preferred solution, the compression efficiency and the restoration precision of the current coding compression of the middleware are calculated according to the fourth data, the fifth data and the sixth data, and specifically defined as follows:

the cloud server calculates compression efficiency before and after data compression through the fourth data and the fifth data, specifically:

wherein t is the time when the station panoramic monitoring terminal generates important data in carrier multidimensional information, eta (t) is the compression efficiency, size () is the storage space occupation size of data, X (t) is the fourth data, and X _code (t) is the fifth data;

the cloud server calculates the restoration accuracy before and after data decompression through the fourth data and the sixth data, specifically:

wherein ψ (t) is the recovery precision, X (t) is the fourth data, X _unzip (t) is the sixth data;

As a preferred solution, the optimizing the third compression dictionary according to the compression efficiency and the restoration precision to obtain a fourth compression dictionary is specifically defined as follows:

and performing head-to-tail splicing optimization on the position code corresponding to the third compression dictionary and the pre-set position code corresponding to the position code of the third compression dictionary to obtain the fourth compression dictionary, wherein the method specifically comprises the following steps:

wherein,for the fourth compression dictionary, A _m For the third compression dictionary, +.>The front and back sections of codes are spliced end to end, delta represents taking A _m A pre-set bit encoding bit corresponding to the position encoding;

by specifically defining the method for optimizing the third compression dictionary by the compression efficiency and the restoration precision, a better data compression dictionary can be obtained and used for updating and optimizing the compression dictionary subsequently, and the data compression efficiency is improved.

As a preferred solution, the performing end-to-end splicing optimization on the position code corresponding to the third compression dictionary and the pre-preset position code corresponding to the position code of the third compression dictionary to obtain the fourth compression dictionary specifically includes:

wherein Q (t) represents the first Q (t) bit of the corresponding position code of the third compression dictionary, eta (t) represents the compression efficiency, phi (t) represents the reduction precision,represents taking an upward rounding, length (A _m (x) A maximum number of bits representing the third compression dictionary code;

the method for performing head-to-tail splicing optimization on the position codes corresponding to the third compression dictionary and the pre-set position codes corresponding to the position codes of the third compression dictionary is specifically defined, so that a fourth compression dictionary with higher accuracy and finer optimization degree can be obtained, and the data compression efficiency is improved.

As a preferred solution, the aggregating updating of the locally stored compression dictionary according to the compression efficiency, the restoring precision and the fourth compression dictionary specifically includes:

setting an aggregation weight and an aggregation weight threshold, and if the aggregation weight is larger than the aggregation weight threshold, updating the third compression dictionary according to the fourth compression dictionary; if the aggregation weight is smaller than the aggregation weight threshold, the third compression dictionary is not updated, specifically:

Wherein, xi _m For the aggregation weight, η (t) represents the compression efficiency, ψ (t) represents the reduction accuracy, A _n For the third compression dictionary to be used,for the fourth compression dictionary, threshold _m Is the aggregate weight threshold;

As a preferred scheme, when the middleware is in a non-optimized state, the fifth data is directly transmitted to a cloud server to complete the transmission of compressed data;

when the middleware is in a non-optimized state, the compression efficiency and the reduction precision of the data compression efficiency optimization method are up to meet the optimization requirement, the current data compression mode can be maintained as an optimal mode all the time, no further adjustment is needed, and the optimization requirement can be set through the condition of the actual situation; only the fifth data sent by the middleware is received at this time, the amount of data transmitted can be reduced, and thus the network burden is reduced.

The invention also provides a data compression device for the panoramic monitoring of the platform area, which comprises a data receiving module, a data processing module, a dictionary optimizing module and a data sending module;

the data receiving module is used for receiving first data and second data sent by the middleware when the middleware is determined to be in an optimized state; the first data are acquired by the middleware according to a platform panoramic monitoring terminal; the second data is obtained by encoding and compressing the first data according to a preset first compression dictionary;

the data processing module is used for carrying out coding decompression on the second data to obtain third data, and calculating the compression efficiency and the reduction precision of the current coding compression of the middleware according to the first data, the second data and the third data;

the dictionary optimization module is used for optimizing the first compression dictionary according to the compression efficiency and the reduction precision to obtain a second compression dictionary;

the data sending module is used for sending the compression efficiency, the restoration precision and the second compression dictionary to the middleware so that the middleware can aggregate and update the locally stored compression dictionary according to the compression efficiency, the restoration precision and the second compression dictionary, and encode and compress the acquired original data according to the updated compression dictionary;

The data compression device for the panoramic monitoring of the transformer area receives and processes data generated by the panoramic monitoring terminal of the transformer area, optimizes the data compression efficiency, can improve the compression efficiency of the panoramic monitoring data of the transformer area, relieves the huge pressure of massive data on a power line carrier, ensures that important event data of the transformer area can be efficiently gathered and compressed, and therefore achieves efficient interaction and transmission of multidimensional information of panoramic monitoring of low-voltage transformer area operation.

The invention also provides a data compression device for the panoramic monitoring of the platform area, which comprises a data transmission module, a dictionary updating module and a data compression module;

the data transmission module is used for transmitting fourth data and fifth data to the cloud server when determining that the middleware is in an optimized state, so that the cloud server carries out coding decompression on the fifth data to obtain sixth data, the compression efficiency and the restoration precision of the current coding compression of the middleware are obtained through calculation according to the fourth data, the fifth data and the sixth data, and then the third compression dictionary is optimized according to the compression efficiency and the restoration precision to obtain a fourth compression dictionary; the fourth data are acquired according to the platform panoramic monitoring terminal; the fifth data is obtained by encoding and compressing the fourth data according to a preset third compression dictionary;

The dictionary updating module is used for receiving the compression efficiency, the restoration precision and the fourth compression dictionary sent by the cloud server and carrying out aggregation updating on the locally stored compression dictionary according to the compression efficiency, the restoration precision and the fourth compression dictionary;

the data compression module is used for carrying out coding compression on the acquired original data according to the updated compression dictionary;

the data compression device for the panoramic monitoring of the transformer area transmits data generated by the panoramic monitoring terminal of the transformer area to the cloud server so as to optimize the data compression efficiency, so that the compression efficiency of the panoramic monitoring data of the transformer area can be improved, the huge pressure of massive data on a power line carrier is relieved, the efficient convergence and compression of important event data of the transformer area are ensured, and the efficient interaction and transmission of multidimensional information for the panoramic monitoring of the operation of a low-voltage transformer area are realized.

Drawings

Fig. 1: a flow diagram of an embodiment of a data compression method for panoramic monitoring of a platform area in the present invention;

fig. 2: a flow diagram of another embodiment of the data compression method for panoramic monitoring of a platform in the present invention;

Fig. 3: a schematic structural diagram of an embodiment of a data compression device for panoramic monitoring of a platform area in the invention;

fig. 4: a schematic structural diagram of another embodiment of the data compression device for panoramic monitoring of a platform area in the invention;

fig. 5: the invention relates to a structural schematic diagram of a middleware of a data compression device for panoramic monitoring of a platform area.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

Example 1

Referring to fig. 1, a flow chart of an embodiment of a data compression method for panoramic monitoring of a platform according to the present invention includes steps 101 to 104, and the steps are as follows:

step 101: when determining that the middleware is in an optimized state, receiving first data and second data sent by the middleware; the first data are acquired by the middleware according to a platform panoramic monitoring terminal; the second data is obtained by encoding and compressing the first data according to a preset first compression dictionary.

In this embodiment, the platform panoramic monitoring terminal sends important data generated at a preset time to a middleware for supporting platform panoramic monitoring, and the important data generated at the preset time is set as first data;

in this embodiment, the platform panoramic monitoring terminal sends the important data generated at the preset time to the middleware for supporting platform panoramic monitoring, where the specific definition mode of the important data generated at the preset time is as follows:

X(t)＝[x ₁ (t),...,x _n (t),...,x _N (t)]

wherein X (t) is N pieces of important data in the carrier multidimensional information to be generated by the platform panoramic monitoring terminal at time t, and X is _n And (t) generating nth important data at the moment t for the station area panoramic monitoring terminal.

In this embodiment, feature extraction is performed on the first data by a preset first method to obtain a first extracted feature, which is specifically defined as follows:

the middleware performs denoising operation on the first data through a preset denoising method, performs data feature mining after the denoised first data is converted into a preset interval through a preset data standardization method, and sets a data feature value extracted through the data feature mining method as the first extraction feature;

In this embodiment, the data feature mining is performed after the denoising first data is converted to a preset interval by a preset data standardization method, and the specific definition mode is as follows:

after the denoised first data is converted into a [0,1] interval through a data standardization method, inputting a preset depth feature mining network to extract data feature values, and obtaining the data feature values extracted from important data generated at preset moments;

in this embodiment, the specific definition manner of the data feature mining network is:

wherein Y (t) = [ Y ] ₁ (t),…,y _q (t),…,y _Q (t)]Q data characteristic values extracted from important data X (t) generated at the moment t, such as voltage fluctuation conditions, current fluctuation conditions and the like of a panoramic monitoring terminal of a platform area; g represents a full connection layer, ω is a weight parameter of the full connection layer, and b is a bias term of the full connection layer; f (f) ⁽ⁱ⁾ (X (t)) is the total number of depth feature mining layers,representing maximum pooling operations, +.> Representing an activation function->The representation is convolved, K _i Representing the convolution kernel of the i-th layerA weight parameter vector; b (B) _i Representing the bias term vector for that layer.

In this embodiment, the event type judgment is performed on the first extracted feature to obtain a first data feature, which is specifically defined in the following manner:

The method comprises the steps of obtaining a vector composed of data characteristic values extracted from the first extracted characteristics, judging specific types of events by using a preset event judging network to obtain a vector composed of important data characteristic values and event matching degrees, and setting the vector as the first data characteristics;

in this embodiment, the specific type of the event is determined by using a preset event studying and determining network, so as to obtain a vector formed by the feature value of the important data and the matching degree of each event, which is specifically defined in the following manner:

Z(t)＝[Z ₁ (t),...,Z _l (t),...,Z _L (t)]

wherein Z (t) is a vector formed by the important data characteristic value and the matching degree of each event, and Z _l (t) is the matching degree of the extracted data characteristic value and the first event at the time t, wherein L represents L events in total;

judging the specific types of the events by the event research judging network to obtain the matching degree of each data characteristic value extracted in the first extraction characteristic with the preset event at the preset moment, wherein the specific steps are as follows:

Wherein sigmoid and tanh are activation functions, Z _l (t) is the matching degree of the extracted data characteristic value and the first event at the moment t, P _l Is a vector of characteristic values of the data in the first event, +. ₁ 、b ₂ Are the deviation amounts.

In this embodiment, the second data is obtained by encoding and compressing the first data according to the first data feature and the preset first compression dictionary by a preset second method, specifically:

searching compression dictionary data with highest matching degree with the first data features in the preset first compression dictionary, and carrying out coding compression on the first data according to the searched compression dictionary data with the highest matching degree with the first data features, wherein the specific definition mode is as follows:

X _code (t)＝A _m [X(t)]

wherein X is _code (t) the second data obtained by encoding and compression, A _m For the first compression dictionary, X (t) is the first data.

The method comprises the steps of defining the acquisition of the first data and the second data in detail, receiving the first data and the second data sent by the middleware when the middleware is determined to be in an optimized state, obtaining important data in carrier multidimensional information generated by the platform panoramic monitoring terminal at a certain moment, extracting data characteristics of the important data, and supporting real-time monitoring of the platform panoramic.

Step 102: and encoding and decompressing the second data to obtain third data, and calculating the compression efficiency and the reduction precision of the current encoding and compressing of the middleware according to the first data, the second data and the third data.

In this embodiment, the compression efficiency and the restoration precision of the current encoding compression of the middleware are calculated according to the first data, the second data and the third data, and specifically defined as:

wherein t is the time when the station panoramic monitoring terminal generates important data in carrier multidimensional information, eta (t) is the compression efficiency, size () is the occupied size of the storage space of the data, X (t) is the first data, and X _code (t) is the second data;

wherein ψ (t) is the recovery precision, X (t) is the first data, X _unzip (t) is the third data.

Step 103: and optimizing the first compression dictionary according to the compression efficiency and the reduction precision to obtain a second compression dictionary.

In this embodiment, the optimizing the first compression dictionary according to the compression efficiency and the restoration precision to obtain the second compression dictionary is specifically defined as follows:

in this embodiment, the performing end-to-end splicing optimization on the first compression dictionary corresponding position code and the pre-preset position code of the first compression dictionary corresponding position code to obtain the second compression dictionary specifically includes:

wherein Q (t) represents the previous Q (t) bit of the corresponding position code of the first compression dictionary, eta (t) represents the compression efficiency, phi (t) represents the reduction precision, Represents taking an upward rounding, length (A _m (x) A maximum number of bits representing the first compression dictionary encoding.

By specifically defining the method for optimizing the second compression dictionary through the compression efficiency and the reduction precision, a better data compression dictionary can be obtained and used for updating and optimizing the first compression dictionary, so that the data compression efficiency is improved.

Step 104: and sending the compression efficiency, the restoration precision and the second compression dictionary to the middleware so that the middleware can aggregate and update the locally stored compression dictionary according to the compression efficiency, the restoration precision and the second compression dictionary, and encode and compress the acquired original data according to the updated compression dictionary.

In this embodiment, the middleware performs aggregation update on the locally stored compression dictionary according to the compression efficiency, the restoration precision and the second compression dictionary, specifically:

Wherein, xi _m For the aggregation weight, η (t) represents the compression efficiency, ψ (t) represents the reduction accuracy, A _n For the first compression dictionary to be used,for the second compression dictionary, threshold _m And (5) the aggregation weight threshold value.

According to the definition mode, when the reduction precision is poorer and the compression efficiency is lower, the aggregation weight is larger, and the aggregation optimization effect of the cloud on the first compression dictionary is better, so that the data compression mode is continuously optimized, and the data compression efficiency is improved.

In this embodiment, when the middleware is in a non-optimized state, the second data sent by the middleware is received, so as to complete transmission of the compressed data.

According to the embodiment, the data generated by the panoramic monitoring terminal of the platform area are received and processed, the data compression efficiency is optimized, the compression efficiency of the panoramic monitoring data of the platform area can be improved, the huge pressure of massive data on the power line carrier is relieved, the efficient convergence and compression of important event data of the platform area are ensured, and therefore the efficient interaction and transmission of multidimensional information of panoramic monitoring of the operation of the low-voltage platform area are realized, and the panoramic real-time monitoring of the platform area is supported.

Example two

Referring to fig. 2, a flow chart of another embodiment of a data compression method for panoramic monitoring of a platform according to the present invention includes steps 201 to 203, and the steps are as follows:

step 201: when the middleware is determined to be in an optimized state, transmitting fourth data and fifth data to a cloud server so that the cloud server can decode and decompress the fifth data to obtain sixth data, calculating the compression efficiency and the restoration precision of the current encoding and compression of the middleware according to the fourth data, the fifth data and the sixth data, and optimizing a third compression dictionary according to the compression efficiency and the restoration precision to obtain a fourth compression dictionary; the fourth data are acquired according to the platform panoramic monitoring terminal; the fifth data is obtained by encoding and compressing the fourth data according to a preset third compression dictionary.

In this embodiment, the platform panoramic monitoring terminal sends the important data generated at the preset time to the middleware for supporting platform panoramic monitoring, and sets the important data generated at the preset time as fourth data;

X(t)＝[x ₁ (t),...,x _n (t),...,x _N (t)]

In this embodiment, feature extraction is performed on the fourth data by presetting a second method to obtain a second extracted feature, which is specifically defined as follows:

the middleware performs denoising operation on the fourth data through a preset denoising method, performs data feature mining after the denoised fourth data is converted into a preset interval through a preset data standardization method, and sets a data feature value extracted through the data feature mining method as the second extraction feature;

In this embodiment, the data feature mining is performed after the denoising fourth data is converted to a preset interval by a preset data standardization method, and the specific definition mode is as follows:

after the fourth data after denoising is converted into a [0,1] interval by a data standardization method, inputting a preset depth feature mining network to extract a data feature value, and obtaining the data feature value extracted from important data generated at a preset moment;

wherein Y (t) = [ Y ] ₁ (t),…,y _q (t),…,y _Q (t)]For Q data characteristic values extracted from important data X (t) generated at time t, such as electricity of a platform panoramic monitoring terminalVoltage fluctuation conditions, current fluctuation conditions, etc.; g represents a full connection layer, ω is a weight parameter of the full connection layer, and b is a bias term of the full connection layer; f (f) ⁽ⁱ⁾ (X (t)) is the total number of depth feature mining layers,representing maximum pooling operations, +.> Representing an activation function->The representation is convolved, K _i A weight parameter vector representing an i-th layer convolution kernel; b (B) _i Representing the bias term vector for that layer.

In this embodiment, the event type judgment is performed on the second extracted feature to obtain a second data feature, which is specifically defined in the following manner:

Acquiring a vector composed of all data characteristic values extracted from the second extracted characteristic, judging the specific type of the event by utilizing a preset event judging network to obtain a vector composed of important data characteristic values and the matching degree of all the events, and setting the vector as the second data characteristic;

Z(t)＝[Z ₁ (t),...,Z _l (t),...,Z _L (t)]

judging the specific types of the events by the event research and judgment network to obtain the matching degree of each data characteristic value extracted in the second extraction characteristic with the preset event at the preset moment, wherein the matching degree is specifically as follows:

In this embodiment, the fifth data is obtained by encoding and compressing the fourth data according to the second data feature and the preset third compression dictionary by a preset second method, specifically:

searching compression dictionary data with highest matching degree with the second data features in the preset third compression dictionary, and encoding and compressing the fourth data according to the searched compression dictionary data with highest matching degree with the second data features, wherein the specific definition mode is as follows:

X _code (t)＝A _m [X(t)]

wherein X is _code (t) the fifth data obtained by encoding compression, A _m For the third compression dictionary, X (t) is the fourth data.

In this embodiment, the compression efficiency and the restoration precision of the current encoding compression of the middleware are calculated according to the fourth data, the fifth data and the sixth data, and specifically defined as:

wherein ψ (t) is the recovery precision, X (t) is the fourth data, X _unzip (t) is the sixth data.

In this embodiment, the optimizing the third compression dictionary according to the compression efficiency and the restoration precision to obtain the fourth compression dictionary is specifically defined as:

in this embodiment, the performing end-to-end splicing optimization on the third compression dictionary corresponding position code and the pre-preset position code of the third compression dictionary corresponding position code to obtain the fourth compression dictionary specifically includes:

wherein Q (t) represents the first Q (t) bit of the corresponding position code of the third compression dictionary, eta (t) represents the compression efficiency, phi (t) represents the reduction precision,represents taking an upward rounding, length (A _m (x) A maximum number of bits representing the third compression dictionary code.

The method comprises the steps of defining the acquisition of fourth data and fifth data in detail, transmitting the fourth data and the fifth data to a cloud server when determining that a middleware is in an optimized state, obtaining important data in carrier multidimensional information generated by a panoramic monitoring terminal of a platform area at a certain moment, extracting data characteristics of the important data, and intuitively finding out the optimization degree of data compression efficiency according to the data compression efficiency and the reduction precision obtained by the method, wherein the optimization degree of the data compression efficiency can be used for adjusting the data compression efficiency optimization method more optimally later; and by specifically defining the method for optimizing the fourth compression dictionary through the compression efficiency and the reduction precision, a better data compression dictionary can be obtained and used for updating and optimizing the third compression dictionary, so that the data compression efficiency is improved.

Step 202: and receiving the compression efficiency, the restoration precision and the fourth compression dictionary sent by the cloud server, and carrying out aggregation updating on the locally stored compression dictionary according to the compression efficiency, the restoration precision and the fourth compression dictionary.

In this embodiment, the aggregating updating of the locally stored compression dictionary according to the compression efficiency, the restoring precision and the fourth compression dictionary specifically includes:

wherein, xi _m For the aggregation weight, η (t) represents the compression efficiency, ψ (t) represents the reduction accuracy, A _n For the third compression dictionary to be used,for the fourth compression dictionary, threshold _m And (5) the aggregation weight threshold value.

According to the definition mode, when the reduction precision is poorer and the compression efficiency is lower, the aggregation weight is larger, and the aggregation optimization effect of the cloud on the third compression dictionary is better, so that the data compression mode is continuously optimized, and the data compression efficiency is improved.

Step 203: and carrying out coding compression on the acquired original data according to the updated compression dictionary.

The updated compression dictionary is used for encoding and compressing the data, so that the compression efficiency of the panoramic monitoring data of the platform area can be improved.

According to the embodiment, the data generated by the platform region panoramic monitoring terminal is transmitted to the cloud server so as to optimize the data compression efficiency, so that the compression efficiency of the platform region panoramic monitoring data can be improved, the huge pressure of massive data on the power line carrier is relieved, the efficient convergence and compression of important event data of the platform region are ensured, the efficient interaction and transmission of multidimensional information based on the carrier wave for the low-voltage platform region operation panoramic monitoring are realized, and the platform region panoramic real-time monitoring is supported.

Example III

Accordingly, referring to fig. 3, a schematic structural diagram of an embodiment of a target segmentation-based plumpness detection device provided in the present invention is applicable to a cloud server, and includes a data receiving module 301, a data processing module 302, a dictionary optimizing module 303, and a data sending module 304.

The data receiving module 301 is configured to receive first data and second data sent by the middleware when it is determined that the middleware is in an optimized state; the first data are acquired by the middleware according to a platform panoramic monitoring terminal; the second data is obtained by encoding and compressing the first data according to a preset first compression dictionary. In this embodiment, the platform panoramic monitoring terminal sends important data generated at a preset time to a middleware for supporting platform panoramic monitoring, and the important data generated at the preset time is set as first data;

X(t)＝[x ₁ (t),...,x _n (t),...,x _N (t)]

wherein X (t) is the time of the panoramic monitoring terminal of the platform areaN important data, x in carrier multidimensional information to be generated by t _n And (t) generating nth important data at the moment t for the station area panoramic monitoring terminal.

wherein Y (t) = [ Y ] ₁ (t),…,y _q (t),…,y _Q (t)]Q data characteristic values extracted from important data X (t) generated at the moment t, such as voltage fluctuation conditions, current fluctuation conditions and the like of a panoramic monitoring terminal of a platform area; g represents a full connection layer, ω is a weight parameter of the full connection layer, and b is a bias term of the full connection layer; f (f) ⁽ⁱ⁾ (X (t)) is the total number of depth feature mining layers,representing maximum pooling operations, +.> Representing an activation function->The representation is convolved, K _i A weight parameter vector representing an i-th layer convolution kernel; b (B) _i Representing the bias term vector for that layer.

Z(t)＝[Z ₁ (t),...,Z _l (t),...,Z _L (t)]

X _code (t)＝A _m [X(t)]

The first data and the second data are defined in detail, and when the middleware is determined to be in an optimized state, the data receiving module 301 receives the first data and the second data sent by the middleware, so that important data in carrier multidimensional information generated by the panoramic monitoring terminal of the platform area at a certain moment can be obtained, the important data is extracted in data characteristics, and real-time monitoring of the panoramic of the platform area can be supported.

The data processing module 302 is configured to perform encoding decompression on the second data to obtain third data, and calculate, according to the first data, the second data, and the third data, compression efficiency and reduction precision of current encoding compression of the middleware.

In this embodiment, the data processing module 302 calculates, according to the first data, the second data, and the third data, the compression efficiency and the restoration precision of the current encoding compression of the middleware according to the specific definition manner is:

the data processing module 302 calculates compression efficiency before and after data compression according to the first data and the second data, specifically:

the data processing module 302 calculates the restoration accuracy before and after data decompression according to the first data and the third data, specifically:

The data processing module 302 can intuitively see the optimization degree of the data compression efficiency through the data compression efficiency and the restoration precision obtained by the method, and can be used for adjusting the data compression efficiency optimization method more optimally later.

The dictionary optimization module 303 is configured to optimize the first compression dictionary according to the compression efficiency and the restoration precision, and obtain a second compression dictionary.

In this embodiment, the dictionary optimization module 303 optimizes the first compression dictionary according to the compression efficiency and the restoration precision to obtain a second compression dictionary, which is specifically defined as follows:

The dictionary optimization module 303 performs end-to-end splicing optimization on the first compression dictionary corresponding position code and the pre-preset position code of the first compression dictionary corresponding position code to obtain the second compression dictionary, specifically:

in this embodiment, the dictionary optimization module 303 performs end-to-end splicing optimization on the first compression dictionary corresponding position code and the pre-preset bit code of the first compression dictionary corresponding position code to obtain the second compression dictionary, specifically:

the dictionary optimization module 303 performs end-to-end concatenation optimization according to the following formula:

wherein Q (t) represents the previous Q (t) bit of the corresponding position code of the first compression dictionary, eta (t) represents the compression efficiency, phi (t) represents the reduction precision,represents taking an upward rounding, length (A _m (x) A maximum number of bits representing the first compression dictionary encoding.

By the method for optimizing the second compression dictionary by the dictionary optimizing module 303, a better data compression dictionary can be obtained, which is used for updating and optimizing the first compression dictionary and improving the data compression efficiency.

The data sending module 304 is configured to send the compression efficiency, the restoration precision, and the second compression dictionary to the middleware, so that the middleware performs aggregation update on a locally stored compression dictionary according to the compression efficiency, the restoration precision, and the second compression dictionary, and performs encoding compression on the acquired original data according to the updated compression dictionary.

wherein, xi _m For the aggregation weight, η (t) represents the compression efficiency, ψ (t) represents the reduction accuracy, A _n For the first compression dictionary to be used,for the second compression dictionary threshold _m And (5) the aggregation weight threshold value.

According to the definition mode, when the reduction precision is poorer and the compression efficiency is lower, the aggregation weight is larger, and the aggregation optimization effect of the cloud server on the first compression dictionary is better, so that the data compression mode is continuously optimized, and the data compression efficiency is improved.

When the middleware is in the non-optimized state, the data receiving module 301 receives the second data sent by the middleware, and completes the transmission of the compressed data.

In this embodiment, when the middleware is in a non-optimized state, it indicates that the compression efficiency and the reduction precision of the data compression efficiency optimization method have reached the requirements for optimization, and the current data compression mode can be maintained as the optimal mode all the time without further adjustment, where the requirements for optimization can be set by the conditions of the actual situation; at this time, the data receiving module 301 only receives the second data sent by the middleware, so that the amount of data transmitted can be reduced, thereby reducing the network burden.

Example IV

Accordingly, referring to fig. 4, a schematic structural diagram of another embodiment of a target segmentation-based fullness detecting device provided in the present invention is applicable to middleware, including a data transmission module 401, a dictionary updating module 402, and a data compression module 403.

The data transmission module 401 is configured to transmit fourth data and fifth data to a cloud server when it is determined that the middleware is in an optimized state, so that the cloud server performs encoding decompression on the fifth data to obtain sixth data, calculates compression efficiency and reduction precision of current encoding compression of the middleware according to the fourth data, the fifth data and the sixth data, and then optimizes a third compression dictionary according to the compression efficiency and the reduction precision to obtain a fourth compression dictionary; the fourth data are acquired according to the platform panoramic monitoring terminal; the fifth data is obtained by encoding and compressing the fourth data according to a preset third compression dictionary.

X(t)＝[x ₁ (t),...,x _n (t),...,x _N (t)]

Z(t)＝[Z ₁ (t),...,Z _l (t),...,Z _L (t)]

X _code (t)＝A _m [X(t)]

wherein Q (t) represents the first Q (t) bit of the corresponding position code of the third compression dictionary, eta (t) represents the compression efficiency, phi (t) represents the reduction precision,represents taking an upward rounding, length (A _m (x) A) the representation stationThe third compression dictionary encodes the maximum number of bits.

The method comprises the steps of defining the acquisition of fourth data and fifth data in detail, transmitting the fourth data and the fifth data to a cloud server by the data transmission module 401 when determining that a middleware is in an optimized state, obtaining important data in carrier multidimensional information generated by a panoramic monitoring terminal of a platform region at a certain moment, extracting data characteristics of the important data, and intuitively finding out the optimization degree of data compression efficiency according to the data compression efficiency and the restoration precision obtained by the method, wherein the optimization degree of the data compression efficiency can be used for adjusting the data compression efficiency optimization method more optimally later; and by specifically defining the method for optimizing the fourth compression dictionary through the compression efficiency and the reduction precision, a better data compression dictionary can be obtained and used for updating and optimizing the third compression dictionary, so that the data compression efficiency is improved.

The dictionary updating module 402 is configured to receive the compression efficiency, the restoration precision, and the fourth compression dictionary sent by the cloud server, and aggregate and update the locally stored compression dictionary according to the compression efficiency, the restoration precision, and the fourth compression dictionary.

In this embodiment, the dictionary updating module 402 performs aggregate updating on the locally stored compression dictionary according to the compression efficiency, the restoration accuracy and the fourth compression dictionary, specifically:

setting an aggregation weight and an aggregation weight threshold, and if the aggregation weight is greater than the aggregation weight threshold, updating the third compression dictionary by the dictionary updating module 402 according to the fourth compression dictionary; if the aggregation weight is smaller than the aggregation weight threshold, the third compression dictionary is not updated, specifically:

According to the definition mode, when the reduction precision is poorer and the compression efficiency is lower, the aggregation weight is larger, and the aggregation optimization effect of the cloud server on the third compression dictionary is better, so that the data compression mode is continuously optimized, and the data compression efficiency is improved.

The data compression module 403 is configured to perform encoding compression on the obtained original data according to the updated compression dictionary.

Example five

Accordingly, referring to fig. 5, a schematic structural diagram of a middleware of a target segmentation-based plumpness detection device provided in the present invention includes an emergency feature mining module, an emergency studying and judging module, an event matching compression dictionary module, a data compression dictionary library module, a data compression processing module and a data compression dictionary updating module.

In this embodiment, the middleware is deployed at the edge gateway and powered by 220V power.

In this embodiment, when it is determined that the middleware is in an optimized state, the platform panoramic monitoring terminal transmits the original data stream of the distributed photovoltaic grid-connected emergency to the emergency feature mining module and the data compression processing module, the emergency feature mining module performs data feature mining, and the feature data obtained by mining is input to the emergency studying and judging module, so as to provide feature support for subsequent emergency category studying and judging.

In this embodiment, after the emergency studying and judging module obtains the feature data output by the emergency feature mining module, the emergency type is studied and judged based on the event studying and judging network, and the studying and judging result is input into the event matching compression dictionary module; the emergency type comprises events such as distributed photovoltaic grid connection/grid disconnection, switch tripping, load shedding, charging and discharging of an energy storage battery and the like.

In this embodiment, the event matching compression dictionary module stores information of a data compression dictionary corresponding to a panoramic monitoring emergency of a platform area, and is configured to support rapid matching of compression dictionary data and panoramic monitoring emergency data, and transmit the compression dictionary data with the highest matching degree of the searched features to the data compression dictionary library module.

In this embodiment, the data compression dictionary library module stores a plurality of data compression dictionaries, searches for a data compression dictionary matched with the data compression dictionary data transmitted by the event matching compression dictionary module after receiving the data of the compression dictionary transmitted by the event matching compression dictionary module, and transmits the data of the compression dictionary transmitted by the event matching compression dictionary module and the data compression dictionary obtained by searching to the data compression processing module;

in this embodiment, the data compression processing module is responsible for encoding and compressing multidimensional information and data generated by different emergencies based on the result output by the data compression dictionary database module, and transmitting the encoded and compressed data and the original data of the distributed photovoltaic grid-connected emergencies to the communication module in the edge gateway;

and the communication module uploads the data transmitted by the data compression processing module to the cloud so as to enable the cloud to calculate and process the data, receive compression method optimization update information fed back by the cloud and transmit the information to the digital compression dictionary update module.

In this embodiment, the data compression dictionary updating module is responsible for processing the compression method optimization updating information fed back from the cloud, and uses the compression method optimization updating information to aggregate and update the local data compression dictionary of the data compression dictionary library module, so as to continuously optimize the data compression mode of the middleware.

In the embodiment, the data compression dictionary with the highest matching degree is selected to compress the acquired data, so that the size of the compressed data is reduced to the maximum extent and the accuracy of the restored data is improved; meanwhile, the data compression dictionary of the middleware is continuously optimized, high matching degree of emergency and corresponding compression modes is guaranteed, efficient interaction of multidimensional information based on carriers is achieved, and panoramic real-time monitoring of a supporting platform area can be achieved.

Further working principles and detailed steps of the present embodiment can be, but are not limited to, those described in connection with embodiment two.

In summary, the embodiment of the invention provides a data compression and device for panoramic monitoring of a platform, when determining that a middleware is in an optimized state, the device acquires important data generated by a panoramic monitoring terminal of the platform, carries out coding compression according to a preset compression dictionary to obtain the important data after coding compression, and transmits the important data generated by the panoramic monitoring terminal of the platform and the important data after coding compression to a cloud server by the middleware; decompressing the encoded and decompressed important data by the cloud server to obtain encoded and decompressed important data, and calculating the compression efficiency and the restoration precision of the current encoding and compression of the middleware according to the important data generated by the platform region panoramic monitoring terminal, the encoded and compressed important data and the encoded and decompressed important data; optimizing the compression dictionary according to the compression efficiency and the reduction precision to obtain an optimized compression dictionary; the cloud server sends the compression efficiency, the restoration precision and the optimized compression dictionary to the middleware, aggregates and updates the locally stored compression dictionary, and encodes and compresses the acquired original data according to the updated compression dictionary, so that the compression efficiency of the panoramic monitoring data of the platform area can be improved, the huge pressure of massive data on the power line carrier is relieved, the efficient aggregation and compression of important event data of the platform area can be ensured, and the efficient interaction and transmission of multidimensional information of panoramic monitoring of low-voltage platform area operation are realized.

The foregoing embodiments have been provided for the purpose of illustrating the general principles of the present invention, and are not to be construed as limiting the scope of the invention. It should be noted that any modifications, equivalent substitutions, improvements, etc. made by those skilled in the art without departing from the spirit and principles of the present invention are intended to be included in the scope of the present invention.

Claims

1. A data compression method for panoramic monitoring of a region, comprising:

when determining that the middleware is in an optimized state, receiving first data and second data sent by the middleware; the first data are acquired by the middleware according to a platform panoramic monitoring terminal; the second data is obtained by encoding and compressing the first data according to a preset first compression dictionary;

and sending the compression efficiency, the restoration precision and the second compression dictionary to the middleware so that the middleware can aggregate and update the locally stored compression dictionary according to the compression efficiency, the restoration precision and the second compression dictionary, and encode and compress the acquired original data according to the updated compression dictionary.

2. The data compression method for panoramic monitoring of a platform area according to claim 1, wherein the compression efficiency and the restoration precision of the current coding compression of the middleware are calculated according to the first data, the second data and the third data, and specifically defined as:

3. The data compression method for panoramic monitoring of a platform area according to claim 1, wherein the optimization of the first compression dictionary according to the compression efficiency and the restoration accuracy is performed to obtain a second compression dictionary, which is specifically defined as follows:

wherein,for the second compression dictionary, A _m For the first compression dictionary, +.>The front and back sections of codes are spliced end to end, delta represents taking A _m The pre-set bit code bits corresponding to the position codes.

4. The data compression method for panoramic monitoring of a platform area according to claim 3, wherein the second compression dictionary is obtained by performing end-to-end splicing optimization on the corresponding position code of the first compression dictionary and the pre-preset position code of the corresponding position code of the first compression dictionary, specifically:

5. The data compression method for panoramic monitoring of a platform area according to claim 1, wherein the middleware performs aggregation updating on a locally stored compression dictionary according to the compression efficiency, the restoration precision and the second compression dictionary, specifically:

6. The data compression method for panoramic monitoring of a district as recited in claim 1, comprising:

And when the middleware is in a non-optimized state, receiving second data sent by the middleware, and completing the transmission of compressed data.

7. A data compression method for panoramic monitoring of a region, comprising:

And carrying out coding compression on the acquired original data according to the updated compression dictionary.

8. The data compression method for panoramic monitoring of a platform area according to claim 7, wherein the compression efficiency and the restoration precision of the current coding compression of the middleware are calculated according to the fourth data, the fifth data and the sixth data, specifically defined as:

9. The data compression method for panoramic monitoring of a platform area according to claim 7, wherein the optimization of the third compression dictionary according to the compression efficiency and the restoration accuracy is performed to obtain a fourth compression dictionary, which is specifically defined as follows:

wherein,for the fourth compression dictionary, A _m For the third compression dictionary, +.>The front and back sections of codes are spliced end to end, delta represents taking A _m The pre-set bit code bits corresponding to the position codes.

10. The data compression method for panoramic monitoring of a platform area according to claim 7, wherein the fourth compression dictionary is obtained by performing end-to-end splicing optimization on the third compression dictionary corresponding position code and the pre-preset bit code of the third compression dictionary corresponding position code, specifically:

11. The data compression method for panoramic monitoring of a platform area according to claim 7, wherein the aggregation updating of the locally stored compression dictionary is performed according to the compression efficiency, the restoration accuracy and the fourth compression dictionary, specifically:

12. The data compression method for panoramic monitoring of a cell as recited in claim 7, comprising:

and when the middleware is in a non-optimal state, directly transmitting the fifth data to a cloud server to finish the transmission of the compressed data.

13. The data compression device for the panoramic monitoring of the platform area is characterized by comprising a data receiving module, a data processing module, a dictionary optimizing module and a data sending module;

the data sending module is used for sending the compression efficiency, the restoration precision and the second compression dictionary to the middleware, so that the middleware can aggregate and update the locally stored compression dictionary according to the compression efficiency, the restoration precision and the second compression dictionary, and can encode and compress the acquired original data according to the updated compression dictionary.

14. The data compression device for the panoramic monitoring of the platform area is characterized by comprising a data transmission module, a dictionary updating module and a data compression module;

the data compression module is used for carrying out coding compression on the acquired original data according to the updated compression dictionary.