CN110502517B - Distributed storage system for storing real-time operation data of power grid - Google Patents
Distributed storage system for storing real-time operation data of power grid Download PDFInfo
- Publication number
- CN110502517B CN110502517B CN201910786402.1A CN201910786402A CN110502517B CN 110502517 B CN110502517 B CN 110502517B CN 201910786402 A CN201910786402 A CN 201910786402A CN 110502517 B CN110502517 B CN 110502517B
- Authority
- CN
- China
- Prior art keywords
- data
- operation data
- dij
- classified
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/06—Electricity, gas or water supply
Abstract
The invention discloses a distributed storage system for storing real-time operation data of a power grid, which comprises a data acquisition unit, a data analysis unit, a data division unit, a controller, a display unit, a management unit, a data following unit and a storage end, wherein the data acquisition unit is used for acquiring the real-time operation data of the power grid; the method comprises the steps of obtaining power grid operation data through a data obtaining unit, classifying the power grid operation data by means of a data analyzing unit to obtain classified operation data, performing order analysis on the classified operation data by means of a data dividing unit to obtain three influence factors, namely a content occupation value Sij, a span duration Tij and a weight value Zij, corresponding to the classified operation data, and calculating a singular value Qij of the corresponding classified operation data according to the three influence factors; and then distributing row values to the classified operation data according to the odd values Qij by means of the controller and corresponding rules thereof, and then storing and distributing the corresponding classified operation data according to the row values by means of the identification dump unit.
Description
Technical Field
The invention belongs to the field of distributed storage of power grid operation data, relates to a distributed storage technology, and particularly relates to a distributed storage system for storing real-time power grid operation data.
Background
The patent document with the publication number of CN103116595B discloses a method for realizing power grid-oriented distributed storage of SCADA historical data, wherein a front-end server collects power data in real time, assembles the data into messages and sends the messages to a bus in a message form; each application server reads the respective subscribed message, and the data obtained by analysis is put into a real-time library; and the data of the real-time database is continuously refreshed, and the data of different service types are stored in the open-source distributed database in batches at different sampling frequencies. The distributed storage of massive scada historical data is adopted, the distributed storage method has the advantages of fast query and analysis capability of big data, supporting multi-copy fault tolerance, supporting distributed computation and the like, and has good expansibility.
However, when the historical data is processed, the data is not combined with the self-characteristics of the data, and only the data of different service types is stored in the open-source distributed database at different sampling frequencies, so that the self-characteristics of the data are not considered comprehensively; and the importance of the data itself is not highlighted; in order to solve this technical problem, a solution is now provided.
Disclosure of Invention
The invention aims to provide a distributed storage system for storing real-time operation data of a power grid.
The purpose of the invention can be realized by the following technical scheme:
a distributed storage system for storing real-time operation data of a power grid comprises a data acquisition unit, a data analysis unit, a data division unit, a controller, a display unit, a management unit, a data following unit and a storage end; the storage end comprises an identification dump unit, a first storage module, a second storage module, a third storage module and a fourth storage module;
the data acquisition unit is used for acquiring power grid operation data, and the power grid operation data is data generated by a power grid during operation;
the data acquisition unit is used for transmitting the power grid operation data to the data analysis unit, and the data analysis unit receives the power grid operation data transmitted by the data acquisition unit and carries out data analysis processing on the power grid operation data to obtain classified operation data Dij;
the data analysis unit is used for transmitting the classified operation data Dij to the data dividing unit, the data dividing unit receives the classified operation data Dij transmitted by the data analysis unit and carries out order analysis on the classified operation data Dij, and the specific steps of the order analysis are as follows:
the method comprises the following steps: firstly, acquiring all classified operation data Dij, and analyzing the importance of the classified operation data Dij to obtain a weight value Zij, wherein Zij corresponds to Dij one to one;
step two: acquiring all classified operating data Dij, and firstly acquiring the time span of the classified operating data Dij at the current distance, wherein the specific acquisition criterion is as follows:
taking half a day as a measurement unit, marking the time span with the distance between all the classified operation data Dij and the current time span as 1.5 days when the time span exceeds one day and is less than two days, and repeating the steps in the same way to obtain the time span with the distance between all the classified operation data Dij and marking the time span as the span duration Tij; tij and Dij are in one-to-one correspondence;
step three: acquiring the occupied storage size of all classified operation data Dij, and adopting a uniform dimension mega to mark the storage size as a content occupation value Sij, wherein Sij corresponds to Dij one to one;
step four: obtaining a content occupation value Sij, a span duration Tij and a weight value Zij, and introducing weight values X3, X4 and X5; and X3< X4< X5, X3+ X4+ X5 ═ 1;
step five: calibrating the storage priority number into an odd value Qij; calculating to obtain odd values Qij according to a formula Qij-X3 Zij + X4 Tij + X5 Sij, wherein the Qij corresponds to the Dij one by one;
the data dividing unit is used for transmitting the odd values Qij to the controller, the controller is used for carrying out classification marking processing on the classified operation data Dij according to the distribution rules stored in the data following unit, and the specific processing steps are as follows:
SS 1: firstly, acquiring an odd value Qij of corresponding classified operation data Dij;
SS 2: sorting the classified operation data Dij according to the value of Qij;
SS 3: assigning the rank I to the corresponding sorted operational data Dij ranked at top 1/5;
assigning the corresponding sorted run data Dij ranked between the headtotals 1/5-2/5 to rank II, here referring to the data at the stage after rank 1/5 to between ranks 2/5;
assigning the row value III to the corresponding sorted run data Dij ranked at a position between the total occupancy 2/5-4/5, as explained above;
assigning the row value IV to the corresponding sort operation data Dij ranked at the last 1/5;
the controller is used for transmitting the classified operation data Dij and the row values corresponding to the classified operation data Dij to the identification unloading unit, and the identification unloading unit is used for unloading the classified operation data Dij, and the specific process is as follows:
k1: obtaining classified operation data Dij and corresponding row values thereof;
k2: storing the classified operation data Dij with the rank value I into a first storage module;
k3: storing the classified operation data Dij with the rank value II in a second storage module;
k4: storing the classified operation data Dij with the rank value III in a third storage module;
k5: storing the classified operation data Dij with the rank value IV into a fourth storage module;
further, the data analysis processing specifically comprises the following steps:
a: acquiring all power grid operation data;
b: classifying the power grid operation data, wherein the specific classification is carried out according to the suffix name of the file;
c: obtaining a plurality of types of power grid operation data, dividing the power grid operation data according to types to obtain classified operation data, and marking the classified operation data as Dij, i is 1.. n, j is 1.. m; where Dij represents the jth class run data for the ith class.
Further, the importance analysis comprises the following specific steps:
s1: firstly, setting i as 1, and acquiring all classified operation data D1j corresponding to the class, wherein j is 1.. m;
s2: obtaining corresponding classified operation data D11 by changing j to 1;
s3: acquiring the checking times and the calling times corresponding to the classified operation data, marking the checking times as K, and marking the calling times as C;
the viewing times refer to that a user searches any data in preset time, and the viewing times of the data are increased by one; the calling times refer to that a user searches any data in a preset time, acquires and calls the data, and indicates that one is added to the calling times corresponding to the data;
s4: calculating importance measurement data weight values according to the viewing times K and the calling times C, introducing balance values X1 and X2, wherein X1 and X2 are preset values, X1+ X2 is 1, and X1 is larger than X2;
s5: calculating a weight value Z of the classified operation data by using a formula Z-C X1+ K X2;
s6: selecting corresponding classified operation data when j is j +1, and repeating the steps S2-S5 to obtain the weight value of the classified operation data;
s7: repeating the step S6 to obtain the weight values of all classified operation data corresponding to the class when i is 1;
s8: repeating the steps S1-S7 when i is equal to i +1, and obtaining the weight values of all the classified operation data of the class;
s9: repeating the step S8 until obtaining the weight values of all the classified operation data, and calibrating the weight values as Zij, i-1.. n, j-1.. m; and Zij and Dij correspond one-to-one.
Furthermore, the response speed and the data reading speed of the first storage module, the second storage module, the third storage module and the fourth storage module to an external instruction are sequentially and gradually reduced.
Further, the management unit is used for the user to enter all preset values X1, X2, X3, X4 and X5; the management unit is used for transmitting preset values X1, X2, X3, X4 and X5 to the controller, the controller is used for transmitting preset values X1, X2, X3, X4 and X5 to the data dividing unit, and the data dividing unit is used for transmitting preset values X1 and X2 to the data analyzing unit.
Furthermore, the controller is also used for analyzing the row values of all the classified operation data once again by combining the data analysis unit and the data analysis unit at preset time intervals to obtain updated row values; the controller is used for transmitting the updated ranking value to the identification unloading unit, and the identification unloading unit is used for storing the classified operation data again according to the updated ranking value;
the identification unloading unit is also used for continuously storing the classified operation data which are stored in the fourth storage module and exceed the second preset time length as deletion data; the fourth storage module automatically deletes the deletion data when detecting the existence thereof.
Further, the controller is further configured to transmit the sorted operating data Dij and the row values corresponding to the sorted operating data Dij to the display unit, and the display unit receives the sorted operating data Dij and the row values corresponding to the sorted operating data Dij transmitted by the controller and displays the sorted operating data Dij and the row values corresponding to the sorted operating data Dij in real time.
The invention has the beneficial effects that:
the method comprises the steps of obtaining power grid operation data through a data obtaining unit, classifying the power grid operation data by means of a data analyzing unit to obtain classified operation data, performing order analysis on the classified operation data by means of a data dividing unit to obtain three influence factors, namely a content occupation value Sij, a span duration Tij and a weight value Zij, corresponding to the classified operation data, and calculating a singular value Qij of the corresponding classified operation data according to the three influence factors; distributing row values to the classified operation data according to the odd values Qij by means of the controller and corresponding rules of the controller, and then storing and distributing the corresponding classified operation data according to the row values by means of the identification dump unit; the invention can utilize the singular value to judge the importance degree of the classified operation data, and store the operation data in different storage modules according to the importance degree of the operation data, thereby facilitating the access of users; meanwhile, deletion processing is carried out on data which is long in time and has little effect on users, so that the data is prevented from occupying effective storage space; the invention is simple, effective and easy to use.
Drawings
In order to facilitate understanding for those skilled in the art, the present invention will be further described with reference to the accompanying drawings.
FIG. 1 is a block diagram of the system of the present invention.
Detailed Description
As shown in fig. 1, a distributed storage system for storing real-time operation data of a power grid includes a data acquisition unit, a data analysis unit, a data division unit, a controller, a display unit, a management unit, a data following unit, and a storage end; the storage end comprises an identification dump unit, a first storage module, a second storage module, a third storage module and a fourth storage module;
the data acquisition unit is used for acquiring power grid operation data, and the power grid operation data can be acquired by accessing a power grid system through the SCADA system; the power grid operation data are all data generated by the power grid during operation, including graphs, models, operation data and the like;
the data acquisition unit is used for transmitting the power grid operation data to the data analysis unit, the data analysis unit receives the power grid operation data transmitted by the data acquisition unit and analyzes the data, and the specific data analysis processing steps are as follows:
a: acquiring all power grid operation data;
b: classifying the power grid operation data, wherein the specific classification is carried out according to the suffix name of the file;
c: obtaining a plurality of types of power grid operation data, dividing the power grid operation data according to types to obtain classified operation data, and marking the classified operation data as Dij, i is 1.. n, j is 1.. m; wherein Dij represents the jth class operation data of the ith class;
the data analysis unit is used for transmitting the classified operation data Dij to the data dividing unit, the data dividing unit receives the classified operation data Dij transmitted by the data analysis unit and carries out order analysis on the classified operation data Dij, and the specific steps of the order analysis are as follows:
the method comprises the following steps: firstly, all classified operation data Dij are obtained, importance analysis is carried out on the classified operation data Dij, and the specific steps of the importance analysis are as follows:
s1: firstly, setting i as 1, and acquiring all classified operation data D1j corresponding to the class, wherein j is 1.. m;
s2: obtaining corresponding classified operation data D11 by changing j to 1;
s3: acquiring the checking times and the calling times corresponding to the classified operation data, marking the checking times as K, and marking the calling times as C;
the viewing times refer to that a user searches any data in preset time, and the viewing times of the data are increased by one; the calling times refer to that a user searches any data in a preset time, acquires and calls the data, and indicates that one is added to the calling times corresponding to the data;
s4: calculating importance measurement data weight values according to the viewing times K and the calling times C, wherein balanced values X1 and X2 are introduced because the viewing times K and the calling times C have different influences on the weight values, X1 and X2 are preset values, and X1+ X2 is 1, and X1> X2;
s5: calculating a weight value Z of the classified operation data by using a formula Z-C X1+ K X2; where X1 may take the value 0.678 and X2 may take the value 0.322;
s6: selecting corresponding classified operation data when j is j +1, and repeating the steps S2-S5 to obtain the weight value of the classified operation data;
s7: repeating the step S6 to obtain the weight values of all classified operation data corresponding to the class when i is 1;
s8: repeating the steps S1-S7 when i is equal to i +1, and obtaining the weight values of all the classified operation data of the class;
s9: repeating the step S8 until obtaining the weight values of all the classified operation data, and calibrating the weight values as Zij, i-1.. n, j-1.. m; and Zij and Dij are in one-to-one correspondence;
step two: acquiring all classified operating data Dij, and firstly acquiring the time span of the classified operating data Dij at the current distance, wherein the specific acquisition criterion is as follows:
taking half a day as a measurement unit, marking the time span with the distance between all the classified operation data Dij and the current time span as 1.5 days when the time span exceeds one day and is less than two days, and repeating the steps in the same way to obtain the time span with the distance between all the classified operation data Dij and marking the time span as the span duration Tij; tij and Dij are in one-to-one correspondence;
step three: acquiring the occupied storage size of all classified operation data Dij, and adopting a uniform dimension mega to mark the storage size as a content occupation value Sij, wherein Sij corresponds to Dij one to one;
step four: obtaining a content occupation value Sij, a span duration Tij and a weight value Zij, and measuring the storage priority number corresponding to the classified operation data according to the three factors, wherein the storage priority number is used for representing the importance degree of the classified operation data and depends on the frequency of access and call of a user, the storage time, the size and other factors, and because the three factors have different influences on the priority value of the stored data, weights X3, X4 and X5 are introduced; and X3< X4< X5, X3+ X4+ X5 ═ 1; here X3, X4 and X5 may take the values 0.23, 0.35 and 0.42 in that order;
step five: calibrating the storage priority number into an odd value Qij; calculating to obtain odd values Qij according to a formula Qij-X3 Zij + X4 Tij + X5 Sij, wherein the Qij corresponds to the Dij one by one;
the data dividing unit is used for transmitting the odd values Qij to the controller, the controller is used for carrying out classification marking processing on the classified operation data Dij according to the distribution rules stored in the data following unit, and the specific processing steps are as follows:
SS 1: firstly, acquiring an odd value Qij of corresponding classified operation data Dij;
SS 2: sorting the classified operation data Dij according to the value of Qij;
SS 3: assigning the rank I to the corresponding sorted operational data Dij ranked at top 1/5;
assigning the corresponding sorted run data Dij ranked between the headtotals 1/5-2/5 to rank II, here referring to the data at the stage after rank 1/5 to between ranks 2/5;
assigning the row value III to the corresponding sorted run data Dij ranked at a position between the total occupancy 2/5-4/5, as explained above;
assigning the row value IV to the corresponding sort operation data Dij ranked at the last 1/5;
the controller is used for transmitting the classified operation data Dij and the row values corresponding to the classified operation data Dij to the identification unloading unit, and the identification unloading unit is used for unloading the classified operation data Dij, and the specific process is as follows:
k1: obtaining classified operation data Dij and corresponding row values thereof;
k2: storing the classified operation data Dij with the rank value I into a first storage module;
k3: storing the classified operation data Dij with the rank value II in a second storage module;
k4: storing the classified operation data Dij with the rank value III in a third storage module;
k5: storing the classified operation data Dij with the rank value IV into a fourth storage module;
the first storage module, the second storage module, the third storage module and the fourth storage module sequentially establish a first-layer folder and a second-layer folder according to types and time when storing data and are used for storing the data;
the speed of response of the first storage module, the second storage module, the third storage module and the fourth storage module to external instructions and the data reading speed are sequentially and gradually reduced;
the management unit is used for a user to enter all preset values X1, X2, X3, X4 and X5; the management unit is used for transmitting preset values X1, X2, X3, X4 and X5 to the controller, the controller is used for transmitting preset values X1, X2, X3, X4 and X5 to the data dividing unit, and the data dividing unit is used for transmitting preset values X1 and X2 to the data analyzing unit;
the controller is also used for analyzing the row values of all the classified operation data once again by combining the data analysis unit and the data analysis unit at intervals of preset time to obtain updated row values; the controller is used for transmitting the updated ranking value to the identification unloading unit, and the identification unloading unit is used for storing the classified operation data again according to the updated ranking value;
the identification unloading unit is also used for continuously storing the classified operation data which are stored in the fourth storage module and exceed the second preset time length as deletion data; the fourth storage module automatically deletes the deletion data when detecting the existence thereof.
The controller is further used for transmitting the classified operation data Dij and the row values corresponding to the classified operation data Dij to the display unit, and the display unit receives the classified operation data Dij and the row values corresponding to the classified operation data Dij transmitted by the controller and displays the classified operation data Dij and the row values corresponding to the classified operation data Dij in real time.
A distributed storage system for storing real-time operation data of a power grid is characterized in that when the distributed storage system works, firstly, the power grid operation data are obtained through a data obtaining unit, then, the power grid operation data are classified through a data analyzing unit to obtain classified operation data, then, the classified operation data are subjected to order analysis through a data dividing unit to obtain three influence factors, namely a content occupation value Sij, a span length Tij and a weight value Zij, of the classified operation data, and a singular value Qij of the corresponding classified operation data is calculated according to the three influence factors; distributing row values to the classified operation data according to the odd values Qij by means of the controller and corresponding rules of the controller, and then storing and distributing the corresponding classified operation data according to the row values by means of the identification dump unit; the invention can utilize the singular value to judge the importance degree of the classified operation data, and store the operation data in different storage modules according to the importance degree of the operation data, thereby facilitating the access of users; meanwhile, deletion processing is carried out on data which is long in time and has little effect on users, so that the data is prevented from occupying effective storage space; the invention is simple, effective and easy to use.
The foregoing is merely exemplary and illustrative of the present invention and various modifications, additions and substitutions may be made by those skilled in the art to the specific embodiments described without departing from the scope of the invention as defined in the following claims.
Claims (7)
1. A distributed storage system for storing real-time operation data of a power grid is characterized by comprising a data acquisition unit, a data analysis unit, a data division unit, a controller, a display unit, a management unit, a data following unit and a storage end; the storage end comprises an identification unloading unit, a first storage module, a second storage module, a third storage module and a fourth storage module;
the data acquisition unit is used for acquiring power grid operation data, and the power grid operation data is data generated by a power grid during operation;
the data acquisition unit is used for transmitting the power grid operation data to the data analysis unit, and the data analysis unit receives the power grid operation data transmitted by the data acquisition unit and carries out data analysis processing on the power grid operation data to obtain classified operation data Dij; where Dij represents the jth classification run data of the ith class, i =1.. n, j =1.. m;
the data analysis unit is used for transmitting the classified operation data Dij to the data dividing unit, the data dividing unit receives the classified operation data Dij transmitted by the data analysis unit and carries out order analysis on the classified operation data Dij, and the specific steps of the order analysis are as follows:
the method comprises the following steps: firstly, acquiring all classified operation data Dij, and analyzing the importance of the classified operation data Dij to obtain a weight value Zij, wherein Zij corresponds to Dij one to one;
step two: acquiring all classified operating data Dij, and firstly acquiring the time span of the classified operating data Dij at the current distance, wherein the specific acquisition criterion is as follows:
taking half a day as a measurement unit, marking the time span with the distance between all the classified operation data Dij and the current time span as 1.5 days when the time span exceeds one day and is less than two days, and repeating the steps in the same way to obtain the time span with the distance between all the classified operation data Dij and marking the time span as the span duration Tij; tij and Dij are in one-to-one correspondence;
step three: acquiring the occupied storage size of all classified operation data Dij, and adopting a uniform dimension mega to mark the storage size as a content occupation value Sij, wherein Sij corresponds to Dij one to one;
step four: obtaining a content occupation value Sij, a span duration Tij and a weight value Zij, and introducing weight values X3, X4 and X5; and has X3< X4< X5, X3+ X4+ X5= 1;
step five: calibrating the storage priority number into an odd value Qij; calculating to obtain odd values Qij according to a formula Qij = X3 Zij + X4 Tij + X5 Sij, wherein the Qij corresponds to the Dij one by one;
the data dividing unit is used for transmitting the odd values Qij to the controller, the controller is used for carrying out classification marking processing on the classified operation data Dij according to the distribution rules stored in the data following unit, and the specific processing steps are as follows:
SS 1: firstly, acquiring an odd value Qij of corresponding classified operation data Dij;
SS 2: sorting the classified operation data Dij according to the value of Qij;
SS 3: assigning the rank I to the corresponding sorted operational data Dij ranked at top 1/5;
assigning the corresponding sorted run data Dij ranked between the headtotals 1/5-2/5 to rank II, here referring to the data at the stage after rank 1/5 to between ranks 2/5;
assigning the row value III to the corresponding sorted run data Dij ranked at a position between the total occupancy 2/5-4/5, as explained above;
assigning the row value IV to the corresponding sort operation data Dij ranked at the last 1/5;
the controller is used for transmitting the classified operation data Dij and the row values corresponding to the classified operation data Dij to the identification unloading unit, and the identification unloading unit is used for unloading the classified operation data Dij, and the specific process is as follows:
k1: obtaining classified operation data Dij and corresponding row values thereof;
k2: storing the classified operation data Dij with the rank value I into a first storage module;
k3: storing the classified operation data Dij with the rank value II in a second storage module;
k4: storing the classified operation data Dij with the rank value III in a third storage module;
k5: and storing the classified operation data Dij with the row value IV into a fourth storage module.
2. The distributed storage system for storing the real-time operation data of the power grid according to claim 1, wherein the data analysis processing comprises the following specific steps:
a: acquiring all power grid operation data;
b: classifying the power grid operation data, wherein the specific classification is carried out according to the suffix name of the file;
c: obtaining a plurality of types of power grid operation data, dividing the power grid operation data according to types to obtain classified operation data, and marking the classified operation data as Dij, i =1.. n, j =1.. m.
3. The distributed storage system for storing the real-time operation data of the power grid according to claim 1, wherein the importance analysis comprises the following specific steps:
s1: firstly, i =1 is ordered, and all classified operation data D1j corresponding to the class are obtained, wherein j =1.. m;
s2: letting j =1, and acquiring corresponding classified operation data D11;
s3: acquiring the checking times and the calling times corresponding to the classified operation data, marking the checking times as K, and marking the calling times as C;
the viewing times refer to that a user searches any data in preset time, and the viewing times of the data are increased by one; the calling times refer to that a user searches any data in a preset time, acquires and calls the data, and indicates that one is added to the calling times corresponding to the data;
s4: calculating importance measurement data weight values according to the viewing times K and the calling times C, introducing balance values X1 and X2, wherein X1 and X2 are preset values, and X1+ X2=1, and X1> X2;
s5: calculating a weight value Z of the classified operation data by using a formula Z = C X1+ K X2;
s6: let j = j +1, select the corresponding classified operation data, repeat steps S2-S5, obtain the weight value of the classified operation data;
s7: repeating the step S6 to obtain the weight values of all classified operation data corresponding to the class when i = 1;
s8: repeating the steps S1-S7 when i = i +1 to obtain the weight values of all the classified operation data of the class;
s9: repeating the step S8 until obtaining a heavy value of all the classified operation data, and marking the heavy value as Zij, i =1.. n, j =1.. m; and Zij and Dij correspond one-to-one.
4. The distributed storage system for storing the real-time operation data of the power grid as claimed in claim 1, wherein the speed of response of the first storage module, the second storage module, the third storage module and the fourth storage module to the external command and the data reading speed are sequentially and gradually reduced.
5. The distributed storage system for storing the real-time operation data of the power grid as claimed in claim 1, wherein the management unit is used for a user to enter all preset values of X1, X2, X3, X4 and X5; the management unit is used for transmitting preset values X1, X2, X3, X4 and X5 to the controller, the controller is used for transmitting preset values X1, X2, X3, X4 and X5 to the data dividing unit, and the data dividing unit is used for transmitting preset values X1 and X2 to the data analyzing unit.
6. The distributed storage system for storing the real-time operation data of the power grid according to claim 1, wherein the controller is further configured to re-analyze the row values of all the classified operation data once to obtain updated row values by combining the data analysis unit and the data analysis unit at preset time intervals; the controller is used for transmitting the updated ranking value to the identification unloading unit, and the identification unloading unit is used for storing the classified operation data again according to the updated ranking value;
the identification unloading unit is also used for continuously storing the classified operation data which are stored in the fourth storage module and exceed the second preset time length as deletion data; the fourth storage module automatically deletes the deletion data when detecting the existence thereof.
7. The distributed storage system for storing the real-time operation data of the power grid as claimed in claim 1, wherein the controller is further configured to transmit the classified operation data Dij and the corresponding row values thereof to the display unit, and the display unit receives the classified operation data Dij and the corresponding row values thereof transmitted by the controller and displays the same in real time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910786402.1A CN110502517B (en) | 2019-08-23 | 2019-08-23 | Distributed storage system for storing real-time operation data of power grid |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910786402.1A CN110502517B (en) | 2019-08-23 | 2019-08-23 | Distributed storage system for storing real-time operation data of power grid |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110502517A CN110502517A (en) | 2019-11-26 |
| CN110502517B true CN110502517B (en) | 2022-01-28 |
Family
ID=68589335
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910786402.1A Active CN110502517B (en) | 2019-08-23 | 2019-08-23 | Distributed storage system for storing real-time operation data of power grid |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110502517B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111581500A (en) * | 2020-04-24 | 2020-08-25 | 贵州力创科技发展有限公司 | Network public opinion-oriented data distributed directional storage method and device |
| CN112181913B (en) * | 2020-10-10 | 2021-05-07 | 上海威固信息技术股份有限公司 | Block chain-based computer storage method and system |
| CN112650455A (en) * | 2021-02-23 | 2021-04-13 | 善智互联(北京)网络科技有限公司 | Lightweight power equipment knowledge hybrid storage medium management method and system |
| CN113434601A (en) * | 2021-07-06 | 2021-09-24 | 湖南方心科技股份有限公司 | Cloud data storage and local edge control system and method for power grid internet of things |
| CN113779008A (en) * | 2021-09-07 | 2021-12-10 | 杭州天宽科技有限公司 | Intelligent storage system for operating data of power intranet |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103116595A (en) * | 2012-10-24 | 2013-05-22 | 中国电力科学研究院 | Realizing method of supervisory control and data acquisition (SCADA) history data distribution-type storage facing power grid |
| CN104268219A (en) * | 2014-09-24 | 2015-01-07 | 国家电网公司 | Management method and system thereof for mass electricity utilization information collection data |
| CN105069703A (en) * | 2015-08-10 | 2015-11-18 | 国家电网公司 | Mass data management method of power grid |
| CN106777141A (en) * | 2016-12-19 | 2017-05-31 | 国网山东省电力公司电力科学研究院 | A kind of acquisition for merging multi-source heterogeneous electric network data and distributed storage method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9002670B2 (en) * | 2011-12-16 | 2015-04-07 | Basen Corporation | Smartgrid energy-usage-data storage and presentation systems, devices, protocol, and processes including a storage distribution process |
-
2019
- 2019-08-23 CN CN201910786402.1A patent/CN110502517B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103116595A (en) * | 2012-10-24 | 2013-05-22 | 中国电力科学研究院 | Realizing method of supervisory control and data acquisition (SCADA) history data distribution-type storage facing power grid |
| CN104268219A (en) * | 2014-09-24 | 2015-01-07 | 国家电网公司 | Management method and system thereof for mass electricity utilization information collection data |
| CN105069703A (en) * | 2015-08-10 | 2015-11-18 | 国家电网公司 | Mass data management method of power grid |
| CN106777141A (en) * | 2016-12-19 | 2017-05-31 | 国网山东省电力公司电力科学研究院 | A kind of acquisition for merging multi-source heterogeneous electric network data and distributed storage method |
Non-Patent Citations (2)
| Title |
|---|
| "Distributed system for data acquisition and management of electric energy consumption";Darek Bober等;《 2009 IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications》;20091201;全文 * |
| "电网调控集群分布式实时数据库的设计与关键技术";吴庆曦等;《电力系统自动化》;20171125;第41卷(第22期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110502517A (en) | 2019-11-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110502517B (en) | Distributed storage system for storing real-time operation data of power grid | |
| Huang et al. | An internet-of-things-based production logistics optimisation method for discrete manufacturing | |
| CN110348622A (en) | A kind of Time Series Forecasting Methods based on machine learning, system and electronic equipment | |
| CN106772205A (en) | A kind of automatic power-measuring system terminal unit exception monitoring method and device | |
| CN105868222A (en) | Task scheduling method and device | |
| CN116911471B (en) | Transmission performance optimization method and system of power supply system | |
| CN106130929B (en) | The service message automatic processing method and system of internet insurance field based on graph-theoretical algorithm | |
| CN108197310A (en) | Industrial part management method and device based on big data | |
| CN111860893A (en) | Data processing method and device | |
| CN111784146A (en) | Enterprise evaluation method and device based on electric power input and output rate | |
| CN110690982B (en) | Method and system for correlation analysis of management performance data of telecommunication network | |
| CN113381417B (en) | Three-phase load unbalance optimization method, device and terminal for power distribution network area | |
| CN113795032B (en) | Method and device for judging invisible faults of indoor division, storage medium and equipment | |
| EP3460732B1 (en) | Dispatching method and system based on multiple levels of steady state production rate in working benches | |
| CN117056360B (en) | Data processing method, device, computer equipment and storage medium | |
| CN112070354A (en) | Power grid equipment operation efficiency evaluation method | |
| CN111988807A (en) | Network problem positioning method and device based on big data and computing equipment | |
| Hu et al. | A ripple-spreading genetic algorithm for the airport gate assignment problem | |
| CN113408863A (en) | Work order recommendation method and device, terminal device and computer storage medium | |
| CN113449258B (en) | Quality evaluation method and device for intelligent electric meter, terminal equipment and storage medium | |
| CN117314393A (en) | Photovoltaic power station overhaul key index evaluation method, system, device and medium | |
| CN116032977B (en) | Intelligent power plant intelligent monitoring early warning maintenance management system based on Internet of things | |
| CN102353445B (en) | Vibration test system based on grid | |
| CN117096955B (en) | Distributed photovoltaic cluster operation control system | |
| CN117633571A (en) | Abnormal user early warning method and device based on multiple clusters |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |