CN109857590B - Data backup system of power dispatching center - Google Patents
Data backup system of power dispatching center Download PDFInfo
- Publication number
- CN109857590B CN109857590B CN201811580672.9A CN201811580672A CN109857590B CN 109857590 B CN109857590 B CN 109857590B CN 201811580672 A CN201811580672 A CN 201811580672A CN 109857590 B CN109857590 B CN 109857590B
- Authority
- CN
- China
- Prior art keywords
- data
- unit
- data transmission
- storage
- primary
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 claims abstract description 74
- 238000004364 calculation method Methods 0.000 claims abstract description 27
- 238000012163 sequencing technique Methods 0.000 claims description 8
- 230000003993 interaction Effects 0.000 claims description 3
- 238000007726 management method Methods 0.000 abstract description 11
- 238000013500 data storage Methods 0.000 abstract description 4
- 238000000034 method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
Abstract
The invention provides a data backup system of a power dispatching center, which comprises a storage module, a data processing module and a management module; the storage module comprises a primary storage unit, a secondary storage unit and a tertiary storage unit; the data processing module comprises a primary data transmission unit and a secondary data transmission unit, wherein the primary data transmission unit is used for processing data stored in the primary storage unit and transmitting the data to the secondary storage unit, and the secondary data transmission unit is used for processing data stored in the secondary storage unit and transmitting the data to the tertiary storage unit; the management module comprises a calculation unit and a control unit, wherein the calculation unit is used for calculating loads of a primary data transmission unit and a secondary data transmission unit in the data processing module, and the control unit is used for performing task allocation according to a calculation result of the calculation unit. The invention adopts a hierarchical storage mode, ensures the integrity of data storage and can effectively improve the transmission efficiency.
Description
Technical Field
The invention relates to the technical field of power systems, in particular to a data backup system of a power dispatching center.
Background
With the rapid development of information technology, information data in power enterprises is also becoming more and more abundant, and the information data plays an important role in continuous operation of power business. In the informatization construction process of the power system, each management system can generate a large amount of real-time electronic data and important document data. Ensuring the security and reliability of these system important data and electronic data has become an important task for informationized construction of power systems. The data backup aims to reload the system after the system crashes and quickly recover the system data through backup data after the data is lost.
The data of the power dispatching center has the characteristics of large scale, rich types, high data generation speed and the like, so that a backup system capable of efficiently processing the data needs to be established.
Disclosure of Invention
The invention aims to solve the technical problem of providing a data backup system of a power dispatching center so as to efficiently process data of the power dispatching center.
In order to solve the technical problems, the invention provides a data backup system of a power dispatching center, which comprises a storage module, a data processing module and a management module;
the storage module comprises first-level storage units, second-level storage units and third-level storage units, wherein the number of the second-level storage units is more than that of the first-level storage units and less than that of the third-level storage units;
the data processing module comprises a primary data transmission unit and a secondary data transmission unit, wherein the primary data transmission unit is used for processing data stored in the primary storage unit and transmitting the data to the secondary storage unit, and the secondary data transmission unit is used for processing data stored in the secondary storage unit and transmitting the data to the tertiary storage unit; the number of the primary data transmission units is more than that of the primary storage units, and the number of the secondary data transmission units is more than that of the secondary storage units;
the management module comprises a calculation unit and a control unit, wherein the calculation unit is used for calculating loads of a primary data transmission unit and a secondary data transmission unit in the data processing module, and the control unit is used for performing task allocation according to a calculation result of the calculation unit.
The calculation unit calculates the load of each data transmission unit by carrying out weighting through assignment according to the storage capacity, the data transmission speed and the data importance degree of the storage module.
Wherein, the formula of the load of each data transmission unit is calculated by the calculation unit as follows:
Load=n 1 ×Eff 1 + n 2 ×Eff 2 + n 3 ×Eff 3 + n 4 ×IM 4
in the above, load is the Load of the data transmission unit, n 1 、 n 2 Weights of storage amounts of adjacent two-stage storage units respectively, n 3 Weight of data transmission speed, n 4 Weight of importance degree of data, eff 1 、Eff 2 Memory efficiency, eff, of adjacent two-level memory cells 3 Data transfer efficiency, IM 4 Data importance level.
Wherein n is 1 1-2, n 2 1-2, n 3 Is 2-3, n 4 2-5.
Wherein the control unit comprises a sequencing processor and an allocation processor;
the sorting processor sorts the primary data transmission unit and the secondary data transmission unit according to the load calculated by the calculation unit; and the allocation processor allocates tasks according to the sequencing result of the sequencing processor.
The primary storage unit adopts an incremental backup mode.
The secondary storage unit adopts a differential backup mode.
The three-level storage unit adopts a complete backup mode.
The data processing module further comprises a primary data processing unit and a secondary data processing unit;
the primary data processing unit is used for analyzing the data in the primary storage unit, deleting the repeated data in the data and transmitting the data to the primary data transmission unit;
the secondary data processing unit is used for analyzing the data in the secondary storage unit and deleting the repeated data and then transmitting the repeated data to the secondary data transmission unit.
The management module further comprises a warning unit and a man-machine interaction platform.
The embodiment of the invention has the beneficial effects that:
(1) The data storage integrity is guaranteed by adopting a hierarchical storage mode, namely, each stage stores corresponding data, and the data cannot be recovered due to the damage of a certain storage unit;
(2) The number of the data transmission units between two adjacent stages is more than that of the storage units, so that the transmission speed can be effectively improved;
(3) The task distribution is performed through complex calculation, so that the transmission efficiency can be effectively improved.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a data backup system of a power dispatching center according to an embodiment of the present invention.
FIG. 2 is a schematic diagram of a framework between a data processing module and a management module in an embodiment of the present invention.
Fig. 3 is another schematic structural diagram of a data backup system of a power dispatching center according to an embodiment of the present invention.
Detailed Description
The following description of embodiments refers to the accompanying drawings, which illustrate specific embodiments in which the invention may be practiced.
As shown in fig. 1 and fig. 2, an embodiment of the present invention provides a data backup system of a power dispatching center, which includes a storage module 1, a data processing module 2 and a management module 3; the memory module 1 comprises a first-level memory unit 11, a second-level memory unit 12 and a third-level memory unit 13, wherein the number of the second-level memory units 12 is more than that of the first-level memory units 11 and less than that of the third-level memory units 13; the data processing module 2 comprises a primary data transmission unit 21 and a secondary data transmission unit 22, wherein the primary data transmission unit 21 is used for processing data stored in the primary storage unit 11 and transmitting the data to the secondary storage unit 12, and the secondary data transmission unit 22 is used for processing data stored in the secondary storage unit 12 and transmitting the data to the tertiary storage unit 13; the number of the primary data transmission units 21 is greater than the number of the primary storage units 11, and the number of the secondary data transmission units 22 is greater than the number of the secondary storage units 12; the management module 3 includes a calculation unit 31 and a control unit 32, the calculation unit 31 is used for calculating loads of the primary data transmission unit 21 and the secondary data transmission unit 22 in the data processing module 2, and the control unit 32 is used for performing task allocation according to a calculation result of the calculation unit 31.
The data backup system of the power dispatching center has the following advantages:
(1) The hierarchical storage mode is adopted, so that the data storage integrity is ensured, namely, each stage stores corresponding data, and the data cannot be recovered due to the damage of a certain storage unit. That is, the memory module 1 includes a primary memory unit 11, a secondary memory unit 12 and a tertiary memory unit 13, it will be understood that the primary memory unit 11 is generally a data memory of each power station, the secondary memory unit 12 may be generally a data memory of a certain area, the tertiary memory unit 12 may be generally a data memory of a certain market, or of course, more secondary memory units, and further four-level memory units, five-level memory units and the like may be further provided.
(2) The number of the data transmission units between two adjacent stages is more than that of the storage units, so that the transmission speed can be effectively improved. That is, the number of the first-stage data transmission units 21 is greater than the number of the first-stage storage units 11, and the number of the second-stage data transmission units 22 is greater than the number of the second-stage storage units 12.
(3) The task distribution is performed through complex calculation, so that the transmission efficiency can be effectively improved.
The data backup can be performed in various manners, and in this scheme, preferably, the primary storage unit adopts an incremental backup manner. And the secondary storage unit adopts a differential backup mode. The three-level storage unit adopts a complete backup mode.
The incremental backup means that the first day is completely backed up, and then only the data which is newly added or modified in the next days is backed up; its advantages are saving memory space and short backup time. The full backup means that the system is fully backed up every day, and all data are backed up every time; the method has the advantages that when the data is lost, all the data before backup can be restored once, and the restoration is convenient. Differential backup refers to a complete backup on the first day, then on the next few days, and then on all the data (new or modified) different from the first day; compared with incremental backup, the method has the advantages that the data recovery is convenient, the storage space can be saved compared with full backup, and the backup time is shortened. By selecting different modes for different storage units, the advantages of saving storage space, improving backup efficiency and ensuring data recovery convenience can be well achieved.
Preferably, referring to fig. 3, the data processing module 2 further includes a primary data processing unit 23 and a secondary data processing unit 24; the primary data processing unit 23 is configured to analyze the data in the primary storage unit 11 and delete the duplicate data therein, and then transmit the duplicate data to the primary data transmission unit 21; the secondary data processing unit 24 is configured to analyze the data in the secondary storage unit 12 and delete the duplicate data therefrom for transmission to the secondary data transmission unit 22. By analyzing and deleting the repeated data, the storage space can be well saved, and the efficiency of the whole backup system is improved.
In some preferred embodiments, the computing unit 31 preferably computes the load according to the storage amount of the storage module, the data transmission speed, and the data importance level. Therefore, the load degree of each transmission node can be well calculated, so that tasks are well distributed, and high-efficiency transmission is realized. Preferably, the calculation unit 31 performs calculation using a weighting method. The load of each data transfer unit (including the primary data transfer unit 21 and the secondary data transfer unit 22) can be calculated by weighting by assignment. The load can thus be calculated by the following formula:
Load=n 1 ×Eff 1 + n 2 ×Eff 2 + n 3 ×Eff 3 + n 4 ×IM 4
wherein n is 1 、 n 2 Weights of storage amounts of adjacent two-stage storage units respectively, n 3 Weight of data transmission speed, n 4 Weight of importance degree of data, eff 1 、Eff 2 Memory efficiency, eff, of adjacent two-level memory cells 3 Data transfer efficiency, IM 4 Data importance level. Specifically, when the load of the primary data transfer unit 21, that is, the load of the transfer node between the primary storage unit 11 and the secondary storage unit 12 is calculated, n 1 、 n 2 Weights, eff, of the storage amounts of the primary storage unit 11 and the secondary storage unit 12 respectively 1 、Eff 2 The storage efficiencies of the primary storage unit 11 and the secondary storage unit 12 are respectively. In some specific embodiments, n 1 1-2, n 2 1-2, n 3 Is 2-3, n 4 2-5.
More preferably, the control unit 32 includes a sorting processor and an allocation processor; the sorting processor sorts the primary data transmission unit 21 and the secondary data transmission unit 22 according to the load calculated by the calculation unit 31; and the allocation processor allocates tasks according to the sequencing result of the sequencing processor. That is, when the load of the data transmission unit is high, stopping the task continuing to be distributed; when the load of the data transmission unit is higher, tasks can be continuously distributed; and the operation balance of a plurality of data transmission units is ensured.
As shown in fig. 3, the management module 3 preferably further includes a warning unit 33, which warns when an abnormality occurs in the system. Preferably, the management module 3 further includes a man-machine interaction platform 34, which can display the operation status of each module and each unit at any time, for example, when the storage capacity of the storage unit exceeds 80%, red is displayed, when the storage capacity is lower than 20%, green is displayed, and when the storage capacity is between 20% and 80%, yellow is displayed; the load values of the data transmission units are ranked in the first 10% and can be displayed in red, ranked in the last 20% and can be displayed in green, and the load values between 10 and 80% can be displayed in yellow.
As can be seen from the above description, the embodiment of the present invention has the following beneficial effects:
(1) The data storage integrity is guaranteed by adopting a hierarchical storage mode, namely, each stage stores corresponding data, and the data cannot be recovered due to the damage of a certain storage unit;
(2) The number of the data transmission units between two adjacent stages is more than that of the storage units, so that the transmission speed can be effectively improved;
(3) The task distribution is performed through complex calculation, so that the transmission efficiency can be effectively improved.
The foregoing disclosure is illustrative of the present invention and is not to be construed as limiting the scope of the invention, which is defined by the appended claims.
Claims (3)
1. The utility model provides a data backup system of power dispatching center which characterized in that: the system comprises a storage module, a data processing module and a management module;
the storage module comprises first-level storage units, second-level storage units and third-level storage units, wherein the number of the second-level storage units is more than that of the first-level storage units and less than that of the third-level storage units; the primary storage unit adopts an incremental backup mode; the secondary storage unit adopts a differential backup mode; the three-level storage unit adopts a complete backup mode;
the data processing module comprises a primary data transmission unit and a secondary data transmission unit, wherein the primary data transmission unit is used for processing data stored in the primary storage unit and transmitting the data to the secondary storage unit, and the secondary data transmission unit is used for processing data stored in the secondary storage unit and transmitting the data to the tertiary storage unit; the number of the primary data transmission units is more than that of the primary storage units, and the number of the secondary data transmission units is more than that of the secondary storage units;
the management module comprises a calculation unit and a control unit, wherein the calculation unit is used for calculating loads of a primary data transmission unit and a secondary data transmission unit in the data processing module, and the control unit is used for performing task allocation according to a calculation result of the calculation unit;
the computing unit performs weighting through assignment according to the storage capacity, the data transmission speed and the data importance degree of the storage module to compute the load of each data transmission unit; the calculation unit calculates the formula of the load of each data transmission unit as follows: load=n 1 ×Eff 1 +n 2 ×Eff 2 +n 3 ×Eff 3 +n 4 ×IM 4 In the above, load is the Load of the data transmission unit, n 1 、n 2 Weights of storage amounts of two-stage storage units adjacent to the data transmission unit respectively, n 3 Weight of data transmission speed, n 4 Weight of importance degree of data, eff 1 、Eff 2 Memory efficiency, eff, of adjacent two-level memory cells 3 Data transfer efficiency, IM 4 Data importance;
the control unit comprises a sequencing processor and an allocation processor; the sorting processor sorts the primary data transmission unit and the secondary data transmission unit according to the load calculated by the calculation unit; the allocation processor performs task allocation according to the sequencing result of the sequencing processor;
the data processing module further comprises a primary data processing unit and a secondary data processing unit; the primary data processing unit is used for analyzing the data in the primary storage unit, deleting the repeated data in the data and transmitting the data to the primary data transmission unit; the secondary data processing unit is used for analyzing the data in the secondary storage unit and deleting the repeated data and then transmitting the repeated data to the secondary data transmission unit.
2. The power dispatching center data backup system of claim 1, wherein: n is n 1 Is 1 to 2, n 2 Is 1 to 2, n 3 Is 2 to 3, n 4 2 to 5.
3. The power dispatching center data backup system of claim 2, wherein: the management module further comprises a warning unit and a man-machine interaction platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811580672.9A CN109857590B (en) | 2018-12-24 | 2018-12-24 | Data backup system of power dispatching center |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811580672.9A CN109857590B (en) | 2018-12-24 | 2018-12-24 | Data backup system of power dispatching center |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109857590A CN109857590A (en) | 2019-06-07 |
| CN109857590B true CN109857590B (en) | 2023-10-31 |
Family
ID=66892033
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811580672.9A Active CN109857590B (en) | 2018-12-24 | 2018-12-24 | Data backup system of power dispatching center |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109857590B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110968462A (en) * | 2019-12-13 | 2020-04-07 | 重庆首厚智能科技研究院有限公司 | Real-time safety backup system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101567837A (en) * | 2008-04-24 | 2009-10-28 | 中兴通讯股份有限公司 | Method and system for distributing media stream links |
| CN106022974A (en) * | 2016-07-15 | 2016-10-12 | 广东中网电力有限公司 | Comprehensive loss-reducing and energy-saving distribution network big data system |
| CN107145407A (en) * | 2017-05-16 | 2017-09-08 | 成都汇智远景科技有限公司 | A kind of method that data are carried out with local backup |
| WO2017164809A1 (en) * | 2016-03-23 | 2017-09-28 | Agency For Science, Technology And Research | Control modules, multi-level data storage devices, multi-level data storage methods, and computer readable media |
| CN107707483A (en) * | 2017-09-26 | 2018-02-16 | 郑州云海信息技术有限公司 | A kind of load-balancing method, system, equipment and computer-readable storage medium |
-
2018
- 2018-12-24 CN CN201811580672.9A patent/CN109857590B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101567837A (en) * | 2008-04-24 | 2009-10-28 | 中兴通讯股份有限公司 | Method and system for distributing media stream links |
| WO2017164809A1 (en) * | 2016-03-23 | 2017-09-28 | Agency For Science, Technology And Research | Control modules, multi-level data storage devices, multi-level data storage methods, and computer readable media |
| CN106022974A (en) * | 2016-07-15 | 2016-10-12 | 广东中网电力有限公司 | Comprehensive loss-reducing and energy-saving distribution network big data system |
| CN107145407A (en) * | 2017-05-16 | 2017-09-08 | 成都汇智远景科技有限公司 | A kind of method that data are carried out with local backup |
| CN107707483A (en) * | 2017-09-26 | 2018-02-16 | 郑州云海信息技术有限公司 | A kind of load-balancing method, system, equipment and computer-readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 一种基于数据动态迁移的分级备份系统的研究;李玮;《计算技术与自动化》;第34卷(第1期);第121-125页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109857590A (en) | 2019-06-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Aminifar et al. | Probabilistic multistage PMU placement in electric power systems | |
| CN104917460B (en) | The monitoring method and device of a kind of photovoltaic cell component | |
| CN107316113B (en) | Power transmission network planning method and system | |
| CN102314336B (en) | A kind of data processing method and system | |
| CN104834984A (en) | Electric power transaction supervision risk early warning system based on unified and interconnected electric power market | |
| CN104020396A (en) | Grid fault diagnosis method based on data mining | |
| CN104506137A (en) | Equipment fault diagnosis method and apparatus | |
| CN110942235A (en) | Electric power emergency evaluation system | |
| CN109857590B (en) | Data backup system of power dispatching center | |
| CN111177128B (en) | Metering big data batch processing method and system based on improved outlier detection algorithm | |
| CN103902582B (en) | A kind of method and apparatus for reducing data warehouse data redundancy | |
| CN115730749B (en) | Power dispatching risk early warning method and device based on fusion power data | |
| CN112561902A (en) | Chip inverse reduction method and system based on deep learning | |
| CN114255058A (en) | Method and device for acquiring power consumption influence based on new crown epidemic situation influence | |
| CN109525437B (en) | Power distribution network communication node recovery method and system | |
| CN114676931B (en) | Electric quantity prediction system based on data center technology | |
| CN110675060A (en) | Energy supply and demand analysis and prediction platform based on big data application | |
| CN107508279B (en) | Stability simulation method for power network | |
| CN110188025B (en) | Efficient association method for alarm logs | |
| CN104182909A (en) | Multi-core parallel successive approximation method of hydropower system optimal scheduling | |
| Bagretsov et al. | Data acquisition technologies and system for automating, record-keeping and managing water supply processes | |
| CN109922124A (en) | A kind of coal mine data management system based on Hadoop | |
| CN116452396A (en) | Monitoring method, device, equipment and medium for energy industry chain | |
| Alshammari et al. | Optimal Technique of reliability and quality Assessment of two-area interconnected power systems | |
| CN115759676A (en) | Emergency dispatching method for movable hydrogen energy power supply system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |