CN107609194A - A kind of storage method of time redundancy Power system load data towards cloud computing - Google Patents
A kind of storage method of time redundancy Power system load data towards cloud computing Download PDFInfo
- Publication number
- CN107609194A CN107609194A CN201710964426.2A CN201710964426A CN107609194A CN 107609194 A CN107609194 A CN 107609194A CN 201710964426 A CN201710964426 A CN 201710964426A CN 107609194 A CN107609194 A CN 107609194A
- Authority
- CN
- China
- Prior art keywords
- labeled
- data
- ych
- pch
- record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Supply And Distribution Of Alternating Current (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
A kind of storage method of time redundancy Power system load data towards cloud computing, the present invention relates to power domain, and in particular to a kind of storage method of Power system load data towards cloud computing.The present invention proposes a kind of storage method of the time redundancy Power system load data towards cloud computing.This method constantly receives information on load, during being stored to cloud computing environment, redundant storage is carried out to the data of storage based on regular hour scope, the Data Entry that realizing when a block is accessed, can participate in calculating can find the data of its forerunner and follow-up certain time scope.
Description
Technical field
The present invention relates to power domain, and in particular to a kind of storage method of Power system load data towards cloud computing.
Background technology
Power system load data is the significant data of operation of power networks, and the data record the electricity consumption of specific taiwan area, enterprise, area
Amount, many artificial intelligence, big data parser can be analyzed based on Power system load data, and these analysis results are for electricity
The operation conditions of net, predict that the access of the clean energy resource such as power consumption, the formulation of electricity price, the safety management of power network, wind-powered electricity generation has ten
Divide important effect.
One feature of Power system load data is that data volume is larger, and is calculated based on artificial intelligence thereon, big data analysis
Method operand is larger.The cloud computing platforms such as the Hadoop currently occurred in computer realm can disperse data to be stored in more
Memory node, and calculated in these memory nodes, this pattern can greatly speed up data-handling capacity and calculating speed.
Cloud computing platform needs to store data as scattered data block, and each data block random storage is in a storage of cloud platform
On node.When being analyzed, electric load parser needs to be based on MapReduce frameworks, reads a data block every time and enters
Row calculates, and is then combined with result；But the maximum feature of Power system load data is temporal correlation, any one analysis is calculated
Method is required for one section of relatively continuous time series information on load of reading just to obtain corresponding result, and data are divided into block
Process may result in calculating process and isolate and come, on the one hand some algorithms may be caused to be difficult to run, on the other hand, may
Cause original algorithm to need to be incorporated as the mechanism that iteration between block communicates, considerably increase programing work amount, while largely deposit
Communication between storage node can reduce the algorithm speed of service on the contrary.That is, lack a kind of method at present to improve power load
Storage mode of the lotus information in cloud computing environment.Therefore, it is above-mentioned to solve to need a kind of new technical scheme among prior art badly
Problem.
The content of the invention
Problem to be solved by this invention is：Provide a kind of depositing for time redundancy Power system load data towards cloud computing
Method for storing.This method constantly receives information on load, during being stored to cloud computing environment, based on regular hour scope
Redundant storage is carried out to the data of storage, the Data Entry that realizing when a block is accessed, can participate in calculating can be looked for
To its forerunner and the data of follow-up certain time scope.
A kind of storage method of time redundancy Power system load data towards cloud computing, including electric load collection service
Device, it is characterized in that comprising the following steps：
Step 1, electric load acquisition server obtain some data blocks, and each data block maximum storage capacity is K；
Step 2, electric load information table is built, the field structure of the storage of the table is ID (uniqueness mark), Time
(time point information), FH (load value), PCH (pre-stored mark), YCH (storage mark), XSC (need to delete and mark)；
Step 3, gather a length of when when a length of gap of electric load information, often group information, often group information interval
frequency；
Step 4, the electric load information gathered in the step 3 is stored in the step 2 in chronological order
In electric load information table；
Step 5, the ID in the electric load information table is labeled as unique designation, Time is labeled as meeting in the shop
The time point of acquisition of information, FH are labeled as power load charge values, and PCH, YCH and XSC are labeled as 0；
Step 6, PCH, YCH and XSC field in electric load information table are labeled as 1, until shared by the record of mark
Memory space reaches capacity K；
Now, the storage total capacity sumki=0 after mark, record position ptri=1, rowsize of mark are single
Memory space shared by information, wherein i are iterations；
Step 7, obtain sumki+rowsize value X；
Step 8, if judging X >=K, mark PCH process terminates；
Step 9, if the X ＜ K in step 7, the pth tri bars in the electric load information table in step 2 are recorded
PCH and YCH fields be labeled as 1, XSC and be labeled as 1；
Step 10, ptri+1=ptri+1, sumki+1=sumki+rowsize are obtained, wherein i is iterations, is returned
Step 6；
Step 11, obtains quantity m=round (gap/frequency+0.5), and wherein round obtains to round up
The record that all PCH and YCH fields in electric load information table are 1, the YCH that its preceding m bar records is labeled as 0, obtains electricity
All PCH and YCH fields are 1 record in power load information table, and the YCH that m bars thereafter record is labeled as into 0, XSC is labeled as 0；
Step 12, the record that all PCH in electric load information table are 1 is extracted, be configured to a block storage and arrive cloud meter
Calculate in environment, wherein in all records of the data block, YCH is that can participate in electric load analysis to calculate labeled as 1 data
Data in method calculating process；The data that YCH is 0 and PCH is 1 are gap data, and in the block, all YCH=1 data are equal
All load datas in the range of its forerunner and follow-up gap can be found；
Step 13, delete the record that all XSC in electric load information table are labeled as 1；
Step 14, in obtained electric load information table if 0 record is labeled as comprising PCH return to step six, if
0 record then return to step four are labeled as comprising PCH.
Gap is 60 minutes in the step 3, and frequency is 15 minutes.
By above-mentioned design, the present invention can bring following beneficial effect：The problem of being proposed for prior art, this
Invention proposes a kind of storage method of the time redundancy Power system load data towards cloud computing.This method constantly receives load
Information, during being stored to cloud computing environment, redundant storage is carried out to the data of storage based on regular hour scope, it is real
When accessing a block now, the Data Entry that can participate in calculating can find its forerunner and follow-up certain time scope
Data.By this method, it can cause original electric load parser is easier to move to cloud computing environment, it is not necessary to
Consider communication process of the data caused by isolating between extra coding and memory node computer.Accelerate electric load analysis to calculate
Calculating speed of the method in cloud computing environment.
Brief description of the drawings
Below in conjunction with the accompanying drawings and embodiment the invention will be further described：
Fig. 1 is a kind of flow chart of the storage method of time redundancy Power system load data towards cloud computing of the invention
Embodiment
With reference to shown in Fig. 1, the present invention will be described in further detail, a kind of time redundancy power load towards cloud computing
The storage method of lotus data, including electric load acquisition server, it is characterized in that comprising the following steps：
Step 1, electric load acquisition server obtain some data blocks, and each data block maximum storage capacity is K；
Step 2, electric load information table is built, the field structure of the storage of the table is ID (uniqueness mark), Time
(time point information), FH (load value), PCH (pre-stored mark), YCH (storage mark), XSC (need to delete and mark)；
Step 3, gather a length of when when a length of gap of electric load information, often group information, often group information interval
frequency；
Step 4, the electric load information gathered in the step 3 is stored in the step 2 in chronological order
In electric load information table；
Step 5, the ID in the electric load information table is labeled as unique designation, Time is labeled as meeting in the shop
The time point of acquisition of information, FH are labeled as power load charge values, and PCH, YCH and XSC are labeled as 0；
Step 6, PCH, YCH and XSC field in electric load information table are labeled as 1, until shared by the record of mark
Memory space reaches capacity K；
Now, the storage total capacity sumki=0 after mark, record position ptri=1, rowsize of mark are single
Memory space shared by information, wherein i are iterations；
Step 7, obtain sumki+rowsize value X；
Step 8, if judging X >=K, mark PCH process terminates；
Step 9, if the X ＜ K in step 7, the pth tri bars in the electric load information table in step 2 are recorded
PCH and YCH fields be labeled as 1, XSC and be labeled as 1；
Step 10, ptri+1=ptri+1, sumki+1=sumki+rowsize are obtained, wherein i is iterations, is returned
Step 6；
Step 11, obtains quantity m=round (gap/frequency+0.5), and wherein round obtains to round up
The record that all PCH and YCH fields in electric load information table are 1, the YCH that its preceding m bar records is labeled as 0, obtains electricity
All PCH and YCH fields are 1 record in power load information table, and the YCH that m bars thereafter record is labeled as into 0, XSC is labeled as 0；
Step 12, the record that all PCH in electric load information table are 1 is extracted, be configured to a block storage and arrive cloud meter
Calculate in environment, wherein in all records of the data block, YCH is that can participate in electric load analysis to calculate labeled as 1 data
Data in method calculating process；The data that YCH is 0 and PCH is 1 are gap data, and in the block, all YCH=1 data are equal
All load datas in the range of its forerunner and follow-up gap can be found；
Step 13, delete the record that all XSC in electric load information table are labeled as 1；
Step 14, in obtained electric load information table if 0 record is labeled as comprising PCH return to step six, if
0 record then return to step four are labeled as comprising PCH.
Gap is 60 minutes in the step 3, and frequency is 15 minutes.
By this method, it can cause original electric load parser is easier to move to cloud computing environment, no
Need to consider communication process of the data caused by isolating between extra coding and memory node computer, accelerate electric load point
Calculating speed of the algorithm in cloud computing environment is analysed, is worth obtaining extensive promotion and application.
Claims (2)
1. a kind of storage method of time redundancy Power system load data towards cloud computing, including electric load acquisition server,
It is characterized in that comprise the following steps：
Step 1, electric load acquisition server obtain some data blocks, and each data block maximum storage capacity is K；
Step 2, build electric load information table, the field structure of the storage of the table is ID (uniqueness mark), Time (when
Between put information), FH (load value), PCH (pre-stored mark), YCH (storage mark), XSC (need to delete and mark)；
Step 3, gather a length of when when a length of gap of electric load information, often group information, often group information interval
frequency；
Step 4, the electric power electric load information gathered in the step 3 being stored in chronological order in the step 2
In information on load table；
Step 5, the ID in the electric load information table is labeled as unique designation, Time is labeled as meeting information in the shop
The time point of acquisition, FH are labeled as power load charge values, and PCH, YCH and XSC are labeled as 0；
Step 6, PCH, YCH and XSC field in electric load information table are labeled as 1, until storage shared by the record of mark
Space reaches capacity K；
Now, the storage total capacity sumk after marki=0, the record position ptr of marki=1, rowsize is single information institute
The memory space of occupancy, wherein i are iterations；
Step 7, obtain sumki+ rowsize value X；
Step 8, if judging X >=K, mark PCH process terminates；
Step 9, if the X ＜ K in step gas, by the pth tr in the electric load information table in step 2iThe PCH of bar record
1, XSC, which is labeled as, with YCH fields is labeled as 1；
Step 10, obtain ptri+1=ptri+1,sumki+1=sumki+ rowsize, wherein i are iterations, return to step six；
Step 11, obtains quantity m=round (gap/frequency+0.5), and wherein round obtains electric power to round up
The record that all PCH and YCH fields in information on load table are 1, the YCH that its preceding m bar records is labeled as 0, obtains power load
All PCH and YCH fields are 1 record in lotus information table, and the YCH that m bars thereafter record is labeled as into 0, XSC is labeled as 0；
Step 12, the record that all PCH in electric load information table are 1 is extracted, be configured to a block storage and arrive cloud computing ring
In border, wherein in all records of the data block, YCH is that can participate in electric load parser meter labeled as 1 data
Data during calculation；The data that YCH is 0 and PCH is 1 are gap data, and in the block, all YCH=1 data can look for
All load datas in the range of its forerunner and follow-up gap；
Step 13, delete the record that all XSC in electric load information table are labeled as 1；
Step 14, in obtained electric load information table if 0 record is labeled as comprising PCH return to step six, if not having
0 record then return to step four are labeled as comprising PCH.
2. a kind of storage method of time redundancy Power system load data towards cloud computing, it is characterized in that：Gap in the step 3
For 60 minutes, frequency was 15 minutes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710964426.2A CN107609194B (en) | 2017-10-17 | 2017-10-17 | Cloud computing-oriented storage method for time redundancy power load data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710964426.2A CN107609194B (en) | 2017-10-17 | 2017-10-17 | Cloud computing-oriented storage method for time redundancy power load data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107609194A true CN107609194A (en) | 2018-01-19 |
| CN107609194B CN107609194B (en) | 2020-08-07 |
Family
ID=61077354
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710964426.2A Active CN107609194B (en) | 2017-10-17 | 2017-10-17 | Cloud computing-oriented storage method for time redundancy power load data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107609194B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111582751A (en) * | 2020-05-19 | 2020-08-25 | 国网吉林省电力有限公司 | Time-weighted electricity purchasing risk early warning method |
| CN113032271A (en) * | 2021-03-31 | 2021-06-25 | 中国电子科技集团公司第十五研究所 | Data sample redundancy quantitative determination method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103605805A (en) * | 2013-12-09 | 2014-02-26 | 冶金自动化研究设计院 | Storage method of massive time series data |
| CN103957265A (en) * | 2014-05-07 | 2014-07-30 | 国家电网公司 | Electric power big-data cloud storage system achieving N-3 storage medium failure tolerance |
| CN105704218A (en) * | 2016-01-19 | 2016-06-22 | 国家电网公司 | Data storage and management method in cloud computing platform |
| US20160357443A1 (en) * | 2015-06-05 | 2016-12-08 | University Of Florida Research Foundation, Incorporated | Method and apparatus for big data cloud storage resource management |
| CN106682077A (en) * | 2016-11-18 | 2017-05-17 | 山东鲁能软件技术有限公司 | Method for storing massive time series data on basis of Hadoop technologies |
-
2017
- 2017-10-17 CN CN201710964426.2A patent/CN107609194B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103605805A (en) * | 2013-12-09 | 2014-02-26 | 冶金自动化研究设计院 | Storage method of massive time series data |
| CN103957265A (en) * | 2014-05-07 | 2014-07-30 | 国家电网公司 | Electric power big-data cloud storage system achieving N-3 storage medium failure tolerance |
| US20160357443A1 (en) * | 2015-06-05 | 2016-12-08 | University Of Florida Research Foundation, Incorporated | Method and apparatus for big data cloud storage resource management |
| CN105704218A (en) * | 2016-01-19 | 2016-06-22 | 国家电网公司 | Data storage and management method in cloud computing platform |
| CN106682077A (en) * | 2016-11-18 | 2017-05-17 | 山东鲁能软件技术有限公司 | Method for storing massive time series data on basis of Hadoop technologies |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111582751A (en) * | 2020-05-19 | 2020-08-25 | 国网吉林省电力有限公司 | Time-weighted electricity purchasing risk early warning method |
| CN111582751B (en) * | 2020-05-19 | 2022-06-14 | 国网吉林省电力有限公司 | Time-weighted electricity purchasing risk early warning method |
| CN113032271A (en) * | 2021-03-31 | 2021-06-25 | 中国电子科技集团公司第十五研究所 | Data sample redundancy quantitative determination method and system |
| CN113032271B (en) * | 2021-03-31 | 2023-10-13 | 中国电子科技集团公司第十五研究所 | Quantitative determination method and system for redundancy of data samples |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107609194B (en) | 2020-08-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Helseth et al. | A model for optimal scheduling of hydro thermal systems including pumped‐storage and wind power | |
| CN106294644B (en) | A kind of magnanimity time series data collection and treatment device and method based on big data technology | |
| WO2019041857A1 (en) | Scene analysis based operating state prediction method of power distribution network including distributed power | |
| CN107124394A (en) | A kind of powerline network security postures Forecasting Methodology and system | |
| CN103399902A (en) | Generation and search method for reachability chain list of directed graph in parallel environment | |
| CN102254024A (en) | Mass data processing system and method | |
| CN107025228B (en) | Question recommendation method and equipment | |
| CN104462222A (en) | Distributed storage method and system for checkpoint vehicle pass data | |
| CN116993227B (en) | Heat supply analysis and evaluation method, system and storage medium based on artificial intelligence | |
| CN104199942B (en) | A kind of Hadoop platform time series data incremental calculation method and system | |
| Shi et al. | Modelling and solutions of coordinated economic dispatch with wind–hydro–thermal complex power source structure | |
| CN108446396A (en) | A kind of electric power data processing method based on modified CIM model | |
| CN106649652A (en) | Construction method for on-line transformer substation main equipment monitoring system based on Hadoop | |
| CN107609194A (en) | A kind of storage method of time redundancy Power system load data towards cloud computing | |
| CN117372201A (en) | Rapid construction method of intelligent water conservancy digital twin model applied to reservoir | |
| CN105023170A (en) | Processing method and device of click stream data | |
| CN104951442A (en) | Method and device for determining result vector | |
| CN110543499A (en) | Anti-electricity-stealing location tracking equipment based on multi-source data fusion | |
| CN112511503A (en) | Method, system, equipment and storage medium for improving safety of intelligent electric meter | |
| CN107295059A (en) | The statistical system and method for service propelling amount | |
| CN108647243B (en) | Industrial big data storage method based on time series | |
| CN106708973A (en) | Method for accelerating Monte Carlo converse solution of PageRank problems | |
| CN116127447A (en) | Virtual power plant false data injection attack detection method, device, terminal and medium | |
| CN116760006A (en) | Wind power prediction method, device, equipment and storage medium | |
| CN102981856B (en) | Network program calculated result storage and retrieval method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |