CN106327055A - Big data technology-based electric power fee controlling method and system - Google Patents
Big data technology-based electric power fee controlling method and system Download PDFInfo
- Publication number
- CN106327055A CN106327055A CN201610639968.8A CN201610639968A CN106327055A CN 106327055 A CN106327055 A CN 106327055A CN 201610639968 A CN201610639968 A CN 201610639968A CN 106327055 A CN106327055 A CN 106327055A
- Authority
- CN
- China
- Prior art keywords
- data
- electricity
- expense
- amount
- distributed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 74
- 238000005516 engineering process Methods 0.000 title claims abstract description 20
- 230000008569 process Effects 0.000 claims abstract description 45
- 238000004364 calculation method Methods 0.000 claims abstract description 27
- 238000003860 storage Methods 0.000 claims abstract description 23
- 230000005611 electricity Effects 0.000 claims description 125
- 238000004422 calculation algorithm Methods 0.000 claims description 22
- 238000007689 inspection Methods 0.000 claims description 19
- 230000005540 biological transmission Effects 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 13
- 230000006870 function Effects 0.000 claims description 12
- 238000012795 verification Methods 0.000 claims description 12
- 238000000605 extraction Methods 0.000 claims description 10
- 230000008901 benefit Effects 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 8
- 230000002354 daily effect Effects 0.000 claims description 8
- 238000007726 management method Methods 0.000 claims description 7
- 230000002159 abnormal effect Effects 0.000 claims description 6
- 230000026676 system process Effects 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 5
- 238000013523 data management Methods 0.000 claims description 5
- 238000012550 audit Methods 0.000 claims description 4
- 238000009826 distribution Methods 0.000 claims description 4
- 230000003203 everyday effect Effects 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000007405 data analysis Methods 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 230000010354 integration Effects 0.000 claims description 3
- 238000012986 modification Methods 0.000 claims description 3
- 230000004048 modification Effects 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000008439 repair process Effects 0.000 claims description 3
- 238000012552 review Methods 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 238000013519 translation Methods 0.000 claims description 3
- 230000014616 translation Effects 0.000 claims description 3
- 230000003139 buffering effect Effects 0.000 claims description 2
- 230000011218 segmentation Effects 0.000 claims description 2
- 238000013500 data storage Methods 0.000 abstract description 3
- 238000013524 data verification Methods 0.000 abstract 1
- 241000208340 Araliaceae Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000010205 computational analysis Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 238000012804 iterative process Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000004080 punching Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/067—Enterprise or organisation modelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Theoretical Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Health & Medical Sciences (AREA)
- Marketing (AREA)
- General Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- Public Health (AREA)
- Primary Health Care (AREA)
- Water Supply & Treatment (AREA)
- Development Economics (AREA)
- Educational Administration (AREA)
- General Health & Medical Sciences (AREA)
- Game Theory and Decision Science (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a big data technology-based electric power fee controlling method and system so as to solve problems of low storage capability, low calculation performance and poor system stability of a conventional electric power fee controlling system in big data quantity conditions. The big data technology-based electric power fee controlling method and system specifically comprises the following steps: 1, a big quantity of data is written in, searched and updated via distributed storage technologies; 2, a distributed internal storage calculation engine is used for data storage, verification and calculation in a whole fee calculation process; 3, a distributed file system, clustering resource scheduling and big data clusters are used as a basic framework, and physical nodes of the system can be dynamically expanded and removed. The big data technology-based electric power fee controlling method and system can provide mass data storage capability and high performance data calculating and analyzing capability, horizontal expansion capability of the fee controlling system can be increased, hardware cost can be lowered, fault tolerating capability of the system can be improved, fee control calculation stability can be improved, and application of big data technologies to electric power fee control can be forcefully supported.
Description
Technical field:
The present invention relates to a kind of electricity expense control method and system based on big data technique, belong to power marketing technical field.
Background technology:
Electric Power Marketing System is the core application of power supply enterprise's information system management, it is necessary to ensure that the high-performance of system and highly reliable
Property.Take a control business important component part as Electric Power Marketing System, it is desirable to every day carries out table code to tens million of stoichiometric points
Data process and full dose the electricity electricity charge calculate, and require completed in 3 to 4 hours, its either data volume, calculate frequency also
It is that the requirement of calculated performance is all far beyond traditional power cost calculating function.And the data that conventional electric power expense prosecutor method is used
Storage and data computation schema, there is limitation in the process to mass data, shows as that storage efficiency is low, calculated performance is weak and meter
Calculate poor reliability, and then affect the stability of marketing system.
Summary of the invention:
It is an object of the invention to overcome the deficiency of above-mentioned prior art to provide the storage capacity of a kind of mass data and high property
Can data calculate and analysis ability, add the horizontal extension ability of expense Ore-controlling Role to reduce hardware cost, improve system
Fault-tolerance, enhances the stability that expense control calculates, the powerful support electricity expense of big data technique application in electricity expense control
Control method and system.
The purpose of the present invention can be reached by following measure: a kind of electricity expense Ore-controlling Role based on big data technique,
It is characterized in that it includes for data preparation, collects the original meter reading data of metering system and carry out the meter reading data pipe resolved
Reason module and gauge table code management module, also include carrying out based on data check, data by the gauge table code information carrying out collection
Calculate and filing and the table code processing module of the work of data analysis, measure and take computing module, amount expense profiling module, amount expense check module
Module is analyzed with remaining sum；
Described meter reading data management module is for collecting the basic data that expense control calculates, including Metrological archives table, electricity charge algorithm
Parameter list, stoichiometric point transformator relation table and be equally shared by all electricity price relation table, and utilize distributed storage technology by these
Data in table carry out extracting, convert, final result is stored in the distributed data base of expense Ore-controlling Role by subregion and verification；
Described gauge table code management module is responsible for receiving electric power metering system and is uploaded to the gauge table code file of ftp server,
File translations is become distributed tractable file format, by utilize Distributed Message Queue technology realize data buffering and
Storage, file content mainly includes power supply unit coding, stoichiometric point numbering, asset number, Customs Assigned Number, the date of checking meter, positive and negative
To active energy and forward and reverse capacity of idle power；
Described table code processing module is used for meter reading data and the association of gauge table code data and quality inspection, quality inspection content
Including mathematical logic error checking and business rule error checking, mathematical logic error checking includes field value format check, non-
Null field null value is checked, business rule error checking include the current period check meter time and last issue check meter time inspection, checked meter
Code and only code size inspection of checking meter, be marked for not verified data, is not involved in expense control and calculates；
Described amount is taken computing module and is used parallel form to be loaded by the result data of table code processing module, and utilization takes calculating
Algorithms library in module carries out electricity and calculates and the electricity charge calculate, and electricity calculates content and mainly includes copying and see electricity, change table electricity, move back
Benefit electricity, total score table electricity, definite proportion quantificational electric quantity, common block list are equally shared by all electricity, loss on transmission electricity and line loss electricity；The electricity charge calculate content
Including power cost, fund and the additional electricity charge, basic charge as per installed capacity and power factor adjustment charge；
Described amount expense profiling module mainly stores distributed memory system to the calculating process and result measuring expense computing module
In, take result for follow-up amount and show, measure expense check and amount expense tracing function service；Utilization takes the storage output of computing module
The mode that interface is unified, is saved in the result of calculation of different units appointment target by different way and (includes database table, daily record
File, control station), not only final result is stored, also to each pilot process of whole calculating process with the time
The mode of axle carries out record；
Described amount is taken check module and is utilized the amount expense configured to verify rule, and employing streaming computing technique is automatically to result of calculation
Verify, verify content and include verifying time started, verification time, task status and mission bit stream data；To checks of the records
In standard output and standard error time started, end time, task status can be filtered, locating query audit log
Information；The abnormal results's data checking module output through amount expense are marked, and write back Electric Power Marketing System and process；
Described remaining sum is analyzed module and is used the amount expense of distributed query technology account balance with every day to taking control user to calculate
Result is compared, and calculates the account balance information taking control user；Again by the alarm threshold comparison of balance amount information Yu configured in advance,
Arrearage warning information and arrearage early warning information write-back marketing system process the most at last.
A kind of electricity expense prosecutor method based on big data technique, it is characterised in that it comprises the following specific steps that:
Step one, algorithm and check rule configuration, before expense control calculating starts, inspection is checked and whether algorithmic rule has variation, if
Variation, does not carries out step 2, if it has, then need to be updated the computational algorithm used during expense control with checking rule
Or it is newly-increased；Its scope of examination mainly include table code check rule configuration, amount expense check rule configuration, electricity calculate algorithm configuration,
The electricity charge computational algorithm configuration and account balance alarm threshold value configure, will check rule and algorithmic rule configure complete laggard row next step；
Step 2, meter reading data initialize, and checking whether meter reading data has renewal, if not updating, carrying out step 3, if having more
Newly, the Back ground Information of Electric Power Marketing System is updated: first the underlying table content of Electric Power Marketing System is carried out data and take out
Take, the tables of data that renewal amount is little is used the mode of increment extraction, the tables of data that renewal amount is big is used the side of full dose extraction
Formula, the more more new data of extraction is carried out data conversion and subregion, make data adapt to distributed storage, finally store data into
Take in the distributed data base of Ore-controlling Role, carry out next step；
Step 3, gauge table code file transmit, and electric power metering system is uploaded to the gauge table code literary composition of ftp server by expense Ore-controlling Role
Part is put in big data distributed file system, and simply processes data file, enters the invalid information in file
Row is rejected；The file being transmitted is carried out state check, if mistake occurs in transmitting procedure, former by monitoring information inspection mistake
Cause, if the data transmission fails that hardware error reason causes, can recover the fault-tolerance of function guarantee fee Ore-controlling Role by caching；
If transmission success, perform next step；
The table code information that step 4, data integration, the meter reading data generating step 2 and step 3 generate carries out integrated, generates
The integrated file of table code；First with distributed file system, two parts data are read out, by contingency table information by two
Divided data carries out integrated, and is monitored integrating process by the output content of integrated daily record, if table code integrating process occurs
Mistake, then return step 2 and step 3 and the data logging updated checked and adjusted, if the integrated file generated of table code becomes
Merit, then carry out next step；
Step 5, table code are checked, and use Distributed Message Queue technology, and the integrated file of table code producing step 4 utilizes step
The table code of one configuration is checked rule and is checked, if there being data not by checking, user selects not by checking data
Process, if there being the data that substantially can repair this manually or to modify by regular fashion, if really belonging to not conform to advise data, can
With select do not process, then system will to such do not conform to advise data be marked process, be not involved in expense control calculating；Table code checks knot
Shu Hou, carries out next step；
Step 6, data load, and are loaded step 5 by the table yardage parallel form according to this checked, loading content bag
Include electricity price, metering, subscriber data and modification information, and the expense control algorithmic rule that the data of loading configure according to step one is converted
Become corresponding data structure；After data have loaded, carry out next step；
Step 7, electricity calculate, and calculate algorithmic rule according to the electricity of step one configuration, see electricity to copying, change table electricity, free
Electricity, move back benefit electricity, total score table electricity, loss on transmission electricity, line loss electricity, definite proportion quantificational electric quantity, common block list are equally shared by all electricity and are counted
Calculate；Electricity carries out next step after calculating；
Step 8, the electricity charge calculate, and according to electricity result of calculation, carry out electricity charge meter according to the electricity charge computational algorithm of step one configuration
Calculate, calculating content is power cost, fund and additional cost, basic charge as per installed capacity, power factor adjustment charge, system by data stream by terms of
Calculating unit is that unit segmentation forms elasticity distribution formula calculating task, calculating task is sent on each node of cluster, finally
The mode of batch processing completes the task of each computing unit in a distributed manner；The electricity charge carry out next step after calculating；
Step 9, amount take filing；Take the distributed memory system in Ore-controlling Role by each algorithm list in step 7 and step 8
The output of unit stores, and according to user's requirement, leaves in database table, journal file and control station respectively, with reserve capacity
Take all pilot processs calculated, and connected by time shaft mode；Meanwhile, final by step 8 and step 9 of Ore-controlling Role is taken
Result of calculation is shown, the data abnormal to result of calculation, and user can be checked by calculating process, reviews what result generated
Process, and can modify, system can record the amendment record of result equally；After amount takes filing, carry out next step；
Step 10, amount take check, and the amount expense utilizing step one to configure is checked rule and verified result, and synchronous recording is verified
Daily record, log content includes time started, verification time, task status and mission bit stream；User utilizes the distributed of system to look into
Ask function to carry out these information filtering inquiry；Data by checking will be stored and distribute by system, and carry out next
Step, to number of non-compliances according to being marked, write-back marketing system processes；
Step 11, remaining sum analysis, system utilizes distributed query to extract accounts information and the balance amount information of expense control user, with step
Rapid ten carry out mathematic interpolation by the result of calculation of verification, and the account balance alarm threshold value utilizing step one to configure compares, right
The minus user of remaining sum carries out arrearage warning, less than account balance alarm threshold value and the user not less than zero, remaining sum is carried out arrearage pre-
Alert, and will report to the police and early warning information write-back Electric Power Marketing System.
The present invention can produce following good effect compared with the prior art: the present invention solves solution tradition expense prosecutor method and exists
The storage capacity that table code data acquisition, amount take calculating, amount expense is verified, remaining sum analytic function aspect exists is weak, calculated performance is weak,
The problem of system stability difference, it has:
1. utilize Distributed Storage and inquiring technology, it is provided that the storage platform of magnanimity information, it is achieved gauge table code data
Large-scale distributed high speed writein, inquire about and update, and make data storage can protect under the ever-increasing premise of data volume
Hold query performance the most constant, improve the data service capabilities of system.
2., by distributed memory computing engines and immediate processing mode, make iterative process efficiency be improved,
Thus provide high performance computing capability, and make system can also keep splendid System Error-tolerance Property in the case of low latency,
Reach quickly to realize the storage of table code, check and the requirement of electricity electricity charge supercomputing.
3. use distributed file system, cluster resource management and dispatching framework and large data sets gang fight structure, make system have
Standby extended capability well, promotes resource overall utilization rate, reduces hardware cost, provide simultaneously data redundancy backup,
The automatic load balancing of server and failed server detection function, it is ensured that the system fault-tolerance to data, prevent because firmly
Part is made mistakes the loss of data that reason causes, and substantially increases the stability of system and then reduces the risk of system.
Accompanying drawing illustrates:
Fig. 1 is the structural representation of the electricity expense Ore-controlling Role based on big data technique of the present invention；
Fig. 2 is the electricity expense control method flow diagram based on big data technique of the present invention.
Detailed description of the invention:
Below in conjunction with the accompanying drawings the detailed description of the invention of the present invention is described in detail.
Embodiment: a kind of electricity expense Ore-controlling Role (seeing Fig. 1) based on big data technique, it includes and electric power metering system
The meter reading data management module, the gauge table code that are connected manage module, and the two module prepares for data, collects metering system
Original meter reading data also resolves, and this system also includes that table code processing module, amount take computing module, amount expense profiling module, amount
Taking check module and remaining sum analyzes module, these five modules are carried out based on data check, data by the table code information carrying out collection
Calculate and filing and the work of data analysis.
Meter reading data management module is for collecting the basic data that expense control calculates, including Metrological archives table, electricity charge algorithm ginseng
Count table, stoichiometric point transformator relation table and be equally shared by all electricity price relation table, and utilizing distributed storage technology by these tables
In data carry out extracting, convert, final result is stored in the distributed data base of expense Ore-controlling Role by subregion and verification.
Described gauge table code management module is responsible for receiving electric power metering system and is uploaded to the gauge table code literary composition of ftp server
Part, becomes distributed tractable file format by file translations, by utilizing Distributed Message Queue technology to realize the slow of data
Punching and storage, file content mainly include power supply unit coding, stoichiometric point numbering, asset number, Customs Assigned Number, the date of checking meter,
Forward and reverse active energy and forward and reverse capacity of idle power；
Table code processing module is used for meter reading data and the association of gauge table code data and quality inspection, and quality inspection content includes number
According to logical error inspection and business rule error checking, mathematical logic error checking includes field value format check, non-NULL field
Null value is checked, business rule error checking include the current period check meter time and last issue check meter time inspection, check meter minimum with copy
Table stops the inspection of code size, is marked for not verified data, is not involved in expense control and calculates.
Amount is taken computing module and is used parallel form to be loaded by the result data of table code processing module, and utilization takes calculating mould
Algorithms library in block carries out electricity and calculates and the electricity charge calculate, and electricity calculates content and mainly includes copying and see electricity, change table electricity, move back benefit
Electricity, total score table electricity, definite proportion quantificational electric quantity, common block list are equally shared by all electricity, loss on transmission electricity and line loss electricity；The electricity charge calculate content bag
Include power cost, fund and the additional electricity charge, basic charge as per installed capacity and power factor adjustment charge.Table code processing module and amount take calculating mould
Block all have employed distributed memory computing engines, is several subtasks by calculating task at internal breakup, these subtasks it
Between by logical relation or run the factor such as sequencing and be built into DAG(directed acyclic graph) structure.
The calculating process and result measuring expense computing module is mainly stored in distributed memory system by amount expense profiling module,
Take result for follow-up amount to show, measure expense check and amount expense tracing function service.The storage output of utilization expense computing module connects
The mode that mouth is unified, is saved in the result of calculation of different units appointment target by different way and (includes database table, daily record literary composition
Part, control station), not only final result is stored, also to each pilot process of whole calculating process with time shaft
Mode carry out record.
Amount is taken check module and is utilized the amount expense configured to verify rule, and result of calculation is entered by employing streaming computing technique automatically
Row is verified, and verifies content and includes verifying time started, verification time, task status and mission bit stream data.To in checks of the records
Standard output and standard error time started, end time, task status can be filtered, locating query audit log believe
Breath.The abnormal results's data checking module output through amount expense are marked, and write back Electric Power Marketing System and process.
Remaining sum is analyzed module and is used the amount expense of distributed query technology account balance with every day to taking control user to calculate knot
Fruit is compared, and calculates the account balance information taking control user.Again by the alarm threshold comparison of balance amount information Yu configured in advance,
Arrearage warning information and arrearage early warning information write-back marketing system process at last.
A kind of electricity expense prosecutor method (seeing Fig. 2) based on big data technique, metering system is by gauge table code files passe
To ftp server and to taking Ore-controlling Role transmission message, trigger and take control evaluation work, the system meter reading data to Electric Power Marketing System
Verify after merging with the gauge table code file association of electric power metering system, by pre-configured calculating, verify rule
Carry out electricity to calculate and electricity charge calculating, and calculating process and result of calculation are carried out filing process, amount expense result is checked
Afterwards user balance is carried out computational analysis, and by check result and remaining sum analysis result write-back Electric Power Marketing System.It include as
Lower concrete steps: step one, algorithm and check rule configuration, before expense control calculating starts, inspection is checked and whether algorithmic rule has
Variation, if not variation, carries out step 2, if it has, then need the computational algorithm used during expense control and check rule
It is updated or newly-increased；Its scope of examination mainly includes that table code checks rule configuration, amount expense checks rule configuration, electricity calculates and calculates
Method configuration, the configuration of electricity charge computational algorithm and the configuration of account balance alarm threshold value, will check rule and algorithmic rule configures complete laggard row
Next step.
Step 2, meter reading data initialize, and checking whether meter reading data has renewal, if not updating, carrying out step 3, if
There is renewal, the Back ground Information of Electric Power Marketing System is updated: first by the underlying table content number of Electric Power Marketing System
According to extraction, the tables of data that renewal amount is little is used the mode of increment extraction, the tables of data that renewal amount is big is used full dose extraction
Mode, then to extraction more new data carry out data conversion and subregion, make data adapt to distributed storage, data are deposited the most at last
Store up in the distributed data base taking Ore-controlling Role, carry out next step.
Step 3, gauge table code file transmit, and electric power metering system is uploaded to the gauge table of ftp server by expense Ore-controlling Role
Code file is put in big data distributed file system, and simply processes data file, to the invalid letter in file
Breath is rejected.The file being transmitted is carried out state check, if mistake occurs in transmitting procedure, wrong by monitoring information inspection
Reason by mistake, if the data transmission fails that hardware error reason causes, can recover the appearance of function guarantee fee Ore-controlling Role by caching
Mistake.If transmission success, perform next step.
The table code information that step 4, data integration, the meter reading data generating step 2 and step 3 generate carries out integrated,
Generate the integrated file of table code.First with distributed file system, two parts data are read out, will by contingency table information
Two parts data carry out integrated, and are monitored integrating process by the output content of integrated daily record, if table code integrating process
Mistake occurs, then returns step 2 and step 3 and the data logging updated is checked and adjusted, if the integrated file of table code is raw
Successfully, then next step is carried out.
Step 5, table code are checked, and use Distributed Message Queue technology, and the integrated file of table code producing step 4 utilizes
The table code of step one configuration is checked rule and is checked, if there being data not by checking, user selects not passing through check figure
According to process, if there being the data that substantially can repair this manually or to modify by regular fashion, if really belonging to not conform to advises data
Then can select not process, then system will to such do not conform to advise data be marked process, be not involved in expense control calculating；Table code school
After core terminates, carry out next step.
Step 6, data load, and are loaded step 5 by the table yardage parallel form according to this checked, in loading
Hold and include electricity price, metering, subscriber data and modification information, and the expense control algorithmic rule data of loading configured according to step one
Change into the data structure of correspondence.After data have loaded, carry out next step.
Step 7, electricity calculate, according to step one configuration electricity calculate algorithmic rule, to copy see electricity, change table electricity,
Free electricity, move back benefit electricity, total score table electricity, loss on transmission electricity, line loss electricity, definite proportion quantificational electric quantity, common block list are equally shared by all electricity and are entered
Row calculates and (as a example by current rule, adds up to electricity=copy to see electricity+change table electricity-free electricity+move back benefit electricity-point table electricity
+ loss on transmission electricity+line loss electricity-definite proportion quantificational electric quantity+share electricity)；Electricity carries out next step after calculating.
Step 8, the electricity charge calculate, and according to electricity result of calculation, carry out the electricity charge according to the electricity charge computational algorithm of step one configuration
Calculating, calculating content is that power cost, fund and additional cost, basic charge as per installed capacity, power factor adjustment charge (are with current rule
Example, adds up to the electricity charge=power cost+fund and additional cost+basic charge as per installed capacity+power factor adjustment charge+projects to move back benefit electricity
Take), data stream is split formation elasticity distribution formula in units of computing unit and is calculated task by system, and calculating task is sent to collection
On each node of group, the mode of batch processing completes the task of each computing unit the most in a distributed manner.After the electricity charge calculate
Carry out next step.
Step 9, amount take filing.Take the distributed memory system in Ore-controlling Role by step 7 and step 8, each is calculated
The output of method unit stores, and according to user's requirement, leaves in database table, journal file and control station respectively, to protect
Storage takes all pilot processs calculated, and is connected by time shaft mode.Meanwhile, Ore-controlling Role is taken by step 8 and step 9
Final calculation result is shown, the data abnormal to result of calculation, and user can be checked by calculating process, reviews result raw
The process become, and can modify, system can record the amendment record of result equally.After amount takes filing, carry out next step.
Step 10, amount take check, and the amount expense utilizing step one to configure is checked rule and verified result, and synchronous recording
Audit log, log content includes time started, verification time, task status and mission bit stream.User utilizes the distribution of system
These information are carried out filtering inquiry by formula query function.Data by checking will be stored and distribute by system, and carry out
Next step, to number of non-compliances according to being marked, write-back marketing system processes.
Step 11, remaining sum analysis, system utilizes distributed query to extract accounts information and the balance amount information of expense control user,
Carry out mathematic interpolation with step 10 by the result of calculation of verification, and the account balance alarm threshold value utilizing step one to configure compares
Relatively, user minus to remaining sum carries out arrearage warning, carries out remaining sum less than account balance alarm threshold value and the user not less than zero
Arrearage early warning, and will report to the police and early warning information write-back Electric Power Marketing System.
The above-described preferred embodiments being only the present invention, it is impossible to limit the interest field of the present invention with this.
Claims (2)
1. an electricity expense Ore-controlling Role based on big data technique, it is characterised in that it includes preparing for data, collecting metering
The original meter reading data of system also carries out meter reading data management module and the gauge table code management module resolved, and also includes for right
Collect the table code that the gauge table code information come carries out data check, data calculate with filing and the work of data analysis and process mould
Block, amount takes computing module, amount expense profiling module, amount expense checks module and remaining sum analyzes module；
Described meter reading data management module is for collecting the basic data that expense control calculates, including Metrological archives table, electricity charge algorithm
Parameter list, stoichiometric point transformator relation table and be equally shared by all electricity price relation table, and utilize distributed storage technology by these
Data in table carry out extracting, convert, final result is stored in the distributed data base of expense Ore-controlling Role by subregion and verification；
Described gauge table code management module is responsible for receiving electric power metering system and is uploaded to the gauge table code file of ftp server,
File translations is become distributed tractable file format, by utilize Distributed Message Queue technology realize data buffering and
Storage, file content mainly includes power supply unit coding, stoichiometric point numbering, asset number, Customs Assigned Number, the date of checking meter, positive and negative
To active energy and forward and reverse capacity of idle power；
Described table code processing module is used for meter reading data and the association of gauge table code data and quality inspection, quality inspection content
Including mathematical logic error checking and business rule error checking, mathematical logic error checking includes field value format check, non-
Null field null value is checked, business rule error checking include the current period check meter time and last issue check meter time inspection, checked meter
Code and only code size inspection of checking meter, be marked for not verified data, is not involved in expense control and calculates；
Described amount is taken computing module and is used parallel form to be loaded by the result data of table code processing module, and utilization takes calculating
Algorithms library in module carries out electricity and calculates and the electricity charge calculate, and electricity calculates content and mainly includes copying and see electricity, change table electricity, move back
Benefit electricity, total score table electricity, definite proportion quantificational electric quantity, common block list are equally shared by all electricity, loss on transmission electricity and line loss electricity；The electricity charge calculate content
Including power cost, fund and the additional electricity charge, basic charge as per installed capacity and power factor adjustment charge；
Described amount expense profiling module mainly stores distributed memory system to the calculating process and result measuring expense computing module
In, take result for follow-up amount and show, measure expense check and amount expense tracing function service；Utilization takes the storage output of computing module
The mode that interface is unified, is saved in the result of calculation of different units appointment target by different way and (includes database table, daily record
File, control station), not only final result is stored, also to each pilot process of whole calculating process with the time
The mode of axle carries out record；
Described amount is taken check module and is utilized the amount expense configured to verify rule, and employing streaming computing technique is automatically to result of calculation
Verify, verify content and include verifying time started, verification time, task status and mission bit stream data；To checks of the records
In standard output and standard error time started, end time, task status can be filtered, locating query audit log
Information；The abnormal results's data checking module output through amount expense are marked, and write back Electric Power Marketing System and process；
Described remaining sum is analyzed module and is used the amount expense of distributed query technology account balance with every day to taking control user to calculate
Result is compared, and calculates the account balance information taking control user；Again by the alarm threshold comparison of balance amount information Yu configured in advance,
Arrearage warning information and arrearage early warning information write-back marketing system process the most at last.
2. an electricity expense prosecutor method based on big data technique, it is characterised in that it comprises the following specific steps that:
Step one, algorithm and check rule configuration, before expense control calculating starts, inspection is checked and whether algorithmic rule has variation, if
Variation, does not carries out step 2, if it has, then need to be updated the computational algorithm used during expense control with checking rule
Or it is newly-increased；Its scope of examination mainly include table code check rule configuration, amount expense check rule configuration, electricity calculate algorithm configuration,
The electricity charge computational algorithm configuration and account balance alarm threshold value configure, will check rule and algorithmic rule configure complete laggard row next step；
Step 2, meter reading data initialize, and checking whether meter reading data has renewal, if not updating, carrying out step 3, if having more
Newly, the Back ground Information of Electric Power Marketing System is updated: first the underlying table content of Electric Power Marketing System is carried out data and take out
Take, the tables of data that renewal amount is little is used the mode of increment extraction, the tables of data that renewal amount is big is used the side of full dose extraction
Formula, the more more new data of extraction is carried out data conversion and subregion, make data adapt to distributed storage, finally store data into
Take in the distributed data base of Ore-controlling Role, carry out next step；
Step 3, gauge table code file transmit, and electric power metering system is uploaded to the gauge table code literary composition of ftp server by expense Ore-controlling Role
Part is put in big data distributed file system, and simply processes data file, enters the invalid information in file
Row is rejected；The file being transmitted is carried out state check, if mistake occurs in transmitting procedure, former by monitoring information inspection mistake
Cause, if the data transmission fails that hardware error reason causes, can recover the fault-tolerance of function guarantee fee Ore-controlling Role by caching；
If transmission success, perform next step；
The table code information that step 4, data integration, the meter reading data generating step 2 and step 3 generate carries out integrated, generates
The integrated file of table code；First with distributed file system, two parts data are read out, by contingency table information by two
Divided data carries out integrated, and is monitored integrating process by the output content of integrated daily record, if table code integrating process occurs
Mistake, then return step 2 and step 3 and the data logging updated checked and adjusted, if the integrated file generated of table code becomes
Merit, then carry out next step；
Step 5, table code are checked, and use Distributed Message Queue technology, and the integrated file of table code producing step 4 utilizes step
The table code of one configuration is checked rule and is checked, if there being data not by checking, user selects not by checking data
Process, if there being the data that substantially can repair this manually or to modify by regular fashion, if really belonging to not conform to advise data, can
With select do not process, then system will to such do not conform to advise data be marked process, be not involved in expense control calculating；Table code checks knot
Shu Hou, carries out next step；
Step 6, data load, and are loaded step 5 by the table yardage parallel form according to this checked, loading content bag
Include electricity price, metering, subscriber data and modification information, and the expense control algorithmic rule that the data of loading configure according to step one is converted
Become corresponding data structure；After data have loaded, carry out next step；
Step 7, electricity calculate, and calculate algorithmic rule according to the electricity of step one configuration, see electricity to copying, change table electricity, free
Electricity, move back benefit electricity, total score table electricity, loss on transmission electricity, line loss electricity, definite proportion quantificational electric quantity, common block list are equally shared by all electricity and are counted
Calculate；Electricity carries out next step after calculating；
Step 8, the electricity charge calculate, and according to electricity result of calculation, carry out electricity charge meter according to the electricity charge computational algorithm of step one configuration
Calculate, calculating content is power cost, fund and additional cost, basic charge as per installed capacity, power factor adjustment charge, system by data stream by terms of
Calculating unit is that unit segmentation forms elasticity distribution formula calculating task, calculating task is sent on each node of cluster, finally
The mode of batch processing completes the task of each computing unit in a distributed manner；The electricity charge carry out next step after calculating；
Step 9, amount take filing；Take the distributed memory system in Ore-controlling Role by each algorithm list in step 7 and step 8
The output of unit stores, and according to user's requirement, leaves in database table, journal file and control station respectively, with reserve capacity
Take all pilot processs calculated, and connected by time shaft mode；Meanwhile, final by step 8 and step 9 of Ore-controlling Role is taken
Result of calculation is shown, the data abnormal to result of calculation, and user can be checked by calculating process, reviews what result generated
Process, and can modify, system can record the amendment record of result equally；After amount takes filing, carry out next step；
Step 10, amount take check, and the amount expense utilizing step one to configure is checked rule and verified result, and synchronous recording is verified
Daily record, log content includes time started, verification time, task status and mission bit stream；User utilizes the distributed of system to look into
Ask function to carry out these information filtering inquiry；Data by checking will be stored and distribute by system, and carry out next
Step, to number of non-compliances according to being marked, write-back marketing system processes；
Step 11, remaining sum analysis, system utilizes distributed query to extract accounts information and the balance amount information of expense control user, with step
Rapid ten carry out mathematic interpolation by the result of calculation of verification, and the account balance alarm threshold value utilizing step one to configure compares, right
The minus user of remaining sum carries out arrearage warning, less than account balance alarm threshold value and the user not less than zero, remaining sum is carried out arrearage pre-
Alert, and will report to the police and early warning information write-back Electric Power Marketing System.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610639968.8A CN106327055B (en) | 2016-08-08 | 2016-08-08 | A kind of electricity expense control method and system based on big data technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610639968.8A CN106327055B (en) | 2016-08-08 | 2016-08-08 | A kind of electricity expense control method and system based on big data technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106327055A true CN106327055A (en) | 2017-01-11 |
| CN106327055B CN106327055B (en) | 2019-10-11 |
Family
ID=57740719
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610639968.8A Active CN106327055B (en) | 2016-08-08 | 2016-08-08 | A kind of electricity expense control method and system based on big data technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106327055B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107729369A (en) * | 2017-09-11 | 2018-02-23 | 新奥泛能网络科技股份有限公司 | The storage method and device of sales rate of electricity data |
| CN107742192A (en) * | 2017-11-22 | 2018-02-27 | 国网江西省电力有限公司电力科学研究院 | A kind of distributed power marketing strategy method and system based on big data |
| CN109508971A (en) * | 2018-11-27 | 2019-03-22 | 北京煜邦电力技术股份有限公司 | A kind of electricity charge calculation method, apparatus, equipment and storage medium |
| CN109871720A (en) * | 2019-03-27 | 2019-06-11 | 贵阳博烁科技有限公司 | A kind of outdoor scene meter reading behavior management system |
| CN110033394A (en) * | 2019-04-22 | 2019-07-19 | 南方电网科学研究院有限责任公司 | Compliance verifies the remote bill control system and method for remote bill control ammeter power failure instruction |
| CN110135824A (en) * | 2019-05-15 | 2019-08-16 | 中国联合网络通信集团有限公司 | Telephone expenses pay on behalf method and apparatus |
| CN111241143A (en) * | 2020-01-09 | 2020-06-05 | 湖南华博信息技术有限公司 | Distributed calculation method and system for water supply amount and water fee |
| CN111480154A (en) * | 2017-11-27 | 2020-07-31 | 斯诺弗雷克公司 | Batch data ingestion in database systems |
| CN112258175A (en) * | 2020-09-04 | 2021-01-22 | 国网浙江省电力有限公司 | Cloud platform-based electric power market electric charge settlement data supervision platform and use method thereof |
| CN112330320A (en) * | 2020-11-09 | 2021-02-05 | 烟台海颐软件股份有限公司 | Distributed computing-based automatic processing system and method for electricity charge copying and checking service |
| CN112381583A (en) * | 2020-11-19 | 2021-02-19 | 深圳供电局有限公司 | Power consumption calculation method and device based on distributed memory calculation technology |
| CN112598414A (en) * | 2020-12-09 | 2021-04-02 | 北京中电普华信息技术有限公司 | Electric power marketing charging method and electric power marketing charging engine |
| CN113342882A (en) * | 2021-05-21 | 2021-09-03 | 贵州电网有限责任公司 | Intelligent checking system for protecting constant value granulation under big data |
| CN116128542A (en) * | 2022-12-13 | 2023-05-16 | 国网山东省电力公司营销服务中心(计量中心) | Method and system for checking electricity fee line of electricity purchasing side |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104063756A (en) * | 2014-05-23 | 2014-09-24 | 国网辽宁省电力有限公司本溪供电公司 | Electric power utilization information remote control system |
| CN104376647A (en) * | 2014-11-04 | 2015-02-25 | 国家电网公司 | Real-time charging system used for electric power |
-
2016
- 2016-08-08 CN CN201610639968.8A patent/CN106327055B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104063756A (en) * | 2014-05-23 | 2014-09-24 | 国网辽宁省电力有限公司本溪供电公司 | Electric power utilization information remote control system |
| CN104376647A (en) * | 2014-11-04 | 2015-02-25 | 国家电网公司 | Real-time charging system used for electric power |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107729369A (en) * | 2017-09-11 | 2018-02-23 | 新奥泛能网络科技股份有限公司 | The storage method and device of sales rate of electricity data |
| CN107742192A (en) * | 2017-11-22 | 2018-02-27 | 国网江西省电力有限公司电力科学研究院 | A kind of distributed power marketing strategy method and system based on big data |
| CN111480154B (en) * | 2017-11-27 | 2022-02-11 | 斯诺弗雷克公司 | Method, system, and medium for batch data ingestion |
| CN111480154A (en) * | 2017-11-27 | 2020-07-31 | 斯诺弗雷克公司 | Batch data ingestion in database systems |
| US11294890B2 (en) | 2017-11-27 | 2022-04-05 | Snowflake Inc. | Batch data ingestion in database systems |
| CN109508971A (en) * | 2018-11-27 | 2019-03-22 | 北京煜邦电力技术股份有限公司 | A kind of electricity charge calculation method, apparatus, equipment and storage medium |
| CN109871720A (en) * | 2019-03-27 | 2019-06-11 | 贵阳博烁科技有限公司 | A kind of outdoor scene meter reading behavior management system |
| CN109871720B (en) * | 2019-03-27 | 2022-04-08 | 贵阳博烁科技有限公司 | Live-action meter reading behavior management system |
| CN110033394A (en) * | 2019-04-22 | 2019-07-19 | 南方电网科学研究院有限责任公司 | Compliance verifies the remote bill control system and method for remote bill control ammeter power failure instruction |
| CN110135824A (en) * | 2019-05-15 | 2019-08-16 | 中国联合网络通信集团有限公司 | Telephone expenses pay on behalf method and apparatus |
| CN111241143A (en) * | 2020-01-09 | 2020-06-05 | 湖南华博信息技术有限公司 | Distributed calculation method and system for water supply amount and water fee |
| CN112258175A (en) * | 2020-09-04 | 2021-01-22 | 国网浙江省电力有限公司 | Cloud platform-based electric power market electric charge settlement data supervision platform and use method thereof |
| CN112330320A (en) * | 2020-11-09 | 2021-02-05 | 烟台海颐软件股份有限公司 | Distributed computing-based automatic processing system and method for electricity charge copying and checking service |
| CN112381583A (en) * | 2020-11-19 | 2021-02-19 | 深圳供电局有限公司 | Power consumption calculation method and device based on distributed memory calculation technology |
| CN112598414A (en) * | 2020-12-09 | 2021-04-02 | 北京中电普华信息技术有限公司 | Electric power marketing charging method and electric power marketing charging engine |
| CN113342882A (en) * | 2021-05-21 | 2021-09-03 | 贵州电网有限责任公司 | Intelligent checking system for protecting constant value granulation under big data |
| CN116128542A (en) * | 2022-12-13 | 2023-05-16 | 国网山东省电力公司营销服务中心(计量中心) | Method and system for checking electricity fee line of electricity purchasing side |
| CN116128542B (en) * | 2022-12-13 | 2024-04-19 | 国网山东省电力公司营销服务中心(计量中心) | Method and system for checking electricity fee line of electricity purchasing side |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106327055B (en) | 2019-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106327055A (en) | Big data technology-based electric power fee controlling method and system | |
| WO2021135177A1 (en) | Construction method and apparatus for energy data warehouse system | |
| US9273983B2 (en) | System and method of high volume import, validation and estimation of meter data | |
| CN104317800A (en) | Hybrid storage system and method for mass intelligent power utilization data | |
| CN104811344A (en) | Network dynamic service monitoring method and apparatus | |
| CN103955510A (en) | Massive electricity marketing data integration method uploaded by ETL cloud platform | |
| CN112632127B (en) | Data processing method for real-time data acquisition and time sequence of equipment operation | |
| CN113129063B (en) | Electric charge calculation issuing method and system based on cloud platform and data center platform | |
| CN112907203B (en) | Salary calculation system based on block chain | |
| CN114880405A (en) | Data lake-based data processing method and system | |
| CN112181967B (en) | Method, device, computer equipment and medium for monitoring quality of source data | |
| CN112688428A (en) | 10kV power grid synchronous line loss treatment method based on Internet of things technology | |
| CN111159154A (en) | Energy data warehouse system | |
| CN111984677B (en) | Resource data checking method, device, computer equipment and storage medium | |
| WO2024056050A1 (en) | Massive flexible load rapid aggregation control method and apparatus | |
| CN111680083B (en) | Intelligent multi-level government financial data acquisition system and data acquisition method | |
| CN111552686A (en) | Power data quality assessment method and device | |
| CN111127186A (en) | Application method of customer credit rating evaluation system based on big data technology | |
| CN115455106B (en) | Power distribution monitoring method, service platform, equipment and storage medium for power distribution operation and maintenance | |
| CN109542914A (en) | The big data analysis and processing platform of air-quality monitoring system | |
| CN115618825A (en) | Financial statement merging method and device, computer readable medium and terminal equipment | |
| CN112395343B (en) | DSG-based field change data acquisition and extraction method | |
| CN110597899B (en) | Project expense management method and system | |
| CN113297146A (en) | Processing model and method for local supervision submission data | |
| CN105205168A (en) | Exposure system based on Redis database and operation method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |