CN203084729U - Power quality monitoring system based on distributed infrastructure (Hadoop) - Google Patents
Power quality monitoring system based on distributed infrastructure (Hadoop) Download PDFInfo
- Publication number
- CN203084729U CN203084729U CN2013200063016U CN201320006301U CN203084729U CN 203084729 U CN203084729 U CN 203084729U CN 2013200063016 U CN2013200063016 U CN 2013200063016U CN 201320006301 U CN201320006301 U CN 201320006301U CN 203084729 U CN203084729 U CN 203084729U
- Authority
- CN
- China
- Prior art keywords
- management server
- server
- cluster
- data
- power quality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Remote Monitoring And Control Of Power-Distribution Networks (AREA)
Abstract
The utility model provides a power quality monitoring system based on a distributed infrastructure (Hadoop). The system comprises a plurality of electric energy monitoring devices, a communication server, a task management server and a distributed computing server cluster, wherein a non-relational database cluster is built in the distributed computing server cluster. The plurality of electric energy monitoring devices are connected with the communication server, the communication server is connected with the task management server through a network, and the task management server is connected with the distributed computing server cluster through the network. According to the power quality monitoring system based on the distributed infrastructure (Hadoop), the problem that storage efficiency and computational efficiency of a traditional power quality monitoring system drop rapidly along with adding of monitoring points is solved, mass storage and parallel computing of power quality monitoring data are achieved due to the face that mass monitoring data are stored in a non-relational database, dynamic capacity expansion of the database is achieved through node dynamic extension, and calculated performance of power quality indicators is improved through parallel computing in a mass data environment.
Description
Technical field
The utility model belongs to electric power quality, computer software engineering and database technical field, particularly a kind of electric energy quality monitoring system based on distributed architecture (Hadoop); Realized electric energy quality monitoring data mass memory and parallel computation by non-relational database (HBase) storage magnanimity Monitoring Data.
Background technology
At present, the deep variation taking place in the power supply type of electric system and characteristic, electric network composition and load structure, and along with the development of new high-tech industry, the susceptibility load in the electrical network is more and more in addition, and the electric system problem also becomes and becomes increasingly complex.The quality problems of electric energy have become the subject matter in the operation of power networks.Quality of power supply on-line monitoring also becomes the important means that ensures safe operation of power system day by day.
Existing Electric Power Quality On-line Monitor System all adopts the persistence that realizes Monitoring Data based on the mode of relevant database, and monitoring data analysis, index calculating and statistics etc. all dependence database are carried out.And relational database exists many shortcomings to the processing of mass data: 1. the growth efficient along with the record number sharply descends; 2. fault tolerant mechanism has limited the extended capability of database.Just because of the inherent shortcoming of relational database, there are many difficulties based on storage, analysis and the statistics of the electric energy quality monitoring data of relational database, the analysis and the statistics that relate to the magnanimity Monitoring Data statistical indicator of big data quantity also are difficult to realize.The special mass data of bringing for the quick increase of monitoring point more is difficult to handle.
The utility model content
The purpose of this utility model provides a kind of electric energy quality monitoring system based on distributed architecture (Hadoop), has realized electric energy quality monitoring data mass memory and parallel computation by database (HBase) storage magnanimity Monitoring Data.
To achieve these goals, the technical solution of the utility model is: a kind of electric energy quality monitoring system based on distributed architecture (Hadoop), comprise a plurality of Power Quality Monitor Device, the communication server, wherein, described system also comprises the task management server, have the Distributed Calculation processing server cluster of non-relational database cluster (HBase), and the relation data management server and the quality of power supply and the network management server that comprise a plurality of administration modules that comprise multiple database access module and import tool, described a plurality of Power Quality Monitor Device connect the communication servers; The described communication server connects the task management server by network; Described task management server connects Distributed Calculation processing server cluster, described Distributed Calculation processing server cluster annexation data management server and the quality of power supply and network management server by network.
Further, described Distributed Calculation processing server cluster is provided with cloud Processing Interface (HBase Master) and multinode Processing Interface (HBase Reion) at non-relational database cluster; Described cloud Processing Interface connects task management server and relation data management server, and described multinode Processing Interface connects the quality of power supply and network management server.
The beneficial effects of the utility model are: the utility model has overcome storage efficiency and the rapid problem that descends of counting yield that traditional electric energy quality monitoring system brings along with the increase of monitoring point, realized electric energy quality monitoring data mass memory and parallel computation by (HBase) database storing magnanimity Monitoring Data, and the dynamic capacity-expanding by node dynamic expansion fulfillment database and under the mass data environment, improve the calculated performance of power quality index by parallel computation.
Description of drawings
Fig. 1 is a connection diagram of the present utility model.
1 is Power Quality Monitor Device, the 2nd among the figure, and the communication server, the 3rd, task management server, the 4th, Distributed Calculation processing server cluster, 4-1 are that non-relational database cluster, 4-2 are that cloud Processing Interface, 4-3 are multinode Processing Interface, the 5th, relation data management server, the 6th, the quality of power supply and network management server.
Embodiment
Present embodiment provides a kind of electric energy quality monitoring system based on distributed architecture (Hadoop), comprise a plurality of Power Quality Monitor Device, the communication server, wherein, described system also comprises the task management server, has the Distributed Calculation processing server cluster of non-relational database cluster (HBase) and comprises the relation data management server of multiple database access module and import tool and comprise the quality of power supply and the network management server of a plurality of administration modules, and described some Power Quality Monitor Device connect some communication servers; Described a plurality of communication server connects the task management server by network; Described task management server connects Distributed Calculation processing server cluster, described Distributed Calculation processing server cluster annexation data management server and the quality of power supply and network management server by network.
Among the embodiment, described Distributed Calculation processing server cluster is provided with cloud Processing Interface (HBase Master) and multinode Processing Interface (HBase Reion) at non-relational database cluster; Described cloud Processing Interface connects task management server and relation data management server, and described multinode Processing Interface connects the quality of power supply and network management server.
Equipment for monitoring power quality 1 will be monitored parameters such as handling the resulting all kinds of power quality indexs in back, voltage, electric current, power and be encoded according to the IEC61850 standard; Result after monitoring device will be encoded is uploaded to the quality of power supply communication server 2 by network.The communication server 2 is provided with the client modules of communication module, stipulations parsing module and HBase cluster.Trigger data is sent to incident when communication module receives the packet of equipment for monitoring power quality transmission, call the stipulations parsing module by task management server 3 and parse all kinds of electric energy quality monitoring indexs according to IEC 61850 data stipulations, from Distributed Calculation processing server cluster 4, call the HBase cluster client terminal by management server 3 then analysis result is write non-relational database cluster 4-1 by cloud Processing Interface 4-2, the cloud Processing Interface is called in the relation data of relation data management server 5 simultaneously, calls a plurality of data management modules on the network by multinode Processing Interface 4-3 by the quality of power supply and network management server 6 then and finishes the distributed parallel of mass data and calculate.
Described terminal Power Quality Monitor Device comprises data exchange module, compatible DL/T 680(IEC 61850) protocol specification such as agreement and PQDIF, be used for data upload to the main website communication server.Monitoring device collects voltage/current signals from electrical network, after voltage/current sensor is converted to voltage signal, carry out signal condition and suppressed system noise, by data collecting card simulating signal is converted into digital signal again, finally parses the various Monitoring Data that need monitoring.The general data of monitoring device collection has real time data (the total effective value of phase voltage, the total effective value of line voltage, the total effective value of electric current, single-phase active power, single-phase reactive power, total active power, frequency etc.), statistical information (comprising: the total effective value of voltage, the total effective value of line voltage, voltage resultant distortion rate, the total effective value of harmonic voltage, positive sequence voltage etc.) and report data information (comprising: the total effective value of voltage, the total effective value of line voltage, voltage fundamental, voltage negative phase-sequence degree of unbalancedness etc.).
Concrete, described terminal monitoring device comes connecting system by the PQDIF monitor data file is uploaded to the communication front end processor under the situation of compatible PQDIF standard.
The Monitoring Data acquisition subsystem that the described terminal monitoring device and the communication server are formed has comprised communication module, the acquisition management module.Wherein communication server is being undertaken the communication with the acquisition terminal device, and except that the real-time Monitoring Data that receiving trap sends over, the data that barrier is for some reason failed to receive extract.The acquisition management server comprises modules such as acquisition tasks management, protocol converter and cloud data base read-write.Acquisition server is compatible PQDIF standard of while except that compatible DL/T 680 standard agreement standards, by the stipulations modular converter data of being accepted are converted to and meet DL/T 680(IEC 61850) data of agreement, the data after the database read writing module will be changed write the cloud database that data-base cluster forms.
The Monitoring Data cloud storage that the described Distributed Calculation processing server cluster that has a non-relational database cluster (HBase) forms comprises cloud database module, Distributed Calculation module, data read with the Distributed Calculation subsystem and writes the calling interface module etc. of interface module, cluster management and monitoring module, cloud cluster management and Distributed Calculation.The cloud database module provides the encapsulation of data read-write operation, data management on the database Hbase based on Hadoop.
The relational database that described relation data management server forms imports subsystem and comprises multiple database access module and import tool.The multiple database access module provides the driving of multiple relational database, and the historical Monitoring Data that is kept in the relational database is carried out read-write operation, is written in the cloud database by cloud data of database interface by import tool.
The Web application management subsystem that the described quality of power supply and network management server form comprises acquisition monitoring, Monitoring Data management, Monitoring Data inquiry, Monitoring Data statistics and modules compositions such as system configuration and management, and the function of quality of power supply system and user interactions is provided.
The acquisition monitoring module is monitored and is managed the equipment for monitoring power quality of connecting system, checks the state of monitoring device and configuration etc.
The Monitoring Data administration module is the module that the data that monitoring device uploads onto the server are managed, and can carry out verification to the integrality that data are uploaded in the monitoring point, if exist the missing data can be by monitoring device being called together the data of surveying the completion disappearance.
It is that the historical data of each monitoring device is carried out simple queries, many condition queries and stable state and transient analysis etc. that the query analysis module of Monitoring Data mainly provides.
The Monitoring Data statistical module mainly be to the electric energy quality monitoring data monthly, season, year carry out statistical computation and generate corresponding report.
System configuration and administration module mainly provide user authority management, monitoring net management and grouping customization function.
Each monitoring device is gathered in real time to power quality data, image data is temporary in monitoring device, and being sent to communication server at interval by certain hour, data based agreement that the acquisition management server transmits communication server and stipulations are carried out format conversion with data and are written in the cloud database.
Claims (2)
1. electric energy quality monitoring system based on distributed architecture (Hadoop), comprise a plurality of Power Quality Monitor Device, the communication server, it is characterized in that, described system also comprises the task management server, has the Distributed Calculation processing server cluster of non-relational database cluster and comprises the relation data management server of multiple database access module and import tool and comprise the quality of power supply and the network management server of a plurality of administration modules, and described a plurality of Power Quality Monitor Device connect the communication server; The described communication server connects the task management server by network; Described task management server connects Distributed Calculation processing server cluster, described Distributed Calculation processing server cluster annexation data management server and the quality of power supply and network management server by network.
2. a kind of electric energy quality monitoring system according to claim 1 based on distributed architecture (Hadoop), it is characterized in that described Distributed Calculation processing server cluster is provided with cloud Processing Interface and multinode Processing Interface at non-relational database cluster; Described cloud Processing Interface connects task management server and relation data management server, and described multinode Processing Interface connects the quality of power supply and network management server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013200063016U CN203084729U (en) | 2013-01-07 | 2013-01-07 | Power quality monitoring system based on distributed infrastructure (Hadoop) |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013200063016U CN203084729U (en) | 2013-01-07 | 2013-01-07 | Power quality monitoring system based on distributed infrastructure (Hadoop) |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN203084729U true CN203084729U (en) | 2013-07-24 |
Family
ID=48830549
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2013200063016U Expired - Fee Related CN203084729U (en) | 2013-01-07 | 2013-01-07 | Power quality monitoring system based on distributed infrastructure (Hadoop) |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN203084729U (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103852744A (en) * | 2014-03-03 | 2014-06-11 | 南方电网科学研究院有限责任公司 | Distributed online monitoring system and method for electric energy metering device |
| CN104391903A (en) * | 2014-11-14 | 2015-03-04 | 广州科腾信息技术有限公司 | Distributed storage and parallel calculation-based power grid data quality detection method |
| CN107607814A (en) * | 2017-09-11 | 2018-01-19 | 广东电网有限责任公司云浮供电局 | A kind of electric energy quality monitoring system and its monitoring method of distributed power source access |
| CN109857075A (en) * | 2019-02-18 | 2019-06-07 | 河南省水文水资源局 | Water resource monitor supervision platform operation maintenance management system based on mobile terminal |
-
2013
- 2013-01-07 CN CN2013200063016U patent/CN203084729U/en not_active Expired - Fee Related
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103852744A (en) * | 2014-03-03 | 2014-06-11 | 南方电网科学研究院有限责任公司 | Distributed online monitoring system and method for electric energy metering device |
| CN104391903A (en) * | 2014-11-14 | 2015-03-04 | 广州科腾信息技术有限公司 | Distributed storage and parallel calculation-based power grid data quality detection method |
| CN107607814A (en) * | 2017-09-11 | 2018-01-19 | 广东电网有限责任公司云浮供电局 | A kind of electric energy quality monitoring system and its monitoring method of distributed power source access |
| CN109857075A (en) * | 2019-02-18 | 2019-06-07 | 河南省水文水资源局 | Water resource monitor supervision platform operation maintenance management system based on mobile terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109547538B (en) | Power distribution equipment state monitoring system based on Internet of things technology and implementation method | |
| CN203084729U (en) | Power quality monitoring system based on distributed infrastructure (Hadoop) | |
| CN107704545A (en) | Railway distribution net magnanimity information method for stream processing based on Storm Yu Kafka message communicatings | |
| CN102969796B (en) | Near-real-time electric quantity monitoring and dispatching management system for rural power grid | |
| CN103955509A (en) | Quick search method for massive electric power metering data | |
| CN104701980A (en) | GPRS remotely monitored intelligent box-type transformer substation | |
| CN101976251B (en) | Method for realizing power utilization information acquisition terminal embedded database management model | |
| CN104362757A (en) | Transformer substation on-line monitoring system based on IEC61850 | |
| CN108737519A (en) | A kind of industrial Internet of Things cloud service platform intelligent acquisition method | |
| CN114448094A (en) | Data sharing system based on platform area intelligent service terminal edge calculation | |
| CN202210344U (en) | Centralized meter reading system based on wireless communication | |
| CN102496260B (en) | Multiple communication technology type of method for electric power information acquisition control | |
| CN107546853A (en) | A kind of substation network data acquisition, management method and device | |
| CN102647027A (en) | Method for realizing construction of power quality data exchanging interface | |
| CN101447049A (en) | Rapid line loss analyzing method and system thereof | |
| Mao et al. | Application of IEC61850 in energy management system for microgrids | |
| Wang et al. | Storage and query of condition monitoring data in smart grid based on Hadoop | |
| CN204013610U (en) | Photovoltaic plant data processing transmission system | |
| CN205176932U (en) | Data collection and transmission system for intelligence measurement platform | |
| CN105447264A (en) | Modeling method of information model of intelligent electronic device | |
| CN204009903U (en) | A kind of electrical network magnanimity Real-time Data Service platform | |
| CN104992372A (en) | Electric power production system software and hardware platform test method and system | |
| CN204536420U (en) | A kind of nuclear power station electric energy monitoring system | |
| CN103605759A (en) | Power grid history state data sharing method | |
| Xu et al. | High performance distributed power quality monitoring IED used in smart grid |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130724 Termination date: 20180107 |