CN211577267U - Hadoop-based regional power grid harmonic monitoring system - Google Patents
Hadoop-based regional power grid harmonic monitoring system Download PDFInfo
- Publication number
- CN211577267U CN211577267U CN201921118644.5U CN201921118644U CN211577267U CN 211577267 U CN211577267 U CN 211577267U CN 201921118644 U CN201921118644 U CN 201921118644U CN 211577267 U CN211577267 U CN 211577267U
- Authority
- CN
- China
- Prior art keywords
- subsystem
- hadoop
- data
- harmonic
- power grid
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Supply And Distribution Of Alternating Current (AREA)
- Remote Monitoring And Control Of Power-Distribution Networks (AREA)
Abstract
The utility model discloses a regional electric wire netting harmonic monitoring system based on Hadoop, including harmonic monitoring data acquisition subsystem, Hadoop cluster subsystem, logic interface layer subsystem, the user side, wherein, harmonic monitoring data acquisition subsystem gathers electric wire netting data and carries out preliminary treatment, link to each other with Hadoop cluster subsystem, Hadoop cluster subsystem can calculate each time harmonic parameter and arrange the order storage to the output result, link to each other with logic interface layer subsystem, the user side links to each other with logic interface layer subsystem, can carry out basic data's parallelization computational analysis and inquire the analysis result through logic interface layer subsystem. The method fully utilizes the strong data storage capacity and the computing capacity provided by the Hadoop distributed file system and the parallelization programming model to store and parallelize the basic sampling data of the regional power grid harmonic monitoring, and the computation meets the requirements on the rapidity and the timeliness of the sampling data analysis under the development of the smart power grid.
Description
Technical Field
The utility model relates to a regional electric wire netting harmonic monitoring field, more specifically relates to a regional electric wire netting harmonic monitoring system based on Hadoop.
Background
The development of the intelligent power grid brings a large amount of investment of power quality monitoring terminals to the regional power grid. Meanwhile, the increase of the sampling frequency and the monitoring time accelerates the explosive growth of the sampling data in the power quality monitoring platform. In a traditional power quality monitoring platform, data of a monitoring terminal is uploaded and processed in a centralized mode. With the continuous promotion of the construction of the smart power grid, higher requirements are put forward on the calculation speed and precision of the power quality monitoring index. The storage capacity and the computing power of the server in the traditional power quality monitoring platform are difficult to meet the increasing business requirements, and although the purchasing of a higher-configuration server can temporarily meet the computing requirements, a large amount of resources are wasted under the condition of no running task.
SUMMERY OF THE UTILITY MODEL
The utility model discloses an overcome above-mentioned prior art at least one kind defect, provide a regional electric wire netting harmonic monitoring system based on Hadoop.
The utility model discloses aim at solving above-mentioned technical problem to a certain extent at least.
The utility model discloses a first purpose is to realize the high-efficient calculation of electric power system sampling data under the condition of low hardware cost and less wasting of resources.
In order to solve the technical problem, the technical scheme of the utility model as follows:
a harmonic monitoring system of a regional power grid based on Hadoop comprises a harmonic monitoring data acquisition subsystem, a Hadoop cluster subsystem, a logic interface layer subsystem and a user side, wherein the harmonic monitoring data acquisition subsystem acquires power grid data and performs primary processing, and is connected with the Hadoop cluster subsystem;
the Hadoop cluster subsystem can calculate each subharmonic parameter and sort and store the output result, and is connected with the logic interface layer subsystem;
the user side is connected with the logic interface layer subsystem and can perform parallelization calculation analysis of basic data and query analysis results through the logic interface layer subsystem;
in the scheme, the Hadoop cluster subsystem provides strong distributed storage and calculation capacity for the sampled data of the power system, is composed of cheap common hardware, can expand the storage and calculation capacity subsequently, greatly promotes the intelligent process of the power system, and improves the utilization rate of hardware resources to a certain extent.
Preferably, the harmonic monitoring data acquisition subsystem comprises a monitoring terminal, the monitoring terminal comprises a processor, and the monitoring terminal is used for performing signal windowing and fast fourier transform on a sampling signal and uploading a specific spectral line to the Hadoop cluster subsystem;
in order to realize the customizable process of the harmonic parameter analysis method on the premise of reducing the transmission overhead of a basic data network, a sampling signal can be packaged and uploaded by a specific spectral line in a frequency spectrum after being subjected to fast Fourier transform, the method actually realizes the process of data compression, taking a double spectral line interpolation algorithm as an example, each harmonic parameter is calculated only by a maximum spectral line and a second maximum spectral line in a frequency spectrum range, the length of a sampling sequence required by primary harmonic parameter analysis is assumed to be 2048 points, the number of harmonic times required to be detected is 21 times at most, under the condition of adopting the double spectral line interpolation algorithm, after being subjected to fast Fourier transform, the amplitude and phase information of 42 spectral lines are required to be uploaded, and the data network transmission overhead is reduced to a great extent.
Preferably, the Hadoop cluster subsystem comprises a plurality of name node calculators, a plurality of data node calculators, a memory and a repeater, wherein the name node calculators are connected with the data node calculators and the memory through the repeater;
in the plurality of data node calculators, one part of the data node calculators operates a Map program to calculate harmonic parameters of harmonic waves, and the other part of the data node calculators operates a Reduce program to sort the calculated harmonic parameters;
through the parallelization processing of the sampling data, the processing process of the sampling data based on different algorithms can be realized by customizing different Map and Reduce functions.
Preferably, the logical interface layer subsystem includes a MapReduce job interface, and the MapReduce job interface provides different window functions for the user side to select.
Compared with the prior art, the utility model discloses technical scheme's beneficial effect is:
the method comprises the steps of calculating basic sampling data of an electric energy quality monitoring platform under a distributed file system and a parallel programming model, designing a regional power grid harmonic monitoring system based on a Hadoop cluster through research on a Hadoop platform core technology, namely a Hadoop distributed file system and a MapReduce parallel programming model, storing and parallelizing basic sampling data of regional power grid harmonic monitoring under the systems by fully utilizing strong data storage capacity and calculation capacity provided by the Hadoop distributed file system and the parallel programming model, realizing customization of a basic sampling data processing algorithm according to needs through a MapReduce operation interface provided in a service logic interface layer of the platform, expanding the storage and calculation capacity through adding nodes of the Hadoop cluster in the system, timely meeting the requirement of rapid performance of sampling data analysis under the development of an intelligent power grid, The requirement of timeliness.
Drawings
Fig. 1 is a schematic diagram of a Hadoop-based regional power grid harmonic monitoring system provided by the invention.
Detailed Description
The drawings are for illustrative purposes only and are not to be construed as limiting the patent;
for the purpose of better illustrating the embodiments, certain features of the drawings may be omitted, enlarged or reduced, and do not represent the size of an actual product;
it will be understood by those skilled in the art that certain well-known structures in the drawings and descriptions thereof may be omitted.
The technical solution of the present invention will be further explained with reference to the accompanying drawings and examples.
Example 1
The harmonic monitoring system of the area power grid based on Hadoop provided by this embodiment, as shown in fig. 1, includes a harmonic monitoring data acquisition subsystem, a Hadoop cluster subsystem, a logic interface layer subsystem, and a user side, where:
the harmonic monitoring data acquisition subsystem acquires power grid data, performs primary processing, and is connected with the Hadoop cluster subsystem;
the Hadoop cluster subsystem can calculate each subharmonic parameter and sort and store the output result, and is connected with the logic interface layer subsystem;
the user side is connected with the logic interface layer subsystem and can perform parallelization calculation analysis of basic data and query analysis results through the logic interface layer subsystem;
the harmonic monitoring data acquisition subsystem comprises a monitoring terminal, the monitoring terminal comprises a processor, and the monitoring terminal is used for performing signal windowing and fast Fourier transform on a sampling signal and uploading a specific spectral line to the Hadoop cluster subsystem;
the Hadoop cluster subsystem comprises a plurality of name node calculators and a plurality of data node calculators, the name node calculators are connected with the data node calculators, and the Hadoop cluster subsystem analyzes and processes harmonic monitoring data by using the strong data storage capacity of a distributed file system in a Hadoop platform and a MapReduce parallel programming model;
in the plurality of data node calculators, one part of the data node calculators operates a Map program to calculate harmonic parameters of harmonic waves, and the other part of the data node calculators operates a Reduce program to sort the calculated harmonic parameters;
the logical interface layer subsystem comprises a MapReduce operation interface which provides different window functions for the user side to select.
In the specific implementation process, the collection of the power quality monitoring data can still be provided through the existing monitoring terminal in the power system, because the platforms are the same, and hardware equipment and software codes for executing different processing operation requirements have good expandability and portability, under the Hadoop platform, operations of different application researches are reasonably scheduled, the intelligent process of the power system can be greatly promoted, the utilization efficiency of hardware resources can be improved to a certain extent relative to the execution of a single operation task, and the strong distributed storage capacity and parallelization computing capacity provided by the Hadoop platform are strongly guaranteed;
in the Hadoop-based regional power grid harmonic monitoring system provided in fig. 1, the Hadoop computer cluster can provide strong data storage and calculation capacity, so that the requirement on the calculation capacity of the monitoring terminals can be reduced, the number of the monitoring terminals in the regional power grid can be increased, the monitoring terminals can upload the sampling data to the cluster for calculation and analysis after completing the acquisition of the sampling data with fixed length, in order to realize the customizable process of the harmonic parameter analysis method on the premise of reducing the transmission overhead of the basic data network, the specific spectral lines in the frequency spectrum of the sampling signals after the fast fourier transform can be packed and uploaded, the method actually realizes the data compression process, taking a double spectral line interpolation algorithm as an example, the calculation of each harmonic parameter only needs the maximum spectral line and the second maximum spectral line in the frequency spectrum range, and assuming that the length of the sampling sequence required for the first harmonic parameter analysis is 2048 points, the number of the harmonic waves to be detected is 21 at most, and under the condition of adopting a double spectral line interpolation algorithm, after fast Fourier transform, amplitude and phase information of 42 spectral lines need to be uploaded, so that the transmission overhead of a data network is reduced to a greater extent;
in a regional power grid harmonic parameter calculation system based on Hadoop cluster management, a window function is selected, the window function provided by a MapReduce operation interface in a logic interface layer subsystem can be selected through a user terminal, data acquisition, signal windowing, fast Fourier transform, fundamental wave searching and spectral lines y1 and y2 corresponding to each subharmonic frequency domain range are realized in a monitoring terminal, the result is uploaded to a near node of a Hadoop cluster in a physical layer, harmonic parameters of harmonic waves are calculated on a data node operating a Map program, the harmonic parameters are sorted and sorted on the data node operating a Reduce program, and the user terminal accesses and inquires the data through the logic interface layer subsystem.
The same or similar reference numerals correspond to the same or similar parts;
the terms describing positional relationships in the drawings are for illustrative purposes only and are not to be construed as limiting the patent;
it is obvious that the above embodiments of the present invention are only examples for clearly illustrating the present invention, and are not limitations to the embodiments of the present invention. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the claims of the present invention.
Claims (5)
1. The utility model provides a regional power grid harmonic monitoring system based on Hadoop, its characterized in that includes harmonic monitoring data acquisition subsystem, Hadoop cluster subsystem, logical interface layer subsystem, user side, wherein:
the harmonic monitoring data acquisition subsystem acquires power grid data and performs primary processing, and is connected with the Hadoop cluster subsystem;
the Hadoop cluster subsystem can calculate each subharmonic parameter and sort and store output results, and is connected with the logic interface layer subsystem;
the user side is connected with the logic interface layer subsystem and can perform parallelization calculation analysis of basic data and query analysis results through the logic interface layer subsystem.
2. The Hadoop-based regional power grid harmonic monitoring system of claim 1, wherein the harmonic monitoring data acquisition subsystem comprises a monitoring terminal, and the monitoring terminal comprises a processor, and is configured to perform signal windowing, fast fourier transformation, and uploading of a specific spectral line to the Hadoop cluster subsystem.
3. The Hadoop-based regional power grid harmonic monitoring system according to claim 1, wherein the Hadoop cluster subsystem comprises a plurality of name node calculators, a plurality of data node calculators, a memory and a repeater, the name node calculators are connected with the data node calculators and the memory through the repeater, and the Hadoop cluster subsystem analyzes and processes harmonic monitoring data by using a strong data storage capacity of a distributed file system in a Hadoop platform and a MapReduce parallelization programming model.
4. The Hadoop-based regional power grid harmonic monitoring system according to claim 3, wherein one of the plurality of data node calculators runs a Map program to calculate harmonic parameters of harmonics, and the other part of the plurality of data node calculators runs a Reduce program to sort the calculated harmonic parameters.
5. The Hadoop-based regional power grid harmonic monitoring system of claim 1, wherein the logical interface layer subsystem comprises a MapReduce job interface that provides different window functions for selection by the user side.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201921118644.5U CN211577267U (en) | 2019-07-16 | 2019-07-16 | Hadoop-based regional power grid harmonic monitoring system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201921118644.5U CN211577267U (en) | 2019-07-16 | 2019-07-16 | Hadoop-based regional power grid harmonic monitoring system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN211577267U true CN211577267U (en) | 2020-09-25 |
Family
ID=72521995
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201921118644.5U Active CN211577267U (en) | 2019-07-16 | 2019-07-16 | Hadoop-based regional power grid harmonic monitoring system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN211577267U (en) |
-
2019
- 2019-07-16 CN CN201921118644.5U patent/CN211577267U/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113569117B (en) | Cloud platform system and method based on industrial internet big data service | |
| CN109286664A (en) | A kind of computation migration terminal energy consumption optimization method based on Lagrange | |
| CN113132945B (en) | Energy-saving scheduling method and system for railway private network base station cell | |
| CN105045856A (en) | Hadoop-based data processing system for big-data remote sensing satellite | |
| CN103365727A (en) | Host load forecasting method in cloud computing environment | |
| Kchaou et al. | Towards an offloading framework based on big data analytics in mobile cloud computing environments | |
| CN113900810A (en) | Distributed graph processing method, system and storage medium | |
| CN104461710A (en) | Method and device for processing tasks | |
| CN104850516B (en) | A kind of DDR Frequency Conversion Designs method and apparatus | |
| Miao et al. | Adaptive DNN partition in edge computing environments | |
| Huang et al. | Computation offloading for multimedia workflows with deadline constraints in cloudlet-based mobile cloud | |
| CN113159539B (en) | Method for combining green energy scheduling and dynamic task allocation in multi-layer edge computing system | |
| CN211577267U (en) | Hadoop-based regional power grid harmonic monitoring system | |
| CN114169506A (en) | Deep learning edge computing system framework based on industrial Internet of things platform | |
| CN110442753A (en) | A kind of chart database auto-creating method and device based on OPC UA | |
| WO2019127926A1 (en) | Calculation method and calculation device for sparse neural network, electronic device, computer readable storage medium, and computer program product | |
| Zhao et al. | Maintainable mobile model using pre-cache technology for high performance android system | |
| CN104796673A (en) | Energy consumption optimization-oriented cloud video monitoring system task access method | |
| CN204790999U (en) | Big data acquisition of industry and processing system | |
| CN116594836A (en) | Cloud protogenesis-based unified monitoring method and device for multi-cloud heterogeneous resources | |
| CN109301820A (en) | A kind of enterprise's electrical control method and system | |
| CN107346444A (en) | Intelligent chip based on high in the clouds big data deep learning | |
| CN104090813A (en) | Analysis modeling method for CPU (central processing unit) usage of virtual machines in cloud data center | |
| CN112835710A (en) | Power line state analysis system based on mobile edge calculation and task processing method | |
| CN111736968A (en) | Method, device, equipment and medium for optimal configuration of computing resources of cloud data center of power distribution system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |