CN109783556A - Power quality controlling equipment on-line monitoring system and construction method based on Hadoop and SSM framework - Google Patents
Power quality controlling equipment on-line monitoring system and construction method based on Hadoop and SSM framework Download PDFInfo
- Publication number
- CN109783556A CN109783556A CN201811579996.0A CN201811579996A CN109783556A CN 109783556 A CN109783556 A CN 109783556A CN 201811579996 A CN201811579996 A CN 201811579996A CN 109783556 A CN109783556 A CN 109783556A
- Authority
- CN
- China
- Prior art keywords
- data
- power quality
- layer
- controlling equipment
- quality controlling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
A kind of power quality controlling equipment on-line monitoring system based on Hadoop and SSM framework, including the data collection layer constituted with power quality controlling equipment on-line monitoring device, with JAVA multithreading, the non-blocking type communication of NIO, the director data transport layer that file monitoring service is constituted, with relational database MySQL, distributed file system HDFS and its included distributed data base HBase in Hadoop framework, the data storage layer that Hive is constituted, with MapReduce, the data application computation layer that Stream software frame is constituted, with Spring, the Business Logic that Spring MVC is realized, the object data data persistence layer constructed with Mybatis, and the data visualization layer that front end mainstream frame is realized.And provide the construction method of the system.The present invention realizes that magnanimity electric energy quality monitoring data carry out efficient, fast and accurately analysis processing.
Description
Technical field
The invention belongs to internet areas, and in particular to a kind of power quality controlling based on Hadoop and SSM framework is set
Standby online monitoring system and construction method.
Background technique
Cloud computing technology is by many technologies such as parallel computation, effectiveness calculating, magnanimity Distributed Storage, virtual technology
Develop obtained result.The hot spot that cloud computing is studied as message area possesses data safety, ultra-large data processing energy
The advantages such as power, cost performance are high and hardware cost is low.Key technology of the Hadoop platform as cloud computing, can complete data algorithm
Parallelization, so keep computational efficiency very fast, can efficient analysis handle mass data.Currently, the cloud computing based on Hadoop
Technology handles extra large quantized data in fields such as security protection, finance, internets and tentatively achieves successful application.
SSM is the web development frame of J2EE exploitation mainstream, is integrated with Spring, SpringMvc, Mybatis frame.Its
In, Spring is the Java Open Framework an of lightweight, is born to simplify enterprise-oriented system exploitation.Spring's
Core is that control inverts (IOC) and towards tangent plane programming (AOP).Spring MVC is a kind of to realize Web based on Java
MVC design pattern request driving type lightweight Web frame, that is, used the thought of MVC architecture mode, by web layer into
The decoupling of row responsibility.MyBatis is one and supports common SQL query, the outstanding Persistence Layer Framework of storing process and advanced mapping.
MyBatis eliminates the manual setting of almost all of JDBC code and parameter and encapsulates to the retrieval of result set, can make
With simple XML or explain for configuration and original mappings, by POJO (the Plain Old Java of interface and Java
Objects, common Java object) it is mapped to the record in database.
As Chinese national economy flourishes, extensive use of the power electronic equipment in industry, a large amount of non-linear, punching
Hitting property, fluctuation and the addition of asymmetric load, cause electric system current waveform distortion (harmonic pollution), voltage fluctuation with
The power quality problems such as flickering and three-phase imbalance produce serious harm to safe operation of power system.Currently, in state's net
It mainly uses and is carried out with Static Var Compensator (SVC), the reactive power compensator that static synchronous compensator (STATCOM) is representative
No-Work Power Compensation Capacity in Electricity System, and then the problems such as prevention voltage fluctuation and flicker.For the most common harmonic pollution and three-phase
Imbalance problem mainly uses passive filter, active filter and compound filter, STATCOM, power quality harnessed synthetically
Device is administered.Power quality controlling product category in China's is abundant at present, and the manufacturer of respective product provides different electric energy matter
Software is measured, the data that the data deficiency of different vendor's acquisition is general acquire transmitting software, and power quality data does not obtain sufficiently
Analysis and utilization.
In practical applications, electric energy governing device is usually all matched with electric energy quality on-line monitoring device.It is existing
Power quality controlling equipment monitoring system generally all using the monitoring instrument of a certain producer as on-line monitoring layer, by too net,
Data are uploaded to data management layer by the modes such as MODEM, Zigbee, GPRS, establish small range data center.The above on-line checking
Mode be there is a problem that obvious: (1) the monitoring instrument data communication mode of different vendor, communication protocol are different, cannot achieve
Data sharing.(2) existing electric energy quality monitoring system data management layer mostly uses greatly relevant database storing data, uses
Traditional centralized processing mode analytical calculation data.It is existing in face of growing and many and diverse electric energy quality monitoring data
Electric energy quality monitoring system is not able to satisfy power quality data and stores and calculate on a large scale analysis requirement.(3) different vendor takes
The acquisition power quality data of the power quality controlling monitoring center built lacks unified transmission mode, further uploads data
To primary server, unified big data processing analysis is carried out.
Summary of the invention
In order to overcome above-mentioned existing technical problem, the present invention provides a kind of electric energy based on Hadoop and SSM framework
Quality controlling equipment on-line monitoring system and construction method are realized using JAVA multithreading, Socket communication to distribution type electric energy
Qualitative data carries out unified acquisition transmission and issues with power quality equipment control instruction, and system is stored using Hadoop, big data
Etc. technological means realize magnanimity electric energy quality monitoring data carry out efficiently, fast and accurately analysis handle, taken using SSM frame
Build power quality controlling monitoring of tools, magnanimity power quality data processing result visualization system.
The technical scheme is that
A kind of power quality controlling equipment on-line monitoring system based on Hadoop Yu SSM framework, comprising: with power quality
The data collection layer that abatement equipment on-line monitoring device is constituted；With JAVA multithreading, the non-blocking type communication of NIO, file monitoring clothes
The director data transport layer for composition of being engaged in；With in relational database MySQL, Hadoop framework distributed file system HDFS and its
The data storage layer that included distributed data base HBase, Hive is constituted；And use MapReduce, Stream software
The data application computation layer that frame is constituted；With the Business Logic that Spring, Spring MVC are realized, with Mybatis building
The data visualization that object data data persistence layer and the front end Bootstrap, Echarts, Websocket mainstream frame are realized
Layer.
Further, the online monitoring system is realized using J2EE programming language, and comprehensive use on the basis of J2EE
Spring, Spring MVC and Mybatis frame, wherein Spring as overall framework be responsible for manage Spring MVC and
Mybatis frame, Spring MVC are responsible for completing the service logic control of power quality controlling equipment and realize.
A kind of construction method based on Hadoop Yu the power quality controlling equipment on-line monitoring system of SSM framework, including
Following steps:
Step 1: power quality controlling equipment on-line monitoring device is constituted into data collection layer, data collection layer uses
ZigBee technology forms wireless sense network, different power quality controlling equipment and its mating on-line monitoring equipment and data is passed through nothing
Line Sensor Network is uploaded to data acquisition node (local server), and data collection layer will acquire different electric energy and administer abatement equipment
Data, data collected include static data and dynamic time sequence data, and dynamic time sequence data include supply voltage deviation, electricity
Pressure fluctuation and flickering, relative harmonic content, three-phase imbalance and frequency departure；Static data includes the electric energy improvement that investment is administered
Working condition, number of devices, the device type of equipment；
Step 2: with the technological maheups director datas such as JAVA multithreading, the non-blocking type communication of NIO, file monitoring service biography
Defeated layer, data transfer layer include client and server composition, wherein the monitoring file that client uses Java 7 newly to introduce
The Watch Service API of system variation monitor to the file under locally specified catalogue, is specified by registration
Monitoring service new data can more will upload after monitoring power quality data update under catalogue；Server is non-using NIO
Blocking type communication mode is used to respond the request of the client high concurrent, high load formula of multiple data collection layers；Client and clothes
Business device end is all made of multi-thread programming mode, is completed at the same time the multi-task；
Step 3: point with relevant database (such as: MySQL, Oracle, Postgres etc.), in Hadoop framework
Cloth file system HDFS and its included distributed data base HBase, Hive constitute data storage layer, by static data
It is stored in relevant database, is extracted dynamic time sequence data from relevant database using Sqoop, structuring number
Table format storage to Hive or is converted to the mode of Key-value and stores HBase accordingly, can also be stored with file mode
Into HDFS, for unstructured data, with catalogue and the storage of the organizational form of file into HDFS；
Step 4: Parallel Algorithm can be write using MapReduce, Stream frame according to demand, to on-line monitoring
Power quality is analyzed with data are administered, and obtains life estimation, the state evaluation of electric energy abatement equipment, is excavated electric energy improvement and is set
Standby failure potential cause, power quality prediction warning, equipment administer power status assessment result；
Step 5: Business Logic increases power quality controlling equipment according to the request of administrator realization, administers record
Maintenance, user log in, user right procuratorial work, administer the inquiry of point power quality, power quality controlling equipment state assessment inquires, is remote
The control of journey power quality controlling equipment, power quality big data analysis result queries, the completion of these modules is in Spring
It is realized in the Controller controller of MVC frame, whole requests that user submits all appoint request corresponding
Controller is handled, the processing that Controller will call corresponding Service component to carry out service logic, electric energy matter
It measures in abatement equipment remote control module, system is communicated by data transfer layer, and instruction is sent data acquisition node, sub- section
Point is communicated by ZigBee, and instruction parsing is issued in power quality controlling equipment；
Step 6: all business operations of Business Logic can carry out persistence by data operation layer, and data are held
Longization operation is completed dependent on the DAO layer assembly of Mybatis frame.DAO layers define interface, and there is no realize specific number
According to operation；Mybatis is by the dynamic proxy method of JDK, in start-up loading configuration file, according to the mapper's of configuration
The realization of xml generation DAO；
Step 7: architecture uses browser/server (B/S) mode, power quality controlling equipment monitoring system table
Existing layer mainly includes that system interface is shown, system interface is realized using JSP, html language；Interface is monitored on-line, in order to improve
The real-time and enhancing usage experience of data transmission use WebSocket technology, and browser once connects with WEB server foundation
After connecing, connection would not be closed, and data can be pushed in time browser end by WebSocket server-side, be rung in real time to realize
It answers.
The beneficial effects of the present invention are:
1. data storage and analysis that distributed computing framework Hadoop is applied to power quality controlling equipment by the present invention
In processing, data management work is simplified on the data store, reduces data maintenance cost.It is excellent using big data parallel computation
Gesture makes the processing power quality data time that data volume is big, dimension is high decline to a great extent.
2. can check that whenever and wherever possible electric energy administers the power quality and equipment working state, regulation effect of point at the end Web
Assessment, and remote controlled power quality equipment, improve work efficiency.
3. the present invention uses the modularization SSM Frame Design of height, Spring realizes the unified management of whole system, has
Effect reduces the system degree of coupling.It has the characteristics that high cohesion, lower coupling convenient for the development and maintenance of system.
4. data transfer layer of the invention provides a kind of different power quality acquisition child node and uploads data automatically to master
The generic way of server.
Detailed description of the invention
Fig. 1 is the power quality controlling equipment on-line monitoring system configuration diagram based on Hadoop and SSM.
Fig. 2 is that the hardware of present example builds schematic diagram.
Fig. 3 is the data transfer layer schematic diagram based on multithreading, NIO.
Fig. 4 is computation layer data treatment process.
Fig. 5 is SSM frame Integrated design schematic diagram.
Fig. 6 is electric energy abatement equipment Basic Information Management module in Business Logic.
Fig. 7 is user and authority management module in Business Logic.
Fig. 8 is monitoring point power quality and abatement equipment working state monitoring module in Business Logic.
Specific embodiment
The preferred embodiment of the present invention is described in detail with reference to the accompanying drawing, and then makes advantages and features of the invention
Can be easier to it will be understood by those skilled in the art that.
Referring to Fig.1~Fig. 8, a kind of power quality controlling equipment on-line monitoring system based on Hadoop Yu SSM framework, packet
It includes: the data collection layer constituted with power quality controlling equipment on-line monitoring device；It is logical with JAVA multithreading, the non-blocking type of NIO
The director data transport layer that letter, file monitoring service are constituted；With the distribution text in relational database MySQL, Hadoop framework
The data storage layer that part system HDFS and its included distributed data base HBase, Hive are constituted；And it uses
The data application computation layer that MapReduce, Stream software frame are constituted；The online monitoring system uses J2EE programming language
It realizes, and comprehensive using Spring, Spring MVC and Mybatis frame on the basis of J2EE, wherein Spring is as total
Body frame is responsible for managing Spring MVC and Mybatis frame, and Spring MVC is responsible for completing the industry of power quality controlling equipment
Business logic control and realization, it is relevant persistently that Mybatis frame is responsible for electric energy abatement equipment online monitoring system underlying database
Change operation；Data visualization layer is realized using the front end Bootstrap, Echarts, Websocket mainstream frame.
A kind of power quality controlling equipment on-line monitoring system construction method based on Hadoop Yu SSM framework, including such as
Lower step:
Step 1: power quality controlling equipment on-line monitoring device is constituted into data collection layer, data collection layer uses
ZigBee technology forms wireless sense network, different power quality controlling equipment and its mating on-line monitoring equipment and data is passed through nothing
Line Sensor Network is uploaded to data acquisition node (local server), and data collection layer will acquire different electric energy and administer abatement equipment
Data, data collected include static data and dynamic time sequence data, and dynamic time sequence data include supply voltage deviation, electricity
Pressure fluctuation and flickering, relative harmonic content, three-phase imbalance and frequency departure；Static data includes the electric energy improvement that investment is administered
Working condition, number of devices, the device type of equipment；
Step 2: with the technological maheups director datas such as JAVA multithreading, the non-blocking type communication of NIO, file monitoring service biography
Defeated layer, data transfer layer include client and server composition, wherein the monitoring file that client uses Java 7 newly to introduce
The Watch Service API of system variation monitor to the file under locally specified catalogue, is specified by registration
Monitoring service new data can more will upload after monitoring power quality data update under catalogue；Server is non-using NIO
Blocking type communication mode is used to respond the request of the client high concurrent, high load formula of multiple data collection layers；Client and clothes
Business device end is all made of multi-thread programming mode, is completed at the same time the multi-task；
Step 3: point with relevant database (such as: MySQL, Oracle, Postgres etc.), in Hadoop framework
Cloth file system HDFS and its included distributed data base HBase, Hive constitute data storage layer, by static data
It is stored in relevant database,.Dynamic time sequence data are extracted from relevant database using Sqoop, structuring
Data store in a table format to Hive or are converted to the mode of Key-value and store HBase, can also be deposited with file mode
It stores up in HDFS, for unstructured data, with catalogue and the storage of the organizational form of file into HDFS；
Step 4: Parallel Algorithm can be write using MapReduce, Stream frame according to demand, to on-line monitoring
Power quality is analyzed with data are administered, and obtains life estimation, the state evaluation of electric energy abatement equipment, is excavated electric energy improvement and is set
Standby failure potential cause, power quality prediction warning, equipment administer power status assessment result；
Step 5: Business Logic increases power quality controlling equipment according to the request of administrator realization, administers record
Maintenance, user log in, user right procuratorial work, administer the inquiry of point power quality, power quality controlling equipment state assessment inquires, is remote
The control of journey power quality controlling equipment, power quality big data analysis result queries, the completion of these modules is in Spring
It is realized in the Controller controller of MVC frame, whole requests that user submits all appoint request corresponding
Controller is handled, the processing that Controller will call corresponding Service component to carry out service logic, electric energy matter
It measures in abatement equipment remote control module, system is communicated by data transfer layer, and instruction is sent data acquisition node, sub- section
Point is communicated by ZigBee, and instruction parsing is issued in power quality controlling equipment；
Step 6: all business operations of Business Logic can carry out persistence by data operation layer, and data are held
Longization operation is completed dependent on the DAO layer assembly of Mybatis frame.DAO layers define interface, and there is no realize specific number
According to operation；Mybatis is by the dynamic proxy method of JDK, in start-up loading configuration file, according to the mapper's of configuration
The realization of xml generation DAO；
Step 7: architecture uses browser/server (B/S) mode, power quality controlling equipment monitoring system table
Existing layer mainly includes that system interface is shown, system interface is realized using JSP, html language；Interface is monitored on-line, in order to improve
The real-time and enhancing usage experience of data transmission use WebSocket technology, and browser once connects with WEB server foundation
After connecing, connection would not be closed, and data can be pushed in time browser end by WebSocket server-side, be rung in real time to realize
It answers.
It is as shown in Figure 1 the power quality controlling equipment on-line monitoring system configuration diagram based on Hadoop and SSM, packet
Include the data collection layer constituted with power quality controlling equipment and its monitoring system, the data transfer layer of ZigBee composition, to close
Be database (MySql, Oracle, Postgres), distributed file system HDFS in Hadoop framework and its including point
Cloth database HBase, Hive constitute data storage layer, are calculated with the data application of MapReduce, Stream software frame
In layer, and integrated SSM frame, the Business Logic and expression layer that Spring, SpringMvc are realized, Mybatis are realized
The DAO layer of persistence.
The hardware for being illustrated in figure 2 present example builds schematic diagram, and wherein Hadoop cluster is to operate in Linux system
On server cluster, including MapReduce, Stream frame, HBase database and HDFS file system.
The data collection layer administers abatement equipment and its matching used on-Line Monitor Device, Zigbee, number by electric energy
According to acquisition child node (local server) composition, wherein primary focus acquires supply voltage deviation, voltage fluctuation and flicker, harmonic wave
The dynamic time sequences data such as containing ratio, the output of electric energy abatement equipment, three-phase imbalance and frequency departure and electric energy abatement equipment
The static datas such as working condition, number of devices, device type.
In the data storage layer, after the socket of main website Cloud Server receives data, is parsed, data are kept in
In relevant database.Dynamic time sequence data are extracted from relevant database using Sqoop, structural data with
Table format storage is to Hive or is converted to the mode of Key-value and stores HBase, can also be arrived with file mode storage
In HDFS.For unstructured data, with catalogue and the storage of the organizational form of file into HDFS.Based on towards column storage
Distributed data base HBase can realize that dynamic time sequence data store, and the data stored in HBase are MapReduce, Stream
The data source of analysis task.The data volume of HBase power quality analysis calculated result is smaller, system to result access when
Prolong it is of less demanding, therefore power quality data analysis result be stored directly in HDFS.
The data transfer layer is as shown in figure 3, data acquisition node client exists first
The file directory and event that monitoring is registered on WindowsWatchService, when registered events occur, notify is sent
Thread.The thread to send instructions under receiving simultaneously notify instruction if receiving instruction issues thread.Server end has one
Special thread handles all IO events, first passes and builds a Selector example, is then registered to various channels,
And interested I/O operation on each channel is specified, finally call a kind of select () method to obtain channel, and obtain from key
Take attachment.
It is dynamic can to write Parallel Algorithm processing using MapReduce, Stream frame according to demand for the calculating application layer
State time series data.HBase same file storage belongs to all data of the same column, when file size is more than the sky of setting
Between after size, current Region can be divided into two Region automatically by storage system.As shown in figure 4, cloud platform Hadoop root
According to tables of data distribution situation in HBase, it is distributed multiple Task and distributed variable-frequencypump is carried out to corresponding dynamic time sequence data.
The Integrated design of the SSM frame modifies the root of Web project as shown in figure 5, in newly-built Web project first
Configuration file web.xml increases the support to Spring frame and Spring MVC frame.It wherein, is integrated Spring frame
Frame needs to be arranged first in web.xml file the path of Spring configuration file applicationContext.xml, simultaneously
The monitor ContextLoaderListener class for being responsible for load Spring context environmental is needed to configure, such is realized
ServletContextListener interface, when Web project initiation, ContextLoaderListener can default execution, and it is real
Existing method, the configuration information of automatic assembling ApplicationContext, complete Spring context environmental creation and just
Beginningization, such as initialization IOC container.Spring is configured in web.xml file simultaneously for integrated Spring MVC frame needs
The DispatcherServlet class of MVC frame, and need through contextConfigLocation parameter setting
The path of SpringMVC configuration file, defaulting corresponding configuration file is the *-servlet.xml under WEB-INF.
DispatcherServlet class is responsible for initializing Spring MVC frame, and completes the monitoring, filtering and distribution of web request.
The Business Logic that described Spring, SpringMvc are realized include electric energy abatement equipment Basic Information Management module,
User and authority management module, remote control module, monitoring point power quality and abatement equipment working state monitoring module, big number
According to analysis result visualization module.
As shown in fig. 6, electric energy abatement equipment Basic Information Management module includes the addition of electric energy abatement equipment information, repairs
Change, search and deletes.Electric energy abatement equipment administrative staff can manage the details of electric energy abatement equipment in this module, such as set
Standby type, specification of equipment, equipment making manufacturer, equipment investment point of use, time of coming into operation etc..
In the power quality controlling equipment remote control module, system is communicated by Socket, and instruction is sent data
Child node is acquired, instruction parsing is issued in power quality controlling equipment by child node by ZigBee communication.
As shown in fig. 7, administrator can assign not respectively according to system different operation in user and authority management module
Same user assigns different operating rights for different user, can also carry out personalized modification etc. in practical applications.
As shown in figure 8, monitoring point power quality and abatement equipment working state monitoring module are by supply voltage deviation, voltage
The real time datas such as fluctuation and flickering, relative harmonic content, the output of electric energy abatement equipment, three-phase imbalance and frequency departure use
Websocket pushes to browser end.For non-real-time data, http communication mode is still used.
The Mybatis realizes persistence DAO layer, by during persistence, need to configure specified data source,
Transaction attributes and some other parameter configuration and mapped file.Mybatis is created according to XML configuration file
SqlSessionFactory, SqlSessionFactory, SqlSession object..SqlSession comprising executing sql institute
All methods needed can directly run the sql sentence of mapping, and the additions and deletions of complete paired data change to look into be submitted with affairs.
The above is only a preferred embodiment of the present invention, it should be pointed out that: the ordinary person of the art is come
It says, without departing from the principle of the present invention, several improvement and retouching can also be made, these are improved also should be regarded as with retouching
Protection scope of the present invention.
Claims (3)
1. a kind of power quality controlling equipment on-line monitoring system based on Hadoop Yu SSM framework, it is characterised in that: the system
System includes the data collection layer constituted with power quality controlling equipment on-line monitoring device, with JAVA multithreading, the non-blocking type of NIO
The director data transport layer that communication, file monitoring service are constituted, with the distribution in relational database MySQL, Hadoop framework
The data storage layer that file system HDFS and its included distributed data base HBase, Hive are constituted, with MapReduce,
Stream software frame constitute data application computation layer, with Spring, Spring MVC realize Business Logic, with
The object data data persistence layer and the front end Bootstrap, Echarts, Websocket mainstream frame of Mybatis building are realized
Data visualization layer.
2. the power quality controlling equipment on-line monitoring system based on Hadoop Yu SSM framework as described in claim 1, special
Sign is: the online monitoring system realized using J2EE programming language, and on the basis of J2EE it is comprehensive using Spring,
Spring MVC and Mybatis frame, wherein Spring is responsible for managing Spring MVC and Mybatis frame as overall framework
Frame, Spring MVC are responsible for completing the service logic control of power quality controlling equipment and realize.
3. a kind of power quality controlling equipment on-line monitoring system based on Hadoop Yu SSM framework as described in claim 1
Construction method, it is characterised in that: the construction method includes the following steps:
Step 1: power quality controlling equipment on-line monitoring device is constituted into data collection layer, data collection layer uses ZigBee
Technology forms wireless sense network, different power quality controlling equipment and its mating on-line monitoring equipment and data is passed through wireless sensing
Data acquisition node is reached on the net, and data collection layer administers the data of abatement equipment, number collected by different electric energy are acquired
According to including static data and dynamic time sequence data, dynamic time sequence data include supply voltage deviation, voltage fluctuation and flicker, harmonic wave
Containing ratio, three-phase imbalance and frequency departure；Static data includes the working condition for the electric energy abatement equipment that investment is administered, sets
Standby number, device type；
Step 2: with technological maheups director data transport layers such as JAVA multithreading, the non-blocking type communication of NIO, file monitoring services,
Data transfer layer includes client and server composition, wherein the monitoring file system that client uses Java 7 newly to introduce
The Watch Service API of change monitor to the file under locally specified catalogue, by registering specified monitoring
Service new data can more will upload after monitoring power quality data update under catalogue；Server uses the non-blocking of NIO
Formula communication mode is used to respond the request of the client high concurrent, high load formula of multiple data collection layers；Client and server
End is all made of multi-thread programming mode, is completed at the same time the multi-task；
Step 3: distributed file system HDFS and its included distribution with relevant database, in Hadoop framework
Database HBase, Hive constitute data storage layer, and static data is stored in relevant database, will dynamic using Sqoop
Time series data is extracted from relevant database, and structural data stores in a table format to Hive or is converted to Key-
The mode of value stores HBase, can also be stored with file mode into HDFS, for unstructured data, with catalogue and text
The organizational form of part is stored into HDFS；
Step 4: Parallel Algorithm can be write using MapReduce, Stream frame according to demand, to the electric energy of on-line monitoring
Quality is analyzed with data are administered, and is obtained life estimation, the state evaluation of electric energy abatement equipment, is excavated the event of electric energy abatement equipment
Hinder potential cause, power quality prediction warning, equipment improvement power status assessment result；
Step 5: Business Logic according to the request of administrator realization power quality controlling equipment is increased, administers record safeguard,
User logs in, user right procuratorial work, administers the inquiry of point power quality, the inquiry of power quality controlling equipment state assessment, long-range electricity
The control of energy quality controlling equipment, power quality big data analysis result queries, the completion of these modules is in Spring MVC
It is realized in the Controller controller of frame, whole requests that user submits all appoint request corresponding
Controller is handled, the processing that Controller will call corresponding Service component to carry out service logic, electric energy matter
It measures in abatement equipment remote control module, system is communicated by data transfer layer, and instruction is sent data acquisition node, sub- section
Instruction parsing is issued in power quality controlling equipment by point by ZigBee communication；
Step 6: all business operations of Business Logic can carry out persistence, the persistence of data by data operation layer
Operation is completed dependent on the DAO layer assembly of Mybatis frame, and DAO layers define interface, does not realize specific data behaviour
Make；Mybatis is given birth in start-up loading configuration file according to the xml of the mapper of configuration by the dynamic proxy method of JDK
At the realization of DAO；
Step 7: architecture uses browser/server (B/S) mode, power quality controlling equipment monitoring system presentation layer
It mainly include that system interface shows that system interface is realized using JSP, html language；It monitors interface on-line, is passed to improve data
After defeated real-time and enhancing usage experience uses WebSocket technology, browser to establish primary connect with WEB server,
Connection would not close, and data can be pushed in time browser end by WebSocket server-side, to realize real-time response.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811579996.0A CN109783556A (en) | 2018-12-24 | 2018-12-24 | Power quality controlling equipment on-line monitoring system and construction method based on Hadoop and SSM framework |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811579996.0A CN109783556A (en) | 2018-12-24 | 2018-12-24 | Power quality controlling equipment on-line monitoring system and construction method based on Hadoop and SSM framework |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109783556A true CN109783556A (en) | 2019-05-21 |
Family
ID=66498064
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811579996.0A Pending CN109783556A (en) | 2018-12-24 | 2018-12-24 | Power quality controlling equipment on-line monitoring system and construction method based on Hadoop and SSM framework |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109783556A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110351608A (en) * | 2019-07-18 | 2019-10-18 | 中国传媒大学 | A kind of radio and television users viewing behavior data slicer system, framework and method |
| CN110413484A (en) * | 2019-08-02 | 2019-11-05 | 西安微电子技术研究所 | A kind of cluster monitoring method for supporting heterogeneous platform |
| CN111143451A (en) * | 2019-12-16 | 2020-05-12 | 中国航空综合技术研究所 | SSM framework design method for hierarchical architecture design |
| CN111427632A (en) * | 2020-02-23 | 2020-07-17 | 西北师范大学 | Psychological assessment method for addicts and operation method of system framework thereof |
| CN111506908A (en) * | 2020-04-10 | 2020-08-07 | 深圳新致软件有限公司 | Big data recommendation method, system and equipment for insurance industry |
| CN112271821A (en) * | 2020-12-21 | 2021-01-26 | 华南理工大学 | Loss-reducing and energy-saving intelligent monitoring and analyzing system for power utilization terminal based on cloud computing |
| CN113176466A (en) * | 2021-05-24 | 2021-07-27 | 苏州大学 | Electric energy quality monitoring system of intelligent electric meter |
| CN113326143A (en) * | 2020-02-28 | 2021-08-31 | 南京理工大学 | Rail transit energy management system based on SSM framework |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103033715A (en) * | 2012-12-25 | 2013-04-10 | 山东电力集团公司电力科学研究院 | Operating status detection system for area equipment in converting station |
| CN104408667A (en) * | 2014-11-20 | 2015-03-11 | 深圳供电局有限公司 | Comprehensive assessment method and system of power quality |
| CN105205729A (en) * | 2015-09-22 | 2015-12-30 | 许继集团有限公司 | Power system energy efficiency public service cloud platform based on cloud computing |
| CN106502772A (en) * | 2016-10-09 | 2017-03-15 | 国网浙江省电力公司信息通信分公司 | Electric quantity data batch high speed processing method and system based on distributed off-line technology |
| CN106651633A (en) * | 2016-10-09 | 2017-05-10 | 国网浙江省电力公司信息通信分公司 | Power utilization information acquisition system and method based on big data technology |
| CN107220360A (en) * | 2017-06-07 | 2017-09-29 | 云南电网有限责任公司信息中心 | A kind of Unified Modeling storage cut-in method based on magnanimity electric power monitoring data |
-
2018
- 2018-12-24 CN CN201811579996.0A patent/CN109783556A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103033715A (en) * | 2012-12-25 | 2013-04-10 | 山东电力集团公司电力科学研究院 | Operating status detection system for area equipment in converting station |
| CN104408667A (en) * | 2014-11-20 | 2015-03-11 | 深圳供电局有限公司 | Comprehensive assessment method and system of power quality |
| CN105205729A (en) * | 2015-09-22 | 2015-12-30 | 许继集团有限公司 | Power system energy efficiency public service cloud platform based on cloud computing |
| CN106502772A (en) * | 2016-10-09 | 2017-03-15 | 国网浙江省电力公司信息通信分公司 | Electric quantity data batch high speed processing method and system based on distributed off-line technology |
| CN106651633A (en) * | 2016-10-09 | 2017-05-10 | 国网浙江省电力公司信息通信分公司 | Power utilization information acquisition system and method based on big data technology |
| CN107220360A (en) * | 2017-06-07 | 2017-09-29 | 云南电网有限责任公司信息中心 | A kind of Unified Modeling storage cut-in method based on magnanimity electric power monitoring data |
Non-Patent Citations (4)
| Title |
|---|
| 叶云龙等: ""基于Web 的电能质量监控系统的研究与设计"", 《电源技术》 * |
| 薛宏攀: ""Web可视化技术在数据挖掘中的研究与应用"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 袁斯烺: ""基于Hadoop与SSM的大数据云存储平台设计与实现"", 《万方学位论文数据库》 * |
| 陆志权: ""工业企业电能质量监测系统架构与实现"", 《中国优秀硕士学位论文全文数据库 工程科技Ⅱ辑》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110351608A (en) * | 2019-07-18 | 2019-10-18 | 中国传媒大学 | A kind of radio and television users viewing behavior data slicer system, framework and method |
| CN110413484A (en) * | 2019-08-02 | 2019-11-05 | 西安微电子技术研究所 | A kind of cluster monitoring method for supporting heterogeneous platform |
| CN110413484B (en) * | 2019-08-02 | 2023-01-31 | 西安微电子技术研究所 | Cluster monitoring method supporting heterogeneous platform |
| CN111143451A (en) * | 2019-12-16 | 2020-05-12 | 中国航空综合技术研究所 | SSM framework design method for hierarchical architecture design |
| CN111427632A (en) * | 2020-02-23 | 2020-07-17 | 西北师范大学 | Psychological assessment method for addicts and operation method of system framework thereof |
| CN113326143A (en) * | 2020-02-28 | 2021-08-31 | 南京理工大学 | Rail transit energy management system based on SSM framework |
| CN111506908A (en) * | 2020-04-10 | 2020-08-07 | 深圳新致软件有限公司 | Big data recommendation method, system and equipment for insurance industry |
| CN111506908B (en) * | 2020-04-10 | 2023-02-17 | 深圳新致软件有限公司 | Big data recommendation method, system and equipment for insurance industry |
| CN112271821A (en) * | 2020-12-21 | 2021-01-26 | 华南理工大学 | Loss-reducing and energy-saving intelligent monitoring and analyzing system for power utilization terminal based on cloud computing |
| CN113176466A (en) * | 2021-05-24 | 2021-07-27 | 苏州大学 | Electric energy quality monitoring system of intelligent electric meter |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109783556A (en) | Power quality controlling equipment on-line monitoring system and construction method based on Hadoop and SSM framework | |
| CN106951694B (en) | Adaptive modeling method for online monitoring system of secondary equipment of power system | |
| CN107315776A (en) | A kind of data management system based on cloud computing | |
| CN107357856A (en) | Implementation method based on power network panorama business model data integration and data, services | |
| CN104615617A (en) | Dispatch monitoring information processing system for substation equipment | |
| CN103338135A (en) | Real-time monitoring method of cluster storage capacity | |
| CN103207920A (en) | Parallel metadata acquisition system | |
| CN114153920A (en) | Big data edge platform and method | |
| CN103455591A (en) | Standard data exchange interface method of parallel cooperative system | |
| CN105303326A (en) | Product full-life-cycle information system based on resource meta-model | |
| CN107766207A (en) | Distributed automatic monitoring method, system, computer-readable recording medium and terminal device | |
| Gagliardelli et al. | A big data platform exploiting auditable tokenization to promote good practices inside local energy communities | |
| CN114281790B (en) | Multi-type load resource aggregator access system and method | |
| CN103745025B (en) | The integrated EMTDC integrated application platforms of high-voltage direct current | |
| CN106682230A (en) | Information service system based on HTML5 and CSS3 mobile display technological architecture | |
| Zhang | The enterprise personnel management system based on B/S Design | |
| Liu et al. | Using semantic web technologies in heterogeneous distributed database system: A case study for managing energy data on mobile devices | |
| CN206193922U (en) | Data management platform system | |
| Wang et al. | Power grid data monitoring and analysis system based on edge computing | |
| Wang | Design and implementation strategy of data migration system based on Hadoop platform | |
| Li et al. | A novel design for data processing framework of park-level power system with data mesh concept | |
| Jing-jing | A New Approach to Economic Operation Monitoring and Analysis Based on the Web | |
| Sun | Intelligent remote monitoring and fault diagnosis of engineering machinery system design | |
| Chang et al. | Distributed storage strategy and visual analysis for economic big data | |
| Wu et al. | A grid-based remote monitoring and diagnosis system for the railway roadbed roller compaction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190521 |