CN111145037A - Big data analysis system - Google Patents
Big data analysis system Download PDFInfo
- Publication number
- CN111145037A CN111145037A CN201811304156.3A CN201811304156A CN111145037A CN 111145037 A CN111145037 A CN 111145037A CN 201811304156 A CN201811304156 A CN 201811304156A CN 111145037 A CN111145037 A CN 111145037A
- Authority
- CN
- China
- Prior art keywords
- data
- way communication
- communication connection
- power
- hash
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007405 data analysis Methods 0.000 title claims abstract description 25
- 238000004891 communication Methods 0.000 claims abstract description 35
- 238000012545 processing Methods 0.000 claims abstract description 23
- 238000006243 chemical reaction Methods 0.000 claims abstract description 14
- 238000001914 filtration Methods 0.000 claims abstract description 14
- 238000005259 measurement Methods 0.000 claims description 11
- 238000000034 method Methods 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 7
- 230000026676 system process Effects 0.000 claims description 2
- 230000005611 electricity Effects 0.000 description 10
- 238000004458 analytical method Methods 0.000 description 2
- 241001609030 Brosme brosme Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/06—Electricity, gas or water supply
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention relates to the technical field of power data analysis, in particular to a big data analysis system, which comprises a power data information acquisition system, wherein the power data information acquisition system is connected with a data conversion system in a one-way communication manner, the data conversion system is connected with a power data information statistical system in a one-way communication manner, the power data information system is connected with a data filtering system in a one-way communication manner, the data filtering system is connected with an operating system in a one-way communication manner, the operating system is connected with a sending system in a one-way communication manner, the sending system is connected with a cloud processing system in a one-way communication manner, the cloud processing system is connected with an operating system in a two-way communication manner, and the cloud processing system is connected with a user terminal in a two-way communication manner. And the operation and management of the equipment are facilitated.
Description
Technical Field
The invention relates to the technical field of electric power data analysis, in particular to a big data analysis system.
Background
Big data (big data, mega data), or huge data, refers to massive, high-growth rate and diversified information assets which need a new processing mode to have stronger decision power, insight and flow optimization capability, and in big data era written by vikto, meier-schenberger and kenius, cusk, the big data refers to shortcuts such as a random analysis method (sampling investigation) but adopts all data for analysis processing, and the big data attracts more and more attention as the cloud era comes, so that the equipment needs to consume a large amount of electric energy in a long-term operation process, and if the electric energy consumed by the equipment at each moment is counted, the electricity utilization conditions of the equipment, such as a power utilization peak period, a power utilization low peak period and an abnormal power utilization period, can be known, so that the power management of the equipment is facilitated. Therefore, a big data analysis system is provided.
Disclosure of Invention
The invention aims to solve the defects in the prior art and provides a big data analysis system.
In order to achieve the purpose, the invention adopts the following technical scheme:
a big data analysis system comprises a power data information acquisition system, wherein the power data information acquisition system is in one-way communication connection with a data conversion system, the data conversion system is in one-way communication connection with a power data information statistics system, the power data information system is in one-way communication connection with a data filtering system, the data filtering system is in one-way communication connection with an operating system, the operating system is in one-way communication connection with a sending system, the sending system is in one-way communication connection with a cloud processing system, the cloud processing system is in one-way communication connection with an operating system, and the cloud processing system is in two-way communication connection with a user terminal;
the electric power data information statistical system performs statistics on electric power data by performing Hash operation, and the statistical process comprises the following steps: the depth of the hash bucket is preset, the depth of the hash bucket is subjected to weighted summation again according to the voltage, current, active and reactive measurement data, the hash values of the voltage, current, active and reactive measurement data packet messages are obtained, and the specific data of the hash values are accumulated by the corresponding counter values every time the hash values are received within unit time.
Preferably, the electric power data information acquisition system receives power frequency electric quantity, voltage, current, active power and reactive power measurement data of the electric equipment acquired by the RTU, and integrates the data in the same type.
Preferably, the data conversion system converts the data acquired by the electric power data information acquisition system into a computer language for transmission and storage.
Preferably, the process of accumulating the hash value of the counter value by the counter value is as follows: and obtaining the hash value of the current data packet message according to the packet header information of the current data packet message, performing weighted summation on the hash value of the current data packet message and the hash value of the historical data packet message, storing the summation result in a hash bucket, and replacing the data in the original hash bucket.
Preferably, the data filtering system processes the electric power data information acquired by the electric power data information acquisition system by adopting a Bloom Filter algorithm.
Preferably, the operating system comprises an LED display screen, an operating panel, a reading module and a transmitting module.
Preferably, the cloud processing system comprises a cloud computing module and a cloud storage module.
Preferably, the user terminal comprises a computer end and a PC end, and the computer end and the PC end are in communication connection with the cloud processing system through the wireless transmission assembly.
The invention has the beneficial effects that:
1. according to the invention, the RTU is used for collecting the power data, the collecting result is accurate, the collecting process is efficient, and the result reliability is high, so that the data statistics has the characteristics of high efficiency and safety.
2. According to the invention, the big data is analyzed and counted by utilizing the Hash operation, so that the data analysis process is more intelligent, the data analysis result has uniqueness, and the data analysis result is more accurate.
3. According to the invention, the electricity utilization condition of the equipment is counted by utilizing big data analysis, the data analysis support required by daily operation of the equipment can be met, the operation and use conditions of the equipment can be more clearly appointed, and the operation and management of the equipment are facilitated.
Drawings
Fig. 1 is a schematic structural diagram of a big data analysis system according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Referring to fig. 1, a big data analysis system comprises a power data information collection system (the power data information collection system receives power frequency electric quantity, voltage, current, active and reactive measurement data of electric equipment collected by an RTU and integrates the data in the same type), the power data information collection system is in one-way communication connection with a data conversion system (the data conversion system converts the data collected by the power data information collection system into a computer language for transmission and storage), the data conversion system is in one-way communication connection with a power data information statistics system (the power data information statistics system performs statistics on the power data by performing hash operation, the statistics process comprises the steps of presetting the depth of a hash bucket, performing weighted summation on the depth of the hash bucket according to the voltage, current, active and reactive measurement data to obtain voltage, reactive power data, and the data conversion system performs similar integration on the data, The hash values of the current, active and reactive measurement data packet messages are calculated by the corresponding counter value every time the hash value is received in unit time, and the process of accumulating the specific data of the hash value by the counter value is as follows: the hash value of the current data packet message is obtained according to the packet header information of the current data packet message, the hash value of the current data packet message and the hash value of the historical data packet message are weighted and summed, the summed result is stored in a hash bucket and replaces the data in the original hash bucket, the power data information system is connected with a data filtering system in a one-way communication mode (the data filtering system adopts a Bloom Filter algorithm for processing and analyzing the power data information acquired by the power data information acquisition system), the data filtering system is connected with an operating system in a one-way communication mode (the operating system comprises an LED display screen, an operating panel, a reading module and a transmission module), the operating system is connected with a sending system in a one-way communication mode, and the sending system is connected with a cloud processing system in a one-way communication mode (the cloud processing system comprises a cloud computing module and a cloud storage module), the cloud processing system is connected with the operating system in a one-way communication mode, and the cloud processing system is connected with the user terminal in a two-way communication mode (the user terminal comprises a computer end and a PC end which are in communication connection with the cloud processing system through a wireless transmission assembly).
Example (b): when a big data analysis system is used for analyzing and processing the electricity utilization information of equipment, the electricity utilization information of a plurality of same equipment, such as power frequency electricity quantity, voltage, current, active power and reactive power measurement data of the electricity utilization equipment, is transmitted to an RTU system in a distributed measurement and control mode, the RTU system performs similar processing on collected data, namely, data information of the same type is stored in the same area, data in the same area is classified, marked and statistically summed, the RTU also performs data conversion on the processed information through a data conversion system, converts the data into a computer language and transmits the computer language to an electricity data information statistical system, the electricity data information statistical system performs Hash operation on the statistically summed data in the electricity data, the depth of a Hash barrel is preset to be 0, and the depth of the Hash barrel is set for the first time according to the statistical summation of the voltage, the current, the active power and the reactive power, obtaining the hash values of the voltage, current, active and reactive measurement data packet messages, and accumulating the specific data of the hash value by the corresponding counter value every time the hash value is received in unit time, wherein the process of accumulating the specific data of the hash value by the counter value is as follows: the hash value of the current data packet message is obtained according to the header information of the current data packet message, the hash value of the current data packet message and the hash value of the historical data packet message are weighted and summed, the summed result is stored in a hash bucket and replaces the data in the original hash bucket, then the data stored in the hash bucket again is transmitted to a data filtering system, the data filtering system filters the data by using a Bloom Filter algorithm, the data is filtered by a preset data filtering rule, the filtered data is transmitted to an operating system, the data is displayed in a curve table mode in an LED display screen, meanwhile, the operating panel can call out the data in the cloud storage system by a reading module and compare the data with the existing data, the filtered data is transmitted to a transmitting system by a transmitting module, and the data is transmitted to a cloud computing module by the transmitting system, the cloud computing module compares the current data with the historical synchronization data, compares the current data with the current data, makes a comparison curve, a broken line and a histogram, transmits the result into the cloud storage module for storage, and can use a mobile phone or a computer to call out the data in the cloud storage module to analyze the electricity utilization information of the equipment.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (8)
1. The big data analysis system comprises a power data information acquisition system and is characterized in that the power data information acquisition system is in one-way communication connection with a data conversion system, the data conversion system is in one-way communication connection with a power data information statistics system, the power data information system is in one-way communication connection with a data filtering system, the data filtering system is in one-way communication connection with an operating system, the operating system is in one-way communication connection with a sending system, the sending system is in one-way communication connection with a cloud processing system, the cloud processing system is in one-way communication connection with the operating system, and the cloud processing system is in two-way communication connection with a user terminal;
the electric power data information statistical system performs statistics on electric power data by performing Hash operation, and the statistical process comprises the following steps: the depth of the hash bucket is preset, the depth of the hash bucket is subjected to weighted summation again according to the voltage, current, active and reactive measurement data, the hash values of the voltage, current, active and reactive measurement data packet messages are obtained, and the specific data of the hash values are accumulated by the corresponding counter values every time the hash values are received within unit time.
2. The big data analysis system according to claim 1, wherein the electric power data information collection system receives the measured data of power frequency electric quantity, voltage, current, active power and reactive power of the electric equipment collected by the RTU, and integrates the data in the same type.
3. The big data analysis system of claim 1, wherein the data conversion system converts the data collected by the power data information collection system into a computer language for transmission and storage.
4. The big data analysis system according to claim 1, wherein the counter value is accumulated with the hash value by: and obtaining the hash value of the current data packet message according to the packet header information of the current data packet message, performing weighted summation on the hash value of the current data packet message and the hash value of the historical data packet message, storing the summation result in a hash bucket, and replacing the data in the original hash bucket.
5. The big data analysis system according to claim 1, wherein the data filtering system processes the big data by using a Bloom Filter algorithm, and processes and analyzes the electric power data information collected by the electric power data information collection system.
6. The big data analysis system according to claim 1, wherein the operating system comprises an LED display screen, an operating panel, a reading module and a transmitting module.
7. The big data analysis system according to claim 1, wherein the cloud processing system comprises a cloud computing module and a cloud storage module.
8. The big data analysis system according to claim 1, wherein the user terminal comprises a computer terminal and a PC terminal, and the computer terminal and the PC terminal are in communication connection with the cloud processing system through a wireless transmission component.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811304156.3A CN111145037A (en) | 2018-11-03 | 2018-11-03 | Big data analysis system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811304156.3A CN111145037A (en) | 2018-11-03 | 2018-11-03 | Big data analysis system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111145037A true CN111145037A (en) | 2020-05-12 |
Family
ID=70516330
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811304156.3A Pending CN111145037A (en) | 2018-11-03 | 2018-11-03 | Big data analysis system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111145037A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117579723A (en) * | 2023-11-22 | 2024-02-20 | 东亚银行(中国)有限公司 | Message parsing method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013034096A (en) * | 2011-08-02 | 2013-02-14 | Nec Corp | Access control system, terminal device, relay device, and access control method |
| CN105388768A (en) * | 2015-10-19 | 2016-03-09 | 浙江爱德利电器股份有限公司 | Remote circuit control system and method based on cloud platform |
| KR101621931B1 (en) * | 2014-12-19 | 2016-05-17 | 한국인터넷진흥원 | Power information transmitting and receiving system in the smart grid |
| CN107590681A (en) * | 2017-08-16 | 2018-01-16 | 佛山市高研信息技术有限公司 | A kind of big data analysis system |
| CN108521413A (en) * | 2018-04-02 | 2018-09-11 | 江苏中控安芯信息安全技术有限公司 | A kind of network of Future Information war is resisted and defence method and system |
-
2018
- 2018-11-03 CN CN201811304156.3A patent/CN111145037A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013034096A (en) * | 2011-08-02 | 2013-02-14 | Nec Corp | Access control system, terminal device, relay device, and access control method |
| KR101621931B1 (en) * | 2014-12-19 | 2016-05-17 | 한국인터넷진흥원 | Power information transmitting and receiving system in the smart grid |
| CN105388768A (en) * | 2015-10-19 | 2016-03-09 | 浙江爱德利电器股份有限公司 | Remote circuit control system and method based on cloud platform |
| CN107590681A (en) * | 2017-08-16 | 2018-01-16 | 佛山市高研信息技术有限公司 | A kind of big data analysis system |
| CN108521413A (en) * | 2018-04-02 | 2018-09-11 | 江苏中控安芯信息安全技术有限公司 | A kind of network of Future Information war is resisted and defence method and system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117579723A (en) * | 2023-11-22 | 2024-02-20 | 东亚银行(中国)有限公司 | Message parsing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110333402B (en) | User voltage abnormity sensing method and system based on edge calculation | |
| CN102932447A (en) | Distribution room remote data acquisition and analysis system | |
| CN112071047A (en) | Resident home leaving and returning behavior judgment method | |
| CN107907759A (en) | The electricity monitoring system and method for power equipment | |
| CN102571429B (en) | A kind of OO intelligent power distribution communication business analyzing method and related device | |
| CN110971001A (en) | Electric power monitoring system and method | |
| CN115642652A (en) | Electric power adjusting device based on artificial intelligence | |
| CN111145037A (en) | Big data analysis system | |
| CN104111945A (en) | Storage management method and system for massive power-quality data | |
| CN110703019A (en) | Power consumption abnormity accurate positioning method based on collected information of power transmission line | |
| CN201426043Y (en) | Load control and management system based on GPRS network | |
| CN103838194A (en) | Intelligent energy-consumption data acquisition system based on wireless network | |
| CN213579446U (en) | Fault detection, operation and maintenance reporting and monitoring system | |
| CN209589132U (en) | A kind of full factory in power station based on big data monitors system | |
| CN112947255A (en) | Energy consumption management system | |
| CN216248879U (en) | Smart power grids safety monitoring system based on multisource data | |
| CN112489400A (en) | Electric mobile operation terminal early warning system and method based on flow analysis | |
| CN209896770U (en) | Intelligent monitoring and analyzing system for pumped storage power station service power grid | |
| CN113009869A (en) | Intelligent power maintenance management system | |
| CN111696301A (en) | Electric fire monitoring device and system based on LoRaWAN technology | |
| CN111797280A (en) | Big data-based information collection and analysis system | |
| CN111538640B (en) | Dynamic analysis data chain | |
| Yang et al. | Sliding-Time-Window and Event-Trigger Based Data Collection Strategy for Non-intrusive Load Monitoring | |
| CN204442016U (en) | Electrical network clean energy resource access remote real-time centralized supervisory control system | |
| CN103972982A (en) | Remote monitoring system and remote monitoring method for hydrogen fuel standby power network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200512 |
|
| RJ01 | Rejection of invention patent application after publication |