CN110413668B - Intelligent processing system for water conservancy informationized data - Google Patents
Intelligent processing system for water conservancy informationized data Download PDFInfo
- Publication number
- CN110413668B CN110413668B CN201910533302.8A CN201910533302A CN110413668B CN 110413668 B CN110413668 B CN 110413668B CN 201910533302 A CN201910533302 A CN 201910533302A CN 110413668 B CN110413668 B CN 110413668B
- Authority
- CN
- China
- Prior art keywords
- data
- module
- calculation
- processing system
- mqtt
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A20/00—Water conservation; Efficient water supply; Efficient water use
- Y02A20/152—Water filtration
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a water conservancy informationized data intelligent processing system which comprises a data source module externally connected with a plurality of data acquisition modules, a message bus connected with the output end of the data source module, a database connected with the output end of the message bus and a data analysis module for analyzing the database. The beneficial effects of the invention are as follows: the invention effectively realizes the analysis and aggregation of the data and the storage of the data, is convenient for later use and inquiry, and can perform data inquiry in real time.
Description
Technical Field
The invention relates to the technical field of water conservancy information processing, in particular to an intelligent water conservancy informationized data processing system.
Background
Hydraulic engineering construction has increasingly highlighted automation, informatization and precision along with technological advancement and development. At present, the information processing system and method applied to hydraulic engineering are mostly set by adopting the purpose with stronger pertinence. For example, if the water bloom condition in the target water area is to be known, that is, the water bloom detection device is arranged at a plurality of monitoring points in the target water area, and the water bloom information detected by the water bloom detection device is transmitted to a laboratory or a monitoring center so as to be convenient for laboratory staff to analyze.
Therefore, the information processing method and system for hydraulic engineering are single in function.
Disclosure of Invention
The invention aims to provide an intelligent processing system for water conservancy informationized data, which can analyze and aggregate the data and store the data, and is convenient for later use and inquiry.
The invention is realized by the following technical scheme:
the intelligent water conservancy informationized data processing system comprises a data source module externally connected with a plurality of data acquisition modules, a message bus connected with the output end of the data source module, a database connected with the output end of the message bus and a data analysis module for analyzing the database.
The external data acquisition module transmits the data to the data source module, the data source module carries out data conversion on the acquired data, filters the validity of the data, calculates the data, judges whether the calculated data exceeds a specified threshold value, detects and analyzes the running state of each data acquisition module and transmits the calculated data to the database, and the database transmits the data to the data analysis module for data aggregation analysis and stores the data to the database; providing for subsequent work. And inquiring service of original data, real-time data, converged data and report data.
Further, in order to better implement the invention, the data source module comprises an MQTT acquisition module and a data synchronization module respectively, and the output ends of the MQTT acquisition module and the data synchronization module are respectively connected with the input end of the message bus.
Further, in order to better realize the invention, the message bus comprises a data conversion module, a data filtering module, a calculation module, an early warning module and a message queue pool which are connected in sequence; the input end of the data conversion module is connected with the output end of the data source module, and the output end of the message queue pool is connected with the database;
and a data conversion module: converting the numerical units of the collected measurement data, and converting the measurement data and the real data;
and a data filtering module: filtering the effective value of the measured data, identifying the real and effective measured data, and marking the abnormal data;
the calculation module: the water level flow, the water level reservoir capacity, the water level amplitude and the water quality grade are calculated;
and the early warning module is used for: the method comprises the steps of taking charge of threshold ranges of various measured data indexes, processing an early warning process and generating a corresponding type of alarm;
message queue pool: the message queue pool sets a Topic, and the database subscribes to the Topic to obtain data under the Topic.
Further, in order to better realize the invention, the message bus also comprises a fault detection module connected with the output ends of the MQTT acquisition module and the data synchronization module respectively;
and a fault detection module: and the processing of the abnormal state of the equipment of the data acquisition module is responsible for generating corresponding equipment abnormal records according to the requirements.
Further, in order to better realize the invention, the measurement data indexes comprise a water level overrun index, a 24-hour rainfall overrun index, a water quality prediction overrun index and a water quality index amplitude overrun index.
Further, in order to better realize the invention, the data transfer among the data conversion module, the data filtering module, the calculation module, the early warning module and the message queue pool is carried out through the RabbitMQ queue.
Further, in order to better realize the invention, the MQTT acquisition module is connected with a plurality of data acquisition modules through an MQTT protocol.
Compared with the prior art, the invention has the following advantages:
the invention effectively realizes the analysis and aggregation of the data and the storage of the data, is convenient for later use and inquiry, and can perform data inquiry in real time.
Drawings
FIG. 1 is a schematic of the workflow of the present invention.
Detailed Description
The present invention will be described in further detail with reference to examples, but embodiments of the present invention are not limited thereto.
Example 1:
the invention is realized by the following technical scheme, as shown in fig. 1, the intelligent processing system for water conservancy informationized data comprises a data source module externally connected with a plurality of data acquisition modules, a message bus connected with the output end of the data source module, a database connected with the output end of the message bus and a data analysis module for analyzing the database.
The external data acquisition module transmits the data to the data source module, the data source module carries out data conversion on the acquired data, filters the validity of the data, calculates the data, judges whether the calculated data exceeds a specified threshold value, detects and analyzes the running state of each data acquisition module and transmits the calculated data to the database, and the database transmits the data to the data analysis module for data aggregation analysis and stores the data to the database; the method provides inquiry services of original data, real-time data, converged data and report data for subsequent work and can support the technology of a third-party platform.
Example 2:
further, as shown in fig. 1, in order to better implement the present invention, the data source module includes an MQTT collection module and a data synchronization module, where output ends of the MQTT collection module and the data synchronization module are connected to input ends of the message bus, respectively.
It should be noted that, through the improvement, the invention provides a plurality of connection modes for connecting with the data acquisition module, and the connection modes are diversified, so that the utilization rate of the invention is better; when the data synchronization module is used for realizing the connection with the data acquisition module, a temporary database is established in the data source module, and the data synchronization module is used for realizing the connection with the data acquisition module through the temporary database.
When the MQTT acquisition module is adopted to realize the connection with the data acquisition module, the MQTT acquisition module realizes the connection with the data acquisition module through an MQTT protocol. The MQTT collection module herein refers to a device having MQTT collection software.
Other portions of the present embodiment are the same as those of the above embodiment, and thus will not be described again.
Example 3:
further, as shown in fig. 1, in order to better implement the present invention, the message bus includes a data conversion module, a data filtering module, a calculation module, an early warning module, and a message queue pool, which are sequentially connected; the input end of the data conversion module is connected with the output end of the data source module, and the output end of the message queue pool is connected with the database;
and a data conversion module: numerical unit conversion of the measurement data acquired by the data acquisition module, and conversion of the measurement data and the real data; if the measured data of the partial reservoir water level is not real data, the measured data of the dam height Cheng Jianqu is needed to be used, and then the measured data of the partial reservoir water level is real reservoir water level data;
and a data filtering module: after the data conversion module converts the measurement data acquired by the data acquisition module, filtering the effective value of the measurement data, identifying the real and effective measurement data, and marking the abnormal data;
the calculation module: the measured data processed by the data filtering module realizes the calculation of water level flow, water level reservoir capacity, water level amplitude and water quality grade;
and the early warning module is used for: judging the measured data calculated by the calculation module, setting the threshold range of each measured data index, processing the early warning flow when the measured data is higher or lower than the threshold range, and generating a corresponding type of alarm;
message queue pool: the message queue pool sets a Topic, and the database subscribes to the Topic to obtain data under the Topic. Multiple subscriptions are implemented by setting the Topic. When in use, the system can be expanded according to the needs, for example, one path of data is distributed to third party software or a platform; so long as the third party software or platform makes a corresponding Topic subscription.
Other portions of the present embodiment are the same as those of the above embodiment, and thus will not be described again.
Example 4:
further, as shown in fig. 1, in order to better implement the present invention, the message bus further includes a fault detection module connected to the output ends of the MQTT collection module and the data synchronization module, respectively; the fault detection module detects abnormal conditions of the data acquisition module through the MQTT acquisition module or the data synchronization module and generates abnormal records of the data acquisition module according to requirements.
And a fault detection module: and the processing of the abnormal state of the equipment of the data acquisition module is responsible for generating corresponding equipment abnormal records according to the requirements.
Further, in order to better realize the invention, the measurement data indexes comprise a water level overrun index, a 24-hour rainfall overrun index, a water quality prediction overrun index and a water quality index amplitude overrun index.
Further, in order to better realize the invention, the data transfer among the data conversion module, the data filtering module, the calculation module, the early warning module and the message queue pool is carried out through the RabbitMQ queue.
The message bus ensures that the message is not lost by using a message persistence of RabbitMQ and a publisher Confirm mechanism and a subscriber ACK mechanism so as to ensure the safety of data transmission.
Further, in order to better realize the invention, the MQTT acquisition module is connected with a plurality of data acquisition modules through an MQTT protocol.
Other portions of the present embodiment are the same as those of the above embodiment, and thus will not be described again.
Example 5:
the embodiment is a specific implementation mode of the invention, a plurality of water level sensors, a plurality of water quality detectors, a plurality of water quality sensors and a plurality of water flow sensors are respectively connected with an MQTT acquisition module, and a fault detection module is respectively connected with the plurality of water level sensors, the plurality of water quality detectors and the plurality of water quality sensors through the MQTT acquisition module, so that the detection of the running states of the plurality of water level sensors, the plurality of water quality detectors and the plurality of water quality sensors is realized, and when abnormality occurs, corresponding equipment abnormality records are generated according to requirements; the data that a plurality of water level sensor, a plurality of water quality detector, a plurality of water quality sensor gathered it pass through MQTT collection module and transmit to data conversion module, and data conversion module carries out data conversion to the data information who obtains, namely: the conversion between the measured data and the real data is realized, for example, the measured data of partial reservoir water level is not the real data, and the real reservoir water level data is only the measured data of the dam height Cheng Jianqu; the converted data identifies real and effective measurement data through a data filtering module, and records and marks abnormal data; the filtered data can realize water level flow calculation, water level reservoir capacity calculation, water level amplitude calculation and water quality grade calculation through a calculation module; the calculated data are transmitted to an early warning module, a threshold range of related calculation data is set in the early warning module, the early warning module obtains the calculated data and then compares the calculated data with the threshold range of the index, and if the calculated data are higher or lower than the threshold range, corresponding warning information is generated according to the related index. The alarm information and the calculated data information are transmitted to a message array pool, the calculated data are transmitted to a data analysis module for aggregation analysis through the message array pool and a database, and the data after aggregation analysis are transmitted to the database for storage; the message array pool is set as the Topic to enable the third party software or platform to query related data information when in use.
The foregoing description is only a preferred embodiment of the present invention, and is not intended to limit the present invention in any way, and any simple modification, equivalent variation, etc. of the above embodiment according to the technical matter of the present invention fall within the scope of the present invention.
Claims (5)
1. A water conservancy informationized data intelligent processing system is characterized in that: the system comprises a data source module externally connected with a plurality of data acquisition modules, a message bus connected with the output end of the data source module, a database connected with the output end of the message bus and a data analysis module for analyzing the database; the data source module comprises an MQTT acquisition module and a data synchronization module, and the output ends of the MQTT acquisition module and the data synchronization module are respectively connected with the input end of the message bus; the message bus comprises a data conversion module, a data filtering module, a calculation module, an early warning module and a message queue pool which are connected in sequence; the input end of the data conversion module is connected with the output end of the data source module, and the output end of the message queue pool is connected with the database;
and a data conversion module: converting the numerical units of the collected measurement data, and converting the measurement data and the real data;
and a data filtering module: filtering the effective value of the measured data, identifying the real and effective measured data, and marking the abnormal data;
the calculation module: realizing water level flow calculation, water level reservoir capacity calculation, water level amplitude calculation and water quality grade calculation;
and the early warning module is used for: the method comprises the steps of taking charge of threshold ranges of various measured data indexes, processing an early warning process and generating a corresponding type of alarm;
message queue pool: the message queue pool sets a Topic, and the database subscribes to the Topic to obtain data under the Topic.
2. The intelligent water conservancy informationized data processing system according to claim 1, wherein: the message bus also comprises a fault detection module which is respectively connected with the output ends of the MQTT acquisition module and the data synchronization module;
and a fault detection module: and the processing of the abnormal state of the equipment of the data acquisition module is responsible for generating corresponding equipment abnormal records according to the requirements.
3. The intelligent water conservancy informationized data processing system according to claim 1, wherein: the measured data indexes comprise a water level overrun index, a 24-hour rainfall overrun index, a water quality prediction overrun index and a water quality index amplitude overrun index.
4. The intelligent water conservancy informationized data processing system according to claim 1, wherein: and data transmission among the data conversion module, the data filtering module, the calculation module, the early warning module and the message queue pool is performed through the RabbitMQ queue.
5. An intelligent water conservancy informationized data processing system according to any one of claims 1-4 and wherein: the MQTT acquisition module is connected with the plurality of data acquisition modules through an MQTT protocol.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910533302.8A CN110413668B (en) | 2019-06-19 | 2019-06-19 | Intelligent processing system for water conservancy informationized data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910533302.8A CN110413668B (en) | 2019-06-19 | 2019-06-19 | Intelligent processing system for water conservancy informationized data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110413668A CN110413668A (en) | 2019-11-05 |
| CN110413668B true CN110413668B (en) | 2023-08-11 |
Family
ID=68359367
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910533302.8A Active CN110413668B (en) | 2019-06-19 | 2019-06-19 | Intelligent processing system for water conservancy informationized data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110413668B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102426442A (en) * | 2011-10-13 | 2012-04-25 | 湖南城市学院 | Water resource real-time monitoring and managing method and system of complicated water system |
| CN104134106A (en) * | 2013-05-05 | 2014-11-05 | 南京理工大学连云港研究院 | Water conservancy intelligent decision supporting system and water conservancy intelligent decision method |
| CN104639625A (en) * | 2015-01-27 | 2015-05-20 | 华南理工大学 | Data concentrator acquisition control method based on MQTT (Message Queuing Telemetry Transport), data concentrator acquisition control device based on MQTT and data concentrator acquisition control system based on MQTT |
| CN107968840A (en) * | 2017-12-15 | 2018-04-27 | 华北电力大学（保定） | A kind of extensive power equipment monitoring, alarming Real-time Data Processing Method and system |
| CN207366013U (en) * | 2017-10-17 | 2018-05-15 | 武汉力地液压设备有限公司 | A kind of intelligent monitor system for water conservancy |
| KR101867400B1 (en) * | 2017-02-17 | 2018-06-15 | 금오공과대학교 산학협력단 | Water Quality Monitoring System based on Wireless Sensor Network |
| CN109299830A (en) * | 2018-10-26 | 2019-02-01 | 国家电网有限公司 | A kind of hydrologic forecast system and method based on Soil Moisture Monitoring |
| CN109376974A (en) * | 2018-08-08 | 2019-02-22 | 成都万江港利科技股份有限公司 | A kind of Water Resources Irrigation total management system |
| CN109814481A (en) * | 2019-01-21 | 2019-05-28 | 北京舞水科技有限公司 | A kind of wisdom aquatic products managing and control system merged based on Internet of Things and meteorological data |
-
2019
- 2019-06-19 CN CN201910533302.8A patent/CN110413668B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102426442A (en) * | 2011-10-13 | 2012-04-25 | 湖南城市学院 | Water resource real-time monitoring and managing method and system of complicated water system |
| CN104134106A (en) * | 2013-05-05 | 2014-11-05 | 南京理工大学连云港研究院 | Water conservancy intelligent decision supporting system and water conservancy intelligent decision method |
| CN104639625A (en) * | 2015-01-27 | 2015-05-20 | 华南理工大学 | Data concentrator acquisition control method based on MQTT (Message Queuing Telemetry Transport), data concentrator acquisition control device based on MQTT and data concentrator acquisition control system based on MQTT |
| KR101867400B1 (en) * | 2017-02-17 | 2018-06-15 | 금오공과대학교 산학협력단 | Water Quality Monitoring System based on Wireless Sensor Network |
| CN207366013U (en) * | 2017-10-17 | 2018-05-15 | 武汉力地液压设备有限公司 | A kind of intelligent monitor system for water conservancy |
| CN107968840A (en) * | 2017-12-15 | 2018-04-27 | 华北电力大学（保定） | A kind of extensive power equipment monitoring, alarming Real-time Data Processing Method and system |
| CN109376974A (en) * | 2018-08-08 | 2019-02-22 | 成都万江港利科技股份有限公司 | A kind of Water Resources Irrigation total management system |
| CN109299830A (en) * | 2018-10-26 | 2019-02-01 | 国家电网有限公司 | A kind of hydrologic forecast system and method based on Soil Moisture Monitoring |
| CN109814481A (en) * | 2019-01-21 | 2019-05-28 | 北京舞水科技有限公司 | A kind of wisdom aquatic products managing and control system merged based on Internet of Things and meteorological data |
Non-Patent Citations (1)
| Title |
|---|
| 冯慧阳.《智能水电厂一体化管控技术的研究》.《中国优秀硕士学位论文工程科技Ⅱ辑》.2017,全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110413668A (en) | 2019-11-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN211206462U (en) | Thing networking water quality monitoring system | |
| CN102681567A (en) | Concrete temperature remote monitoring system for concrete dam | |
| CN105573257A (en) | Remote monitoring method for sewage treatment | |
| CN205301926U (en) | Embedded high -speed water pump vibrations data acquisition system based on DSP | |
| CN117072883A (en) | Urban drainage pipe network remote monitoring maintenance system based on Internet of things technology | |
| CN115616341A (en) | Operation and maintenance monitoring system for remotely and automatically searching power cable line based on Internet of things | |
| CN109246640A (en) | A kind of Continuous Bridge work progress stress monitoring system and method | |
| CN110413668B (en) | Intelligent processing system for water conservancy informationized data | |
| CN1625110A (en) | Environmental protection water quality remote monitoring alarm system | |
| CN109341757A (en) | A kind of the intelligent detecting prewarning system and its application method of information system operation data | |
| CN116187980B (en) | Visual intelligent management system for environmental protection equipment based on data transmission | |
| CN117639270A (en) | Transformer substation monitoring and operation and maintenance system based on digital twinning | |
| CN116131755B (en) | Intelligent control system and method for solar power generation equipment | |
| CN112702435A (en) | Intelligent management system for sewage treatment of thermal power plant | |
| CN109828092A (en) | A kind of sewage monitoring system | |
| CN206773920U (en) | A kind of sensing circuit of bad weather road conditions automatic early-warning system | |
| CN213302459U (en) | Hydraulic generator fault warning system | |
| CN212112218U (en) | Wisdom sewage plant station remote supervision and operation evaluation system based on thing networking | |
| CN103631232A (en) | Data monitoring control method and data monitoring control device | |
| CN111614561A (en) | Intelligent road side data transmission method and device based on edge calculation and distributed system | |
| CN208987188U (en) | A kind of Continuous Bridge work progress stress monitoring system | |
| CN206601125U (en) | Transformer station's sedimentation monitoring system based on fibre-optical grating sensor network | |
| CN111443401A (en) | Weather prediction and information transfer system based on expressway network | |
| CN202614641U (en) | On-line monitoring device for cleanness of hydraulic lubricating oil product | |
| CN210469743U (en) | Underground space roof sinking monitoring device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |