CN110413668A - A kind of Water Conservancy Information data intelligence processing system - Google Patents
A kind of Water Conservancy Information data intelligence processing system Download PDFInfo
- Publication number
- CN110413668A CN110413668A CN201910533302.8A CN201910533302A CN110413668A CN 110413668 A CN110413668 A CN 110413668A CN 201910533302 A CN201910533302 A CN 201910533302A CN 110413668 A CN110413668 A CN 110413668A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- index
- output end
- water conservancy
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A20/00—Water conservation; Efficient water supply; Efficient water use
- Y02A20/152—Water filtration
Abstract
The invention discloses a kind of Water Conservancy Information data intelligence processing systems, data source modules including external multiple data acquisition modules, the messaging bus connecting with data source modules output end, the database connecting with messaging bus output end and for the data analysis module to database analysis.The beneficial effects of the present invention are: the present invention effectively realizes the analysis for being able to carry out data and convergence and stores to data, uses and inquire convenient for the later period, it being capable of real-time perfoming data query.
Description
Technical field
The present invention relates to water conservancy technical field of information processing, are a kind of Water Conservancy Information data intelligence processing specifically
System.
Background technique
Hydraulic engineering construction has increasingly highlighted it with development with advances in technology and has automated, is information-based and accurate
Change.It is applied to the information processing system and method for hydraulic engineering at present, mostly uses the stronger purpose of specific aim greatly and set.Example
Such as, if for the wawter bloom situation in master goal waters, i.e., in multiple monitoring points of the target water, setting wawter bloom detects dress
It sets, and the wawter bloom information that wawter bloom detection device detects is transmitted to laboratory or monitoring center, in order to experimenter
It is analyzed.
It follows that existing known information processing method and system function for hydraulic engineering is more single.
Summary of the invention
The purpose of the present invention is to provide a kind of Water Conservancy Information data intelligence processing systems, are able to carry out the analysis of data
With converge and data are stored, use and inquire convenient for the later period.
The present invention is achieved through the following technical solutions:
A kind of Water Conservancy Information data intelligence processing system, data source modules and number including external multiple data acquisition modules
According to the messaging bus of source module output end connection, the database being connect with messaging bus output end and for database analysis
Data analysis module.
External data acquisition module is by several water conservancies according to passing to data source modules, and data source modules are by data collected
Data conversion is carried out, the filtering of data validity, data are calculated, judge whether being more than defined to the data after calculating
Threshold value is detected and analyzed the operating status of each data acquisition module and the data after calculating is transferred to database, number
Data analysis module progress data convergence analysis is transferred data to according to library and is saved in database；It is provided for subsequent operation.It is former
Beginning data, real time data, convergence data, the query service of report data.
Further, in order to preferably realize the present invention, the data source modules include difference MQTT acquisition module sum number
According to synchronization module, the output end of MQTT acquisition module and data simultaneous module is connect with the input terminal of messaging bus respectively.
Further, in order to preferably realize the present invention, the messaging bus include sequentially connected data conversion module,
Data filtering module, computing module, warning module, message queue pool；The input terminal and data source mould of the data conversion module
The output end of block connects, and the message queue pool output end is connect with database；
Data conversion module: to the numerical value Conversion of measurement unit of the measurement data of acquisition, the conversion of measurement data and truthful data；
Data filtering module: the virtual value of measurement data is filtered, identifies authentic and valid measurement data, abnormal data is carried out
Label；
Computing module: stage-discharge, water level storage capacity, range of stage, the calculating of water grade are realized；
Warning module: being responsible for the threshold range of each measurement data index, carries out the processing of early warning process, and generates corresponding types
Alarm；
Message queue pool: theme Topic is arranged in message queue pool, and database subscribes to the theme Topic and obtains theme Topic
Under data.
Further, in order to preferably realize the present invention, the messaging bus further includes difference MQTT acquisition module sum number
The fault detection module connected according to the output end of synchronization module；
Fault detection module: it is responsible for the processing of data acquisition module equipment state exception, it is different to generate corresponding equipment as needed
Often record.
Further, in order to preferably realize the present invention, the measurement data index includes that water level transfinites index, 24 hours
Transfinite index, water quality prediction of rainfall transfinite index, water quality transfinites index and water quality indicator luffing transfinites index.
Further, in order to preferably realize the present invention, the data conversion module, data filtering module, computing module,
Data between warning module, message queue pool pass through RabbitMQ queue progress.
Further, in order to preferably realize the present invention, the MQTT acquisition module passes through MQTT agreement and multiple data
Acquisition module connection.
Compared with prior art, the present invention have the following advantages that and the utility model has the advantages that
The present invention effectively realizes the analysis for being able to carry out data and convergence and stores to data, convenient for the later period use and
Inquiry, being capable of real-time perfoming data query.
Detailed description of the invention
Fig. 1 is workflow schematic diagram of the invention.
Specific embodiment
The present invention is described in further detail below with reference to embodiment, embodiments of the present invention are not limited thereto.
Embodiment 1:
The present invention is achieved through the following technical solutions, as shown in Figure 1, a kind of Water Conservancy Information data intelligence processing system, including
The data source modules of external multiple data acquisition modules, the messaging bus and messaging bus being connect with data source modules output end
Output end connection database and for the data analysis module to database analysis.
External data acquisition module is by several water conservancies according to passing to data source modules, and data source modules are by data collected
Data conversion is carried out, the filtering of data validity, data are calculated, judge whether being more than defined to the data after calculating
Threshold value is detected and analyzed the operating status of each data acquisition module and the data after calculating is transferred to database, number
Data analysis module progress data convergence analysis is transferred data to according to library and is saved in database；It is provided for subsequent operation original
Data, real time data, convergence data, the query service of report data can be simultaneously third-party platform technical support.
Embodiment 2:
The present embodiment advanced optimizes on the basis of the above embodiments, as shown in Figure 1, further, in order to preferably real
The existing present invention, the data source modules include difference MQTT acquisition module and data simultaneous module, MQTT acquisition module and data
The output end of synchronization module is connect with the input terminal of messaging bus respectively.
It should be noted that the present invention provides a variety of connection types connecting with data acquisition module by above-mentioned improvement,
Connection type diversification makes utilization rate of the invention more preferable；When the company using data simultaneous module realization and data acquisition module
When connecing, volatile data base will be established in data source modules, data simultaneous module will be realized by volatile data base to be acquired with data
The connection of module.
When realizing the connection with data acquisition module using MQTT acquisition module, MQTT acquisition module will be assisted by MQTT
View realizes the connection with data acquisition module.Here MQTT acquisition module refers to the equipment with MQTT acquisition software.
The other parts of the present embodiment are same as the previously described embodiments, and so it will not be repeated.
Embodiment 3:
The present embodiment advanced optimizes on the basis of the above embodiments, as shown in Figure 1, further, in order to preferably real
The existing present invention, the messaging bus includes sequentially connected data conversion module, data filtering module, computing module, early warning mould
Block, message queue pool；The input terminal of the data conversion module and the output end of data source modules connect, the message queue pool
Output end is connect with database；
Data conversion module: to the numerical value Conversion of measurement unit of data acquisition module measurement data collected, measurement data and true
The conversion of data；If the measurement data of part reservoir level is not truthful data, then need to subtract measurement number using dam elevation
According to, after be only true reservoir level data；
Data filtering module: after data conversion module converts data acquisition module measurement data collected, to survey
The virtual value filtering for measuring data, identifies authentic and valid measurement data, abnormal data is marked；
Computing module: stage-discharge, water level storage capacity, range of stage, water are realized to data filtering module treated measurement data
The calculating of matter grade；
Warning module: the measurement data after calculating computing module judges, is responsible for the threshold of each measurement data index of setting
It is worth range, the processing of early warning process is carried out when being higher or lower than threshold range, and generates the alarm of corresponding types；
Message queue pool: theme Topic is arranged in message queue pool, and database subscribes to the theme Topic and obtains theme Topic
Under data.Multiple subscription are realized by setting theme Topic.It can be extended, such as distribute all the way as needed when use
Data are to third party software or platform；As long as third party software or platform carry out corresponding Topic subscription.
The other parts of the present embodiment are same as the previously described embodiments, and so it will not be repeated.
Embodiment 4:
The present embodiment advanced optimizes on the basis of the above embodiments, as shown in Figure 1, further, in order to preferably real
The existing present invention, the messaging bus further include the failure inspection that MQTT acquisition module is connected with the output end of data simultaneous module respectively
Survey module；Fault detection module realizes the abnormal conditions to data acquisition module by MQTT acquisition module or data simultaneous module
It is detected, and generates the exception record of data acquisition module as needed.
Fault detection module: it is responsible for the processing of data acquisition module equipment state exception, generates set accordingly as needed
Standby exception record.
Further, in order to preferably realize the present invention, the measurement data index includes that water level transfinites index, 24 hours
Transfinite index, water quality prediction of rainfall transfinite index, water quality transfinites index and water quality indicator luffing transfinites index.
Further, in order to preferably realize the present invention, the data conversion module, data filtering module, computing module,
Data between warning module, message queue pool pass through RabbitMQ queue progress.
Message duration of the messaging bus by using RabbitMQ, publisher's Confirm mechanism, subscriber's ACK mechanism
Ensure that message will not lose, to guarantee the safety of data transmitting.
Further, in order to preferably realize the present invention, the MQTT acquisition module passes through MQTT agreement and multiple data
Acquisition module connection.
The other parts of the present embodiment are same as the previously described embodiments, and so it will not be repeated.
Embodiment 5:
The present embodiment is the specific embodiment of the present invention, multiple water level sensors, multiple Water quality detectors, multiple water quality
Sensor, multiple water flow sensing units respectively with MQTT acquisition module and connection, fault detection module by MQTT acquisition module with
Multiple water level sensors, multiple Water quality detectors, multiple water quality sensors are separately connected, to realize to multiple level sensors
The detection of device, multiple Water quality detectors, multiple water quality sensor operating statuses generates corresponding as needed when occurring abnormal
Unit exception record；The data that multiple water level sensors, multiple Water quality detectors, multiple water quality sensors are acquired pass through
MQTT acquisition module passes to data conversion module, and data conversion module carries out data conversion to data information obtained, it may be assumed that
Realize that the conversion of measurement data and truthful data is needed if the measurement data of part reservoir level is not truthful data using big
Height of dam journey is only true reservoir level data after subtracting measurement data；Data after conversion are true by the identification of data filtering module
Real effective measurement data, and abnormal data are recorded and marked；Filtered data will be realized by computing module
Stage-discharge calculates, water level storage capacity calculates, range of stage calculates and the calculating of water grade；Data after calculating will be passed to pre-
Alert module, is set with the threshold range of relevant calculation data in warning module, will be with after the data that warning module is calculated
The threshold range of index is compared and analyzed, it, will be pairs of according to relevant quota student if be higher or lower than threshold range
The warning message answered.Warning message and the data information after calculating will be transmitted to message array pond, by message array pond and
Data after calculating are transmitted to data analysis module and carry out convergence analysis by database, and the data after convergence analysis are transmitted to data
Library is saved；Since the Topic that is the theme is arranged in message array pond, so that third party software or platform can be when in use
Related data information is inquired.
The above is only presently preferred embodiments of the present invention, not does limitation in any form to the present invention, it is all according to
According to technical spirit any simple modification to the above embodiments of the invention, equivalent variations, protection of the invention is each fallen within
Within the scope of.
Claims (7)
1. a kind of Water Conservancy Information data intelligence processing system, it is characterised in that: the number including external multiple data acquisition modules
According to source module, the messaging bus being connect with data source modules output end, the database being connect with messaging bus output end and use
In the data analysis module to database analysis.
2. a kind of Water Conservancy Information data intelligence processing system according to claim 1, it is characterised in that: the data source
Module includes difference MQTT acquisition module and data simultaneous module, the output end difference of MQTT acquisition module and data simultaneous module
It is connect with the input terminal of messaging bus.
3. a kind of Water Conservancy Information data intelligence processing system according to claim 2, it is characterised in that: the message is total
Line includes sequentially connected data conversion module, data filtering module, computing module, warning module, message queue pool；The number
It is connected according to the input terminal of conversion module and the output end of data source modules, the message queue pool output end is connect with database；
Data conversion module: to the numerical value Conversion of measurement unit of the measurement data of acquisition, the conversion of measurement data and truthful data；
Data filtering module: the virtual value of measurement data is filtered, identifies authentic and valid measurement data, abnormal data is carried out
Label；
Computing module: realize that stage-discharge calculates, water level storage capacity calculates, range of stage calculates, the calculating of water grade；
Warning module: being responsible for the threshold range of each measurement data index, carries out the processing of early warning process, and generates corresponding types
Alarm；
Message queue pool: theme Topic is arranged in message queue pool, and database subscribes to the theme Topic and obtains theme Topic
Under data.
4. a kind of Water Conservancy Information data intelligence processing system according to claim 3, it is characterised in that: the message is total
Line further includes the fault detection module that MQTT acquisition module is connected with the output end of data simultaneous module respectively；
Fault detection module: it is responsible for the processing of data acquisition module equipment state exception, it is different to generate corresponding equipment as needed
Often record.
5. a kind of Water Conservancy Information data intelligence processing system according to claim 3, it is characterised in that: the measurement number
It include that water level index, 24 hours rainfall transfinite index, the water quality prediction of index, water quality that transfinite that transfinite transfinites index and water quality according to index
Index luffing transfinites index.
6. a kind of Water Conservancy Information data intelligence processing system according to claim 3, it is characterised in that: the data turn
Mold changing block, data filtering module, computing module, warning module, the data between message queue pool pass through RabbitMQ team
Column carry out.
7. according to a kind of described in any item Water Conservancy Information data intelligence processing systems of claim 2-6, it is characterised in that: institute
MQTT acquisition module is stated to connect by MQTT agreement with multiple data acquisition modules.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910533302.8A CN110413668B (en) | 2019-06-19 | 2019-06-19 | Intelligent processing system for water conservancy informationized data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910533302.8A CN110413668B (en) | 2019-06-19 | 2019-06-19 | Intelligent processing system for water conservancy informationized data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110413668A true CN110413668A (en) | 2019-11-05 |
| CN110413668B CN110413668B (en) | 2023-08-11 |
Family
ID=68359367
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910533302.8A Active CN110413668B (en) | 2019-06-19 | 2019-06-19 | Intelligent processing system for water conservancy informationized data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110413668B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102426442A (en) * | 2011-10-13 | 2012-04-25 | 湖南城市学院 | Water resource real-time monitoring and managing method and system of complicated water system |
| CN104134106A (en) * | 2013-05-05 | 2014-11-05 | 南京理工大学连云港研究院 | Water conservancy intelligent decision supporting system and water conservancy intelligent decision method |
| CN104639625A (en) * | 2015-01-27 | 2015-05-20 | 华南理工大学 | Data concentrator acquisition control method based on MQTT (Message Queuing Telemetry Transport), data concentrator acquisition control device based on MQTT and data concentrator acquisition control system based on MQTT |
| CN107968840A (en) * | 2017-12-15 | 2018-04-27 | 华北电力大学（保定） | A kind of extensive power equipment monitoring, alarming Real-time Data Processing Method and system |
| CN207366013U (en) * | 2017-10-17 | 2018-05-15 | 武汉力地液压设备有限公司 | A kind of intelligent monitor system for water conservancy |
| KR101867400B1 (en) * | 2017-02-17 | 2018-06-15 | 금오공과대학교 산학협력단 | Water Quality Monitoring System based on Wireless Sensor Network |
| CN109299830A (en) * | 2018-10-26 | 2019-02-01 | 国家电网有限公司 | A kind of hydrologic forecast system and method based on Soil Moisture Monitoring |
| CN109376974A (en) * | 2018-08-08 | 2019-02-22 | 成都万江港利科技股份有限公司 | A kind of Water Resources Irrigation total management system |
| CN109814481A (en) * | 2019-01-21 | 2019-05-28 | 北京舞水科技有限公司 | A kind of wisdom aquatic products managing and control system merged based on Internet of Things and meteorological data |
-
2019
- 2019-06-19 CN CN201910533302.8A patent/CN110413668B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102426442A (en) * | 2011-10-13 | 2012-04-25 | 湖南城市学院 | Water resource real-time monitoring and managing method and system of complicated water system |
| CN104134106A (en) * | 2013-05-05 | 2014-11-05 | 南京理工大学连云港研究院 | Water conservancy intelligent decision supporting system and water conservancy intelligent decision method |
| CN104639625A (en) * | 2015-01-27 | 2015-05-20 | 华南理工大学 | Data concentrator acquisition control method based on MQTT (Message Queuing Telemetry Transport), data concentrator acquisition control device based on MQTT and data concentrator acquisition control system based on MQTT |
| KR101867400B1 (en) * | 2017-02-17 | 2018-06-15 | 금오공과대학교 산학협력단 | Water Quality Monitoring System based on Wireless Sensor Network |
| CN207366013U (en) * | 2017-10-17 | 2018-05-15 | 武汉力地液压设备有限公司 | A kind of intelligent monitor system for water conservancy |
| CN107968840A (en) * | 2017-12-15 | 2018-04-27 | 华北电力大学（保定） | A kind of extensive power equipment monitoring, alarming Real-time Data Processing Method and system |
| CN109376974A (en) * | 2018-08-08 | 2019-02-22 | 成都万江港利科技股份有限公司 | A kind of Water Resources Irrigation total management system |
| CN109299830A (en) * | 2018-10-26 | 2019-02-01 | 国家电网有限公司 | A kind of hydrologic forecast system and method based on Soil Moisture Monitoring |
| CN109814481A (en) * | 2019-01-21 | 2019-05-28 | 北京舞水科技有限公司 | A kind of wisdom aquatic products managing and control system merged based on Internet of Things and meteorological data |
Non-Patent Citations (1)
| Title |
|---|
| 冯慧阳: "《智能水电厂一体化管控技术的研究》" * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110413668B (en) | 2023-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN201508482U (en) | Waste water processing real time monitoring system | |
| CN111259334A (en) | Monitoring and early warning method for water use abnormity of large users of industrial enterprises | |
| CN104636352B (en) | A kind of SCADA system history datas complement and inquiry processing method based on quality stamp | |
| CN112381309A (en) | Reservoir dam safety monitoring and early warning method, device and system and storage medium | |
| CN107862338A (en) | Marine environmental monitoring data quality management method and system based on double check method | |
| CN206472157U (en) | A kind of water quality information monitoring system based on Cloud Server | |
| CN107450427A (en) | The O＆M dynamic management-control method of pollution sources online monitoring system and its detection device | |
| CN110213542A (en) | A kind of comprehensive on-line monitoring cloud platform system of the foundation pit based on Internet of Things big data | |
| CN107860425A (en) | A kind of bridge structural health monitoring and early warning system and method | |
| CN107918629A (en) | The correlating method and device of a kind of alarm failure | |
| CN105021790A (en) | Water quality monitoring system and method | |
| CN105892447A (en) | Automatic test system and method for marine controller | |
| CN113944883B (en) | Monitoring and dispatching integrated system of urban water supply network | |
| CN109272760B (en) | Online detection method for abnormal data value of SCATS system detector | |
| CN205621238U (en) | Damaged on -line monitoring alarm device of nuclear reactor fuel | |
| CN110413668A (en) | A kind of Water Conservancy Information data intelligence processing system | |
| CN115508528A (en) | River and lake water quality-hydrodynamics online intelligent monitoring system and method | |
| CN207704252U (en) | A kind of Reservoir Water Quality on-line monitoring system based on industrial network | |
| CN107247871A (en) | Item detection time checking method for early warning and device | |
| CN109840721A (en) | Cost model system based on online data management under a kind of big data | |
| CN109374849A (en) | Sewage treatment on-line monitoring system | |
| CN115494206A (en) | Water station system with intelligent management and control function | |
| CN213241241U (en) | Pump station intelligent management system based on BIM technology | |
| CN103365284B (en) | A kind of multi information based on OPC technology detects and fusing device and method | |
| CN108055332A (en) | The Internet of Things setting method and automatic alarm system of a kind of automatic alarm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |