CN116074324A - Independent metering and partitioning system and method for water supply network - Google Patents
Independent metering and partitioning system and method for water supply network Download PDFInfo
- Publication number
- CN116074324A CN116074324A CN202310323807.8A CN202310323807A CN116074324A CN 116074324 A CN116074324 A CN 116074324A CN 202310323807 A CN202310323807 A CN 202310323807A CN 116074324 A CN116074324 A CN 116074324A
- Authority
- CN
- China
- Prior art keywords
- water consumption
- meter
- water
- group
- corresponding relation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 title claims abstract description 270
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000000638 solvent extraction Methods 0.000 title claims description 15
- 238000007726 management method Methods 0.000 claims abstract description 45
- 230000000737 periodic effect Effects 0.000 claims abstract description 20
- 238000004364 calculation method Methods 0.000 claims description 32
- 238000004458 analytical method Methods 0.000 claims description 24
- 238000013139 quantization Methods 0.000 claims description 18
- 230000002159 abnormal effect Effects 0.000 claims description 11
- 238000013468 resource allocation Methods 0.000 claims description 5
- 238000012216 screening Methods 0.000 claims description 5
- 230000036316 preload Effects 0.000 claims description 3
- 238000002360 preparation method Methods 0.000 claims description 3
- 238000013316 zoning Methods 0.000 claims 1
- 238000005192 partition Methods 0.000 abstract description 4
- 230000004044 response Effects 0.000 abstract description 3
- 238000013523 data management Methods 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 11
- 238000004422 calculation algorithm Methods 0.000 description 4
- 239000008358 core component Substances 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 239000000306 component Substances 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 238000000429 assembly Methods 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000007621 cluster analysis Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q2209/00—Arrangements in telecontrol or telemetry systems
- H04Q2209/60—Arrangements in telecontrol or telemetry systems for transmitting utility meters data, i.e. transmission of data from the reader of the utility meter
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q2209/00—Arrangements in telecontrol or telemetry systems
- H04Q2209/70—Arrangements in the main station, i.e. central controller
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A20/00—Water conservation; Efficient water supply; Efficient water use
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses an independent metering partition system and method for a water supply network, and relates to the technical field of water affair data management. The method comprises the steps of obtaining the geographic position of each meter end and the corresponding relation of water consumption with respect to time; extracting the water consumption period characteristic of each meter end according to the corresponding relation of the water consumption of each meter end with respect to time; acquiring a plurality of position groups according to the geographical position of each meter end and the water consumption period characteristic of each meter end, wherein the water consumption period characteristic difference between meter ends in the same position group is in a set range; acquiring water consumption representative periodic characteristics of the table end in each position group; preloading a history record of the corresponding relation of the water consumption with respect to time according to the water consumption representative period characteristic of the table end in each position group, and preparing the computing power resource of the management end; and receiving the water service data packet sent by the table terminal. The invention improves the reliability of the service response of the management end.
Description
Technical Field
The invention belongs to the technical field of water service data management, and particularly relates to an independent metering and partitioning system and method for a water supply network.
Background
The statistical mode of the water meter for the water consumption can be simply divided into partition metering and independent metering. The former performs combination statistics on the water quantity of the whole water consumption area, and only one or a few data uploaded by the table end needs to be processed. The latter is to count the water quantity of each user individually, and the number of the surface ends which face the extremely large number in one area needs to count one by one, especially the number of the surface ends in the first-line city is easy to tens of millions.
The water consumption data collected by the water meter of the Internet of things can be sent and transmitted to the management end in the form of data packets, in order to improve communication efficiency and avoid packet loss, each water consumption and corresponding collection time are not completely recorded in the data packets, and therefore the newly received data packets are required to be analyzed and calculated by combining the historical records of the data packets or the water consumption historical records of the corresponding meter ends.
In the process of receiving and analyzing data packets sent by a plurality of independently metered meter ends, a large amount of calculation force is required to be consumed, the throughput pressure of a database is greatly increased, and the hardware equipment of a management end is likely to be down.
A distributed processing system for providing location-based services and a system, method and computer program product for customizing services such as location-based services provided onboard a vehicle to be serviced are disclosed in the publication CN111566620 a. The distributed processing system includes a plurality of computing devices including at least one edge device and at least one cloud computing device. Each computing device includes a core component and one or more services. The services may be configured as pipelines or micro-services. The core component of each computing device is configured to communicate with the one or more services of the respective computing device and with the core component of at least one of the other computing devices in order to share data, such as data having a collision-free copy data type, and synchronize the core components. The scheme realizes safe and stable transmission and analysis of the data packet by deploying a large number of distributed computing devices, but the whole water service data statistics management system is required to be comprehensively upgraded, and the cost is high.
Disclosure of Invention
The invention aims to provide an independent metering partition system and method for a water supply network, which are used for analyzing the water consumption histories of meter ends to obtain the time probability of sending water service data packets by the meter ends and virtually partitioning a plurality of meter ends according to the time probability, so that storage resources and calculation power scheduling are carried out on a management end, and the reliability of service response of the management end is improved.
In order to solve the technical problems, the invention is realized by the following technical scheme:
the invention provides an independent metering and partitioning method for a water supply network, which comprises the following steps of,
obtaining the corresponding relation of the geographical position and the water consumption of each meter end with respect to time;
extracting the water consumption period characteristic of each meter end according to the corresponding relation of the water consumption of each meter end with respect to time;
acquiring a plurality of position group according to the geographical position of each meter end and the water consumption period characteristic of each meter end, wherein the water consumption period characteristic difference between the meter ends in the same position group is in a set range;
acquiring water consumption representative periodic characteristics of the table end in each position group;
preloading a history record of the corresponding relation of the water consumption with respect to time according to the water consumption representative period characteristic of the table end in each position group, and preparing the computing power resource of the management end;
receiving the water service data packet sent by the table end;
analyzing the water service data packet under the prepared computing power resource according to the preloaded historical record of the corresponding relation of the water consumption of the table end with respect to time and the corresponding relation of the water consumption of the table end with respect to time, which is recorded by the water service data packet;
and writing the corresponding relation of the water consumption of the table end obtained through analysis with respect to time into a database.
The invention also discloses an independent metering and partitioning system of the water supply network, which comprises,
the meter end is used for generating a water service data packet according to the collected water consumption of the user, wherein the analysis complexity of the water service data packet is positively related to the corresponding water consumption;
the water service data packet is sent outwards;
the management end comprises a database, a load balancing unit, a network receiving and transmitting unit and an analysis calculating unit; wherein,,
the database is used for storing a history record of the corresponding relation of the water consumption collected by the meter end with respect to time;
the load balancing unit is used for acquiring the geographic position of each meter end and the corresponding relation of water consumption with respect to time;
extracting the water consumption period characteristic of each meter end according to the corresponding relation of the water consumption of each meter end with respect to time;
acquiring a plurality of position group according to the geographical position of each meter end and the water consumption period characteristic of each meter end, wherein the water consumption period characteristic difference between the meter ends in the same position group is in a set range;
acquiring water consumption representative periodic characteristics of the table end in each position group;
preloading a history record of the corresponding relation of the water consumption with respect to time according to the water consumption representative period characteristic of the table end in each position group, and preparing the computing power resource of the management end;
the network transceiver unit is used for receiving the water service data packet sent by the table end;
the analysis and calculation unit is used for analyzing and obtaining the corresponding relation of the water consumption of the table end recorded by the water service data packet under the prepared computing power resource according to the preloaded historical record of the corresponding relation of the water consumption of the table end with respect to time and the water service data packet;
and writing the corresponding relation of the water consumption of the table end obtained through analysis with respect to time into a database.
According to the method, the water consumption characteristics of the meter ends, namely the water consumption period characteristics, are obtained by analyzing the historical data of the water consumption of each meter end on time, and then the meter ends with similar water consumption characteristics are classified into groups at the same position according to the water consumption period characteristics. The meter ends in the same position group can be regarded as having the same water consumption period characteristic, so that the water consumption prediction of the position group can be realized by only combining the meter end number in the position group and the water consumption representative period characteristic. And then, the distribution of the preloading space and the calculation power resources of the management end can be realized only according to the water consumption proportion of the group at different positions, and the water service data packet is analyzed and calculated according to the distribution, so that the corresponding relation of the water consumption of each meter end with respect to time is obtained. In the process, the water consumption characteristics of each meter end are pre-allocated with the pre-loading space and the computing power resources, so that downtime caused by the fact that a large number of water service data packets are simultaneously uploaded to the management end is effectively avoided.
Of course, it is not necessary for any one product to practice the invention to achieve all of the advantages set forth above at the same time.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a method for independently metering and partitioning a water supply network according to the present invention;
FIG. 2 is a schematic diagram of functional modules and information flow of an independent metering and partitioning system of a water supply network according to the present invention;
FIG. 3 is a schematic view of scattered points of the corresponding relation of water consumption collected by a middle-end in one year with respect to time;
FIG. 4 is a schematic diagram of daily water consumption ratio and change coefficient of the middle-end in a week;
FIG. 5 is a schematic diagram of the water consumption ratio and the time change coefficient of the middle-end in one day;
FIG. 6 is a flow chart of step S5 according to the present invention;
FIG. 7 is a flow chart of step S51 according to the present invention;
FIG. 8 is a flow chart of step S511 according to the present invention;
FIG. 9 is a flow chart of step S54 according to the present invention;
FIG. 10 is a flow chart of step S6 according to the present invention;
FIG. 11 is a flow chart of step S7 according to the present invention;
FIG. 12 is a flow chart of step S72 according to the present invention;
in the drawings, the list of components represented by the various numbers is as follows:
the system comprises a 1-management end, a 11-database, a 12-load balancing unit, a 13-network receiving and transmitting unit and a 14-analysis calculating unit;
2-table end.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Because the performance of the water service internet of things is weaker, in order to ensure that the data transmission is stable and reliable, the water service data packet sent by the meter end is usually provided with a more complex data error correction and verification mechanism, the water service data newly collected by the meter end can be obtained after the data packet is firstly calculated, and in order to save electric quantity, the internet of things network end is generally designed to send the water service data packet once every ton of water flow. However, since the number of the table terminals is too large, for example, more than ten millions of table terminals for civil use, commercial use, government use and industrial use in Shanghai city, when a large number of water service data packets are simultaneously gushed into the management terminal, if the management terminal is not prepared in advance for solving the water service data packets, the management terminal is likely to be down. In order to effectively avoid such a situation, the present invention provides the following arrangement.
Referring to fig. 1 and 2, the present invention provides an independent metering partition system for a water supply network, which is divided from a functional module into a database, a load balancing unit, a network transceiver unit and an analysis and calculation unit. The database is usually a relational database, for example MySQL or Oracle, and stores the corresponding relation of the water quantity collected by each table end with respect to time in a data table, and before analyzing the water service data packet newly received by the network transceiver unit, the data table of the corresponding table end needs to be called in the database. In other words, a buffer space for loading and a computing power for computation need to be prepared in the parsing calculation unit before parsing the water service data packet. After the system is initialized and debugged, the hardware resources of the system can completely meet the analysis and calculation requirements of the water service data packet, but the analysis and calculation are likely to be blocked due to the problems of memory and calculation thread scheduling, so that the analysis and calculation preparation of the water service data packet uploaded by the table end needs to be realized by combining the water consumption period characteristics of each table end.
In the whole, the system is connected with the meter end through a network, and the meter end executes the step S2 to send the water service data packet outwards after executing the step S1 to generate the water service data packet according to the collected water consumption of the user. It should be emphasized that, since the water service data packet includes a corresponding relationship of water consumption with respect to time, the more the corresponding water consumption in the water service data packet is, the more complex the corresponding relationship of the parsed water consumption with respect to time is, so that the parsing complexity of the water service data packet is positively related to the corresponding water consumption.
Next we discuss the logic of the manager in the application process. Functionally, the management end can be divided into a database, a load balancing unit, a network transceiver unit and an analysis and calculation unit. The database is used for storing the corresponding relation of water quantity with respect to time, the network transceiver unit is used for carrying out network communication, the analysis and calculation unit is used for analyzing and calculating the water service data packet, and the load balancing unit is the key point of the scheme and is used for preparing the memory and the calculation thread.
Before the operation logic of the load balancing unit is further discussed, the relation of the water consumption collected by the meter end with respect to time needs to be analyzed, that is, how to extract the cycle characteristics of the water consumption of the meter end. The method adopts the scheme that the periodic characteristics of the corresponding table terminal are obtained according to the history record of the corresponding relation of the water quantity with respect to time. The periodic characteristic in the scheme can be water consumption characteristics in one year, time sharing characteristics of month, week and day.
In real life, the water consumption is closely related to the air temperature, the sunshine time and the holiday system, and the water consumption is periodic, namely, the water service data packet history record of the whole year is sufficiently representative, the accuracy of the periodic characteristics of the water consumption of the meter end extracted later can be effectively avoided, and specifically, the water consumption of each meter end in each working day and rest day in the past year period and the distribution proportion of the water consumption are firstly obtained as the periodic characteristics of the water consumption of the meter end. The time-sharing water consumption of each meter end water consumption on each weekday and rest day during the past year and the distribution ratio of each hour water consumption are then obtained as the cycle characteristics of the meter end water consumption. Since most meter terminals are resident and consumer commercial water meter terminals, the daily water consumption and the time-sharing water consumption on the same day are closely related to whether the day is a workday or a rest day, and thus it is necessary to extract the cycle characteristics of the water consumption at the meter terminals and the corresponding time-sharing cycle characteristics respectively according to the workday and the rest day. The periodic feature extraction of the water usage at the end of a particular table can take part in figures 3 to 5.
Referring to fig. 3, after the water consumption of a certain enterprise in the last year, the classification cycle feature extraction of the weekday and holiday is shown in fig. 4, and the time-sharing water consumption cycle feature extraction of the table end of a certain day is shown in fig. 5.
And the running process of the management end is continuously discussed, because the number of the meter ends is numerous, if the load balancing unit performs water quantity pre-judgment on each specific meter end, the calculated quantity is excessively large, and the management end is more likely to be down, so that the meter ends with the same or similar water consumption period characteristics are marked into the same position group, thereby facilitating subsequent calculation. In a specific implementation process, the load balancing unit may be executed first in step S3 to obtain the geographical location of each table end and the corresponding relationship of the water consumption with respect to time. Step S4 may be performed to extract the water consumption cycle characteristics of each table according to the time-related correspondence of the water consumption of each table. Step S5 can be executed to obtain a plurality of position groups according to the geographical position of each table end and the water consumption period characteristic of each table end, and it is to be noted that the water consumption period characteristic difference between the table ends in the same position group is within a set range.
Because each position group contains a great number of table ends, subsequent processing operation cannot be performed according to the water consumption period characteristics of each table end, and therefore, step S6 can be executed to obtain the water consumption representative period characteristics of the table ends in each position group. And finally, step S7 can be executed to perform preloading of the history record of the corresponding relation of the water consumption with respect to time and preparation of the computing power resource of the management end according to the water consumption representative period characteristic of the table end in each position group. Therefore, the memory and calculation power of the management end are pre-allocated, and downtime caused by insufficient performance in the subsequent analysis and calculation process is avoided.
After the memory and calculation of the management end are distributed, the network transceiver unit is used for executing step S8 to receive the water service data packet sent by the table end and buffer the water service data packet in the memory of the management end, so as to facilitate subsequent analysis and calculation. And the analysis and calculation unit is used for executing the step S9 to obtain the corresponding relation of the water consumption of the table end recorded by the water service data packet according to the history record of the corresponding relation of the water consumption of the preloaded table end with respect to time and the water service data packet under the prepared calculation resources. And finally, the step S10 can be executed to write the corresponding relation of the water consumption of the table end obtained through analysis in the database with respect to time, and complete and accurate recording of the water consumption and the acquisition time of the table end is completed.
As shown in fig. 6, if the conventional clustering algorithm is adopted to find the meter ends with the same or similar water consumption cycle characteristics, the workload is still heavy, so that we need to obtain a daily law according to the common sense of life, that is, users with similar distances have similarity in water consumption habits, for example, merchants in the same business area have similar door opening and closing time, so that the water consumption habits are similar, and the accurate position group can be assisted to be obtained quickly based on the characteristics. In the specific execution process, step S51 may be executed first to pre-sort all the table ends according to the geographical location of each table end to obtain a plurality of location initial groups. Step S52 may be performed to obtain the total water consumption and the variance of the water consumption of each table end in the initial group in a specified period according to the water consumption period characteristics of the table end in the initial group at each position, where the specified period may be one year or one week, and may be one day. Step S53 can be executed to quantitatively mark the table end in the initial group of each position according to the total water consumption and variance value of each table end in the specified period, and a two-dimensional quantitative marking result of the table end is obtained. Step S54 may be executed to screen out abnormal table ends in the initial group according to the two-dimensional quantized marking result of each table end and the set range of the water consumption period characteristic difference. And finally, step S55 can be executed to transfer the abnormal table end into the initial position group which accords with the setting range of the water consumption period characteristic difference, so as to obtain a plurality of position groups. The water consumption periodic characteristics of the meter end are converted into two-dimensional quantitative marking results, so that cluster analysis of the water consumption periodic characteristics of the meter end is realized, and classification of the position group can be accurately realized.
Referring to fig. 7, in order to improve the classification speed of the position group, in step S5, instead of the complete clustering method, the method performs preliminary clustering according to the common sense of life that the distances between the table ends are similar, and the water consumption cycle characteristics are also similar, and in the specific implementation process, step S511 may be performed first to obtain the average value of the distances between any two nearest neighboring table ends according to the geographic position of each table end. Step S512 may be performed to divide the table ends with the distance smaller than the dividing distance into the same initial group. Step S513 may be performed to mark the table ends that are not allocated to any one of the position initial groups as unallocated table ends, and the table ends that have been allocated to any one of the position initial groups as allocated table ends. Step S514 may be performed next to acquire an initial group corresponding to the allocated table end closest to the unallocated table end as the target position initial group. Step S515 may be performed to incorporate the unassigned table ends into the corresponding target position initial group, and step S516 may be performed to assign all table ends to the position initial group to obtain a plurality of position initial groups. By means of the position clustering, a plurality of initial position groups are obtained, and the classification speed of the subsequent position groups is increased.
Referring to fig. 8, since the number of table ends in the initial group at each position is very large, the calculation amount is huge in a mode of calculating the average value of all the table end distances in pairs, and the calculation can be performed by using a space statistics method, specifically, step S5111 can be performed to obtain the area of the area where all the table ends are located and the number of all the table ends according to the geographical position of each table end. Step S5112 may be performed to obtain the average density of all the table ends according to the ratio of the number of all the table ends to the area of the area where all the table ends are located, and step S5113 may be performed to obtain the average occupied area of each table end according to the average density of all the table ends. Finally, step S5114 may be executed to obtain an average value of the distances between any two nearest two table ends according to the average occupied area of each table end. By simple density calculation, the calculated amount is greatly saved, and the classification speed of the position group is indirectly improved.
Referring to fig. 9, it is also noted that this method is easy to misjudge when the common sense of life is adopted in which the distances of the meter ends are similar, so that the meter ends of the initial group of positions are also required to be selected from the misclassified meter ends, specifically, step S541 can be executed to obtain the total water consumption setting range and the variance value setting range of the water consumption in the designated period according to the setting range of the characteristic difference of the water consumption period, that is, the two-dimensional quantization marking result is set. Step S542 may be performed to obtain the average two-dimensional quantized mark result of all the table ends in each initial group of locations, and step S543 may be performed to select the table end closest to the average two-dimensional quantized mark result in the initial group of locations as the core table end. Step S544 may be performed next to obtain a two-dimensional quantized mark result difference value between each table end and the core table end, and step S545 may be performed next to assign each table end to the core table end with the smallest two-dimensional quantized mark result difference value to obtain an updated position initial group. Step S546 may be performed to obtain two-dimensional quantized mark result differences of the two table ends with the largest two-dimensional quantized mark result differences in the initial group at each location. Step S547 may be performed to determine whether the two-dimensional quantization flag result difference of the two table ends with the largest two-dimensional quantization flag result difference is greater than the set two-dimensional quantization flag result, and if so, step S548 may be performed to flag the two table ends as abnormal table ends. Continuously updating the initial group of positions and screening out abnormal table ends, and executing step S548 to judge whether the two-dimensional quantization mark result difference value of the two table ends with the largest two-dimensional quantization mark result difference value in each initial group of positions is smaller than the set two-dimensional quantization mark result or not until the screening of the abnormal table ends is completed. And accurately selecting the abnormal table ends in the initial group of the positions by means of iteratively executing a clustering algorithm.
Referring to fig. 10, since the number of table ends in the location group is still very large, the water consumption cycle characteristic of each table end cannot be involved in subsequent calculation, and in order to simplify the calculation, a representative table end needs to be selected from each location group, and in the implementation process, step S61 may be performed first to randomly extract a plurality of table ends from the location group. Step S62 may be performed next to obtain two-dimensional quantized labeling results for a plurality of table ends randomly extracted, step S63 may be performed next to calculate a mean value of the two-dimensional quantized labeling results for each table end randomly extracted within the location group. Step S64 may be performed to obtain, in the location cluster, a table end closest to the average value difference of the two-dimensional quantized signature result of each table end randomly extracted as a representative table end in the location cluster. Finally, step S65 may be performed to take the water consumption representative periodic characteristic of the table end as the water consumption representative periodic characteristic of the table end in the position group. By selecting the most representative table end from the position group, the complexity of implementing operation is reduced on the premise of not affecting the accuracy of subsequent memory and calculation force distribution.
Referring to fig. 11, it should be reiterated that the hardware resources of the present system are sufficient, but may not respond due to the scheduling imbalance, so that the memory and computation of the management end need to be allocated and scheduled. Based on the positive correlation between the analysis complexity of the water service data packet and the corresponding water consumption, the calculation force and the memory space can be allocated according to the estimated water consumption among the position groups, specifically, step S71 can be executed first, and the accumulated water consumption of the table end in each position group in the future period can be obtained according to the water consumption representative period characteristic of the table end in each position group and the table end contained in each position group. Step S72 may be performed to obtain the preloading space and the algorithm resource allocation rule of the management end according to the water consumption representative period characteristic of each location group. Step S73 may be executed to preload the history record of the corresponding relationship between the water consumption of the table end and time according to the corresponding relationship between the ratio between the accumulated water consumption of the table end and time in each position group in the future period and the preload space allocation rule of the management end. Finally, step S74 may be executed to allocate the computing power resources of the management end according to the correspondence of the ratio between the accumulated water consumption of the table end in each position group in the future period with respect to time and the computing power resource allocation rule of the management end. And the distribution of the memory and the calculation power of the management end among the position groups is obtained by calculating the water consumption ratio among the position groups, so that the system non-response caused by untimely scheduling is avoided.
Referring to fig. 12, the pre-loading space and the algorithm of the management end are simply allocated according to the water consumption between the location clusters, and in a specific implementation process, step S721 may be executed to obtain the estimated water consumption period and the water consumption distribution of the table end in the location clusters according to the water consumption representative periodic characteristic of each location cluster. Step S722 may be executed to obtain the estimated water usage distribution of the table end in each position group in the future period according to the estimated water usage period and the water usage distribution of the table end in the position group. Step S723 may be performed to obtain a correspondence relationship between a ratio of the cumulative water usage of the table end in each position group in the future period with respect to time according to the estimated water usage distribution of the table end in each position group in the future period. And finally, step S724 can be executed to obtain the ratio between the accumulated water consumption of the table end in each position group at any moment, and allocate the preloading space and the computing power resource of the management end, so as to obtain the preloading space and the computing power resource allocation rule of the management end. It should be noted that, by estimating the water consumption distribution of each meter end in the future period, the accumulated water consumption proportion of each group at each location in the future period needs to be combined with the history record of the corresponding relationship of the water consumption of each meter end with respect to time, and the influence of the working day and holiday needs to be fully considered.
In summary, the method and the device realize classification and water consumption estimation of the table end according to the water consumption collected by the table end in the implementation process, and then pre-allocate and schedule the memory and calculation power in the management end based on the estimated water consumption of the position group classified by the table end, so as to avoid downtime caused by untimely analysis and treatment of the water service data received by the management end.
The above description of illustrated embodiments of the invention, including what is described in the abstract, is not intended to be exhaustive or to limit the invention to the precise forms disclosed herein. Although specific embodiments of, and examples for, the invention are described herein for illustrative purposes only, various equivalent modifications are possible within the spirit and scope of the present invention, as those skilled in the relevant art will recognize and appreciate. As noted, these modifications can be made to the present invention in light of the foregoing description of illustrated embodiments of the present invention and are to be included within the spirit and scope of the present invention.
The systems and methods have been described herein in general terms as being helpful in understanding the details of the present invention. Furthermore, various specific details have been set forth in order to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that an embodiment of the invention can be practiced without one or more of the specific details, or with other apparatus, systems, assemblies, methods, components, materials, parts, and/or the like. In other instances, well-known structures, materials, and/or operations are not specifically shown or described in detail to avoid obscuring aspects of embodiments of the invention.
Thus, although the invention has been described herein with reference to particular embodiments thereof, a latitude of modification, various changes and substitutions are intended in the foregoing disclosures, and it will be appreciated that in some instances some features of the invention will be employed without a corresponding use of other features without departing from the scope and spirit of the invention as set forth. Therefore, many modifications may be made to adapt a particular situation or material to the essential scope and spirit of the present invention. It is intended that the invention not be limited to the particular terms used in following claims and/or to the particular embodiment disclosed as the best mode contemplated for carrying out this invention, but that the invention will include any and all embodiments and equivalents falling within the scope of the appended claims. Accordingly, the scope of the invention should be determined only by the following claims.
Claims (10)
1. An independent metering and partitioning method for a water supply network is characterized by comprising the following steps of,
obtaining the corresponding relation of the geographical position and the water consumption of each meter end with respect to time;
extracting the water consumption period characteristic of each meter end according to the corresponding relation of the water consumption of each meter end with respect to time;
acquiring a plurality of position group according to the geographical position of each meter end and the water consumption period characteristic of each meter end, wherein the water consumption period characteristic difference between the meter ends in the same position group is in a set range;
acquiring water consumption representative periodic characteristics of the table end in each position group;
preloading a history record of the corresponding relation of the water consumption with respect to time according to the water consumption representative period characteristic of the table end in each position group, and preparing the computing power resource of the management end;
receiving the water service data packet sent by the table end;
analyzing the water service data packet under the prepared computing power resource according to the preloaded historical record of the corresponding relation of the water consumption of the table end with respect to time and the corresponding relation of the water consumption of the table end with respect to time, which is recorded by the water service data packet;
and writing the corresponding relation of the water consumption of the table end obtained through analysis with respect to time into a database.
2. The method of independent metering and partitioning a water supply network according to claim 1, wherein the step of obtaining a plurality of location clusters according to the geographical location of each meter end and the water consumption cycle characteristic of each meter end comprises,
pre-classifying all the table ends according to the geographic position of each table end to obtain a plurality of position initial groups;
obtaining the total water consumption and the variance value of the water consumption of each table end in the initial group in a specified period according to the water consumption period characteristics of the table end in the initial group in each position;
carrying out quantization marking on each table end in the initial group at each position according to the total water consumption and variance value of each table end in a specified period to obtain a two-dimensional quantization marking result of the table end;
screening abnormal meter ends in the position initial group according to the two-dimensional quantitative marking result of each meter end and the setting range of the water consumption period characteristic difference;
and transferring the abnormal table end into a position initial group which accords with the set range of the water consumption period characteristic difference to obtain a plurality of position groups.
3. The method of independent metering and partitioning a water supply network according to claim 2, wherein said step of pre-classifying all of said meter ends according to the geographical location of each meter end to obtain a plurality of location-initiated clusters comprises,
acquiring an average value of distances between any two nearest neighbors of the two meter ends according to the geographic position of each meter end;
taking the average value of the distances between any two nearest two meter ends as a demarcation distance, and dividing the meter ends with the mutual distance smaller than the demarcation distance into the same initial group at the position;
marking the table ends which are not allocated to any of the position initial groups as unallocated table ends, and marking the table ends which are already allocated to any of the position initial groups as allocated table ends;
acquiring the initial group corresponding to the allocated table end closest to the unallocated table end as a target position initial group;
the unallocated table end is brought into the corresponding initial group of the target position;
and distributing all the table ends to the initial groups to obtain a plurality of initial groups.
4. The method for independently metering and partitioning a water supply network according to claim 3, wherein said step of obtaining an average value of distances between any two nearest neighbors of two said meter ends according to the geographical position of each meter end comprises,
acquiring the area of the area where all the meter ends are located and the number of all the meter ends according to the geographic position of each meter end;
obtaining the average density of all the surface ends according to the ratio of the number of all the surface ends to the area of the area where all the surface ends are located;
calculating the average occupied area of each meter end according to the average density of all the meter ends;
and obtaining the average value of the distance between any two nearest neighbor meter ends according to the average occupied area of each meter end.
5. The method according to claim 2, wherein the step of screening out abnormal water supply network ends in the initial group of positions according to the two-dimensional quantitative marking result of each water supply network end and the set range of the water consumption period characteristic difference comprises the steps of,
obtaining a total water consumption setting range and a variance value setting range of water consumption in a specified period according to the setting range of the characteristic difference of the water consumption period, namely setting a two-dimensional quantization marking result;
acquiring average two-dimensional quantitative marking results of all the table ends in each initial group of the positions;
selecting the table end closest to the average two-dimensional quantitative marking result from the initial group of positions as a core table end;
obtaining a two-dimensional quantization marking result difference value of each table end and the core table end;
distributing each table end to a core table end with the smallest two-dimensional quantization marking result difference value to obtain the updated position initial group;
obtaining two-dimensional quantized mark result differences of the two table ends with the largest difference value of the two-dimensional quantized mark results in the initial group of each position;
if the two-dimensional quantization marking result difference value of the two table ends with the largest two-dimensional quantization marking result difference value is larger than the set two-dimensional quantization marking result, marking the two table ends as abnormal table ends;
and continuously updating the initial group of positions and screening out the abnormal table ends until the two-dimensional quantization marking result difference value of the two table ends with the largest two-dimensional quantization marking result difference value in each initial group of positions is smaller than the set two-dimensional quantization marking result.
6. A water supply network independent metering and zoning method according to any of claims 2 to 5, wherein the specified period comprises one year, one week and/or one day.
7. The method of independent metering and partitioning a water supply network according to claim 2, wherein said step of obtaining the water usage at said meter end in each of said groups of locations represents a periodic characteristic, comprises,
randomly extracting a plurality of table ends from the position group;
acquiring a plurality of randomly extracted two-dimensional quantitative marking results of the table ends;
calculating the average value of the two-dimensional quantitative marking results of each table end extracted randomly in the position group;
acquiring the table end closest to the average value difference value of the two-dimensional quantitative marking result of each table end extracted randomly in the position group, and taking the table end as a representative table end in the position group;
and taking the water consumption representing periodic characteristics of the table end as the water consumption representing periodic characteristics of the table end in the position group.
8. The method according to claim 1, wherein the step of preloading the history of the correspondence of the water consumption with respect to time and the preparation of the computing power resources of the management side according to the water consumption representative period characteristic of the table end in each of the position groups comprises,
acquiring the accumulated water consumption of the meter end in each position group in a future period according to the water consumption representative periodic characteristic of the meter end in each position group and the meter end contained in each position group;
obtaining a preloading space of the management end and a calculation force resource allocation rule according to the water quantity representative period characteristic of each position group;
preloading a history record of the corresponding relation of the water consumption of the table end with respect to time according to the corresponding relation of the ratio of the accumulated water consumption of the table end with respect to time in each position group in a future period and the preloading space allocation rule of the management end;
and distributing the computing power resources of the management end according to the corresponding relation of the ratio between the accumulated water consumption of the meter end in each position group in the future period and the computing power resource distribution rule of the management end.
9. The method of independent metering and partitioning a water supply network according to claim 8, wherein said step of obtaining a preload space of said management side and a calculation resource allocation rule based on said water volume representative cycle characteristic of each of said location group comprises,
obtaining estimated water consumption time periods and water consumption distribution of the meter ends in the position groups according to the water quantity representative period characteristics of each position group;
obtaining estimated water consumption distribution of the meter end in each position group in a future period according to the estimated water consumption period and the water consumption distribution of the meter end in the position group;
acquiring a corresponding relation of a ratio between the accumulated water consumption of the meter end in each position group in a future period according to the estimated water consumption distribution of the meter end in each position group in the future period;
and obtaining the ratio between the accumulated water consumption of the table end in each position group at any moment, and distributing the preloading space and the computing power resource of the management end to obtain the preloading space and the computing power resource distribution rule of the management end.
10. An independent metering and partitioning system for a water supply network is characterized by comprising,
the meter end is used for generating a water service data packet according to the collected water consumption of the user, wherein the analysis complexity of the water service data packet is positively related to the corresponding water consumption;
the water service data packet is sent outwards;
the management end comprises a database, a load balancing unit, a network receiving and transmitting unit and an analysis calculating unit; wherein,,
the database is used for storing a history record of the corresponding relation of the water consumption collected by the meter end with respect to time;
the load balancing unit is used for acquiring the geographic position of each meter end and the corresponding relation of water consumption with respect to time;
extracting the water consumption period characteristic of each meter end according to the corresponding relation of the water consumption of each meter end with respect to time;
acquiring a plurality of position group according to the geographical position of each meter end and the water consumption period characteristic of each meter end, wherein the water consumption period characteristic difference between the meter ends in the same position group is in a set range;
acquiring water consumption representative periodic characteristics of the table end in each position group;
preloading a history record of the corresponding relation of the water consumption with respect to time according to the water consumption representative period characteristic of the table end in each position group, and preparing the computing power resource of the management end;
the network transceiver unit is used for receiving the water service data packet sent by the table end;
the analysis and calculation unit is used for analyzing and obtaining the corresponding relation of the water consumption of the table end recorded by the water service data packet under the prepared computing power resource according to the preloaded historical record of the corresponding relation of the water consumption of the table end with respect to time and the water service data packet;
and writing the corresponding relation of the water consumption of the table end obtained through analysis with respect to time into a database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310323807.8A CN116074324B (en) | 2023-03-30 | 2023-03-30 | Independent metering and partitioning system and method for water supply network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310323807.8A CN116074324B (en) | 2023-03-30 | 2023-03-30 | Independent metering and partitioning system and method for water supply network |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116074324A true CN116074324A (en) | 2023-05-05 |
| CN116074324B CN116074324B (en) | 2023-06-30 |
Family
ID=86180517
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310323807.8A Active CN116074324B (en) | 2023-03-30 | 2023-03-30 | Independent metering and partitioning system and method for water supply network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116074324B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113112127A (en) * | 2021-03-22 | 2021-07-13 | 浙江和达科技股份有限公司 | Metering management method and system based on artificial intelligence |
| KR20210113707A (en) * | 2020-03-09 | 2021-09-17 | (주)엔와이인포텍 | Pipe network management system for managing pipe network of waterworks and method of the same |
| CN114449373A (en) * | 2022-01-14 | 2022-05-06 | 河南卓正电子科技有限公司 | Wisdom water affairs system based on thing networking wireless transmission |
| CN114493221A (en) * | 2022-01-18 | 2022-05-13 | 河南卓正电子科技有限公司 | Intelligent water affair management system and method based on internet of things data collection |
| CN115293660A (en) * | 2022-10-08 | 2022-11-04 | 广东广宇科技发展有限公司 | Intelligent water affair distribution method and system based on multi-source data processing |
| CN115617279A (en) * | 2022-12-13 | 2023-01-17 | 北京中电德瑞电子科技有限公司 | Distributed cloud data processing method and device and storage medium |
| CN115827621A (en) * | 2023-02-17 | 2023-03-21 | 河北雄安睿天科技有限公司 | Water affair data management system based on cloud computing and data analysis |
-
2023
- 2023-03-30 CN CN202310323807.8A patent/CN116074324B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20210113707A (en) * | 2020-03-09 | 2021-09-17 | (주)엔와이인포텍 | Pipe network management system for managing pipe network of waterworks and method of the same |
| CN113112127A (en) * | 2021-03-22 | 2021-07-13 | 浙江和达科技股份有限公司 | Metering management method and system based on artificial intelligence |
| CN114449373A (en) * | 2022-01-14 | 2022-05-06 | 河南卓正电子科技有限公司 | Wisdom water affairs system based on thing networking wireless transmission |
| CN114493221A (en) * | 2022-01-18 | 2022-05-13 | 河南卓正电子科技有限公司 | Intelligent water affair management system and method based on internet of things data collection |
| CN115293660A (en) * | 2022-10-08 | 2022-11-04 | 广东广宇科技发展有限公司 | Intelligent water affair distribution method and system based on multi-source data processing |
| CN115617279A (en) * | 2022-12-13 | 2023-01-17 | 北京中电德瑞电子科技有限公司 | Distributed cloud data processing method and device and storage medium |
| CN115827621A (en) * | 2023-02-17 | 2023-03-21 | 河北雄安睿天科技有限公司 | Water affair data management system based on cloud computing and data analysis |
Non-Patent Citations (1)
| Title |
|---|
| 郭加强;: "谈分区域计量在供水系统中的运营管理", 山西建筑, vol. 41, no. 33 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116074324B (en) | 2023-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Zhang et al. | Slaq: quality-driven scheduling for distributed machine learning | |
| US20180081629A1 (en) | Method and apparatus for providing ordered sets of arbitrary percentile estimates for varying timespans | |
| CN105069703B (en) | A kind of electrical network mass data management method | |
| CN110806954B (en) | Method, device, equipment and storage medium for evaluating cloud host resources | |
| CN112667376A (en) | Task scheduling processing method and device, computer equipment and storage medium | |
| CN111355606B (en) | Web application-oriented container cluster self-adaptive expansion and contraction system and method | |
| CN102043674A (en) | Estimating service resource consumption based on response time | |
| CN114066073A (en) | Power grid load prediction method | |
| Wang et al. | Lube: Mitigating bottlenecks in wide area data analytics | |
| CN110704371A (en) | Large-scale data management and data distribution system and method | |
| CN114064204A (en) | Method for dynamic capacity expansion based on service prediction in micro-service environment | |
| CN115375205A (en) | Method, device and equipment for determining water user portrait | |
| CN116074324B (en) | Independent metering and partitioning system and method for water supply network | |
| WO2020206699A1 (en) | Predicting virtual machine allocation failures on server node clusters | |
| CN111192123A (en) | Account checking system based on hybrid cloud computing platform and account checking method thereof | |
| CN117971475A (en) | Intelligent management method and system for GPU computing force pool | |
| CN117149392A (en) | Resource processing method, device, server and storage medium | |
| CN115391047A (en) | Resource scheduling method and device | |
| Wang et al. | Mitigating bottlenecks in wide area data analytics via machine learning | |
| CN109670227B (en) | Method for estimating parameter pairs of simulation mathematical model based on big data | |
| CN111784029A (en) | Fog node resource allocation method | |
| Mayer | Window-based data parallelization in complex event processing | |
| CN117478529B (en) | Distributed computing power sensing and scheduling system based on AIGC | |
| CN118069380B (en) | Computing power resource processing method | |
| CN117689070B (en) | Ammeter management system based on internet of things equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |