CN111078698A - Novel hydrologic monitoring data storage mechanism - Google Patents
Novel hydrologic monitoring data storage mechanism Download PDFInfo
- Publication number
- CN111078698A CN111078698A CN201911273592.3A CN201911273592A CN111078698A CN 111078698 A CN111078698 A CN 111078698A CN 201911273592 A CN201911273592 A CN 201911273592A CN 111078698 A CN111078698 A CN 111078698A
- Authority
- CN
- China
- Prior art keywords
- data storage
- data
- time
- backtracking
- function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2291—User-Defined Types; Storage management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a new hydrologic monitoring data storage mechanism, which is applied to hydrologic monitoring data and urban water affair data and comprises the following steps: setting data storage time as X and data storage quantity as Y; establishing a functional relation between the data storage quantity Y and the data storage time X, wherein the functional relation is one or a combination of a plurality of piecewise functions, linear functions, exponential functions and power functions; at the current time T, the data are stored in full quantity, and the farther the backtracking time is, the more the data are deleted, and the larger the data slimming degree is. The invention dynamically reduces the weight of the monitoring data in real time, reduces the requirement on storage space and improves the system operation efficiency.
Description
Technical Field
The invention relates to the technical field of data storage, in particular to a novel hydrologic monitoring data storage mechanism.
Background
In the hydrologic and water conservancy information system, the system stores a large amount of various data, wherein important data are hydrologic and water conservancy monitoring data, such as water quality, water level, flow rate, rainfall data and the like of various water bodies, and the real-time information of the water bodies is acquired through a detection terminal, remotely transmitted to a water conservancy monitoring center and stored in a system database. As shown in fig. 1, conventional data storage is full storage. As the running time of the system increases, the monitoring data volume gradually increases, on one hand, the storage of the database is stressed more, and a larger storage space is needed. On the other hand, when a work such as data query and search is performed in a complicated full-scale database, efficiency is further deteriorated.
Disclosure of Invention
In order to solve the problems in the prior art, the invention aims to provide a novel hydrologic monitoring data storage mechanism, which is used for dynamically slimming data and solving the problems that a large-capacity storage space is required and the data processing efficiency is low in the prior art.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
the utility model provides a hydrology monitoring data stores new mechanism, is applied to hydrology monitoring data and city water affairs data, its characterized in that, new mechanism includes:
setting data storage time as X and data storage quantity as Y;
establishing a functional relation between the data storage quantity Y and the data storage time X, wherein the functional relation is one or a combination of a plurality of piecewise functions, linear functions, exponential functions and power functions;
at the current time T, the data are stored in full quantity, and the farther the backtracking time is, the more the data are deleted, and the larger the data slimming degree is.
Further, the function relationship is a piecewise function, and the piecewise function includes:
setting a backtracking time parameter delta according to business needs, obtaining a backtracking time interval X based on the current time T, wherein X is T-n delta, backtracking is carried out from the current time, and the farther the backtracking time is, the larger n is;
setting a data slimming parameter N according to business requirements, wherein the data storage quantity Y is 1/mN, the data storage quantity is 1 in the current time interval, and the farther the backtracking time is, the larger m is.
Further, the function relationship is an exponential function, the data storage capacity is Y ═ a ^ X, and a is determined according to the service requirement.
Further, the function relationship is an exponential function, the data storage capacity is Y ═ X ^ b, and b is determined according to the service requirement.
The novel hydrologic monitoring data storage mechanism is innovated on a data storage mechanism, changes the traditional hydrologic monitoring data full-scale storage mechanism into a dynamic data storage 'slimming' mechanism, and has the following beneficial effects:
1) by adopting a dynamic 'slimming' mechanism of data storage, the storage of redundant data can be reduced according to business requirements, and the requirement on storage space is reduced.
2) The flexibility and the high efficiency of the database are kept, the query and the retrieval of the data are convenient, and the system operation efficiency is improved.
Drawings
The present invention will be further described and illustrated with reference to the following drawings.
FIG. 1 is a schematic diagram of a conventional full-size data storage mechanism.
FIG. 2 is a diagram of an embodiment of the new mechanism for data storage of the present invention.
FIG. 3 is a diagram of a second embodiment of the new mechanism for data storage according to the present invention.
FIG. 4 is a schematic diagram of a third embodiment of the new mechanism for data storage according to the present invention.
FIG. 5 is a diagram of a fourth embodiment of the new mechanism for data storage of the present invention.
Detailed Description
The technical solution of the present invention will be more clearly and completely explained by the description of the preferred embodiments of the present invention with reference to the accompanying drawings.
The novel hydrologic monitoring data storage mechanism is applied to hydrologic monitoring data and urban water affair data. Along with the lapse of time, the data in the hydrological and hydraulic monitoring database is more and more, and among numerous data, the closer to the current moment, the more important the data is, and have strict requirements for the integrity of the data, must be preserved in full form; and the farther away from the current time, the less important the data is. Therefore, by utilizing the characteristic, the invention dynamically reduces the weight of the monitoring data of the monitoring database in real time.
The novel hydrologic monitoring data storage mechanism comprises the following steps:
setting data storage time as X and data storage quantity as Y;
establishing a functional relation between the data storage quantity Y and the data storage time X, wherein the functional relation is one or a combination of a plurality of piecewise functions, linear functions, exponential functions and power functions;
at the current time T, the data are stored in full quantity, and the farther the backtracking time is, the more the data are deleted, and the larger the data slimming degree is.
As shown in fig. 2, in one embodiment, the functional relationship between the data storage amount Y and the storage time X is a piecewise function. In the coordinate system shown in fig. 2, the abscissa is a time axis, and the ordinate is a data storage amount.
Specifically, a backtracking time parameter δ is set according to business needs, a backtracking time interval X is obtained based on the current time T, X is T-n δ, and the farther the backtracking time is, the larger n is;
setting a data slimming parameter N according to business requirements, wherein the data storage quantity Y is 1/mN, the data storage quantity is 1 in the current time interval, and the farther the backtracking time is, the larger m is.
It should be noted that, the above dynamic "slimming" mechanism employs a segmented function, the value of δ of the abscissa (time axis) can be set according to the business needs, and the segment (interval) division of the abscissa can also be defined by itself, and is not limited to the uniform segmentation in the above figure. The value of N of the ordinate can be customized according to business needs, and the data storage amount corresponding to each interval is not limited to the mode (1, 1/N, 1/2N, …) in the above figure, and can be customized by a user.
Besides the above-mentioned sectional functions, the functions adopted by the dynamic "slimming" mechanism of data can also adopt another several common function modes: linear functions, exponential functions, power functions.
In another embodiment, as shown in fig. 3, the functional relationship between the data storage amount Y and the storage time X is a linear function.
In another embodiment, as shown in fig. 4, the functional relationship between the data storage amount Y and the storage time X is an exponential function, and the data storage amount Y ═ a ^ X, a is determined according to the traffic demand.
In another embodiment, as shown in fig. 5, the functional relationship between the data storage amount Y and the storage time X is a power function, and the data storage amount is Y ═ X ^ b, and b is determined according to the traffic demand.
When the database is "slim", how to screen the data depends on specific business requirements. For example, when the database storage is converted from "1" (full storage) to "1/2" (half of "slimming"), the water level data in the current interval may be sorted, the data of the top 1/2 may be retained, or the data of the top 1/2 may be sorted monthly in units of months. In summary, data screening needs to be dependent on business requirements.
The invention performs dynamic slimming of the database in the operation process of the system through a predefined slimming mechanism of the data, thereby keeping the flexibility of the database. However, in the case of monitoring data with strict requirement and full storage, or in the case of business requirement and full data retention, the database "slimming" mechanism is not suitable for use.
The above detailed description merely describes preferred embodiments of the present invention and does not limit the scope of the invention. Without departing from the spirit and scope of the present invention, it should be understood that various changes, substitutions and alterations can be made herein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims and their equivalents. The scope of the invention is defined by the claims.
Claims (4)
1. A new hydrologic monitoring data storage mechanism is applied to hydrologic monitoring data and urban water affair data, and is characterized in that the new mechanism comprises:
setting data storage time as X and data storage quantity as Y;
establishing a functional relation between a data storage amount Y and a data storage time X, wherein the functional relation is one or a combination of a piecewise function, a linear function, an exponential function and a power function;
at the current time T, the data are stored in full quantity, and the farther the backtracking time is, the more the data are deleted, and the larger the data slimming degree is.
2. The new mechanism for hydrologic monitoring data storage according to claim 1 wherein said functional relationship is a piecewise function comprising:
setting a backtracking time parameter delta according to business needs, obtaining a backtracking time interval X based on the current time T, wherein X is T-n delta, backtracking is carried out from the current time, and the farther the backtracking time is, the larger n is;
setting a data slimming parameter N according to business requirements, wherein the data storage quantity Y is 1/mN, the data storage quantity is 1 in the current time interval, and the farther the backtracking time is, the larger m is.
3. The new mechanism for hydrologic monitoring data storage according to claim 1 wherein said function relationship is exponential, said data storage is Y ═ a ^ X, a is dependent on traffic demand.
4. The mechanism of claim 1 wherein the function relationship is a power function, and the amount of data storage is Y ═ X ^ b, b is dependent on traffic demand.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911273592.3A CN111078698A (en) | 2019-12-12 | 2019-12-12 | Novel hydrologic monitoring data storage mechanism |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911273592.3A CN111078698A (en) | 2019-12-12 | 2019-12-12 | Novel hydrologic monitoring data storage mechanism |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111078698A true CN111078698A (en) | 2020-04-28 |
Family
ID=70314053
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911273592.3A Pending CN111078698A (en) | 2019-12-12 | 2019-12-12 | Novel hydrologic monitoring data storage mechanism |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111078698A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105868071A (en) * | 2016-03-23 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Monitoring data processing method and device |
| CN108319725A (en) * | 2018-02-28 | 2018-07-24 | 武汉珞珈弘禹工程技术有限公司 | A kind of method and system of hydrologic monitoring data storage |
| CN110300134A (en) * | 2018-03-22 | 2019-10-01 | 杭州海康威视系统技术有限公司 | Memory space method of adjustment, device and the cloud storage system of cloud storage resource pool |
-
2019
- 2019-12-12 CN CN201911273592.3A patent/CN111078698A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105868071A (en) * | 2016-03-23 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Monitoring data processing method and device |
| CN108319725A (en) * | 2018-02-28 | 2018-07-24 | 武汉珞珈弘禹工程技术有限公司 | A kind of method and system of hydrologic monitoring data storage |
| CN110300134A (en) * | 2018-03-22 | 2019-10-01 | 杭州海康威视系统技术有限公司 | Memory space method of adjustment, device and the cloud storage system of cloud storage resource pool |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102024045B (en) | Information classification processing method, device and terminal | |
| CN111324679B (en) | Method, device and system for processing address information | |
| CN104462141B (en) | Method, system and the storage engines device of a kind of data storage and inquiry | |
| CN102479223A (en) | Data query method and system | |
| CN110135890A (en) | The product data method for pushing and relevant device of knowledge based relation excavation | |
| CN105279163A (en) | Buffer memory data update and storage method and system | |
| CN104298736A (en) | Method and device for aggregating and connecting data as well as database system | |
| CN103516912A (en) | Mobile terminal locating and power saving method | |
| CN107291539A (en) | Cluster program scheduler method based on resource significance level | |
| CN103853838A (en) | Data processing method and device | |
| CN101963993B (en) | Method for fast searching database sheet table record | |
| CN102486772A (en) | Method and device for exporting data | |
| CN109547931A (en) | Determine the server in mobile terminal location | |
| CN111078698A (en) | Novel hydrologic monitoring data storage mechanism | |
| CN104102411B (en) | A kind of method for editing text and text editing apparatus | |
| CN109347723A (en) | A kind of information cuing method and device | |
| CN101650734A (en) | Menu filter method, menu filter device, menu processing system and information processing equipment | |
| CN105095224A (en) | Method, apparatus and system for carrying out OLAP analysis in mobile communication network | |
| CN111447303A (en) | GPS-based dynamic coding method for Internet of things platform equipment | |
| CN111460796A (en) | Accidental sensitive word discovery method based on word network | |
| CN103150034A (en) | Method and system for displaying candidate words | |
| CN110377757A (en) | A kind of real time knowledge map construction system | |
| CN108804374A (en) | A kind of e-book reading management method based on mobile terminal APP | |
| CN108062636A (en) | A kind of method that enterprise's cross reference figure is formed according to property right of enterprises big data | |
| CN107169014A (en) | POI recommends method, device, equipment and computer-readable recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200428 |
|
| WD01 | Invention patent application deemed withdrawn after publication |