CN111078698A - Novel hydrologic monitoring data storage mechanism - Google Patents

Novel hydrologic monitoring data storage mechanism Download PDF

Info

Publication number
CN111078698A
CN111078698A CN201911273592.3A CN201911273592A CN111078698A CN 111078698 A CN111078698 A CN 111078698A CN 201911273592 A CN201911273592 A CN 201911273592A CN 111078698 A CN111078698 A CN 111078698A
Authority
CN
China
Prior art keywords
data storage
data
time
backtracking
function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911273592.3A
Other languages
Chinese (zh)
Inventor
石久波
王金旺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Unicloud Nanjing Digital Technology Co Ltd
Original Assignee
Unicloud Nanjing Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Unicloud Nanjing Digital Technology Co Ltd filed Critical Unicloud Nanjing Digital Technology Co Ltd
Priority to CN201911273592.3A priority Critical patent/CN111078698A/en
Publication of CN111078698A publication Critical patent/CN111078698A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2291User-Defined Types; Storage management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention provides a new hydrologic monitoring data storage mechanism, which is applied to hydrologic monitoring data and urban water affair data and comprises the following steps: setting data storage time as X and data storage quantity as Y; establishing a functional relation between the data storage quantity Y and the data storage time X, wherein the functional relation is one or a combination of a plurality of piecewise functions, linear functions, exponential functions and power functions; at the current time T, the data are stored in full quantity, and the farther the backtracking time is, the more the data are deleted, and the larger the data slimming degree is. The invention dynamically reduces the weight of the monitoring data in real time, reduces the requirement on storage space and improves the system operation efficiency.

Description

Novel hydrologic monitoring data storage mechanism
Technical Field
The invention relates to the technical field of data storage, in particular to a novel hydrologic monitoring data storage mechanism.
Background
In the hydrologic and water conservancy information system, the system stores a large amount of various data, wherein important data are hydrologic and water conservancy monitoring data, such as water quality, water level, flow rate, rainfall data and the like of various water bodies, and the real-time information of the water bodies is acquired through a detection terminal, remotely transmitted to a water conservancy monitoring center and stored in a system database. As shown in fig. 1, conventional data storage is full storage. As the running time of the system increases, the monitoring data volume gradually increases, on one hand, the storage of the database is stressed more, and a larger storage space is needed. On the other hand, when a work such as data query and search is performed in a complicated full-scale database, efficiency is further deteriorated.
Disclosure of Invention
In order to solve the problems in the prior art, the invention aims to provide a novel hydrologic monitoring data storage mechanism, which is used for dynamically slimming data and solving the problems that a large-capacity storage space is required and the data processing efficiency is low in the prior art.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
the utility model provides a hydrology monitoring data stores new mechanism, is applied to hydrology monitoring data and city water affairs data, its characterized in that, new mechanism includes:
setting data storage time as X and data storage quantity as Y;
establishing a functional relation between the data storage quantity Y and the data storage time X, wherein the functional relation is one or a combination of a plurality of piecewise functions, linear functions, exponential functions and power functions;
at the current time T, the data are stored in full quantity, and the farther the backtracking time is, the more the data are deleted, and the larger the data slimming degree is.
Further, the function relationship is a piecewise function, and the piecewise function includes:
setting a backtracking time parameter delta according to business needs, obtaining a backtracking time interval X based on the current time T, wherein X is T-n delta, backtracking is carried out from the current time, and the farther the backtracking time is, the larger n is;
setting a data slimming parameter N according to business requirements, wherein the data storage quantity Y is 1/mN, the data storage quantity is 1 in the current time interval, and the farther the backtracking time is, the larger m is.
Further, the function relationship is an exponential function, the data storage capacity is Y ═ a ^ X, and a is determined according to the service requirement.
Further, the function relationship is an exponential function, the data storage capacity is Y ═ X ^ b, and b is determined according to the service requirement.
The novel hydrologic monitoring data storage mechanism is innovated on a data storage mechanism, changes the traditional hydrologic monitoring data full-scale storage mechanism into a dynamic data storage 'slimming' mechanism, and has the following beneficial effects:
1) by adopting a dynamic 'slimming' mechanism of data storage, the storage of redundant data can be reduced according to business requirements, and the requirement on storage space is reduced.
2) The flexibility and the high efficiency of the database are kept, the query and the retrieval of the data are convenient, and the system operation efficiency is improved.
Drawings
The present invention will be further described and illustrated with reference to the following drawings.
FIG. 1 is a schematic diagram of a conventional full-size data storage mechanism.
FIG. 2 is a diagram of an embodiment of the new mechanism for data storage of the present invention.
FIG. 3 is a diagram of a second embodiment of the new mechanism for data storage according to the present invention.
FIG. 4 is a schematic diagram of a third embodiment of the new mechanism for data storage according to the present invention.
FIG. 5 is a diagram of a fourth embodiment of the new mechanism for data storage of the present invention.
Detailed Description
The technical solution of the present invention will be more clearly and completely explained by the description of the preferred embodiments of the present invention with reference to the accompanying drawings.
The novel hydrologic monitoring data storage mechanism is applied to hydrologic monitoring data and urban water affair data. Along with the lapse of time, the data in the hydrological and hydraulic monitoring database is more and more, and among numerous data, the closer to the current moment, the more important the data is, and have strict requirements for the integrity of the data, must be preserved in full form; and the farther away from the current time, the less important the data is. Therefore, by utilizing the characteristic, the invention dynamically reduces the weight of the monitoring data of the monitoring database in real time.
The novel hydrologic monitoring data storage mechanism comprises the following steps:
setting data storage time as X and data storage quantity as Y;
establishing a functional relation between the data storage quantity Y and the data storage time X, wherein the functional relation is one or a combination of a plurality of piecewise functions, linear functions, exponential functions and power functions;
at the current time T, the data are stored in full quantity, and the farther the backtracking time is, the more the data are deleted, and the larger the data slimming degree is.
As shown in fig. 2, in one embodiment, the functional relationship between the data storage amount Y and the storage time X is a piecewise function. In the coordinate system shown in fig. 2, the abscissa is a time axis, and the ordinate is a data storage amount.
Specifically, a backtracking time parameter δ is set according to business needs, a backtracking time interval X is obtained based on the current time T, X is T-n δ, and the farther the backtracking time is, the larger n is;
setting a data slimming parameter N according to business requirements, wherein the data storage quantity Y is 1/mN, the data storage quantity is 1 in the current time interval, and the farther the backtracking time is, the larger m is.
It should be noted that, the above dynamic "slimming" mechanism employs a segmented function, the value of δ of the abscissa (time axis) can be set according to the business needs, and the segment (interval) division of the abscissa can also be defined by itself, and is not limited to the uniform segmentation in the above figure. The value of N of the ordinate can be customized according to business needs, and the data storage amount corresponding to each interval is not limited to the mode (1, 1/N, 1/2N, …) in the above figure, and can be customized by a user.
Besides the above-mentioned sectional functions, the functions adopted by the dynamic "slimming" mechanism of data can also adopt another several common function modes: linear functions, exponential functions, power functions.
In another embodiment, as shown in fig. 3, the functional relationship between the data storage amount Y and the storage time X is a linear function.
In another embodiment, as shown in fig. 4, the functional relationship between the data storage amount Y and the storage time X is an exponential function, and the data storage amount Y ═ a ^ X, a is determined according to the traffic demand.
In another embodiment, as shown in fig. 5, the functional relationship between the data storage amount Y and the storage time X is a power function, and the data storage amount is Y ═ X ^ b, and b is determined according to the traffic demand.
When the database is "slim", how to screen the data depends on specific business requirements. For example, when the database storage is converted from "1" (full storage) to "1/2" (half of "slimming"), the water level data in the current interval may be sorted, the data of the top 1/2 may be retained, or the data of the top 1/2 may be sorted monthly in units of months. In summary, data screening needs to be dependent on business requirements.
The invention performs dynamic slimming of the database in the operation process of the system through a predefined slimming mechanism of the data, thereby keeping the flexibility of the database. However, in the case of monitoring data with strict requirement and full storage, or in the case of business requirement and full data retention, the database "slimming" mechanism is not suitable for use.
The above detailed description merely describes preferred embodiments of the present invention and does not limit the scope of the invention. Without departing from the spirit and scope of the present invention, it should be understood that various changes, substitutions and alterations can be made herein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims and their equivalents. The scope of the invention is defined by the claims.

Claims (4)

1. A new hydrologic monitoring data storage mechanism is applied to hydrologic monitoring data and urban water affair data, and is characterized in that the new mechanism comprises:
setting data storage time as X and data storage quantity as Y;
establishing a functional relation between a data storage amount Y and a data storage time X, wherein the functional relation is one or a combination of a piecewise function, a linear function, an exponential function and a power function;
at the current time T, the data are stored in full quantity, and the farther the backtracking time is, the more the data are deleted, and the larger the data slimming degree is.
2. The new mechanism for hydrologic monitoring data storage according to claim 1 wherein said functional relationship is a piecewise function comprising:
setting a backtracking time parameter delta according to business needs, obtaining a backtracking time interval X based on the current time T, wherein X is T-n delta, backtracking is carried out from the current time, and the farther the backtracking time is, the larger n is;
setting a data slimming parameter N according to business requirements, wherein the data storage quantity Y is 1/mN, the data storage quantity is 1 in the current time interval, and the farther the backtracking time is, the larger m is.
3. The new mechanism for hydrologic monitoring data storage according to claim 1 wherein said function relationship is exponential, said data storage is Y ═ a ^ X, a is dependent on traffic demand.
4. The mechanism of claim 1 wherein the function relationship is a power function, and the amount of data storage is Y ═ X ^ b, b is dependent on traffic demand.
CN201911273592.3A 2019-12-12 2019-12-12 Novel hydrologic monitoring data storage mechanism Pending CN111078698A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911273592.3A CN111078698A (en) 2019-12-12 2019-12-12 Novel hydrologic monitoring data storage mechanism

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911273592.3A CN111078698A (en) 2019-12-12 2019-12-12 Novel hydrologic monitoring data storage mechanism

Publications (1)

Publication Number Publication Date
CN111078698A true CN111078698A (en) 2020-04-28

Family

ID=70314053

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911273592.3A Pending CN111078698A (en) 2019-12-12 2019-12-12 Novel hydrologic monitoring data storage mechanism

Country Status (1)

Country Link
CN (1) CN111078698A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105868071A (en) * 2016-03-23 2016-08-17 乐视网信息技术(北京)股份有限公司 Monitoring data processing method and device
CN108319725A (en) * 2018-02-28 2018-07-24 武汉珞珈弘禹工程技术有限公司 A kind of method and system of hydrologic monitoring data storage
CN110300134A (en) * 2018-03-22 2019-10-01 杭州海康威视系统技术有限公司 Memory space method of adjustment, device and the cloud storage system of cloud storage resource pool

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105868071A (en) * 2016-03-23 2016-08-17 乐视网信息技术(北京)股份有限公司 Monitoring data processing method and device
CN108319725A (en) * 2018-02-28 2018-07-24 武汉珞珈弘禹工程技术有限公司 A kind of method and system of hydrologic monitoring data storage
CN110300134A (en) * 2018-03-22 2019-10-01 杭州海康威视系统技术有限公司 Memory space method of adjustment, device and the cloud storage system of cloud storage resource pool

Similar Documents

Publication Publication Date Title
CN102024045B (en) Information classification processing method, device and terminal
CN111324679B (en) Method, device and system for processing address information
CN104462141B (en) Method, system and the storage engines device of a kind of data storage and inquiry
CN102479223A (en) Data query method and system
CN110135890A (en) The product data method for pushing and relevant device of knowledge based relation excavation
CN105279163A (en) Buffer memory data update and storage method and system
CN104298736A (en) Method and device for aggregating and connecting data as well as database system
CN103516912A (en) Mobile terminal locating and power saving method
CN107291539A (en) Cluster program scheduler method based on resource significance level
CN103853838A (en) Data processing method and device
CN101963993B (en) Method for fast searching database sheet table record
CN102486772A (en) Method and device for exporting data
CN109547931A (en) Determine the server in mobile terminal location
CN111078698A (en) Novel hydrologic monitoring data storage mechanism
CN104102411B (en) A kind of method for editing text and text editing apparatus
CN109347723A (en) A kind of information cuing method and device
CN101650734A (en) Menu filter method, menu filter device, menu processing system and information processing equipment
CN105095224A (en) Method, apparatus and system for carrying out OLAP analysis in mobile communication network
CN111447303A (en) GPS-based dynamic coding method for Internet of things platform equipment
CN111460796A (en) Accidental sensitive word discovery method based on word network
CN103150034A (en) Method and system for displaying candidate words
CN110377757A (en) A kind of real time knowledge map construction system
CN108804374A (en) A kind of e-book reading management method based on mobile terminal APP
CN108062636A (en) A kind of method that enterprise's cross reference figure is formed according to property right of enterprises big data
CN107169014A (en) POI recommends method, device, equipment and computer-readable recording medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20200428

WD01 Invention patent application deemed withdrawn after publication