CN114911668A - Data resource monitoring method and system - Google Patents
Data resource monitoring method and system Download PDFInfo
- Publication number
- CN114911668A CN114911668A CN202210330541.5A CN202210330541A CN114911668A CN 114911668 A CN114911668 A CN 114911668A CN 202210330541 A CN202210330541 A CN 202210330541A CN 114911668 A CN114911668 A CN 114911668A
- Authority
- CN
- China
- Prior art keywords
- cluster
- file
- duty ratio
- value
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3034—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a storage system, e.g. DASD based or network based
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3055—Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/1734—Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Mathematical Physics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a data resource monitoring method and a system, wherein the method comprises the following steps of obtaining basic information and position information of a file to be monitored, and obtaining a cluster value of a disk where the file to be monitored is located according to the position information, wherein the basic information comprises attributes, an occupied space value, time information and a size value; if the attribute is a read-only file, judging whether the cluster duty ratio of the file to be monitored exceeds a first preset duty ratio or not based on the occupied space value, the size value and the cluster value, and if so, carrying out early warning; if the attribute is a writable file, acquiring a predicted cluster duty ratio change rate based on the time information, the occupied space value and the size value, judging whether the cluster duty ratio of the file to be monitored exceeds a second preset duty ratio based on the predicted cluster duty ratio change rate and the time information, and if so, performing early warning. Whether the last cluster space of the file is wasted can be accurately monitored, and the monitoring precision is improved.
Description
Technical Field
The present application relates to the field of data resource monitoring technologies, and in particular, to a data resource monitoring method and system.
Background
With the development of the times, most important data resources of enterprises or individuals are stored in a system disk, a cluster is the minimum disk space amount used for storing files in the disk, one file can occupy a plurality of clusters to be stored, one cluster can occupy another cluster if the other cluster is not placed, and at last, a certain cluster can have a space left, but at the moment, the files are stored completely, the cluster with the left space can not store other files, the space is wasted if the left space is too large, and the system can be confused when a plurality of files are stored. The existing files are divided into read-only and writable types, the size of the read-only file cannot be changed, the size of the writable file can be changed, the file types are different, but clusters in a disk are the same, and the space of the disk is wasted. However, in the prior art, it is not accurate to monitor whether the occupied space of a certain cluster is wasted.
Therefore, how to accurately monitor whether the space occupied by the file in the last cluster is wasted is a technical problem to be solved at present.
Disclosure of Invention
The invention provides a data resource monitoring method, which is used for solving the technical problem that whether the space occupied by a file in the last cluster is wasted or not can not be monitored in the prior art. The method comprises the following steps:
acquiring basic information and position information of a file to be monitored, and acquiring a cluster value of a disk where the file to be monitored is located according to the position information, wherein the basic information comprises attributes, occupied space values, time information and size values;
if the attribute is a read-only file, judging whether the cluster duty ratio of the file to be monitored exceeds a first preset duty ratio or not based on the occupied space value, the size value and the cluster value, and if so, carrying out early warning;
if the attribute is a writable file, acquiring a predicted cluster duty ratio change rate based on the time information, the occupied space value and the size value, judging whether the cluster duty ratio of the file to be monitored exceeds a second preset duty ratio based on the predicted cluster duty ratio change rate and the time information, and if so, early warning;
the read-only file is a file which can only be read, and the writable file is a file which can be read and written.
In some embodiments of the present application, determining, based on the occupied space value, the size value, and the cluster value, whether a cluster duty cycle of the file to be monitored exceeds a first preset duty cycle specifically includes:
obtaining a residual space value S by subtracting the occupied space value from the size value, wherein the cluster value is M, and the cluster duty ratio of the file to be monitored is S/M;
setting the first preset duty cycle based on the size value and the cluster value;
and if the S/M exceeds the first preset duty ratio, early warning is carried out.
In some embodiments of the present application, the method further comprises:
and if the S/M does not exceed the first preset duty ratio, marking the file to be monitored with sufficient capacity.
In some embodiments of the present application, obtaining a predicted cluster duty cycle change rate based on the time information, the occupied space value, and the size value specifically includes:
the time information comprises creation time, modification time and access time;
in the time from the creation time to the modification time, acquiring the cluster duty ratio of each time node according to the occupied space value and the size value;
and obtaining the predicted cluster duty ratio change rate based on the cluster duty ratios of all the time nodes.
In some embodiments of the present application, it is determined whether the cluster duty cycle of the file to be monitored exceeds a second preset duty cycle based on the predicted cluster duty cycle change rate and the time information, specifically:
acquiring a corresponding occupied space value and a corresponding size value after the modification time, acquiring a cluster duty ratio based on the corresponding occupied space value and the corresponding size value after the modification time, and acquiring a predicted cluster duty ratio based on the cluster duty ratio and the predicted cluster duty ratio change rate;
if the predicted cluster duty ratio exceeds the second preset duty ratio, early warning is carried out;
setting the second preset duty cycle based on the cluster value and the predicted cluster duty cycle rate of change.
Correspondingly, the application also provides a data resource monitoring system, which comprises:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring basic information and position information of a file to be monitored and acquiring a cluster value of a disk where the file to be monitored is located according to the position information, and the basic information comprises attributes, an occupied space value, time information and a size value;
the first judgment module is used for judging whether the cluster duty ratio of the file to be monitored exceeds a first preset duty ratio or not based on the occupied space value, the size value and the cluster value if the attribute is the read-only file, and carrying out early warning if the cluster duty ratio of the file to be monitored exceeds the first preset duty ratio;
a second determination module, configured to, if the attribute is a writable file, obtain a predicted cluster duty cycle change rate based on the time information, the occupied space value, and the size value, determine whether a cluster duty cycle of the file to be monitored exceeds a second preset duty cycle based on the predicted cluster duty cycle change rate and the time information, and perform early warning if the cluster duty cycle of the file to be monitored exceeds the second preset duty cycle;
the read-only file is a file which can only be read, and the writable file is a file which can be read and written.
In some embodiments of the present application, the first determining module is specifically configured to:
obtaining a residual space value S by subtracting the occupied space value from the size value, wherein the cluster value is M, and the cluster duty ratio of the file to be monitored is S/M;
setting the first preset duty cycle based on the size value and the cluster value;
and if the S/M exceeds the first preset duty ratio, early warning is carried out.
In some embodiments of the present application, the system further comprises a marking module configured to:
and if the S/M does not exceed the first preset duty ratio, marking the file to be monitored with sufficient capacity.
In some embodiments of the present application, the second determining module is specifically configured to:
the time information comprises creation time, modification time and access time;
in the time from the creation time to the modification time, acquiring the cluster duty ratio of each time node according to the occupied space value and the size value;
and obtaining the predicted cluster duty ratio change rate based on the cluster duty ratios of all the time nodes.
In some embodiments of the present application, the second determining module is further specifically configured to:
acquiring an occupied space value and a size value corresponding to the modified time, acquiring a cluster duty ratio based on the occupied space value and the size value corresponding to the modified time, and acquiring a predicted cluster duty ratio based on the cluster duty ratio and the predicted cluster duty ratio change rate;
if the predicted cluster duty ratio exceeds the second preset duty ratio, early warning is carried out;
setting the second preset duty cycle based on the cluster value and the predicted cluster duty cycle rate of change.
By applying the technical scheme, the method comprises the following steps of obtaining basic information and position information of a file to be monitored, and obtaining a cluster value of a disk where the file to be monitored is located according to the position information, wherein the basic information comprises attributes, an occupied space value, time information and a size value. If the attribute is the read-only file, judging whether the cluster duty ratio of the file to be monitored exceeds a first preset duty ratio or not based on the occupied space value, the size value and the cluster value, and if so, carrying out early warning. If the attribute is the writable file, acquiring a predicted cluster duty ratio change rate based on the time information, the occupied space value and the size value, judging whether the cluster duty ratio of the file to be monitored exceeds a second preset duty ratio based on the predicted cluster duty ratio change rate and the time information, and if so, early warning. Classifying file attributes, monitoring in different modes according to read-only or writable attributes of files, calculating the difference between the size value and the occupied space value of a file when the file is a read-only file, wherein the difference is the residual space of a certain cluster, calculating the cluster duty ratio according to the residual space, and judging whether the cluster duty ratio exceeds a first preset cluster duty ratio or not, which indicates that the residual space is too much, so that the waste of disk space is caused. When a file is a writable file, it is not possible to determine whether there is too much space remaining in the last cluster of the file because the writable file may need to be written all the time. The change rate of the cluster duty ratio can only be predicted by each time node between the file creation time and the file modification time, the file cluster duty ratio is presumed according to the predicted cluster duty ratio change rate, and the fact that the cluster duty ratio exceeds the second preset cluster duty ratio indicates that the file disk space is wasted. Different judging modes are set according to different attributes of the files, whether the use space of the last cluster of the files is wasted or not can be accurately monitored, and the capacity of the whole disk or the system is greatly improved. According to the monitoring method, the clusters in the disk can be adjusted according to the monitoring result, and the adaptability between the file and the disk is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart illustrating a data resource monitoring method according to an embodiment of the present invention;
fig. 2 shows a schematic structural diagram of a data resource monitoring system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
An embodiment of the present application provides a data resource monitoring method, as shown in fig. 1, the method includes the following steps:
step S101, acquiring basic information and position information of a file to be monitored, and acquiring a cluster value of a disk where the file to be monitored is located according to the position information, wherein the basic information comprises attributes, an occupied space value, time information and a size value;
step S102, if the attribute is a read-only file, judging whether the cluster duty ratio of the file to be monitored exceeds a first preset duty ratio based on the occupied space value, the size value and the cluster value, and if so, performing early warning;
step S103, if the attribute is a writable file, acquiring a predicted cluster duty ratio change rate based on the time information, the occupied space value and the size value, judging whether the cluster duty ratio of the file to be monitored exceeds a second preset duty ratio based on the predicted cluster duty ratio change rate and the time information, and if so, giving an early warning.
In step S101, basic information and location information of a file to be monitored are obtained, and a cluster value of a disk where the file to be monitored is located is obtained according to the location information, where the basic information includes an attribute, an occupied space value, time information, and a size value.
In this embodiment, the basic information and the location information of the file to be monitored are obtained, the disk in which the file to be monitored is located is determined according to the location information, and then the cluster of the disk is determined, where the cluster is an allocation unit, that is, the minimum disk space amount for storing the file is allocated. When a file is stored in a disk, one cluster is stored in another cluster without storage, and so on, the last cluster is only possibly full or not full. Because the file size and the cluster have larger difference, most of the time, the last cluster is in an unsatisfied state, and a residual space exists. The method and the device are generated accordingly, and when the last cluster is judged to be in an unsatisfied state, whether the residual space is too much or not is judged, so that space waste is caused. The basic information includes an attribute, an occupied space value, time information, and a size value. The occupied space value is how much space the file occupies in the disk, and the size value is how much space the file occupies.
In step S102, if the attribute is a read-only file, it is determined whether a cluster duty ratio of the file to be monitored exceeds a first preset duty ratio based on the occupied space value, the size value, and the cluster value, and if so, an early warning is performed.
In this embodiment, different manners are selected according to the attribute of the file to be monitored to determine whether the space is wasted, the file attribute is a read-only file, and the read-only file is a file that can only be browsed or read and cannot be written or operated by a user, so that the size value of the file is not changed. And judging whether the cluster duty ratio of the file to be monitored exceeds a first preset duty ratio or not according to the occupied space value, the size value and the cluster value. If the file size exceeds the preset threshold, the residual space of the last cluster of the file is too large, the situation of disk space waste exists, and disk quantity waste early warning is sent out.
In order to ensure the accuracy of file space monitoring, in some embodiments of the present application, a difference is made between the occupied space value and the size value to obtain a remaining space value S, the cluster value is M, and the cluster duty ratio of the file to be monitored is S/M; setting the first preset duty cycle based on the size value and the cluster value; and if the S/M exceeds the first preset duty ratio, early warning is carried out.
In this embodiment, for the reasons mentioned above, the occupied space value is definitely greater than the size value, so that the occupied space value is subtracted from the size value to obtain a remaining space value S, which is the remaining space of the last cluster in the file. The cluster value is M, and the cluster value is the minimum disk space amount in the disk. The cluster duty ratio of the file to be monitored is S/M; setting the first preset duty cycle based on the size value and the cluster value. And if the S/M exceeds the first preset duty ratio, early warning is carried out, and if the S/M exceeds the first preset duty ratio, the situation that the residual space of the last cluster of the file is too large and the disk space is wasted is shown, and the disk quantity waste early warning is sent out.
It can be understood that, the first preset duty ratio is obtained according to the size value and the cluster value, and which mathematical method, model or means is not the important point of protection of the present application, and any technical solution based on this technical concept should fall within the scope of protection of the present application.
In order to further ensure the accuracy of file space monitoring, in some embodiments of the present application, if the S/M does not exceed the first preset duty cycle, the file to be monitored is marked with sufficient capacity usage.
In this embodiment, if the S/M does not exceed the first preset duty ratio, it indicates that the remaining space of the last cluster of the file is small, and no space waste is generated. The file to be monitored is marked with sufficient capacity, and the file cannot be monitored later, because the size of the read-only file cannot be changed, the time required by monitoring can be greatly saved according to the mark, and the time is used for monitoring other files.
In step S103, if the attribute is a writable file, a predicted cluster duty ratio change rate is obtained based on the time information, the occupied space value, and the size value, whether a cluster duty ratio of the file to be monitored exceeds a second preset duty ratio is determined based on the predicted cluster duty ratio change rate and the time information, and if the cluster duty ratio exceeds the second preset duty ratio, an early warning is performed.
In order to ensure the accuracy of the space monitoring of the writable file, in some embodiments of the present application, the time information includes creation time, modification time, and access time. The creation time is the time when the file is created, and the creation time is only one. The modification time is the time of modification to the file, since there may be multiple modifications, the modification time being set by default to the time of the latest modification. The access time is the time of opening the file each time, and the access time is set as the last time of opening the file by default. And in the step from the creation time to the modification time, acquiring the cluster duty ratio of each time node according to the occupied space value and the size value, wherein the occupied space value and the size value are values corresponding to each time node, that is, the occupied space value and the size value of each time node are different, and the size value and the occupied space value are changed because the writable file may be in an over-written state. And obtaining the predicted cluster duty ratio change rate based on the cluster duty ratios of all the time nodes.
It is understood that the time node can be adaptively set or modified according to the disk condition of the file or the system refreshing condition.
In order to further ensure the accuracy of space monitoring of the writable file, in some embodiments of the present application, an occupied space value and a size value corresponding to the modified time are obtained, a cluster duty cycle is obtained based on the occupied space value and the size value corresponding to the modified time, and a predicted cluster duty cycle is obtained based on the cluster duty cycle and the predicted cluster duty cycle change rate; if the predicted cluster duty ratio exceeds the second preset duty ratio, early warning is carried out; setting the second preset duty cycle based on the cluster value and the predicted cluster duty cycle rate of change.
In this embodiment, the cluster duty cycle of the current file is determined according to the latest (current) occupied space value and the size value corresponding to the modification time, and the predicted cluster duty cycle is obtained based on the cluster duty cycle and the predicted cluster duty cycle change rate; and if the predicted cluster duty ratio exceeds the second preset duty ratio, early warning is carried out. Because the writable file may be continuously in a writing state, the size value and the space occupation value of the writable file are changed all the time, only the cluster duty ratio change rate can be predicted, the predicted cluster duty ratio is obtained based on the cluster duty ratio, and whether the cluster duty ratio exceeds a second preset duty ratio is judged. Setting the second preset duty cycle based on the cluster value and the predicted cluster duty cycle rate of change.
It should be understood that the means for setting the first preset duty ratio or the second preset duty ratio is not a key point, the above concept is a key point, and any technical solution based on this technical concept should fall within the protection scope of the present application.
By applying the technical scheme, the method comprises the following steps of obtaining basic information and position information of a file to be monitored, and obtaining a cluster value of a disk where the file to be monitored is located according to the position information, wherein the basic information comprises attributes, an occupied space value, time information and a size value. And if the attribute is a read-only file, judging whether the cluster duty ratio of the file to be monitored exceeds a first preset duty ratio or not based on the occupied space value, the size value and the cluster value, and if so, carrying out early warning. If the attribute is a writable file, acquiring a predicted cluster duty ratio change rate based on the time information, the occupied space value and the size value, judging whether the cluster duty ratio of the file to be monitored exceeds a second preset duty ratio based on the predicted cluster duty ratio change rate and the time information, and if so, performing early warning. Classifying file attributes, monitoring in different modes according to read-only or writable attributes of files, calculating the difference between the size value and the occupied space value of a file when the file is a read-only file, wherein the difference is the residual space of a certain cluster, calculating the cluster duty ratio according to the residual space, and judging whether the cluster duty ratio exceeds a first preset cluster duty ratio or not, which indicates that the residual space is too much, so that the waste of disk space is caused. When a file is a writable file, it is not possible to determine whether there is too much space remaining in the last cluster of the file because the writable file may need to be written all the time. The change rate of the cluster duty ratio can only be predicted by each time node between the file creation time and the file modification time, the file cluster duty ratio is presumed according to the predicted cluster duty ratio change rate, and the fact that the cluster duty ratio exceeds the second preset cluster duty ratio indicates that the file disk space is wasted. Different judging modes are set according to different attributes of the files, whether the use space of the last cluster of the files is wasted or not can be accurately monitored, and the capacity of the whole disk or the system is greatly improved. According to the monitoring method, the clusters in the disk can be adjusted according to the monitoring result, and the adaptability between the file and the disk is improved.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present invention may be implemented by hardware, or by software plus a necessary general hardware platform. Based on such understanding, the technical solution of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.), and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the method according to the implementation scenarios of the present invention.
Correspondingly, the present application also provides a data resource monitoring system, as shown in fig. 2, the system includes:
an obtaining module 201, configured to obtain basic information and location information of a file to be monitored, and obtain a cluster value of a disk where the file to be monitored is located according to the location information, where the basic information includes an attribute, an occupied space value, time information, and a size value;
a first determining module 202, configured to determine, if the attribute is a read-only file, whether a cluster duty cycle of the file to be monitored exceeds a first preset duty cycle based on the occupied space value, the size value, and the cluster value, and if so, perform an early warning;
a second determining module 203, configured to, if the attribute is a writable file, obtain a predicted cluster duty ratio change rate based on the time information, the occupied space value, and the size value, determine whether a cluster duty ratio of the file to be monitored exceeds a second preset duty ratio based on the predicted cluster duty ratio change rate and the time information, and perform early warning if the cluster duty ratio of the file to be monitored exceeds the second preset duty ratio;
the read-only file is a file which can only be read, and the writable file is a file which can be read and written.
In some embodiments of the present application, the first determining module 202 is specifically configured to:
obtaining a residual space value S by subtracting the occupied space value from the size value, wherein the cluster value is M, and the cluster duty ratio of the file to be monitored is S/M;
setting the first preset duty cycle based on the size value and the cluster value;
and if the S/M exceeds the first preset duty ratio, early warning is carried out.
In some embodiments of the present application, the system further comprises a marking module configured to:
and if the S/M does not exceed the first preset duty ratio, marking the file to be monitored with sufficient capacity.
In some embodiments of the present application, the second determining module 203 is specifically configured to:
the time information comprises creation time, modification time and access time;
in the time from the creation time to the modification time, acquiring the cluster duty ratio of each time node according to the occupied space value and the size value;
and obtaining the predicted cluster duty ratio change rate based on the cluster duty ratios of all the time nodes.
In some embodiments of the present application, the second determining module 203 is further specifically configured to:
acquiring a corresponding occupied space value and a corresponding size value after the modification time, acquiring a cluster duty ratio based on the corresponding occupied space value and the corresponding size value after the modification time, and acquiring a predicted cluster duty ratio based on the cluster duty ratio and the predicted cluster duty ratio change rate;
if the predicted cluster duty ratio exceeds the second preset duty ratio, early warning is carried out;
setting the second preset duty cycle based on the cluster value and the predicted cluster duty cycle rate of change.
Those skilled in the art will appreciate that the modules in the system implementing the scenario may be distributed in the system implementing the scenario according to the description of the implementation scenario, or may be correspondingly changed in one or more systems different from the present implementation scenario. The modules of the implementation scenario may be combined into one module, or may be further split into a plurality of sub-modules.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.
Claims (10)
1. A method for monitoring digital resources, comprising:
acquiring basic information and position information of a file to be monitored, and acquiring a cluster value of a disk where the file to be monitored is located according to the position information, wherein the basic information comprises attributes, occupied space values, time information and size values;
if the attribute is a read-only file, judging whether the cluster duty ratio of the file to be monitored exceeds a first preset duty ratio or not based on the occupied space value, the size value and the cluster value, and if so, carrying out early warning;
if the attribute is a writable file, acquiring a predicted cluster duty ratio change rate based on the time information, the occupied space value and the size value, judging whether the cluster duty ratio of the file to be monitored exceeds a second preset duty ratio based on the predicted cluster duty ratio change rate and the time information, and if so, early warning;
the read-only file is a file which can only be read, and the writable file is a file which can be read and written.
2. The method according to claim 1, wherein determining whether the cluster duty cycle of the file to be monitored exceeds a first preset duty cycle based on the occupied space value, the size value, and the cluster value is specifically:
obtaining a residual space value S by subtracting the occupied space value from the size value, wherein the cluster value is M, and the cluster duty ratio of the file to be monitored is S/M;
setting the first preset duty cycle based on the size value and the cluster value;
and if the S/M exceeds the first preset duty ratio, early warning is carried out.
3. The method of claim 2, wherein the method further comprises:
and if the S/M does not exceed the first preset duty ratio, marking the file to be monitored with sufficient capacity.
4. The method according to claim 1, wherein obtaining a predicted cluster duty cycle rate of change based on the time information, the occupancy value, and the size value is specifically:
the time information comprises creation time, modification time and access time;
in the time from the creation time to the modification time, acquiring the cluster duty ratio of each time node according to the occupied space value and the size value;
and obtaining the predicted cluster duty ratio change rate based on the cluster duty ratios of all the time nodes.
5. The method according to claim 4, wherein the step of determining whether the cluster duty cycle of the file to be monitored exceeds a second preset duty cycle based on the predicted cluster duty cycle change rate and the time information is specifically:
acquiring an occupied space value and a size value corresponding to the modified time, acquiring a cluster duty ratio based on the occupied space value and the size value corresponding to the modified time, and acquiring a predicted cluster duty ratio based on the cluster duty ratio and the predicted cluster duty ratio change rate;
if the predicted cluster duty ratio exceeds the second preset duty ratio, early warning is carried out;
setting the second preset duty cycle based on the cluster value and the predicted cluster duty cycle rate of change.
6. A data resource monitoring system, comprising:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring basic information and position information of a file to be monitored and acquiring a cluster value of a disk where the file to be monitored is located according to the position information, and the basic information comprises attributes, an occupied space value, time information and a size value;
the first judgment module is used for judging whether the cluster duty ratio of the file to be monitored exceeds a first preset duty ratio or not based on the occupied space value, the size value and the cluster value if the attribute is the read-only file, and carrying out early warning if the cluster duty ratio of the file to be monitored exceeds the first preset duty ratio;
a second determination module, configured to, if the attribute is a writable file, obtain a predicted cluster duty cycle change rate based on the time information, the occupied space value, and the size value, determine whether a cluster duty cycle of the file to be monitored exceeds a second preset duty cycle based on the predicted cluster duty cycle change rate and the time information, and perform early warning if the cluster duty cycle of the file to be monitored exceeds the second preset duty cycle;
the read-only file is a file which can only be read, and the writable file is a file which can be read and written.
7. The system of claim 6, wherein the first determination module is specifically configured to:
obtaining a residual space value S by subtracting the occupied space value from the size value, wherein the cluster value is M, and the cluster duty ratio of the file to be monitored is S/M;
setting the first preset duty cycle based on the size value and the cluster value;
and if the S/M exceeds the first preset duty ratio, early warning is carried out.
8. The system of claim 7, further comprising a marking module to:
and if the S/M does not exceed the first preset duty ratio, marking the file to be monitored with sufficient capacity.
9. The system of claim 6, wherein the second determination module is specifically configured to:
the time information comprises creation time, modification time and access time;
in the time from the creation time to the modification time, acquiring the cluster duty ratio of each time node according to the occupied space value and the size value;
and obtaining the predicted cluster duty ratio change rate based on the cluster duty ratios of all the time nodes.
10. The system of claim 9, wherein the second determination module is further specifically configured to:
acquiring a corresponding occupied space value and a corresponding size value after the modification time, acquiring a cluster duty ratio based on the corresponding occupied space value and the corresponding size value after the modification time, and acquiring a predicted cluster duty ratio based on the cluster duty ratio and the predicted cluster duty ratio change rate;
if the predicted cluster duty ratio exceeds the second preset duty ratio, early warning is carried out;
setting the second preset duty cycle based on the cluster value and the predicted cluster duty cycle rate of change.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210330541.5A CN114911668B (en) | 2022-03-31 | 2022-03-31 | Data resource monitoring method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210330541.5A CN114911668B (en) | 2022-03-31 | 2022-03-31 | Data resource monitoring method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114911668A true CN114911668A (en) | 2022-08-16 |
| CN114911668B CN114911668B (en) | 2022-12-16 |
Family
ID=82762419
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210330541.5A Active CN114911668B (en) | 2022-03-31 | 2022-03-31 | Data resource monitoring method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114911668B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050160189A1 (en) * | 2004-01-21 | 2005-07-21 | International Business Machines Corporation | Reliable use of desktop class disk drives in enterprise storage applications |
| CN102999369A (en) * | 2012-12-25 | 2013-03-27 | 杭州华三通信技术有限公司 | Method and device for upgrading virtual machines |
| CN109407971A (en) * | 2018-09-13 | 2019-03-01 | 新华三云计算技术有限公司 | The method and device of staging disk lock |
| CN109471756A (en) * | 2018-11-16 | 2019-03-15 | 深圳市得微电子有限责任公司 | Data reconstruction method, device and computer readable storage medium |
| CN110401567A (en) * | 2019-07-25 | 2019-11-01 | 中国工商银行股份有限公司 | The processing method of alarm data, calculates equipment, medium at device |
| CN114077690A (en) * | 2020-08-21 | 2022-02-22 | 浙江宇视科技有限公司 | Vector data processing method, device, equipment and storage medium |
| CN114188632A (en) * | 2021-11-15 | 2022-03-15 | 深圳市科陆电子科技股份有限公司 | Fan speed regulation method, device, equipment and storage medium |
-
2022
- 2022-03-31 CN CN202210330541.5A patent/CN114911668B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050160189A1 (en) * | 2004-01-21 | 2005-07-21 | International Business Machines Corporation | Reliable use of desktop class disk drives in enterprise storage applications |
| CN102999369A (en) * | 2012-12-25 | 2013-03-27 | 杭州华三通信技术有限公司 | Method and device for upgrading virtual machines |
| CN109407971A (en) * | 2018-09-13 | 2019-03-01 | 新华三云计算技术有限公司 | The method and device of staging disk lock |
| CN109471756A (en) * | 2018-11-16 | 2019-03-15 | 深圳市得微电子有限责任公司 | Data reconstruction method, device and computer readable storage medium |
| CN110401567A (en) * | 2019-07-25 | 2019-11-01 | 中国工商银行股份有限公司 | The processing method of alarm data, calculates equipment, medium at device |
| CN114077690A (en) * | 2020-08-21 | 2022-02-22 | 浙江宇视科技有限公司 | Vector data processing method, device, equipment and storage medium |
| CN114188632A (en) * | 2021-11-15 | 2022-03-15 | 深圳市科陆电子科技股份有限公司 | Fan speed regulation method, device, equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 苏守宝: "在VFP中访问DLL获取磁盘结构信息", 《安庆师范学院学报(自然科学版)》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114911668B (en) | 2022-12-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107656807B (en) | Automatic elastic expansion method and device for virtual resources | |
| US8682850B2 (en) | Method of enhancing de-duplication impact by preferential selection of master copy to be retained | |
| JP2013509658A (en) | Allocation of storage memory based on future usage estimates | |
| CN110930291B (en) | GPU video memory management control method and related device | |
| CN111309644B (en) | Memory allocation method and device and computer readable storage medium | |
| CN113495889B (en) | Distributed object storage method and device, electronic equipment and storage medium | |
| US20100138627A1 (en) | Efficient alert mechanism for overutilization of storage resources | |
| CN110007858B (en) | Storage space allocation method and device | |
| CN112367384B (en) | Kafka cluster-based dynamic speed limiting method and device and computer equipment | |
| CN112256433B (en) | Partition migration method and device based on Kafka cluster | |
| CN110737717B (en) | Database migration method and device | |
| CN114844791B (en) | Cloud service automatic management and distribution method and system based on big data and storage medium | |
| CN116244085A (en) | Kubernetes cluster container group scheduling method, device and medium | |
| CN109634524B (en) | Data partition configuration method, device and equipment of data processing daemon | |
| CN111399761A (en) | Storage resource allocation method, device and equipment and storage medium | |
| CN114217740A (en) | Storage management method, equipment, system and computer readable storage medium | |
| CN114911668B (en) | Data resource monitoring method and system | |
| CN115442262B (en) | Resource evaluation method and device, electronic equipment and storage medium | |
| CN115080253B (en) | GPU task allocation method and device, electronic equipment and storage medium | |
| CN110932935A (en) | Resource control method, device, equipment and computer storage medium | |
| CN116204311A (en) | Pod cluster capacity expansion and contraction method and device, computer equipment and storage medium | |
| CN112398892A (en) | Service distribution method, device and equipment | |
| CN114513401A (en) | Automatic operation and maintenance repair method and device for private cloud and computer readable medium | |
| CN106959888B (en) | Task processing method and device in cloud storage system | |
| CN113407192B (en) | Model deployment method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |