CN111736772A - Storage space data processing method and device of distributed file system - Google Patents

Storage space data processing method and device of distributed file system Download PDF

Info

Publication number
CN111736772A
CN111736772A CN202010541216.4A CN202010541216A CN111736772A CN 111736772 A CN111736772 A CN 111736772A CN 202010541216 A CN202010541216 A CN 202010541216A CN 111736772 A CN111736772 A CN 111736772A
Authority
CN
China
Prior art keywords
storage space
utilization rate
maximum
value
predicted value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010541216.4A
Other languages
Chinese (zh)
Inventor
王启宇
沈一帆
任政
白佳乐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202010541216.4A priority Critical patent/CN111736772A/en
Publication of CN111736772A publication Critical patent/CN111736772A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614Improving the reliability of storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608Saving storage space on storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0631Configuration or reconfiguration of storage systems by allocating resources to storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/0644Management of space entities, e.g. partitions, extents, pools
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0653Monitoring storage devices or systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

The embodiment of the application provides a storage space data processing method and device of a distributed file system, wherein the method comprises the following steps: predicting the use information according to the change rate of the use information of the storage space of the target storage volume in a set time period to obtain storage space use information prediction data; according to the comparison result of the storage space use information prediction data and a preset use threshold, executing corresponding storage space allocation operation on the target storage volume; the method and the device can accurately predict the use condition of the storage space in the distributed file system, timely and reliably execute the corresponding storage space scheduling operation, avoid the condition of large file write failure, and ensure the stable operation of the system.

Description

Storage space data processing method and device of distributed file system
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for processing storage space data of a distributed file system.
Background
The distributed file storage system used at present is a distributed file system built based on a file system of a host, the distributed file system takes file systems on different servers as storage blocks, and a plurality of storage blocks form a storage volume and then are provided for a user. The distributed file system distributes files to different storage blocks through scheduling under a non-stripe strategy.
The inventor finds that if a large file is continuously increased, a user still has residual space on a storage volume from the perspective of the storage volume, but when the storage volume occupies one storage block, writing fails because one file cannot be written across two storage blocks, and the prior art cannot achieve reliable and flexible storage space scheduling when the large file is written, so that the situation of writing failure of the large file is easily caused.
Disclosure of Invention
Aiming at the problems in the prior art, the application provides a storage space data processing method and device of a distributed file system, which can accurately predict the use condition of a storage space in the distributed file system, timely and reliably execute corresponding storage space scheduling operation, avoid the condition of large file write failure and ensure the stable operation of the system.
In order to solve at least one of the above problems, the present application provides the following technical solutions:
in a first aspect, the present application provides a storage space data processing method for a distributed file system, including:
predicting the use information according to the change rate of the use information of the storage space of the target storage volume in a set time period to obtain storage space use information prediction data;
and executing corresponding storage space allocation operation on the target storage volume according to the comparison result of the storage space usage information prediction data and a preset usage threshold.
Further, the predicting of the usage information according to the change rate of the storage space usage information of the target storage volume in a set time period to obtain storage space usage information prediction data includes:
determining a first matrix parameter according to the maximum utilization rate and the maximum difference of the utilization rate of the target storage volume, wherein the maximum utilization rate and the maximum difference of the utilization rate are determined according to the current utilization rate of each storage block in the target storage volume;
determining a second matrix parameter according to the maximum utilization rate and the change speed and the change acceleration of the maximum difference value of the utilization rates in a set historical time period;
determining a third matrix parameter according to the maximum utilization rate and the maximum utilization rate difference value, and an expected maximum utilization rate difference value obtained after the change speed and the change acceleration pass a set future time period;
determining a state transition matrix of a Kalman filter according to the first matrix parameter, the second matrix parameter and the third matrix parameter;
and performing information prediction on the maximum utilization rate and the maximum utilization rate difference value according to the Kalman filter to obtain a maximum utilization rate prediction value and a maximum utilization rate difference value prediction value, and setting the maximum utilization rate prediction value and the maximum utilization rate difference value prediction value as storage space utilization information prediction data.
Further, the performing, according to the comparison result between the storage space usage information prediction data and a preset usage threshold, a corresponding storage space allocation operation on the target storage volume includes:
judging whether the maximum utilization rate predicted value is larger than a first preset utilization threshold value or not and whether the utilization rate maximum difference predicted value is larger than a second preset utilization threshold value or not, and if yes, executing storage space data equalization processing on the target storage volume;
judging whether the maximum utilization rate predicted value is larger than a first preset utilization threshold value or not and whether the utilization rate maximum difference predicted value is smaller than a second preset utilization threshold value or not, and if yes, executing storage space expansion processing on the target storage volume;
judging whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value or not and whether the utilization rate maximum difference predicted value is larger than a second preset utilization threshold value or not, and if yes, executing storage space data equalization processing on the target storage volume;
and judging whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value or not, and whether the utilization rate maximum difference predicted value is smaller than a second preset utilization threshold value or not, if so, judging that the storage space of the target storage volume is normal.
Further, before the performing, according to the comparison result between the storage space usage information prediction data and a preset usage threshold, a corresponding storage space allocation operation on the target storage volume, the method includes:
performing linear regression processing on the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value;
and carrying out error screening processing according to the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value after the linear regression processing and a preset standard deviation screening model to obtain the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value after the error screening processing.
In a second aspect, the present application provides a storage space data processing apparatus of a distributed file system, including:
the storage space prediction module is used for predicting the use information according to the change rate of the use information of the storage space of the target storage volume in a set time period to obtain storage space use information prediction data;
and the storage space allocation module is used for executing corresponding storage space allocation operation on the target storage volume according to the comparison result of the storage space use information prediction data and a preset use threshold.
Further, the memory space prediction module comprises:
a first matrix parameter determining unit, configured to determine a first matrix parameter according to a maximum usage rate of the target storage volume and a maximum difference between the usage rates, where the maximum usage rate and the maximum difference between the usage rates are determined according to a current usage rate of each storage block in the target storage volume;
the second matrix parameter determining unit is used for determining second matrix parameters according to the change speed and the change acceleration of the maximum utilization rate and the maximum difference value of the utilization rates in a set historical time period;
a third matrix parameter determining unit, configured to determine a third matrix parameter according to the maximum usage rate and the maximum difference between the usage rates, and according to a maximum difference between an expected maximum usage rate and an expected usage rate, which are obtained after the change speed and the change acceleration pass a set future time period;
the state transition matrix determining unit is used for determining a state transition matrix of the Kalman filter according to the first matrix parameter, the second matrix parameter and the third matrix parameter;
and the Kalman filter prediction unit is used for performing information prediction on the maximum utilization rate and the maximum utilization rate difference value according to the Kalman filter to obtain a maximum utilization rate prediction value and a maximum utilization rate difference value prediction value, and setting the maximum utilization rate prediction value and the maximum utilization rate difference value prediction value as storage space utilization information prediction data.
Further, the storage space allocation module includes:
the first data equalization processing unit is used for judging whether the maximum utilization rate predicted value is greater than a first preset utilization threshold value or not and whether the utilization rate maximum difference predicted value is greater than a second preset utilization threshold value or not, and if yes, executing storage space data equalization processing on the target storage volume;
the storage space capacity expansion unit is used for judging whether the maximum utilization rate predicted value is larger than a first preset utilization threshold value or not and whether the maximum utilization rate difference predicted value is smaller than a second preset utilization threshold value or not, and if yes, executing storage space capacity expansion processing on the target storage volume;
the second data equalization processing unit is used for judging whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value or not and whether the maximum utilization rate difference predicted value is larger than a second preset utilization threshold value or not, and if yes, executing storage space data equalization processing on the target storage volume;
and the storage space normality judging unit is used for judging whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value or not and whether the utilization rate maximum difference value predicted value is smaller than a second preset utilization threshold value or not, and if so, judging that the storage space of the target storage volume is normal.
Further, still include:
the linear regression unit is used for carrying out linear regression processing on the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value;
and the error screening unit is used for carrying out error screening processing according to the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value which are subjected to the linear regression processing and a preset standard deviation screening model to obtain the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value which are subjected to the error screening processing.
In a third aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the storage space data processing method of the distributed file system when executing the program.
In a fourth aspect, the present application provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the storage space data processing method of the distributed file system.
According to the technical scheme, after the storage space use information of the target storage volume is obtained, use information prediction is carried out according to the change rate of the storage space use information in a set time period, so that storage space use information prediction data in the set time in the future are obtained, numerical comparison is carried out according to the storage space use information prediction data and a preset use threshold, corresponding storage space allocation operation is carried out on the target storage volume according to the comparison result, the use condition of the storage space in the distributed file system is accurately predicted, corresponding storage space scheduling operation is timely and reliably carried out, the situation of large file writing failure is avoided, and the stable operation of the system is guaranteed.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a storage space data processing method of a distributed file system in an embodiment of the present application;
FIG. 2 is a second flowchart illustrating a storage space data processing method of a distributed file system according to an embodiment of the present application;
FIG. 3 is a third flowchart illustrating a storage space data processing method of a distributed file system according to an embodiment of the present application;
FIG. 4 is a fourth flowchart illustrating a storage space data processing method of the distributed file system according to an embodiment of the present application;
FIG. 5 is a block diagram of a storage space data processing apparatus of a distributed file system according to an embodiment of the present application;
FIG. 6 is a second block diagram of a storage space data processing apparatus of a distributed file system according to an embodiment of the present application;
FIG. 7 is a third block diagram of a storage space data processing apparatus of a distributed file system according to an embodiment of the present application;
FIG. 8 is a fourth block diagram of a storage space data processing apparatus of a distributed file system according to an embodiment of the present application;
FIG. 9 is a schematic diagram of a linear regression process in one embodiment of the present application;
FIG. 10 is a diagram illustrating various memory allocation operations in an embodiment of the present application;
fig. 11 is a schematic structural diagram of an electronic device in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In view of the problem that the prior art cannot reliably and flexibly schedule the storage space when writing a large file, and thus the situation of writing failure of the large file is easily caused, the application provides a storage space data processing method and device of a distributed file system, which predict the use information according to the change rate of the storage space use information in a set time period after obtaining the storage space use information of a target storage volume, so as to obtain the storage space use information prediction data in the set time in the future, compare the storage space use information prediction data with a preset use threshold value, and perform corresponding storage space allocation operation on the target storage volume according to the comparison result, thereby accurately predicting the use condition of the storage space in the distributed file system, and timely and reliably performing corresponding storage space scheduling operation, the situation of large file write failure is avoided, and the stable operation of the system is guaranteed.
In order to accurately predict the use condition of the storage space in the distributed file system, timely and reliably execute the corresponding storage space scheduling operation, avoid the situation of large file write failure, and ensure the stable operation of the system, the present application provides an embodiment of a storage space data processing method of the distributed file system, and referring to fig. 1, the storage space data processing method of the distributed file system specifically includes the following contents:
step S101: and predicting the use information according to the change rate of the use information of the storage space of the target storage volume in a set time period to obtain storage space use information prediction data.
It is understood that a distributed file system (i.e., a distributed file storage system) is a system built based on a host file system, and the distributed file system takes file systems on different servers as storage blocks, and the storage blocks form a storage volume and then are provided for a user. The distributed file system distributes files to different storage blocks through scheduling under a non-stripe strategy.
Optionally, the storage space usage information includes, but is not limited to: the current utilization of each storage block in the target storage volume, the maximum utilization in the target storage volume determined by the current utilization of each storage block, and the maximum difference in utilization in the target storage volume (difference between the maximum utilization and the minimum utilization) determined by the current utilization of each storage block.
It is understood that the maximum usage rate and the maximum difference of the usage rates can reflect whether the storage space of each storage block in the target storage volume is balanced.
Alternatively, the prediction of the usage information can be performed based on the change rate of the storage space usage information in a set time period, which may be a historical time period, that is, a storage space usage information prediction data, which is a value predicted to be possible in a future period of time according to the data change characteristics of the storage space usage information in a past period of time.
It is to be understood that the storage space usage information prediction data can be obtained according to at least one existing data prediction method.
Step S102: and executing corresponding storage space allocation operation on the target storage volume according to the comparison result of the storage space usage information prediction data and a preset usage threshold.
Optionally, after obtaining the storage space usage information prediction data in the above steps, the storage space usage information prediction data may be compared with at least one preset usage threshold value, so as to divide the storage space usage information prediction data into at least one different situation, and different storage space allocation operations are set for each situation, so that the storage space allocation operation is flexibly and accurately performed on the target storage volume in advance, so as to cope with the storage space usage change that may occur in the future, ensure the stability of the whole distributed file system, and particularly, can solve the problem that the large file writing may fail.
As can be seen from the above description, the storage space data processing method of the distributed file system according to the embodiment of the present application can predict the usage information according to the change rate of the storage space usage information in a set time period after obtaining the storage space usage information of the target storage volume, so as to obtain the storage space usage information prediction data in a set time in the future, perform numerical comparison according to the storage space usage information prediction data and a preset usage threshold, and perform a corresponding storage space allocation operation on the target storage volume according to a comparison result, thereby accurately predicting the usage of the storage space in the distributed file system, performing a corresponding storage space scheduling operation timely and reliably, avoiding a situation of large file write failure, and ensuring stable operation of the system.
In order to accurately predict the storage space usage information, in an embodiment of the storage space data processing method of the distributed file system of the present application, referring to fig. 2, the step S101 may further include the following steps:
step S201: determining a first matrix parameter according to the maximum utilization rate and the maximum difference of the utilization rate of the target storage volume, wherein the maximum utilization rate and the maximum difference of the utilization rate are determined according to the current utilization rate of each storage block in the target storage volume.
Step S202: and determining a second matrix parameter according to the change speed and the change acceleration of the maximum utilization rate and the maximum difference value of the utilization rates in a set historical time period.
Step S203: and determining a third matrix parameter according to the maximum utilization rate and the maximum utilization rate difference value, wherein the expected maximum utilization rate and the expected maximum utilization rate difference value are obtained after the change speed and the change acceleration pass a set future time period.
Step S204: and determining a state transition matrix of the Kalman filter according to the first matrix parameter, the second matrix parameter and the third matrix parameter.
Step S205: and performing information prediction on the maximum utilization rate and the maximum utilization rate difference value according to the Kalman filter to obtain a maximum utilization rate prediction value and a maximum utilization rate difference value prediction value, and setting the maximum utilization rate prediction value and the maximum utilization rate difference value prediction value as storage space utilization information prediction data.
Optionally, first, the current utilization rate of each storage block in the target storage volume may be obtained, so as to determine the maximum utilization rate x and the maximum utilization rate difference y of the target storage volume, and use the maximum utilization rate x and the maximum utilization rate difference y as a first matrix parameter, where the first matrix parameter is one of parameters used for generating a state transition matrix in the kalman filter.
Then, the change speeds dx and dy (first derivative of x and y, respectively) and the change acceleration d within a set history time period (for example, the past 1 hour) are calculated based on the maximum usage rate x and the maximum difference y of the usage rates2x and d2y (performing second-order derivation on x and y respectively), and determining a second matrix parameter, wherein the second matrix parameter is one of parameters used for generating a state transition matrix in the Kalman filter.
Then, according to the maximum utilization rate x and the maximum difference value y of the utilization rates, according to the change speed (dx and dy) and the change acceleration (d)2x and d2y) obtaining an expected maximum utilization rate x 'and an expected maximum utilization difference y' after a set future time period delta t (for example, 1 hour in the future), and determining a third matrix parameter, wherein the third matrix parameter is one of parameters used for generating a state transition matrix in the Kalman filter.
The parameters are arranged to obtain:
Figure BDA0002539008220000081
Figure BDA0002539008220000082
dx'=dx+d2x
dy'=dy+d2y
d2x'=d2x
d2y'=d2y
this results in a matrix:
Figure BDA0002539008220000083
the above matrix is set as a state transition matrix of a kalman filter, thereby generating a kalman filter suitable for the present application, and prediction data at time T + Δ T is obtained by inputting maximum utilization and maximum difference data of the utilization from time 0 to time T. By adjusting Δ t, a predicted value after 1 second or even after 1 day can be obtained.
In order to flexibly perform corresponding storage space allocation operations according to the storage space usage information prediction data of different degrees, in an embodiment of the storage space data processing method of the distributed file system of the present application, referring to fig. 3, the step S102 may further specifically include the following:
step S301: and judging whether the maximum utilization rate predicted value is greater than a first preset utilization threshold value or not, and whether the utilization rate maximum difference predicted value is greater than a second preset utilization threshold value or not, if so, executing storage space data equalization processing on the target storage volume.
Step S302: and judging whether the maximum utilization rate predicted value is greater than a first preset utilization threshold value or not, and whether the utilization rate maximum difference predicted value is less than a second preset utilization threshold value or not, and if so, executing storage space expansion processing on the target storage volume.
Step S303: and judging whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value or not and whether the utilization rate maximum difference predicted value is larger than a second preset utilization threshold value or not, and if so, executing storage space data equalization processing on the target storage volume.
Step S304: and judging whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value or not, and whether the utilization rate maximum difference predicted value is smaller than a second preset utilization threshold value or not, if so, judging that the storage space of the target storage volume is normal.
Referring to fig. 10, for a target storage volume whose predicted maximum utilization ratio predicted value is greater than 80%, if the maximum utilization ratio difference predicted value is greater than 40%, storage space data balancing processing may be performed on the target storage volume, and if the maximum utilization ratio difference predicted value is less than 40%, storage volume expansion processing is performed, that is, at least one storage block is newly added. For a target storage volume with the maximum utilization rate predicted value lower than 80%, if the predicted maximum utilization rate difference predicted value is greater than 40%, performing storage space data equalization processing on the target storage volume, otherwise, judging that the storage space of the target storage volume is normal, and performing stable operation.
In order to further improve the accuracy of the storage space usage information prediction data, in an embodiment of the storage space data processing method of the distributed file system of the present application, referring to fig. 4, before executing step S102, the following may be further included:
step S401: and performing linear regression processing on the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value.
Step S402: and carrying out error screening processing according to the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value after the linear regression processing and a preset standard deviation screening model to obtain the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value after the error screening processing.
Optionally, the predicted values from the current time T to T + Δ T (i.e., the maximum utilization rate predicted value and the maximum utilization rate difference predicted value) are taken, the abscissa value is set as the maximum utilization rate predicted value, the ordinate value is set as the maximum utilization rate difference predicted value, at this time, the least squares normal linear regression calculation is performed, and the obtained result is shown in fig. 9, where the higher the degree of fitting of linear regression is, the smaller the error is, and the longer the confidence prediction range is.
Then, the model is screened according to a predetermined standard deviation, such as the standard deviation
Figure BDA0002539008220000101
Wherein, yiIs a predicted value represented by a point on an oblique line in fig. 9,
Figure BDA0002539008220000102
the predicted values represented by all the points in FIG. 9 are defined, n is the data number of the predicted values, and the method is also self-defined
Figure BDA0002539008220000103
If the predicted data at the time T + delta T is credible when the predicted data is less than an expectation (for example, 0.05), otherwise, the predicted data is incredible error data, and therefore error screening processing is carried out, namely, an incredible maximum utilization rate predicted value and a utilization rate maximum difference value predicted value are removed.
It is understood that, for example, the standard deviation
Figure BDA0002539008220000104
Reducing delta T when the expected value is exceeded, and repeating the calculation until the standard deviation is reached
Figure BDA0002539008220000105
Less than expected.
In order to accurately predict the usage of the storage space in the distributed file system, execute the corresponding storage space scheduling operation timely and reliably, avoid the situation of large file write failure, and ensure the stable operation of the system, the present application provides an embodiment of a storage space data processing apparatus of the distributed file system, which is used for implementing all or part of the contents of the storage space data processing method of the distributed file system, and referring to fig. 5, the storage space data processing apparatus of the distributed file system specifically includes the following contents:
and the storage space prediction module 10 is configured to perform usage information prediction according to a change rate of the storage space usage information of the target storage volume in a set time period, so as to obtain storage space usage information prediction data.
And the storage space allocation module 20 is configured to execute a corresponding storage space allocation operation on the target storage volume according to a comparison result between the storage space usage information prediction data and a preset usage threshold.
As can be seen from the above description, the storage space data processing apparatus of the distributed file system according to the embodiment of the present application can perform usage information prediction according to the change rate of the storage space usage information in a set time period after obtaining the storage space usage information of the target storage volume, to obtain the storage space usage information prediction data in a set time in the future, perform numerical comparison according to the storage space usage information prediction data and a preset usage threshold, and perform corresponding storage space allocation operation on the target storage volume according to the comparison result, thereby accurately predicting the usage of the storage space in the distributed file system, performing corresponding storage space scheduling operation timely and reliably, avoiding a situation of large file write failure, and ensuring stable operation of the system.
In order to accurately predict the storage space usage information, in an embodiment of the storage space data processing apparatus of the distributed file system of the present application, referring to fig. 6, the storage space prediction module 10 includes:
a first matrix parameter determining unit 11, configured to determine a first matrix parameter according to a maximum utilization rate of the target storage volume and a maximum difference of the utilization rates, where the maximum utilization rate and the maximum difference of the utilization rates are determined according to a current utilization rate of each storage block in the target storage volume.
And a second matrix parameter determining unit 12, configured to determine a second matrix parameter according to a change speed and a change acceleration of the maximum difference between the maximum usage rate and the usage rate within a set historical time period.
A third matrix parameter determining unit 13, configured to determine a third matrix parameter according to the maximum usage rate and the maximum difference between the usage rates, and according to the expected maximum usage rate and the maximum difference between the expected usage rates, which are obtained after the change speed and the change acceleration pass through a set future time period.
A state transition matrix determining unit 14, configured to determine a state transition matrix of the kalman filter according to the first matrix parameter, the second matrix parameter, and the third matrix parameter.
And the kalman filter prediction unit 15 is configured to perform information prediction on the maximum utilization rate and the maximum difference of the utilization rates according to the kalman filter to obtain a maximum utilization rate prediction value and a maximum utilization rate difference prediction value, and set the maximum utilization rate prediction value and the maximum utilization rate difference prediction value as storage space utilization information prediction data.
In order to flexibly perform the corresponding storage space allocation operation according to the storage space usage information prediction data of different degrees, in an embodiment of the storage space data processing apparatus of the distributed file system of the present application, referring to fig. 7, the storage space allocation module 20 includes:
the first data equalization processing unit 21 is configured to determine whether the maximum utilization prediction value is greater than a first preset utilization threshold, and whether the maximum utilization difference prediction value is greater than a second preset utilization threshold, if yes, perform storage space data equalization processing on the target storage volume.
And the storage space capacity expansion unit 22 is configured to determine whether the maximum utilization prediction value is greater than a first preset utilization threshold value, and whether the maximum utilization difference prediction value is less than a second preset utilization threshold value, if so, perform storage space capacity expansion processing on the target storage volume.
And the second data equalization processing unit 23 is configured to determine whether the maximum utilization prediction value is smaller than a first preset utilization threshold, and whether the maximum utilization difference prediction value is larger than a second preset utilization threshold, if so, perform storage space data equalization processing on the target storage volume.
And the storage space normality judging unit 24 is configured to judge whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value, and whether the usage rate maximum difference predicted value is smaller than a second preset utilization threshold value, if so, judge that the storage space of the target storage volume is normal.
In order to further improve the accuracy of the storage space usage information prediction data, in an embodiment of the storage space data processing apparatus of the distributed file system of the present application, referring to fig. 8, the storage space data processing apparatus further includes:
and a linear regression unit 31, configured to perform linear regression processing on the maximum utilization prediction value and the utilization maximum difference prediction value.
And the error screening unit 32 is configured to perform error screening processing according to the maximum utilization predicted value and the maximum utilization difference predicted value after the linear regression processing and a preset standard deviation screening model to obtain the maximum utilization predicted value and the maximum utilization difference predicted value after the error screening processing.
In order to accurately predict the usage of a storage space in a distributed file system, timely and reliably execute a corresponding storage space scheduling operation, avoid a situation of large file write failure, and ensure stable operation of the system, the present application provides an embodiment of an electronic device for implementing all or part of the contents in a storage space data processing method of the distributed file system, where the electronic device specifically includes the following contents:
a processor (processor), a memory (memory), a communication Interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the communication interface is used for realizing information transmission between the storage space data processing device of the distributed file system and relevant equipment such as a core service system, a user terminal, a relevant database and the like; the logic controller may be a desktop computer, a tablet computer, a mobile terminal, and the like, but the embodiment is not limited thereto. In this embodiment, the logic controller may refer to an embodiment of the storage space data processing method of the distributed file system and an embodiment of the storage space data processing apparatus of the distributed file system in the embodiment, which are incorporated herein, and repeated details are not repeated.
It is understood that the user terminal may include a smart phone, a tablet electronic device, a network set-top box, a portable computer, a desktop computer, a Personal Digital Assistant (PDA), an in-vehicle device, a smart wearable device, and the like. Wherein, intelligence wearing equipment can include intelligent glasses, intelligent wrist-watch, intelligent bracelet etc..
In practical applications, part of the storage space data processing method of the distributed file system may be executed on the electronic device side as described above, or all operations may be completed in the client device. The selection may be specifically performed according to the processing capability of the client device, the limitation of the user usage scenario, and the like. This is not a limitation of the present application. The client device may further include a processor if all operations are performed in the client device.
The client device may have a communication module (i.e., a communication unit), and may be communicatively connected to a remote server to implement data transmission with the server. The server may include a server on the task scheduling center side, and in other implementation scenarios, the server may also include a server on an intermediate platform, for example, a server on a third-party server platform that is communicatively linked to the task scheduling center server. The server may include a single computer device, or may include a server cluster formed by a plurality of servers, or a server structure of a distributed apparatus.
Fig. 11 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application. As shown in fig. 11, the electronic device 9600 can include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this FIG. 11 is exemplary; other types of structures may also be used in addition to or in place of the structure to implement telecommunications or other functions.
In one embodiment, the storage space data processing method functions of the distributed file system may be integrated into the central processor 9100. The central processor 9100 may be configured to control as follows:
step S101: and predicting the use information according to the change rate of the use information of the storage space of the target storage volume in a set time period to obtain storage space use information prediction data.
Step S102: and executing corresponding storage space allocation operation on the target storage volume according to the comparison result of the storage space usage information prediction data and a preset usage threshold.
As can be seen from the above description, according to the electronic device provided in the embodiment of the present application, after the storage space usage information of the target storage volume is obtained, the usage information is predicted according to the change rate of the storage space usage information in the set time period, so as to obtain the storage space usage information prediction data in the set time in the future, and the storage space usage information prediction data is compared with the preset usage threshold value according to the value, so as to perform the corresponding storage space allocation operation on the target storage volume according to the comparison result, thereby accurately predicting the usage situation of the storage space in the distributed file system, timely and reliably performing the corresponding storage space scheduling operation, avoiding the situation of large file write failure, and ensuring stable operation of the system.
In another embodiment, the storage space data processing apparatus of the distributed file system may be configured separately from the central processing unit 9100, for example, the storage space data processing apparatus of the distributed file system may be configured as a chip connected to the central processing unit 9100, and the storage space data processing method function of the distributed file system is realized by the control of the central processing unit.
As shown in fig. 11, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 also does not necessarily include all of the components shown in fig. 11; in addition, the electronic device 9600 may further include components not shown in fig. 11, which may be referred to in the prior art.
As shown in fig. 11, a central processor 9100, sometimes referred to as a controller or operational control, can include a microprocessor or other processor device and/or logic device, which central processor 9100 receives input and controls the operation of the various components of the electronic device 9600.
The memory 9140 can be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 9100 can execute the program stored in the memory 9140 to realize information storage or processing, or the like.
The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. Power supply 9170 is used to provide power to electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, an LCD display, but is not limited thereto.
The memory 9140 can be a solid state memory, e.g., Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 9140 could also be some other type of device. Memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 being used for storing application programs and function programs or for executing a flow of operations of the electronic device 9600 by the central processor 9100.
The memory 9140 can also include a data store 9143, the data store 9143 being used to store data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers for the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, contact book applications, etc.).
The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. The communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as in the case of a conventional mobile communication terminal.
Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and receive audio input from the microphone 9132, thereby implementing ordinary telecommunications functions. The audio processor 9130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100, thereby enabling recording locally through the microphone 9132 and enabling locally stored sounds to be played through the speaker 9131.
An embodiment of the present application further provides a computer-readable storage medium capable of implementing all the steps in the storage space data processing method of the distributed file system with the execution subject being the server or the client in the foregoing embodiments, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements all the steps in the storage space data processing method of the distributed file system with the execution subject being the server or the client in the foregoing embodiments, for example, when the processor executes the computer program, the processor implements the following steps:
step S101: and predicting the use information according to the change rate of the use information of the storage space of the target storage volume in a set time period to obtain storage space use information prediction data.
Step S102: and executing corresponding storage space allocation operation on the target storage volume according to the comparison result of the storage space usage information prediction data and a preset usage threshold.
As can be seen from the above description, in the computer-readable storage medium provided in this embodiment of the present application, after the storage space usage information of the target storage volume is obtained, the usage information is predicted according to the change rate of the storage space usage information in a set time period, so as to obtain the storage space usage information prediction data in a set time in the future, and the storage space usage information prediction data is compared with a preset usage threshold value according to a numerical value, so as to perform a corresponding storage space allocation operation on the target storage volume according to a comparison result, thereby accurately predicting the usage of the storage space in the distributed file system, timely and reliably performing a corresponding storage space scheduling operation, avoiding a situation where writing of a large file fails, and ensuring stable operation of the system.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principle and the implementation mode of the invention are explained by applying specific embodiments in the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. A method for processing storage space data of a distributed file system, the method comprising:
predicting the use information according to the change rate of the use information of the storage space of the target storage volume in a set time period to obtain storage space use information prediction data;
and executing corresponding storage space allocation operation on the target storage volume according to the comparison result of the storage space usage information prediction data and a preset usage threshold.
2. The method for processing storage space data of a distributed file system according to claim 1, wherein the obtaining of storage space usage information prediction data by predicting usage information according to a change rate of storage space usage information of a target storage volume in a set time period comprises:
determining a first matrix parameter according to the maximum utilization rate and the maximum difference of the utilization rate of the target storage volume, wherein the maximum utilization rate and the maximum difference of the utilization rate are determined according to the current utilization rate of each storage block in the target storage volume;
determining a second matrix parameter according to the maximum utilization rate and the change speed and the change acceleration of the maximum difference value of the utilization rates in a set historical time period;
determining a third matrix parameter according to the maximum utilization rate and the maximum utilization rate difference value, and an expected maximum utilization rate difference value obtained after the change speed and the change acceleration pass a set future time period;
determining a state transition matrix of a Kalman filter according to the first matrix parameter, the second matrix parameter and the third matrix parameter;
and performing information prediction on the maximum utilization rate and the maximum utilization rate difference value according to the Kalman filter to obtain a maximum utilization rate prediction value and a maximum utilization rate difference value prediction value, and setting the maximum utilization rate prediction value and the maximum utilization rate difference value prediction value as storage space utilization information prediction data.
3. The method for processing storage space data of a distributed file system according to claim 2, wherein the performing, according to the comparison result between the storage space usage information prediction data and a preset usage threshold, a corresponding storage space allocation operation on the target storage volume comprises:
judging whether the maximum utilization rate predicted value is larger than a first preset utilization threshold value or not and whether the utilization rate maximum difference predicted value is larger than a second preset utilization threshold value or not, and if yes, executing storage space data equalization processing on the target storage volume;
judging whether the maximum utilization rate predicted value is larger than a first preset utilization threshold value or not and whether the utilization rate maximum difference predicted value is smaller than a second preset utilization threshold value or not, and if yes, executing storage space expansion processing on the target storage volume;
judging whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value or not and whether the utilization rate maximum difference predicted value is larger than a second preset utilization threshold value or not, and if yes, executing storage space data equalization processing on the target storage volume;
and judging whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value or not, and whether the utilization rate maximum difference predicted value is smaller than a second preset utilization threshold value or not, if so, judging that the storage space of the target storage volume is normal.
4. The method for processing storage space data of a distributed file system according to claim 2, before performing a corresponding storage space allocation operation on the target storage volume according to the comparison result between the storage space usage information prediction data and a preset usage threshold, comprising:
performing linear regression processing on the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value;
and carrying out error screening processing according to the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value after the linear regression processing and a preset standard deviation screening model to obtain the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value after the error screening processing.
5. A storage space data processing apparatus of a distributed file system, comprising:
the storage space prediction module is used for predicting the use information according to the change rate of the use information of the storage space of the target storage volume in a set time period to obtain storage space use information prediction data;
and the storage space allocation module is used for executing corresponding storage space allocation operation on the target storage volume according to the comparison result of the storage space use information prediction data and a preset use threshold.
6. The storage space data processing apparatus of the distributed file system according to claim 5, wherein the storage space prediction module comprises:
a first matrix parameter determining unit, configured to determine a first matrix parameter according to a maximum usage rate of the target storage volume and a maximum difference between the usage rates, where the maximum usage rate and the maximum difference between the usage rates are determined according to a current usage rate of each storage block in the target storage volume;
the second matrix parameter determining unit is used for determining second matrix parameters according to the change speed and the change acceleration of the maximum utilization rate and the maximum difference value of the utilization rates in a set historical time period;
a third matrix parameter determining unit, configured to determine a third matrix parameter according to the maximum usage rate and the maximum difference between the usage rates, and according to a maximum difference between an expected maximum usage rate and an expected usage rate, which are obtained after the change speed and the change acceleration pass a set future time period;
the state transition matrix determining unit is used for determining a state transition matrix of the Kalman filter according to the first matrix parameter, the second matrix parameter and the third matrix parameter;
and the Kalman filter prediction unit is used for performing information prediction on the maximum utilization rate and the maximum utilization rate difference value according to the Kalman filter to obtain a maximum utilization rate prediction value and a maximum utilization rate difference value prediction value, and setting the maximum utilization rate prediction value and the maximum utilization rate difference value prediction value as storage space utilization information prediction data.
7. The apparatus of claim 6, wherein the storage space allocation module comprises:
the first data equalization processing unit is used for judging whether the maximum utilization rate predicted value is greater than a first preset utilization threshold value or not and whether the utilization rate maximum difference predicted value is greater than a second preset utilization threshold value or not, and if yes, executing storage space data equalization processing on the target storage volume;
the storage space capacity expansion unit is used for judging whether the maximum utilization rate predicted value is larger than a first preset utilization threshold value or not and whether the maximum utilization rate difference predicted value is smaller than a second preset utilization threshold value or not, and if yes, executing storage space capacity expansion processing on the target storage volume;
the second data equalization processing unit is used for judging whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value or not and whether the maximum utilization rate difference predicted value is larger than a second preset utilization threshold value or not, and if yes, executing storage space data equalization processing on the target storage volume;
and the storage space normality judging unit is used for judging whether the maximum utilization rate predicted value is smaller than a first preset utilization threshold value or not and whether the utilization rate maximum difference value predicted value is smaller than a second preset utilization threshold value or not, and if so, judging that the storage space of the target storage volume is normal.
8. The storage space data processing apparatus of a distributed file system according to claim 6, further comprising:
the linear regression unit is used for carrying out linear regression processing on the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value;
and the error screening unit is used for carrying out error screening processing according to the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value which are subjected to the linear regression processing and a preset standard deviation screening model to obtain the maximum utilization rate predicted value and the utilization rate maximum difference value predicted value which are subjected to the error screening processing.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the storage space data processing method of the distributed file system according to any one of claims 1 to 4 when executing the program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the storage space data processing method of a distributed file system according to any one of claims 1 to 4.
CN202010541216.4A 2020-06-15 2020-06-15 Storage space data processing method and device of distributed file system Pending CN111736772A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010541216.4A CN111736772A (en) 2020-06-15 2020-06-15 Storage space data processing method and device of distributed file system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010541216.4A CN111736772A (en) 2020-06-15 2020-06-15 Storage space data processing method and device of distributed file system

Publications (1)

Publication Number Publication Date
CN111736772A true CN111736772A (en) 2020-10-02

Family

ID=72649124

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010541216.4A Pending CN111736772A (en) 2020-06-15 2020-06-15 Storage space data processing method and device of distributed file system

Country Status (1)

Country Link
CN (1) CN111736772A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112231137A (en) * 2020-12-14 2021-01-15 广东睿江云计算股份有限公司 Rebalancing method and system for distributed storage data
CN112905119A (en) * 2021-02-19 2021-06-04 山东英信计算机技术有限公司 Data writing control method, device and equipment of distributed storage system
CN113190503A (en) * 2021-05-08 2021-07-30 重庆紫光华山智安科技有限公司 File system capacity expansion method and device, electronic equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104023088A (en) * 2014-06-28 2014-09-03 山东大学 Storage server selection method applied to distributed file system
CN106407355A (en) * 2016-09-07 2017-02-15 中国农业银行股份有限公司 Data storage method and device
CN110300134A (en) * 2018-03-22 2019-10-01 杭州海康威视系统技术有限公司 Memory space method of adjustment, device and the cloud storage system of cloud storage resource pool
CN110334059A (en) * 2018-02-11 2019-10-15 北京京东尚科信息技术有限公司 Method and apparatus for handling file

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104023088A (en) * 2014-06-28 2014-09-03 山东大学 Storage server selection method applied to distributed file system
CN106407355A (en) * 2016-09-07 2017-02-15 中国农业银行股份有限公司 Data storage method and device
CN110334059A (en) * 2018-02-11 2019-10-15 北京京东尚科信息技术有限公司 Method and apparatus for handling file
CN110300134A (en) * 2018-03-22 2019-10-01 杭州海康威视系统技术有限公司 Memory space method of adjustment, device and the cloud storage system of cloud storage resource pool

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112231137A (en) * 2020-12-14 2021-01-15 广东睿江云计算股份有限公司 Rebalancing method and system for distributed storage data
CN112905119A (en) * 2021-02-19 2021-06-04 山东英信计算机技术有限公司 Data writing control method, device and equipment of distributed storage system
CN113190503A (en) * 2021-05-08 2021-07-30 重庆紫光华山智安科技有限公司 File system capacity expansion method and device, electronic equipment and storage medium
CN113190503B (en) * 2021-05-08 2022-12-02 重庆紫光华山智安科技有限公司 File system capacity expansion method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN111786885B (en) Distributed full-link gray level routing method and device
CN111736772A (en) Storage space data processing method and device of distributed file system
CN111078930A (en) Audio file data processing method and device
CN108345462B (en) Method and device for upgrading components
CN111090960A (en) Engineering structure finite element model processing method and device
CN111782470A (en) Distributed container log data processing method and device
CN112817694A (en) Automatic load balancing method and device for distributed system
CN111338905A (en) Application node data processing method and device
CN113434423A (en) Interface test method and device
CN111930624A (en) Test link message data processing method and device
CN112116402A (en) Credit risk customer-level default rate determination method and device
CN112766698B (en) Application service pressure determining method and device
CN112559158A (en) Micro-service timing task scheduling method and device
CN112792808A (en) Industrial robot online track planning method and device based on variable structure filter
CN111953847A (en) Client message risk reminding method, device and system
CN115794909A (en) Database query privacy protection method and device
CN113515426A (en) System performance data processing method and device
CN117331665A (en) Environment migration method and device for application system
CN113342501A (en) System fault processing method and device
CN115563137A (en) Stationary point data processing method and device
CN115495686A (en) Webpage data processing method and device
CN113420266A (en) Computer system integrated software protection method and device
CN114661617A (en) Test environment detection method and device
CN117435402A (en) Method and device for scheduling tape drives with backup strategy
CN115293364A (en) Method and device for measuring stability of machine learning characteristic factor

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination