CN110515556B - Method, device and equipment for determining use capacity of data volume and readable storage medium - Google Patents
Method, device and equipment for determining use capacity of data volume and readable storage medium Download PDFInfo
- Publication number
- CN110515556B CN110515556B CN201910785340.2A CN201910785340A CN110515556B CN 110515556 B CN110515556 B CN 110515556B CN 201910785340 A CN201910785340 A CN 201910785340A CN 110515556 B CN110515556 B CN 110515556B
- Authority
- CN
- China
- Prior art keywords
- data
- size
- determining
- target data
- capacity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000001680 brushing effect Effects 0.000 claims abstract description 17
- 238000004590 computer program Methods 0.000 claims description 11
- 238000011010 flushing procedure Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000013507 mapping Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000009977 dual effect Effects 0.000 description 2
- 238000013508 migration Methods 0.000 description 2
- 230000005012 migration Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a method, a device, equipment and a readable storage medium for determining the use capacity of a data volume, wherein the technical scheme comprises the following steps: receiving an IO write-in request, and determining target data and target data size specified by the IO write-in request; acquiring the size of additional data corresponding to the brushing target data; accumulating and calculating the size of the target data and the size of the additional data to obtain the real size of the brushing data corresponding to the IO write-in request; and determining the using capacity of the data volume by using the real size of the data to be brushed. Therefore, the technical scheme determines that the use capacity of the data volume is the capacity of the data volume occupied really after the data is refreshed. Furthermore, the data volume utilization capacity can be utilized to timely and accurately prompt capacity expansion.
Description
Technical Field
The present invention relates to the field of storage technologies, and in particular, to a method, an apparatus, a device, and a readable storage medium for determining a volume capacity of a data volume.
Background
In order to improve the utilization rate of the storage device, the data volume can be allocated to the user according to the requirement, and when the usage of the data volume reaches a capacity expansion condition (for example, the usage is greater than a capacity expansion threshold), the capacity expansion of the data volume is performed.
However, in practical applications, it is often found that the data volume cannot be fully written before the capacity expansion is prompted. That is to say, when the data volume is expanded, a large error occurs between the counted use capacity and the real use capacity, and the error affects the user experience to a certain extent and cannot effectively remind the user of timely expanding the capacity.
In summary, how to effectively solve the problems of determining the usage of a data volume and the like is a technical problem that needs to be solved urgently by those skilled in the art.
Disclosure of Invention
The invention aims to provide a method, a device and equipment for determining the use capacity of a data volume and a readable storage medium, so as to determine the actual use condition of the data volume.
In order to solve the technical problems, the invention provides the following technical scheme:
a method for determining a volume usage capacity, comprising:
receiving an IO write request, and determining target data and target data size specified by the IO write request;
acquiring the size of additional data corresponding to the target data to be refreshed;
accumulating and calculating the size of the target data and the size of the additional data to obtain the real data size of the IO write-in request;
and determining the using capacity of the data volume by using the real size of the data to be brushed.
Preferably, the obtaining of the size of the additional data corresponding to the target data comprises:
when a single controller is used for executing the down-brushing operation of the target data, reverse metadata corresponding to the target data is obtained;
determining a data size of the reverse metadata as the additional data size.
Preferably, the obtaining of the reverse metadata corresponding to the target data includes:
and allocating a physical storage address to the target data, and generating the reverse metadata by using the physical storage address.
Preferably, the obtaining of the size of the additional data corresponding to the target data comprises:
when the double controllers are used for executing the down-brushing operation of the target data, acquiring zero padding data and reverse metadata corresponding to the target data;
determining a sum of a data size of the zero padding data and a data size of the zero padding data as the additional data size.
Preferably, acquiring zero padding data corresponding to the target data includes:
judging whether the target data has a corresponding unfilled stripe;
and if so, zero padding is carried out on the unfilled strips, and the zero padding data is obtained.
Preferably, the determining the target data and the target data size specified by the IO write request includes:
determining valid data and invalid data corresponding to the IO write-in request;
and determining the valid data and the invalid data as the target data, and determining the size of the target data.
Preferably, the method further comprises the following steps:
judging whether the use capacity of the data volume is larger than a capacity expansion threshold value or not;
if yes, the capacity expansion prompting information is output.
A data volume usage capacity determination apparatus, comprising:
the IO data statistical module is used for receiving an IO write request and determining target data and target data size specified by the IO write request;
the additional data counting module is used for acquiring the size of additional data corresponding to the target data;
the real brushing data counting module is used for accumulating and calculating the size of the target data and the size of the additional data to obtain the size of the real brushing data corresponding to the IO writing request;
and the data volume using capacity determining module is used for determining the data volume using capacity by utilizing the real size of the data to be brushed.
A data volume usage capacity determination device, comprising:
a memory for storing a computer program;
and a processor for implementing the steps of the above-mentioned data volume usage capacity determination method when executing the computer program.
A readable storage medium, on which a computer program is stored, which computer program, when executed by a processor, implements the steps of the above-mentioned data volume usage capacity determination method.
By applying the method provided by the embodiment of the invention, the IO write-in request is received, and the target data size specified by the IO write-in request are determined; acquiring the size of additional data corresponding to the brushing target data; accumulating and calculating the size of the target data and the size of the additional data to obtain the real data size of the IO write-in request; and determining the use capacity of the data volume by using the real size of the data to be brushed.
After analyzing the process of data flushing to the data volume and the existing data volume use condition determining method, when the data is found to be flushed to the data volume, due to the limitation of stripes, the addition of reverse metadata and the like, a part of additional data is added and stored in the data volume along with the data required to be stored by the user, and in the existing data volume use condition determining method, only the data required to be stored by the user is counted, but the additional data generated by the data flushing is not counted, so that a counting error is caused. Based on this, after the size of the target data is determined, the data size corresponding to the additional data corresponding to the target data is also obtained, so that the sum of the size of the target data and the size of the additional data is calculated, and the size of the data volume actually occupied by the IO write request can be obtained. And then, the data volume using capacity can be determined by actually refreshing the data size. Therefore, the method determines that the use capacity of the data volume is the capacity of the data volume occupied really after the data is flushed, and further can utilize the use capacity of the data volume to perform timely and accurate capacity expansion reminding.
Correspondingly, embodiments of the present invention further provide a device, an apparatus, and a readable storage medium for determining a data volume usage capacity corresponding to the method for determining a data volume usage capacity, which have the above technical effects and are not described herein again.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a flowchart illustrating an implementation of a method for determining a volume usage capacity according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a data volume usage capacity determining apparatus according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a data volume utilization capacity determining apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a data volume utilization capacity determining apparatus according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The first embodiment is as follows:
referring to fig. 1, fig. 1 is a flowchart illustrating a method for determining a volume usage capacity according to an embodiment of the present invention, where the method is applicable to a computer device, and the method includes the following steps:
s101, receiving an IO write request, and determining target data and target data size specified by the IO write request.
When an IO write request is received, target data and a target data size specified by the IO write request may be determined.
The target data designates the original data needing to be flushed to the data volume for the user or the upper-layer application. For example, when a user needs to store a picture, the pixel matrix data corresponding to the picture is the target data.
Specifically, valid data and invalid data corresponding to the IO write request may be determined; then, valid data and invalid data are determined as target data, and a target data size is determined. And the size corresponding to the valid data and the invalid data is synthesized to be the size of the target data. For how to analyze the IO write request and determine the specific implementation process of the specified target data and the size of the target data, reference may be made to the existing analysis process of the IO write request, which is not described herein again.
And S102, acquiring the size of the additional data corresponding to the brushing target data.
When the target data is flushed to the data volume, the zero padding data needs to be added due to stripe limitation, and the reverse metadata needs to be added for garbage collection and migration of the data. Therefore, when the additional data is the target data to be flushed, the additional data is flushed to the data volume, and the additional data is often ignored in the existing data volume use condition determining method, so that an error is generated between the use condition and the real use condition.
The following describes how to determine the size of the additional data in each case.
The first condition is as follows: the implementation process of determining the size of the additional data under the condition of data refreshing of the single controller comprises the following steps:
the method comprises the following steps that firstly, when a single controller is used for executing the down-brushing operation of target data, reverse metadata corresponding to the target data are obtained;
and step two, determining the data size of the reverse metadata as the additional data size.
For convenience of description, the above two steps will be described in combination.
The obtaining of the reverse metadata corresponding to the target data may specifically be allocating a physical storage address to the target data, and generating the reverse metadata by using the physical storage address.
Note that, the forward metadata: the metadata of the mapping from the host LUN (Logical Unit Number) to the physical space is stored, and is used for finding the corresponding physical space when the subsequent host reads the data of the specific LUN. Reverse metadata: and storing the mapping metadata from the physical space to the host LUN, wherein the mapping metadata and the forward metadata have a one-to-one correspondence relationship and are used for garbage collection and migration of data.
Specifically, because LSA (Log Structure Architecture) does not wait for a full stripe, but 20ms overtime disc writing (in other embodiments of the present invention, the overtime disc writing time may also be other time duration, such as 15ms, 30ms, and other numerical values), each reverse metadata block may be followed by only 2-5 data grains (standard 8KB for the size of write IO that the data LSA is furled), and at this time, the proportion of the reverse metadata block in the whole FU (basic unit of space brushing, size 8MB) may reach 30% -50%, in this case, if the occupation of the space of the reverse metadata is ignored, a great error exists between the counted valid data capacity and the actual disk occupation capacity (in the FU with valid data, the reverse metadata corresponding to the valid data is also valid data), and functions such as flow control and threshold alarm according to the capacity are affected.
Case two: the implementation process of determining the size of the additional data under the condition of data brushing of the double controllers comprises the following steps:
the method comprises the steps that firstly, when a double controller is used for executing the down-brushing operation of target data, zero padding data and reverse metadata corresponding to the target data are obtained;
and step two, determining the sum of the data size of the zero padding data and the data size of the zero padding data as the size of the additional data.
For convenience of description, the above two steps will be described in combination.
For how to obtain the reverse metadata, reference may be made to the determination manner of the reverse metadata in the above case one, which is not described herein again.
The method for acquiring zero padding data corresponding to target data includes: judging whether the target data has a corresponding unfilled stripe; if yes, zero filling is carried out on the strips which are not full, and zero filling data are obtained.
Specifically, under the condition of low load of the dual controllers, the full FU is fixedly completed under the dual control, and if the full FU is not completed, zero is filled, so that the full FU may not be completed within a preset time under the condition of low load, the incomplete part needs to be filled with zero, a large amount of zero filling data is generated, and the accuracy of effective capacity statistics is also interfered.
That is, the additional data may contain only the reverse metadata, or may include both the reverse metadata and the zero padding data.
And S103, accumulating and calculating the size of the target data and the size of the additional data to obtain the real size of the brushing data corresponding to the IO write-in request.
After the size of the target data and the size of the additional data are determined, accumulating the size of the target data and the size of the additional data, wherein the accumulation result is the real size of the data to be flushed corresponding to the IO write-in request, and the size of the data volume really occupied by the IO write-in request.
And S104, determining the use capacity of the data volume by using the real size of the data to be brushed.
In practical application, each IO write request can be subjected to statistical processing to obtain each real size of the flushed data, so that the use capacity of the data volume can be determined.
Preferably, after the real and reliable data volume usage capacity is determined, it can be determined whether the data volume usage capacity is greater than a capacity expansion threshold; if yes, the capacity expansion prompting information is output. Therefore, reliable capacity expansion reminding can be performed as much as possible.
It should be noted that, the embodiment of the present invention does not limit what kind of processing the determined data usage capacity is subsequently used for. For example, the volume usage capacity may be used to monitor the volume, or the volume usage capacity may be used to prompt a capacity expansion, or the volume usage capacity may be used to respond to IO.
After analyzing the process of data flushing to the data volume and the existing data volume use condition determining method, when the data is found to be flushed to the data volume, due to the limitation of stripes, the addition of reverse metadata and the like, a part of additional data is added and stored in the data volume along with the data required to be stored by the user, and in the existing data volume use condition determining method, only the data required to be stored by the user is counted, but the additional data generated by the data flushing is not counted, so that a counting error is caused. Therefore, after the target data size of the target data is determined, the data size corresponding to the additional data corresponding to the target data is also obtained, so that the sum of the target data size and the additional data size is calculated, and the data volume size actually occupied by the IO write-in request can be obtained. And then, the data volume using capacity can be determined by actually refreshing the data size. Therefore, the method determines that the use capacity of the data volume is the capacity of the data volume occupied really after the data is refreshed, and further, the use capacity of the data volume can be used for timely and accurate capacity expansion reminding.
For ease of understanding, the following description will be given of the above data volume usage capacity determination method by taking a specific application scenario as an example.
As can be seen from the above, in the spatial layout of a data volume, the contained data can be divided into four main types: valid data, invalid data, reverse metadata, zero padding data.
The process of determining the volume usage capacity may include
1) Recording the sizes of valid data and invalid data after IO issuing is finished every time, wherein the size of the valid data and the invalid data is the size of data to be operated in IO;
2) waiting for 20ms (preset time which can be adjusted according to a system) overtime, and recording the size of the reverse metadata;
3) waiting for 100ms (preset time which can be adjusted according to a system) overtime, and recording the size of zero padding data;
4) accumulating the effective data size, the invalid data size, the reverse metadata size and the zero padding data size to obtain real brushing data corresponding to IO each time.
5) And accumulating the real data brushed corresponding to IO each time to obtain the use capacity of the data volume.
The sizes of the reverse metadata block, the invalid data, the valid data and the zero padding data generated in each IO process of the data volume are recorded, and then the total sizes of the reverse metadata block, the zero padding data, the invalid data and the valid data are summarized and counted. After the use capacity of the data volume is determined, the user can be reminded of paying attention to the use condition of the capacity and expanding the capacity timely as early as possible.
The second embodiment:
corresponding to the above method embodiments, the embodiment of the present invention further provides a data volume usage capacity determining apparatus, and the data volume usage capacity determining apparatus described below and the data volume usage capacity determining method described above may be referred to correspondingly with each other.
Referring to fig. 2, the apparatus includes the following modules:
the IO data statistics module 101 is configured to receive an IO write request, and determine target data and a size of the target data specified by the IO write request;
the additional data counting module 102 is used for acquiring the size of additional data corresponding to the brushing target data;
the real brushing data counting module 103 is configured to calculate the size of the target data and the size of the additional data in an accumulated manner, and obtain a real brushing data size corresponding to the IO write request;
and the data volume usage capacity determining module 104 is configured to determine the data volume usage capacity by using the real size of the flushed data.
After analyzing the process of flushing data to a data volume and the existing data volume usage statistics determination method, when the data is flushed to the data volume, due to stripe limitation, reverse metadata addition and the like, a part of additional data is added and stored in the data volume along with data required to be stored by a user, and in the existing data volume usage determination method, only the data required to be stored by the user is counted, and the additional data generated by flushing is not counted, so that a statistical error is caused. Based on this, after the device determines the size of the target data, the device also obtains the size of the data corresponding to the additional data corresponding to the target data, so as to calculate the sum of the size of the target data and the size of the additional data, and then the size of the data volume actually occupied by the IO write request can be obtained. And then, the data volume using capacity can be determined by actually brushing the data size. Therefore, the device determines that the use capacity of the data volume is the capacity of the data volume occupied really after the data is flushed, and further can utilize the use capacity of the data volume to perform timely and accurate capacity expansion reminding.
In an embodiment of the present invention, the additional data statistics module 102 includes:
the reverse metadata determining unit is used for acquiring reverse metadata corresponding to the target data when the single controller is used for executing the brushing operation of the target data;
an additional data size determining unit for determining a data size of the reverse metadata as an additional data size.
In an embodiment of the present invention, the reverse metadata determination unit is specifically configured to assign a physical storage address to the target data, and generate the reverse metadata by using the physical storage address.
In an embodiment of the present invention, the additional data statistics module 102 includes:
the additional data determining unit is used for acquiring zero padding data and reverse metadata corresponding to the target data when the double controllers are used for executing the down-brushing operation of the target data;
an additional data size determining unit for determining a sum of a data size of the zero padding data and a data size of the zero padding data as an additional data size.
In an embodiment of the present invention, the additional data determining unit is specifically configured to determine whether the target data has a corresponding under-full stripe; if yes, zero filling is carried out on the strips which are not full, and zero filling data are obtained.
In a specific embodiment of the present invention, the IO data statistics module 101 is specifically configured to determine valid data and invalid data corresponding to an IO write request; the valid data and invalid data are determined as target data, and the target data size is determined.
In one embodiment of the present invention, the method further comprises:
the capacity expansion reminding module is used for judging whether the use capacity of the data volume is larger than a capacity expansion threshold value or not; if yes, the capacity expansion prompting information is output.
Example three:
corresponding to the above method embodiment, the embodiment of the present invention further provides a data volume usage capacity determination device, and a data volume usage capacity determination device described below and a data volume usage capacity determination method described above may be referred to in correspondence with each other.
Referring to fig. 3, the data volume usage capacity determination device includes:
a memory D1 for storing computer programs;
a processor D2, configured to implement the steps of the data volume usage capacity determination method of the above-mentioned method embodiment when executing the computer program.
Specifically, referring to fig. 4, fig. 4 is a schematic diagram of a specific structure of a data volume usage capacity determining device provided in this embodiment, which may generate relatively large differences due to different configurations or performances, and may include one or more processors (CPUs) 322 (e.g., one or more processors) and a memory 332, and one or more storage media 330 (e.g., one or more mass storage devices) storing an application 342 or data 344. Memory 332 and storage media 330 may be, among other things, transient storage or persistent storage. The program stored on the storage medium 330 may include one or more modules (not shown), each of which may include a sequence of instructions operating on the data processing apparatus. Still further, the central processor 322 may be configured to communicate with the storage medium 330, and execute a series of instruction operations in the storage medium 330 on the data volume usage capacity determination device 301.
The data volume usage capacity determination apparatus 301 may also include one or more power sources 326, one or more wired or wireless network interfaces 350, one or more input-output interfaces 358, and/or one or more operating systems 341. For example, Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
The steps in the data volume usage capacity determination method described above may be implemented by the structure of the data volume usage capacity determination device.
Example four:
corresponding to the above method embodiment, an embodiment of the present invention further provides a readable storage medium, where a readable storage medium described below and a data volume usage capacity determination method described above may be referred to correspondingly.
A readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the steps of the data volume usage capacity determination method of the above-mentioned method embodiment.
The readable storage medium may be a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and various other readable storage media capable of storing program codes.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the components and steps of the various examples have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
Claims (9)
1. A method for determining a usage capacity of a data volume, comprising:
receiving an IO write request, and determining target data and target data size specified by the IO write request;
acquiring the size of additional data corresponding to the target data to be refreshed;
accumulating and calculating the size of the target data and the size of the additional data to obtain the real data size of the IO write-in request;
determining the use capacity of the data volume by using the real size of the data to be brushed;
wherein, the acquiring and refreshing the size of the additional data corresponding to the target data comprises:
when a single controller is used for executing the down-brushing operation of the target data, reverse metadata corresponding to the target data is obtained;
determining a data size of the reverse metadata as the additional data size.
2. The method for determining the usage capacity of the data volume according to claim 1, wherein obtaining the reverse metadata corresponding to the target data includes:
and allocating a physical storage address to the target data, and generating the reverse metadata by using the physical storage address.
3. The method for determining the usage capacity of the data volume according to claim 1, wherein the obtaining of the size of the additional data corresponding to the target data comprises:
when the double controllers are used for executing the down-brushing operation of the target data, acquiring zero padding data and reverse metadata corresponding to the target data;
determining a sum of a data size of the zero padding data and a data size of the zero padding data as the additional data size.
4. The method for determining the usage capacity of the data volume according to claim 3, wherein acquiring zero padding data corresponding to the target data includes:
judging whether the target data has a corresponding unfilled stripe;
if yes, zero filling is carried out on the unfilled strips, and zero filling data are obtained.
5. The method for determining the usage capacity of the data volume according to claim 1, wherein the determining the target data and the target data size specified by the IO write request includes:
determining valid data and invalid data corresponding to the IO write-in request;
and determining the valid data and the invalid data as the target data, and determining the size of the target data.
6. The method for determining the usage capacity of the data volume according to any one of claims 1 to 5, further comprising:
judging whether the use capacity of the data volume is larger than a capacity expansion threshold value or not;
if yes, the capacity expansion prompting information is output.
7. A data volume usage capacity determination apparatus, comprising:
the IO data statistical module is used for receiving an IO write request and determining target data and target data size specified by the IO write request;
the additional data counting module is used for acquiring the size of additional data corresponding to the target data;
the real brushing data counting module is used for accumulating and calculating the size of the target data and the size of the additional data to obtain the size of the real brushing data corresponding to the IO writing request;
the data volume using capacity determining module is used for determining the using capacity of the data volume by utilizing the size of the real updated data;
wherein the additional data statistics module comprises:
the reverse metadata determining unit is used for acquiring reverse metadata corresponding to the target data when a single controller is used for executing the brushing-down operation of the target data;
an additional data size determining unit for determining a data size of the reverse metadata as the additional data size.
8. A data volume usage capacity determination device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the data volume usage capacity determination method according to any one of claims 1 to 6 when executing said computer program.
9. A readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the steps of the data volume usage capacity determination method according to any one of claims 1 to 6.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910785340.2A CN110515556B (en) | 2019-08-23 | 2019-08-23 | Method, device and equipment for determining use capacity of data volume and readable storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910785340.2A CN110515556B (en) | 2019-08-23 | 2019-08-23 | Method, device and equipment for determining use capacity of data volume and readable storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110515556A CN110515556A (en) | 2019-11-29 |
CN110515556B true CN110515556B (en) | 2022-07-22 |
Family
ID=68626585
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910785340.2A Active CN110515556B (en) | 2019-08-23 | 2019-08-23 | Method, device and equipment for determining use capacity of data volume and readable storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110515556B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111736772B (en) * | 2020-06-15 | 2024-06-25 | 中国工商银行股份有限公司 | Storage space data processing method and device of distributed file system |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106648457A (en) * | 2016-09-27 | 2017-05-10 | 华为数字技术(成都)有限公司 | Method of updating reverse mapping metadata and device |
CN108763517A (en) * | 2018-05-30 | 2018-11-06 | 郑州云海信息技术有限公司 | A kind of method and relevant device for deleting metadata |
CN109445713A (en) * | 2018-11-09 | 2019-03-08 | 郑州云海信息技术有限公司 | A kind of storage state recording method, system and the associated component of metadata volume |
-
2019
- 2019-08-23 CN CN201910785340.2A patent/CN110515556B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106648457A (en) * | 2016-09-27 | 2017-05-10 | 华为数字技术(成都)有限公司 | Method of updating reverse mapping metadata and device |
CN108763517A (en) * | 2018-05-30 | 2018-11-06 | 郑州云海信息技术有限公司 | A kind of method and relevant device for deleting metadata |
CN109445713A (en) * | 2018-11-09 | 2019-03-08 | 郑州云海信息技术有限公司 | A kind of storage state recording method, system and the associated component of metadata volume |
Also Published As
Publication number | Publication date |
---|---|
CN110515556A (en) | 2019-11-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106354590B (en) | Disk detection method and device | |
US10303600B2 (en) | Method and storage device for collecting garbage data | |
US9367262B2 (en) | Assigning a weighting to host quality of service indicators | |
CN108874324B (en) | Access request processing method, device, equipment and readable storage medium | |
CN110688256B (en) | Metadata power-on recovery method and device, electronic equipment and storage medium | |
US20200133577A1 (en) | Method, electronic device and computer readable storage medium of storage management | |
CN113867644B (en) | Disk array optimization method, disk array optimization device, computer equipment and storage medium | |
CN113625973B (en) | Data writing method, device, electronic equipment and computer readable storage medium | |
CN114328281A (en) | Method and device for processing abnormal power failure of solid state disk, electronic equipment and medium | |
CN112148226A (en) | Data storage method and related device | |
CN110515556B (en) | Method, device and equipment for determining use capacity of data volume and readable storage medium | |
CN106484313A (en) | Data message backup method, data back up method and device | |
CN115757066A (en) | Hard disk performance test method, device, equipment, storage medium and program product | |
US10915363B2 (en) | Resource sharing controller of a computer platform and associated resource sharing method | |
CN113434470B (en) | Data distribution method and device and electronic equipment | |
KR20170009554A (en) | Test system and test method | |
CN107924350B (en) | Electronic equipment and data compression method thereof | |
CN110727399A (en) | Storage array management method and device | |
CN112269540A (en) | Data storage method, system, equipment and computer readable storage medium | |
CN104503924A (en) | Area distribution method and device of tiered storage system | |
CN111444117A (en) | Method and device for realizing fragmentation of storage space, storage medium and electronic equipment | |
JP6988231B2 (en) | Information processing equipment, information processing system, information processing method and information processing program | |
CN115562588A (en) | Virtual disk array configuration method and device, computer equipment and storage medium | |
CN111176568B (en) | Data analysis method and device | |
CN111880962B (en) | RAID reconstruction speed control method, system and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |