CN111176571A - Method, device, equipment and medium for managing local object - Google Patents
Method, device, equipment and medium for managing local object Download PDFInfo
- Publication number
- CN111176571A CN111176571A CN201911379286.8A CN201911379286A CN111176571A CN 111176571 A CN111176571 A CN 111176571A CN 201911379286 A CN201911379286 A CN 201911379286A CN 111176571 A CN111176571 A CN 111176571A
- Authority
- CN
- China
- Prior art keywords
- invalid data
- target
- data
- writing
- data segment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
The invention discloses a local object management method, which comprises the following steps: creating an invalid data linked list for recording attribute information of each aggregated file and position information of invalid data on the aggregated files; judging whether a writing instruction for writing target data is received; if so, writing the target data to be written into the target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data. Therefore, the method and the device can multiplex the data segment of the aggregation file for storage in time, avoid the phenomenon that a disk generates a large amount of read-write operations in the process of transferring effective data, and reduce the influence on the actual read-write operations of the front-end service; the storage space is quickly released, and meanwhile, extra load on a disk is avoided. In addition, the management device, the equipment and the storage medium of the local object correspond to the method.
Description
Technical Field
The present invention relates to the field of distributed storage technologies, and in particular, to a method, an apparatus, a device, and a medium for managing a local object.
Background
With the rapid development of distributed storage technology, distributed storage is widely used in various industries. In distributed storage, the local object store is at the bottom, and is responsible for actually writing data to disk. In the implementation mode of object aggregation of local object storage, all objects are written into an aggregation file in a time sequence and in an additional writing mode, the file size is defaulted to 64MB, and when the file size exceeds the size, the file size is automatically switched to a new aggregation file. Such a file will eventually be distributed over different aggregate files, and an aggregate file will also contain objects for different files.
When the write file is modified, firstly, the new data is additionally written into the current aggregation file, and then the data segment corresponding to the aggregation file where the original data is located is set to be in an invalid state; when a file is deleted, directly setting the data segment corresponding to the aggregation file in which the data is positioned as an invalid state; when invalid data exists on one aggregation file due to modification or deletion, judging whether valid data exists on the aggregation file or not, if so, not processing, and at the moment, not releasing the storage space; otherwise, deleting the aggregation file and releasing the storage space. There are two ways to process invalid data to free up memory:
(1) a timed scanning mechanism. The object aggregation mechanism starts a timer, scans all the aggregation files at regular time, transfers the valid data to a new aggregation file, and then deletes the original aggregation file, thereby realizing the release of the storage space.
However, the method has a lag in releasing the storage space, and cannot be used in a scene that the storage space is full and is written immediately after being deleted, because the storage space is not really released and the space shortage is still indicated by writing again. In addition, during the process of transferring the effective data, a large amount of reading and writing can be generated on the disk, and the disk load is increased, so that the actual reading and writing operation of the front-end service is influenced.
(2) Aggregate file hole-punching mechanism. When invalid data is generated on the aggregation file, the invalid data segment is punched directly through a fallocate interface of the Linux system, and at the moment, the part of space is released immediately. The disadvantage of this approach is that frequent punching of the same aggregate file results in loss of its xfs extension attribute, and frequent punching also increases the load on the disk.
Therefore, it is an urgent need to provide a local object management method that can realize fast release of storage space and avoid extra load on the disk.
Disclosure of Invention
The invention aims to provide a method, a device, equipment and a medium for managing local objects, which can directly write target data to be written into a target invalid data segment when receiving a write instruction, can multiplex the data segment of an aggregated file for storage in time, avoid a large amount of read-write operations of a magnetic disk in the process of transferring valid data, and reduce the influence on the actual read-write operations of front-end services; in addition, by covering the target invalid data, the storage space is quickly released, and the extra load on the disk is avoided.
In order to solve the above technical problem, the present invention provides a method for managing a local object, including:
creating an invalid data linked list for recording attribute information of each aggregated file and position information of invalid data on the aggregated files;
judging whether a writing instruction for writing target data is received;
if so, writing the target data to be written into a target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data.
Preferably, the target invalid data is invalid data meeting a preset condition; the preset condition is that the length of the occupied invalid data segment is greater than or equal to the length of the data segment required by the target data.
Preferably, the location information specifically includes an offset and a length of the invalid data in the aggregate file.
Preferably, the method further comprises the following steps:
and when the target data is written into a target invalid data segment corresponding to the target invalid data, transferring the target invalid data segment from the invalid data linked list to an effective data linked list.
Preferably, the method further comprises the following steps:
when the position information of new invalid data is added in an invalid data linked list, judging whether a new data segment corresponding to the new invalid data is continuous with other invalid data segments;
and if so, merging the new data segment and an invalid data segment continuous with the new data segment.
Preferably, the method further comprises the following steps:
and when the length of the effective data segment in the aggregation file is smaller than a preset length, migrating the effective data segment.
Preferably, the method further comprises the following steps:
monitoring the current use condition of a target disk stored in a local object, and when the current use rate of the target disk exceeds a preset value, giving an alarm.
In order to solve the above technical problem, the present invention further provides a local object management apparatus, including:
the system comprises a creating module, a searching module and a sending module, wherein the creating module is used for creating an invalid data linked list used for recording attribute information of each aggregation file and position information of invalid data on the aggregation files;
the judging module is used for judging whether a writing instruction for writing target data is received or not; if yes, entering a writing module;
and the writing module is used for writing the target data to be written into a target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data.
In order to solve the above technical problem, the present invention further provides a local object management device, including a memory for storing a computer program;
a processor for implementing the steps of the method for managing local objects according to any one of the preceding claims when executing said computer program.
In order to solve the above technical problem, the present invention further provides a computer-readable storage medium, having a computer program stored thereon, where the computer program is executed by a processor to implement the steps of the method for managing local objects according to any one of the above aspects.
The invention provides a local object management method, which comprises the following steps: creating an invalid data linked list for recording attribute information of each aggregated file and position information of invalid data on the aggregated files; judging whether a writing instruction for writing target data is received; if so, writing the target data to be written into the target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data. Therefore, the target data to be written is directly written into the target invalid data segment when the writing instruction is received, the data segment of the aggregated file can be reused for storage in time, a large amount of read-write operations of a magnetic disk in the process of transferring the valid data are avoided, and the influence on the actual read-write operations of the front-end service is reduced; in addition, by covering the target invalid data, the storage space is quickly released, and the extra load on the disk is avoided.
In addition, the management device, the equipment and the storage medium of the local object provided by the invention correspond to the method, and have the same beneficial effects.
Drawings
In order to illustrate the embodiments of the present invention more clearly, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a flowchart of a method for managing local objects according to an embodiment of the present invention;
fig. 2 is a flowchart of another local object management method according to an embodiment of the present invention;
fig. 3 is a structural diagram of a local object management apparatus according to an embodiment of the present invention;
fig. 4 is a structural diagram of a local object management device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without any creative work belong to the protection scope of the present invention.
The core of the invention is to provide a management method, a device, equipment and a medium of a local object, the invention can directly write target data to be written into a target invalid data segment when receiving a write instruction, and can multiplex the data segment of an aggregate file for storage in time, thereby avoiding a large amount of read-write operations of a magnetic disk in the process of transferring valid data and reducing the influence on the actual read-write operation of front-end services; in addition, by covering the target invalid data, the storage space is quickly released, and the extra load on the disk is avoided.
In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Fig. 1 is a flowchart of a method for managing local objects according to an embodiment of the present invention; as shown in fig. 1, a method for managing a local object according to an embodiment of the present invention includes steps S101 to S103:
step S101: creating an invalid data linked list for recording attribute information of each aggregated file and position information of invalid data on the aggregated files;
in one embodiment, the attribute information of the aggregate file and the location information of the valid data stored in the aggregate file may be recorded in a valid data linked list. In this embodiment, an invalid data linked list for recording attribute information of each aggregate file and location information of invalid data on the aggregate file is created. Specifically, the location information specifically includes an offset and a length of the invalid data in the aggregate file, and the invalid data or a data segment of the valid data stored in the aggregate file can be determined according to the recorded offset and length; the attribute information of the aggregate file is specifically an ID identifier of the aggregate file. It should be noted that the aggregate file provided in the embodiment of the present invention may have a capacity of 1 GB. Those skilled in the art can set the capacity of the aggregate file according to the actual application situation, and the embodiment of the present invention is not limited.
Step S102: judging whether a writing instruction for writing target data is received; if yes, go to step S103;
step S103: and writing the target data to be written into a target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data.
In a specific implementation, when a write instruction for writing target data is received, the target data needing to be written may be written into a target invalid data segment corresponding to the target invalid data. Specifically, the target invalid data is invalid data that satisfies a preset condition; the preset condition is that the length of the occupied invalid data segment is greater than or equal to the length of the data segment required by the target data.
In one embodiment, the target invalid data is determined from the invalid data satisfying the preset condition, and when there are a plurality of invalid data satisfying the preset condition, the invalid data having a length closest to the length of the target data from among the plurality of invalid data may be used as the target invalid data. One skilled in the art may determine the target invalid data in other ways according to the actual application, and the embodiment of the present invention is not limited. According to the position information of the target invalid data recorded in the invalid data linked list, a target invalid data section corresponding to the target invalid data is obtained, and the target data is written into the target invalid data section, so that the target invalid data is covered through the target data, and the multiplexing of the aggregation file is realized.
In one embodiment, when a write command is received, it may be first determined whether the actual available space of the target disk can meet the length requirement of the target data, and if so, the actual available space of the target disk may be directly written into an idle data segment of the target disk; if the invalid data segment cannot be met, applying for a writing space from the invalid data linked list, and writing the target data needing to be written into the target invalid data segment corresponding to the target invalid data to cover the target invalid data. When a modification and rewriting instruction is received, whether the actual available space of the target disk can meet the length requirement of the modified data can be judged firstly, if so, the modified data can be directly written into the idle data segment of the target disk, the data segment in which the modified data is written is changed into an effective data segment, and the data segment in which the modified data is located is changed into an invalid data segment.
Specifically, after the target data is written into the target invalid data section corresponding to the target invalid data, the target invalid data section is transferred from the invalid data linked list to the valid data linked list, so that the information in the invalid data linked list is updated, and the accuracy and the timeliness of the invalid data linked list are ensured.
The invention provides a local object management method, which comprises the following steps: creating an invalid data linked list for recording attribute information of each aggregated file and position information of invalid data on the aggregated files; judging whether a writing instruction for writing target data is received; if so, writing the target data to be written into the target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data. Therefore, the target data to be written is directly written into the target invalid data segment when the writing instruction is received, the data segment of the aggregated file can be reused for storage in time, a large amount of read-write operations of a magnetic disk in the process of transferring the valid data are avoided, and the influence on the actual read-write operations of the front-end service is reduced; in addition, by covering the target invalid data, the storage space is quickly released, and the extra load on the disk is avoided.
Fig. 2 is a flowchart of another local object management method according to an embodiment of the present invention; as shown in fig. 2, the method for managing local objects according to the embodiment of the present invention further includes steps S104 to S105:
step S104: when the position information of new invalid data is added in the invalid data linked list, judging whether a new data segment corresponding to the new invalid data is continuous with other invalid data segments; if yes, go to step S105;
s105: and merging the new data segment and the invalid data segment continuous with the new data segment.
In specific implementation, when new invalid data is generated, the invalid data linked list is updated, the position information of the new invalid data is added into the invalid data linked list, at the moment, whether a new data segment corresponding to the new invalid data is continuous with other invalid data segments can be judged, if the new data segment is continuous with other invalid data segments, the new data segment and the invalid data segment continuous with the new data segment can be merged, and meanwhile, the position information in the invalid data segment linked list is updated to be the merged position information, so that the writing of target data needing a large space is facilitated, and the invalid data segments can be effectively utilized.
As shown in fig. 2, the method for managing a local object according to the embodiment of the present invention further includes step S106:
step S106: and when the length of the effective data segment in the aggregation file is smaller than the preset length, migrating the effective data segment.
In specific implementation, when the length of the effective data segment in the aggregate file is found to be smaller than the preset length, the effective data segment can be migrated, so that the effective data segment with the smaller length is merged with other effective data segments, defragmentation of the aggregate file is completed, and the aggregate file is conveniently and reasonably utilized. It should be noted that the preset length may be configured according to an actual application, and the embodiment of the present invention is not limited.
As shown in fig. 2, the method for managing local objects according to the embodiment of the present invention further includes step S107:
step S107: and monitoring the current use condition of the target disk stored in the local object, and when the current use rate of the target disk exceeds a preset value, giving an alarm.
In one embodiment, the present invention prompts the user accordingly by monitoring the current usage of the target disk of the local object store. When the current utilization rate of the target disk exceeds a preset value, the user can be prompted that the current available space is insufficient; for example, when the current usage rate of the target disk exceeds eighty-five percent, a near full alarm can be printed; when the current usage of the target disk exceeds ninety-five percent, a full alarm may be printed and the entire storage system may be disabled from writing data. It should be noted that, a person skilled in the art may set the preset value according to the actual application situation, and the embodiment of the present invention is not limited.
The invention also provides a management device of the local object and a corresponding embodiment of the management equipment of the local object. It should be noted that the present invention describes the embodiments from two perspectives, one is based on the functional module, and the other is based on the hardware.
Fig. 3 is a structural diagram of a local object management apparatus according to an embodiment of the present invention; as shown in fig. 3, an apparatus for managing a local object according to an embodiment of the present invention includes:
a creating module 10, configured to create an invalid data linked list used for recording attribute information of each aggregate file and location information of invalid data on the aggregate file;
a judging module 11, configured to judge whether a write instruction for writing target data is received; if yes, entering a writing module;
and the writing module 12 is configured to write the target data to be written into the target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data.
The method for managing the local object provided by the embodiment of the invention further comprises the following steps:
and the transfer module is used for transferring the target invalid data segment from the invalid data linked list to the valid data linked list after the target data is written into the target invalid data segment corresponding to the target invalid data.
The method for managing the local object provided by the embodiment of the invention further comprises the following steps:
the merging module is used for judging whether a new data segment corresponding to the new invalid data is continuous with other invalid data segments or not when the position information of the new invalid data is added in the invalid data linked list; if so, the new data segment is merged with an invalid data segment that is contiguous with the new data segment.
The method for managing the local object provided by the embodiment of the invention further comprises the following steps:
and the migration module is used for migrating the effective data segment when the length of the effective data segment in the aggregation file is smaller than the preset length.
The method for managing the local object provided by the embodiment of the invention further comprises the following steps:
and the monitoring module is used for monitoring the current use condition of the target disk stored in the local object, and giving an alarm prompt when the current use rate of the target disk exceeds a preset value.
Since the embodiments of this section correspond to the embodiments of the method section, reference is made to the description of the embodiments of the method section for the embodiments of this section, and details are not repeated here.
The invention provides a management device of local objects, comprising: creating an invalid data linked list for recording attribute information of each aggregated file and position information of invalid data on the aggregated files; judging whether a writing instruction for writing target data is received; if so, writing the target data to be written into the target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data. Therefore, the target data to be written is directly written into the target invalid data segment when the writing instruction is received, the data segment of the aggregated file can be reused for storage in time, a large amount of read-write operations of a magnetic disk in the process of transferring the valid data are avoided, and the influence on the actual read-write operations of the front-end service is reduced; in addition, by covering the target invalid data, the storage space is quickly released, and the extra load on the disk is avoided.
Fig. 4 is a structural diagram of a local object management device according to an embodiment of the present invention. As shown in fig. 4, the local object management apparatus according to the embodiment of the present invention includes a memory 20 for storing a computer program;
a processor 21 for implementing the steps of the method for managing local objects as defined in any of the above when executing a computer program.
The processor 21 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 21 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 21 may also include a main processor and a coprocessor, where the main processor is a processor for processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 21 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, the processor 21 may further include an AI (Artificial Intelligence) processor for processing a calculation operation related to machine learning.
The memory 20 may include one or more computer-readable storage media, which may be non-transitory. Memory 20 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 20 is at least used for storing the following computer program 201, wherein after being loaded and executed by the processor 21, the computer program can implement relevant steps in the local object management method disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202, data 203, and the like, and the storage manner may be a transient storage manner or a permanent storage manner. Operating system 202 may include, among others, Windows, Unix, Linux, and the like.
In some embodiments, the management device of the local object may further include an input/output interface 22, a communication interface 23, a power supply 24, and a communication bus 25.
Those skilled in the art will appreciate that the architecture shown in FIG. 4 does not constitute a limitation of the management facility for local objects and may include more or fewer components than those shown.
Since the embodiments of this section correspond to the embodiments of the method section, reference is made to the description of the embodiments of the method section for the embodiments of this section, and details are not repeated here. In some embodiments of the invention, the processor and memory may be connected by a bus or other means.
The management equipment of the local object provided by the invention can realize the following method: creating an invalid data linked list for recording attribute information of each aggregated file and position information of invalid data on the aggregated files; judging whether a writing instruction for writing target data is received; if so, writing the target data to be written into the target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data. Therefore, the target data to be written is directly written into the target invalid data segment when the writing instruction is received, the data segment of the aggregated file can be reused for storage in time, a large amount of read-write operations of a magnetic disk in the process of transferring the valid data are avoided, and the influence on the actual read-write operations of the front-end service is reduced; in addition, by covering the target invalid data, the storage space is quickly released, and the extra load on the disk is avoided.
Finally, the invention also provides a corresponding embodiment of the computer readable storage medium. The computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps as set forth in the above-mentioned method embodiments.
It is to be understood that if the method in the above embodiments is implemented in the form of software functional units and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and performs all or part of the steps of the methods according to the embodiments of the present invention, or all or part of the technical solution. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The method, the apparatus, the device and the medium for managing the local object provided by the present invention are described in detail above. The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A method for managing local objects, comprising:
creating an invalid data linked list for recording attribute information of each aggregated file and position information of invalid data on the aggregated files;
judging whether a writing instruction for writing target data is received;
if so, writing the target data to be written into a target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data.
2. The method according to claim 1, wherein the target invalid data is invalid data that satisfies a preset condition; the preset condition is that the length of the occupied invalid data segment is greater than or equal to the length of the data segment required by the target data.
3. The method according to claim 1, wherein the location information specifically includes an offset and a length of the invalid data in the aggregate file.
4. The method for managing local objects according to claim 1, further comprising:
and when the target data is written into a target invalid data segment corresponding to the target invalid data, transferring the target invalid data segment from the invalid data linked list to an effective data linked list.
5. The method for managing local objects according to claim 1, further comprising:
when the position information of new invalid data is added in an invalid data linked list, judging whether a new data segment corresponding to the new invalid data is continuous with other invalid data segments;
and if so, merging the new data segment and an invalid data segment continuous with the new data segment.
6. The method for managing local objects according to claim 1, further comprising:
and when the length of the effective data segment in the aggregation file is smaller than a preset length, migrating the effective data segment.
7. The method for managing local objects according to claim 1, further comprising:
monitoring the current use condition of a target disk stored in a local object, and when the current use rate of the target disk exceeds a preset value, giving an alarm.
8. An apparatus for managing local objects, comprising:
the system comprises a creating module, a searching module and a sending module, wherein the creating module is used for creating an invalid data linked list used for recording attribute information of each aggregation file and position information of invalid data on the aggregation files;
the judging module is used for judging whether a writing instruction for writing target data is received or not; if yes, entering a writing module;
and the writing module is used for writing the target data to be written into a target invalid data segment corresponding to the target invalid data according to the position information recorded in the invalid data linked list so as to cover the target invalid data.
9. A local object management device comprising a memory for storing a computer program;
processor for implementing the steps of the method for managing local objects according to any one of claims 1 to 7 when executing said computer program.
10. A computer-readable storage medium, characterized in that it has stored thereon a computer program which, when being executed by a processor, carries out the steps of the method for managing local objects according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911379286.8A CN111176571A (en) | 2019-12-27 | 2019-12-27 | Method, device, equipment and medium for managing local object |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911379286.8A CN111176571A (en) | 2019-12-27 | 2019-12-27 | Method, device, equipment and medium for managing local object |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111176571A true CN111176571A (en) | 2020-05-19 |
Family
ID=70652170
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911379286.8A Withdrawn CN111176571A (en) | 2019-12-27 | 2019-12-27 | Method, device, equipment and medium for managing local object |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111176571A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111984196A (en) * | 2020-08-21 | 2020-11-24 | 苏州浪潮智能科技有限公司 | File migration method, device, equipment and readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105700828A (en) * | 2016-01-15 | 2016-06-22 | 北京市博汇科技股份有限公司 | Data write-read method and device |
| CN106951183A (en) * | 2017-02-27 | 2017-07-14 | 南京杰迈视讯科技有限公司 | A kind of web camera date storage method of high efficient and reliable |
| CN108595503A (en) * | 2018-03-19 | 2018-09-28 | 网宿科技股份有限公司 | Document handling method and server |
| CN109376100A (en) * | 2018-11-05 | 2019-02-22 | 浪潮电子信息产业股份有限公司 | A kind of caching wiring method, device, equipment and readable storage medium storing program for executing |
| CN109614385A (en) * | 2018-12-11 | 2019-04-12 | 浪潮电子信息产业股份有限公司 | A kind of file updating method, device, equipment and readable storage medium storing program for executing |
| CN109739933A (en) * | 2019-01-02 | 2019-05-10 | 郑州云海信息技术有限公司 | Memory space method for releasing, device, terminal and computer readable storage medium |
| CN110597762A (en) * | 2018-05-25 | 2019-12-20 | 杭州海康威视系统技术有限公司 | File processing method, device, equipment and storage medium |
-
2019
- 2019-12-27 CN CN201911379286.8A patent/CN111176571A/en not_active Withdrawn
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105700828A (en) * | 2016-01-15 | 2016-06-22 | 北京市博汇科技股份有限公司 | Data write-read method and device |
| CN106951183A (en) * | 2017-02-27 | 2017-07-14 | 南京杰迈视讯科技有限公司 | A kind of web camera date storage method of high efficient and reliable |
| CN108595503A (en) * | 2018-03-19 | 2018-09-28 | 网宿科技股份有限公司 | Document handling method and server |
| CN110597762A (en) * | 2018-05-25 | 2019-12-20 | 杭州海康威视系统技术有限公司 | File processing method, device, equipment and storage medium |
| CN109376100A (en) * | 2018-11-05 | 2019-02-22 | 浪潮电子信息产业股份有限公司 | A kind of caching wiring method, device, equipment and readable storage medium storing program for executing |
| CN109614385A (en) * | 2018-12-11 | 2019-04-12 | 浪潮电子信息产业股份有限公司 | A kind of file updating method, device, equipment and readable storage medium storing program for executing |
| CN109739933A (en) * | 2019-01-02 | 2019-05-10 | 郑州云海信息技术有限公司 | Memory space method for releasing, device, terminal and computer readable storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111984196A (en) * | 2020-08-21 | 2020-11-24 | 苏州浪潮智能科技有限公司 | File migration method, device, equipment and readable storage medium |
| CN111984196B (en) * | 2020-08-21 | 2022-08-19 | 苏州浪潮智能科技有限公司 | File migration method, device, equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106201659B (en) | A kind of method and host of live migration of virtual machine | |
| CN107729558B (en) | Method, system and device for defragmenting file system and computer storage medium | |
| JP6920448B2 (en) | Flash memory file system and its data management method | |
| CN102541538A (en) | Picture displaying method and device based on mobile terminal | |
| CN107589916A (en) | A kind of entangling based on correcting and eleting codes deletes the creation method and relevant apparatus in pond | |
| US10877885B2 (en) | Electronic device data operation method and electronic device for improved electronic device storage | |
| CN115576505A (en) | Data storage method, device and equipment and readable storage medium | |
| CN115407943A (en) | Memory dump file generation method, device and equipment and readable storage medium | |
| CN111176571A (en) | Method, device, equipment and medium for managing local object | |
| CN107148612A (en) | A kind of method and apparatus of extending user subregion | |
| US11176089B2 (en) | Systems and methods for implementing dynamic file systems | |
| CN103177019B (en) | Usb storage device and driving method thereof | |
| CN110032474B (en) | Method, system and related components for determining snapshot occupied capacity | |
| CN114995770B (en) | Data processing method, device, equipment, system and readable storage medium | |
| CN114328007B (en) | Container backup and restoration method, device and medium thereof | |
| CN113703678B (en) | Method, device, equipment and medium for re-splitting storage bucket index | |
| CN115203130A (en) | File cleaning method, device, equipment and medium for distributed file system | |
| CN106202262A (en) | A kind of information processing method and electronic equipment | |
| CN112269535A (en) | Space resource allocation method and device of storage system and readable storage medium | |
| CN106407465A (en) | File deletion method and system based on distributed file system | |
| CN107704307A (en) | A kind of management method, device and the terminal of virtual external storage | |
| CN112463048A (en) | Compact processing speed adjusting method and device, electronic equipment and medium | |
| CN113806295B (en) | File migration method, system, equipment and computer readable storage medium | |
| CN104461382A (en) | Internal writing method for file server operating multiple file systems and server | |
| CN111625192B (en) | Metadata object access method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200519 |