CN112667161B - File system data processing method, device, equipment and medium - Google Patents

File system data processing method, device, equipment and medium Download PDF

Info

Publication number
CN112667161B
CN112667161B CN202011566249.0A CN202011566249A CN112667161B CN 112667161 B CN112667161 B CN 112667161B CN 202011566249 A CN202011566249 A CN 202011566249A CN 112667161 B CN112667161 B CN 112667161B
Authority
CN
China
Prior art keywords
data storage
storage unit
written
data
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011566249.0A
Other languages
Chinese (zh)
Other versions
CN112667161A (en
Inventor
肖丹
周良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Coretek Systems Inc
Original Assignee
Coretek Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Coretek Systems Inc filed Critical Coretek Systems Inc
Priority to CN202011566249.0A priority Critical patent/CN112667161B/en
Publication of CN112667161A publication Critical patent/CN112667161A/en
Application granted granted Critical
Publication of CN112667161B publication Critical patent/CN112667161B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The embodiment of the invention discloses a data processing method, a device, equipment and a medium of a file system. The method comprises the following steps: acquiring data to be written, determining a source data storage unit to be written and a target data storage unit corresponding to the data to be written, and recording the index of the source data storage unit and the index of the target data storage unit; writing the data to be written into the target data storage unit; and if the data to be written is written successfully, updating the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit. The technical scheme solves the problem that the writing quantity of the file data is too large when the log file is adopted to track the file system, and improves the writing speed and efficiency of the file data.

Description

File system data processing method, device, equipment and medium
Technical Field
Embodiments of the present invention relate to the field of data processing technologies, and in particular, to a data processing method, apparatus, device, and medium for a file system.
Background
The FAT (File Allocation Table, file configuration table) file system is a simple file system currently used in various platforms, and has a file configuration table in the FAT area for recording information on how files are stored in different clusters in a disk in a scattered manner, thereby realizing chained storage of files. In a file system using a journaling mechanism, journaling files are typically employed to track all modifications of the file system. If the system is accidentally suspended due to a fault or abnormal power failure, the damaged file system can be repaired through the log file when the system is restarted.
When the log file is adopted to track the file system, the file data to be written is generally written into the disk log area directly and then written into the disk file system, so that the writing quantity of the file data in the file system is increased in multiple times, and when the file data to be written is excessive, the writing speed and efficiency of the file data are seriously reduced.
Disclosure of Invention
The embodiment of the invention provides a data processing method, device, equipment and medium of a file system, which are used for solving the problem that the writing quantity of file data is overlarge when a log file is adopted for tracking the file system, and improving the writing speed and efficiency of the file data.
In a first aspect, an embodiment of the present invention provides a data processing method of a file system, including:
acquiring data to be written, determining a source data storage unit to be written and a target data storage unit corresponding to the data to be written, and recording the index of the source data storage unit and the index of the target data storage unit;
writing the data to be written into the target data storage unit;
and if the data to be written is written successfully, updating the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit.
In a second aspect, an embodiment of the present invention further provides a data processing apparatus of a file system, including:
the data acquisition module is used for acquiring data to be written, determining a source data storage unit to be written corresponding to the data to be written and a target data storage unit, and recording the index of the source data storage unit and the index of the target data storage unit;
the data writing module is used for writing the data to be written into the target data storage unit;
and the data storage unit updating module is used for updating the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit if the data to be written is written successfully.
In a third aspect, an embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor executes the program to implement a data processing method of a file system according to any embodiment of the present invention.
In a fourth aspect, an embodiment of the present invention further provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements a data processing method of a file system according to any embodiment of the present invention.
In the technical scheme provided by the embodiment of the invention, the data to be written is obtained, the source data storage unit and the target data storage unit which correspond to the data to be written are determined, the index of the source data storage unit and the index of the target data storage unit are recorded, then the data to be written is written into the target data storage unit, and if the data to be written is written successfully, the data storage unit which corresponds to the data to be written is updated from the source data storage unit to the target data storage unit. According to the technical scheme, the data to be written can be written into the file system only by writing the data to be written into the target data storage unit, the data to be written is not required to be written into the log area before being written into the file system, the problem that the writing quantity of the file data is overlarge when the log file is adopted for tracking the file system is solved, and the writing speed and the writing efficiency of the file data are improved.
Drawings
FIG. 1a is a flowchart illustrating a data processing method of a file system according to a first embodiment of the present invention;
FIG. 1b is a schematic diagram of a cluster chain corresponding to a file before and after a change in the cluster chain according to the first embodiment of the present invention;
FIG. 2 is a flow chart of a data processing method of a file system according to a second embodiment of the present invention;
FIG. 3 is a schematic diagram of a data processing apparatus of a file system according to a third embodiment of the present invention;
fig. 4 is a schematic hardware structure of a computer device in a fourth embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently, or at the same time. Furthermore, the order of the operations may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example 1
Fig. 1a is a flowchart of a data processing method of a file system according to an embodiment of the present invention, which is applicable to a case of reducing a writing amount of file data in a log area when performing file system tracking, where the method may be performed by a data processing apparatus of a file system according to an embodiment of the present invention, and the apparatus may be implemented in a software and/or hardware manner and may be generally integrated in a computer device.
As shown in fig. 1a, the data processing method of a file system provided in this embodiment specifically includes:
s110, acquiring data to be written, determining a source data storage unit to be written and a target data storage unit corresponding to the data to be written, and recording indexes of the source data storage unit and the target data storage unit.
The data to be written refers to the data which needs to be written into the file system for storage.
The data storage unit refers to disk space occupied when storing data in a file system.
The source data storage unit refers to a data storage unit where a file to which data to be written belongs originally exists; the target data storage unit refers to any one of the data storage units in the file system that can be used to store data to be written.
In this embodiment, if the writing of the data to be written is successful, the target data storage unit is the data storage unit where the file to which the data to be written belongs is the final data storage unit. When determining the target data storage unit, any free data storage unit in the file system may be selected, or any data storage unit capable of storing data to be written may be selected according to a preset selection policy, for example, a data storage unit capable of being covered by data is selected, which is not limited in detail in the embodiment of the present invention.
The index of the data storage unit refers to an indication identifier corresponding to the data storage unit, so as to be used for indicating a specific position occupied by the data storage unit in the disk space.
The index of the source data storage unit refers to an indication identifier corresponding to the source data storage unit; the index of the target data storage unit refers to the indication identifier corresponding to the target data storage unit.
After the data to be written is obtained, determining a source data storage unit to be written corresponding to the data to be written, selecting a target data storage unit corresponding to the data to be written, and recording indexes corresponding to the source data storage unit and the target data storage unit.
In this embodiment, the index of the source data storage unit and the index of the target data storage unit may be recorded in the log area of the file system. That is, the file modification status corresponding to the data to be written is recorded in the log area of the file system, wherein the index of the source data storage unit corresponds to the source storage address before the file corresponding to the data to be written is modified, and the index of the target data storage unit corresponds to the destination storage address after the file corresponding to the data to be written is modified.
S120, writing the data to be written into the target data storage unit.
In this embodiment, the data to be written in the source data storage unit is written in the target data storage unit for storage, and the data to be written in is not written in the source data storage unit.
That is, the present embodiment performs a write operation on data to be written by a write-in-place manner, which means that the data to be written is not written into a source data storage unit to which it is originally written, but is written into a newly determined target data storage unit.
And S130, if the data to be written is written successfully, updating the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit.
The data storage unit corresponding to the data to be written may further include other data storage units corresponding to the file to which the data to be written belongs, in addition to the source data storage unit, and no operation is required for these other data storage units. Therefore, after the data to be written is written into the target data storage unit, if the data to be written is written successfully, the data storage unit corresponding to the data to be written is updated from the source data storage unit to the target data storage unit.
Optionally, if the writing of the data to be written fails, performing data rollback according to the index of the source data storage unit and the index of the target data storage unit; if the writing of the data to be written is successful, the method may further include: and deleting the index of the recorded source data storage unit and the index of the target data storage unit.
Rollback refers to reading records in the data storage unit according to the reverse sequence of data writing and performing corresponding processing to return to the state before data writing so as to ensure the consistency of the system state and the integrity of the data.
In the prior art, data to be written is generally written into a source data storage unit, the source data storage unit is subjected to data coverage, and before the data to be written is written into the source data storage unit, the data to be written is ensured to be written into a log area, so that the stored data in the log area can be used as a data recovery basis when the data to be written fails to be written into the source data storage unit.
In this embodiment, the data to be written is not written into the source data storage unit, that is, the source data storage unit is not subjected to data coverage, so that the stored data in the source data storage unit can be used as a data rollback basis when the data to be written fails to be written into the target data storage unit, that is, can be rolled back to the data storage state before the data to be written is written.
After the data to be written is completely written into the target data storage unit, if the data to be written is successfully written into the target data storage unit, the index of the recorded source data storage unit and the index of the target data storage unit can be deleted at the moment so as to finish the record of the file modification state.
In the process of writing the data to be written into the target data storage unit, if the data writing fails, for example, unexpected interruption can be caused by system failure or abnormal power failure, so that the data to be written into fails, after the system is restarted, the data rollback can be performed according to the index of the source data storage unit and the index of the target data storage unit.
When the data rollback is performed, the target data storage unit can be determined according to the index of the target data storage unit, the data in the target data storage unit is deleted, the source data storage unit is determined according to the index of the source data storage unit, the data in the source data storage unit is used as the storage data corresponding to the file to which the data to be written belongs again, so that the data rollback of the file to which the data to be written belongs is realized, and at the moment, the file to which the data to be written belongs is restored to the state before the data to be written is written.
When the data rollback operation is completed, the indexes of the recorded source data storage units and the indexes of the target data storage units corresponding to the data to be written can be deleted, so that the record of the file modification state is ended, and the beneficial effects of improving the writing speed and efficiency of the file data on the premise of realizing the power-down protection of the file system are achieved. Or when the writing of the data to be written into the target data storage unit is successful, the index of the source data storage unit and the index of the target data storage unit corresponding to the data to be written, which are recorded in the log area of the file system, can be deleted, namely the file modification state corresponding to the data to be written is deleted.
On the basis of the technical scheme, the file system can be a FAT file system, and the corresponding data storage units are clusters. Wherein, a data storage unit can comprise a plurality of data storage subunits, and the data storage subunits corresponding to the clusters are sectors; the source data storage unit includes at least one cluster, and the clusters included in the source data storage unit are in one-to-one correspondence with the clusters included in the target data storage unit.
The FAT file system may use a 32-bit file configuration table, the cluster is a basic unit formed by combining a plurality of adjacent sectors and used for distributing disk space, and the sectors are the smallest physical storage units in the disk.
Further, as an optional implementation manner, updating the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit may include: acquiring an associated data storage unit corresponding to the source data storage unit; deleting a data storage unit chain corresponding to the source data storage unit and the associated data storage unit according to the index of the source data storage unit and the index of the associated data storage unit; and establishing a data storage unit chain corresponding to the target data storage unit and the associated data storage unit according to the index of the target data storage unit and the index of the associated data storage unit.
The associated data storage unit refers to a data storage unit which corresponds to a file to which data to be written belongs and which does not need to be updated.
The index of the associated data storage unit refers to the indication identifier corresponding to the associated data storage unit.
And the data storage unit chain consists of at least two data storage units, one data storage unit chain corresponds to one file, and the number of the data storage units included in the data storage unit chain is related to the data size of the file. When the data storage units are clusters, the data storage unit chain is a cluster chain, the index of the data storage units is a cluster number, and one cluster chain can comprise at least two clusters.
The data storage unit chain corresponding to the source data storage unit and the associated data storage unit, namely an original cluster chain, refers to a cluster chain corresponding to a file to which data to be written originally belongs, namely a cluster chain corresponding to the source data storage unit and the associated data storage unit; the data storage unit chain corresponding to the target data storage unit and the associated data storage unit, that is, the target cluster chain, means a cluster chain corresponding to a file to which data to be written belongs, that is, a cluster chain corresponding to the target data storage unit and the associated data storage unit.
After the data to be written is written into the target data storage unit, deleting the original cluster chain corresponding to the source data storage unit and the associated data storage unit according to the index of the source data storage unit and the index of the associated data storage unit, and establishing a target cluster chain corresponding to the target data storage unit and the associated data storage unit according to the index of the target data storage unit and the index of the associated data storage unit, so that the cluster chain corresponding to the file to which the data to be written belongs is adjusted from the original cluster chain to the target cluster chain.
Further, performing data rollback according to the index of the source data storage unit and the index of the target data storage unit may include: deleting a data storage unit chain corresponding to the target data storage unit and the associated data storage unit according to the index of the target data storage unit and the index of the associated data storage unit; recovering a data storage unit chain corresponding to the source data storage unit and the associated data storage unit according to the index of the source data storage unit and the index of the associated data storage unit; and deleting the index of the recorded source data storage unit and the index of the target data storage unit.
When the writing of the data to be written into the target data storage unit fails, and the data rollback is carried out, deleting the data storage unit chain (namely the target cluster chain) corresponding to the target data storage unit and the associated data storage unit according to the index of the target data storage unit and the index of the associated data storage unit, and simultaneously deleting the data written into the target data storage unit. And recovering the data storage unit chains (namely original cluster chains) corresponding to the source data storage units and the associated data storage units according to the indexes of the source data storage units and the associated data storage units, namely reestablishing the cluster chains corresponding to the source data storage units and the associated data storage units, wherein the reestablished cluster chains corresponding to the source data storage units and the associated data storage units are identical to the original cluster chains corresponding to the source data storage units and the associated data storage units.
It should be noted that, in addition to the source cluster, the original cluster chain corresponding to the source data storage unit (i.e., the source cluster) may also include associated data storage units (i.e., other clusters) corresponding to the files to which the data to be written belong, and no operation is required for these other clusters. Therefore, when the target cluster chain corresponding to the target cluster is established according to the index of the target data storage unit (namely, the target cluster) and the index of the associated data storage unit, the other clusters are added into the target cluster chain according to the original sequence; when the original cluster chain corresponding to the source data storage unit is restored according to the index of the source data storage unit and the index of the associated data storage unit, the other clusters are added to the restored original cluster chain according to the original sequence.
As a specific embodiment, a cluster chain "cluster 256-cluster 333-cluster 234-cluster 332" is provided in FIG. 1b, wherein the cluster chain is assumed to correspond to file "hello.c", the file size corresponds to the size of 4 clusters, each cluster is 4 sectors in size, and the starting cluster is cluster 256. Assuming that the data writing update needs to be performed on the file content in the 2 nd cluster (i.e., cluster 333) and the 3 rd cluster (i.e., cluster 234) in the file "hello.c", the source data storage units corresponding to the data to be written are the clusters 333 and 234, the indexes of the source data storage units, i.e., cluster number 333 and cluster number 234, can be recorded in the log area of the file system, while the target data storage units corresponding to the data to be written are determined, and assuming that the selected target data storage units are the clusters 666 and 888 (the clusters included in the source data storage units are in one-to-one correspondence with the clusters included in the target data storage units), the indexes of the target data storage units, i.e., cluster number 666 and cluster number 888, are recorded in the log area. For example, the data to be written corresponding to the source data storage unit cluster 333 is written into the target data storage unit cluster 666 corresponding to the source data storage unit cluster 333, the data to be written corresponding to the source data storage unit cluster 234 is written into the target data storage unit cluster 888 corresponding to the source data storage unit cluster 234, if the data to be written is written successfully, the index cluster numbers 333 and 234 of the source data storage unit and the index cluster numbers 666 and 888 of the target data storage unit recorded in the log area are deleted, and according to the index cluster numbers 333 and 234 of the source data storage unit and the index cluster numbers 256 and 332 of the associated data storage unit, deleting original cluster chains 'cluster 256-cluster 333-cluster 234-cluster 332' corresponding to the source data storage unit clusters 333 and 324 and the associated data storage unit clusters 256 and 332, and establishing target cluster chains 'cluster 256-cluster 666-cluster 888-cluster 332' corresponding to the target data storage unit clusters 666 and 888 and the associated data storage unit clusters 256 and 332 according to the index cluster numbers 666 and 888 of the target data storage unit and the index cluster numbers 256 and 332 of the associated data storage unit, so as to finish writing operation of the data to be written, wherein the cluster chain corresponding to the updated 'hello.c' file is 'cluster 256-cluster 666-cluster 888-cluster 332'; if the system power failure causes the writing failure of the data to be written in the data writing process, the data rollback is carried out according to the index cluster numbers 333 and 234 of the source data storage unit and the index cluster numbers 666 and 888 of the target data storage unit, the target cluster chain 'cluster 256-cluster 666-cluster 888-332' corresponding to the target data storage unit clusters 666 and 888 and the associated data storage unit clusters 256 and 332 is deleted according to the index cluster numbers 666 and the cluster numbers 888 of the source data storage unit and the index cluster numbers 666 and the cluster 332 of the associated data storage unit, the original cluster chain 'cluster 256-cluster 333-234-cluster 332' corresponding to the source data storage unit clusters 333 and 324 and the associated data storage unit clusters and 332 is restored according to the index cluster numbers 666 and the cluster numbers 888 of the source data storage unit and the associated data storage unit clusters and the index cluster 256, and the target data storage unit cluster 888 is deleted, namely the index number 333 and the cluster number of the target data storage unit clusters to be deleted is corresponding to the state of the data to be deleted.
When the system power failure causes the writing failure of the data to be written, after the system is restarted to roll back the data, the target data storage unit to be written corresponding to the data to be written can be redetermined and the index of the target data storage unit to be written can be recorded again, so that the data to be written is rewritten into the newly determined target data storage unit.
As another alternative implementation manner, if the source data storage unit includes one or more clusters, and only a part of sectors in one target cluster correspond to the data to be written, before writing the data to be written into the target data storage unit, the method may further include:
and copying the data in the rest sectors except part of sectors in the target cluster into a corresponding cluster in the target data storage unit.
The target cluster refers to any cluster which needs to perform data writing update on a source data storage unit corresponding to data to be written.
The source data storage unit may include one cluster or a plurality of clusters, when writing and updating are required to be performed on data in the file system, only partial sectors in one cluster may be involved to correspond to the data to be written, at this time, the data in other sectors except the partial sectors may be copied to one cluster corresponding to the current cluster to be updated in the target data storage unit corresponding to the source data storage unit, and then the data to be written corresponding to the partial sectors is written into the target data storage unit. For example, one cluster includes 4 sectors, and 1 sector in one cluster in the source data storage unit needs to be updated by writing data, and after copying data in the other 3 sectors of the cluster into one cluster corresponding to the cluster in the target data storage unit, the data to be written is written into the cluster in the target data storage unit.
In fig. 1b, assuming that data corresponding to two sectors in a cluster 333 in a cluster chain corresponding to a file "hello.c" needs to be updated, data in two sectors in a source data storage unit cluster 333 that do not need to be updated may be copied to a cluster 666 in a target data storage unit corresponding to the source data storage unit cluster 333, and then data to be written corresponding to two sectors to be updated may be written into the cluster 666.
In the technical scheme provided by the embodiment of the invention, the data to be written is obtained, the source data storage unit and the target data storage unit which correspond to the data to be written are determined, the index of the source data storage unit and the index of the target data storage unit are recorded, then the data to be written is written into the target data storage unit, and if the data to be written is written successfully, the data storage unit which corresponds to the data to be written is updated from the source data storage unit to the target data storage unit. According to the technical scheme, the data to be written can be written into the file system only by writing the data to be written into the target data storage unit, the data to be written is not required to be written into the log area before being written into the file system, the problem that the writing quantity of the file data is overlarge when the log file is adopted for tracking the file system is solved, and the writing speed and the writing efficiency of the file data are improved.
Example two
Fig. 2 is a flowchart of a data processing method of a file system according to a second embodiment of the present invention. The present embodiment is embodied on the basis of the above embodiment, wherein after determining the source data storage unit to be written corresponding to the data to be written, before determining the target data storage unit to be written corresponding to the data to be written, the method may further include:
estimating the total number of to-be-operated of the data storage subunits according to the number of the source data storage units, and comparing the total number of to-be-operated with the target total number of to-be-operated; wherein one data storage unit includes a plurality of data storage subunits; the total number of target operations is twice the number of data storage subunits included in the source data storage unit;
determining a target data storage unit to be written corresponding to the data to be written may include:
and when the total number of the to-be-operated operations is smaller than or equal to the total number of the target operations, determining a target data storage unit to be written, which corresponds to the data to be written.
Further, when the total number of to-be-operated is greater than the target total number of operated, the data to be written may be written into the log area; and if the data to be written is successfully written into the log area, writing the data to be written into the source data storage unit.
As shown in fig. 2, the data processing method of a file system provided in this embodiment specifically includes:
s210, acquiring data to be written, determining a source data storage unit to be written corresponding to the data to be written, recording indexes of the source data storage unit, and estimating the total number of the data storage subunits to be operated according to the number of the source data storage units.
Wherein one data storage unit may comprise a plurality of data storage subunits.
The total number of operations to be performed refers to the total number of data storage subunits involved in performing a write operation on data to be written.
Obtaining data to be written, determining a source data storage unit to be written corresponding to the data to be written, recording an index of the data storage unit, estimating the total number of to-be-operated data storage subunits according to the number of the source data storage units, wherein the total number of to-be-operated data storage subunits can be obtained by adopting a preset estimation method, for example, assuming that a file system is a FAT system, the sum of the number of to-be-operated sectors corresponding to other steps such as the number of sectors operated when the index of the source data storage unit and the index of a target data storage unit are recorded, the number of sectors operated when writing operation is performed on the data to be written, the number of sectors operated when a target cluster chain is established and the like can be calculated, and the calculated sum of the number is used as the total number of to-be-operated data storage subunits.
S220, judging whether the total number of to-be-operated operations is larger than the target total number of operation, if not, executing S230, and if so, executing S270.
The total number of target operations is twice the number of data storage subunits included in the source data storage unit, that is, the total number of target operations corresponds to the number of data storage subunits that need to be operated when writing operation is performed on data to be written by adopting a file copy writing mode in the prior art, wherein the file copy refers to that the data to be written is written into a log area first and then written into the source data storage unit. For example, when one source data storage unit includes 4 data storage subunits, the total number of target operations is 8, that is, the number of data storage subunits that need to be operated when the file copy mode is adopted is 8.
Judging whether the total number of to-be-operated is larger than the target total number of operation, and if the total number of to-be-operated is smaller than or equal to the target total number of operation, adopting a remote writing mode in the embodiment; if the total number of to-be-operated operations is larger than the total number of target operations, a file copying and writing mode in the prior art is adopted.
S230, determining a target data storage unit to be written corresponding to the data to be written, and recording the index of the target data storage unit.
S240, writing the data to be written into the target data storage unit.
S250, judging whether the data to be written fails to be written, if so, executing S260, and if not, executing S270.
S260, performing data rollback according to the index of the source data storage unit and the index of the target data storage unit, and then executing S280.
When the file system is a FAT file system, the data storage unit is a cluster, and the data storage subunit is a sector, at this time, when data rollback is performed according to the index of the source data storage unit and the index of the target data storage unit, the target cluster chain corresponding to the target data storage unit and the associated data storage unit can be deleted according to the index of the target data storage unit and the index of the associated data storage unit, the data written in the target data storage unit is deleted at the same time, and then the original cluster chain corresponding to the source data storage unit and the associated data storage unit is restored according to the index of the source data storage unit and the index of the associated data storage unit.
S270, updating the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit.
S280, deleting the index of the recorded source data storage unit and the index of the target data storage unit.
When the data to be written is successfully written into the target data storage unit, deleting the recorded index of the source data storage unit and the index of the target data storage unit corresponding to the data to be written; or when the writing of the data to be written into the target data storage unit fails, deleting the index of the recorded source data storage unit and the index of the target data storage unit after the system is restarted to finish the data rollback operation so as to finish the recording of the file modification state.
S290, writing the data to be written into the log area.
When the total number of the to-be-written data is larger than the total number of the target operations, the to-be-written data is written into the log area, if the system is accidentally interrupted in the process of writing into the log area, after the system is restarted, the written part of the to-be-written data can be completely deleted before the system is interrupted, and then the write operation is performed on the to-be-written data again, so that the complete writing of all the to-be-written data is ensured.
And S2100, if the data to be written is successfully written into the log area, the data to be written into the source data storage unit.
Only after all the data to be written are written into the log area, a complete log file is formed, then the data to be written is written into the source data storage unit, if the system is interrupted accidentally in the process of writing into the source data storage unit, after the system is restarted, the rest of the unwritten data to be written can be written into the source data storage unit of the file system continuously according to the complete log file formed in the log area.
For example, if the writing operation of a file is completed, the data to be written corresponding to the sector 555 and the sector 888 need to be updated, the data to be written corresponding to the sector 555 and the sector 888 is written into the log area, a complete log is formed after the data to be written corresponding to the sector 555 and the sector 888 are both written into the log area, then the file system can continue to write the data to be written corresponding to the sector 555 and the sector 888 into the source data storage unit, if the system is powered down after the writing of the data to be written corresponding to the sector 555 into the source data storage unit is completed, after the system is restarted, the data to be written corresponding to the sector 888 can be written into the source data storage unit of the file system according to the complete log recorded in the log area, so that the problem that the state of the file system is inconsistent due to the loss of the data to be written corresponding to the sector 888 caused by the power-down device is avoided.
It should be noted that, the file writing operation mainly includes writing file data and creating a file, wherein the creating file only needs to write data of one directory entry, and the writing data volume is smaller, so when the file writing operation is the creating file, a mode of writing the data to be written into the log area and then writing into the source data storage unit can be adopted; when the file writing operation is writing of the file data, the situation that the written file data is smaller or larger may exist, so that the file writing mode can be determined after the size relation between the total number of to-be-operated operations and the total number of target operations is judged, and the matched writing mode is adaptively selected according to different operations and different writing situations of the file writing, so that the writing speed and the writing efficiency of the file data are improved.
As a specific implementation manner, for the cluster chain "cluster 256-cluster 333-cluster 234-cluster 332" provided in fig. 1b, assuming that the file contents in the 2 nd cluster (i.e. cluster 333) and the 3 rd cluster (i.e. cluster 234) need to be updated by writing data, the indexes of the source data storage units, i.e. cluster number 333 and cluster number 234, can be recorded in the log area of the file system, then the total number of target operations is determined to be 16 according to the number of corresponding data storage subunits (i.e. sectors) being 8 (i.e. the total number of sectors to be operated is 16 when the file copy writing mode is adopted, i.e. the operation for the sectors when the file copy writing mode is adopted can include operating 8 sectors when the data to be written in the log area and operating 8 sectors when the data to be written in the source data storage unit), so as to estimate the total number of sectors to be operated when the remote writing mode is adopted, and determine the size relationship between the total number of sectors to be operated and the total number of target operations. Specifically, the operations for the sector when the write-in mode is adopted may include: 1 sector is operated when the index of the source data storage unit and the index of the target data storage unit are recorded in the log area of the file system, 8 sectors are operated when the write operation is performed on data to be written in the target data storage unit, 1 sector is operated when the original cluster chain corresponding to the source data storage unit is deleted according to the index of the source data storage unit, 1 sector is operated when the target cluster chain corresponding to the target data storage unit is established according to the index of the target data storage unit, and 1 sector is required to be operated when the index of the source data storage unit and the index of the target data storage unit recorded in the log area are deleted when the data to be written in succeed in writing, and the total number of the sectors to be operated is estimated to be 12. In this case, the total number of sectors to be operated corresponding to the off-site writing method is smaller than the total number of target operations, so that the off-site writing method is adopted, i.e., the data to be written is directly written into the target data storage unit clusters 666 and 888 corresponding to the source data storage unit clusters 333 and 234, respectively.
As another specific embodiment, in fig. 1b, assuming that data corresponding to two sectors in the cluster 333 in the file "hello.c" needs to be updated, when estimating the total number of to-be-operated sectors, the operations for the sectors when adopting the write-in-place manner may at least include: according to the index of the target data storage unit, 1 sector is operated when a target cluster chain corresponding to the target data storage unit is established, 2 sectors are operated when data in two sectors which are not required to be updated in the cluster 333 are copied into a corresponding one of the target data storage units, 2 sectors are operated when data to be written corresponding to the two sectors to be updated are written into the target data storage unit, 1 sector is operated when the index of the source data storage unit and the index of the target data storage unit recorded in the log area are deleted, and the total number of the sectors to be operated is estimated to be 6. In this case, the total number of sectors to be operated is greater than the target total number of operations, so that the file copy writing method is adopted, that is, after the data to be written is completely written into the log area, the data to be written is written into the source data storage unit cluster 333.
The present embodiment is not explained in detail herein, and reference is made to the foregoing embodiments.
According to the technical scheme, the data to be written is obtained, the source data storage unit to be written corresponding to the data to be written is determined, the index of the source data storage unit is recorded, the total number of the data storage subunits to be operated is estimated according to the number of the source data storage units, the writing mode of the data to be written is selected by judging the size relation between the total number of the data to be operated and the total number of the target operations, the adaptively selected matching writing mode according to the size of the data to be written is realized, the writing quantity of the file data is reduced as a whole, and the writing speed and the writing efficiency of the file data are improved.
Example III
Fig. 3 is a schematic structural diagram of a data processing apparatus of a file system according to a third embodiment of the present invention, which is applicable to a case of reducing the writing amount of file data in a log area when performing file system tracking, and the apparatus may be implemented in a software and/or hardware manner and may be generally integrated in a computer device.
As shown in fig. 3, the data query device specifically includes: a data acquisition module 310, a data writing module 320, and a data storage unit updating module 330. Wherein,
a data obtaining module 310, configured to obtain data to be written, determine a source data storage unit to be written and a target data storage unit corresponding to the data to be written, and record an index of the source data storage unit and an index of the target data storage unit;
A data writing module 320, configured to write the data to be written into the target data storage unit;
and the data storage unit updating module 330 is configured to update the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit if the data to be written is written successfully.
According to the technical scheme provided by the embodiment of the invention, the data to be written is obtained, the source data storage unit and the target data storage unit which correspond to the data to be written are determined, the index of the source data storage unit and the index of the target data storage unit are recorded, then the data to be written is written into the target data storage unit, and if the data to be written is written successfully, the data storage unit which corresponds to the data to be written is updated from the source data storage unit to the target data storage unit. According to the technical scheme, the data to be written can be written into the file system only by writing the data to be written into the target data storage unit, the data to be written is not required to be written into the log area before being written into the file system, the problem that the writing quantity of the file data is overlarge when the log file is adopted for tracking the file system is solved, and the writing speed and the writing efficiency of the file data are improved.
Optionally, the apparatus further includes: the data rollback module is used for performing data rollback according to the index of the source data storage unit and the index of the target data storage unit if the data to be written fails to be written;
the data storage unit updating module 330 is specifically configured to: and if the data to be written is written successfully, deleting the recorded index of the source data storage unit and the recorded index of the target data storage unit.
Optionally, the data obtaining module 310 is configured to, after determining the source data storage unit to be written corresponding to the data to be written, estimate, according to the number of the source data storage units, the total number of to-be-operated data storage subunits before determining the target data storage unit to be written corresponding to the data to be written, and compare the total number of to-be-operated data storage subunits with the total number of target operations; when the total number of to-be-operated is smaller than or equal to the total number of target operations, determining a target data storage unit to be written, which corresponds to the data to be written; wherein the total number of target operations is twice the number of data storage subunits included in the source data storage unit, one of the data storage units comprising a plurality of data storage subunits.
Optionally, the data storage unit is a cluster, and the data storage subunit is a sector; the source data storage unit comprises at least one cluster, and the clusters included in the source data storage unit are in one-to-one correspondence with the clusters included in the target data storage unit.
Optionally, the data storage unit updating module 330 is specifically configured to: acquiring an associated data storage unit corresponding to the source data storage unit; deleting a data storage unit chain corresponding to the source data storage unit and the associated data storage unit according to the index of the source data storage unit and the index of the associated data storage unit; and establishing a data storage unit chain corresponding to the target data storage unit and the associated data storage unit according to the index of the target data storage unit and the index of the associated data storage unit.
Further, the data rollback module is specifically configured to: deleting a data storage unit chain corresponding to the indexes of the target data storage unit and the associated data storage unit according to the indexes of the target data storage unit and the associated data storage unit; recovering a data storage unit chain corresponding to the source data storage unit and the associated data storage unit according to the index of the source data storage unit and the index of the associated data storage unit; and deleting the recorded index of the source data storage unit and the index of the target data storage unit.
Optionally, the apparatus further includes: and the data copying module is used for copying the data in the rest sectors except the partial sectors in the target cluster to the corresponding one of the target data storage units before writing the data to be written into the target data storage units if the source data storage unit comprises one or more clusters and only partial sectors in one of the target clusters correspond to the data to be written.
Optionally, the apparatus further includes: the data copying and writing module is specifically used for: when the total number of to-be-operated is larger than the total number of target operations, writing the to-be-written data into a log area; and if the data to be written is successfully written into the log area, writing the data to be written into the source data storage unit.
The data processing device of the file system can execute the data processing method of the file system provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of executing the data processing method of the file system.
Example IV
Fig. 4 is a schematic hardware structure of a computer device according to a fourth embodiment of the present invention, where, as shown in fig. 4, the computer device includes:
One or more processors 410, one processor 410 being illustrated in fig. 4;
a memory 420;
the processor 410 and the memory 420 in the computer device may be connected by a bus or otherwise, for example in fig. 4.
The memory 420 is used as a non-transitory computer readable storage medium for storing a software program and a computer executable program, and includes program instructions corresponding to a data processing method applied to a file system of a computer device in an embodiment of the present invention:
acquiring data to be written, determining a source data storage unit to be written and a target data storage unit corresponding to the data to be written, and recording the index of the source data storage unit and the index of the target data storage unit;
writing the data to be written into the target data storage unit;
and if the data to be written is written successfully, updating the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit.
The processor 410 executes various functional applications of the host computer and data processing by executing software program instructions stored in the memory 420, i.e., implements the data processing method of any of the file systems applied to the computer device in the above embodiments.
Memory 420 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created according to the use of the computer device, etc. In addition, memory 420 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device.
Example five
A fifth embodiment of the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a data processing method for a file system as provided in all embodiments of the present application: that is, the program, when executed by the processor, implements:
acquiring data to be written, determining a source data storage unit to be written and a target data storage unit corresponding to the data to be written, and recording the index of the source data storage unit and the index of the target data storage unit;
writing the data to be written into the target data storage unit;
and if the data to be written is written successfully, updating the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit.
Any combination of one or more computer readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., connected through the internet using an internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.

Claims (9)

1. A method for processing data in a file system, comprising:
acquiring data to be written, determining a source data storage unit to be written and a target data storage unit corresponding to the data to be written, and recording the index of the source data storage unit and the index of the target data storage unit; the source data storage unit is a data storage unit where a file to which data to be written belongs originally exists; the target data storage unit refers to any data storage unit used for storing data to be written in a file system;
writing the data to be written into the target data storage unit;
if the data to be written is successfully written, updating a data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit;
if the writing of the data to be written fails, carrying out data rollback according to the index of the source data storage unit and the index of the target data storage unit;
if the writing of the data to be written is successful, the method further comprises: deleting the recorded index of the source data storage unit and the index of the target data storage unit;
After determining the source data storage unit to be written corresponding to the data to be written, before determining the target data storage unit to be written corresponding to the data to be written, the method further comprises:
estimating the total number of to-be-operated data storage subunits according to the number of the source data storage units, and comparing the total number of to-be-operated data storage subunits with the total number of target operations; wherein one of the data storage units comprises a plurality of data storage subunits; the total number of target operations is twice the number of data storage subunits included in the source data storage unit;
determining a target data storage unit to be written corresponding to the data to be written, including:
and when the total number of the to-be-operated operations is smaller than or equal to the total number of the target operations, determining a target data storage unit to be written, which corresponds to the data to be written.
2. The method of claim 1, wherein the data storage units are clusters and the data storage subunits are sectors;
the source data storage unit comprises at least one cluster, and the clusters included in the source data storage unit are in one-to-one correspondence with the clusters included in the target data storage unit.
3. The method of claim 2, wherein updating the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit comprises:
acquiring an associated data storage unit corresponding to the source data storage unit;
deleting a data storage unit chain corresponding to the source data storage unit and the associated data storage unit according to the index of the source data storage unit and the index of the associated data storage unit;
and establishing a data storage unit chain corresponding to the target data storage unit and the associated data storage unit according to the index of the target data storage unit and the index of the associated data storage unit.
4. A method according to claim 3, wherein rolling back data according to the index of the source data storage unit and the index of the target data storage unit comprises:
deleting a data storage unit chain corresponding to the target data storage unit and the associated data storage unit according to the index of the target data storage unit and the index of the associated data storage unit;
Recovering a data storage unit chain corresponding to the source data storage unit and the associated data storage unit according to the index of the source data storage unit and the index of the associated data storage unit;
and deleting the recorded index of the source data storage unit and the index of the target data storage unit.
5. The method of claim 3, wherein if the source data storage unit comprises one or more clusters and only a portion of sectors in a target cluster are involved in the corresponding data to be written, further comprising, prior to writing the data to be written to the target data storage unit:
and copying the data in the rest sectors except the partial sectors in the target cluster into a corresponding cluster in the target data storage unit.
6. The method as recited in claim 1, further comprising:
when the total number of to-be-operated is larger than the total number of target operations, writing the to-be-written data into a log area;
and if the data to be written is successfully written into the log area, writing the data to be written into the source data storage unit.
7. A data processing apparatus of a file system, comprising:
The data acquisition module is used for acquiring data to be written, determining a source data storage unit to be written corresponding to the data to be written and a target data storage unit, and recording the index of the source data storage unit and the index of the target data storage unit; the source data storage unit is a data storage unit where a file to which data to be written belongs originally exists; the target data storage unit refers to any data storage unit used for storing data to be written in a file system;
the data writing module is used for writing the data to be written into the target data storage unit;
the data storage unit updating module is used for updating the data storage unit corresponding to the data to be written from the source data storage unit to the target data storage unit if the data to be written is written successfully;
the data rollback module is used for performing data rollback according to the index of the source data storage unit and the index of the target data storage unit if the data to be written fails to be written;
the data storage unit updating module is further configured to delete the recorded index of the source data storage unit and the recorded index of the target data storage unit if the data to be written is successfully written;
The data acquisition module is further configured to estimate a total number of to-be-operated data storage subunits according to the number of the source data storage units after determining a source data storage unit to be written corresponding to the to-be-written data and before determining a target data storage unit to be written corresponding to the to-be-written data, and compare the total number of to-be-operated data with the total number of target operations; when the total number of to-be-operated is smaller than or equal to the total number of target operations, determining a target data storage unit to be written, which corresponds to the data to be written;
wherein one of the data storage units comprises a plurality of data storage subunits; the total number of target operations is twice the number of data storage subunits included in the source data storage unit.
8. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any of claims 1-6 when the program is executed by the processor.
9. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any of claims 1-6.
CN202011566249.0A 2020-12-25 2020-12-25 File system data processing method, device, equipment and medium Active CN112667161B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011566249.0A CN112667161B (en) 2020-12-25 2020-12-25 File system data processing method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011566249.0A CN112667161B (en) 2020-12-25 2020-12-25 File system data processing method, device, equipment and medium

Publications (2)

Publication Number Publication Date
CN112667161A CN112667161A (en) 2021-04-16
CN112667161B true CN112667161B (en) 2023-11-10

Family

ID=75409487

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011566249.0A Active CN112667161B (en) 2020-12-25 2020-12-25 File system data processing method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN112667161B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008090378A (en) * 2006-09-29 2008-04-17 Seiko Epson Corp Hybrid file system, operating system, cache control method, and recording medium
WO2009110665A1 (en) * 2008-03-03 2009-09-11 Samsung Electronics Co., Ltd. Information storage medium for recording data according to journaling file system, and method of and apparatus for writing/recovering data using journaling file system
WO2014143023A1 (en) * 2013-03-15 2014-09-18 Hewlett-Packard Development Company, L.P. Memory module controller supporting extended writes
CN111400267A (en) * 2019-11-19 2020-07-10 杭州海康威视系统技术有限公司 Method and device for recording log
CN111886591A (en) * 2019-09-12 2020-11-03 创新先进技术有限公司 Log structure storage system
CN112035294A (en) * 2020-08-25 2020-12-04 华东计算技术研究所(中国电子科技集团公司第三十二研究所) Security log file system, and implementation method and medium thereof

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6993539B2 (en) * 2002-03-19 2006-01-31 Network Appliance, Inc. System and method for determining changes in two snapshots and for transmitting changes to destination snapshot
US9003110B2 (en) * 2010-01-13 2015-04-07 International Business Machines Corporation Dividing incoming data into multiple data streams and transforming the data for storage in a logical data object
JP2015005229A (en) * 2013-06-21 2015-01-08 インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation Method for duplicating file of tape cartridge and program and tape drive

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008090378A (en) * 2006-09-29 2008-04-17 Seiko Epson Corp Hybrid file system, operating system, cache control method, and recording medium
WO2009110665A1 (en) * 2008-03-03 2009-09-11 Samsung Electronics Co., Ltd. Information storage medium for recording data according to journaling file system, and method of and apparatus for writing/recovering data using journaling file system
WO2014143023A1 (en) * 2013-03-15 2014-09-18 Hewlett-Packard Development Company, L.P. Memory module controller supporting extended writes
CN111886591A (en) * 2019-09-12 2020-11-03 创新先进技术有限公司 Log structure storage system
CN111400267A (en) * 2019-11-19 2020-07-10 杭州海康威视系统技术有限公司 Method and device for recording log
CN112035294A (en) * 2020-08-25 2020-12-04 华东计算技术研究所(中国电子科技集团公司第三十二研究所) Security log file system, and implementation method and medium thereof

Also Published As

Publication number Publication date
CN112667161A (en) 2021-04-16

Similar Documents

Publication Publication Date Title
US9690666B1 (en) Incremental backup operations in a transactional file system
US8856469B2 (en) Apparatus and method for logging optimization using non-volatile memory
US20140089730A1 (en) Storage control device and method for controlling storages
US8095510B2 (en) Data restoration in a storage system using multiple restore points
US8862844B2 (en) Backup apparatus, backup method and computer-readable recording medium in or on which backup program is recorded
WO2019001521A1 (en) Data storage method, storage device, client and system
CN103034592B (en) Data processing method and device
WO2021169163A1 (en) File data access method and apparatus, and computer-readable storage medium
US8595430B2 (en) Managing a virtual tape library domain and providing ownership of scratch erased volumes to VTL nodes
CN109213450B (en) Associated metadata deleting method, device and equipment based on flash memory array
CN105095418B (en) A kind of method and apparatus of processing write requests
CN113608695A (en) Data processing method, system, device and medium
CN107329699B (en) Erasure rewriting method and system
CN107329695B (en) Distributed storage memory management method, system and computer storage medium
CN112667161B (en) File system data processing method, device, equipment and medium
CN112988880B (en) Data synchronization method, device, electronic equipment and computer storage medium
US11093348B2 (en) Method, device and computer program product for recovering metadata
CN103714059A (en) Data updating method and device
US9235349B2 (en) Data duplication system, data duplication method, and program thereof
CN115827322A (en) Cloud storage data full-scale disaster recovery method and system
CN109325005A (en) A kind of data processing method and electronic equipment
KR101533042B1 (en) Apparatus and method of computing for guaranteeing data consistency
CN114063883A (en) Method for storing data, electronic device and computer program product
CN108984117B (en) Data reading and writing method, medium and equipment
US8150806B2 (en) Idempotent storage replication management

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant