CN114153385B - Distributed storage write buffer data step-by-step brushing method, device and medium - Google Patents
Distributed storage write buffer data step-by-step brushing method, device and medium Download PDFInfo
- Publication number
- CN114153385B CN114153385B CN202111338442.3A CN202111338442A CN114153385B CN 114153385 B CN114153385 B CN 114153385B CN 202111338442 A CN202111338442 A CN 202111338442A CN 114153385 B CN114153385 B CN 114153385B
- Authority
- CN
- China
- Prior art keywords
- data
- disk
- disk space
- flushed
- writing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 117
- 230000001680 brushing effect Effects 0.000 title claims abstract description 18
- 230000008569 process Effects 0.000 claims abstract description 77
- 238000012545 processing Methods 0.000 claims abstract description 28
- 238000002360 preparation method Methods 0.000 claims abstract description 26
- 238000011010 flushing procedure Methods 0.000 claims description 21
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000012423 maintenance Methods 0.000 abstract description 3
- 230000007717 exclusion Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The application relates to a distributed storage write buffer data step-by-step brushing method, a device and a medium. The method comprises the steps of deeply copying object metadata of data to be flushed, generating temporary object metadata, and processing a writing process of the data to be flushed by utilizing the temporary object metadata to obtain disk space information for storing disk space of the data to be flushed, so as to form disk writing preparation information; then writing the data to be flushed to a slow disk according to the disk writing preparation information, wherein the process does not update the metadata of the object and only writes the data to be flushed compared with the conventional means; after the writing is completed, the writing process of the data to be flushed is processed again by using the object metadata, and the updating of the object metadata is completed. The method and the device realize asynchronization of data writing and object metadata updating in the process of downloading data to be downloaded, ensure the priority of service writing, improve the efficiency of downloading data, do not need to record and update the object metadata, reduce the complexity of a program and facilitate maintenance.
Description
Technical Field
The application relates to the technical field of caching and brushing, in particular to a distributed storage and writing buffer data stepping and brushing method, device and medium.
Background
The distributed storage generally uses the high-speed device as a write buffer to improve the write performance of the system, the high-speed device has strong read-write performance and can quickly read and write, but has limited capacity, the data written into the high-speed device needs to be flushed down to the slow device, and then the flushed data can be released from the high-speed device, so that the high-speed device can continuously accept the write request, and the system performance is improved.
The process of flushing down the buffer data on the high-speed device involves the transfer of the buffer data itself and the update of the corresponding object metadata, the buffer data needs to be read from the high-speed device and written into the low-speed device, and the object metadata for recording the position information of the data also needs to be updated so as to correctly reflect the position of the device where the data is located. In order to ensure the consistency of the data, the process of flushing the buffered data and the process of writing the service need to be kept mutually exclusive, i.e. only one process can write the corresponding data part at the same time. When implementing the buffered data flushing process, one way is that all flushing steps are completed in one stage, and one flushing process is long because of the slow device writing process, so that business writing is blocked. The other mode is to disperse the steps of brushing down into a plurality of stages, and each stage is mutually exclusive, so that the mode avoids long-time blocking of service writing, and can achieve service writing priority, thereby improving service processing performance. In the implementation of the downloading by stepwise steps, one implementation mode is to identify the data information to be written, record the update information of the object metadata, execute the data writing, finally update the recorded update information of the object metadata to the object metadata and make persistence, which is not intuitive, and realize a set of downloading logic outside the original business writing flow, when the business writing of the object metadata changes, the downloading process also needs to make corresponding adjustment, especially when the structure information of the object metadata is complex, the update information recording and updating process of the object metadata is more complex, which is unfavorable for software maintenance.
Disclosure of Invention
In order to solve the above technical problems or at least partially solve the above technical problems, the present application provides a method, an apparatus and a medium for step-by-step flushing of write buffered data in distributed storage.
In a first aspect, the present application provides a method for writing buffered data in a distributed storage system, including:
s1, reading data stored in high-speed storage equipment to determine data to be flushed;
s2, deeply copying object metadata of the data to be brushed to obtain temporary object metadata;
s3, configuring a playback disk space resource application manager to be in a first state;
s4, processing the writing process of the data to be flushed by using the temporary object metadata to obtain updated temporary object metadata and disk writing preparation information, wherein the disk writing preparation information comprises disk space information and the data information to be flushed;
s5, writing the data to be written into the corresponding disk according to the disk writing preparation information through asynchronous writing;
s6, configuring a playback disk space resource application manager to be in a second state;
s7, processing the data writing process to be flushed by utilizing the object metadata to obtain and persist the updated object metadata.
Further, the writing process of the data to be flushed is configured to apply for the disk space to a preset playback disk space resource application manager through a disk application request.
Furthermore, the first state and the second state of the playable disk space resource application manager are configured through an interface, the first state is configured through the interface when the data to be written is written, and the second state is configured through the interface when the metadata of the object is updated.
Further, in the first state, the playback-capable disk space resource application manager responds to a disk application request, allocates a real disk space, acquires disk space information of the allocated disk space, and records the disk space information and the corresponding disk application request;
in the second state, the playback disk space resource application manager responds to the disk application request, acquires the disk space information of the disk space where the data to be flushed is located, checks the disk space information of the disk space where the data to be flushed is located by using the parameters in the disk application request recorded in the first state, and feeds back the disk space information in the first state.
Further, the mutual exclusion process is configured among the S1, the S2-S4 and the S6-S7.
Further, in the process of mutual exclusion process conversion, whether the metadata of the object is changed or not is detected; if yes, the flow of the distributed storage write buffer data step-by-step down-flushing is terminated.
Furthermore, the object metadata is utilized to process the data writing process to be flushed, the updated object metadata is obtained, the disk writing preparation information is obtained, the obtained disk writing preparation information is discarded, and the updated object metadata is persisted.
And further, storing the disk write preparation information obtained in the step S4 into a queue in sequence, and performing asynchronous writing to perform brushing of data to be flushed according to the disk write preparation information stored in the queue.
In a second aspect, the present application provides a distributed storage write buffer data step-down flushing device, including: the distributed storage write buffer data step-by-step brushing method is realized by the aid of the processing unit, the storage unit, the interface unit, the bus unit and the power supply unit, wherein the bus unit is connected with the processing unit and the interface unit, the power supply unit supplies power to the processing unit, the storage unit, the interface unit and the bus unit, the storage unit stores at least one instruction, and the processing unit reads and executes the instruction.
In a third aspect, the present application provides a medium for implementing a method for implementing a distributed storage write buffer data step-down flushing, where the medium implementing the distributed storage write buffer data step-down flushing method stores at least one instruction, and reads and executes the instruction to implement the distributed storage write buffer data step-down flushing method.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages:
the application realizes the method of the distributed storage Xie Huancun data by the two writing processes. The first write-in processing is realized by using temporary object metadata, and the function of the first write-in processing is to write the data to be flushed from the high-speed storage device to the disk, and the object metadata of the data to be flushed is not updated; the second writing process is realized through the object metadata, and the disk space information of the disk space for storing the data to be flushed in the first writing process needs to be fed back to finish updating the object metadata; the data to be flushed does not need to be written to the disk during the second write process. Thus, the data under-flushing in the high-speed storage device is divided into two process implementations which can be asynchronous.
The first write process preferentially writes the data to be flushed to the disk, and the second write process updates the object metadata. The priority of service writing is guaranteed, the data writing efficiency is improved through the asynchronism of writing the data to be written and updating the object metadata, the complexity of a program is reduced, and the maintenance is convenient.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the application or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a flowchart of a playback-capable disk space resource application manager in a first state according to an embodiment of the present application responding to a disk application request issued by a write process of data to be flushed;
FIG. 2 is a flow chart of a playback-capable disk space resource application manager in a second state in response to a disk application request issued by a write process of data to be flushed in accordance with an embodiment of the present application;
FIG. 3 is a flowchart of a method for flushing data in a distributed storage write buffer according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a device for step-down flushing of write buffered data for distributed storage according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Example 1
The embodiment of the application provides a distributed storage write buffer data step-by-step brushing method. The application realizes the method of the distributed storage Xie Huancun data by the two writing processes. The first write-in processing is realized by using temporary object metadata, and the function of the first write-in processing is to write the data to be flushed from the high-speed storage device to the disk, and the object metadata of the data to be flushed is not updated; the second writing process is realized through the object metadata, and the disk space information of the disk space for storing the data to be refreshed in the first writing process needs to be fed back, so that the updating of the object metadata is completed through the fed back disk space information; the data to be flushed does not need to be written to the disk during the second write process. The application realizes that the data under-brushing in the high-speed storage device is divided into two processes which can be realized asynchronously.
In the existing resource management mechanism for data writing, the second writing process cannot repeatedly apply for obtaining the disk space for storing the data to be flushed in the first writing process, so that in order to realize the method, a playback disk space resource application manager is created, and the writing process for configuring the data to be flushed sends a disk application request to the playback disk space resource application manager.
In the implementation process, the playable disk space resource application manager comprises a first state and a second state, wherein the first state and the second state of the playable disk space resource application manager are configured through an interface, the first state is configured through the interface when writing the data to be flushed, and the second state is configured through the interface when updating the metadata of the object.
Referring to fig. 1, in a first state, the playable disk space resource application manager responds to a disk application request issued by a writing process of data to be flushed, by performing the following steps:
s10, distributing a real disk space, wherein the real disk space is used for storing data to be brushed;
s20, obtaining disk space information of the allocated disk space;
s30, recording the disk space information and the corresponding disk application request; in the recording process, the disk space information of the allocated disk space is recorded in sequence, and when the disk application request is recorded, the parameters in the disk application request are recorded in sequence.
And S40, feeding back disk space information, wherein the fed back disk space information is used for addressing the disk space to store data to be flushed.
Referring to fig. 2, in the second state, the playback-capable disk space resource application manager responds to a disk application request issued by the writing process of the data to be flushed, by performing the following steps:
s100, obtaining disk space information of a disk space where data to be brushed is located;
s200, checking and checking the disk space information of the disk space where the data to be flushed is located by using the parameters in the recorded disk application request in the first state, executing S300 if the checking is passed, and prompting an error and interrupting if the checking is not passed.
S300, feeding back the disk space information recorded in the first state, wherein the fed back disk space information is used for updating the object metadata.
Referring to fig. 3, the method for brushing down the write buffer data in a distributed storage manner according to the present application includes:
s1, reading data stored in the high-speed storage device to determine data to be flushed.
S2, deeply copying object metadata of the data to be brushed to obtain temporary object metadata; deep replication requests new memory for the replicated object metadata so that modifying the memory data of the temporary object metadata does not affect the memory data of the object metadata.
S3, configuring the playback disk space resource application manager to be in a first state. In the implementation process, an interface of the playback-capable disk space resource application manager is called for configuration. And the replayable disk space resource application manager configured in the first state feeds back the disk space information when responding to the disk application request, and records the disk space information and parameters in the corresponding disk application request.
S4, processing the writing process of the data to be flushed by using the temporary object metadata to obtain updated temporary object metadata and disk writing preparation information, wherein the disk writing preparation information comprises disk space information and the data to be flushed, and the disk space information of the disk writing preparation information is fed back from a playback disk space resource application manager; the present process processes the writing process of the data to be flushed through the temporary object metadata, and thus, the temporary object metadata is updated.
In the specific implementation process, disc writing preparation information is sequentially stored in a queue; specifically, one possible queue may be a FIFO queue, where disk write preparation information that first enters the FIFO queue is first asynchronously written, so as to implement sequential processing of the disk write preparation information.
S5, writing the data to be written into a disk space obtained by addressing the disk space information through asynchronous writing according to the content of the disk writing preparation information; in the implementation process, the asynchronous writing carries out corresponding brushing of the data to be flushed according to the sequence of the disk writing preparation information in the queue.
The first write process is completed through the above process, in which the data to be flushed in the high-speed storage device is written into the disk space, and the temporary object metadata is updated.
S6, configuring a playback disk space resource application manager to be in a second state; specifically, in the implementation process, an interface of the playback-capable disk space resource application manager is called for configuration. The replayable disk space resource application manager after being configured into the second state obtains the disk space information of the disk space where the data to be flushed is located when responding to the disk application request; and checking the disk space information of the disk space where the data to be flushed is located by using the parameters in the recorded disk application request in the first state, and feeding back the recorded disk space information in the first state if the checking is passed.
S7, processing the data writing process to be flushed by utilizing the object metadata to obtain and persist the updated object metadata. In the implementation process, the updated object metadata and disk write preparation information are obtained. Since the writing process of the data to be flushed is performed in the first writing process, the resulting disk writing preparation information is discarded.
The three processes of the configuration S1, the configuration S2-S4 and the configuration S6-S7 are mutually exclusive processes. In the specific implementation process, three processes S1, S2-S4 and S6-S7 are set as mutual exclusion processes in a mutual exclusion lock mode.
Detecting whether the metadata of the object is changed or not in the conversion process of the mutual exclusion process; if yes, the flow of the distributed storage write buffer data step-by-step brushing is terminated, and the subsequent flow stages are not executed any more. In distributed storage, operators of object data may have multiple and operate in close time, object metadata changes, and data to be flushed in a high-speed storage device is not up-to-date.
Example 2
Referring to fig. 4, an embodiment of the present application provides a distributed storage write buffer data step-down brushing device, including: the distributed storage write buffer data step-by-step brushing method is realized by the aid of the processing unit, the storage unit, the interface unit, the bus unit and the power supply unit, wherein the bus unit is connected with the processing unit and the interface unit, the power supply unit supplies power to the processing unit, the storage unit, the interface unit and the bus unit, the storage unit stores at least one instruction, and the processing unit reads and executes the instruction.
Example 3
The embodiment of the application provides a medium for realizing a distributed storage write buffer data step-by-step brushing method, which stores at least one instruction, reads and executes the instruction to realize the distributed storage write buffer data step-by-step brushing method.
The application realizes the method of the distributed storage Xie Huancun data by the two writing processes. The first write-in processing is realized by using temporary object metadata, and the function of the first write-in processing is to write the data to be flushed from the high-speed storage device to the disk, and the object metadata of the data to be flushed is not updated; the second writing process is realized through the object metadata, and the disk space information of the disk space for storing the data to be flushed in the first writing process needs to be fed back to finish updating the object metadata; the data to be flushed does not need to be written to the disk during the second write process. Thus, the data under-flushing in the high-speed storage device is divided into two process implementations which can be asynchronous.
The first write process preferentially writes the data to be flushed to the disk, and the second write process updates the object metadata. The priority of service writing is guaranteed, the data writing efficiency is improved through the asynchronism of writing the data to be written and updating the object metadata, the complexity of a program is reduced, and the maintenance is convenient.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The foregoing is only a specific embodiment of the application to enable those skilled in the art to understand or practice the application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (9)
1. A method for a distributed storage write buffer data step-down flush comprising:
s1, reading data stored in high-speed storage equipment to determine data to be flushed;
s2, deeply copying object metadata of the data to be brushed to obtain temporary object metadata;
s3, configuring a playback disk space resource application manager to be in a first state; in a first state, the replayable disk space resource application manager responds to a disk application request, allocates a real disk space, acquires disk space information of the allocated disk space, records the disk space information and a corresponding disk application request, feeds back the disk space information, and uses the fed-back disk space information to address the disk space to store data to be flushed;
s4, processing the writing process of the data to be flushed by using the temporary object metadata to obtain updated temporary object metadata and disk writing preparation information, wherein the disk writing preparation information comprises disk space information and the data information to be flushed;
s5, writing the data to be written into the corresponding disk according to the disk writing preparation information through asynchronous writing;
s6, configuring a playback disk space resource application manager to be in a second state; in the second state, the replayable disk space resource application manager responds to a disk application request, acquires disk space information of the disk space where the data to be flushed is located, checks the disk space information of the disk space where the data to be flushed is located by using parameters in the disk application request recorded in the first state, and feeds back the disk space information in the first state;
s7, processing the data writing process to be flushed by utilizing the object metadata to obtain and persist the updated object metadata.
2. The method for stepwise flushing of write buffered data for distributed storage of claim 1 wherein the writing process of configuring the data to be flushed applies for disk space to a preset playable disk space resource application manager via a disk application request.
3. The method of claim 1, wherein the first state and the second state of the playable disk space resource application manager are configured through an interface; and when the data to be written is written, the first state is configured through the interface, and when the metadata of the object is updated, the second state is configured through the interface.
4. The method of claim 1, wherein the configurations S1, S2-S4, S6-S7 are mutually exclusive procedures.
5. The method for stepwise flushing of write buffered data for distributed storage of claim 4, wherein during the conversion of the exclusive procedure, detecting whether the object metadata is changed; if yes, the flow of the distributed storage write buffer data step-by-step down-flushing is terminated.
6. The method for stepwise flushing of buffered data for distributed storage according to claim 1, wherein the object metadata is used to process the data to be flushed, obtain both updated object metadata and disk write preparation information, discard the obtained disk write preparation information, and persist the updated object metadata.
7. The method for flushing down the buffered data in a distributed storage according to claim 1, wherein the disk write preparation information obtained in S4 is sequentially stored in the queue, and the asynchronous writing performs the flushing of the data to be flushed according to the disk write preparation information stored in the queue.
8. A distributed storage write buffer data step-down swiping device, comprising: the distributed storage write buffer data step-by-step brushing method comprises a processing unit, a storage unit, an interface unit, a bus unit and a power supply unit, wherein the bus unit is connected with the processing unit and the interface unit, the power supply unit supplies power to the processing unit, the storage unit, the interface unit and the bus unit, the storage unit stores at least one instruction, and the processing unit reads and executes the instruction to realize the distributed storage write buffer data step-by-step brushing method according to any one of claims 1-7.
9. A medium for implementing a distributed storage write buffer data step-down method, wherein the medium for implementing the distributed storage write buffer data step-down method stores at least one instruction, and a processor reads and executes the instruction to implement the distributed storage write buffer data step-down method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111338442.3A CN114153385B (en) | 2021-11-12 | 2021-11-12 | Distributed storage write buffer data step-by-step brushing method, device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111338442.3A CN114153385B (en) | 2021-11-12 | 2021-11-12 | Distributed storage write buffer data step-by-step brushing method, device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114153385A CN114153385A (en) | 2022-03-08 |
| CN114153385B true CN114153385B (en) | 2023-08-29 |
Family
ID=80460198
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111338442.3A Active CN114153385B (en) | 2021-11-12 | 2021-11-12 | Distributed storage write buffer data step-by-step brushing method, device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114153385B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109831540A (en) * | 2019-04-12 | 2019-05-31 | 成都四方伟业软件股份有限公司 | Distributed storage method, device, electronic equipment and storage medium |
| CN111104254A (en) * | 2019-11-29 | 2020-05-05 | 北京浪潮数据技术有限公司 | Storage system data flashing method, device, equipment and readable storage medium |
| CN111506253A (en) * | 2019-01-31 | 2020-08-07 | 阿里巴巴集团控股有限公司 | Distributed storage system and storage method thereof |
| CN111736767A (en) * | 2020-05-29 | 2020-10-02 | 苏州浪潮智能科技有限公司 | Method and equipment for writing cache of distributed object storage system |
| CN113419670A (en) * | 2021-03-31 | 2021-09-21 | 阿里巴巴新加坡控股有限公司 | Data writing processing method and device and electronic equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104679772B (en) * | 2013-11-29 | 2019-01-25 | 深圳市腾讯计算机系统有限公司 | Method, apparatus, equipment and the system of file are deleted in Distributed Data Warehouse |
-
2021
- 2021-11-12 CN CN202111338442.3A patent/CN114153385B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111506253A (en) * | 2019-01-31 | 2020-08-07 | 阿里巴巴集团控股有限公司 | Distributed storage system and storage method thereof |
| CN109831540A (en) * | 2019-04-12 | 2019-05-31 | 成都四方伟业软件股份有限公司 | Distributed storage method, device, electronic equipment and storage medium |
| CN111104254A (en) * | 2019-11-29 | 2020-05-05 | 北京浪潮数据技术有限公司 | Storage system data flashing method, device, equipment and readable storage medium |
| CN111736767A (en) * | 2020-05-29 | 2020-10-02 | 苏州浪潮智能科技有限公司 | Method and equipment for writing cache of distributed object storage system |
| CN113419670A (en) * | 2021-03-31 | 2021-09-21 | 阿里巴巴新加坡控股有限公司 | Data writing processing method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114153385A (en) | 2022-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101624376B1 (en) | Converting luns into files or files into luns in real time | |
| CN111708738B (en) | Method and system for realizing interaction of hadoop file system hdfs and object storage s3 data | |
| JPH10187505A (en) | Information storage system and data arranging method applied to the system | |
| CN109271098B (en) | Data migration method and device | |
| JP2005501317A (en) | External data storage management system and method | |
| US8527559B2 (en) | Garbage collector with concurrent flipping without read barrier and without verifying copying | |
| CN109582686B (en) | Method, device, system and application for ensuring consistency of distributed metadata management | |
| CN109491605A (en) | A kind of date storage method based on COW, device and medium | |
| CN110032543A (en) | A kind of management method of storage file system | |
| US8145604B2 (en) | Method and apparatus for relocating an active five system journal | |
| JP6069962B2 (en) | Information processing apparatus, area release control program, and area release control method | |
| JP4461089B2 (en) | Storage control apparatus and storage control method | |
| CN114153385B (en) | Distributed storage write buffer data step-by-step brushing method, device and medium | |
| US20120209891A1 (en) | Database management method, database management system and database management program | |
| JP2005128771A (en) | Data file system, data access server, and data access program | |
| KR100981064B1 (en) | A method to maintain software raid consistency using journaling file system | |
| US20130031320A1 (en) | Control device, control method and storage apparatus | |
| JP3882461B2 (en) | Storage device system and backup acquisition method thereof | |
| US20070061530A1 (en) | Method for storage of digital data in a mainframe data center and associated device | |
| CN113204520A (en) | Remote sensing data rapid concurrent read-write method based on distributed file system | |
| CN112732195A (en) | Method, system, equipment and medium for online takeover of heterogeneous storage volume | |
| KR20190069134A (en) | Apparatus and method for file sharing between applications | |
| US8549221B2 (en) | RAID management apparatus, RAID management method, and computer product | |
| US20210034580A1 (en) | Method, apparatus and computer program product for maintaining metadata | |
| US9110812B2 (en) | Virtual tape device and control method of virtual tape device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |