CN114153385A - Distributed storage write buffer data step-by-step flushing method, device and medium - Google Patents
Distributed storage write buffer data step-by-step flushing method, device and medium Download PDFInfo
- Publication number
- CN114153385A CN114153385A CN202111338442.3A CN202111338442A CN114153385A CN 114153385 A CN114153385 A CN 114153385A CN 202111338442 A CN202111338442 A CN 202111338442A CN 114153385 A CN114153385 A CN 114153385A
- Authority
- CN
- China
- Prior art keywords
- data
- disk
- object metadata
- disk space
- writing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 126
- 238000011010 flushing procedure Methods 0.000 title claims abstract description 31
- 230000008569 process Effects 0.000 claims abstract description 82
- 238000012545 processing Methods 0.000 claims abstract description 32
- 238000002360 preparation method Methods 0.000 claims abstract description 26
- 230000007717 exclusion Effects 0.000 claims description 9
- 230000001680 brushing effect Effects 0.000 claims description 8
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000002085 persistent effect Effects 0.000 claims description 3
- 238000012423 maintenance Methods 0.000 abstract description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to a distributed storage write buffer data step-by-step flushing method, a device and a medium. The method includes the steps that object metadata of data to be refreshed are deeply copied to generate temporary object metadata, the writing process of the data to be refreshed is processed by the aid of the temporary object metadata, disk space information of a disk space for storing the data to be refreshed is obtained, and disk writing preparation information is formed; then writing the data to be refreshed into a slow disk according to the disk writing preparation information, wherein compared with the conventional means, the process does not update the object metadata and only writes the data to be refreshed; and after the writing is finished, processing the writing process of the data to be refreshed again by using the object metadata, and finishing the updating of the object metadata. The method and the device realize the asynchronization of data writing and object metadata updating in the process of downloading the data to be downloaded, ensure the priority of service writing, improve the efficiency of downloading the data, do not need to record and update the object metadata, reduce the complexity of a program and facilitate maintenance.
Description
Technical Field
The present application relates to the field of buffer flushing technologies, and in particular, to a method, an apparatus, and a medium for distributed storage write buffer data step-by-step flushing.
Background
In distributed storage, a high-speed device is generally used as a write buffer to improve the write performance of the system, the high-speed device has strong read-write performance and can read and write quickly, but has limited capacity, data written to the high-speed device needs to be printed on a slow-speed device, and then the printed data can be released from the high-speed device, so that the high-speed device can continuously accept write requests, and the system performance is improved.
The buffer data refreshing process on the high-speed device relates to the transfer of the buffer data and the updating of corresponding object metadata, the buffer data needs to be read from the high-speed device and written into the slow-speed device, and meanwhile, the object metadata recording the data position information also needs to be updated so as to correctly reflect the position of the device where the data is located. In order to ensure the consistency of data, the flushing process of the buffered data and the service writing process need to keep mutual exclusion, that is, only one process can write corresponding data parts at the same time. When the buffer data flushing process is realized, one mode is that all flushing steps are completed in one stage, and because the slow device writing process is included, the one-time flushing process consumes long time, and service writing is blocked. The other mode is that the steps of the lower brushing are distributed into a plurality of stages to be completed, and each stage is mutually exclusive, so that the long-time blocking of the service writing is avoided, the service writing can be prioritized, and the service processing performance is improved. In the implementation of the down-flushing by stages and steps, one implementation mode is to identify data information to be written, record update information of object metadata, execute data writing, and finally update the recorded update information of the object metadata to the object metadata and carry out persistence.
Disclosure of Invention
In order to solve the technical problems or at least partially solve the technical problems, the application provides a distributed storage write buffer data step-by-step flushing method, device and medium.
In a first aspect, the present application provides a distributed storage write buffer data step-by-step flushing method, including:
s1, reading the data stored in the high-speed storage device to determine the data to be brushed;
s2, deeply copying the object metadata of the data to be refreshed to obtain temporary object metadata;
s3, configuring the playable disk space resource application manager as a first state;
s4, processing the writing process of the data to be refreshed by using the temporary object metadata to obtain updated temporary object metadata and disk writing preparation information, wherein the disk writing preparation information comprises disk space information and data information to be refreshed;
s5, writing the data to be refreshed into the corresponding disk according to the disk writing preparation information through asynchronous writing;
s6, configuring the playable disk space resource application manager as a second state;
and S7, processing the write process of the data to be refreshed by using the object metadata, and obtaining and persisting the updated object metadata.
Furthermore, the writing process configuring the data to be flushed applies for the disk space from the preset playable disk space resource application manager through the disk application request.
Furthermore, the first state and the second state of the playable disk space resource application manager are configured through an interface, the first state is configured through the interface when writing data to be flushed, and the second state is configured through the interface when updating object metadata.
Furthermore, in the first state, the playable disk space resource application manager responds to the disk application request, allocates a real disk space, acquires disk space information of the allocated disk space, and records the disk space information and the corresponding disk application request;
and in the second state, the playable disk space resource manager responds to the disk application request, acquires the disk space information of the disk space where the data to be refreshed are located, checks and checks the disk space information of the disk space where the data to be refreshed are located by using the parameters in the disk application request recorded in the first state, and feeds back the disk space information in the first state.
Furthermore, mutual exclusion is performed among the configuration S1, S2-S4, S6-S7.
Furthermore, in the mutual exclusion process conversion process, whether the object metadata is changed is detected; if so, terminating the flow of the distributed storage write buffer data step-by-step brushing.
Furthermore, the writing process of the data to be refreshed is processed by using the object metadata, so that updated object metadata and disk writing preparation information are obtained, the obtained disk writing preparation information is discarded, and the updated object metadata is persisted.
Further, the disk write preparation information obtained in S4 is sequentially stored in the queue, and the asynchronous write performs the flushing of the data to be flushed according to the disk write preparation information stored in the queue.
In a second aspect, the present application provides a distributed storage write buffer data step-by-step flushing apparatus, including: the distributed storage write buffer data step-by-step refreshing method comprises a processing unit, a storage unit, an interface unit, a bus unit and a power supply unit, wherein the bus unit is connected with the processing unit and the interface unit, the power supply unit supplies power to the processing unit, the storage unit, the interface unit and the bus unit, the storage unit stores at least one instruction, and the processing unit reads and executes the instruction to achieve the distributed storage write buffer data step-by-step refreshing method.
In a third aspect, the present application provides a medium for implementing a distributed storage write buffer data step-by-step flushing method, where the medium for implementing the distributed storage write buffer data step-by-step flushing method stores at least one instruction, and reads and executes the instruction to implement the distributed storage write buffer data step-by-step flushing method.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages:
the distributed memory credit cache data step-by-step downloading method is realized through two writing processing processes. The first writing processing process is realized by using temporary object metadata, and the effect of the first writing processing process is to write the data to be refreshed onto a magnetic disk from high-speed storage equipment, and the object metadata of the data to be refreshed are not updated; the second writing process is realized through the object metadata, and the updating of the object metadata is completed by feeding back the disk space information of the disk space for storing the data to be refreshed in the first writing process; the data to be flushed need not be written to the disk during the second write process. Therefore, the data in the high-speed storage device is divided into two asynchronous processes to be realized.
The first writing process preferentially writes the data to be refreshed into the disk, and the second writing process updates the object metadata. The priority of the service writing is ensured, the data writing efficiency is improved through the asynchronization of the data writing to be refreshed and the object metadata updating, the complexity of the program is reduced, and the maintenance is convenient.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1 is a flowchart of a playable disk space resource application manager in a first state responding to a disk application request issued by a write process of data to be flushed according to an embodiment of the present application;
FIG. 2 is a flowchart of a playable disk space resource application manager in a second state responding to a disk application request issued by a write process of data to be flushed according to an embodiment of the present disclosure;
FIG. 3 is a flowchart of a distributed storage write buffer data step-by-step flushing method according to an embodiment of the present application;
fig. 4 is a schematic diagram of a distributed storage write buffer data stepping flushing apparatus according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Example 1
The embodiment of the application provides a distributed storage write buffer data step-by-step refreshing method. The distributed memory credit cache data step-by-step downloading method is realized through two writing processing processes. The first writing processing process is realized by using temporary object metadata, and the effect of the first writing processing process is to write the data to be refreshed onto a disk from high-speed storage equipment, and the object metadata of the data to be refreshed are not updated; the second writing process is realized through the object metadata, the disk space information of the disk space storing the data to be refreshed in the first writing process needs to be fed back, and the object metadata is updated through the fed-back disk space information; the data to be flushed need not be written to the disk during the second write process. The method and the device realize that the data in the high-speed storage device is refreshed into two asynchronous processes.
In the existing resource management mechanism of data writing, the second writing process cannot repeatedly apply to obtain the disk space for storing the data to be refreshed in the first writing process, so that in order to realize the method, a playable disk space resource application manager is created, and the writing process for configuring the data to be refreshed sends a disk application request to the playable disk space resource application manager.
In a specific implementation process, the playable disk space resource application manager comprises a first state and a second state, the first state and the second state of the playable disk space resource application manager are configured through an interface, the first state is configured through the interface when data to be refreshed is written, and the second state is configured through the interface when object metadata is updated.
Referring to fig. 1, in a first state, the playable disk space resource application manager performs the following steps in response to a disk application request issued by a write process of data to be flushed:
s10, distributing real disk space for storing the data to be refreshed;
s20, acquiring the disk space information of the distributed disk space;
s30, recording the disk space information and the corresponding disk application request; and in the recording process, sequentially recording the disk space information of the distributed disk space, and when recording a disk application request, sequentially recording parameters in the disk application request.
And S40, feeding back disk space information, wherein the fed back disk space information is used for addressing disk space to store the data to be brushed.
Referring to fig. 2, in the second state, the playable disk space resource manager performs the following steps in response to a disk application request issued by a write process of the data to be flushed:
s100, acquiring disk space information of a disk space where data to be refreshed are located;
s200, checking and checking the disk space information of the disk space where the data to be brushed off is located by using the parameters in the disk application request recorded in the first state, executing S300 if the checking is passed, and prompting an error and interrupting if the checking is not passed.
And S300, feeding back the disk space information recorded in the first state, wherein the fed back disk space information is used for updating the object metadata.
Referring to fig. 3, the distributed storage write buffer data step-by-step flushing method according to the present application includes:
and S1, reading the data stored in the high-speed storage device to determine the data to be brushed.
S2, deeply copying the object metadata of the data to be refreshed to obtain temporary object metadata; the deep replication requests a new memory for storing the replicated object metadata, so that the memory data of the temporary object metadata is not affected by modifying the memory data of the temporary object metadata.
S3, the playable disk space resource application manager is configured to be in a first state. In the specific implementation process, an interface of the playable disk space resource application manager is called for configuration. And the playable disk space resource application manager configured in the first state feeds back the disk space information and records the disk space information and parameters in the corresponding disk application request when responding to the disk application request.
S4, processing the writing process of the data to be refreshed by using the temporary object metadata to obtain updated temporary object metadata and disk writing preparation information, wherein the disk writing preparation information comprises disk space information and data information to be refreshed, and the disk space information of the disk writing preparation information comes from the feedback of the playable disk space resource application manager; the process handles the write process of the data to be flushed by the temporary object metadata, and therefore, the temporary object metadata is updated.
In the specific implementation process, the disk writing preparation information is sequentially stored in the queue; specifically, one possible queue may be an FIFO queue, and the disk write preparation information that enters the FIFO queue first is asynchronously written first, so that the disk write preparation information is sequentially processed.
S5, writing the data to be refreshed into the disk space obtained by addressing the disk space information through asynchronous writing according to the content of the disk writing preparation information; in the specific implementation process, the asynchronous writing carries out the corresponding brushing of the data to be brushed according to the sequence of the disk writing preparation information in the queue.
The first write processing process is completed through the above process, and in the first write processing process, the data to be flushed in the high-speed storage device is written into the disk space, and the temporary object metadata is updated.
S6, configuring the playable disk space resource application manager as a second state; specifically, in the specific implementation process, an interface of the playback-capable disk space resource application manager is called for configuration. When the playable disk space resource application manager configured in the second state responds to the disk application request, disk space information of a disk space where data to be refreshed are located is obtained; and checking the disk space information of the disk space where the data to be refreshed is located by using the parameters in the disk application request recorded in the first state, and feeding back the disk space information recorded in the first state if the checking is passed.
And S7, processing the write process of the data to be refreshed by using the object metadata, and obtaining and persisting the updated object metadata. In the specific implementation process, the updated object metadata and disk write preparation information are obtained in the process. Since the write process of the data to be flushed is realized in the first write process, the resulting disk write preparation information is discarded.
Configuring mutual exclusion processes among the three processes S1, S2-S4 and S6-S7. In the specific implementation process, three processes of S1, S2-S4 and S6-S7 are set as mutual exclusion processes in a mutual exclusion lock mode.
Detecting whether the metadata of the object is changed or not in the process of mutual exclusion process conversion; if so, terminating the flow of the distributed storage write buffer data step-by-step flushing, and not executing the subsequent flow stage. In distributed storage, there may be multiple operators of object data and operations are performed in close time, the object metadata changes, and the data to be flushed in the high-speed storage device is not up-to-date.
Example 2
Referring to fig. 4, an embodiment of the present application provides a distributed storage write buffer data step-by-step flushing apparatus, including: the distributed storage write buffer data step-by-step refreshing method comprises a processing unit, a storage unit, an interface unit, a bus unit and a power supply unit, wherein the bus unit is connected with the processing unit and the interface unit, the power supply unit supplies power to the processing unit, the storage unit, the interface unit and the bus unit, the storage unit stores at least one instruction, and the processing unit reads and executes the instruction to achieve the distributed storage write buffer data step-by-step refreshing method.
Example 3
The embodiment of the application provides a medium for realizing a distributed storage write buffer data step-by-step flushing method, wherein the medium for realizing the distributed storage write buffer data step-by-step flushing method stores at least one instruction, and reads and executes the instruction to realize the distributed storage write buffer data step-by-step flushing method.
The distributed memory credit cache data step-by-step downloading method is realized through two writing processing processes. The first writing processing process is realized by using temporary object metadata, and the effect of the first writing processing process is to write the data to be refreshed onto a magnetic disk from high-speed storage equipment, and the object metadata of the data to be refreshed are not updated; the second writing process is realized through the object metadata, and the updating of the object metadata is completed by feeding back the disk space information of the disk space for storing the data to be refreshed in the first writing process; the data to be flushed need not be written to the disk during the second write process. Therefore, the data in the high-speed storage device is divided into two asynchronous processes to be realized.
The first writing process preferentially writes the data to be refreshed into the disk, and the second writing process updates the object metadata. The priority of the service writing is ensured, the data writing efficiency is improved through the asynchronization of the data writing to be refreshed and the object metadata updating, the complexity of the program is reduced, and the maintenance is convenient.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A distributed storage write buffer data step-by-step brushing method is characterized by comprising the following steps:
s1, reading the data stored in the high-speed storage device to determine the data to be brushed;
s2, deeply copying the object metadata of the data to be refreshed to obtain temporary object metadata;
s3, configuring the playable disk space resource application manager as a first state;
s4, processing the writing process of the data to be refreshed by using the temporary object metadata to obtain updated temporary object metadata and disk writing preparation information, wherein the disk writing preparation information comprises disk space information and data information to be refreshed;
s5, writing the data to be refreshed into the corresponding disk according to the disk writing preparation information through asynchronous writing;
s6, configuring the playable disk space resource application manager as a second state;
and S7, processing the write process of the data to be refreshed by using the object metadata, and obtaining and persisting the updated object metadata.
2. The method for stepping down the write buffer data stored in the distributed storage according to claim 1, wherein the write process configuring the data to be down-brushed applies for the disk space from a preset playable disk space resource application manager through a disk application request.
3. The distributed storage write buffer data stepping brushing method according to claim 1, wherein the first state and the second state of the playable disk space resource application manager are configured through an interface; when writing data to be refreshed, the interface is configured to be in a first state, and when updating the object metadata, the interface is configured to be in a second state.
4. The distributed storage write buffer data step-by-step flushing method as claimed in claim 1, wherein in the first state, the playable disk space resource application manager responds to the disk application request, allocates a real disk space, obtains disk space information of the allocated disk space, and records the disk space information with the corresponding disk application request;
and in the second state, the playable disk space resource manager responds to the disk application request, acquires the disk space information of the disk space where the data to be refreshed are located, checks and checks the disk space information of the disk space where the data to be refreshed are located by using the parameters in the disk application request recorded in the first state, and feeds back the disk space information in the first state.
5. The distributed storage write buffer data stepping and brushing method according to claim 1, wherein mutual exclusion procedures are configured among S1, S2-S4, S6-S7.
6. The distributed storage write buffer data step-by-step flushing method as claimed in claim 4, wherein in the mutual exclusion process conversion process, it is detected whether the object metadata is changed; if so, terminating the flow of the distributed storage write buffer data step-by-step brushing.
7. The distributed storage write buffer data step-by-step flushing method of claim 1, wherein a data write process to be flushed is processed by using object metadata, so that updated object metadata and disk write preparation information are obtained, the obtained disk write preparation information is discarded, and the updated object metadata is persisted.
8. The method for stepping down the write-buffered data stored in the distributed storage according to claim 1, wherein the disk write preparation information obtained in S4 is sequentially stored in the queue, and the asynchronous write performs the data to be refreshed according to the disk write preparation information stored in the queue.
9. The utility model provides a distributed storage write buffer data device of brushing down step, its characterized in that includes: the distributed storage write buffer data step-by-step refreshing method comprises a processing unit, a storage unit, an interface unit, a bus unit and a power supply unit, wherein the bus unit is connected with the processing unit and the interface unit, the power supply unit supplies power to the processing unit, the storage unit, the interface unit and the bus unit, the storage unit stores at least one instruction, and the processing unit reads and executes the instruction to achieve the distributed storage write buffer data step-by-step refreshing method according to any one of claims 1 to 8.
10. A medium for implementing the distributed storage write buffer data step-by-step flushing method, wherein the medium for implementing the distributed storage write buffer data step-by-step flushing method stores at least one instruction, reads and executes the instruction to implement the distributed storage write buffer data step-by-step flushing method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111338442.3A CN114153385B (en) | 2021-11-12 | 2021-11-12 | Distributed storage write buffer data step-by-step brushing method, device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111338442.3A CN114153385B (en) | 2021-11-12 | 2021-11-12 | Distributed storage write buffer data step-by-step brushing method, device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114153385A true CN114153385A (en) | 2022-03-08 |
| CN114153385B CN114153385B (en) | 2023-08-29 |
Family
ID=80460198
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111338442.3A Active CN114153385B (en) | 2021-11-12 | 2021-11-12 | Distributed storage write buffer data step-by-step brushing method, device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114153385B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160253362A1 (en) * | 2013-11-29 | 2016-09-01 | Tencent Technology (Shenzhen) Company Limited | Method, device, node and system for managing file in distributed data warehouse |
| CN109831540A (en) * | 2019-04-12 | 2019-05-31 | 成都四方伟业软件股份有限公司 | Distributed storage method, device, electronic equipment and storage medium |
| CN111104254A (en) * | 2019-11-29 | 2020-05-05 | 北京浪潮数据技术有限公司 | Storage system data flashing method, device, equipment and readable storage medium |
| CN111506253A (en) * | 2019-01-31 | 2020-08-07 | 阿里巴巴集团控股有限公司 | Distributed storage system and storage method thereof |
| CN111736767A (en) * | 2020-05-29 | 2020-10-02 | 苏州浪潮智能科技有限公司 | Method and equipment for writing cache of distributed object storage system |
| CN113419670A (en) * | 2021-03-31 | 2021-09-21 | 阿里巴巴新加坡控股有限公司 | Data writing processing method and device and electronic equipment |
-
2021
- 2021-11-12 CN CN202111338442.3A patent/CN114153385B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160253362A1 (en) * | 2013-11-29 | 2016-09-01 | Tencent Technology (Shenzhen) Company Limited | Method, device, node and system for managing file in distributed data warehouse |
| CN111506253A (en) * | 2019-01-31 | 2020-08-07 | 阿里巴巴集团控股有限公司 | Distributed storage system and storage method thereof |
| CN109831540A (en) * | 2019-04-12 | 2019-05-31 | 成都四方伟业软件股份有限公司 | Distributed storage method, device, electronic equipment and storage medium |
| CN111104254A (en) * | 2019-11-29 | 2020-05-05 | 北京浪潮数据技术有限公司 | Storage system data flashing method, device, equipment and readable storage medium |
| CN111736767A (en) * | 2020-05-29 | 2020-10-02 | 苏州浪潮智能科技有限公司 | Method and equipment for writing cache of distributed object storage system |
| CN113419670A (en) * | 2021-03-31 | 2021-09-21 | 阿里巴巴新加坡控股有限公司 | Data writing processing method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114153385B (en) | 2023-08-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5647203B2 (en) | Memory page management | |
| CN111880751B (en) | Hard disk migration method, distributed storage cluster system and storage medium | |
| CN111708738B (en) | Method and system for realizing interaction of hadoop file system hdfs and object storage s3 data | |
| JPH10187505A (en) | Information storage system and data arranging method applied to the system | |
| CN109582686B (en) | Method, device, system and application for ensuring consistency of distributed metadata management | |
| CN110019083A (en) | Storage method, device, electronic equipment and the storage medium of distributed file system | |
| JP6069962B2 (en) | Information processing apparatus, area release control program, and area release control method | |
| CN114153385A (en) | Distributed storage write buffer data step-by-step flushing method, device and medium | |
| JP3882461B2 (en) | Storage device system and backup acquisition method thereof | |
| US20070061530A1 (en) | Method for storage of digital data in a mainframe data center and associated device | |
| CN112286448B (en) | Object access method and device, electronic equipment and machine-readable storage medium | |
| JPH1153123A (en) | Backup system | |
| CN112860188A (en) | Data migration method, system, device and medium | |
| KR20190069134A (en) | Apparatus and method for file sharing between applications | |
| JP2856003B2 (en) | Asynchronous data input / output method | |
| US20070260816A1 (en) | RAID management apparatus, RAID management method, and computer product | |
| JP2574537B2 (en) | Process management equipment | |
| JP2641399B2 (en) | File management device | |
| JPS5947341B2 (en) | Dynamic exclusive control method for index sequential files | |
| JP4131579B2 (en) | Data management system and data management method | |
| US20070300026A1 (en) | Synchronous backup device and method used for storage device | |
| JP2003150394A (en) | Method for managing memory | |
| TWI323414B (en) | A method for generating snapshots | |
| CN116595100A (en) | Capacity expansion method for distributed database | |
| JP2512948B2 (en) | Data processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |