CN110780819A - Data read-write method of distributed storage system - Google Patents
Data read-write method of distributed storage system Download PDFInfo
- Publication number
- CN110780819A CN110780819A CN201911025181.2A CN201911025181A CN110780819A CN 110780819 A CN110780819 A CN 110780819A CN 201911025181 A CN201911025181 A CN 201911025181A CN 110780819 A CN110780819 A CN 110780819A
- Authority
- CN
- China
- Prior art keywords
- target
- osd
- request
- homing group
- identification information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000004422 calculation algorithm Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 10
- 238000004364 calculation method Methods 0.000 abstract description 6
- 239000002699 waste material Substances 0.000 abstract description 4
- 238000013507 mapping Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000009191 jumping Effects 0.000 description 2
- 241001362551 Samba Species 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a data read-write method, a data read-write device, a storage server and a readable storage medium of a distributed storage system, wherein the scheme comprises the following steps: obtaining an IO request, wherein the IO request comprises identification information of a target object; determining a target homing group according to the identification information of the target object; and determining a target OSD corresponding to the target homing group in a pre-established cache file, and sending the IO request to the target OSD to realize data reading and writing. Therefore, the corresponding relation between the object homing group and the OSD is cached in the cache file, so that the object OSD corresponding to the object homing group does not need to be determined through complicated calculation in the data reading and writing process, the waste of system CPU resources in an IO path is reduced, and the IO delay can be greatly reduced.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a data reading and writing method and apparatus for a distributed storage system, a storage server, and a readable storage medium.
Background
With the rapid development of cloud computing technology, the performance and reliability requirements of the industry on distributed storage are higher and higher. In the current distributed storage system, when a client reads and writes an object, a homing group needs to be calculated according to an object name, then members of the homing group need to be calculated, but hash calculation needs to be called through multilayer circulation and recursion when the members of the homing group are calculated, so that system CPU resources are greatly wasted, and the delay of front-end IO is increased.
Therefore, how to provide a data reading and writing method in a distributed storage system to avoid the influence of the data reading and writing process on the front-end IO delay is a problem to be solved by those skilled in the art.
Disclosure of Invention
The application aims to provide a data reading and writing method and device of a distributed storage system, a storage server and a readable storage medium, and aims to solve the problem that the traditional data reading and writing scheme occupies more system CPU resources in the data reading and writing process, so that the front-end IO delay is increased.
The specific scheme is as follows:
in a first aspect, the present application provides a data read-write method for a distributed storage system, which is applied to a Ceph client, and includes:
obtaining an IO request, wherein the IO request comprises identification information of a target object;
determining a target homing group according to the identification information of the target object;
and determining a target OSD corresponding to the target homing group in a pre-established cache file, and sending the IO request to the target OSD to realize data reading and writing.
Preferably, the determining a target OSD corresponding to the target homing group in a pre-created cache file and sending the IO request to the target OSD includes:
judging whether the target homing group exists in a pre-established cache file or not;
if yes, determining a target OSD corresponding to the target homing group in the cache file, and sending the IO request to the target OSD;
if not, calculating a target OSD corresponding to the target homing group according to a flush algorithm, sending the IO request to the target OSD, and recording the corresponding relation between the target homing group and the target OSD in the cache file.
Preferably, the calculating the target OSD corresponding to the target homing group according to the scrub algorithm includes:
and calculating an OSD group corresponding to the target homing group according to a flush algorithm, and taking a main OSD in the OSD group as a target OSD.
Preferably, the determining a target homing group according to the identification information of the target object includes:
and performing a modulo operation on the hash value of the identification information of the target object to obtain the identification information of the target homing group.
Preferably, before the obtaining the IO request, the method further includes:
acquiring a file to be written, segmenting the file to be written into a plurality of target objects according to the size of a preset object, and determining identification information of each target object; and generating an IO request carrying the identification information of the target object.
Preferably, the determining the target OSD corresponding to the target group in the pre-created cache file includes:
and determining a target OSD corresponding to the target homing group in a pre-established cache list.
Preferably, before the determining the target OSD corresponding to the target group in the pre-created cache file, the method further includes:
and if the OSD map is detected to be changed, initializing a pre-created cache file.
In a second aspect, the present application provides a data read/write apparatus for a distributed storage system, which is applied to a Ceph client, and includes:
a request acquisition module: the method comprises the steps of obtaining an IO request, wherein the IO request comprises identification information of a target object;
a homing group determination module: the target object storage unit is used for determining a target homing group according to the identification information of the target object;
a request sending module: and the IO request is sent to the target OSD to realize data reading and writing.
In a third aspect, the present application provides a storage server of a distributed storage system, including:
a memory: for storing a computer program;
a processor: for executing the computer program to implement the steps of the data reading and writing method of the distributed storage system as described above.
In a fourth aspect, the present application provides a readable storage medium, on which a computer program is stored, which, when being executed by a processor, is configured to implement the steps of the data reading and writing method of the distributed storage system as described above.
The scheme of the data read-write method, the data read-write device, the storage server and the readable storage medium of the distributed storage system provided by the application comprises the following steps: obtaining an IO request, wherein the IO request comprises identification information of a target object; determining a target homing group according to the identification information of the target object; and determining a target OSD corresponding to the target homing group in a pre-established cache file, and sending the IO request to the target OSD to realize data reading and writing. Therefore, the corresponding relation between the object homing group and the OSD is cached in the cache file, so that the object OSD corresponding to the object homing group does not need to be determined through complicated calculation in the data reading and writing process, the waste of system CPU resources in an IO path is reduced, and the IO delay can be greatly reduced.
Drawings
For a clearer explanation of the embodiments or technical solutions of the prior art of the present application, the drawings needed for the description of the embodiments or prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a flowchart illustrating a first implementation of a data reading and writing method of a distributed storage system according to an embodiment of the present disclosure;
fig. 2 is a flowchart illustrating a second implementation of a data reading and writing method of a distributed storage system according to an embodiment of the present disclosure;
fig. 3 is a functional block diagram of an embodiment of a data reading/writing apparatus of a distributed storage system provided in the present application;
fig. 4 is a schematic structural diagram of an embodiment of a storage server of a distributed storage system provided in the present application.
Detailed Description
The core of the application is to provide a data reading and writing method and device of a distributed storage system, a storage server and a readable storage medium, which reduce the waste of system CPU resources in the data reading and writing process and can greatly reduce IO delay.
In order that those skilled in the art will better understand the disclosure, the following detailed description will be given with reference to the accompanying drawings. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, a first embodiment of a data reading and writing method of a distributed storage system provided in the present application is described below, where the first embodiment includes:
s101, an IO request is obtained, wherein the IO request comprises identification information of a target object;
s102, determining a target homing group according to the identification information of the target object;
s103, determining a target OSD corresponding to the target homing group in a pre-established cache file, and sending the IO request to the target OSD to realize data reading and writing.
The embodiment is applied to a Ceph client, where the client refers to a service process accessing a cluster, for nas scenes, refer to nfsserver and samba, a corresponding block scene refers to tgt process, and a corresponding object scene refers to rgw.
In Ceph, no matter what storage method (object, block, file system) is used, data is segmented into a plurality of objects (objects), and a place Group (PG for short) is used for logically grouping the objects, so that unified management and efficiency improvement are achieved. An OSD (Object Storage Device) is used to provide Storage resources, and each disk, SSD, RAID group, or partition may become an OSD. Specifically, when data is written, a file is divided into a plurality of objects, and the objects are mapped to a home group first and then mapped to an OSD group by the home group. The object and the homing group are in one-to-many mapping relation, and the homing group and the OSD are in many-to-many mapping relation. It should be noted that the target OSD in this embodiment refers to a main OSD in the OSD group, i.e., an OSD capable of performing data read/write operations.
The IO request of this embodiment includes identification information of a target object, and specifically, when the IO request is a read request, the IO request mainly includes information of the identification information of the target object, offset of the object read request, and a length to be read; when the IO request is a write request, the information mainly included is identification information of a target object, offset of the object write request, length of data to be written, and content of the data to be written. After receiving the IO request, the Ceph client first calculates a target homing group to which the target object is mapped according to identification information of the target object carried in the IO request, calculates a hash value of the identification information of the target object as a specific implementation manner, and obtains a homing group corresponding to the target object by modulo.
Then, in general, a CRUSH algorithm (distributed selection algorithm for data storage) is used to calculate the target OSD to which the target homing group is mapped. However, in this embodiment, a cache file is preset, and the cache file is used for recording a mapping relationship between the configuration group and the OSD, so that after the target homing group is determined, the corresponding target OSD is not required to be calculated through a cumbersome CRUSH algorithm, and the target OSD can be directly determined only by querying the cache file, so that the IO request is forwarded to the target OSD, and a cumbersome calculation process is avoided.
Specifically, after the target homing group is determined, firstly inquiring a cache file, judging whether a mapping relation between the target homing group and the OSD is recorded in the cache file, and if so, determining the target OSD corresponding to the target homing group; otherwise, calculating the target OSD corresponding to the target homing group by using a CRUSH algorithm. Wherein the CRUSH algorithm is used to calculate the location where the object should be written or read.
The embodiment provides a data read-write method of a distributed storage system, and the scheme includes: obtaining an IO request, wherein the IO request comprises identification information of a target object; determining a target homing group according to the identification information of the target object; and determining a target OSD corresponding to the target homing group in a pre-established cache file, and sending the IO request to the target OSD to realize data reading and writing. Therefore, the corresponding relation between the object homing group and the OSD is cached in the cache file, so that the object OSD corresponding to the object homing group does not need to be determined through complicated calculation in the data reading and writing process, the waste of system CPU resources in an IO path is reduced, and the IO delay can be greatly reduced.
The second embodiment of the data reading and writing method for the distributed storage system provided by the present application is described in detail below, and the second embodiment is implemented based on the first embodiment and is expanded to a certain extent on the basis of the first embodiment.
Specifically, in the present embodiment, the mapping relationship between the group and the OSD is recorded in a list form, and the present embodiment takes a data writing scene as an example for description. Referring to fig. 2, the second embodiment is applied to a Ceph client, and specifically includes:
s201, acquiring a file to be written, segmenting the file to be written into a plurality of target objects according to the size of a preset object, and determining identification information of each target object; generating an IO request carrying identification information of the target object;
the preset object size is adjusted according to actual requirements, and is usually 2M or 4M. The objects obtained by splitting all have unique identification information, and generally consist of File ID of the File to be written and the numbers of the fragments.
S202, an IO request is obtained, wherein the IO request comprises identification information of a target object;
s203, carrying out a modulo operation on the hash value of the identification information of the target object to obtain the identification information of the target homing group;
s204, judging whether the target homing group exists in a pre-established cache list or not; if yes, jumping to S205, otherwise jumping to S206;
in this embodiment, the identification information of the PG is similar to 1.0, 1.1, and 1.2, and the cache list may be implemented in a code by using a map structure, which includes the following specific contents:
[1.0,[1,2,3]]
[1.1,[2,5,3]]
[1.2,[3,6,8]]
.
.
.
[1.5,[6,7,9]]
wherein [1,2,3] behind the identification information of each homing group is the identification information of the OSD corresponding to the homing group.
S205, determining a target OSD corresponding to the target homing group in the cache list;
s206, calculating an OSD group corresponding to the target homing group according to a flush algorithm, taking a main OSD in the OSD group as a target OSD, and recording a corresponding relation between the target homing group and the target OSD in the cache list;
s207, sending the IO request to the target OSD to realize data reading and writing;
and S208, initializing a pre-created cache list if the OSD map is detected to be changed.
The OSD Map records how many OSD clusters contain, which nodes the OSD belongs to respectively, and the weight information of the nodes and the OSD respectively, and the relations are stored in a tree structure. The OSD and the node are online and offline to bring the change of the OSDMap, and the OSD Map change can cause the corresponding change of the OSD corresponding to the PG, so that the PG cache list needs to be cleared and the cache needs to be performed again.
As can be seen, according to the data reading and writing method for the distributed storage system provided by this embodiment, the corresponding relationship between the destination group and the OSD is cached in the cache file, so that it is not necessary to determine the target OSD corresponding to the target destination group through complicated calculation in the data reading and writing process, and thus the CPU consumption and the delay on the IO path are greatly reduced, thereby saving the CPU resource occupation of the system and greatly reducing the front-end IO delay.
In the following, a data read/write apparatus of a distributed storage system provided in an embodiment of the present application is introduced, and a data read/write apparatus of a distributed storage system described below and a data read/write method of a distributed storage system described above may be referred to correspondingly.
Referring to fig. 3, the apparatus is applied to a Ceph client, and includes:
the request acquisition module 301: the method comprises the steps of obtaining an IO request, wherein the IO request comprises identification information of a target object;
the homing group determination module 302: the target object storage unit is used for determining a target homing group according to the identification information of the target object;
the request sending module 303: and the IO request is sent to the target OSD to realize data reading and writing.
The data reading and writing device of the distributed storage system of this embodiment is used to implement the data reading and writing method of the distributed storage system, and therefore a specific implementation manner of the device may be seen in the foregoing embodiment parts of the data reading and writing method of the distributed storage system, for example, the request obtaining module 301, the group setting determining module 302, and the request sending module 303, which are respectively used to implement steps S101, S102, and S103 in the data reading and writing method of the distributed storage system. Therefore, specific embodiments thereof may be referred to in the description of the corresponding respective partial embodiments, and will not be described herein.
In addition, since the data reading and writing device of the distributed storage system of this embodiment is used to implement the data reading and writing method of the distributed storage system, the role thereof corresponds to the role of the method described above, and details are not described here.
In addition, the present application also provides a storage server of a distributed storage system, as shown in fig. 4, including:
the memory 100: for storing a computer program;
the processor 200: for executing the computer program to implement the steps of a data reading and writing method of a distributed storage system as described above.
Finally, the present application provides a readable storage medium on which a computer program is stored, which computer program, when being executed by a processor, is adapted to implement the steps of a method for reading and writing data of a distributed storage system as described above.
The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above detailed descriptions of the solutions provided in the present application, and the specific examples applied herein are set forth to explain the principles and implementations of the present application, and the above descriptions of the examples are only used to help understand the method and its core ideas of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (10)
1. A data read-write method of a distributed storage system is applied to a Ceph client, and comprises the following steps:
obtaining an IO request, wherein the IO request comprises identification information of a target object;
determining a target homing group according to the identification information of the target object;
and determining a target OSD corresponding to the target homing group in a pre-established cache file, and sending the IO request to the target OSD to realize data reading and writing.
2. The method of claim 1, wherein the determining a target OSD corresponding to the target homing group in a pre-created cache file and sending the IO request to the target OSD comprises:
judging whether the target homing group exists in a pre-established cache file or not;
if yes, determining a target OSD corresponding to the target homing group in the cache file, and sending the IO request to the target OSD;
if not, calculating a target OSD corresponding to the target homing group according to a flush algorithm, sending the IO request to the target OSD, and recording the corresponding relation between the target homing group and the target OSD in the cache file.
3. The method of claim 2, wherein the calculating the target OSD corresponding to the target homing group according to a househ algorithm comprises:
and calculating an OSD group corresponding to the target homing group according to a flush algorithm, and taking a main OSD in the OSD group as a target OSD.
4. The method of claim 1, wherein determining a target homing group based on identification information of the target object comprises:
and performing a modulo operation on the hash value of the identification information of the target object to obtain the identification information of the target homing group.
5. The method of claim 4, prior to the get IO request, further comprising:
acquiring a file to be written, segmenting the file to be written into a plurality of target objects according to the size of a preset object, and determining identification information of each target object; and generating an IO request carrying the identification information of the target object.
6. The method of claim 5, wherein the determining the target OSD corresponding to the target homing group in a pre-created buffer file comprises:
and determining a target OSD corresponding to the target homing group in a pre-established cache list.
7. The method of any of claims 1-6, wherein prior to the determining the target OSD corresponding to the target homing group in a pre-created cache file, further comprising:
and if the OSD map is detected to be changed, initializing a pre-created cache file.
8. The utility model provides a distributed storage system's data read write device which is applied to the Ceph client, includes:
a request acquisition module: the method comprises the steps of obtaining an IO request, wherein the IO request comprises identification information of a target object;
a homing group determination module: the target object storage unit is used for determining a target homing group according to the identification information of the target object;
a request sending module: and the IO request is sent to the target OSD to realize data reading and writing.
9. A storage server of a distributed storage system, comprising:
a memory: for storing a computer program;
a processor: for executing the computer program for implementing the steps of a data read-write method of a distributed storage system as claimed in any one of claims 1 to 7.
10. A readable storage medium, on which a computer program is stored, which, when being executed by a processor, is adapted to carry out the steps of a method for reading and writing data of a distributed storage system according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911025181.2A CN110780819A (en) | 2019-10-25 | 2019-10-25 | Data read-write method of distributed storage system |
| PCT/CN2020/092831 WO2021077745A1 (en) | 2019-10-25 | 2020-05-28 | Data reading and writing method of distributed storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911025181.2A CN110780819A (en) | 2019-10-25 | 2019-10-25 | Data read-write method of distributed storage system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110780819A true CN110780819A (en) | 2020-02-11 |
Family
ID=69386814
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911025181.2A Pending CN110780819A (en) | 2019-10-25 | 2019-10-25 | Data read-write method of distributed storage system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110780819A (en) |
| WO (1) | WO2021077745A1 (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112363674A (en) * | 2020-11-12 | 2021-02-12 | 新华三技术有限公司成都分公司 | Data writing method and device |
| CN112486413A (en) * | 2020-11-27 | 2021-03-12 | 杭州朗和科技有限公司 | Data reading method, device, medium and computing equipment |
| WO2021077745A1 (en) * | 2019-10-25 | 2021-04-29 | 浪潮电子信息产业股份有限公司 | Data reading and writing method of distributed storage system |
| CN112783443A (en) * | 2021-01-18 | 2021-05-11 | 北京聚云科技有限公司 | Data reading method and device and electronic equipment |
| CN112925482A (en) * | 2021-03-15 | 2021-06-08 | 北京首都在线科技股份有限公司 | Data processing method, device, system, electronic equipment and computer storage medium |
| CN114327299A (en) * | 2022-03-01 | 2022-04-12 | 苏州浪潮智能科技有限公司 | Sequential reading and pre-reading method, device, equipment and medium |
| CN114564460A (en) * | 2022-02-25 | 2022-05-31 | 苏州浪潮智能科技有限公司 | Parameter tuning method, device, equipment and medium based on distributed storage system |
| CN116737619A (en) * | 2023-08-15 | 2023-09-12 | 苏州浪潮智能科技有限公司 | Data request system, method, device, computer equipment and storage medium |
| CN117348820A (en) * | 2023-12-04 | 2024-01-05 | 浪潮云信息技术股份公司 | Data processing method, system, equipment and storage medium of distributed system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103905540A (en) * | 2014-03-25 | 2014-07-02 | 浪潮电子信息产业股份有限公司 | Object storage data distribution mechanism based on two-sage Hash |
| US20160330281A1 (en) * | 2015-05-07 | 2016-11-10 | Dell Products L.P. | Systems and methods to improve read/write performance in object storage applications |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9317525B2 (en) * | 2013-01-30 | 2016-04-19 | Hewlett Packard Enterprise Development Lp | Reconstructing a state of a file system using a preserved snapshot |
| CN108287660B (en) * | 2017-01-09 | 2021-07-09 | 中国移动通信集团河北有限公司 | Data storage method and device |
| CN110222013B (en) * | 2019-06-11 | 2023-05-12 | 深信服科技股份有限公司 | Method, system, equipment and storage medium for determining cluster storage capacity |
| CN110780819A (en) * | 2019-10-25 | 2020-02-11 | 浪潮电子信息产业股份有限公司 | Data read-write method of distributed storage system |
-
2019
- 2019-10-25 CN CN201911025181.2A patent/CN110780819A/en active Pending
-
2020
- 2020-05-28 WO PCT/CN2020/092831 patent/WO2021077745A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103905540A (en) * | 2014-03-25 | 2014-07-02 | 浪潮电子信息产业股份有限公司 | Object storage data distribution mechanism based on two-sage Hash |
| US20160330281A1 (en) * | 2015-05-07 | 2016-11-10 | Dell Products L.P. | Systems and methods to improve read/write performance in object storage applications |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021077745A1 (en) * | 2019-10-25 | 2021-04-29 | 浪潮电子信息产业股份有限公司 | Data reading and writing method of distributed storage system |
| CN112363674B (en) * | 2020-11-12 | 2022-04-22 | 新华三技术有限公司成都分公司 | Data writing method and device |
| CN112363674A (en) * | 2020-11-12 | 2021-02-12 | 新华三技术有限公司成都分公司 | Data writing method and device |
| CN112486413A (en) * | 2020-11-27 | 2021-03-12 | 杭州朗和科技有限公司 | Data reading method, device, medium and computing equipment |
| CN112486413B (en) * | 2020-11-27 | 2022-08-05 | 杭州朗和科技有限公司 | Data reading method, device, medium and computing equipment |
| CN112783443A (en) * | 2021-01-18 | 2021-05-11 | 北京聚云科技有限公司 | Data reading method and device and electronic equipment |
| CN112925482A (en) * | 2021-03-15 | 2021-06-08 | 北京首都在线科技股份有限公司 | Data processing method, device, system, electronic equipment and computer storage medium |
| CN114564460A (en) * | 2022-02-25 | 2022-05-31 | 苏州浪潮智能科技有限公司 | Parameter tuning method, device, equipment and medium based on distributed storage system |
| CN114564460B (en) * | 2022-02-25 | 2024-01-19 | 苏州浪潮智能科技有限公司 | Parameter tuning method, device, equipment and medium based on distributed storage system |
| CN114327299A (en) * | 2022-03-01 | 2022-04-12 | 苏州浪潮智能科技有限公司 | Sequential reading and pre-reading method, device, equipment and medium |
| WO2023165188A1 (en) * | 2022-03-01 | 2023-09-07 | 苏州浪潮智能科技有限公司 | Sequential read prefetching method and apparatus, device, and medium |
| CN116737619A (en) * | 2023-08-15 | 2023-09-12 | 苏州浪潮智能科技有限公司 | Data request system, method, device, computer equipment and storage medium |
| CN116737619B (en) * | 2023-08-15 | 2023-11-03 | 苏州浪潮智能科技有限公司 | Data request system, method, device, computer equipment and storage medium |
| CN117348820A (en) * | 2023-12-04 | 2024-01-05 | 浪潮云信息技术股份公司 | Data processing method, system, equipment and storage medium of distributed system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021077745A1 (en) | 2021-04-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110780819A (en) | Data read-write method of distributed storage system | |
| US10585617B1 (en) | Buffering copy requests in a storage system | |
| CN107436725B (en) | Data writing and reading methods and devices and distributed object storage cluster | |
| US11243706B2 (en) | Fragment management method and fragment management apparatus | |
| US8521986B2 (en) | Allocating storage memory based on future file size or use estimates | |
| CN110908589B (en) | Data file processing method, device, system and storage medium | |
| WO2020093501A1 (en) | File storage method and deletion method, server, and storage medium | |
| EP4030273A1 (en) | Data storage method and device | |
| KR101993793B1 (en) | Conservative garbage collecting and tagged integers for memory management | |
| CN108920100B (en) | Ceph-based read-write model optimization and heterogeneous copy combination method | |
| CN109582649B (en) | Metadata storage method, device and equipment and readable storage medium | |
| CN113703672A (en) | Super-fusion system, IO request issuing method thereof and physical server | |
| CN112346647A (en) | Data storage method, device, equipment and medium | |
| CN110427347A (en) | Method, apparatus, memory node and the storage medium of data de-duplication | |
| US20220129333A1 (en) | Message Processing Method and Apparatus in Distributed System | |
| CN113835639B (en) | I/O request processing method, device, equipment and readable storage medium | |
| JP6582721B2 (en) | Control device, storage system, and control program | |
| CN113986522A (en) | Load balancing-based distributed storage server capacity expansion system | |
| CN111435323B (en) | Information transmission method, device, terminal, server and storage medium | |
| WO2023024656A1 (en) | Data access method, storage system, and storage node | |
| CN111966845B (en) | Picture management method, device, storage node and storage medium | |
| CN114490540A (en) | Data storage method, medium, device and computing equipment | |
| CN108769123B (en) | Data system and data processing method | |
| WO2023093091A1 (en) | Data storage system, smart network card, and computing node | |
| CN111857587B (en) | Hit detection method based on magnetic track address in cache device of storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200211 |