CN109558079A - A kind of method and device of distributed memory system processing operation request - Google Patents

A kind of method and device of distributed memory system processing operation request Download PDF

Info

Publication number
CN109558079A
CN109558079A CN201811375966.8A CN201811375966A CN109558079A CN 109558079 A CN109558079 A CN 109558079A CN 201811375966 A CN201811375966 A CN 201811375966A CN 109558079 A CN109558079 A CN 109558079A
Authority
CN
China
Prior art keywords
sub
request
object storage
storage device
operation request
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811375966.8A
Other languages
Chinese (zh)
Inventor
张露露
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Yunhai Information Technology Co Ltd
Original Assignee
Zhengzhou Yunhai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Yunhai Information Technology Co Ltd filed Critical Zhengzhou Yunhai Information Technology Co Ltd
Priority to CN201811375966.8A priority Critical patent/CN109558079A/en
Publication of CN109558079A publication Critical patent/CN109558079A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0631Configuration or reconfiguration of storage systems by allocating resources to storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659Command handling arrangements, e.g. command buffers, queues, command scheduling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Multi Processors (AREA)

Abstract

The invention discloses a kind of methods of distributed memory system processing operation request, applied to client, operation requests can be received, then operation requests multiple sub-operations are decomposed into request, and determine the object storage device for being respectively used to handle each sub-operation request, corresponding sub-operation request is sent to each object storage equipment finally by network, so as to the object storage device processing sub-operation request.It can be seen that, the method achieve the decomposition in client executing to operation requests, and the purpose being allocated is requested to the sub-operation that decomposition obtains, it avoids and operation requests is sent to the process that main OSD is allocated by main OSD again, the dependence to main OSD is reduced, the efficiency of processing operation request is improved.In addition, effect corresponds to the above method the present invention also provides device, a kind of client and a kind of distributed memory system of a kind of request of distributed memory system processing operation.

Description

A kind of method and device of distributed memory system processing operation request
Technical field
The present invention relates to field of storage, in particular to a kind of method, apparatus of distributed memory system processing operation request, Client and a kind of distributed memory system.
Background technique
Distributed memory system is a large amount of common PC servers by network interconnection, externally provides storage as a whole The system of service.
Distributed memory system includes for initiating the operation requests client to data, further includes for storing data Object storage device, object storage device are equipment (the Object-based Storage based on object storage technology Device), abbreviation OSD.
Currently, the process of distributed memory system processing operation request is as shown in Figure 1, object storage device is divided into main OSD With from OSD, when client issues operation requests, need first to send operation requests to main OSD, then main OSD is true by calculating Surely the multiple from OSD of operation requests are executed, then multiple from OSD transmission sub-operation request to this, is only returned result to when from OSD After main OSD, main OSD just can be to the message of clients report processing completion.
As it can be seen that the method that traditional distributed operating system processing operation is requested needs main OSD to be allocated calculating, to master The dependence of OSD computing capability is larger, and operation requests treatment effeciency is lower.
Summary of the invention
The object of the present invention is to provide a kind of distributed memory system processing operation request method, apparatus, client and A kind of distributed memory system, the method to solve traditional distributed operating system processing operation request need main OSD into Row distribution calculates, operation requests treatment effeciency lower problem larger to the dependence of main OSD computing capability.
In order to solve the above technical problems, the present invention provides a kind of method of distributed memory system processing operation request, Applied to client, comprising:
Receive operation requests;
The operation requests are decomposed into the request of multiple sub-operations, and determines to be respectively used to handle each sub-operation and ask The object storage device asked;
Corresponding sub-operation request is sent to each object storage device by network, so that the object storage is set It is standby to handle the sub-operation request.
Optionally, described the operation requests are decomposed into multiple sub-operations to request, and determine be respectively used to handle it is each The object storage device of the sub-operation request, comprising:
When the operation requests are write request, target data to be written is determined;
Correcting and eleting codes calculating is carried out to the target data, obtains including original data block and the multiple data for verifying data block Block;
The sub- write request of each data block is generated, and determines the object for being respectively used to handle each sub- write request Store equipment.
Optionally, described the operation requests are decomposed into multiple sub-operations to request, and determine be respectively used to handle it is each The object storage device of the sub-operation request, comprising:
When the operation requests are read request, target data to be read is determined;
According to default screening conditions, the data block of preset quantity is filtered out from the data block of the target data;
The sub- read request of each data block in the data block of the preset quantity is generated, and determination is respectively used to handle The object storage device of each sub- read request.
Optionally, described the operation requests are decomposed into multiple sub-operations to request, and determine be respectively used to handle it is each The object storage device of the sub-operation request, comprising:
Default osdc module is called, the operation requests are decomposed into multiple sub-operations and are requested, and determination is respectively used to locate Manage the object storage device of each sub-operation request.
Optionally, corresponding sub-operation request is sent to each object storage device by network described, so as to The object storage device is handled after the sub-operation request, further includes:
Receive the processing result that each object storage device requests the sub-operation.
Correspondingly, being applied to client the present invention also provides a kind of device of distributed memory system processing operation request End, comprising:
Receiving module: for receiving operation requests;
Decomposing module: requesting for the operation requests to be decomposed into multiple sub-operations, and determines and be respectively used to processing respectively The object storage device of a sub-operation request;
Sending module: for sending corresponding sub-operation request to each object storage device by network, so as to The object storage device handles the sub-operation request.
Optionally, the decomposing module includes:
Target data determination unit: for determining target data to be written when the operation requests are write request;
Correcting and eleting codes computing unit: for carrying out correcting and eleting codes calculating to the target data, obtain include original data block with Verify multiple data blocks of data block;
Sub- write request generation unit: for generating the sub- write request of each data block, and determination is respectively used to handle The object storage device of each sub- write request.
Optionally, the decomposing module is specifically used for:
Default osdc module is called, the operation requests are decomposed into multiple sub-operations and are requested, and determination is respectively used to locate Manage the object storage device of each sub-operation request.
In addition, the present invention also provides a kind of clients, comprising:
Memory: for storing computer program;
Processor: for executing the computer program, to realize a kind of distributed memory system processing as described above The step of method of operation requests.
Finally, the distributed memory system includes multiple objects the present invention also provides a kind of distributed memory system Equipment is stored, further includes a kind of client as described above.
A kind of method of distributed memory system processing operation request provided by the present invention, is applied to client, can Operation requests are received, operation requests are then decomposed into multiple sub-operations and are requested, and determination is respectively used to handle each sub-operation The object storage device of request sends corresponding sub-operation to each object storage equipment finally by network and requests, so as to right The request of the sub-operation as described in storage device processes.As it can be seen that the method achieve the decomposition in client executing to operation requests, and The purpose being allocated is requested to the obtained sub-operation of decomposition, is avoided and operation requests are sent to main OSD are carried out again by main OSD The process of distribution reduces the dependence to main OSD, improves the efficiency of processing operation request.
In addition, the present invention also provides a kind of distributed memory system processing operation request device, a kind of client and A kind of distributed memory system, effect correspond to the above method, and which is not described herein again.
Detailed description of the invention
It, below will be to embodiment or existing for the clearer technical solution for illustrating the embodiment of the present invention or the prior art Attached drawing needed in technical description is briefly described, it should be apparent that, the accompanying drawings in the following description is only this hair Bright some embodiments for those of ordinary skill in the art without creative efforts, can be with root Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the process schematic of current distributed memory system processing operation request;
Fig. 2 is a kind of realization of the embodiment of the method one of distributed memory system processing operation request provided by the present invention Flow chart;
Fig. 3 is a kind of process of the embodiment of the method one of distributed memory system processing operation request provided by the present invention Schematic diagram;
Fig. 4 is a kind of realization of the embodiment of the method two of distributed memory system processing operation request provided by the present invention Flow chart;
Fig. 5 be a kind of distributed memory system processing operation request provided by the present invention embodiment of the method two in be distributed The configuration diagram of formula system;
Fig. 6 is a kind of functional block of the Installation practice of distributed memory system processing operation request provided by the present invention Figure;
Fig. 7 is a kind of structural schematic diagram of client embodiment provided by the invention;
Fig. 8 be the present invention for a kind of distributed memory system embodiment structural schematic diagram.
Specific embodiment
Core of the invention is to provide a kind of method, apparatus of distributed memory system processing operation request, a kind of client End and a kind of distributed memory system realize the decomposition in client executing to operation requests, and grasp to the son that decomposition obtains Make the purpose that request is allocated, avoid and operation requests are sent to the process that main OSD is allocated by main OSD again, reduces Dependence to main OSD improves the efficiency of processing operation request.
In order to enable those skilled in the art to better understand the solution of the present invention, with reference to the accompanying drawings and detailed description The present invention is described in further detail.Obviously, described embodiments are only a part of the embodiments of the present invention, rather than Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise Under every other embodiment obtained, shall fall within the protection scope of the present invention.
It is situated between below to a kind of embodiment of the method one of distributed memory system processing operation request provided by the invention It continues, embodiment one is applied to client, and referring to fig. 2, embodiment one includes:
Step S101: operation requests are received.
It should be noted that as shown in figure 3, client mainly realizes interface, externally in distributed memory system The function of access is provided, upper layer application can access the data stored in distributed memory system by interface, that is, be stored in Data in OSD.Specifically, aforesaid operations request can be write operation requests or read operation request, aforesaid operations request can be with Issued by user, be also possible to the automatic trigger upper layer application under certain preset condition make its issue, the present embodiment to this not It limits.
Step S102: the operation requests are decomposed into multiple sub-operations and are requested, and determination is respectively used to handle each institute State the object storage device of sub-operation request.
It is noted that when data are written, needing to be divided into data in distributed memory system Then each data block is stored in different object storage devices by multiple data blocks.Therefore, when aforesaid operations request is to write When request, the data for needing to be written into are divided, and determine that each data block for dividing and obtaining needs which is written Object storage device, it is clear that when aforesaid operations request is write request, above-mentioned sub-operation request, which just contains some data block, to be needed The information of which object storage device is written.And when aforesaid operations request is read request, it is thus necessary to determine that data to be read Each data block which object storage device be stored in, it is clear that above-mentioned sub-operation request at this time is contained from some object Storage equipment reads the information of which data block.
Step S103: corresponding sub-operation is sent to each object storage device by network and is requested, so as to described The object storage device processing sub-operation request.
Due to the architectural features of distributed memory system, client generally requires through network and accesses object storage device On data, therefore above-mentioned sub-operation request be by network transmission.As shown in figure 3, client is by network directly to right As storage equipment carries out data transmission.
As it can be seen that the present embodiment provides a kind of method of distributed memory system processing operation request, it is applied to client, Operation requests can be received, operation requests are then decomposed into multiple sub-operations and are requested, and determination is respectively used to handle each height The object storage device of operation requests sends corresponding sub-operation to each object storage equipment finally by network and requests, with Just object storage device handles the sub-operation request.As it can be seen that the method achieve divide in client executing operation requests Solution, and the purpose being allocated is requested to the sub-operation that decomposition obtains, it avoids and operation requests is sent to main OSD again by leading The process that OSD is allocated reduces the dependence to main OSD, improves the efficiency of processing operation request.
The method for starting that a kind of distributed memory system processing operation request provided by the invention is discussed in detail below is implemented Example two, embodiment two is realized based on embodiment one, and has carried out expansion to a certain extent on the basis of example 1.
As shown in figure 4, embodiment two includes:
Step S201: operation requests are received.
Step S202: calling default osdc module, and the operation requests are decomposed into multiple sub-operations and are requested, and determines and divides The object storage device of each sub-operation request Yong Yu not handled.
As described above, client provides the external interface of distributed memory system, upper layer application can pass through the interface To access the data in distributed memory system.As an alternative embodiment, above-mentioned distributed memory system can be Icfs, the system can be realized block storage, file storage and object storage, and the primary structure of the system is as shown in figure 5, client Storage system can be accessed by Librados interface, the position of bottom compared with Librados is located in client with Osdc, Librados provides the basic interfaces such as creation, deletion, the creation of object, the deletion of Pool, and Osdc is then used for encapsulation operation, meter The address of object is calculated, transmission asks summation process overtime.
The present embodiment is based on the improvement to above-mentioned Osdc module, to realize that operation requests, which are decomposed into multiple sub-operations, asks It asks, and the process being allocated is requested to the sub-operation that decomposition obtains.Specifically, first in the Objecter.cc/ of Osdc module Do_split_op () function is added in h file, realizes and operation is split into several sub-operations by correcting and eleting codes, then exist New do_osd_split_op () letter is write according to original do_osd_op () function in ReplicatedPG.cc file Number is adapted to sub-operation after splitting in the function.
Step S203: corresponding sub-operation is sent to each object storage device by network and is requested, so as to described The object storage device processing sub-operation request.
Step S204: the processing result that each object storage device requests the sub-operation is received.
As described above, operation requests include write request and read request, it is read request or write request, step according to operation requests The implementation procedure of rapid S202 is slightly different.Therefore, a step can be increased between step S201 and step S202: judgement behaviour Make request be read request or write request, then respectively enter corresponding process flow according to two kinds of situations, below to this two Kind processing distance is described:
When operation requests are write request, specific process flow are as follows:
Step S301: according to write request, target data to be written is determined.
Step S302: carrying out correcting and eleting codes calculating to the target data, obtains including original data block and verification data block Multiple data blocks.
Above-mentioned correcting and eleting codes calculate, and refer to a data being cut into n equal part, by dividing data encoding to this n etc., obtain The verification data block of the equal sizes such as m, this n+m parts of data are stored on different nodes, take any n in n+m data block A data block can obtain original data by restructing algorithm, fault-tolerant to achieve the purpose that.Under normal circumstances, n takes 10, m to take 3。
Step S303: generating the sub- write request of each data block, and determines to be respectively used to handle each son and write The object storage device of request.
When operation requests are read request, specific process flow are as follows:
Step S401: according to read request, target data to be read is determined.
Step S402: according to default screening conditions, the number of preset quantity is filtered out from the data block of the target data According to block.
As described above, taking any n data block in n+m data block, complete initial data can be accessed, because This, as a preferred embodiment, the preset quantity between n a to n+m can be set, to reduce pair for needing to access Quantity as storing equipment.
Step S403: the sub- read request of each data block in the data block of the preset quantity is generated, and determines and divides The object storage device of each sub- read request Yong Yu not handled.
To sum up, the method for a kind of distributed memory system processing operation request provided in this embodiment, by Osdc mould Block improves, and realizes the purpose decomposed and distributed to operation requests in client, avoids and issues main OSD again by leading The process that OSD is allocated, improves treatment effeciency.
Below to a kind of Installation practice of distributed memory system processing operation request provided in an embodiment of the present invention into Row is introduced, and a kind of device of distributed memory system processing operation request described below is deposited with a kind of above-described distribution The method of storage system processing operation request can correspond to each other reference.
Referring to Fig. 6, which includes:
Receiving module 601: for receiving operation requests;
Decomposing module 602: it is requested for the operation requests to be decomposed into multiple sub-operations, and determination is respectively used to handle The object storage device of each sub-operation request;
Sending module 603: for sending corresponding sub-operation request to each object storage device by network, with Toilet states object storage device and handles the sub-operation request.
As an alternative embodiment, the decomposing module 602 includes:
Target data determination unit 6021: for determining number of targets to be written when the operation requests are write request According to;
Correcting and eleting codes computing unit 6022: it for carrying out correcting and eleting codes calculating to the target data, obtains including initial data Multiple data blocks of block sum check data block;
Sub- write request generation unit 6023: for generating the sub- write request of each data block, and determination is respectively used to Handle the object storage device of each sub- write request.
As an alternative embodiment, the decomposing module 602 is specifically used for:
Default osdc module is called, the operation requests are decomposed into multiple sub-operations and are requested, and determination is respectively used to locate Manage the object storage device of each sub-operation request.
A kind of device of distributed memory system processing operation request of the present embodiment is for realizing a kind of distribution above-mentioned The method of formula storage system processing operation request, therefore the visible distribution one of above of specific embodiment in the device The embodiment part of the method for storage system processing operation request, for example, receiving module 601, decomposing module 602, sending module 603, it is respectively used to step S101, S102, S103 in the method for realizing a kind of above-mentioned distributed memory system processing operation request. So specific embodiment is referred to the description of corresponding various pieces embodiment, not reinflated introduction herein.
In addition, due to the present embodiment a kind of distributed memory system processing operation request device for realizing above-mentioned A kind of method of distributed memory system processing operation request, therefore its effect is corresponding with the effect of the above method, here not It repeats again.
In addition, the present invention also provides a kind of client embodiments, as shown in fig. 7, the client includes:
Memory 701: for storing computer program;
Processor 702: for executing the computer program, to realize at a kind of distributed memory system as described above The step of managing the method for operation requests.
Finally, the present invention provides a kind of distributed memory system, as shown in figure 8, the distributed memory system includes Multiple object storage devices 801 further include a kind of client 802 as described above.
A kind of client of the present embodiment and a kind of distributed memory system are for realizing a kind of distributed storage above-mentioned The method of system processing operation request, therefore the client, the specific embodiment of distributed memory system are visible hereinbefore A kind of embodiment part of the method for distributed memory system processing operation request, and the client, distributed memory system Effect corresponds to the above method, here not reinflated introduction.
Each embodiment in this specification is described in a progressive manner, the highlights of each of the examples are with it is other The difference of embodiment, same or similar part may refer to each other between each embodiment.For being filled disclosed in embodiment For setting, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is referring to method part Explanation.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered Think beyond the scope of this invention.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology In any other form of storage medium well known in field.
Above to a kind of method, apparatus, the client of the request of distributed memory system processing operation provided by the present invention And distributed memory system is described in detail.Specific case used herein to the principle of the present invention and embodiment into Elaboration is gone, the above description of the embodiment is only used to help understand the method for the present invention and its core ideas.It should be pointed out that pair For those skilled in the art, without departing from the principle of the present invention, the present invention can also be carried out Some improvements and modifications, these improvements and modifications also fall within the scope of protection of the claims of the present invention.

Claims (10)

1. a kind of method of distributed memory system processing operation request, is applied to client characterized by comprising
Receive operation requests;
The operation requests are decomposed into multiple sub-operation requests, and determines and is respectively used to handle each sub-operation request Object storage device;
Corresponding sub-operation request is sent to each object storage device by network, at the object storage device Manage the sub-operation request.
2. the method as described in claim 1, which is characterized in that described the operation requests are decomposed into multiple sub-operations to ask It asks, and determines the object storage device for being respectively used to handle each sub-operation request, comprising:
When the operation requests are write request, target data to be written is determined;
Correcting and eleting codes calculating is carried out to the target data, obtains including original data block and the multiple data blocks for verifying data block;
The sub- write request of each data block is generated, and determines the object storage for being respectively used to handle each sub- write request Equipment.
3. the method as described in claim 1, which is characterized in that described the operation requests are decomposed into multiple sub-operations to ask It asks, and determines the object storage device for being respectively used to handle each sub-operation request, comprising:
When the operation requests are read request, target data to be read is determined;
According to default screening conditions, the data block of preset quantity is filtered out from the data block of the target data;
Generate the sub- read request of each data block in the data block of the preset quantity, and determine be respectively used to handle it is each The object storage device of the sub- read request.
4. method as claimed in any one of claims 1-3, which is characterized in that it is described the operation requests are decomposed into it is multiple Sub-operation request, and determine the object storage device for being respectively used to handle each sub-operation request, comprising:
The operation requests are decomposed into multiple sub-operations and requested by the default osdc module of calling, and are determined and be respectively used to processing respectively The object storage device of a sub-operation request.
5. method as claimed in claim 4, which is characterized in that sent out by network to each object storage device described Corresponding sub-operation is sent to request, after the object storage device processing sub-operation request, further includes:
Receive the processing result that each object storage device requests the sub-operation.
6. a kind of device of distributed memory system processing operation request, is applied to client characterized by comprising
Receiving module: for receiving operation requests;
Decomposing module: it is requested for the operation requests to be decomposed into multiple sub-operations, and determination is respectively used to handle each institute State the object storage device of sub-operation request;
Sending module: for sending corresponding sub-operation request to each object storage device by network, so as to described The object storage device processing sub-operation request.
7. device as claimed in claim 6, which is characterized in that the decomposing module includes:
Target data determination unit: for determining target data to be written when the operation requests are write request;
Correcting and eleting codes computing unit: it for carrying out correcting and eleting codes calculating to the target data, obtains including initial data block sum check Multiple data blocks of data block;
Sub- write request generation unit: for generating the sub- write request of each data block, and determine be respectively used to handle it is each The object storage device of the sub- write request.
8. device as claimed in claim 7, which is characterized in that the decomposing module is specifically used for:
The operation requests are decomposed into multiple sub-operations and requested by the default osdc module of calling, and are determined and be respectively used to processing respectively The object storage device of a sub-operation request.
9. a kind of client characterized by comprising
Memory: for storing computer program;
Processor: for executing the computer program, to realize a kind of distribution as described in claim 1-5 any one The step of method of storage system processing operation request.
10. a kind of distributed memory system, which is characterized in that the distributed memory system includes multiple object storage devices, It further include a kind of client as claimed in claim 9.
CN201811375966.8A 2018-11-19 2018-11-19 A kind of method and device of distributed memory system processing operation request Pending CN109558079A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811375966.8A CN109558079A (en) 2018-11-19 2018-11-19 A kind of method and device of distributed memory system processing operation request

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811375966.8A CN109558079A (en) 2018-11-19 2018-11-19 A kind of method and device of distributed memory system processing operation request

Publications (1)

Publication Number Publication Date
CN109558079A true CN109558079A (en) 2019-04-02

Family

ID=65866689

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811375966.8A Pending CN109558079A (en) 2018-11-19 2018-11-19 A kind of method and device of distributed memory system processing operation request

Country Status (1)

Country Link
CN (1) CN109558079A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112486413A (en) * 2020-11-27 2021-03-12 杭州朗和科技有限公司 Data reading method, device, medium and computing equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103561057A (en) * 2013-10-15 2014-02-05 深圳清华大学研究院 Data storage method based on distributed hash table and erasure codes
CN106657356A (en) * 2016-12-29 2017-05-10 郑州云海信息技术有限公司 Data writing method and device for cloud storage system, and cloud storage system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103561057A (en) * 2013-10-15 2014-02-05 深圳清华大学研究院 Data storage method based on distributed hash table and erasure codes
CN106657356A (en) * 2016-12-29 2017-05-10 郑州云海信息技术有限公司 Data writing method and device for cloud storage system, and cloud storage system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112486413A (en) * 2020-11-27 2021-03-12 杭州朗和科技有限公司 Data reading method, device, medium and computing equipment
CN112486413B (en) * 2020-11-27 2022-08-05 杭州朗和科技有限公司 Data reading method, device, medium and computing equipment

Similar Documents

Publication Publication Date Title
US20180314706A1 (en) Iterative object scanning for information lifecycle management
JP2020173778A (en) Method, apparatus, electronic facility, computer readable medium, and computer program for allocating resource
US20100115070A1 (en) Method for generating manipulation requests of an initialization and administration database of server cluster, data medium and corresponding a server cluster, data medium and corresponding service cluster
JP5065296B2 (en) A method for modeling a free pool of resources
US9098379B2 (en) Computing reusable image components to minimize network bandwidth usage
US8966213B2 (en) Granting and revoking supplemental memory allocation requests
EP3958122A1 (en) Memory management method, apparatus, and system
CN105227489A (en) A kind of bandwidth management method and electronic equipment
CN108234551B (en) Data processing method and device
CN108255989A (en) Picture storage method, device, terminal device and computer storage media
CN109582649A (en) A kind of metadata storing method, device, equipment and readable storage medium storing program for executing
CN109033430A (en) A kind of virtual machine image file storage method and device
CN115617511A (en) Resource data processing method and device, electronic equipment and storage medium
CN109558079A (en) A kind of method and device of distributed memory system processing operation request
CN109656877A (en) A kind of method, apparatus and distributed file system of user file quota
WO2021023000A1 (en) Information processing method and apparatus, electronic device and storage medium
CN109739443B (en) SSD (solid State disk) hybrid read-write method, device, equipment and storage medium
CN112883239B (en) Resource allocation method and device, computer equipment and storage medium
CN109614385A (en) A kind of file updating method, device, equipment and readable storage medium storing program for executing
CN110019487A (en) A kind of database connection management method and device
CN109376001A (en) A kind of method and apparatus of resource allocation
CN108874316A (en) Method, apparatus, equipment and the readable storage medium storing program for executing of storage resource centralized management
CN109344131A (en) Date storage method, device and management server
CN112000295B (en) Management method, system and device for back-end storage
CN112631951B (en) Storage space allocation method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190402