CN108255432A - Write operation control method, system, device and storage medium based on bedding storage - Google Patents
Write operation control method, system, device and storage medium based on bedding storage Download PDFInfo
- Publication number
- CN108255432A CN108255432A CN201810030038.1A CN201810030038A CN108255432A CN 108255432 A CN108255432 A CN 108255432A CN 201810030038 A CN201810030038 A CN 201810030038A CN 108255432 A CN108255432 A CN 108255432A
- Authority
- CN
- China
- Prior art keywords
- ponds
- written
- write operation
- write
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
The invention discloses a kind of write operation control method, system, device and storage medium based on bedding storage, including:When receiving write operation requests, the type in the corresponding base ponds of data to be written is judged;If pond is deleted in base ponds to entangle, the type of the corresponding write operation of write operation requests is judged, when write operation is write for covering, be written into data write-in cache ponds, and base ponds are written in data to be written in the form of entangling and delete;If base ponds are copy pond, data write-in cache ponds are written into, and base ponds are written in data to be written in the form of copy.When reaching the preset standard of base ponds type and write operation type in the application, so that this part data to be written preserved in cache ponds and base ponds are consistent, reduce Data Migration pressure when cache ponds reach water level using space, file system is made to keep a smoother performance, improves user experience.
Description
Technical field
The present invention relates to technical field of memory, more particularly to a kind of write operation control method based on bedding storage, are
System, device and storage medium.
Background technology
With the appearance similar to high-performance storage device as SSD (Solid State Drives, solid state disk),
Bedding storage technology becomes more and more important in enterprise's storage market.Bedding storage is made by using the high storage device of performance
It is cold as standby pond (base ponds) storage that the high storage device of hot spot data, performance low capacity is stored for cache pool (cache ponds)
Data promote the performance of distributed file system entirety.In writeback patterns, for write request, client is by data
Write-in cache pool is returned to, and when reaching preset watermark threshold using space of cache pool, is performed data migration operation, will be cached
The data to turn cold stored in pond brush standby pond, and then they are removed from cache pool.
As it can be seen that in the prior art, for writeback patterns, when being originally written into, the performance of distributed file system is very
Height, however when cache pool reaches water level using space, data will move to standby pond, and Data Migration pressure is larger, then add
The read-write pressure of upper client, seriously reduces access performance.
Therefore how to provide a kind of scheme for solving above-mentioned technical problem is that those skilled in the art need to solve at present
Problem.
Invention content
The object of the present invention is to provide a kind of write operation control method based on bedding storage, system, device and storages to be situated between
Matter, when reaching the preset standard of base ponds type and write operation type so that treat this part preserved in cache ponds and base ponds
Write-in data are consistent, and are reduced Data Migration pressure when cache ponds reach water level using space, are kept file system
One smoother performance, improves user experience.
In order to solve the above technical problems, the present invention provides a kind of write operation control method based on bedding storage, including:
When receiving write operation requests, the type in the corresponding base ponds of data to be written is judged;
If pond is deleted in the base ponds to entangle, the type of the corresponding write operation of the write operation requests is judged, when described
When write operation is write for covering, by the data write-in cache ponds to be written, and the data to be written are write in the form of entangling and deleting
Enter the base ponds;
If the base ponds are copy pond, by the data write-in cache ponds to be written, and the number to be written
The base ponds are written in the form of copy according to this.
Preferably, the process of the type for judging the corresponding write operation of the write operation requests is specially:
The type of the corresponding write operation of the init_op_flags functions acquisition write operation requests is called in do_op.
Preferably, it is described the data to be written by entangle delete or copy in the form of the write-in base ponds process it is specific
For:
Call do_proxy_write functions directly the data to be written by entangle delete or copy in the form of described in write-in
Base ponds.
Preferably, the calling do_proxy_write functions are directly deleted the data to be written or the shape of copy to entangle
Formula is written before the base ponds, and this method further includes:
Call maybe_handle_cache functions encapsulation maybe_handle_cache_detail functions;
The maybe_handle_cache_detail functions introducing is called to act on behalf of write mode.
In order to solve the above technical problems, the present invention also provides a kind of write operation control system based on bedding storage, packet
It includes:
Judgment module, for when receiving write operation requests, judging the type in the corresponding base ponds of data to be written;Such as
Pond is deleted in base ponds described in fruit to entangle, then triggering, which entangles to delete, acts on behalf of writing unit, if the base ponds are copy pond, triggers copy
Act on behalf of writing unit;
It is described entangle to delete act on behalf of writing unit, for judging the type of the corresponding write operation of the write operation requests, when described
When write operation is write for covering, by the data write-in cache ponds to be written, and the data to be written are write in the form of entangling and deleting
Enter the base ponds;
The replica agent writing unit, for the data to be written to be written cache ponds, and the number to be written
The base ponds are written in the form of copy according to this.
Preferably, it is described entangle to delete act on behalf of writing unit and be specifically used for init_op_flags functions being called to obtain institute in do_op
State the type of the corresponding write operation of write operation requests.
Preferably, it is described entangle to delete act on behalf of writing unit or the replica agent writing unit and be specifically used for calling do_
Proxy_write functions directly the data to be written by entangle delete or copy in the form of the write-in base ponds.
Preferably, which further includes call unit, for maybe_handle_cache functions to be called to encapsulate maybe_
Handle_cache_detail functions;The maybe_handle_cache_detail functions is called to introduce agency's write-in mould
Formula.
In order to solve the above technical problems, the present invention also provides a kind of write operation control device based on bedding storage, packet
It includes:
Memory, for storing computer program;
Processor realizes the step of write operation control method described in any of the above-described during for performing the computer program
Suddenly.
In order to solve the above technical problems, the present invention also provides a kind of computer readable storage medium, the computer can
It reads to be stored with computer program on storage medium, realizes when the computer program is executed by processor and write described in any of the above-described
The step of method of controlling operation thereof.
The present invention provides a kind of write operation control method based on bedding storage, including:Receiving write operation requests
When, judge the type in the corresponding base ponds of data to be written;If pond is deleted in base ponds to entangle, judge that write operation requests are corresponding
The type of write operation when write operation is write for covering, is written into data write-in cache ponds, and data to be written are deleted to entangle
Form write-in base ponds;If base ponds are copy pond, data write-in cache ponds are written into, and data to be written
Base ponds are written in the form of copy.
The high follow-up performance of middle distributed file system initial performance is low compared with the prior art, in the application client to
Write operation is initiated in cache ponds, when reaching the preset standard of base ponds type and write operation type, is written into data write-in
Cache ponds, while data to be written write-in base ponds so that this partial data preserved in cache ponds and base ponds is one
It causes, so as to reduce Data Migration pressure when cache ponds use space arrival water level, distributed file system is made to keep one
A smoother performance, improves user experience.
It is and above-mentioned the present invention also provides a kind of write operation control system, device and storage medium based on bedding storage
Write operation control method has identical advantageous effect.
Description of the drawings
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to institute in the prior art and embodiment
Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the present invention
Example, for those of ordinary skill in the art, without creative efforts, can also obtain according to these attached drawings
Obtain other attached drawings.
Fig. 1 is a kind of process flow diagram flow chart of the write operation control method based on bedding storage provided by the invention;
Fig. 2 is a kind of structure diagram of the write operation control system based on bedding storage provided by the invention.
Specific embodiment
The core of the present invention is to provide a kind of write operation control method based on bedding storage, system, device and storage and is situated between
Matter, when reaching the preset standard of base ponds type and write operation type so that treat this part preserved in cache ponds and base ponds
Write-in data are consistent, and are reduced Data Migration pressure when cache ponds reach water level using space, are kept file system
One smoother performance, improves user experience.
Purpose, technical scheme and advantage to make the embodiment of the present invention are clearer, below in conjunction with the embodiment of the present invention
In attached drawing, the technical solution in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
All other embodiments obtained without making creative work shall fall within the protection scope of the present invention.
Fig. 1 is please referred to, Fig. 1 is a kind of process flow of the write operation control method based on bedding storage provided by the invention
Figure, this method include:
Step S11:When receiving write operation requests, the type in the corresponding base ponds of data to be written is judged;
It should be noted that memory space, can be divided into different storage levels by bedding storage, also known as classification storage
Not, it is placed the data according to hierarchical storage management strategy in different storage ranks, meets user to processing speed, conveyor
The diverse requirements of width and memory capacity rationally utilize memory space, promotion storage system access performance, reduction totality portion to reach
Affix one's name to the purpose of cost.
It needs to establish different disk pools when layer functions are configured, different types of storage medium is configured.Based on this, divide
The distributed file system of layer storage at least needs 3 ponds, 1 metadata pond, 1 standby pond, 1 cache pool, wherein, 1
A pond corresponds to a kind of redundancy rule, and general metadata pond is copy pond, and standby pond is to entangle to delete pond or copy pond, cache pool and be
Copy pond.Caching of the cache pool as standby pond, for client, cache pool is sightless.
In addition, hierarchical storage management strategy here can support the corresponding data of read operation request that can be accessed according to nearest
The mechanism that time is upgraded:For read operation request, if it is the data in last access time, data are upgraded, it is no
Do not upgrade then.The mechanism reduces the frequency of moving back of data, reduces unnecessary data and moves back caused system loss, simultaneously
Also improve the service life of high-performance storage device.Hierarchical storage management strategy can also support the height based on memory space
Water level method, high-low water level method require to monitor storage device in real time using space, judge making for high-performance storage device
Whether reach certain watermark threshold with space, when use space reach watermark threshold when triggering perform data migration operation.
Step S12:If pond is deleted in base ponds to entangle, the type of the corresponding write operation of write operation requests is judged, grasped when writing
When being write as covering, data write-in cache ponds are written into, and base ponds are written in data to be written in the form of entangling and delete;Such as
Fruit base ponds are copy pond, then are written into data write-in cache ponds, and base is written in data to be written in the form of copy
Pond.
Specifically, it is contemplated that entangle and deleted rolling back action, for example entangle and delete 4+2, a data are cut into 4 parts, generate 2 parts of verifications
The disk of 6 nodes can be written in code, 6 parts of data, and 6 divided datas are all write as work(and are just counted as work(, if the write-in failure of some node,
Entire write operation is exactly failure, it is necessary to roll back to the state before write-in, the node that otherwise will be had is new data, is had
Node is the situation of legacy data, causes the data preserved on disk and practical data inconsistent.
Therefore, base ponds are when entangling to delete pond, need the type of the corresponding write operation of write operation requests for judging to receive, when
When write operation is write for covering, returned, and data to be written are acted on behalf of in the form of entangling and deleting after being written into data write-in cache ponds
Base ponds are written, it is seen then that this partial data preserved in cache ponds and base ponds is consistent, so as to reduce cache ponds
Data Migration pressure during water level is reached using space so that distributed file system can keep a smoother performance.
In addition, under writeback patterns, no longer waited when caching is not hit by, in the application the object from base ponds promoted (promote) to
In cache ponds, cache ponds are then written, but directly writes the data to cache ponds and acts on behalf of write-in base ponds, reduces and writes
The delay of operation improves the performance of write operation.It is write if write operation is not covering, for example is that modification is write, then continue to use existing skill
The method of art, judges whether caching hits, and during cache hit, the data to be modified directly in modification cache ponds, caching is not hit by
When, data to be modified are promoted from base ponds to cache ponds, data to be modified are changed in cache ponds.
Specifically, copy is not needed to data slicer, and write-in is all the whole complete data of part, has a data to be written
Even if success success, without rolling back action, so the type without distinguishing write operation.Based on this, when base ponds are copy ponds, directly
It connects and is returned, and data to be written are acted on behalf of in the form of copy write-in base ponds after being written into data write-in cache ponds.
This partial data preserved in cache ponds and base ponds is consistent, reduce cache ponds using space reach water level when
Data Migration pressure so that distributed file system can keep a smoother performance, mitigate distributed file system
The defects of initial performance is high, follow-up performance is low.
The present invention provides a kind of write operation control method based on bedding storage, including:Receiving write operation requests
When, judge the type in the corresponding base ponds of data to be written;If pond is deleted in base ponds to entangle, judge that write operation requests are corresponding
The type of write operation when write operation is write for covering, is written into data write-in cache ponds, and data to be written are deleted to entangle
Form write-in base ponds;If base ponds are copy pond, data write-in cache ponds are written into, and data to be written
Base ponds are written in the form of copy.
The high follow-up performance of middle distributed file system initial performance is low compared with the prior art, in the application client to
Write operation is initiated in cache ponds, when reaching the preset standard of base ponds type and write operation type, is written into data write-in
Cache ponds, while data to be written write-in base ponds so that this partial data preserved in cache ponds and base ponds is one
It causes, so as to reduce Data Migration pressure when cache ponds use space arrival water level, distributed file system is made to keep one
A smoother performance, improves user experience.
On the basis of above-described embodiment:
As a kind of preferred embodiment, the process for judging the type of the corresponding write operation of write operation requests is specially:
The type of the corresponding write operation of init_op_flags functions acquisition write operation requests is called in do_op.
Specifically, it when the type of the corresponding write operation of write operation requests is judged in the application, is directly called in do_op
Init_op_flags functions come determine the corresponding write operation of write operation requests whether be covering write, function call result can be bright
True display write operation type to carry out corresponding subsequent operation, and realizes that simply development difficulty is relatively low, shortens exploitation
Time, so as to reduce enterprise's production cost.
As a kind of preferred embodiment, data to be written by entangle delete or copy in the form of base ponds are written process have
Body is:
Call do_proxy_write functions directly data to be written by entangle delete or copy in the form of base ponds are written.
Specifically, if pond is deleted in base ponds to entangle, and write operation is write for covering, then calls do_proxy_write functions straight
It connects and base ponds is written in data to be written in the form of entangling and delete.If base ponds are copy pond, do_proxy_write is called
Directly base ponds are written in data to be written by function in the form of copy.Do_proxy_write functions is called to realize agency in this way
Write mode, it is relatively more flexible, it is applied widely.
As a kind of preferred embodiment, call do_proxy_write functions that directly data to be written are deleted or secondary to entangle
Before this form write-in base ponds, this method further includes:
Call maybe_handle_cache functions encapsulation maybe_handle_cache_detail functions;
The introducing of maybe_handle_cache_detail functions is called to act on behalf of write mode.
Specifically, call do_proxy_write functions directly treating in order to which agency's write-in is better achieved, in the application
Write-in data by entangle delete or copy in the form of base ponds are written before, can also carry out some initial works, specifically, call
Maybe_handle_cache functions encapsulate maybe_handle_cache_detail functions, then call maybe_handle_
Write mode is acted on behalf of in cache_detail functions (entrance function that agency writes) introducing.
Fig. 2 is please referred to, Fig. 2 is a kind of structural representation of the write operation control system based on bedding storage provided by the invention
Figure, the system include:
Judgment module 1, for when receiving write operation requests, judging the type in the corresponding base ponds of data to be written;
If pond is deleted in base ponds to entangle, triggering, which entangles to delete, acts on behalf of writing unit 2, if base ponds are copy pond, triggers replica agent
Writing unit 3;
It entangles to delete and acts on behalf of writing unit 2, for judging the type of the corresponding write operation of write operation requests, when write operation is covering
When writing, data write-in cache ponds are written into, and base ponds are written in data to be written in the form of entangling and delete;
Replica agent writing unit 3, for being written into data write-in cache ponds, and data to be written with copy
Form write-in base ponds.
As a kind of preferred embodiment, entangle to delete and act on behalf of writing unit 2 specifically for calling init_op_ in do_op
Flags functions obtain the type of the corresponding write operation of write operation requests.
As a kind of preferred embodiment, entangle to delete and act on behalf of writing unit 2 or replica agent writing unit 3 specifically for calling
Do_proxy_write functions directly data to be written by entangle delete or copy in the form of base ponds are written.
As a kind of preferred embodiment, which further includes call unit, for calling maybe_handle_cache
Function encapsulates maybe_handle_cache_detail functions;Maybe_handle_cache_detail functions is called to introduce generation
Manage write mode.
Above method embodiment is please referred to for the introduction of system provided by the invention, details are not described herein by the present invention.
The present invention also provides a kind of write operation control device based on bedding storage, including:
Memory, for storing computer program;
Processor, the step of any of the above-described write operation control method is realized during for performing computer program.
Above method embodiment is please referred to for the introduction of device provided by the invention, details are not described herein by the present invention.
The present invention also provides a kind of computer readable storage medium, computer journey is stored on computer readable storage medium
Sequence, when computer program is executed by processor the step of realization any of the above-described write operation control method.
Above method embodiment is please referred to for the introduction of computer readable storage medium provided by the invention, the present invention exists
This is repeated no more.
Each embodiment is described by the way of progressive in this specification, the highlights of each of the examples are with other
The difference of embodiment, just to refer each other for identical similar portion between each embodiment.For system disclosed in embodiment,
For device and storage medium, since it is corresponded to the methods disclosed in the examples, so description is fairly simple, related part
Referring to method part illustration.
It should also be noted that, in the present specification, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, term " comprising ", "comprising" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or equipment including a series of elements not only include that
A little elements, but also including other elements that are not explicitly listed or further include for this process, method, article or
The intrinsic element of equipment.In the absence of more restrictions, the element limited by sentence "including a ...", is not arranged
Except also there are other identical elements in the process including element, method, article or equipment.
The foregoing description of the disclosed embodiments enables professional and technical personnel in the field to realize or use the present invention.
A variety of modifications of these embodiments will be apparent for those skilled in the art, it is as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, it is of the invention
The embodiments shown herein is not intended to be limited to, and is to fit to and the principles and novel features disclosed herein phase one
The most wide range caused.
Claims (10)
1. a kind of write operation control method based on bedding storage, which is characterized in that including:
When receiving write operation requests, the type in the corresponding base ponds of data to be written is judged;
If pond is deleted in the base ponds to entangle, judge the type of the corresponding write operation of the write operation requests, behaviour is write when described
When being write as covering, by the data write-in cache ponds to be written, and institute is written in the data to be written in the form of entangling and delete
State base ponds;
If the base ponds are copy pond, the data to be written are written into cache ponds, and the data to be written with
The base ponds are written in the form of copy.
2. write operation control method according to claim 1, which is characterized in that described to judge that the write operation requests correspond to
The process of type of write operation be specially:
The type of the corresponding write operation of the init_op_flags functions acquisition write operation requests is called in do_op.
3. write operation control method according to claim 1, which is characterized in that described that the data to be written are deleted with entangling
Or the process in the form write-in base ponds of copy is specially:
Call do_proxy_write functions directly the data to be written by entangle delete or copy in the form of the write-in base
Pond.
4. write operation control method according to claim 3, which is characterized in that the calling do_proxy_write functions
Directly the data to be written by entangle delete or copy in the form of before the write-in base ponds, this method further includes:
Call maybe_handle_cache functions encapsulation maybe_handle_cache_detail functions;
The maybe_handle_cache_detail functions introducing is called to act on behalf of write mode.
5. a kind of write operation control system based on bedding storage, which is characterized in that including:
Judgment module, for when receiving write operation requests, judging the type in the corresponding base ponds of data to be written;If institute
It states base ponds and deletes pond to entangle, then triggering, which entangles to delete, acts on behalf of writing unit, if the base ponds are copy pond, triggers replica agent
Writing unit;
It is described entangle to delete act on behalf of writing unit, for judging the type of the corresponding write operation of the write operation requests, behaviour is write when described
When being write as covering, by the data write-in cache ponds to be written, and institute is written in the data to be written in the form of entangling and delete
State base ponds;
The replica agent writing unit, for by the data to be written write-in cache ponds, and the data to be written with
The base ponds are written in the form of copy.
6. write operation control system according to claim 5, which is characterized in that it is described entangle to delete act on behalf of writing unit and specifically use
In the type that the corresponding write operation of the init_op_flags functions acquisition write operation requests is called in do_op.
7. write operation control system according to claim 5, which is characterized in that it is described entangle to delete act on behalf of writing unit or described
Replica agent writing unit is specifically used for calling do_proxy_write functions that directly the data to be written are deleted or secondary to entangle
The base ponds are written in this form.
8. write operation control system according to claim 7, which is characterized in that the system further includes call unit, is used for
Call maybe_handle_cache functions encapsulation maybe_handle_cache_detail functions;Call the maybe_
Write mode is acted on behalf of in the introducing of handle_cache_detail functions.
9. a kind of write operation control device based on bedding storage, which is characterized in that including:
Memory, for storing computer program;
Processor realizes the write operation control method as described in any one of Claims 1-4 during for performing the computer program
The step of.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium
Program, realizing the write operation control method as described in any one of Claims 1-4 when the computer program is executed by processor
Step.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810030038.1A CN108255432A (en) | 2018-01-12 | 2018-01-12 | Write operation control method, system, device and storage medium based on bedding storage |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810030038.1A CN108255432A (en) | 2018-01-12 | 2018-01-12 | Write operation control method, system, device and storage medium based on bedding storage |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108255432A true CN108255432A (en) | 2018-07-06 |
Family
ID=62726343
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810030038.1A Pending CN108255432A (en) | 2018-01-12 | 2018-01-12 | Write operation control method, system, device and storage medium based on bedding storage |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108255432A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115437581A (en) * | 2022-11-08 | 2022-12-06 | 浪潮电子信息产业股份有限公司 | Data processing method, device and equipment and readable storage medium |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102779180A (en) * | 2012-06-29 | 2012-11-14 | 华为技术有限公司 | Operation processing method of data storage system and data storage system |
CN105183384A (en) * | 2015-09-10 | 2015-12-23 | 浪潮(北京)电子信息产业有限公司 | Direct erasure correction implementation method and device |
CN105630418A (en) * | 2015-12-24 | 2016-06-01 | 曙光信息产业(北京)有限公司 | Data storage method and device |
CN105659213A (en) * | 2013-10-18 | 2016-06-08 | 日立数据系统工程英国有限公司 | Target-driven independent data integrity and redundancy recovery in a shared-nothing distributed storage system |
US20160211869A1 (en) * | 2015-01-20 | 2016-07-21 | International Business Machines Corporation | Multiple Erasure Codes for Distributed Storage |
CN106227731A (en) * | 2016-07-06 | 2016-12-14 | 联想(北京)有限公司 | A kind of data processing method, device and distributed file system |
CN106649891A (en) * | 2017-02-24 | 2017-05-10 | 深圳市中博睿存信息技术有限公司 | Distributed data storage method and system |
CN106708653A (en) * | 2016-12-29 | 2017-05-24 | 广州中国科学院软件应用技术研究所 | Mixed tax administration data security protecting method based on erasure code and multi-copy |
CN106775462A (en) * | 2016-11-30 | 2017-05-31 | 郑州云海信息技术有限公司 | A kind of method and apparatus that memory copying is reduced during read-write |
-
2018
- 2018-01-12 CN CN201810030038.1A patent/CN108255432A/en active Pending
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102779180A (en) * | 2012-06-29 | 2012-11-14 | 华为技术有限公司 | Operation processing method of data storage system and data storage system |
CN105659213A (en) * | 2013-10-18 | 2016-06-08 | 日立数据系统工程英国有限公司 | Target-driven independent data integrity and redundancy recovery in a shared-nothing distributed storage system |
US20160211869A1 (en) * | 2015-01-20 | 2016-07-21 | International Business Machines Corporation | Multiple Erasure Codes for Distributed Storage |
CN105183384A (en) * | 2015-09-10 | 2015-12-23 | 浪潮(北京)电子信息产业有限公司 | Direct erasure correction implementation method and device |
CN105630418A (en) * | 2015-12-24 | 2016-06-01 | 曙光信息产业(北京)有限公司 | Data storage method and device |
CN106227731A (en) * | 2016-07-06 | 2016-12-14 | 联想(北京)有限公司 | A kind of data processing method, device and distributed file system |
CN106775462A (en) * | 2016-11-30 | 2017-05-31 | 郑州云海信息技术有限公司 | A kind of method and apparatus that memory copying is reduced during read-write |
CN106708653A (en) * | 2016-12-29 | 2017-05-24 | 广州中国科学院软件应用技术研究所 | Mixed tax administration data security protecting method based on erasure code and multi-copy |
CN106649891A (en) * | 2017-02-24 | 2017-05-10 | 深圳市中博睿存信息技术有限公司 | Distributed data storage method and system |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115437581A (en) * | 2022-11-08 | 2022-12-06 | 浪潮电子信息产业股份有限公司 | Data processing method, device and equipment and readable storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103914516B (en) | A kind of method and system of storage system multi-zone supervision | |
CN103714015B (en) | Method device and system for reducing back invalidation transactions from a snoop filter | |
CN104145252A (en) | Adaptive cache promotions in a two level caching system | |
CN106662981A (en) | Storage device, program, and information processing method | |
CN108647151A (en) | It is a kind of to dodge system metadata rule method, apparatus, equipment and storage medium entirely | |
CN107463509B (en) | Cache management method, cache controller and computer system | |
US20130145095A1 (en) | Melthod and system for integrating the functions of a cache system with a storage tiering system | |
US7039765B1 (en) | Techniques for cache memory management using read and write operations | |
CN108920387A (en) | Reduce method, apparatus, computer equipment and the storage medium of read latency | |
JP6711121B2 (en) | Information processing apparatus, cache memory control method, and cache memory control program | |
CN103345368B (en) | Data caching method in buffer storage | |
CN107615254A (en) | The cache memory architectures and algorithm of blending objects storage device | |
CN103257932A (en) | Method and system for managing data in computer readable cache system | |
CN109213420A (en) | Date storage method, apparatus and system | |
CN112051968B (en) | Kafka-based distributed data stream hierarchical cache automatic migration method | |
CN103207840A (en) | Demoting partial tracks from a first cache to a second cache | |
CN112799595B (en) | Data processing method, device and storage medium | |
CN103049393B (en) | Memory headroom management method and device | |
CN110502188A (en) | A kind of date storage method and device based on data base read-write performance | |
CN104040508A (en) | Populating a first stride of tracks from a first cache to write to a second stride in a second cache | |
CN106788468A (en) | A kind of correcting and eleting codes update method and device, electronic equipment | |
US7660948B2 (en) | Arranging and destaging data to holographic storage | |
CN112463054A (en) | Method and equipment for improving read-write performance | |
CN107133183A (en) | A kind of cache data access method and system based on TCMU Virtual Block Devices | |
CN107402819A (en) | The management method and system of a kind of client-cache |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180706 |
|
RJ01 | Rejection of invention patent application after publication |