CN109327539A - A kind of distributed block storage system and its data routing method - Google Patents
A kind of distributed block storage system and its data routing method Download PDFInfo
- Publication number
- CN109327539A CN109327539A CN201811359816.8A CN201811359816A CN109327539A CN 109327539 A CN109327539 A CN 109327539A CN 201811359816 A CN201811359816 A CN 201811359816A CN 109327539 A CN109327539 A CN 109327539A
- Authority
- CN
- China
- Prior art keywords
- storage
- data
- block
- distributed
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1061—Peer-to-peer [P2P] networks using node-based peer discovery mechanisms
- H04L67/1065—Discovery involving distributed pre-established resource-based relationships among peers, e.g. based on distributed hash tables [DHT]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of distributed block storage system and its data routing methods, storage system includes block storage access client, storage server cluster and the Metadata Service cluster being separately connected by storing network, wherein, block storage access client is converted into the concurrent reading and concurrent writing request to the storage object of different copies for receiving upper layer application read-write requests, and by the upper layer application read-write requests；Storage server cluster includes multiple storage service nodes, for storing data, and responds concurrent reading and concurrent writing request；Metadata Service cluster is used to store the cluster configuration information of the storage server cluster, and monitors the real-time status of storage server cluster；The distributed block storage system carries out data distribution using distributed hash algorithm, and all data objects of storage volume are evenly distributed in all storage service nodes.Compared with prior art, the present invention has many advantages, such as to reduce the delay of read-write requests link transmission, improves distributed memory system performance.
Description
Technical field
The present invention relates to computer distribution type block technical field of memory, more particularly, to a kind of distributed block storage system and
Its data routing method.
Background technique
The fast development of smart machine, social media, Internet of Things brings data explosion formula to increase；On the other hand, increasingly general
And big data apply so that data become push human social development valuable source.In this context, the need of data storage
It asks and just undergoes unprecedented rapid growth.In face of mass data and continual data handling requirements, traditional network storage
Framework is had too many difficulties to cope in performance and capacity；Information Security, business continuance face the challenge；Unit capacity cost is excessively high
It is high.Distributed block storage system uses expansible system architecture, shares all storage loads using more storage servers, leads to
Distributed algorithm positioning storing data is crossed, to improve the reliability of storage system, availability, and is easy to extend.
In distributed block storage system, consider for performance, is generally deposited using copy mechanism and the guarantee of strong consistency principle
Storage system reliability and availability.And traditional copy mechanism generally first will in block storage access client by storing network
Data are sent to the storage server where the data first authentic copy, and the data that the first authentic copy will be written again are sent out by storing network
Write-in result is finally returned to block storage access client by the memory node write-in being sent to where triplicate or even triplicate
Entire writing process is held just to complete.In this way, data write request at least needs data storing transmission over networks twice every time.
This data writing mode makes current block storage service be unable to reach the performance of traditional network storage, is unable to satisfy core business number
According to the random access performance requirement of random access.
Summary of the invention
It is an object of the present invention to overcome the above-mentioned drawbacks of the prior art and provide a kind of distributed blocks to store
System and its data routing method.
The purpose of the present invention can be achieved through the following technical solutions:
A kind of distributed block storage system, the block including being separately connected by storing network store access client, storage
Server cluster and Metadata Service cluster, wherein
Described piece of storage access client turns for receiving upper layer application read-write requests, and by the upper layer application read-write requests
Turn to the concurrent reading and concurrent writing request to the storage object of different copies；
The storage server cluster includes multiple storage service nodes, for storing data, and responds the parallel reading
Write request；
The Metadata Service cluster is used to store the cluster configuration information of the storage server cluster, and described in monitoring
The real-time status of storage server cluster；
The distributed block storage system carries out data distribution using distributed hash algorithm, by all data pair of storage volume
As being evenly distributed in all storage service nodes.
Further, described piece of storage access client includes:
Block device interface unit provides I O access interface for creating Linux block device；
Link transmission unit is stored, for establishing and the connection of the storage service node, the concurrent reading and concurrent writing is transmitted and asks
It asks, the storage link transmission unit is multi-link redundancy transmission unit；
IO routing unit calculates all pairs according to the upper layer application read-write requests for using distributed hash algorithm
Target storage service node where this.
Further, the storage service node includes:
Data recovery unit, for restoring copy data；
Cluster state agency, for the Metadata Service cluster communication and establish heartbeat, obtain cluster state and update；
Date read-write cell, including multiple disks, for realizing data storage.
Further, the trigger condition for restoring copy data includes:
There is storage service node off-line or online；Or there are disk exception or disk to increase in storage service node.
Further, the data recovery unit restores copy data using Pull mode, according to distributed hash algorithm
The data object list for being distributed locally node is calculated, constructs the data object list locally lacked, and read from other nodes
Copy data is taken to be restored to local node.
The present invention also provides a kind of data routing method applied to distributed block storage system as mentioned, including it is following
Step:
1) block storage access client receives upper layer application read-write requests, converts the upper layer application read-write requests to one
The concurrent reading and concurrent writing of a or multiple storage objects is requested；
2) block storage access client calculates the storage clothes where all copies of storage object according to cluster state information
Business node；
3) concurrent reading and concurrent writing request described in corresponding storage service node processing, and processing result is returned into block storage access client
End.
Further, the offset address of block of the upper layer application read-write requests comprising the data to be accessed and data block are long
Degree.
Further, the cluster state information is obtained or is updated one of in the following manner:
A) block storage access client load store volume, when generating block device, according to input parameter from storage server section
Point obtains；
B) block storage access client regularly sends cluster state inquiry request and takes office the storage server node for being intended to line
It obtains and updates；
C) block storage access client is sent according to the cluster state version information for including in the processing result received
It requests to obtain to any online storage service node and update.
Further, when the upper layer application read-write requests are write request, block stores access client and passes through storage net
The storage service node that the concurrent reading and concurrent writing is requested while being sent to where all copies by network；
When the upper layer application read-write requests are read requests, block stores access client, and general is described simultaneously by storing network
Row read-write requests are sent to the storage service node where one of copy according to preference strategy.
Further, when the upper layer application read-write requests are read requests, if block storage access client and storage take
Business node fusion is deployed in same server node, and one of copy then preferentially reads local node pair in local node
Notebook data.
Compared with prior art, the present invention have with following the utility model has the advantages that
1) present invention carries out data distribution using distributed hash algorithm, and all data objects of storage volume are uniformly distributed
Into all storage service nodes, the appearance of hot spot disk or hot spot storage service node is effectively prevented.
2) data of upper layer application read-write requests only need to complete a parallel transmission in storage network, without via master
Copy storage service node synchrodata reduces by a layer network transmission delay and mentions to reduce IO time delay to the second triplicate
High-performance.
3) IO routing unit is integrated by storing access client in block, reduces the delay of read-write requests link transmission, improves
Distributed memory system performance.
4) storage system of the present invention can reduce a data in the time delay of storage network transmission, to improve storage system
Performance.
5) all node data recoveries can carry out simultaneously in storage server cluster, promote resume speed.
6) multi-link redundancy is supported in the connection between block storage access client and storage service node, avoids storing because of block
IO middle-end caused by access client and storage service node connecting link failure, while can also polymerize multilink bandwidth, it mentions
Height volume read-write requests throughput performance.
7) each storage service node device has cluster state to act on behalf of the communication, it can be achieved that with metadata server cluster, and
When obtain cluster state update.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of distributed block storage system of the present invention；
Fig. 2 is that block of the invention stores access client initialization process schematic diagram；
Fig. 3 is the distributed hash data distribution algorithms schematic illustration that distributed block storage system of the present invention uses；
Fig. 4 is write request processing mode flow diagram of the invention.
Specific embodiment
The present invention is described in detail with specific embodiment below in conjunction with the accompanying drawings.The present embodiment is with technical solution of the present invention
Premised on implemented, the detailed implementation method and specific operation process are given, but protection scope of the present invention is not limited to
Following embodiments.
As shown in Figure 1, the present invention provides a kind of distributed block storage system, it is separately connected including by storing network 4
Block stores access client (BAC) 1, storage server cluster 2 and Metadata Service cluster (MDSCluster) 3, wherein block is deposited
Storage access client 1 converts the upper layer application read-write requests to different copies for receiving upper layer application read-write requests
Storage object concurrent reading and concurrent writing request；Storage server cluster 2 includes multiple storage service nodes (IOS), for storing number
According to, and respond concurrent reading and concurrent writing request；Metadata Service cluster 3 is used to store the cluster configuration letter of the storage server cluster
Breath, and monitor the real-time status of storage server cluster.The distributed block storage system using distributed hash (DHT) algorithm into
All data objects of storage volume are evenly distributed in all storage service nodes by row data distribution.
Block storage access client 1 includes that block device interface unit, storage link transmission unit and IO routing unit, block are set
Standby interface unit provides I O access interface for creating Linux block device；Storage link transmission unit is for establishing and storing clothes
The connection of business node, transmission concurrent reading and concurrent writing request, storage link transmission unit is multi-link redundancy transmission unit；IO routing unit
For calculating the target storage service node where all copies according to upper layer application read-write requests, specifically breathed out using distributed
Uncommon algorithm calculates the storage service node where the make the test first authentic copy or even N copy.
Fig. 2 is that block stores access client initialization process schematic diagram.In Fig. 2, interface layer initiation is wrapping with load request, block
Access client is stored according to the volume UUID parameter and storage service nodal information of input, volume inquiry is sent by control link
Request storage service node, and the building volume block device parameter of the volume details by returning, as block device size, type,
Whether Discard etc. is supported；If rolling up inquiry request success, continuation signalling of bouquet status query request to storage service node,
IO routing unit is initialized by the storage server cluster information of return, and establishes I/O link connection, is visited as fruit block stores
It asks client and storage service node that there are multilinks, establishes redundancy I/O link, complete block device creation, reading can be normally carried out
It writes.
Fig. 3 is the distributed hash data distribution algorithms schematic illustration that distributed block storage system of the present invention uses.When
Block storage access client receives the read-write requests of upper layer application, converts the request into the read-write to cluster internal storage object
Request；IO routing unit calculates cryptographic Hash according to corresponding storage object ID, and finds first in data distribution Hash ring
Memory node IOS1 where copy, and the memory node IOS2 where triplicate is thus searched clockwise；If storage section
Point IOS2 and memory node IOS1 are located at the same storage domain, then continue to search clockwise, until finding not in the same storage
The memory node in domain.
Storage service node includes data recovery unit 21, cluster state agency 22 and date read-write cell 23, and data are extensive
Multiple unit 21 is for restoring copy data；Cluster state agency 22 for Metadata Service cluster communication and establish heartbeat, obtain
Cluster state is taken to update；Date read-write cell 23 includes multiple disks, for realizing data storage.
In data recovery unit 21, the trigger condition for restoring copy data includes: to have storage service node off-line or online；
Or there are disk exception or disk increase etc. in storage service node.Data recovery unit 21 restores number of copies using Pull mode
According to calculating the data object list for being distributed locally node according to distributed hash algorithm, construct the data pair locally lacked
As list, and copy data is read from other nodes and is restored to local node.
Data routing method applied to above-mentioned distributed block storage system, comprising the following steps:
1) block storage access client receives upper layer application read-write requests, converts the upper layer application read-write requests to one
The concurrent reading and concurrent writing of a or multiple storage objects is requested, and the upper layer application read-write requests include the offset of the block for the data to be accessed
Address and data block length；
2) block stores access client and calculates storage object according to cluster state information by built-in IO routing unit
Storage service node where all copies, specifically,
When upper layer application read-write requests are write request, block storage access client by storing network asks concurrent reading and concurrent writing
The storage service node being sent to when seeking common ground where all copies；
When upper layer application read-write requests are read requests, block storage access client by storing network asks concurrent reading and concurrent writing
Rooting is sent to the storage service section where one of copy according to preference strategy；
3) corresponding storage service node processing concurrent reading and concurrent writing request, and processing result is returned into block and stores access client；
4) processing result that block storage access client receives all copy storage server nodes carries out integrated treatment, institute
There is copy to be written and successfully then returns to upper layer application success；Different according to storage server node return value, read-write requests may
It needs to be retried according to step 2), or returns to upper layer application read-write failure.
Cluster state information is obtained or is updated one of in the following manner:
A) block storage access client load store volume, when generating block device, according to input parameter from storage server section
Point obtains；
B) block storage access client regularly sends cluster state inquiry request and takes office the storage server node for being intended to line
It obtains and updates；
C) block storage access client sends request according to the cluster state version information for including in the processing result received
It obtains and updates to any online storage service node.
Above-mentioned steps 2) in, when upper layer application read-write requests are read requests, if block storage access client and storage take
Business node fusion is deployed in same server node, and one of copy then preferentially reads local node pair in local node
Notebook data.
Fig. 3 is write request processing mode flow diagram of the invention, specifically: 1. block storage access client receives
Layer application request；2. after IO routing unit calculates the memory node information of all copies of write request, block stores access client
One write request is individually constructed to all copy memory nodes, and sends write request to simultaneously the memory node of place copy；
3. storage service node returns the result, after only all copy write requests all return successfully, write request, which just returns to apply, is write as function.
The preferred embodiment of the present invention has been described in detail above.It should be appreciated that those skilled in the art without
It needs creative work according to the present invention can conceive and makes many modifications and variations.Therefore, all technologies in the art
Personnel are available by logical analysis, reasoning, or a limited experiment on the basis of existing technology under this invention's idea
Technical solution, all should be within the scope of protection determined by the claims.
Claims (10)
1. a kind of distributed block storage system, which is characterized in that including the block storage access visitor being separately connected by storing network
Family end, storage server cluster and Metadata Service cluster, wherein
Described piece of storage access client converts the upper layer application read-write requests to for receiving upper layer application read-write requests
Concurrent reading and concurrent writing request to the storage object of different copies；
The storage server cluster includes multiple storage service nodes, for storing data, and responds the concurrent reading and concurrent writing and asks
It asks；
The Metadata Service cluster is used to store the cluster configuration information of the storage server cluster, and monitors the storage
The real-time status of server cluster；
The distributed block storage system carries out data distribution using distributed hash algorithm, and all data objects of storage volume are equal
It is even to be distributed in all storage service nodes.
2. distributed block storage system according to claim 1, which is characterized in that described piece of storage access client packet
It includes:
Block device interface unit provides I O access interface for creating Linux block device；
Store link transmission unit, for establishes with the connection of the storage service node, transmit the concurrent reading and concurrent writing and request, institute
Stating storage link transmission unit is multi-link redundancy transmission unit；
IO routing unit calculates all copy institutes according to the upper layer application read-write requests for using distributed hash algorithm
Target storage service node.
3. distributed block storage system according to claim 1, which is characterized in that the storage service node includes:
Data recovery unit, for restoring copy data；
Cluster state agency, for the Metadata Service cluster communication and establish heartbeat, obtain cluster state and update；
Date read-write cell, including multiple disks, for realizing data storage.
4. distributed block storage system according to claim 3, which is characterized in that the triggering item for restoring copy data
Part includes:
There is storage service node off-line or online；Or there are disk exception or disk to increase in storage service node.
5. distributed block storage system according to claim 3, which is characterized in that the data recovery unit uses Pull
Mode restores copy data, the data object list for being distributed locally node is calculated according to distributed hash algorithm, building is originally
The data object list of ground missing, and read copy data from other nodes and be restored to local node.
6. a kind of data routing method applied to distributed block storage system as described in claim 1, which is characterized in that packet
Include following steps:
1) block storage access client receives upper layer application read-write requests, convert the upper layer application read-write requests to one or
The concurrent reading and concurrent writing of multiple storage objects is requested；
2) block storage access client calculates the storage service section where all copies of storage object according to cluster state information
Point；
3) concurrent reading and concurrent writing request described in corresponding storage service node processing, and processing result is returned into block and stores access client.
7. the data routing method of distributed block storage system according to claim 6, which is characterized in that answer on the upper layer
It include the offset address and data block length of the block for the data to be accessed with read-write requests.
8. the data routing method of distributed block storage system according to claim 6, which is characterized in that the cluster shape
State information is obtained or is updated one of in the following manner:
A) block storage access client load store volume when generating block device, is obtained according to input parameter from storage server node
It takes；
B) block storage access client regularly send cluster state inquiry request take office be intended to line storage server node obtain
It updates；
C) block storage access client sends request according to the cluster state version information for including in the processing result received
It obtains and updates to any online storage service node.
9. the data routing method of distributed block storage system according to claim 6, which is characterized in that answer on the upper layer
When with read-write requests being write request, the concurrent reading and concurrent writing is requested while being sent by storing network by block storage access client
To the storage service node where all copies；
When the upper layer application read-write requests are read requests, block stores access client by storing network by the parallel reading
Write request is sent to the storage service node where one of copy according to preference strategy.
10. the data routing method of distributed block storage system according to claim 9, which is characterized in that the upper layer
When using read-write requests being read requests, if block storage access client merges with storage service node and is deployed in same server
Node, and one of copy then preferentially reads local node copy data in local node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811359816.8A CN109327539A (en) | 2018-11-15 | 2018-11-15 | A kind of distributed block storage system and its data routing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811359816.8A CN109327539A (en) | 2018-11-15 | 2018-11-15 | A kind of distributed block storage system and its data routing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109327539A true CN109327539A (en) | 2019-02-12 |
Family
ID=65257690
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811359816.8A Pending CN109327539A (en) | 2018-11-15 | 2018-11-15 | A kind of distributed block storage system and its data routing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109327539A (en) |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110221779A (en) * | 2019-05-29 | 2019-09-10 | 清华大学 | The construction method of distributed persistence memory storage system |
| CN111104070A (en) * | 2019-12-24 | 2020-05-05 | 北京同有飞骥科技股份有限公司 | Method and system for realizing data consistency in distributed system |
| CN111212111A (en) * | 2019-12-17 | 2020-05-29 | 腾讯科技（深圳）有限公司 | Object storage service management method and electronic equipment |
| CN111371848A (en) * | 2020-02-21 | 2020-07-03 | 苏州浪潮智能科技有限公司 | Request processing method, device, equipment and storage medium |
| CN111447275A (en) * | 2020-03-26 | 2020-07-24 | 深圳市中盛瑞达科技有限公司 | Storage system and storage device |
| CN111488321A (en) * | 2020-03-05 | 2020-08-04 | 北京联创信安科技股份有限公司 | Management system for storage volume |
| CN111552437A (en) * | 2020-04-22 | 2020-08-18 | 上海天玑科技股份有限公司 | Snapshot method and snapshot device applied to distributed storage system |
| CN111586141A (en) * | 2020-04-30 | 2020-08-25 | 中国工商银行股份有限公司 | Job processing method, device and system and electronic equipment |
| CN111586138A (en) * | 2020-04-30 | 2020-08-25 | 中国工商银行股份有限公司 | Job processing method, device and system and electronic equipment |
| CN111581020A (en) * | 2020-04-22 | 2020-08-25 | 上海天玑科技股份有限公司 | Method and device for data recovery in distributed block storage system |
| CN111866038A (en) * | 2019-04-25 | 2020-10-30 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | Distributed storage dynamic defense system and method based on heterogeneous multiple copies |
| CN112231189A (en) * | 2020-09-11 | 2021-01-15 | 苏州浪潮智能科技有限公司 | Method and device for counting sizes of universal interface layer blocks |
| CN112379768A (en) * | 2020-11-12 | 2021-02-19 | 北京中电兴发科技有限公司 | Power consumption reduction method applied to embedded cloud storage system |
| CN112433678A (en) * | 2020-11-26 | 2021-03-02 | 湖南国科微电子股份有限公司 | Network adjusting method, device, equipment and medium for distributed storage system |
| CN112532701A (en) * | 2020-11-19 | 2021-03-19 | 苏州浪潮智能科技有限公司 | Distributed accelerated storage method and system based on QEMU (quantum execution unit) |
| CN112596960A (en) * | 2020-11-25 | 2021-04-02 | 新华三云计算技术有限公司 | Distributed storage service switching method and device |
| CN112631687A (en) * | 2020-12-31 | 2021-04-09 | 中国农业银行股份有限公司 | Configuration method, device and equipment of service cluster |
| CN112671905A (en) * | 2020-12-23 | 2021-04-16 | 广州三七互娱科技有限公司 | Service scheduling method, device and system |
| CN112733183A (en) * | 2020-12-23 | 2021-04-30 | 苏州浪潮智能科技有限公司 | Method, system and medium for safely accessing designated storage area |
| CN112866406A (en) * | 2021-02-04 | 2021-05-28 | 建信金融科技有限责任公司 | Data storage method, system, device, equipment and storage medium |
| CN113268472A (en) * | 2021-07-15 | 2021-08-17 | 北京华品博睿网络技术有限公司 | Distributed data storage system and method |
| CN113630450A (en) * | 2021-07-26 | 2021-11-09 | 深圳市杉岩数据技术有限公司 | Access control method of distributed storage system and distributed storage system |
| CN113765793A (en) * | 2021-06-07 | 2021-12-07 | 北京京东振世信息技术有限公司 | Data transmission method and device, storage medium and electronic equipment |
| CN114513530A (en) * | 2022-04-19 | 2022-05-17 | 山东省计算中心（国家超级计算济南中心） | Cross-domain storage space bidirectional supply method and system |
| CN114721285A (en) * | 2022-05-24 | 2022-07-08 | 苏州蓝赫朋勃智能科技有限公司 | Distributed home bus system, medium and method and home system applied to distributed home bus system |
| US11709830B2 (en) | 2020-11-25 | 2023-07-25 | Coupang Corp. | Systems and methods for managing a highly available distributed hybrid transactional and analytical database |
| CN116760850A (en) * | 2023-08-17 | 2023-09-15 | 浪潮电子信息产业股份有限公司 | Data processing method, device, equipment, medium and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102024044A (en) * | 2010-12-08 | 2011-04-20 | 华为技术有限公司 | Distributed file system |
| US20120117154A1 (en) * | 2010-11-04 | 2012-05-10 | Hitachi, Ltd. | Method for utilizing heterogeneous storage systems by cooperating with server side storage software |
| CN102867035A (en) * | 2012-08-28 | 2013-01-09 | 浪潮(北京)电子信息产业有限公司 | High-availability method and device of distributed document system cluster |
| CN103929500A (en) * | 2014-05-06 | 2014-07-16 | 刘跃 | Method for data fragmentation of distributed storage system |
| CN104378423A (en) * | 2014-11-13 | 2015-02-25 | 普华基础软件股份有限公司 | Metadata cluster distribution storage system and storage data reading and writing method |
| CN105242881A (en) * | 2015-10-12 | 2016-01-13 | 创新科软件技术（深圳）有限公司 | Distributed storage system and data read-write method for same |
-
2018
- 2018-11-15 CN CN201811359816.8A patent/CN109327539A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120117154A1 (en) * | 2010-11-04 | 2012-05-10 | Hitachi, Ltd. | Method for utilizing heterogeneous storage systems by cooperating with server side storage software |
| CN102024044A (en) * | 2010-12-08 | 2011-04-20 | 华为技术有限公司 | Distributed file system |
| CN102867035A (en) * | 2012-08-28 | 2013-01-09 | 浪潮(北京)电子信息产业有限公司 | High-availability method and device of distributed document system cluster |
| CN103929500A (en) * | 2014-05-06 | 2014-07-16 | 刘跃 | Method for data fragmentation of distributed storage system |
| CN104378423A (en) * | 2014-11-13 | 2015-02-25 | 普华基础软件股份有限公司 | Metadata cluster distribution storage system and storage data reading and writing method |
| CN105242881A (en) * | 2015-10-12 | 2016-01-13 | 创新科软件技术（深圳）有限公司 | Distributed storage system and data read-write method for same |
Cited By (42)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111866038A (en) * | 2019-04-25 | 2020-10-30 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | Distributed storage dynamic defense system and method based on heterogeneous multiple copies |
| CN110221779A (en) * | 2019-05-29 | 2019-09-10 | 清华大学 | The construction method of distributed persistence memory storage system |
| CN111212111A (en) * | 2019-12-17 | 2020-05-29 | 腾讯科技（深圳）有限公司 | Object storage service management method and electronic equipment |
| CN111104070A (en) * | 2019-12-24 | 2020-05-05 | 北京同有飞骥科技股份有限公司 | Method and system for realizing data consistency in distributed system |
| CN111371848A (en) * | 2020-02-21 | 2020-07-03 | 苏州浪潮智能科技有限公司 | Request processing method, device, equipment and storage medium |
| CN111488321A (en) * | 2020-03-05 | 2020-08-04 | 北京联创信安科技股份有限公司 | Management system for storage volume |
| CN111447275A (en) * | 2020-03-26 | 2020-07-24 | 深圳市中盛瑞达科技有限公司 | Storage system and storage device |
| CN111552437A (en) * | 2020-04-22 | 2020-08-18 | 上海天玑科技股份有限公司 | Snapshot method and snapshot device applied to distributed storage system |
| CN111581020B (en) * | 2020-04-22 | 2024-03-19 | 上海天玑科技股份有限公司 | Method and device for recovering data in distributed block storage system |
| CN111552437B (en) * | 2020-04-22 | 2024-03-15 | 上海天玑科技股份有限公司 | Snapshot method and snapshot device applied to distributed storage system |
| CN111581020A (en) * | 2020-04-22 | 2020-08-25 | 上海天玑科技股份有限公司 | Method and device for data recovery in distributed block storage system |
| CN111586138A (en) * | 2020-04-30 | 2020-08-25 | 中国工商银行股份有限公司 | Job processing method, device and system and electronic equipment |
| CN111586138B (en) * | 2020-04-30 | 2022-10-21 | 中国工商银行股份有限公司 | Job processing method, device and system and electronic equipment |
| CN111586141B (en) * | 2020-04-30 | 2023-04-07 | 中国工商银行股份有限公司 | Job processing method, device and system and electronic equipment |
| CN111586141A (en) * | 2020-04-30 | 2020-08-25 | 中国工商银行股份有限公司 | Job processing method, device and system and electronic equipment |
| CN112231189B (en) * | 2020-09-11 | 2022-08-19 | 苏州浪潮智能科技有限公司 | Method and device for counting sizes of universal interface layer blocks |
| CN112231189A (en) * | 2020-09-11 | 2021-01-15 | 苏州浪潮智能科技有限公司 | Method and device for counting sizes of universal interface layer blocks |
| CN112379768A (en) * | 2020-11-12 | 2021-02-19 | 北京中电兴发科技有限公司 | Power consumption reduction method applied to embedded cloud storage system |
| CN112379768B (en) * | 2020-11-12 | 2021-05-18 | 北京中电兴发科技有限公司 | Power consumption reduction method applied to embedded cloud storage system |
| CN112532701A (en) * | 2020-11-19 | 2021-03-19 | 苏州浪潮智能科技有限公司 | Distributed accelerated storage method and system based on QEMU (quantum execution unit) |
| CN112532701B (en) * | 2020-11-19 | 2022-07-15 | 苏州浪潮智能科技有限公司 | Distributed accelerated storage method and system based on QEMU (quantum execution unit) |
| US11709830B2 (en) | 2020-11-25 | 2023-07-25 | Coupang Corp. | Systems and methods for managing a highly available distributed hybrid transactional and analytical database |
| CN112596960B (en) * | 2020-11-25 | 2023-06-13 | 新华三云计算技术有限公司 | Distributed storage service switching method and device |
| CN112596960A (en) * | 2020-11-25 | 2021-04-02 | 新华三云计算技术有限公司 | Distributed storage service switching method and device |
| CN112433678A (en) * | 2020-11-26 | 2021-03-02 | 湖南国科微电子股份有限公司 | Network adjusting method, device, equipment and medium for distributed storage system |
| CN112433678B (en) * | 2020-11-26 | 2022-08-19 | 湖南国科微电子股份有限公司 | Network adjusting method, device, equipment and medium for distributed storage system |
| CN112733183B (en) * | 2020-12-23 | 2023-01-10 | 苏州浪潮智能科技有限公司 | Method, system and medium for safely accessing designated storage area |
| CN112671905B (en) * | 2020-12-23 | 2023-04-28 | 广州三七互娱科技有限公司 | Service scheduling method, device and system |
| CN112671905A (en) * | 2020-12-23 | 2021-04-16 | 广州三七互娱科技有限公司 | Service scheduling method, device and system |
| CN112733183A (en) * | 2020-12-23 | 2021-04-30 | 苏州浪潮智能科技有限公司 | Method, system and medium for safely accessing designated storage area |
| CN112631687A (en) * | 2020-12-31 | 2021-04-09 | 中国农业银行股份有限公司 | Configuration method, device and equipment of service cluster |
| CN112866406B (en) * | 2021-02-04 | 2023-03-24 | 中国建设银行股份有限公司 | Data storage method, system, device, equipment and storage medium |
| CN112866406A (en) * | 2021-02-04 | 2021-05-28 | 建信金融科技有限责任公司 | Data storage method, system, device, equipment and storage medium |
| CN113765793B (en) * | 2021-06-07 | 2023-09-05 | 北京京东振世信息技术有限公司 | Data transmission method and device, storage medium and electronic equipment |
| CN113765793A (en) * | 2021-06-07 | 2021-12-07 | 北京京东振世信息技术有限公司 | Data transmission method and device, storage medium and electronic equipment |
| CN113268472A (en) * | 2021-07-15 | 2021-08-17 | 北京华品博睿网络技术有限公司 | Distributed data storage system and method |
| CN113630450A (en) * | 2021-07-26 | 2021-11-09 | 深圳市杉岩数据技术有限公司 | Access control method of distributed storage system and distributed storage system |
| CN113630450B (en) * | 2021-07-26 | 2024-03-15 | 深圳市杉岩数据技术有限公司 | Access control method of distributed storage system and distributed storage system |
| CN114513530A (en) * | 2022-04-19 | 2022-05-17 | 山东省计算中心（国家超级计算济南中心） | Cross-domain storage space bidirectional supply method and system |
| CN114721285A (en) * | 2022-05-24 | 2022-07-08 | 苏州蓝赫朋勃智能科技有限公司 | Distributed home bus system, medium and method and home system applied to distributed home bus system |
| CN116760850A (en) * | 2023-08-17 | 2023-09-15 | 浪潮电子信息产业股份有限公司 | Data processing method, device, equipment, medium and system |
| CN116760850B (en) * | 2023-08-17 | 2024-01-12 | 浪潮电子信息产业股份有限公司 | Data processing method, device, equipment, medium and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109327539A (en) | A kind of distributed block storage system and its data routing method | |
| CN108268208B (en) | RDMA (remote direct memory Access) -based distributed memory file system | |
| US10530855B2 (en) | Lock state synchronization for non-disruptive persistent operation | |
| US7440977B2 (en) | Recovery method using extendible hashing-based cluster logs in shared-nothing spatial database cluster | |
| US10747746B2 (en) | Efficient read replicas | |
| CN102143215B (en) | Network-based PB level cloud storage system and processing method thereof | |
| CN104111804B (en) | A kind of distributed file system | |
| US6678788B1 (en) | Data type and topological data categorization and ordering for a mass storage system | |
| CN103763383B (en) | Integrated cloud storage system and its storage method | |
| EP2169909B1 (en) | System and method to maintain coherence of cache contents in a multi-tier software system aimed at interfacing large databases | |
| US6691209B1 (en) | Topological data categorization and formatting for a mass storage system | |
| CN106066896B (en) | Application-aware big data deduplication storage system and method | |
| CN111405019B (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN104281506A (en) | Data maintenance method and system for file system | |
| CN104008152A (en) | Distributed file system architectural method supporting mass data access | |
| CN107870829A (en) | A kind of distributed data restoration methods, server, relevant device and system | |
| CN104580226A (en) | Session data sharing system and method | |
| CN108076090A (en) | Data processing method and storage management system | |
| CN112559637B (en) | Data processing method, device, equipment and medium based on distributed storage | |
| CN102833580A (en) | High-definition video application system and method based on infiniband | |
| CN103501319A (en) | Low-delay distributed storage system for small files | |
| CN102023816A (en) | Object storage policy and access method of object storage system | |
| CN109597903A (en) | Image file processing apparatus and method, document storage system and storage medium | |
| CN109726211B (en) | Distributed time sequence database | |
| CN105187565A (en) | Method for utilizing network storage data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190212 |