CN102307221A - Cloud storage system and implementation method thereof - Google Patents
Cloud storage system and implementation method thereof Download PDFInfo
- Publication number
- CN102307221A CN102307221A CN201110074160A CN201110074160A CN102307221A CN 102307221 A CN102307221 A CN 102307221A CN 201110074160 A CN201110074160 A CN 201110074160A CN 201110074160 A CN201110074160 A CN 201110074160A CN 102307221 A CN102307221 A CN 102307221A
- Authority
- CN
- China
- Prior art keywords
- file
- client
- node
- memory node
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to the technical field of Internet information, in particular to a cloud storage system and an implementation method thereof. The cloud storage system comprises more than one metadata server sets and a plurality of data block storage node sets, wherein metadata server sets manage the whole distributed file system, respond an access of a client to a file, receive a writing request of a writing client and distribute the writing request to a storage block or receive a request of a reading client for reading a file and return to a position of a block corresponding to the file; and the reading client reads file blocks from corresponding blocks and combines the file blocks. In a system, the file is divided into one or more blocks; the blocks are scatteredly stored in the data block storage node sets; and storage nodes create, delete and copy the file blocks under the command of metadata servers. In the cloud storage system and the implementation method, the safety and the transmission efficiency are improved due to block redundancy distribution and block balance distribution, and the congestion probability is reduced. The cloud storage system and the implementation method are widely applied to cloud storage systems of enterprises.
Description
Technical field
The present invention relates to the internet information technical field, be specifically related to a kind of cloud storage system and its implementation.
Background technology
Cloud computing is the result that virtual (Virtual ization), effectiveness are calculated (Utility Computing), IaaS (infrastructure is promptly served), PaaS (platform is promptly served), the mixing evolution of SaaS notions such as (software are promptly served) and risen to.It provides a brand-new the Internet commerce services model, promptly the user can through network with as required, the mode that is prone to expansion rents required service.The transmittability of cloud computing techniques make use high speed internet; Resources such as calculating, storage, software, service are transplanted in the extensive high-performance computer of managing concentratedly the Internet, personal computer, the virtual machine from the personal computer that disperses or server, thereby are made the user use these resources as electrification.A kind of new computation schema has been explained in cloud computing: application, data and IT resource offer the user with service manner through network and use.Cloud computing has three distinguishing features: the one, rent as required; The 2nd, the extensively collaborative and resource-sharing the user of wide; The 3rd, resource is effectively allocated.
The cloud storage is in cloud computing (cloud computing) conceptive extension and develops a new notion of coming out; Be meant through functions such as cluster application, grid or distributed file systems; A large amount of various dissimilar memory devices in the network are gathered collaborative work through application software, a system of storage and Operational Visit function externally is provided jointly.When the core of cloud computing system computing and processing is storage and the management of mass data; Just need a large amount of memory device of configuration in the cloud computing system; Cloud computing system just is transformed into a cloud storage system so, is the cloud computing system of core with storage with management so the cloud storage is one.
In today of Internet technology high speed development, the deep development of IT application in enterprises causes enterprise's generation every day great deal of related information data.Traditional NAS (Network Attached Storage; The network storage equipment) storage administration and extended method, for the dispersiveness of enterprise site, the extensibility of storage; The complexity of service logic, all there is more shortcoming the processing aspect of safety of data and historical data.
Data can be deployed on a plurality of memory nodes with redundant fashion in the cloud storage system, improve the read or write speed of system through the memory node distributivity.Because data redundancy distributes, when the individual data node breaks down, system through redundant node also can retrieving system in data, the fail safe that has improved system.In addition, still keeping multifarious today in desktop platform, mobile platform, Web browser inner core, how to solve cross-platform integrated this difficulty, also is the key problem of concern of the presentation layer of storage platform.Move popularizing of technology such as inserting 3G network, metropolitan area WLAN, must promote the business demand that mobile device inserts storage.How that the storage access of mobile environment is effectively unified with the access of Web environment or desktop environment, also need a comprehensive solution.The cloud storage platform generally can realize comprehensive integratedly with the storage of Web storage environment and desktop, realizes that mobile device can indifference inserts the cloud storage platform and file is operated.Safety is divided into two aspects, the i.e. fail safe of the fail safe of background system and front end.The cloud storage platform has certain advantage in these problems of processing.
Summary of the invention
One of technical problem that the present invention solves is to be suitable for the cloud storage system of enterprise application; Have the advantages such as high-throughput that ensure data security, realize data access.
Two of the technical problem that the present invention solves is to provide a kind of implementation method of cloud storage system, can improve fail safe and efficiency of transmission, reduces congested probability; Realize to move, the integrated visit of desktop, Web storage; And can promote transmission and storage security.
The technical scheme that the present invention one of solves the problems of the technologies described above is:
Described cloud storage system includes more than one meta data server set and the set of plurality of data piece memory node;
Comprise an above metadata node in the meta data server set, it is identical to have adding up of data in any two metadata node; Any two metadata set of services are redundant each other; Whole distributed file system of described meta data server aggregate and customer in response end are to the visit of file; Acceptance is write the request of client and is distributed to memory block; Or the request that client is read file is read in acceptance; And the position of the corresponding piece of backspace file, by reading client from corresponding blocks, read back blocks of files and combination;
The data block store node set comprises two above data block store nodes, and the data accumulation that each data block store node set has is identical; Described data block store node set is in charge of incidental storage on the node.
Said cloud storage system also comprises with the monitoring server being the management system of core; Said monitoring server is as the resource unified management device of system; Be responsible for the running status of monitoring metadata node, data block store node, and system's obtaining, distributing metadata.
Two the technical scheme that the present invention solves the problems of the technologies described above is:
Whole distributed file system is in charge of in the set of the meta data server of system, as open, close, Rename file and catalogue, determine blocks of files to arrive the mapping of concrete memory node simultaneously; The data block store node set is in charge of storage subsidiary on the node;
Described internal system is divided into one or more with a file, and these pieces disperse to be stored in the data block store node set; Memory node under the commander of meta data server, carry out blocks of files establishment, delete and duplicate;
Meta data server aggregate response client is to the visit of file; Acceptance is write the request of client and is distributed to memory node; Or accept to read the request that client is read file, and the position of the memory node of backspace file correspondence, by reading client from the blocks of files of reading back the memory node is also made up.
The visit door represents as the foreground of cloud storage system, is responsible for accepting this or that, through calling API cloud storage system is read and write;
The read procedure of described visit door is: accesses meta-data server at first; Obtain the piece distributed intelligence of file; Return to information then and read client; Read client and undertaken alternately by blocks of files distributed intelligence and corresponding data piece memory node, all blocks of files of reading back, and be combined into a complete file; Return to the user through the visit door again;
The process of writing of described visit door is: the client of writing of cloud storage is cached to a local temporary file with file data, and writing by the transparency of application is redirected to this temporary file; The data of accumulating when temporary file surpass a block size, client contacts meta data server; Meta data server inserts filename in the hierarchical structure of file system, and distributes a piece to give it, and the identifier that returns memory node then and object block are to writing client; Writing client writes local temporary files on the memory node of appointment.
Described read operation can be carried out in parallelization.
Described writing in the process, when closing of a file, remaining unwritten data also can be transferred on the memory node of appointment in temporary file, write client then and tell the meta data server file to close; This moment, meta data server was submitted to persistent storage with file creation operation; If meta data server breaks down before closing of a file, then this document will be lost.
7, according to each described implementation method of claim 3 to 6, it is characterized in that: file system is striden the memory node storage, and promptly the blocks of files redundant distributions is in two above memory node set; Client can be read and write each memory node simultaneously;
System becomes the piece sequence with each file storage, and all pieces all are same sizes, and block size can be optimized according to the file size of storage scenarios commonly used.
All pieces of file all can be replicated; The block size of each file and redundancy factor are all configurable; Redundancy factor can dispose in document creation, also can change later on; Duplicating of meta data server management block; It is the memory node of each from cluster reception heartbeat packet and a piece distribution report periodically; This memory node operate as normal is represented in the reception of heartbeat packet, and piece distribution report has comprised the tabulation of going up all piece compositions on this memory node.
System adopts poll to distribute for memory node, and preceding two copies of upload file adopt synchronization mechanism, and the 3rd copy adopts asynchronous; After uploading the client data end of transmission, memory node reports the meta data server fileinfo synchronously, returns the client success after the success.
Expired time of system's lease mechanism agreement, in upload procedure, as long as connection is not unusual, the lease automatic renewal; If aborted appears in client, after expired time, the automatic recovery file state of system;
System adopts dynamic update mechanism, under the non-stop situation of service, Control Node is sent the upgrading order, and the transmission AKU is given other nodes.
System safety adopts the cryptographic system design, and transfer of data is encrypted and is divided into the node communication encryption, and customer data is encrypted; AES in the transfer of data is RC4; The authentication mode of customer end adopted license.
It is the management system of core that system is provided with the monitoring server, and monitoring server is as the resource unified management device of system, the running status of meta data server, memory node set, and system all is to be responsible for by monitoring server to obtaining, distributing of metadata; All data block store servers are also reported state to monitoring server when meta data server is reported heartbeat; Monitoring server is monitored the state of all nodes in real time, can mail or SMS notification keeper when unusual generation.
The present invention is redundant and block balance distribution raising fail safe and efficiency of transmission through piece, reduces congested probability; Have the advantages such as high-throughput that ensure data security, realize data access.
Description of drawings
Below in conjunction with accompanying drawing the present invention is further specified:
Fig. 1 is a system construction drawing of the present invention;
Fig. 2 is a system read-write flow chart of the present invention;
Fig. 3 is that data block of the present invention deposits in and illustration is implemented in the redundant copies distribution;
Fig. 4 is the network design figure that adopts system of the present invention.
Embodiment
As shown in Figure 1, cloud storage system be divided into meta data server set 1 (M0, M1 ..., MN) with data block store node set 2 (S0, S1 ..., SN) two levels.Comprise a plurality of meta data servers in the meta data server set 1, to any two meta data servers, it is identical having adding up of data in each meta data server.Two metadata set of services 1 are redundant each other.The data accumulation that has in same each data block store node set 2 is identical.System can confirm which concrete storage server node subscription client will arrive and read and write according to the client network environment.Meta data server is in charge of the visit to file of whole distributed file system and customer in response end; Acceptance is write the request of client and is distributed to memory block; Or the request that client is read file is read in acceptance; And the position of the corresponding piece of backspace file, by reading client from corresponding blocks, read back blocks of files and combination.The data block store node is being in charge of their subsidiary storages on the node.In inside, a file is divided into one or more in fact, and these pieces disperse to be stored in the data block store node set.Meta data server is responsible for whole distributed file system is managed, and for example opens, closes, Rename file and catalogue, determines the mapping that blocks of files is put to concrete storage successively simultaneously.Memory node under the commander of meta data server, carry out piece establishment, delete and duplicate.Meta data server and memory node all are to be designed to may operate on the machine of common cheapness.System adopts the Java language exploitation, therefore can be deployed on the very large-scale machine.A typical enterprise cloud deployment scenario is that an independent metadata server node is managed a plurality of data block store nodes.
Generally speaking, can have only a node in the meta data server set.Data are generally also built up the data-base cluster form in a plurality of nodes, to improve the metadata read or write speed.Data form a distributed file system in the meta data server set, with most of alternative document system class seemingly, the user can create directory, and creates betwixt, deletes, moves and Rename file.Meta data server is responsible for maintaining file system; Any modification to file system directories and file attribute all will be noted by meta data server; The copy number that comprises file, the number of duplicate of the document is called the redundancy factor of a file, and this information also is to be preserved by meta data server.
As shown in Figure 2, showed data write process and Control Node and the incidence relation that back end took place.
The visit door is that the foreground of cloud storage system represents, and it is responsible for accepting this or that, through calling API (Application Programming Interface, API) cloud storage system is read and write.As scheme the reading and writing client and also be appreciated that to being integrated in the assembly of visit in the door.
The read procedure of visit door: the visit door will be to row read operation during certain file in the system.It is the accesses meta-data server at first, obtains the piece distributed intelligence of file.Return to information then and read client, read client and undertaken alternately by blocks of files distributed intelligence and corresponding data piece memory node, all blocks of files of reading back, and be combined into a complete file.Return to the user through the visit door then.Because piece is distributed on a plurality of nodes simultaneously, so this read operation can be carried out in parallelization.
The process of writing of visit door: the visit door will be uploaded certain file in cloud storage system.In the cloud storage system, write the request of client establishment file and do not issue meta data server in fact immediately.Through portal server, the writing client and can file data be cached to a local temporary file of cloud storage.Writing by the transparency of using is redirected to this temporary file.The data of accumulating when this temporary file surpass a block size, and client just can be got in touch meta data server.Meta data server inserts filename in the hierarchical structure of file system, and distributes a data block to give it, and the identifier that returns memory node then and target data block are to writing client.Writing client writes local temporary files on the memory node of appointment.When closing of a file, remaining unwritten data also can be transferred on the memory node of appointment in temporary file, write client then and tell the meta data server file to close.This moment, meta data server just was submitted to persistent storage with file creation operation.If meta data server breaks down before closing of a file, then this document will be lost.
As scheme a plurality of meta data server information and keep at any time synchronously, promptly many machines each other heat be equipped with, operation is bound external IP with the cluster form simultaneously, and service is provided; After a meta data server was delayed machine, other meta data servers still can provide external service.
In order to improve the stability of whole cloud storage system, in cloud storage system, having designed with the monitoring server is the management system of core.Monitoring server is as the resource unified management device of system, the running status of meta data server, memory node server, and system all is to be responsible for by monitoring server to obtaining, distributing of metadata.All data block store servers are also reported state to monitoring server when meta data server is reported heartbeat.Monitoring server is monitored the state of all nodes in real time, can mail or SMS notification keeper when unusual generation.Monitoring server node not necessarily in whole storage system, cloud storage system also can externally provide service under the situation of monitoring server not having.
As shown in Figure 3, cloud files stored system is designed in an a large amount of memory node set, can stride the mass file system that memory node is stored reliably.Like file that comprises 5 pieces among Fig. 3,5 piece difference redundant distributions are in two memory nodes set.Client can be read and write each memory node simultaneously, thereby promotes read or write speed.System becomes the piece sequence with each file storage, and all pieces all are same sizes, and in order to reduce the information content of piece in the metadata, block size is optimized according to the file size of storage scenarios commonly used in the enterprise.All pieces of file all can be replicated for fault-tolerant.The block size of each file and redundancy factor all are configurable.Redundancy factor like each piece among Fig. 3 is 2.In Fig. 3,, also can read information from other node fast if there is a station server node to break down.Disaster tolerance is done in general each memory node set each other, is distributed in the machine room of diverse location.Redundancy factor can dispose in document creation, also can change later on.The cloud stored files only allows once to write.Duplicating of metadata service affair device full powers management block; It is the memory node of each from cluster reception heartbeat packet and a piece distribution report periodically; This memory node operate as normal is represented in the reception of heartbeat packet, and piece distribution report has comprised the tabulation of going up all piece compositions on this memory node.
Random assignment can cause data skewness weighing apparatus in practical application.If too rely on data balancing (balancer) function, then system burden is overweight.Adopt poll to distribute for memory node, the order assignment strategy can just guarantee the equilibrium issue of data as much as possible at data transfer phase.Cloud storage system adopts the balanced configuration of automaticdata to be used for Provisioning Policy, such as when how many morning every day or linking numbers be less than, carrying out data balancing.Data balancing is according to the data capacity of memory node, in conjunction with the total capacity computing node average size of cloud storage system.
In practical application, several hard disks of a memory node carry are common configurations, and many disks treatment mechanism guarantees only when all hard disks all lost efficacy, just to stop service.When a hard disk broke down, many disks mechanism can be found out all data that belong to this piece hard disk, and reported Control Node institute data trnascription, got rid of the inefficacy hard disk at last.
If what upload file was adopted is synchronization mechanism, is 3 such as the copy factor, then can waits until after all data trnascriptions all transmit completion and just return the client success.On customer experience, can cause the slow excessively sensation of transmission speed like this.The strategy of native system is, preceding two copies adopt synchronization mechanism, and on the basis that has guaranteed data integrity, the 3rd copy adopts asynchronous uploading, and significantly shortens the data upload time.Behind the client data end of transmission, memory node reports the meta data server fileinfo synchronously, returns the client success after the success.
The communications protocol of system all is to be structured on the ICP/IP protocol.Client is connected to meta data server through a configurable port, and is mutual through private client agreement and metadata node.And memory node is to use memory node interaction protocol and metadata node to carry out alternately.Take out a remote procedure call RPC (Remote Procedure Call Protocol, remote procedure call protocol) from client protocol and memory node interaction protocol.In design, meta data server can initiatively not initiated RPC, but response is from the RPC request of client and memory node.Main RPC operation is as shown in the table.
User or certain file of application deletion, this file is not deleted from system at once.On the contrary, system is this file rename, and transfers to/the trash catalogue.When file during also in/trash catalogue, this document can promptly be recovered.The time that file is preserved in/trash is configurable, and when surpassing this time, meta data server will be deleted this document from distributed file system.The deletion of file also will discharge the data block of related this document.Notice, between file is by the increase of user's deletion and system's free space, have a stand-by period delay.When deleted file also be retained in/the trash catalogue in the time, if the user wants to recover this file, can retrieve and browse/trash catalogue and retrieve this document./ trash catalogue is only preserved the last time copy of deleted file./ trash catalogue has nothing different with the alternative document catalogue.
In the cloud storage system practical application, if client in upload procedure because some aborted, can cause file status current in the Control Node to form isolated island.Expired time of lease mechanism agreement, in upload procedure, as long as connection is not unusual, the lease automatic renewal.If aborted appears in client, after expired time, the automatic recovery file state of system.
Cloud storage system is not allow to exist long service disruption, has so just brought certain difficulty to upgrading.System adopts dynamic update machine-processed under such demand, under the non-stop situation of service, Control Node is sent the upgrading order, and the transmission AKU can guarantee the upgrading of whole cluster to other nodes.
The cryptographic system design is adopted in the design of cloud storage security, solves safety problems such as verify data cryptographic integrity by different level.Transfer of data is encrypted and is divided into the node communication encryption, and customer data is encrypted.Whole cloud storage system is supported high performance tailor-made algorithm, and algorithm is replaceable, has realized that different user takes the data of different algorithms protection oneself, and has cut to the mode that safe class is protected.
The authentication mode of customer end adopted license, client license authentication is flexible and changeable, can bind client ip in case of necessity, accomplishes safety guarantee to greatest extent.
License generates and has adopted the RSA asymmetry to encrypt, and RSA adopts 128 high strength algorithms, guarantees that fully license can not forge.Because the generation of license is not a routine operation, so we do not consider algorithm performance.AES in transfer of data is RC4, and RC4 is that symmetry is encrypted.Be that the user can use the license encryption also can use the license deciphering.And the encryption performance of RC4 can not cause data transmission procedure slow excessively than higher.
As shown in Figure 4, in network configuration, meta data server uses common 1000M Ethernet to be connected with the piece storage server.The high-performance of cloud storage system does not rely on a certain machine, and what its utilized is the performance of whole system, piece storage server even can use common PC.And meta data server is as the Centroid of whole system, big internal memory of server requirement and high-performance CPU, and the unique requirement of piece storage server then is that hard drive space is wanted enough greatly.
Claims (20)
1. cloud storage system is characterized in that: described cloud storage system includes more than one meta data server set and the set of plurality of data piece memory node;
Comprise an above metadata node in the meta data server set, it is identical to have adding up of data in any two metadata node; Any two metadata set of services are redundant each other; Whole distributed file system of described meta data server aggregate and customer in response end are to the visit of file; Acceptance is write the request of client and is distributed to memory block; Or the request that client is read file is read in acceptance; And the position of the corresponding piece of backspace file, by reading client from corresponding blocks, read back blocks of files and combination;
The data block store node set comprises two above data block store nodes, and the data accumulation that each data block store node set has is identical; Described data block store node set is in charge of incidental storage on the node.
2. cloud storage system according to claim 1; It is characterized in that: said cloud storage system also comprises with the monitoring server being the management system of core; Said monitoring server is as the resource unified management device of system; Be responsible for the running status of monitoring metadata node, data block store node, and system's obtaining, distributing metadata.
3. the implementation method of the described cloud storage system of claim 1 is characterized in that:
Whole distributed file system is in charge of in the set of the meta data server of system, as open, close, Rename file and catalogue, determine blocks of files to arrive the mapping of concrete memory node simultaneously; The data block store node set is in charge of storage subsidiary on the node;
Described internal system is divided into one or more with a file, and these pieces disperse to be stored in the data block store node set; Memory node under the commander of meta data server, carry out blocks of files establishment, delete and duplicate;
Meta data server aggregate response client is to the visit of file; Acceptance is write the request of client and is distributed to memory node; Or accept to read the request that client is read file, and the position of the memory node of backspace file correspondence, by reading client from the blocks of files of reading back the memory node is also made up.
4. implementation method according to claim 3 is characterized in that: the visit door represents as the foreground of cloud storage system, is responsible for accepting this or that, through calling API cloud storage system is read and write;
The read procedure of described visit door is: accesses meta-data server at first; Obtain the piece distributed intelligence of file; Return to information then and read client; Read client and undertaken alternately by blocks of files distributed intelligence and corresponding data piece memory node, all blocks of files of reading back, and be combined into a complete file; Return to the user through the visit door again;
The process of writing of described visit door is: the client of writing of cloud storage is cached to a local temporary file with file data, and writing by the transparency of application is redirected to this temporary file; The data of accumulating when temporary file surpass a block size, client contacts meta data server; Meta data server inserts filename in the hierarchical structure of file system, and distributes a piece to give it, and the identifier that returns memory node then and object block are to writing client; Writing client writes local temporary files on the memory node of appointment.
5. implementation method according to claim 4 is characterized in that: described read operation can be carried out in parallelization.
6. implementation method according to claim 4; It is characterized in that: described writing in the process; When closing of a file, remaining unwritten data also can be transferred on the memory node of appointment in temporary file, write client then and tell the meta data server file to close; This moment, meta data server was submitted to persistent storage with file creation operation; If meta data server breaks down before closing of a file, then this document will be lost.
7. according to each described implementation method of claim 3 to 6, it is characterized in that: file system is striden the memory node storage, and promptly the blocks of files redundant distributions is in two above memory node set; Client can be read and write each memory node simultaneously;
System becomes the piece sequence with each file storage, and all pieces all are same sizes, but the file size of block size root pick storage scenarios commonly used is optimized.
8. implementation method according to claim 7 is characterized in that: all pieces of file all can be replicated; The block size of each file and redundancy factor are all configurable; Redundancy factor can dispose in document creation, also can change later on; Duplicating of meta data server management block; It is the memory node of each from cluster reception heartbeat packet and a piece distribution report periodically; This memory node operate as normal is represented in the reception of heartbeat packet, and piece distribution report has comprised the tabulation of going up all piece compositions on this memory node.
9. according to each described implementation method of claim 3 to 6, it is characterized in that: system adopts poll to distribute for memory node, and preceding two copies of upload file adopt synchronization mechanism, and the 3rd copy adopts asynchronous; After uploading the client data end of transmission, memory node reports the meta data server fileinfo synchronously, returns the client success after the success.
10. implementation method according to claim 7 is characterized in that: system adopts poll to distribute for memory node, and preceding two copies of upload file adopt synchronization mechanism, and the 3rd copy adopts asynchronous; After uploading the client data end of transmission, memory node reports the meta data server fileinfo synchronously, returns the client success after the success.
11. implementation method according to claim 8 is characterized in that: system adopts poll to distribute for memory node, and preceding two copies of upload file adopt synchronization mechanism, and the 3rd copy adopts asynchronous; After uploading the client data end of transmission, memory node reports the meta data server fileinfo synchronously, returns the client success after the success.
12., it is characterized in that according to each described implementation method of claim 3 to 6: expired time of system's lease mechanism agreement, in upload procedure, as long as connection is not unusual, the lease automatic renewal; If aborted appears in client, after expired time, the automatic recovery file state of system;
System adopts dynamic update mechanism, under the non-stop situation of service, Control Node is sent the upgrading order, and the transmission AKU is given other nodes.
13. implementation method according to claim 7 is characterized in that: expired time of system's lease mechanism agreement, in upload procedure, as long as connection is not unusual, the lease automatic renewal; If aborted appears in client, after expired time, the automatic recovery file state of system;
System adopts dynamic update mechanism, under the non-stop situation of service, Control Node is sent the upgrading order, and the transmission AKU is given other nodes.
14. implementation method according to claim 8 is characterized in that: expired time of system's lease mechanism agreement, in upload procedure, as long as connection is not unusual, the lease automatic renewal; If aborted appears in client, after expired time, the automatic recovery file state of system;
System adopts dynamic update mechanism, under the non-stop situation of service, Control Node is sent the upgrading order, and the transmission AKU is given other nodes.
15. implementation method according to claim 9 is characterized in that: expired time of system's lease mechanism agreement, in upload procedure, as long as connection is not unusual, the lease automatic renewal; If aborted appears in client, after expired time, the automatic recovery file state of system;
System adopts dynamic update mechanism, under the non-stop situation of service, Control Node is sent the upgrading order, and the transmission AKU is given other nodes.
16. implementation method according to claim 10 is characterized in that: expired time of system's lease mechanism agreement, in upload procedure, as long as connection is not unusual, the lease automatic renewal; If aborted appears in client, after expired time, the automatic recovery file state of system;
System adopts dynamic update mechanism, under the non-stop situation of service, Control Node is sent the upgrading order, and the transmission AKU is given other nodes.
17. according to each described implementation method of claim 3 to 6, it is characterized in that: system safety adopts the cryptographic system design, and transfer of data is encrypted and is divided into the node communication encryption, and customer data is encrypted; AES in the transfer of data is RC4; The authentication mode of customer end adopted license.
18. implementation method according to claim 7 is characterized in that: system safety adopts the cryptographic system design, and transfer of data is encrypted and is divided into the node communication encryption, and customer data is encrypted; AES in the transfer of data is RC4; The authentication mode of customer end adopted license.
19. according to each described implementation method of claim 3 to 6; It is characterized in that: it is the management system of core that system is provided with the monitoring server; Monitoring server is as the resource unified management device of system; The running status of meta data server, memory node set, system all is to be responsible for by monitoring server to obtaining, distributing of metadata; All data block store servers are also reported state to monitoring server when meta data server is reported heartbeat; Monitoring server is monitored the state of all nodes in real time, can mail or SMS notification keeper when unusual generation.
20. implementation method according to claim 7; It is characterized in that: it is the management system of core that system is provided with the monitoring server; Monitoring server is as the resource unified management device of system; The running status of meta data server, memory node set, system all is to be responsible for by monitoring server to obtaining, distributing of metadata; All data block store servers are also reported state to monitoring server when meta data server is reported heartbeat; Monitoring server is monitored the state of all nodes in real time, can mail or SMS notification keeper when unusual generation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110074160A CN102307221A (en) | 2011-03-25 | 2011-03-25 | Cloud storage system and implementation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110074160A CN102307221A (en) | 2011-03-25 | 2011-03-25 | Cloud storage system and implementation method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102307221A true CN102307221A (en) | 2012-01-04 |
Family
ID=45381025
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110074160A Pending CN102307221A (en) | 2011-03-25 | 2011-03-25 | Cloud storage system and implementation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102307221A (en) |
Cited By (92)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102571968A (en) * | 2012-01-17 | 2012-07-11 | 华中科技大学 | Directional data forwarding method in cloud backup system |
| CN102694863A (en) * | 2012-05-30 | 2012-09-26 | 电子科技大学 | Realization method of distributed storage system on basis of load adjustment and system fault tolerance |
| CN102694860A (en) * | 2012-05-25 | 2012-09-26 | 北京邦诺存储科技有限公司 | Method, equipment and system for data processing of cloud storage |
| CN102882983A (en) * | 2012-10-22 | 2013-01-16 | 南京云创存储科技有限公司 | Rapid data memory method for improving concurrent visiting performance in cloud memory system |
| CN102904948A (en) * | 2012-09-29 | 2013-01-30 | 南京云创存储科技有限公司 | Super-large-scale low-cost storage system |
| CN103034739A (en) * | 2012-12-29 | 2013-04-10 | 天津南大通用数据技术有限公司 | Distributed memory system and updating and querying method thereof |
| CN103124295A (en) * | 2013-02-28 | 2013-05-29 | 浪潮集团有限公司 | Large attachment uploading and managing method based on cloud computing |
| CN103207867A (en) * | 2012-01-16 | 2013-07-17 | 联想(北京)有限公司 | Method for processing data blocks, method for initiating recovery operation and nodes |
| CN103237046A (en) * | 2013-02-25 | 2013-08-07 | 中国科学院深圳先进技术研究院 | Distributed file system supporting mixed cloud storage application and realization method thereof |
| WO2013127225A1 (en) * | 2012-03-02 | 2013-09-06 | 深圳市朗科科技股份有限公司 | Multi-application cloud storage platform and cloud storage terminal |
| CN103412929A (en) * | 2013-08-16 | 2013-11-27 | 蓝盾信息安全技术股份有限公司 | Mass data storage method |
| WO2013177968A1 (en) * | 2012-05-28 | 2013-12-05 | 华为技术有限公司 | File storage system and device, and file access method |
| CN103490923A (en) * | 2013-09-11 | 2014-01-01 | 中国联合网络通信集团有限公司 | Log file reading and writing method, device and system |
| CN103533006A (en) * | 2012-07-06 | 2014-01-22 | 中兴通讯股份有限公司 | United cloud disk client, server, system and united cloud disk service method |
| CN103581229A (en) * | 2012-07-26 | 2014-02-12 | 腾讯科技（深圳）有限公司 | Distributed file system, file access method and client terminal |
| CN103581332A (en) * | 2013-11-15 | 2014-02-12 | 武汉理工大学 | HDFS framework and pressure decomposition method for NameNodes in HDFS framework |
| CN103581122A (en) * | 2012-07-25 | 2014-02-12 | 腾讯科技（深圳）有限公司 | Data writing-in method, system and device |
| CN103595797A (en) * | 2013-11-18 | 2014-02-19 | 上海爱数软件有限公司 | Caching method for distributed storage system |
| CN103763155A (en) * | 2014-01-24 | 2014-04-30 | 国家电网公司 | Multi-service heartbeat monitoring method for distributed type cloud storage system |
| CN103973731A (en) * | 2013-01-29 | 2014-08-06 | 中兴通讯股份有限公司 | Method and device for managing cloud storage recycle bin |
| CN103973583A (en) * | 2013-01-28 | 2014-08-06 | 中兴通讯股份有限公司 | Load balancing optimizing method and system for distributed file system |
| CN104090891A (en) * | 2013-12-12 | 2014-10-08 | 深圳市腾讯计算机系统有限公司 | Method and device for data processing and server and system for data processing |
| CN104104739A (en) * | 2014-08-08 | 2014-10-15 | 成都致云科技有限公司 | Data synchronization method for metadata service cluster of cloud storage system |
| CN104158863A (en) * | 2014-08-02 | 2014-11-19 | 成都致云科技有限公司 | Cloud storage mechanism based on transaction-level whole-course high-speed buffer |
| WO2014183708A1 (en) * | 2013-12-02 | 2014-11-20 | 中兴通讯股份有限公司 | Method and system for realizing block storage of distributed file system |
| CN104243622A (en) * | 2014-10-21 | 2014-12-24 | 广东轩辕网络科技股份有限公司 | Cloud computing data sharing system and method |
| CN104428761A (en) * | 2012-07-11 | 2015-03-18 | 英派尔科技开发有限公司 | Network congestion reduction |
| CN104471528A (en) * | 2012-04-23 | 2015-03-25 | 谷歌公司 | Associating a file type with an application in a network storage service |
| CN104735109A (en) * | 2013-12-23 | 2015-06-24 | 上海联影医疗科技有限公司 | Medical image data storing system |
| CN104750657A (en) * | 2013-12-31 | 2015-07-01 | 中国石油化工股份有限公司 | Numerical simulation redundancy parallel computing method applicable to fracture-cavity type structure carbonate reservoirs |
| CN104754001A (en) * | 2013-12-30 | 2015-07-01 | 方正宽带网络服务股份有限公司 | Cloud storage system and data storage method |
| CN104954823A (en) * | 2014-03-31 | 2015-09-30 | 华为技术有限公司 | Image calculation pretreatment device, method thereof and system thereof |
| CN105025053A (en) * | 2014-04-24 | 2015-11-04 | 苏宁云商集团股份有限公司 | Distributed file upload method based on cloud storage technology and system |
| CN105025084A (en) * | 2015-06-10 | 2015-11-04 | 国网智能电网研究院 | A cloud storage system based on synchronization agents and mixed storage |
| CN105049504A (en) * | 2015-07-09 | 2015-11-11 | 国云科技股份有限公司 | Big data transit transmission synchronization and storage method |
| CN105100149A (en) * | 2014-05-13 | 2015-11-25 | 中国电信股份有限公司 | Method and system for file management |
| CN105227643A (en) * | 2015-09-11 | 2016-01-06 | 武汉思捷云信息科技有限公司 | A kind of storage emerging system based on cloud storage platform facing video monitoring and method |
| CN105230105A (en) * | 2013-03-20 | 2016-01-06 | 微软技术许可有限责任公司 | For the dynamic interval of synchrodata |
| CN105635278A (en) * | 2015-12-30 | 2016-06-01 | 深圳市瑞驰信息技术有限公司 | Method for managing metadata of storage system and metadata server |
| CN105721527A (en) * | 2014-12-04 | 2016-06-29 | 金蝶软件（中国）有限公司 | Data processing method and server |
| CN105740124A (en) * | 2016-02-01 | 2016-07-06 | 南京邮电大学 | Redundant data filtering method oriented to cloud computing monitoring system |
| CN106027647A (en) * | 2016-05-20 | 2016-10-12 | 云南云电同方科技有限公司 | LXPFS (Linux XProgram File System) cluster distributed file storage system |
| CN106156086A (en) * | 2015-03-31 | 2016-11-23 | 西门子公司 | Hadoop platform system and host node log backup method thereof |
| CN106302659A (en) * | 2016-08-02 | 2017-01-04 | 合肥奇也信息科技有限公司 | A kind of based on cloud storage system promotes access data quick storage method |
| WO2017041654A1 (en) * | 2015-09-09 | 2017-03-16 | 阿里巴巴集团控股有限公司 | Method and apparatus for writing and acquiring data in distributed storage system |
| CN106603729A (en) * | 2017-02-23 | 2017-04-26 | 郑州云海信息技术有限公司 | Distributed-file-system multi-client synchronization method and system thereof |
| CN106815298A (en) * | 2016-12-09 | 2017-06-09 | 中电科华云信息技术有限公司 | Distributed sharing file system based on block storage |
| CN104298574B (en) * | 2014-09-16 | 2017-07-04 | 南京斯坦德云科技股份有限公司 | A kind of data high-speed storage processing system |
| CN107168642A (en) * | 2017-03-30 | 2017-09-15 | 北京奇艺世纪科技有限公司 | A kind of date storage method and system |
| CN107491343A (en) * | 2017-09-08 | 2017-12-19 | 中国电子科技集团公司第二十八研究所 | A kind of across cluster resource scheduling system based on cloud computing |
| CN107613026A (en) * | 2017-10-31 | 2018-01-19 | 四川仕虹腾飞信息技术有限公司 | Distributed file management system based on cloud storage system |
| CN107689876A (en) * | 2016-08-04 | 2018-02-13 | 上海德拓信息技术股份有限公司 | The distribution management method of metadata in distributed objects storage system |
| CN107786670A (en) * | 2017-11-10 | 2018-03-09 | 郑州云海信息技术有限公司 | A kind of system and method that data and cloud storage R. concomitans are locally stored |
| CN108021338A (en) * | 2016-10-31 | 2018-05-11 | 甲骨文国际公司 | It is used for realization the system and method for two layers of committing protocol |
| CN108234465A (en) * | 2017-12-26 | 2018-06-29 | 创新科存储技术有限公司 | Abnormal redundancy approach and device are coped in a kind of distributed file system |
| CN108347466A (en) * | 2017-01-24 | 2018-07-31 | 全球能源互联网研究院 | A kind of date storage method and device of cloud storage system |
| CN108632305A (en) * | 2017-03-16 | 2018-10-09 | 杭州海康威视数字技术股份有限公司 | Cloud storage system, media data storage method and system |
| CN108683729A (en) * | 2018-05-14 | 2018-10-19 | 重庆第二师范学院 | A kind of environmental monitoring data safe storage system and method towards credible cloud |
| CN108717454A (en) * | 2012-04-23 | 2018-10-30 | 谷歌有限责任公司 | The shared file preserved with synchronous electronics |
| CN108829805A (en) * | 2018-06-06 | 2018-11-16 | 福建南威软件有限公司 | A kind of fragment storage method based on MongoDB |
| CN109218340A (en) * | 2017-06-29 | 2019-01-15 | 上海云教信息技术有限公司 | A kind of online data citation system |
| CN109347909A (en) * | 2014-09-01 | 2019-02-15 | 广东电网有限责任公司信息中心 | The working method of PROXZONE service platform |
| CN109542482A (en) * | 2018-11-19 | 2019-03-29 | 郑州云海信息技术有限公司 | A kind of piece of storage service upgrade method, device, equipment and readable storage medium storing program for executing |
| CN109600410A (en) * | 2017-09-30 | 2019-04-09 | 杭州海康威视数字技术股份有限公司 | Data-storage system and method |
| CN109660493A (en) * | 2017-10-11 | 2019-04-19 | 南京南瑞继保电气有限公司 | A kind of new energy collection control cloud storage method based on block chain |
| CN109857445A (en) * | 2017-11-30 | 2019-06-07 | 株式会社日立制作所 | Storage system and control software layout method |
| WO2019144846A1 (en) * | 2018-01-23 | 2019-08-01 | 杭州海康威视系统技术有限公司 | Storage system, and method and apparatus for allocating storage resources |
| CN110515555A (en) * | 2019-05-27 | 2019-11-29 | 杭州前云数据技术有限公司 | High reliability enterprise storage system and reading/writing method based on multichannel object storage service |
| CN110837479A (en) * | 2018-08-17 | 2020-02-25 | 华为技术有限公司 | Data processing method, related device and computer storage medium |
| CN110955641A (en) * | 2019-11-05 | 2020-04-03 | 上海海加网络科技有限公司 | Embedded storage terminal device for distributed file sharing system |
| CN111124301A (en) * | 2019-12-18 | 2020-05-08 | 深圳供电局有限公司 | Data consistency storage method and system of object storage device |
| CN111339192A (en) * | 2020-02-21 | 2020-06-26 | 深圳供电局有限公司 | Distributed edge computing data storage system |
| CN111355775A (en) * | 2019-12-30 | 2020-06-30 | 深圳创新科技术有限公司 | Method, device, equipment and storage medium for judging state of CloudStack cluster sub-server |
| CN111447275A (en) * | 2020-03-26 | 2020-07-24 | 深圳市中盛瑞达科技有限公司 | Storage system and storage device |
| CN111488321A (en) * | 2020-03-05 | 2020-08-04 | 北京联创信安科技股份有限公司 | Management system for storage volume |
| EP3627326A4 (en) * | 2017-06-16 | 2020-10-28 | Huawei Technologies Co., Ltd. | File processing method and mobile terminal |
| CN111858746A (en) * | 2020-05-27 | 2020-10-30 | 武汉瞬付科技有限公司 | Personal data storage system based on cloud platform |
| CN112328444A (en) * | 2020-10-09 | 2021-02-05 | 国家电网有限公司 | Cloud computer management system and management method thereof |
| CN112380182A (en) * | 2020-10-29 | 2021-02-19 | 中科热备(北京)云计算技术有限公司 | Distributed storage method based on disk management mode |
| CN112631520A (en) * | 2020-12-25 | 2021-04-09 | 北京百度网讯科技有限公司 | Distributed block storage system, method, apparatus, device, and medium |
| CN112783419A (en) * | 2019-11-06 | 2021-05-11 | 阿里巴巴集团控股有限公司 | Distributed storage method and device, electronic equipment and storage medium |
| CN112947864A (en) * | 2021-03-29 | 2021-06-11 | 南方电网数字电网研究院有限公司 | Metadata storage method, device, equipment and storage medium |
| CN112948343A (en) * | 2021-03-25 | 2021-06-11 | 兴业数字金融服务（上海）股份有限公司 | Mass content storage system and method based on distributed big data block |
| CN113010486A (en) * | 2021-02-05 | 2021-06-22 | 湖南国科亿存信息科技有限公司 | Metadata layered caching method and device for centerless distributed file system |
| WO2021142768A1 (en) * | 2020-01-17 | 2021-07-22 | 华为技术有限公司 | Method and apparatus for cloning file system |
| CN113296714A (en) * | 2021-06-17 | 2021-08-24 | 杭州海康威视系统技术有限公司 | Data storage system based on NAS protocol |
| CN113422789A (en) * | 2020-03-26 | 2021-09-21 | 山东管理学院 | Service deployment method and system in network computing environment |
| US11223681B2 (en) | 2020-04-10 | 2022-01-11 | Netapp, Inc. | Updating no sync technique for ensuring continuous storage service in event of degraded cluster state |
| CN114785813A (en) * | 2022-06-23 | 2022-07-22 | 四川野马科技有限公司 | Engineering cost COS result file formatting storage method and system |
| CN114827180A (en) * | 2022-06-22 | 2022-07-29 | 蒲惠智造科技股份有限公司 | Distribution method of cloud data distributed storage |
| CN117240873A (en) * | 2023-11-08 | 2023-12-15 | 阿里云计算有限公司 | Cloud storage system, data reading and writing method, device and storage medium |
| CN117240917A (en) * | 2023-11-08 | 2023-12-15 | 阿里云计算有限公司 | Cache type cloud storage system, data read-write method, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1633086A (en) * | 2005-01-26 | 2005-06-29 | 北京大学 | Online backup method based on data block redundancy and virtualized storage |
| CN101692239A (en) * | 2009-10-19 | 2010-04-07 | 浙江大学 | Method for distributing metadata of distributed type file system |
| CN101901275A (en) * | 2010-08-23 | 2010-12-01 | 华中科技大学 | Distributed storage system and method thereof |
| CN201726424U (en) * | 2009-08-18 | 2011-01-26 | 升东网络科技发展(上海)有限公司 | Distributed storage system |
-
2011
- 2011-03-25 CN CN201110074160A patent/CN102307221A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1633086A (en) * | 2005-01-26 | 2005-06-29 | 北京大学 | Online backup method based on data block redundancy and virtualized storage |
| CN201726424U (en) * | 2009-08-18 | 2011-01-26 | 升东网络科技发展(上海)有限公司 | Distributed storage system |
| CN101692239A (en) * | 2009-10-19 | 2010-04-07 | 浙江大学 | Method for distributing metadata of distributed type file system |
| CN101901275A (en) * | 2010-08-23 | 2010-12-01 | 华中科技大学 | Distributed storage system and method thereof |
Cited By (140)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103207867A (en) * | 2012-01-16 | 2013-07-17 | 联想(北京)有限公司 | Method for processing data blocks, method for initiating recovery operation and nodes |
| CN102571968B (en) * | 2012-01-17 | 2014-09-24 | 华中科技大学 | Directional data forwarding method in cloud backup system |
| CN102571968A (en) * | 2012-01-17 | 2012-07-11 | 华中科技大学 | Directional data forwarding method in cloud backup system |
| WO2013127225A1 (en) * | 2012-03-02 | 2013-09-06 | 深圳市朗科科技股份有限公司 | Multi-application cloud storage platform and cloud storage terminal |
| CN104471528B (en) * | 2012-04-23 | 2019-01-08 | 谷歌有限责任公司 | File type is associated with the application in network storage service |
| CN104471528A (en) * | 2012-04-23 | 2015-03-25 | 谷歌公司 | Associating a file type with an application in a network storage service |
| CN108717454A (en) * | 2012-04-23 | 2018-10-30 | 谷歌有限责任公司 | The shared file preserved with synchronous electronics |
| CN108717454B (en) * | 2012-04-23 | 2022-07-15 | 谷歌有限责任公司 | Sharing and synchronizing electronically stored files |
| CN102694860A (en) * | 2012-05-25 | 2012-09-26 | 北京邦诺存储科技有限公司 | Method, equipment and system for data processing of cloud storage |
| WO2013177968A1 (en) * | 2012-05-28 | 2013-12-05 | 华为技术有限公司 | File storage system and device, and file access method |
| US9405757B2 (en) | 2012-05-28 | 2016-08-02 | Huawei Technologies Co., Ltd. | File storage system, apparatus, and file access method |
| CN102694863B (en) * | 2012-05-30 | 2015-08-26 | 电子科技大学 | Based on the implementation method of the distributed memory system of adjustment of load and System Fault Tolerance |
| CN102694863A (en) * | 2012-05-30 | 2012-09-26 | 电子科技大学 | Realization method of distributed storage system on basis of load adjustment and system fault tolerance |
| CN103533006A (en) * | 2012-07-06 | 2014-01-22 | 中兴通讯股份有限公司 | United cloud disk client, server, system and united cloud disk service method |
| CN103533006B (en) * | 2012-07-06 | 2019-09-24 | 中兴通讯股份有限公司 | A kind of joint cloud disk client, server, system and joint cloud disk service method |
| CN104428761A (en) * | 2012-07-11 | 2015-03-18 | 英派尔科技开发有限公司 | Network congestion reduction |
| US10002027B2 (en) | 2012-07-11 | 2018-06-19 | Empire Technology Development Llc | Network congestion reduction |
| CN104428761B (en) * | 2012-07-11 | 2017-08-15 | 英派尔科技开发有限公司 | The reduction of network congestion |
| CN103581122A (en) * | 2012-07-25 | 2014-02-12 | 腾讯科技（深圳）有限公司 | Data writing-in method, system and device |
| CN103581122B (en) * | 2012-07-25 | 2018-01-16 | 腾讯科技（深圳）有限公司 | Wiring method, system and the device of data |
| CN103581229A (en) * | 2012-07-26 | 2014-02-12 | 腾讯科技（深圳）有限公司 | Distributed file system, file access method and client terminal |
| CN103581229B (en) * | 2012-07-26 | 2018-06-15 | 腾讯科技（深圳）有限公司 | Distributed file system, file access method and client |
| CN102904948A (en) * | 2012-09-29 | 2013-01-30 | 南京云创存储科技有限公司 | Super-large-scale low-cost storage system |
| CN102882983A (en) * | 2012-10-22 | 2013-01-16 | 南京云创存储科技有限公司 | Rapid data memory method for improving concurrent visiting performance in cloud memory system |
| CN102882983B (en) * | 2012-10-22 | 2015-06-10 | 南京云创存储科技有限公司 | Rapid data memory method for improving concurrent visiting performance in cloud memory system |
| CN103034739A (en) * | 2012-12-29 | 2013-04-10 | 天津南大通用数据技术有限公司 | Distributed memory system and updating and querying method thereof |
| CN103973583A (en) * | 2013-01-28 | 2014-08-06 | 中兴通讯股份有限公司 | Load balancing optimizing method and system for distributed file system |
| WO2014117513A1 (en) * | 2013-01-29 | 2014-08-07 | 中兴通讯股份有限公司 | Method and device for managing recycle bin of cloud storage |
| CN103973731B (en) * | 2013-01-29 | 2017-12-29 | 中兴通讯股份有限公司 | The recycle bin management method and device of a kind of cloud storage |
| CN103973731A (en) * | 2013-01-29 | 2014-08-06 | 中兴通讯股份有限公司 | Method and device for managing cloud storage recycle bin |
| CN103237046B (en) * | 2013-02-25 | 2016-08-17 | 中国科学院深圳先进技术研究院 | Support distributed file system and the implementation method of mixed cloud storage application |
| CN103237046A (en) * | 2013-02-25 | 2013-08-07 | 中国科学院深圳先进技术研究院 | Distributed file system supporting mixed cloud storage application and realization method thereof |
| CN103124295A (en) * | 2013-02-28 | 2013-05-29 | 浪潮集团有限公司 | Large attachment uploading and managing method based on cloud computing |
| CN105230105A (en) * | 2013-03-20 | 2016-01-06 | 微软技术许可有限责任公司 | For the dynamic interval of synchrodata |
| CN103412929A (en) * | 2013-08-16 | 2013-11-27 | 蓝盾信息安全技术股份有限公司 | Mass data storage method |
| CN103490923A (en) * | 2013-09-11 | 2014-01-01 | 中国联合网络通信集团有限公司 | Log file reading and writing method, device and system |
| CN103581332B (en) * | 2013-11-15 | 2017-05-24 | 武汉理工大学 | HDFS framework and pressure decomposition method for NameNodes in HDFS framework |
| CN103581332A (en) * | 2013-11-15 | 2014-02-12 | 武汉理工大学 | HDFS framework and pressure decomposition method for NameNodes in HDFS framework |
| CN103595797A (en) * | 2013-11-18 | 2014-02-19 | 上海爱数软件有限公司 | Caching method for distributed storage system |
| CN103595797B (en) * | 2013-11-18 | 2017-01-18 | 上海爱数信息技术股份有限公司 | Caching method for distributed storage system |
| CN104679665A (en) * | 2013-12-02 | 2015-06-03 | 中兴通讯股份有限公司 | Method and system for achieving block storage of distributed file system |
| WO2014183708A1 (en) * | 2013-12-02 | 2014-11-20 | 中兴通讯股份有限公司 | Method and system for realizing block storage of distributed file system |
| CN104090891A (en) * | 2013-12-12 | 2014-10-08 | 深圳市腾讯计算机系统有限公司 | Method and device for data processing and server and system for data processing |
| CN104090891B (en) * | 2013-12-12 | 2016-05-04 | 深圳市腾讯计算机系统有限公司 | Data processing method, Apparatus and system |
| CN104735109A (en) * | 2013-12-23 | 2015-06-24 | 上海联影医疗科技有限公司 | Medical image data storing system |
| CN104754001A (en) * | 2013-12-30 | 2015-07-01 | 方正宽带网络服务股份有限公司 | Cloud storage system and data storage method |
| CN104750657A (en) * | 2013-12-31 | 2015-07-01 | 中国石油化工股份有限公司 | Numerical simulation redundancy parallel computing method applicable to fracture-cavity type structure carbonate reservoirs |
| CN103763155A (en) * | 2014-01-24 | 2014-04-30 | 国家电网公司 | Multi-service heartbeat monitoring method for distributed type cloud storage system |
| CN104954823B (en) * | 2014-03-31 | 2018-06-15 | 华为技术有限公司 | A kind of figure calculates the device of pretreatment, method and system |
| WO2015149587A1 (en) * | 2014-03-31 | 2015-10-08 | 华为技术有限公司 | Graph calculation preprocessing device, method and system |
| CN104954823A (en) * | 2014-03-31 | 2015-09-30 | 华为技术有限公司 | Image calculation pretreatment device, method thereof and system thereof |
| CN105025053A (en) * | 2014-04-24 | 2015-11-04 | 苏宁云商集团股份有限公司 | Distributed file upload method based on cloud storage technology and system |
| CN105100149A (en) * | 2014-05-13 | 2015-11-25 | 中国电信股份有限公司 | Method and system for file management |
| CN104158863A (en) * | 2014-08-02 | 2014-11-19 | 成都致云科技有限公司 | Cloud storage mechanism based on transaction-level whole-course high-speed buffer |
| CN104104739A (en) * | 2014-08-08 | 2014-10-15 | 成都致云科技有限公司 | Data synchronization method for metadata service cluster of cloud storage system |
| CN109347909A (en) * | 2014-09-01 | 2019-02-15 | 广东电网有限责任公司信息中心 | The working method of PROXZONE service platform |
| CN104298574B (en) * | 2014-09-16 | 2017-07-04 | 南京斯坦德云科技股份有限公司 | A kind of data high-speed storage processing system |
| CN104243622A (en) * | 2014-10-21 | 2014-12-24 | 广东轩辕网络科技股份有限公司 | Cloud computing data sharing system and method |
| CN104243622B (en) * | 2014-10-21 | 2017-11-10 | 广东轩辕网络科技股份有限公司 | Cloud computing data-sharing systems and method |
| CN105721527A (en) * | 2014-12-04 | 2016-06-29 | 金蝶软件（中国）有限公司 | Data processing method and server |
| CN106156086A (en) * | 2015-03-31 | 2016-11-23 | 西门子公司 | Hadoop platform system and host node log backup method thereof |
| CN105025084A (en) * | 2015-06-10 | 2015-11-04 | 国网智能电网研究院 | A cloud storage system based on synchronization agents and mixed storage |
| CN105025084B (en) * | 2015-06-10 | 2018-11-16 | 国网智能电网研究院 | A kind of cloud storage system based on sync agent and mixing storage |
| CN105049504B (en) * | 2015-07-09 | 2019-03-05 | 国云科技股份有限公司 | A kind of big data transfer transmission is synchronous and storage method |
| CN105049504A (en) * | 2015-07-09 | 2015-11-11 | 国云科技股份有限公司 | Big data transit transmission synchronization and storage method |
| CN106527958A (en) * | 2015-09-09 | 2017-03-22 | 阿里巴巴集团控股有限公司 | Data writing and obtaining methods and devices used for distributed storage system |
| WO2017041654A1 (en) * | 2015-09-09 | 2017-03-16 | 阿里巴巴集团控股有限公司 | Method and apparatus for writing and acquiring data in distributed storage system |
| CN106527958B (en) * | 2015-09-09 | 2020-03-10 | 阿里巴巴集团控股有限公司 | Method and equipment for writing data and acquiring data for distributed storage system |
| US10599337B2 (en) | 2015-09-09 | 2020-03-24 | Alibaba Group Holding Limited | Method and device for writing data and acquiring data in a distributed storage system |
| CN105227643A (en) * | 2015-09-11 | 2016-01-06 | 武汉思捷云信息科技有限公司 | A kind of storage emerging system based on cloud storage platform facing video monitoring and method |
| CN105635278A (en) * | 2015-12-30 | 2016-06-01 | 深圳市瑞驰信息技术有限公司 | Method for managing metadata of storage system and metadata server |
| CN105740124B (en) * | 2016-02-01 | 2018-05-08 | 南京邮电大学 | A kind of redundant data filter method towards cloud computing monitoring system |
| CN105740124A (en) * | 2016-02-01 | 2016-07-06 | 南京邮电大学 | Redundant data filtering method oriented to cloud computing monitoring system |
| CN106027647A (en) * | 2016-05-20 | 2016-10-12 | 云南云电同方科技有限公司 | LXPFS (Linux XProgram File System) cluster distributed file storage system |
| CN106027647B (en) * | 2016-05-20 | 2019-07-09 | 云南云电同方科技有限公司 | The cluster distributed document storage system of LXPFS |
| CN106302659A (en) * | 2016-08-02 | 2017-01-04 | 合肥奇也信息科技有限公司 | A kind of based on cloud storage system promotes access data quick storage method |
| CN107689876A (en) * | 2016-08-04 | 2018-02-13 | 上海德拓信息技术股份有限公司 | The distribution management method of metadata in distributed objects storage system |
| CN108021338B (en) * | 2016-10-31 | 2023-12-19 | 甲骨文国际公司 | System and method for implementing a two-layer commit protocol |
| CN108021338A (en) * | 2016-10-31 | 2018-05-11 | 甲骨文国际公司 | It is used for realization the system and method for two layers of committing protocol |
| CN106815298A (en) * | 2016-12-09 | 2017-06-09 | 中电科华云信息技术有限公司 | Distributed sharing file system based on block storage |
| CN108347466A (en) * | 2017-01-24 | 2018-07-31 | 全球能源互联网研究院 | A kind of date storage method and device of cloud storage system |
| CN106603729A (en) * | 2017-02-23 | 2017-04-26 | 郑州云海信息技术有限公司 | Distributed-file-system multi-client synchronization method and system thereof |
| CN108632305A (en) * | 2017-03-16 | 2018-10-09 | 杭州海康威视数字技术股份有限公司 | Cloud storage system, media data storage method and system |
| CN107168642A (en) * | 2017-03-30 | 2017-09-15 | 北京奇艺世纪科技有限公司 | A kind of date storage method and system |
| US11868314B2 (en) | 2017-06-16 | 2024-01-09 | Huawei Technologies Co., Ltd. | File processing method and mobile terminal |
| EP3627326A4 (en) * | 2017-06-16 | 2020-10-28 | Huawei Technologies Co., Ltd. | File processing method and mobile terminal |
| US11468008B2 (en) | 2017-06-16 | 2022-10-11 | Huawei Technologies Co., Ltd. | File processing method and mobile terminal |
| CN109218340A (en) * | 2017-06-29 | 2019-01-15 | 上海云教信息技术有限公司 | A kind of online data citation system |
| CN107491343B (en) * | 2017-09-08 | 2020-04-17 | 中电莱斯信息系统有限公司 | Cross-cluster resource scheduling system based on cloud computing |
| CN107491343A (en) * | 2017-09-08 | 2017-12-19 | 中国电子科技集团公司第二十八研究所 | A kind of across cluster resource scheduling system based on cloud computing |
| CN109600410A (en) * | 2017-09-30 | 2019-04-09 | 杭州海康威视数字技术股份有限公司 | Data-storage system and method |
| CN109660493A (en) * | 2017-10-11 | 2019-04-19 | 南京南瑞继保电气有限公司 | A kind of new energy collection control cloud storage method based on block chain |
| CN109660493B (en) * | 2017-10-11 | 2020-12-18 | 南京南瑞继保电气有限公司 | New energy centralized control cloud storage method based on block chain |
| CN107613026A (en) * | 2017-10-31 | 2018-01-19 | 四川仕虹腾飞信息技术有限公司 | Distributed file management system based on cloud storage system |
| CN107786670A (en) * | 2017-11-10 | 2018-03-09 | 郑州云海信息技术有限公司 | A kind of system and method that data and cloud storage R. concomitans are locally stored |
| CN109857445A (en) * | 2017-11-30 | 2019-06-07 | 株式会社日立制作所 | Storage system and control software layout method |
| CN109857445B (en) * | 2017-11-30 | 2022-06-10 | 株式会社日立制作所 | Storage system and control software configuration method |
| CN108234465A (en) * | 2017-12-26 | 2018-06-29 | 创新科存储技术有限公司 | Abnormal redundancy approach and device are coped in a kind of distributed file system |
| WO2019144846A1 (en) * | 2018-01-23 | 2019-08-01 | 杭州海康威视系统技术有限公司 | Storage system, and method and apparatus for allocating storage resources |
| US11403009B2 (en) | 2018-01-23 | 2022-08-02 | Hangzhou Hikivision System Technology Co., Ltd. | Storage system, and method and apparatus for allocating storage resources |
| CN108683729A (en) * | 2018-05-14 | 2018-10-19 | 重庆第二师范学院 | A kind of environmental monitoring data safe storage system and method towards credible cloud |
| CN108829805A (en) * | 2018-06-06 | 2018-11-16 | 福建南威软件有限公司 | A kind of fragment storage method based on MongoDB |
| CN110837479A (en) * | 2018-08-17 | 2020-02-25 | 华为技术有限公司 | Data processing method, related device and computer storage medium |
| CN110837479B (en) * | 2018-08-17 | 2023-09-01 | 华为云计算技术有限公司 | Data processing method, related equipment and computer storage medium |
| CN109542482A (en) * | 2018-11-19 | 2019-03-29 | 郑州云海信息技术有限公司 | A kind of piece of storage service upgrade method, device, equipment and readable storage medium storing program for executing |
| CN110515555A (en) * | 2019-05-27 | 2019-11-29 | 杭州前云数据技术有限公司 | High reliability enterprise storage system and reading/writing method based on multichannel object storage service |
| CN110515555B (en) * | 2019-05-27 | 2023-03-14 | 杭州前云数据技术有限公司 | High-reliability enterprise-level storage system based on multi-path object storage service and read-write method |
| CN110955641A (en) * | 2019-11-05 | 2020-04-03 | 上海海加网络科技有限公司 | Embedded storage terminal device for distributed file sharing system |
| CN112783419A (en) * | 2019-11-06 | 2021-05-11 | 阿里巴巴集团控股有限公司 | Distributed storage method and device, electronic equipment and storage medium |
| CN111124301B (en) * | 2019-12-18 | 2024-02-23 | 深圳供电局有限公司 | Data consistency storage method and system of object storage device |
| CN111124301A (en) * | 2019-12-18 | 2020-05-08 | 深圳供电局有限公司 | Data consistency storage method and system of object storage device |
| CN111355775B (en) * | 2019-12-30 | 2022-11-18 | 深圳创新科技术有限公司 | Method, device, equipment and storage medium for judging state of CloudStack cluster sub-server |
| CN111355775A (en) * | 2019-12-30 | 2020-06-30 | 深圳创新科技术有限公司 | Method, device, equipment and storage medium for judging state of CloudStack cluster sub-server |
| WO2021142768A1 (en) * | 2020-01-17 | 2021-07-22 | 华为技术有限公司 | Method and apparatus for cloning file system |
| CN111339192A (en) * | 2020-02-21 | 2020-06-26 | 深圳供电局有限公司 | Distributed edge computing data storage system |
| CN111488321A (en) * | 2020-03-05 | 2020-08-04 | 北京联创信安科技股份有限公司 | Management system for storage volume |
| CN113422789A (en) * | 2020-03-26 | 2021-09-21 | 山东管理学院 | Service deployment method and system in network computing environment |
| CN113422789B (en) * | 2020-03-26 | 2022-11-25 | 山东管理学院 | Service deployment method and system in network computing environment |
| CN111447275A (en) * | 2020-03-26 | 2020-07-24 | 深圳市中盛瑞达科技有限公司 | Storage system and storage device |
| US11223681B2 (en) | 2020-04-10 | 2022-01-11 | Netapp, Inc. | Updating no sync technique for ensuring continuous storage service in event of degraded cluster state |
| CN111858746A (en) * | 2020-05-27 | 2020-10-30 | 武汉瞬付科技有限公司 | Personal data storage system based on cloud platform |
| CN112328444A (en) * | 2020-10-09 | 2021-02-05 | 国家电网有限公司 | Cloud computer management system and management method thereof |
| CN112380182A (en) * | 2020-10-29 | 2021-02-19 | 中科热备(北京)云计算技术有限公司 | Distributed storage method based on disk management mode |
| CN112631520A (en) * | 2020-12-25 | 2021-04-09 | 北京百度网讯科技有限公司 | Distributed block storage system, method, apparatus, device, and medium |
| CN112631520B (en) * | 2020-12-25 | 2023-09-22 | 北京百度网讯科技有限公司 | Distributed block storage system, method, apparatus, device and medium |
| CN113010486A (en) * | 2021-02-05 | 2021-06-22 | 湖南国科亿存信息科技有限公司 | Metadata layered caching method and device for centerless distributed file system |
| CN113010486B (en) * | 2021-02-05 | 2021-11-26 | 湖南国科亿存信息科技有限公司 | Metadata layered caching method and device for centerless distributed file system |
| CN112948343A (en) * | 2021-03-25 | 2021-06-11 | 兴业数字金融服务（上海）股份有限公司 | Mass content storage system and method based on distributed big data block |
| CN112947864A (en) * | 2021-03-29 | 2021-06-11 | 南方电网数字电网研究院有限公司 | Metadata storage method, device, equipment and storage medium |
| CN112947864B (en) * | 2021-03-29 | 2024-03-08 | 南方电网数字平台科技(广东)有限公司 | Metadata storage method, apparatus, device and storage medium |
| CN113296714A (en) * | 2021-06-17 | 2021-08-24 | 杭州海康威视系统技术有限公司 | Data storage system based on NAS protocol |
| CN113296714B (en) * | 2021-06-17 | 2022-03-04 | 杭州海康威视系统技术有限公司 | Data storage system based on NAS protocol |
| CN114827180A (en) * | 2022-06-22 | 2022-07-29 | 蒲惠智造科技股份有限公司 | Distribution method of cloud data distributed storage |
| CN114827180B (en) * | 2022-06-22 | 2022-09-27 | 蒲惠智造科技股份有限公司 | Distribution method of cloud data distributed storage |
| CN114785813B (en) * | 2022-06-23 | 2022-11-04 | 四川野马科技有限公司 | Engineering cost COS result file formatting storage system |
| CN114785813A (en) * | 2022-06-23 | 2022-07-22 | 四川野马科技有限公司 | Engineering cost COS result file formatting storage method and system |
| CN117240873A (en) * | 2023-11-08 | 2023-12-15 | 阿里云计算有限公司 | Cloud storage system, data reading and writing method, device and storage medium |
| CN117240917A (en) * | 2023-11-08 | 2023-12-15 | 阿里云计算有限公司 | Cache type cloud storage system, data read-write method, equipment and storage medium |
| CN117240873B (en) * | 2023-11-08 | 2024-03-29 | 阿里云计算有限公司 | Cloud storage system, data reading and writing method, device and storage medium |
| CN117240917B (en) * | 2023-11-08 | 2024-04-05 | 阿里云计算有限公司 | Cache type cloud storage system, data read-write method, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102307221A (en) | Cloud storage system and implementation method thereof | |
| TWI737395B (en) | Log-structured storage systems and method | |
| TWI733514B (en) | A storage system, a network node of a blockchain network, and a blockchain-based log-structured storage system | |
| US10387673B2 (en) | Fully managed account level blob data encryption in a distributed storage environment | |
| US10764045B2 (en) | Encrypting object index in a distributed storage environment | |
| TW202117529A (en) | Log-structured storage systems | |
| CN111183420B (en) | Log structured storage system | |
| US10659225B2 (en) | Encrypting existing live unencrypted data using age-based garbage collection | |
| JP6479020B2 (en) | Hierarchical chunking of objects in a distributed storage system | |
| TWI766309B (en) | Log-structured storage systems | |
| US8712982B2 (en) | Virtual multi-cluster clouds | |
| CN111183450B (en) | Log structured storage system | |
| CN111295649B (en) | Log structured storage system | |
| CN105025053A (en) | Distributed file upload method based on cloud storage technology and system | |
| CN103150347A (en) | Dynamic replica management method based on file heat | |
| CN102420854A (en) | Distributed file system facing to cloud storage | |
| Noghabi et al. | Ambry: Linkedin's scalable geo-distributed object store | |
| Zhang et al. | Survey of research on big data storage | |
| CN113449065A (en) | Data deduplication-oriented decentralized storage method and storage device | |
| KR101371202B1 (en) | Distributed file system having multi MDS architecture and method for processing data using the same | |
| Meng et al. | A network load sensitive block placement strategy of HDFS | |
| Klaver et al. | Distributed file system on the SURFnet network Report | |
| Huang et al. | A novel replica placement strategy for data center network | |
| Abead et al. | A HADOOP DISTRIBUTED FILE SYSTEM REPLICATION APPROACH | |
| Meye | Dependability in cloud storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120104 |