CN103530388A - Performance improving data processing method in cloud storage system - Google Patents
Performance improving data processing method in cloud storage system Download PDFInfo
- Publication number
- CN103530388A CN103530388A CN201310494892.0A CN201310494892A CN103530388A CN 103530388 A CN103530388 A CN 103530388A CN 201310494892 A CN201310494892 A CN 201310494892A CN 103530388 A CN103530388 A CN 103530388A
- Authority
- CN
- China
- Prior art keywords
- data
- storage system
- online
- client
- data storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the cloud storage field, and discloses a performance improving data processing method in a cloud storage system. The performance improving data processing method relates to a metadata management system, an online data storage system, a near line data storage system, an off-line data storage system and a client terminal. Only control signal transmission is carried out between the metadata management system and the client terminal, storage data flow transmission is not carried out between the metadata management system and the client terminal, and the storage data flow transmission is carried out between the client terminal and the online data storage system. Data are autonomously transmitted among different devices in the cloud storage system so that the devices with different configurations can be effectively used, and the whole use ratio of the cloud storage system is improved. By means of data segmentation, concurrency of data reading and writing is improved, the IOPS and the bandwidth are improved, the reading and writing time is shortened, and the performance is improved. Improvement is carried out on an existing cloud storage system device, the process is completely implemented through software on the basis that hardware accesses are in good conditions, and the implementation and achieving difficulties are small. The performance improving data processing method can be popularized and used on a large data platform.
Description
Technical field
The present invention relates to cloud field of storage, particularly in a kind of cloud storage system, promote the data processing method of access performance.
Technical background
In current IT management, exist ever-increasing data volume, increasing cluster application and cloud storage system are put in actual use, and multi-user, how concurrent visiting demand also get more and more.
But the cloud storage system of prior art is mostly serial storage means, its access response, readwrite performance, also in variation gradually, cannot be tackled many clients' intensive mass memory read-write demand.
Technical matters to be solved by this invention is for the deficiencies in the prior art, and the data processing method of improving performance in a kind of cloud storage system is provided.
Summary of the invention
The technical problem to be solved in the present invention is: the data processing method that improving performance in a kind of cloud storage system is provided.
The technical solution adopted in the present invention is: the data processing method of improving performance in a kind of cloud storage system, comprise metadata management system, online data storage system, near-line data storage system, off-line data storage system and client, as shown in Figure 1,
Wherein, between described metadata management system and client, only carry out the transmission of control signal, do not carry out the transmission of memorying data flow;
Between client and online data storage system, carry out memorying data flow transmission;
Wherein, online data storage system effectiveness is high, and cost is also high, is used for depositing access ratio alive data more frequently, such as hot spot datas such as database, system software, application software;
Near-line data storage system efficiency is medium, and cost is medium, mainly deposits that some are active poor, has visiting demand but non-hot spot data, such as multimedia database, document, backup etc.;
Off-line data storage system cost is low, and access efficiency is low, is mainly used to system filing and backup, is generally used for depositing non-hot spot data.
Comparatively speaking, online data storage system effectiveness can be higher, and cost also can be higher; Near-line data storage system is taken second place, and off-line data storage system has best cost, but access efficiency can be lower.
During data transmission, the data file even partition that is greater than threshold value is each data block, and distributed storage is in each online data storage system; By the control of data management system, guarantee concurrent the carrying out of individual data file read-write.
System is by the access frequency of the automatic tracking data of metadata management system, data are automatic flowing in online data storage system, near-line data storage system and off-line data storage system, in the time of mobile, the backup of upper level can be deleted, and in metadata management system, carry out the backup of index, to guarantee the utilization factor of resource and the validity of access.
As shown in Figure 2, when client is write data, data are divided into the data block of each standard, and each writes data block and operate according to following steps, finally accomplish concurrent writing, and finally reach and shorten the whole write time, improving performance object:
(1) client is initiated data write request to metadata management system;
(2) metadata management system is according to work and the service condition of the online data storage system of its management, according to the method for load balancing, calculate can store data object online data storage system, in object online data storage system, create new data block;
(3) data block of object online data storage system creates successfully, and result is returned to metadata management system;
(4) metadata management system backup synchronous this data message, and the relevant information of object online storage subsystem is returned to client;
(5) client, according to the object online data storage system related information obtaining, is sent data write request to corresponding object memory node, and sends data to object online storage subsystem;
(6) object on-line storage node receives data and into the corresponding data piece of storing, and also to other online data storage systems, backs up simultaneously;
(7) when local data writes and backed up after, object online data storage system will complete information and return to client;
(8) client has been received after information, completes writing of data.
Data are write fashionable, be temporarily stored in current online data storage system, if access frequency is high, position can not change, if follow-up this data access frequencies go lower, these data can move to voluntarily in near-line data storage system under the commander of metadata management system, and even finally move in off-line data storage system.
During client read data, reading of content is generally comprised of a plurality of read data pieces, and each read data piece operates according to following steps, parallel read data piece from data-storage system, and idiographic flow is as shown in Figure 3.
(1) when client is according to read data file, request is submitted to metadata service system, initiate data read request;
(2) metadata management system search index list, returns to the list of the data-storage system at this data place, and each data-storage system list comprises address and the sequence number of each data-storage system;
(3) client sends read data request to the minimum data-storage system of read-write requests number;
(4) data-storage system is from local file system sense data piece, and return data piece is to client.
When data read, when metadata management system finds this Data Position, if these data are positioned at off-line data storage system or near-line data storage system, can Autonomic Migration Framework arrive near-line data storage system, and then move to online data storage system, or directly migrate in online data storage system.
Beneficial effect of the present invention is:
(1) effective utilization of distinct device in cloud storage system
By the autonomous migration of data distinct device in cloud storage system, the equipment of different configurations can be utilized effectively, promote the overall utilization rate of cloud storage system.
(2) improving performance and reliability
Data processing method provided by the invention, by deblocking, has increased the concurrency of reading and writing data, thereby promotes IOPS and bandwidth, shortens access time, improving performance;
In deblocking, again each little authority data piece is carried out to a plurality of backups, guarantee data reliability.
(3) technical difficulty is moderate, can promote
Utilize existing cloud storage system equipment to transform, on the intact basis of hardware path, by software, realized completely, implement, to realize difficulty less.On large data platform, also can promote the use of.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of data processing method of the present invention;
Fig. 2 is the process flow diagram of client of the present invention while writing data;
Process flow diagram when Fig. 3 is client read data of the present invention.
Embodiment
With reference to the accompanying drawings, in conjunction with the embodiments to the detailed description of the invention.
Embodiment 1:
A data processing method for improving performance in cloud storage system, comprises metadata management system, online data storage system, near-line data storage system, off-line data storage system and client, it is characterized in that:
Between described metadata management system and client, only carry out the transmission of control signal, do not carry out the transmission of memorying data flow;
Between client and online data storage system, carry out memorying data flow transmission;
Wherein, online data storage system effectiveness is high, and cost is also high, is used for storage system to access alive data frequently;
Near-line data storage system efficiency is medium, and cost is medium, mainly deposits that some are active poor, has visiting demand but non-hot spot data;
Off-line data storage system cost is low, and access efficiency is low, is mainly used to system filing and backup, is used for depositing sluggish non-hot spot data.
Embodiment 2:
On the basis of embodiment 1, the present embodiment is when data transmission, and the data file even partition that is greater than threshold value is each data block, and distributed storage is in each online data storage system, by the control of data management system, guarantee concurrent the carrying out of individual data file read-write.
Embodiment 3:
On the basis of embodiment 1, the system of the present embodiment is by the access frequency of the automatic tracking data of metadata management system, data are automatic flowing in online data storage system, near-line data storage system and off-line data storage system, in the time of mobile, the backup of upper level can be deleted, and in metadata management system, carry out the backup of index, to guarantee the utilization factor of resource and the validity of access.
Embodiment 4:
On the basis of embodiment 1,2 or 3, when the present embodiment client is write data, data are divided into the data block of each standard, and each writes data block and operate according to following steps, finally accomplish concurrent writing, and shorten the whole write time, improving performance object:
(1) client is initiated data write request to metadata management system;
(2) metadata management system is according to work and the service condition of the online data storage system of its management, according to the method for load balancing, calculate can store data object online data storage system, in object online data storage system, create new data block;
(3) data block of object online data storage system creates successfully, and result is returned to metadata management system;
(4) metadata management system backup synchronous this data message, and the relevant information of object online storage subsystem is returned to client;
(5) client, according to the object online data storage system related information obtaining, is sent data write request to corresponding object memory node, and sends data to object online storage subsystem;
(6) object on-line storage node receives data and into the corresponding data piece of storing, and also to other online data storage systems, backs up simultaneously;
(7) when local data writes and backed up after, object online data storage system will complete information and return to client;
(8) client has been received after information, completes writing of data.
Embodiment 5:
At embodiment 1, on 2 or 3 basis, the present embodiment is write fashionable in data, first be temporarily stored in current online data storage system, if access frequency is high, position can not change, if follow-up this data access frequencies go lower, these data can move to voluntarily in near-line data storage system under the commander of metadata management system, and even finally move in off-line data storage system.
Embodiment 6:
On the basis of embodiment 1,2 or 3, the present embodiment is when client read data, and reading of content is comprised of a plurality of read data pieces, and each read data piece operates according to following steps, parallel read data piece from data-storage system:
(1) when client is according to read data file, request is submitted to metadata service system, initiate data read request;
(2) metadata management system search index list, returns to the list of the data-storage system at this data place, and each data-storage system list comprises address and the sequence number of each data-storage system;
(3) client sends read data request to the minimum data-storage system of read-write requests number;
(4) data-storage system is from local file system sense data piece, and return data piece is to client.
Embodiment 7:
At embodiment 1, on 2 or 3 basis, when the present embodiment data read, when metadata management system finds this Data Position, if these data are positioned at off-line data storage system or near-line data storage system, can Autonomic Migration Framework arrive near-line data storage system, and then move to online data storage system, or directly migrate in online data storage system.
Claims (7)
1. a data processing method for improving performance in cloud storage system, comprises metadata management system, online data storage system, near-line data storage system, off-line data storage system and client, it is characterized in that:
Between described metadata management system and client, only carry out the transmission of control signal, do not carry out the transmission of memorying data flow;
Between client and online data storage system, carry out memorying data flow transmission;
Wherein, online data storage system effectiveness is high, and cost is also high, is used for storage system to access alive data frequently;
Near-line data storage system efficiency is medium, and cost is medium, mainly deposits that some are active poor, has visiting demand but non-hot spot data;
Off-line data storage system cost is low, and access efficiency is low, is mainly used to system filing and backup, deposits sluggish non-hot spot data.
2. the data processing method of improving performance in a kind of cloud storage system according to claim 1, it is characterized in that: during data transmission, the data file even partition that is greater than threshold value is each data block, distributed storage is in each online data storage system, by the control of data management system, guarantee concurrent the carrying out of individual data file read-write.
3. the data processing method of improving performance in a kind of cloud storage system according to claim 1, it is characterized in that: system is by the access frequency of the automatic tracking data of metadata management system, data are automatic flowing in online data storage system, near-line data storage system and off-line data storage system, in the time of mobile, the backup of upper level can be deleted, and in metadata management system, carry out the backup of index, to guarantee the utilization factor of resource and the validity of access.
4. according to claim 1, the data processing method of improving performance in a kind of cloud storage system described in 2 or 3, it is characterized in that: when client is write data, data are divided into the data block of each standard, and each is write data block and operates according to following steps, finally accomplish concurrent writing, shorten the whole write time, improving performance object:
metadata management system is according to work and the service condition of the online data storage system of its management, according to the method for load balancing, calculate can store data object online data storage system, in object online data storage system, create new data block;
the data block of object online data storage system creates successfully, and result is returned to metadata management system;
metadata management system backup synchronous this data message, and the relevant information of object online storage subsystem is returned to client;
client, according to the object online data storage system related information obtaining, is sent data write request to corresponding object memory node, and sends data to object online storage subsystem;
object on-line storage node receives data and into the corresponding data piece of storing, and also to other online data storage systems, backs up simultaneously;
after local data writes and backed up, object online data storage system will complete information and return to client;
client has been received after information, completes writing of data.
5. according to claim 1, the data processing method of improving performance in a kind of cloud storage system described in 2 or 3, it is characterized in that: data are write fashionable, first be temporarily stored in current online data storage system, if access frequency is high, position can not change, if follow-up this data access frequencies go lower, these data can move to voluntarily in near-line data storage system under the commander of metadata management system, and even finally move in off-line data storage system.
6. according to claim 1, the data processing method of improving performance in a kind of cloud storage system described in 2 or 3, it is characterized in that: during client read data, reading of content is comprised of a plurality of read data pieces, each read data piece operates according to following steps, parallel read data piece from data-storage system:
client during according to read data file, is submitted to metadata service system by request, initiates data read request;
the list of metadata management system search index, returns to the list of the data-storage system at this data place, and each data-storage system list comprises address and the sequence number of each data-storage system;
data-storage system is from local file system sense data piece, and return data piece is to client.
7. according to claim 1, the data processing method of improving performance in a kind of cloud storage system described in 2 or 3, it is characterized in that: when data read, when metadata management system finds this Data Position, if these data are positioned at off-line data storage system or near-line data storage system, can Autonomic Migration Framework arrive near-line data storage system, and then move to online data storage system, or directly migrate in online data storage system.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310494892.0A CN103530388A (en) | 2013-10-22 | 2013-10-22 | Performance improving data processing method in cloud storage system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310494892.0A CN103530388A (en) | 2013-10-22 | 2013-10-22 | Performance improving data processing method in cloud storage system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN103530388A true CN103530388A (en) | 2014-01-22 |
Family
ID=49932397
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310494892.0A Pending CN103530388A (en) | 2013-10-22 | 2013-10-22 | Performance improving data processing method in cloud storage system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103530388A (en) |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104023246A (en) * | 2014-04-28 | 2014-09-03 | 深圳英飞拓科技股份有限公司 | Private video data cloud-storage system and method |
CN104125285A (en) * | 2014-08-02 | 2014-10-29 | 成都致云科技有限公司 | Cloud storage read-write method high in IO throughput capacity |
CN104408047A (en) * | 2014-10-28 | 2015-03-11 | 浪潮电子信息产业股份有限公司 | Method for uploading text file to HDFS (hadoop distributed file system) in multi-machine parallel mode based on NFS (network file system) file server |
CN104683472A (en) * | 2015-03-12 | 2015-06-03 | 浪潮集团有限公司 | Data transmission method capable of supporting large data volume |
CN104809211A (en) * | 2015-04-30 | 2015-07-29 | 苏州星熙数据科技有限公司 | High-expansibility database design method based on Hbase |
CN104917788A (en) * | 2014-03-11 | 2015-09-16 | 中国移动通信集团公司 | Data storage method and apparatus |
CN105243163A (en) * | 2015-11-05 | 2016-01-13 | 国家电网公司 | Archiving integration system and method of historical data |
CN105554149A (en) * | 2015-12-31 | 2016-05-04 | 康佳集团股份有限公司 | Video cloud storage load equalizing method and system based on video ranks |
CN105991660A (en) * | 2015-01-27 | 2016-10-05 | 杭州海康威视系统技术有限公司 | System for sharing resources among multiple cloud storage systems |
CN108052284A (en) * | 2017-12-08 | 2018-05-18 | 北京奇虎科技有限公司 | A kind of distributed data storage method and device |
CN108664525A (en) * | 2017-04-01 | 2018-10-16 | 北京京东尚科信息技术有限公司 | Data processing method and device for data processing server |
CN109240853A (en) * | 2018-08-29 | 2019-01-18 | 深圳市瑞驰信息技术有限公司 | A kind of mixing standby system of novel unified interface |
WO2019024673A1 (en) * | 2017-08-02 | 2019-02-07 | 众安信息技术服务有限公司 | Blockchain block data archiving method and apparatus, and query method and apparatus |
CN109669636A (en) * | 2018-12-20 | 2019-04-23 | 广州勤泰信息科技有限公司 | A kind of distributed intelligence storage system |
CN112000523A (en) * | 2020-08-25 | 2020-11-27 | 浪潮云信息技术股份公司 | Cloud backup system and method |
WO2021103596A1 (en) * | 2019-11-29 | 2021-06-03 | 浪潮电子信息产业股份有限公司 | Data migration method, device, and computer-readable storage medium |
CN113204536A (en) * | 2021-05-27 | 2021-08-03 | 济南浪潮数据技术有限公司 | Read-write optimization method and device for distributed storage system |
CN113239207A (en) * | 2021-07-12 | 2021-08-10 | 深圳市知酷信息技术有限公司 | Online document induction and storage system based on document data analysis |
CN114422537A (en) * | 2022-03-28 | 2022-04-29 | 维塔科技(北京)有限公司 | Multi-cloud storage system, multi-cloud data reading and writing method and electronic equipment |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101027632A (en) * | 2004-11-19 | 2007-08-29 | 国际商业机器公司 | Methods and apparatus for distributing data within a storage area network |
US20100274826A1 (en) * | 2009-04-23 | 2010-10-28 | Hitachi, Ltd. | Method for clipping migration candidate file in hierarchical storage management system |
CN102142006A (en) * | 2010-10-27 | 2011-08-03 | 华为技术有限公司 | File processing method and device of distributed file system |
US20110276538A1 (en) * | 2010-05-06 | 2011-11-10 | The Go Daddy Group, Inc. | Cloud storage solution for reading and writing files |
US20120198151A1 (en) * | 2011-02-02 | 2012-08-02 | Hitachi, Ltd. | Storage apparatus and data management method |
US20120278569A1 (en) * | 2011-04-26 | 2012-11-01 | Hitachi, Ltd. | Storage apparatus and control method therefor |
US20130080703A1 (en) * | 2011-09-28 | 2013-03-28 | Hitachi, Ltd. | Method for calculating tier relocation cost and storage system using the same |
CN103092526A (en) * | 2011-10-31 | 2013-05-08 | 国际商业机器公司 | Method and device for transferring data between storage devices |
CN103106151A (en) * | 2011-11-15 | 2013-05-15 | Lsi公司 | Apparatus to manage efficient data migration between tiers |
CN103250143A (en) * | 2012-12-28 | 2013-08-14 | 华为技术有限公司 | Data storage method and storage device |
EP2631805A1 (en) * | 2010-10-22 | 2013-08-28 | Intec Inc. | Storage-service-provision device, system, service-provision method, and service-provision program |
-
2013
- 2013-10-22 CN CN201310494892.0A patent/CN103530388A/en active Pending
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101027632A (en) * | 2004-11-19 | 2007-08-29 | 国际商业机器公司 | Methods and apparatus for distributing data within a storage area network |
US20100274826A1 (en) * | 2009-04-23 | 2010-10-28 | Hitachi, Ltd. | Method for clipping migration candidate file in hierarchical storage management system |
US20110276538A1 (en) * | 2010-05-06 | 2011-11-10 | The Go Daddy Group, Inc. | Cloud storage solution for reading and writing files |
EP2631805A1 (en) * | 2010-10-22 | 2013-08-28 | Intec Inc. | Storage-service-provision device, system, service-provision method, and service-provision program |
CN102142006A (en) * | 2010-10-27 | 2011-08-03 | 华为技术有限公司 | File processing method and device of distributed file system |
US20120198151A1 (en) * | 2011-02-02 | 2012-08-02 | Hitachi, Ltd. | Storage apparatus and data management method |
US20120278569A1 (en) * | 2011-04-26 | 2012-11-01 | Hitachi, Ltd. | Storage apparatus and control method therefor |
US20130080703A1 (en) * | 2011-09-28 | 2013-03-28 | Hitachi, Ltd. | Method for calculating tier relocation cost and storage system using the same |
CN103092526A (en) * | 2011-10-31 | 2013-05-08 | 国际商业机器公司 | Method and device for transferring data between storage devices |
CN103106151A (en) * | 2011-11-15 | 2013-05-15 | Lsi公司 | Apparatus to manage efficient data migration between tiers |
CN103250143A (en) * | 2012-12-28 | 2013-08-14 | 华为技术有限公司 | Data storage method and storage device |
Cited By (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104917788A (en) * | 2014-03-11 | 2015-09-16 | 中国移动通信集团公司 | Data storage method and apparatus |
CN104023246B (en) * | 2014-04-28 | 2018-01-30 | 深圳英飞拓科技股份有限公司 | A kind of video data private cloud storage system and video data private cloud storage method |
CN104023246A (en) * | 2014-04-28 | 2014-09-03 | 深圳英飞拓科技股份有限公司 | Private video data cloud-storage system and method |
CN104125285A (en) * | 2014-08-02 | 2014-10-29 | 成都致云科技有限公司 | Cloud storage read-write method high in IO throughput capacity |
CN104408047A (en) * | 2014-10-28 | 2015-03-11 | 浪潮电子信息产业股份有限公司 | Method for uploading text file to HDFS (hadoop distributed file system) in multi-machine parallel mode based on NFS (network file system) file server |
CN105991660A (en) * | 2015-01-27 | 2016-10-05 | 杭州海康威视系统技术有限公司 | System for sharing resources among multiple cloud storage systems |
CN104683472A (en) * | 2015-03-12 | 2015-06-03 | 浪潮集团有限公司 | Data transmission method capable of supporting large data volume |
CN104809211A (en) * | 2015-04-30 | 2015-07-29 | 苏州星熙数据科技有限公司 | High-expansibility database design method based on Hbase |
CN105243163A (en) * | 2015-11-05 | 2016-01-13 | 国家电网公司 | Archiving integration system and method of historical data |
CN105554149A (en) * | 2015-12-31 | 2016-05-04 | 康佳集团股份有限公司 | Video cloud storage load equalizing method and system based on video ranks |
CN108664525A (en) * | 2017-04-01 | 2018-10-16 | 北京京东尚科信息技术有限公司 | Data processing method and device for data processing server |
WO2019024673A1 (en) * | 2017-08-02 | 2019-02-07 | 众安信息技术服务有限公司 | Blockchain block data archiving method and apparatus, and query method and apparatus |
CN108052284A (en) * | 2017-12-08 | 2018-05-18 | 北京奇虎科技有限公司 | A kind of distributed data storage method and device |
WO2019109538A1 (en) * | 2017-12-08 | 2019-06-13 | 北京奇虎科技有限公司 | Distributed data storage method and device |
CN108052284B (en) * | 2017-12-08 | 2020-11-06 | 北京奇虎科技有限公司 | Distributed data storage method and device |
CN109240853A (en) * | 2018-08-29 | 2019-01-18 | 深圳市瑞驰信息技术有限公司 | A kind of mixing standby system of novel unified interface |
CN109669636A (en) * | 2018-12-20 | 2019-04-23 | 广州勤泰信息科技有限公司 | A kind of distributed intelligence storage system |
WO2021103596A1 (en) * | 2019-11-29 | 2021-06-03 | 浪潮电子信息产业股份有限公司 | Data migration method, device, and computer-readable storage medium |
CN112000523A (en) * | 2020-08-25 | 2020-11-27 | 浪潮云信息技术股份公司 | Cloud backup system and method |
CN113204536A (en) * | 2021-05-27 | 2021-08-03 | 济南浪潮数据技术有限公司 | Read-write optimization method and device for distributed storage system |
CN113239207A (en) * | 2021-07-12 | 2021-08-10 | 深圳市知酷信息技术有限公司 | Online document induction and storage system based on document data analysis |
CN114422537A (en) * | 2022-03-28 | 2022-04-29 | 维塔科技(北京)有限公司 | Multi-cloud storage system, multi-cloud data reading and writing method and electronic equipment |
CN114422537B (en) * | 2022-03-28 | 2022-06-21 | 维塔科技(北京)有限公司 | Multi-cloud storage system, multi-cloud data reading and writing method and electronic equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103530388A (en) | Performance improving data processing method in cloud storage system | |
CN103268318B (en) | A kind of distributed key value database system of strong consistency and reading/writing method thereof | |
CN103106249B (en) | A kind of parallel data processing system based on Cassandra | |
US11811895B2 (en) | Automatic data replica manager in distributed caching and data processing systems | |
US9612758B1 (en) | Performing a pre-warm-up procedure via intelligently forecasting as to when a host computer will access certain host data | |
US10140194B2 (en) | Storage system transactions | |
CN103294167B (en) | A kind of low energy consumption cluster-based storage reproducing unit based on data behavior and method | |
CN104111804A (en) | Distributed file system | |
CN106534308B (en) | Method and device for solving data block access hot spot in distributed storage system | |
CN102117248A (en) | Caching system and method for caching data in caching system | |
CN102843396A (en) | Data writing and reading method and device in distributed caching system | |
CN106066890B (en) | Distributed high-performance database all-in-one machine system | |
CN107832423B (en) | File reading and writing method for distributed file system | |
CN103037004A (en) | Implement method and device of cloud storage system operation | |
US9110820B1 (en) | Hybrid data storage system in an HPC exascale environment | |
CN105516284A (en) | Clustered database distributed storage method and device | |
CN106933868A (en) | A kind of method and data server for adjusting data fragmentation distribution | |
CN103399823A (en) | Method, equipment and system for storing service data | |
CN111309245B (en) | Hierarchical storage writing method and device, reading method and device and system | |
CN105468297A (en) | Quick synchronization method for master and slave device data in cloud storage system | |
CN104410666A (en) | Method and system for implementing heterogeneous storage resource management under cloud computing | |
CN104142953A (en) | Metadata dynamic management method and system | |
CN104158863A (en) | Cloud storage mechanism based on transaction-level whole-course high-speed buffer | |
US20210263666A1 (en) | Object tiering in a distributed storage system | |
CN105302489A (en) | Heterogeneous multi-core remote embedded memory system and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140122 |
|
RJ01 | Rejection of invention patent application after publication |