CN103530388A - Performance improving data processing method in cloud storage system - Google Patents

Performance improving data processing method in cloud storage system Download PDF

Info

Publication number
CN103530388A
CN103530388A CN201310494892.0A CN201310494892A CN103530388A CN 103530388 A CN103530388 A CN 103530388A CN 201310494892 A CN201310494892 A CN 201310494892A CN 103530388 A CN103530388 A CN 103530388A
Authority
CN
China
Prior art keywords
data
storage system
online
client
data storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310494892.0A
Other languages
Chinese (zh)
Inventor
刘刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Electronic Information Industry Co Ltd
Original Assignee
Inspur Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Electronic Information Industry Co Ltd filed Critical Inspur Electronic Information Industry Co Ltd
Priority to CN201310494892.0A priority Critical patent/CN103530388A/en
Publication of CN103530388A publication Critical patent/CN103530388A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to the cloud storage field, and discloses a performance improving data processing method in a cloud storage system. The performance improving data processing method relates to a metadata management system, an online data storage system, a near line data storage system, an off-line data storage system and a client terminal. Only control signal transmission is carried out between the metadata management system and the client terminal, storage data flow transmission is not carried out between the metadata management system and the client terminal, and the storage data flow transmission is carried out between the client terminal and the online data storage system. Data are autonomously transmitted among different devices in the cloud storage system so that the devices with different configurations can be effectively used, and the whole use ratio of the cloud storage system is improved. By means of data segmentation, concurrency of data reading and writing is improved, the IOPS and the bandwidth are improved, the reading and writing time is shortened, and the performance is improved. Improvement is carried out on an existing cloud storage system device, the process is completely implemented through software on the basis that hardware accesses are in good conditions, and the implementation and achieving difficulties are small. The performance improving data processing method can be popularized and used on a large data platform.

Description

The data processing method of improving performance in a kind of cloud storage system
Technical field
The present invention relates to cloud field of storage, particularly in a kind of cloud storage system, promote the data processing method of access performance.
Technical background
In current IT management, exist ever-increasing data volume, increasing cluster application and cloud storage system are put in actual use, and multi-user, how concurrent visiting demand also get more and more.
But the cloud storage system of prior art is mostly serial storage means, its access response, readwrite performance, also in variation gradually, cannot be tackled many clients' intensive mass memory read-write demand.
Technical matters to be solved by this invention is for the deficiencies in the prior art, and the data processing method of improving performance in a kind of cloud storage system is provided.
Summary of the invention
The technical problem to be solved in the present invention is: the data processing method that improving performance in a kind of cloud storage system is provided.
The technical solution adopted in the present invention is: the data processing method of improving performance in a kind of cloud storage system, comprise metadata management system, online data storage system, near-line data storage system, off-line data storage system and client, as shown in Figure 1,
Wherein, between described metadata management system and client, only carry out the transmission of control signal, do not carry out the transmission of memorying data flow;
Between client and online data storage system, carry out memorying data flow transmission;
Wherein, online data storage system effectiveness is high, and cost is also high, is used for depositing access ratio alive data more frequently, such as hot spot datas such as database, system software, application software;
Near-line data storage system efficiency is medium, and cost is medium, mainly deposits that some are active poor, has visiting demand but non-hot spot data, such as multimedia database, document, backup etc.;
Off-line data storage system cost is low, and access efficiency is low, is mainly used to system filing and backup, is generally used for depositing non-hot spot data.
Comparatively speaking, online data storage system effectiveness can be higher, and cost also can be higher; Near-line data storage system is taken second place, and off-line data storage system has best cost, but access efficiency can be lower.
During data transmission, the data file even partition that is greater than threshold value is each data block, and distributed storage is in each online data storage system; By the control of data management system, guarantee concurrent the carrying out of individual data file read-write.
System is by the access frequency of the automatic tracking data of metadata management system, data are automatic flowing in online data storage system, near-line data storage system and off-line data storage system, in the time of mobile, the backup of upper level can be deleted, and in metadata management system, carry out the backup of index, to guarantee the utilization factor of resource and the validity of access.
As shown in Figure 2, when client is write data, data are divided into the data block of each standard, and each writes data block and operate according to following steps, finally accomplish concurrent writing, and finally reach and shorten the whole write time, improving performance object:
(1) client is initiated data write request to metadata management system;
(2) metadata management system is according to work and the service condition of the online data storage system of its management, according to the method for load balancing, calculate can store data object online data storage system, in object online data storage system, create new data block;
(3) data block of object online data storage system creates successfully, and result is returned to metadata management system;
(4) metadata management system backup synchronous this data message, and the relevant information of object online storage subsystem is returned to client;
(5) client, according to the object online data storage system related information obtaining, is sent data write request to corresponding object memory node, and sends data to object online storage subsystem;
(6) object on-line storage node receives data and into the corresponding data piece of storing, and also to other online data storage systems, backs up simultaneously;
(7) when local data writes and backed up after, object online data storage system will complete information and return to client;
(8) client has been received after information, completes writing of data.
Data are write fashionable, be temporarily stored in current online data storage system, if access frequency is high, position can not change, if follow-up this data access frequencies go lower, these data can move to voluntarily in near-line data storage system under the commander of metadata management system, and even finally move in off-line data storage system.
During client read data, reading of content is generally comprised of a plurality of read data pieces, and each read data piece operates according to following steps, parallel read data piece from data-storage system, and idiographic flow is as shown in Figure 3.
(1) when client is according to read data file, request is submitted to metadata service system, initiate data read request;
(2) metadata management system search index list, returns to the list of the data-storage system at this data place, and each data-storage system list comprises address and the sequence number of each data-storage system;
(3) client sends read data request to the minimum data-storage system of read-write requests number;
(4) data-storage system is from local file system sense data piece, and return data piece is to client.
When data read, when metadata management system finds this Data Position, if these data are positioned at off-line data storage system or near-line data storage system, can Autonomic Migration Framework arrive near-line data storage system, and then move to online data storage system, or directly migrate in online data storage system.
Beneficial effect of the present invention is:
(1) effective utilization of distinct device in cloud storage system
By the autonomous migration of data distinct device in cloud storage system, the equipment of different configurations can be utilized effectively, promote the overall utilization rate of cloud storage system.
(2) improving performance and reliability
Data processing method provided by the invention, by deblocking, has increased the concurrency of reading and writing data, thereby promotes IOPS and bandwidth, shortens access time, improving performance;
In deblocking, again each little authority data piece is carried out to a plurality of backups, guarantee data reliability.
(3) technical difficulty is moderate, can promote
Utilize existing cloud storage system equipment to transform, on the intact basis of hardware path, by software, realized completely, implement, to realize difficulty less.On large data platform, also can promote the use of.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of data processing method of the present invention;
Fig. 2 is the process flow diagram of client of the present invention while writing data;
Process flow diagram when Fig. 3 is client read data of the present invention.
Embodiment
With reference to the accompanying drawings, in conjunction with the embodiments to the detailed description of the invention.
Embodiment 1:
A data processing method for improving performance in cloud storage system, comprises metadata management system, online data storage system, near-line data storage system, off-line data storage system and client, it is characterized in that:
Between described metadata management system and client, only carry out the transmission of control signal, do not carry out the transmission of memorying data flow;
Between client and online data storage system, carry out memorying data flow transmission;
Wherein, online data storage system effectiveness is high, and cost is also high, is used for storage system to access alive data frequently;
Near-line data storage system efficiency is medium, and cost is medium, mainly deposits that some are active poor, has visiting demand but non-hot spot data;
Off-line data storage system cost is low, and access efficiency is low, is mainly used to system filing and backup, is used for depositing sluggish non-hot spot data.
Embodiment 2:
On the basis of embodiment 1, the present embodiment is when data transmission, and the data file even partition that is greater than threshold value is each data block, and distributed storage is in each online data storage system, by the control of data management system, guarantee concurrent the carrying out of individual data file read-write.
Embodiment 3:
On the basis of embodiment 1, the system of the present embodiment is by the access frequency of the automatic tracking data of metadata management system, data are automatic flowing in online data storage system, near-line data storage system and off-line data storage system, in the time of mobile, the backup of upper level can be deleted, and in metadata management system, carry out the backup of index, to guarantee the utilization factor of resource and the validity of access.
Embodiment 4:
On the basis of embodiment 1,2 or 3, when the present embodiment client is write data, data are divided into the data block of each standard, and each writes data block and operate according to following steps, finally accomplish concurrent writing, and shorten the whole write time, improving performance object:
(1) client is initiated data write request to metadata management system;
(2) metadata management system is according to work and the service condition of the online data storage system of its management, according to the method for load balancing, calculate can store data object online data storage system, in object online data storage system, create new data block;
(3) data block of object online data storage system creates successfully, and result is returned to metadata management system;
(4) metadata management system backup synchronous this data message, and the relevant information of object online storage subsystem is returned to client;
(5) client, according to the object online data storage system related information obtaining, is sent data write request to corresponding object memory node, and sends data to object online storage subsystem;
(6) object on-line storage node receives data and into the corresponding data piece of storing, and also to other online data storage systems, backs up simultaneously;
(7) when local data writes and backed up after, object online data storage system will complete information and return to client;
(8) client has been received after information, completes writing of data.
Embodiment 5:
At embodiment 1, on 2 or 3 basis, the present embodiment is write fashionable in data, first be temporarily stored in current online data storage system, if access frequency is high, position can not change, if follow-up this data access frequencies go lower, these data can move to voluntarily in near-line data storage system under the commander of metadata management system, and even finally move in off-line data storage system.
Embodiment 6:
On the basis of embodiment 1,2 or 3, the present embodiment is when client read data, and reading of content is comprised of a plurality of read data pieces, and each read data piece operates according to following steps, parallel read data piece from data-storage system:
(1) when client is according to read data file, request is submitted to metadata service system, initiate data read request;
(2) metadata management system search index list, returns to the list of the data-storage system at this data place, and each data-storage system list comprises address and the sequence number of each data-storage system;
(3) client sends read data request to the minimum data-storage system of read-write requests number;
(4) data-storage system is from local file system sense data piece, and return data piece is to client.
Embodiment 7:
At embodiment 1, on 2 or 3 basis, when the present embodiment data read, when metadata management system finds this Data Position, if these data are positioned at off-line data storage system or near-line data storage system, can Autonomic Migration Framework arrive near-line data storage system, and then move to online data storage system, or directly migrate in online data storage system.

Claims (7)

1. a data processing method for improving performance in cloud storage system, comprises metadata management system, online data storage system, near-line data storage system, off-line data storage system and client, it is characterized in that:
Between described metadata management system and client, only carry out the transmission of control signal, do not carry out the transmission of memorying data flow;
Between client and online data storage system, carry out memorying data flow transmission;
Wherein, online data storage system effectiveness is high, and cost is also high, is used for storage system to access alive data frequently;
Near-line data storage system efficiency is medium, and cost is medium, mainly deposits that some are active poor, has visiting demand but non-hot spot data;
Off-line data storage system cost is low, and access efficiency is low, is mainly used to system filing and backup, deposits sluggish non-hot spot data.
2. the data processing method of improving performance in a kind of cloud storage system according to claim 1, it is characterized in that: during data transmission, the data file even partition that is greater than threshold value is each data block, distributed storage is in each online data storage system, by the control of data management system, guarantee concurrent the carrying out of individual data file read-write.
3. the data processing method of improving performance in a kind of cloud storage system according to claim 1, it is characterized in that: system is by the access frequency of the automatic tracking data of metadata management system, data are automatic flowing in online data storage system, near-line data storage system and off-line data storage system, in the time of mobile, the backup of upper level can be deleted, and in metadata management system, carry out the backup of index, to guarantee the utilization factor of resource and the validity of access.
4. according to claim 1, the data processing method of improving performance in a kind of cloud storage system described in 2 or 3, it is characterized in that: when client is write data, data are divided into the data block of each standard, and each is write data block and operates according to following steps, finally accomplish concurrent writing, shorten the whole write time, improving performance object:
Figure 2013104948920100001DEST_PATH_IMAGE002
client is initiated data write request to metadata management system;
metadata management system is according to work and the service condition of the online data storage system of its management, according to the method for load balancing, calculate can store data object online data storage system, in object online data storage system, create new data block;
Figure 2013104948920100001DEST_PATH_IMAGE006
the data block of object online data storage system creates successfully, and result is returned to metadata management system;
Figure 2013104948920100001DEST_PATH_IMAGE008
metadata management system backup synchronous this data message, and the relevant information of object online storage subsystem is returned to client;
Figure 2013104948920100001DEST_PATH_IMAGE010
client, according to the object online data storage system related information obtaining, is sent data write request to corresponding object memory node, and sends data to object online storage subsystem;
Figure 2013104948920100001DEST_PATH_IMAGE012
object on-line storage node receives data and into the corresponding data piece of storing, and also to other online data storage systems, backs up simultaneously;
Figure 2013104948920100001DEST_PATH_IMAGE014
after local data writes and backed up, object online data storage system will complete information and return to client;
client has been received after information, completes writing of data.
5. according to claim 1, the data processing method of improving performance in a kind of cloud storage system described in 2 or 3, it is characterized in that: data are write fashionable, first be temporarily stored in current online data storage system, if access frequency is high, position can not change, if follow-up this data access frequencies go lower, these data can move to voluntarily in near-line data storage system under the commander of metadata management system, and even finally move in off-line data storage system.
6. according to claim 1, the data processing method of improving performance in a kind of cloud storage system described in 2 or 3, it is characterized in that: during client read data, reading of content is comprised of a plurality of read data pieces, each read data piece operates according to following steps, parallel read data piece from data-storage system:
Figure 494976DEST_PATH_IMAGE002
client during according to read data file, is submitted to metadata service system by request, initiates data read request;
Figure 474434DEST_PATH_IMAGE004
the list of metadata management system search index, returns to the list of the data-storage system at this data place, and each data-storage system list comprises address and the sequence number of each data-storage system;
Figure 67220DEST_PATH_IMAGE006
client sends read data request to the minimum data-storage system of read-write requests number;
data-storage system is from local file system sense data piece, and return data piece is to client.
7. according to claim 1, the data processing method of improving performance in a kind of cloud storage system described in 2 or 3, it is characterized in that: when data read, when metadata management system finds this Data Position, if these data are positioned at off-line data storage system or near-line data storage system, can Autonomic Migration Framework arrive near-line data storage system, and then move to online data storage system, or directly migrate in online data storage system.
CN201310494892.0A 2013-10-22 2013-10-22 Performance improving data processing method in cloud storage system Pending CN103530388A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310494892.0A CN103530388A (en) 2013-10-22 2013-10-22 Performance improving data processing method in cloud storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310494892.0A CN103530388A (en) 2013-10-22 2013-10-22 Performance improving data processing method in cloud storage system

Publications (1)

Publication Number Publication Date
CN103530388A true CN103530388A (en) 2014-01-22

Family

ID=49932397

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310494892.0A Pending CN103530388A (en) 2013-10-22 2013-10-22 Performance improving data processing method in cloud storage system

Country Status (1)

Country Link
CN (1) CN103530388A (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104023246A (en) * 2014-04-28 2014-09-03 深圳英飞拓科技股份有限公司 Private video data cloud-storage system and method
CN104125285A (en) * 2014-08-02 2014-10-29 成都致云科技有限公司 Cloud storage read-write method high in IO throughput capacity
CN104408047A (en) * 2014-10-28 2015-03-11 浪潮电子信息产业股份有限公司 Method for uploading text file to HDFS (hadoop distributed file system) in multi-machine parallel mode based on NFS (network file system) file server
CN104683472A (en) * 2015-03-12 2015-06-03 浪潮集团有限公司 Data transmission method capable of supporting large data volume
CN104809211A (en) * 2015-04-30 2015-07-29 苏州星熙数据科技有限公司 High-expansibility database design method based on Hbase
CN104917788A (en) * 2014-03-11 2015-09-16 中国移动通信集团公司 Data storage method and apparatus
CN105243163A (en) * 2015-11-05 2016-01-13 国家电网公司 Archiving integration system and method of historical data
CN105554149A (en) * 2015-12-31 2016-05-04 康佳集团股份有限公司 Video cloud storage load equalizing method and system based on video ranks
CN105991660A (en) * 2015-01-27 2016-10-05 杭州海康威视系统技术有限公司 System for sharing resources among multiple cloud storage systems
CN108052284A (en) * 2017-12-08 2018-05-18 北京奇虎科技有限公司 A kind of distributed data storage method and device
CN108664525A (en) * 2017-04-01 2018-10-16 北京京东尚科信息技术有限公司 Data processing method and device for data processing server
CN109240853A (en) * 2018-08-29 2019-01-18 深圳市瑞驰信息技术有限公司 A kind of mixing standby system of novel unified interface
WO2019024673A1 (en) * 2017-08-02 2019-02-07 众安信息技术服务有限公司 Blockchain block data archiving method and apparatus, and query method and apparatus
CN109669636A (en) * 2018-12-20 2019-04-23 广州勤泰信息科技有限公司 A kind of distributed intelligence storage system
CN112000523A (en) * 2020-08-25 2020-11-27 浪潮云信息技术股份公司 Cloud backup system and method
WO2021103596A1 (en) * 2019-11-29 2021-06-03 浪潮电子信息产业股份有限公司 Data migration method, device, and computer-readable storage medium
CN113204536A (en) * 2021-05-27 2021-08-03 济南浪潮数据技术有限公司 Read-write optimization method and device for distributed storage system
CN113239207A (en) * 2021-07-12 2021-08-10 深圳市知酷信息技术有限公司 Online document induction and storage system based on document data analysis
CN114422537A (en) * 2022-03-28 2022-04-29 维塔科技(北京)有限公司 Multi-cloud storage system, multi-cloud data reading and writing method and electronic equipment

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101027632A (en) * 2004-11-19 2007-08-29 国际商业机器公司 Methods and apparatus for distributing data within a storage area network
US20100274826A1 (en) * 2009-04-23 2010-10-28 Hitachi, Ltd. Method for clipping migration candidate file in hierarchical storage management system
CN102142006A (en) * 2010-10-27 2011-08-03 华为技术有限公司 File processing method and device of distributed file system
US20110276538A1 (en) * 2010-05-06 2011-11-10 The Go Daddy Group, Inc. Cloud storage solution for reading and writing files
US20120198151A1 (en) * 2011-02-02 2012-08-02 Hitachi, Ltd. Storage apparatus and data management method
US20120278569A1 (en) * 2011-04-26 2012-11-01 Hitachi, Ltd. Storage apparatus and control method therefor
US20130080703A1 (en) * 2011-09-28 2013-03-28 Hitachi, Ltd. Method for calculating tier relocation cost and storage system using the same
CN103092526A (en) * 2011-10-31 2013-05-08 国际商业机器公司 Method and device for transferring data between storage devices
CN103106151A (en) * 2011-11-15 2013-05-15 Lsi公司 Apparatus to manage efficient data migration between tiers
CN103250143A (en) * 2012-12-28 2013-08-14 华为技术有限公司 Data storage method and storage device
EP2631805A1 (en) * 2010-10-22 2013-08-28 Intec Inc. Storage-service-provision device, system, service-provision method, and service-provision program

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101027632A (en) * 2004-11-19 2007-08-29 国际商业机器公司 Methods and apparatus for distributing data within a storage area network
US20100274826A1 (en) * 2009-04-23 2010-10-28 Hitachi, Ltd. Method for clipping migration candidate file in hierarchical storage management system
US20110276538A1 (en) * 2010-05-06 2011-11-10 The Go Daddy Group, Inc. Cloud storage solution for reading and writing files
EP2631805A1 (en) * 2010-10-22 2013-08-28 Intec Inc. Storage-service-provision device, system, service-provision method, and service-provision program
CN102142006A (en) * 2010-10-27 2011-08-03 华为技术有限公司 File processing method and device of distributed file system
US20120198151A1 (en) * 2011-02-02 2012-08-02 Hitachi, Ltd. Storage apparatus and data management method
US20120278569A1 (en) * 2011-04-26 2012-11-01 Hitachi, Ltd. Storage apparatus and control method therefor
US20130080703A1 (en) * 2011-09-28 2013-03-28 Hitachi, Ltd. Method for calculating tier relocation cost and storage system using the same
CN103092526A (en) * 2011-10-31 2013-05-08 国际商业机器公司 Method and device for transferring data between storage devices
CN103106151A (en) * 2011-11-15 2013-05-15 Lsi公司 Apparatus to manage efficient data migration between tiers
CN103250143A (en) * 2012-12-28 2013-08-14 华为技术有限公司 Data storage method and storage device

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104917788A (en) * 2014-03-11 2015-09-16 中国移动通信集团公司 Data storage method and apparatus
CN104023246B (en) * 2014-04-28 2018-01-30 深圳英飞拓科技股份有限公司 A kind of video data private cloud storage system and video data private cloud storage method
CN104023246A (en) * 2014-04-28 2014-09-03 深圳英飞拓科技股份有限公司 Private video data cloud-storage system and method
CN104125285A (en) * 2014-08-02 2014-10-29 成都致云科技有限公司 Cloud storage read-write method high in IO throughput capacity
CN104408047A (en) * 2014-10-28 2015-03-11 浪潮电子信息产业股份有限公司 Method for uploading text file to HDFS (hadoop distributed file system) in multi-machine parallel mode based on NFS (network file system) file server
CN105991660A (en) * 2015-01-27 2016-10-05 杭州海康威视系统技术有限公司 System for sharing resources among multiple cloud storage systems
CN104683472A (en) * 2015-03-12 2015-06-03 浪潮集团有限公司 Data transmission method capable of supporting large data volume
CN104809211A (en) * 2015-04-30 2015-07-29 苏州星熙数据科技有限公司 High-expansibility database design method based on Hbase
CN105243163A (en) * 2015-11-05 2016-01-13 国家电网公司 Archiving integration system and method of historical data
CN105554149A (en) * 2015-12-31 2016-05-04 康佳集团股份有限公司 Video cloud storage load equalizing method and system based on video ranks
CN108664525A (en) * 2017-04-01 2018-10-16 北京京东尚科信息技术有限公司 Data processing method and device for data processing server
WO2019024673A1 (en) * 2017-08-02 2019-02-07 众安信息技术服务有限公司 Blockchain block data archiving method and apparatus, and query method and apparatus
CN108052284A (en) * 2017-12-08 2018-05-18 北京奇虎科技有限公司 A kind of distributed data storage method and device
WO2019109538A1 (en) * 2017-12-08 2019-06-13 北京奇虎科技有限公司 Distributed data storage method and device
CN108052284B (en) * 2017-12-08 2020-11-06 北京奇虎科技有限公司 Distributed data storage method and device
CN109240853A (en) * 2018-08-29 2019-01-18 深圳市瑞驰信息技术有限公司 A kind of mixing standby system of novel unified interface
CN109669636A (en) * 2018-12-20 2019-04-23 广州勤泰信息科技有限公司 A kind of distributed intelligence storage system
WO2021103596A1 (en) * 2019-11-29 2021-06-03 浪潮电子信息产业股份有限公司 Data migration method, device, and computer-readable storage medium
CN112000523A (en) * 2020-08-25 2020-11-27 浪潮云信息技术股份公司 Cloud backup system and method
CN113204536A (en) * 2021-05-27 2021-08-03 济南浪潮数据技术有限公司 Read-write optimization method and device for distributed storage system
CN113239207A (en) * 2021-07-12 2021-08-10 深圳市知酷信息技术有限公司 Online document induction and storage system based on document data analysis
CN114422537A (en) * 2022-03-28 2022-04-29 维塔科技(北京)有限公司 Multi-cloud storage system, multi-cloud data reading and writing method and electronic equipment
CN114422537B (en) * 2022-03-28 2022-06-21 维塔科技(北京)有限公司 Multi-cloud storage system, multi-cloud data reading and writing method and electronic equipment

Similar Documents

Publication Publication Date Title
CN103530388A (en) Performance improving data processing method in cloud storage system
CN103268318B (en) A kind of distributed key value database system of strong consistency and reading/writing method thereof
CN103106249B (en) A kind of parallel data processing system based on Cassandra
US11811895B2 (en) Automatic data replica manager in distributed caching and data processing systems
US9612758B1 (en) Performing a pre-warm-up procedure via intelligently forecasting as to when a host computer will access certain host data
US10140194B2 (en) Storage system transactions
CN103294167B (en) A kind of low energy consumption cluster-based storage reproducing unit based on data behavior and method
CN104111804A (en) Distributed file system
CN106534308B (en) Method and device for solving data block access hot spot in distributed storage system
CN102117248A (en) Caching system and method for caching data in caching system
CN102843396A (en) Data writing and reading method and device in distributed caching system
CN106066890B (en) Distributed high-performance database all-in-one machine system
CN107832423B (en) File reading and writing method for distributed file system
CN103037004A (en) Implement method and device of cloud storage system operation
US9110820B1 (en) Hybrid data storage system in an HPC exascale environment
CN105516284A (en) Clustered database distributed storage method and device
CN106933868A (en) A kind of method and data server for adjusting data fragmentation distribution
CN103399823A (en) Method, equipment and system for storing service data
CN111309245B (en) Hierarchical storage writing method and device, reading method and device and system
CN105468297A (en) Quick synchronization method for master and slave device data in cloud storage system
CN104410666A (en) Method and system for implementing heterogeneous storage resource management under cloud computing
CN104142953A (en) Metadata dynamic management method and system
CN104158863A (en) Cloud storage mechanism based on transaction-level whole-course high-speed buffer
US20210263666A1 (en) Object tiering in a distributed storage system
CN105302489A (en) Heterogeneous multi-core remote embedded memory system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20140122

RJ01 Rejection of invention patent application after publication