CN106527985A - Storage interaction device and storage system based on ceph - Google Patents

Storage interaction device and storage system based on ceph Download PDF

Info

Publication number
CN106527985A
CN106527985A CN201610946252.2A CN201610946252A CN106527985A CN 106527985 A CN106527985 A CN 106527985A CN 201610946252 A CN201610946252 A CN 201610946252A CN 106527985 A CN106527985 A CN 106527985A
Authority
CN
China
Prior art keywords
rbd
cache
several
volume
ceph
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610946252.2A
Other languages
Chinese (zh)
Inventor
刘斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Yunhai Information Technology Co Ltd
Original Assignee
Zhengzhou Yunhai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Yunhai Information Technology Co Ltd filed Critical Zhengzhou Yunhai Information Technology Co Ltd
Priority to CN201610946252.2A priority Critical patent/CN106527985A/en
Publication of CN106527985A publication Critical patent/CN106527985A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614Improving the reliability of storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/0644Management of space entities, e.g. partitions, extents, pools
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer And Data Communications (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a storage interaction device based on ceph. The storage interaction device comprises a RBD (RADOS (Reliable Autonomous Distributed Object Storage) Block Device) roll and a RBD cache which is correspondingly arranged with the RBD roll, wherein the RBD cache is used for accessing the RBD roll according to a plurality of received access requests sent from a plurality of user sides, and carrying out optimization processing on an access operation; data obtained after the RBD roll is accessed is returned to a corresponding client side. By use of the storage interaction device, a problem that an error is reported since the data is not synchronous when a plurality of client sides simultaneously access one RBD roll through different RBD caches is avoided, and reliability is high. The invention also discloses a storage system based on the ceph, and comprises comprises a plurality of above storage interaction devices, and unnecessary details are not given here.

Description

A kind of storage interactive device and storage system based on ceph
Technical field
The present invention relates to technical field of data storage, more particularly to a kind of storage interactive device based on ceph.This It is bright to further relate to a kind of storage system based on ceph.
Background technology
Ceph is a kind of unification, distributed storage designed based on outstanding performance, reliability and extensibility System, the bottom of Ceph be RADOS (reliable autonomous distributed object storage, it is distributed Object storage system).Physical storage device virtualization integration can be RBD (RADOS block devices) pond by RADOS, and according to certainly RBD ponds are divided into several RBD volume to carry out data storage by definition.
RBD volume when carrying out data interaction with user side, target (target) layer pass through, and by kernel module or Librbd as interface, wherein, kernel module be in kernel state, and librbd be in User space.As librbd can not make Use kernel caching of page, therefore in librbd, be provided with the caching of the User space of oneself, referred to as " RBD cache ", RBD cache as General hard disk cache (caching) equally, can improve the performance of librbd.
As shown in figure 1, Fig. 1 is the structural representation of the storage interactive system in current ceph;As librbd is user State, it is tgt-target now to correspond to the target layers that use, and the netting twine of client 1 is connected to the sections of the node1 in cluster Point (node here refers to server), client 2 is connected to the node2 nodes in cluster using a netting twine, in all nodes Target1 is created, and LUN1 is created by RBD volume 1 of rear end and corresponding client is mapped to by target1, now client End 1 and client 2 can pass through target1 and LUN1 and access RBD volume 1.
Current RBD cache are set up according to client, 1 corresponding RBD cache1 of such client, client 2 Correspondence RBD cache2, each client correspond to a RBD cache respectively.Now, client 1 accesses RBD volume 1 of path For:Target1 → LUN1 in 1 → node1 of client → RBD cache1 → RBD volume 1;Client 2 accesses RBD volume 1 of road Footpath is:Target1 → LUN1 in 1 → node2 of client → RBD cache2 → RBD volume 1.In this case, if two Client is simultaneously accessed RBD volume 1 and is operated (virtual machine (vm) migration, read-write etc.), and client 1 and the transmission of client 2 Data are inconsistent, and the data that may result in RBD cache1 and RBD cache2 are asynchronous so that not knowing for RBD volume make With the data in which RBD cache, and then system is caused to report an error.
Therefore, how to provide a kind of storage interactive device based on ceph that reduction system reports an error and storage system is ability Field technique personnel need the problem for solving at present.
The content of the invention
It is an object of the invention to provide a kind of storage interactive device based on ceph, it is to avoid multiple client is by different The problem that RBD cache are simultaneously asynchronous to data during a RBD volume of access and report an error, reliability are high;Another mesh of the present invention Be to provide a kind of storage system based on ceph including above-mentioned storage interactive device.
To solve above-mentioned technical problem, the invention provides a kind of storage interactive device based on ceph, including a RBD Volume, an and RBD volume of RBD cache being correspondingly arranged;
The RBD cache, several access requests for sending according to several user sides for receiving access institute RBD volume is stated, and process is optimized to accessing operation;The data obtained after will be access described RBD volume return corresponding client.
Preferably, the RBD cache specifically for:
The access order of several access requests that several user sides that adjustment is received send simultaneously accesses the RBD Volume;The data obtained after will be access described RBD volume return corresponding client.
To solve above-mentioned technical problem, present invention also offers a kind of storage system based on ceph, including several with Upper described storage interactive device, respectively by each RBD volume several logical blocks set up and the logical block one by one Include several servers in corresponding target layers and server cluster, the server cluster;
The target layers, for receiving the access request that several clients send respectively;
The logical block, for as the data interaction interface between RBD cache and the target layers, will be described Several access requests that target layers are received are sent to the RBD cache;
Accordingly, the RBD cache will access it is described RBD volume after the data that obtain by corresponding logical block and Target layers return corresponding client.
Preferably, the target layers include that several target corresponding to the logical block, the target set In the server being placed in the ceph, and correspond with the server.
Preferably, connected by netting twine between the client and server.
The invention provides a kind of storage interactive device based on ceph, RBD cache and RBD volume of one-to-one corresponding setting, RBD volume in the device of each client is required to when conducting interviews by the RBD cache, and the RBD cache can Processs is optimized to the access of each client operation, so as to avoiding multiple client from passing through different RBD cache while When accessing to one RBD volume, data are asynchronous and the problem that reports an error, improve the reliability of ceph.Present invention also offers a kind of Including the storage system based on ceph of several above-mentioned storage interactive devices, it may have above-mentioned advantage, will not be described here.
Description of the drawings
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, below will be to institute in prior art and embodiment The accompanying drawing that needs are used is briefly described, it should be apparent that, drawings in the following description are only some enforcements of the present invention Example, for those of ordinary skill in the art, on the premise of not paying creative work, can be being obtained according to these accompanying drawings Obtain other accompanying drawings.
Fig. 1 is the structural representation of the storage interactive system in current ceph;
A kind of structural representation of storage interactive device based on ceph that Fig. 2 is provided for the present invention;
A kind of structural representation of storage system based on ceph that Fig. 3 is provided for the present invention.
Specific embodiment
The core of the present invention is to provide a kind of storage interactive device based on ceph, it is to avoid multiple client is by different The problem that RBD cache are simultaneously asynchronous to data during a RBD volume of access and report an error, reliability are high;Another core of the present invention The heart is to provide a kind of storage system based on ceph including above-mentioned storage interactive device.
To make purpose, technical scheme and the advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is The a part of embodiment of the present invention, rather than the embodiment of whole.Based on the embodiment in the present invention, those of ordinary skill in the art The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
The invention provides a kind of storage interactive device based on ceph, shown in Figure 2, Fig. 2 is provided for the present invention A kind of structural representation of the storage interactive device based on ceph;The device is included one RBD volume 12, corresponding is set with RBD volume 12 The RBD cache11 for putting;
RBD cache11, several access requests for sending according to several user sides for receiving access RBD volume 12, and process is optimized to accessing operation;The data obtained after RBD volume 12 being accessed return corresponding client.
Specifically, RBD cache11 specifically for:
The access order of several access requests that several user sides that adjustment is received send simultaneously accesses RBD volume 12; The data obtained after RBD volume 12 being accessed return corresponding client.
The invention provides a kind of storage interactive device based on ceph, RBD cache and RBD volume of one-to-one corresponding setting, RBD volume in the device of each client is required to when conducting interviews by the RBD cache, and the RBD cache can Processs is optimized to the access of each client operation, so as to avoiding multiple client from passing through different RBD cache while When accessing to one RBD volume, data are asynchronous and the problem that reports an error, improve the reliability of ceph.
Present invention also offers a kind of storage system based on ceph, shown in Figure 3, Fig. 3 provide for the present invention one Plant the structural representation of the storage system based on ceph.In Fig. 3, LUN1 is based on RBD volume 1 logical block set up, Tgt- Target1 is the target corresponding to LUN1;Node1, Node2, Node3 are server.
The system includes several interactive devices stored above, passes through several logic lists of each RBD volume foundation respectively Include in unit, and the one-to-one target layers of the logical block and server cluster, server cluster that several service Device;
Target layers, for receiving the access request that several clients send respectively;
Logical block, for as the data interaction interface between RBD cache and target layers, target layers being received To several access requests send to RBD cache;
Accordingly, the data that RBD cache are obtained after accessing RBD volume are by corresponding logical block and target layers Return corresponding client.
Wherein, target layers include that several target corresponding to logical block, target are arranged at the clothes in ceph In business device, and correspond with server.Target is target, and client needs first to look for target, just can know that and will visit Request transmission is asked where.
It should be noted that when if client is more, it is larger that the capacity of RBD cache should be arranged, and RBD cache Thread Count should accordingly increase.
It is understood that the RBD cache in the present invention are arranged based on RBD volume, logical block is set up by RBD volume, Target layers also correspond to logical block.As multiple RBD volumes have been generally comprised in ceph, therefore need to arrange multiple storage interactions Device.
It is further known that, logical block here is set up by RBD volume, i.e., logical block is corresponded with RBD volume, enters one Step, target layers are correspondingly arranged with logical block, you can corresponded with RBD volume with being interpreted as target layers.Therefore client The access request of transmission can be sent to right by the target layers and logical block corresponding to which RBD volume, the access request In RBD volume of the RBD cache, and then this RBD volume should be accessed according to the access request.For example, it is assumed that target layers are right Should be in the first logical block, the first logical block is by a RBD volume setting, if the access request that then client sends passes through the One target layers and the first logical block, then the access request can send to RBD cache, and then according to the access request Access the first RBD volume.
Certainly, depending on the number of the storage interactive device that concrete ceph includes is by RBD volume of number, it is of the invention to this not It is construed as limiting.
Specifically, client is connected by netting twine with server, and the storage by way of IPSAN in access server sets It is standby, also, communicated by iscsi agreements between client and server.As target is arranged at clothes correspondingly In business device, client can be sent access request into corresponding target by netting twine.
In addition, in the storage system, each client can connect multiple servers, each server can also connect many Individual client, the present invention are not construed as limiting to this.
It should be noted that in this manual, such as first and second or the like relational terms are used merely to one Individual entity or operation are made a distinction with another entity or operation, and are not necessarily required or implied these entities or operate it Between there is any this actual relation or order.And, term " including ", "comprising" or its any other variant are intended to Cover including for nonexcludability, so that a series of process, method, article or equipment including key elements not only includes those Key element, but also including other key elements being not expressly set out, or also include for this process, method, article or set Standby intrinsic key element.In the absence of more restrictions, the key element for being limited by sentence "including a ...", it is not excluded that Also there is other identical element in the process including the key element, method, article or equipment.
The foregoing description of the disclosed embodiments, enables professional and technical personnel in the field to realize or using the present invention. Various modifications to these embodiments will be apparent for those skilled in the art, as defined herein General Principle can be realized without departing from the spirit or scope of the present invention in other embodiments.Therefore, the present invention The embodiments shown herein is not intended to be limited to, and is to fit to and principles disclosed herein and features of novelty phase one The most wide scope for causing.

Claims (5)

1. a kind of storage interactive device based on ceph, it is characterised in that including RBD volume, and RBD volume of for being correspondingly arranged Individual RBD cache;
The RBD cache, several access requests for sending according to several user sides for receiving access the RBD Volume, and process is optimized to accessing operation;The data obtained after will be access described RBD volume return corresponding client.
2. device according to claim 1, it is characterised in that the RBD cache specifically for:
The access order of several access requests that several user sides that adjustment is received send simultaneously accesses described RBD volume;Will The data obtained after accessing described RBD volume return corresponding client.
3. a kind of storage system based on ceph, it is characterised in that hand over including several storages as claimed in claim 1 or 2 Mutual device, several logical blocks and the one-to-one target layers of the logical block for passing through each RBD volume foundation respectively And server cluster, include several servers in the server cluster;
The target layers, for receiving the access request that several clients send respectively;
The logical block, for as the data interaction interface between RBD cache and the target layers, will be described Several access requests that target layers are received are sent to the RBD cache;
Accordingly, the RBD cache will access it is described RBD volume after the data that obtain by corresponding logical block and Target layers return corresponding client.
4. system according to claim 3, it is characterised in that the target layers include that several correspond to the logic The target of unit, the target are arranged in the server in the ceph, and are corresponded with the server.
5. system according to claim 3, it is characterised in that connected by netting twine between the client and server.
CN201610946252.2A 2016-11-02 2016-11-02 Storage interaction device and storage system based on ceph Pending CN106527985A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610946252.2A CN106527985A (en) 2016-11-02 2016-11-02 Storage interaction device and storage system based on ceph

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610946252.2A CN106527985A (en) 2016-11-02 2016-11-02 Storage interaction device and storage system based on ceph

Publications (1)

Publication Number Publication Date
CN106527985A true CN106527985A (en) 2017-03-22

Family

ID=58292329

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610946252.2A Pending CN106527985A (en) 2016-11-02 2016-11-02 Storage interaction device and storage system based on ceph

Country Status (1)

Country Link
CN (1) CN106527985A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107153515A (en) * 2017-05-10 2017-09-12 郑州云海信息技术有限公司 A kind of many control cluster-based storage information processing systems and method
CN107179929A (en) * 2017-05-15 2017-09-19 郑州云海信息技术有限公司 A kind of optimization implementation method and device of WRITE_SAME functions
CN107729020A (en) * 2017-10-11 2018-02-23 北京航空航天大学 A kind of method for realizing extensive container rapid deployment
CN109033328A (en) * 2018-07-19 2018-12-18 郑州云海信息技术有限公司 A kind of access request processing method, device, equipment and readable storage medium storing program for executing
CN109189583A (en) * 2018-09-20 2019-01-11 郑州云海信息技术有限公司 A kind of distributed lock implementation method and device
CN110442646A (en) * 2019-07-29 2019-11-12 北京易捷思达科技发展有限公司 A kind of ceph data simultaneous module main side write performance optimization system and method
CN110971631A (en) * 2018-09-29 2020-04-07 北京金山云网络技术有限公司 Method, device, server and medium for accessing ceph cluster
CN111176577A (en) * 2019-12-28 2020-05-19 浪潮电子信息产业股份有限公司 Distributed block storage service command processing method, device, equipment and medium
CN113254091A (en) * 2021-06-09 2021-08-13 广东睿江云计算股份有限公司 Ceph block device-based diskless system starting method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1804831A (en) * 2005-01-13 2006-07-19 陈翌 Network cache management system and method
US20090172284A1 (en) * 2007-12-28 2009-07-02 Zeev Offen Method and apparatus for monitor and mwait in a distributed cache architecture
CN102006330A (en) * 2010-12-01 2011-04-06 北京瑞信在线系统技术有限公司 Distributed cache system, data caching method and inquiring method of cache data
CN102016807A (en) * 2008-04-22 2011-04-13 Lsi公司 Distributed cache system in a drive array
CN103946833A (en) * 2011-11-11 2014-07-23 摩博菲乐有限公司Dba摩博莱 System and method for managing dedicated caches

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1804831A (en) * 2005-01-13 2006-07-19 陈翌 Network cache management system and method
US20090172284A1 (en) * 2007-12-28 2009-07-02 Zeev Offen Method and apparatus for monitor and mwait in a distributed cache architecture
CN102016807A (en) * 2008-04-22 2011-04-13 Lsi公司 Distributed cache system in a drive array
CN102006330A (en) * 2010-12-01 2011-04-06 北京瑞信在线系统技术有限公司 Distributed cache system, data caching method and inquiring method of cache data
CN103946833A (en) * 2011-11-11 2014-07-23 摩博菲乐有限公司Dba摩博莱 System and method for managing dedicated caches

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107153515A (en) * 2017-05-10 2017-09-12 郑州云海信息技术有限公司 A kind of many control cluster-based storage information processing systems and method
CN107153515B (en) * 2017-05-10 2020-04-03 郑州云海信息技术有限公司 Multi-control cluster storage information processing system and method
CN107179929A (en) * 2017-05-15 2017-09-19 郑州云海信息技术有限公司 A kind of optimization implementation method and device of WRITE_SAME functions
CN107179929B (en) * 2017-05-15 2020-02-07 苏州浪潮智能科技有限公司 WRITE _ SAME function optimization implementation method and device
CN107729020A (en) * 2017-10-11 2018-02-23 北京航空航天大学 A kind of method for realizing extensive container rapid deployment
CN109033328A (en) * 2018-07-19 2018-12-18 郑州云海信息技术有限公司 A kind of access request processing method, device, equipment and readable storage medium storing program for executing
CN109189583A (en) * 2018-09-20 2019-01-11 郑州云海信息技术有限公司 A kind of distributed lock implementation method and device
CN109189583B (en) * 2018-09-20 2021-10-01 郑州云海信息技术有限公司 Distributed lock implementation method and device
CN110971631A (en) * 2018-09-29 2020-04-07 北京金山云网络技术有限公司 Method, device, server and medium for accessing ceph cluster
CN110971631B (en) * 2018-09-29 2022-07-05 北京金山云网络技术有限公司 Method, device, server and medium for accessing ceph cluster
CN110442646B (en) * 2019-07-29 2021-01-12 北京易捷思达科技发展有限公司 Write performance optimization system and method for master end of ceph data synchronization module
CN110442646A (en) * 2019-07-29 2019-11-12 北京易捷思达科技发展有限公司 A kind of ceph data simultaneous module main side write performance optimization system and method
CN111176577A (en) * 2019-12-28 2020-05-19 浪潮电子信息产业股份有限公司 Distributed block storage service command processing method, device, equipment and medium
WO2021128889A1 (en) * 2019-12-28 2021-07-01 浪潮电子信息产业股份有限公司 Distributed block storage service command processing method, apparatus and device, and medium
US11656802B2 (en) 2019-12-28 2023-05-23 Inspur Electronic Information Industry Co., Ltd. Distributed block storage service command processing method, apparatus, device and medium
CN113254091A (en) * 2021-06-09 2021-08-13 广东睿江云计算股份有限公司 Ceph block device-based diskless system starting method
CN113254091B (en) * 2021-06-09 2021-11-02 广东睿江云计算股份有限公司 Ceph block device-based diskless system starting method

Similar Documents

Publication Publication Date Title
CN106527985A (en) Storage interaction device and storage system based on ceph
US10484015B2 (en) Data storage system with enforced fencing
US9851906B2 (en) Virtual machine data placement in a virtualized computing environment
CN104899286B (en) Distributed content is stored and is fetched
US8819230B2 (en) Virtual private storage array service for cloud servers
US20160132541A1 (en) Efficient implementations for mapreduce systems
CN105843557B (en) Redundant storage system, redundant storage method and redundant storage device
US10127276B2 (en) Method and system for dynamically optimizing client queries to read-mostly servers
CN107046563A (en) A kind of implementation method, system and the cloud platform of distribution type high efficient cloud disk
CN105612490A (en) Extent hashing technique for distributed storage architecture
CN105025053A (en) Distributed file upload method based on cloud storage technology and system
WO2012142027A2 (en) Reliability based data allocation and recovery in a storage system
WO2012167378A1 (en) System and method of optimization of in-memory data grid placement
CN105867843A (en) Data transmission method and device
CN103124299A (en) Distributed block-level storage system in heterogeneous environment
US10616134B1 (en) Prioritizing resource hosts for resource placement
CN104219279A (en) Modular architecture for extreme-scale distributed processing applications
CN104050248A (en) File storage system and storage method
CN105635310B (en) A kind of access method and device of storage resource
KR20140055288A (en) System and method for providing data analysis service in cloud environment
CN103329105A (en) Application recovery in file system
CN105516313A (en) Distributed storage system used for big data
Yang et al. Automatic and Scalable Data Replication Manager in Distributed Computation and Storage Infrastructure of Cyber-Physical Systems.
CN105637471B (en) Method and apparatus for being monitored and controlling to storage environment
CN109597903A (en) Image file processing apparatus and method, document storage system and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170322