CN1464468A - Data management system in the internet storage system - Google Patents

Data management system in the internet storage system Download PDF

Info

Publication number
CN1464468A
CN1464468A CN 02122473 CN02122473A CN1464468A CN 1464468 A CN1464468 A CN 1464468A CN 02122473 CN02122473 CN 02122473 CN 02122473 A CN02122473 A CN 02122473A CN 1464468 A CN1464468 A CN 1464468A
Authority
CN
China
Prior art keywords
data
write
read
metadata
memory device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 02122473
Other languages
Chinese (zh)
Other versions
CN1255731C (en
Inventor
许鲁
范中磊
张建刚
韩晓明
张瑾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zhongke Blue Whale Information Technology Co Ltd
Original Assignee
Institute of Computing Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Computing Technology of CAS filed Critical Institute of Computing Technology of CAS
Priority to CN 02122473 priority Critical patent/CN1255731C/en
Publication of CN1464468A publication Critical patent/CN1464468A/en
Application granted granted Critical
Publication of CN1255731C publication Critical patent/CN1255731C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data management system in the internet storage system comprising, storage device for performing system file data reading and writing on the storage device, metadata reading and writing, logging data reading and writing, reproduction and reclamation of data including file data and metadata, backup and recovery of data including file data, metadata and logging data, and resource allocation and reclamation, a server, by adding control protocol to the standard internet block device interface protocol based on the IP internet to control the storage device perform the relative operation.

Description

Data management system in the network store system
Technical field
The present invention relates to areas of information technology, particularly a kind of data management system that is applied to network store system.
Background technology
Attached net storage (being called for short NAS) and storage area network (being called for short SAN) are the based on network storage systems that grows up on the attached server stores of the tradition basis of (being called for short SAS), are two main developing direction in the new types of data memory module.
Although regarding memory device as, NAS and SAN separate with server, but unlike NAS, SAN structurally shows as a kind of independently network or subnet, and Fig. 1 is the structural representation of SAN, and wherein server (1) links to each other with memory device (3) by fiber channel network (2).
SAN is to be the center with the data storage, adopt telescopic network topology structure, the direct connected mode of the optical-fibre channel by having high transfer rate (being called for short FC), the selectable exchanges data of multichannel between the inner arbitrary node of SAN is provided, and data storage management is concentrated on storage system in the relatively independent storage area network.The data transmission rate of SAN network internal is very fast, but operating system still rests on server end, and the user is not at the network of directly visiting SAN, so this just causes SAN can not realize file-sharing under isomerous environment.Although after multiple optical channel transmission agreement is moved towards standardization and cross-platform clustered file systems gradually and is come into operation, SAN is implemented under the several operation systems the most at last, data sharing and data-optimized management to greatest extent, and the seamless expansion of system, but SAN is when pursuing performance and speed, also make it become expensive synonym, its expensive system equipment cost and complicated management are the main causes that limits its widespread use.
Along with the widespread use of the Internet and developing rapidly of technique of internet, the particularly appearance of the appearance of gigabit Ethernet and practicability thereof and 10,000,000,000 (10G) Ethernet, 40,000 million (40G) Ethernets and 160,000 million (160G) Ethernet provides material base for we solve the problem that the SAN based on FC exists.
Summary of the invention
The object of the present invention is to provide a kind of data managing method that is applied to network store system, to solve existing SAN cost height and problem such as complex management costliness based on FC.
For achieving the above object, data management system in the network store system comprises: memory device, carry out the read-write of read-write, the daily record data of read-write, the metadata of file data in the system, the backup of the data of duplicating and reclaim, comprise file data, metadata and daily record data of data that comprises file data and metadata and the distribution and the recovery of recovery and resource on described memory device; Server comes control store equipment to operate accordingly by add control protocol on the standard network block device interface protocol of IP based network.
The present invention adds control protocol on the standard network block device agreement of IP based network, come control store equipment to operate accordingly with this, make the read-write of file data, the read-write of metadata, the read-write of daily record data, duplicate and the backup of recovery, data and the distribution of recovery and resource of data all on memory device, finish with recovery, thereby realize incorporate data management.So just realized the centralized management of IP based network, compared that it has, and versatility is good, cost is low, realize and manage characteristics such as simple with SAN based on FC.
Description of drawings
Fig. 1 is the structural representation of SAN;
Fig. 2 is the data managing method logical diagram that the present invention is based on IP network;
Fig. 3 is the workflow diagram that the present invention is based on the data managing method of IP network.
Embodiment
The present invention proposes a kind of data management system that is applied to network store system.Its principal feature comprises following two aspects: duplicate and the distribution of the backup of recovery, data (comprising file data, metadata and daily record data etc.) and recovery and resource and the recovery etc. of 1, the read-write of the read-write of the read-write of file data, metadata, daily record data in the system, data (comprising file data and metadata) are all finished on memory device.2, server adds control protocol on the standard network block device agreement based on Internet Protocol (being called for short IP) network, comes control store equipment to operate accordingly with this, thereby realizes incorporate data management.
Fig. 2 has described logic relation picture of the present invention.One or more server 1 sends to one or more memory device 4 by the standard network block device agreement of IP network 2 and the control protocol 3 of adding thereon with control information, 5 pairs of protocol informations from server of protocol analysis module on the memory device are resolved, and call processing module 6 then and operate accordingly.The processing module 6 here comprise read-write, the metadata of file data read-write, the read-write of daily record data, data are duplicated and totally 6 processing sub such as the distribution of the backup of recovery, data and recovery and resource and recovery, are used for satisfying the different demands of server.
Be additional to control protocol on the standard network block device agreement among the present invention and be by some data block number being extracted, be not re-used as the request analysis of data block, and realize operation control memory device as the method that control command is resolved.Server sends data block request by standard network block device agreement, if the data block number of expression control command, memory device is then carried out corresponding operation; Otherwise just handle by the data block request of standard.Fig. 3 has provided the roughly flow process of its work.
For file system, these data blocks as the data block number correspondence of control command are used as bad piece handle among the present invention, so just guaranteed the support of memory device, can therefore not influence its scope of application different system.Certainly, to be used as bad piece processing as the data block of the data block number correspondence of control command can make the capacity of memory device decrease, but the quantity of these data blocks is considerably less, and the ratio that accounts for whole storage device data number of blocks is very low, can ignore fully.

Claims (6)

1. the data management system in the network store system is characterized in that comprising:
Memory device carries out the read-write of read-write, the daily record data of read-write, the metadata of file data in the system, the backup of the data of duplicating and reclaim, comprise file data, metadata and daily record data of data that comprises file data and metadata and the distribution and the recovery of recovery and resource on described memory device;
Server comes control store equipment to operate accordingly by add control protocol on the standard network block device interface protocol of IP based network.
2. by the described system of claim 1, it is characterized in that the described control protocol that is additional on the standard network block device agreement is by some data block number are extracted, be not re-used as the request analysis of data block, and realize the operation of memory device is controlled as the method that control command is resolved.
3. by the described system of claim 1, it is characterized in that described memory device comprises parsing module 5, be used for the protocol information from server is resolved; Processing module 6 is used to carry out the instruction of parsing module 5.
4. by the described system of claim 2, it is characterized in that described processing module comprise read-write, the metadata of file data read-write, the read-write of daily record data, data are duplicated and the distribution of the backup of recovery, data and recovery and resource and recycling submodule.
5. by the described system of claim 1, it is characterized in that described memory device is a plurality of memory devices.
6. by the described system of claim 1, it is characterized in that described server is a plurality of servers.
CN 02122473 2002-06-05 2002-06-05 Data management system in the internet storage system Expired - Fee Related CN1255731C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 02122473 CN1255731C (en) 2002-06-05 2002-06-05 Data management system in the internet storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 02122473 CN1255731C (en) 2002-06-05 2002-06-05 Data management system in the internet storage system

Publications (2)

Publication Number Publication Date
CN1464468A true CN1464468A (en) 2003-12-31
CN1255731C CN1255731C (en) 2006-05-10

Family

ID=29743237

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 02122473 Expired - Fee Related CN1255731C (en) 2002-06-05 2002-06-05 Data management system in the internet storage system

Country Status (1)

Country Link
CN (1) CN1255731C (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100405791C (en) * 2004-12-20 2008-07-23 华中科技大学 Flow processing method for network storage system
CN100416508C (en) * 2004-11-02 2008-09-03 惠普开发有限公司 Copy operations in storage networks
CN102137161A (en) * 2011-03-15 2011-07-27 华中科技大学 File-level data sharing and storing system based on fiber channel
CN101361047B (en) * 2005-12-07 2011-09-28 国际商业机器公司 Method and system for data protection in storage systems
CN1976491B (en) * 2005-12-02 2012-05-09 三星电子株式会社 Mobile content management apparatus
CN101542483B (en) * 2006-11-22 2012-08-29 国际商业机器公司 Apparatus and method for resource reclamation in data storage systems
CN104169921A (en) * 2012-06-15 2014-11-26 弗雷森纽斯医疗护理德国有限责任公司 Device, method, and data reading device for handling treatment-related data
CN101276301B (en) * 2007-03-27 2016-06-08 赛门铁克公司 The method and apparatus of Resources allocation between backup tasks in data backup system

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100416508C (en) * 2004-11-02 2008-09-03 惠普开发有限公司 Copy operations in storage networks
CN100405791C (en) * 2004-12-20 2008-07-23 华中科技大学 Flow processing method for network storage system
CN1976491B (en) * 2005-12-02 2012-05-09 三星电子株式会社 Mobile content management apparatus
CN101361047B (en) * 2005-12-07 2011-09-28 国际商业机器公司 Method and system for data protection in storage systems
CN101542483B (en) * 2006-11-22 2012-08-29 国际商业机器公司 Apparatus and method for resource reclamation in data storage systems
CN101276301B (en) * 2007-03-27 2016-06-08 赛门铁克公司 The method and apparatus of Resources allocation between backup tasks in data backup system
CN102137161A (en) * 2011-03-15 2011-07-27 华中科技大学 File-level data sharing and storing system based on fiber channel
CN102137161B (en) * 2011-03-15 2013-10-30 华中科技大学 File-level data sharing and storing system based on fiber channel
CN104169921A (en) * 2012-06-15 2014-11-26 弗雷森纽斯医疗护理德国有限责任公司 Device, method, and data reading device for handling treatment-related data

Also Published As

Publication number Publication date
CN1255731C (en) 2006-05-10

Similar Documents

Publication Publication Date Title
US7216148B2 (en) Storage system having a plurality of controllers
US7007048B1 (en) System for information life cycle management model for data migration and replication
JP4632574B2 (en) Storage device, file data backup method, and file data copy method
US7962609B2 (en) Adaptive storage block data distribution
CN102541990B (en) Database redistribution method and system utilizing virtual partitions
EP2002339B1 (en) Use of volume containers in replication and provisioning management
CN108183961A (en) A kind of distributed caching method based on Redis
JP2001331355A (en) Computer system
CN109299056B (en) A kind of method of data synchronization and device based on distributed file system
EP2702499A2 (en) System and method for migration of data clones
CN107832423B (en) File reading and writing method for distributed file system
CN1723434A (en) Apparatus and method for a scalable network attach storage system
CN102033912A (en) Distributed-type database access method and system
CN103503414A (en) Computing storage integration cluster system
CN111984191A (en) Multi-client caching method and system supporting distributed storage
CN103595799A (en) Method for achieving distributed shared data bank
US20020161982A1 (en) System and method for implementing a storage area network system protocol
CN108776690B (en) Method for HDFS distributed and centralized mixed data storage system based on hierarchical governance
CN1255731C (en) Data management system in the internet storage system
CN108536833A (en) A kind of distributed, database and its construction method towards big data
CN100535867C (en) Apparatus and method for file-level replication between two or more non-symmetric storage sites
CN109871363A (en) A kind of shared-file system and its building method of redundancy structure
CN1209714C (en) Server system based on network storage and expandable system structure and its method
CN112069142A (en) Distributed high-availability shared storage system and construction method thereof
Dell

Legal Events

Date Code Title Description
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: TIANJIN ZHONGKE BLUE WHALE INFORMATION TECHNOLOGY

Free format text: FORMER OWNER: INST. OF COMPUTING TECHN. ACADEMIA SINICA

Effective date: 20091204

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20091204

Address after: Tianjin New Technology Industrial Park Huayuan Industrial Park Haitai development 6 Road 6 green industrial base F 5 gate 201.

Patentee after: Tianjin Branch Blue Whale Information Technology Co., Ltd.

Address before: No. 6 South Road, Zhongguancun Academy of Sciences, Beijing

Patentee before: Institute of Computing Technology, Chinese Academy of Sciences

PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Data managing method for network storage system and network storage system constituted thereby

Effective date of registration: 20120629

Granted publication date: 20060510

Pledgee: Bank of Shanghai Limited by Share Ltd Tianjin branch

Pledgor: Tianjin Branch Blue Whale Information Technology Co., Ltd.

Registration number: 2012990000342

PC01 Cancellation of the registration of the contract for pledge of patent right

Date of cancellation: 20130724

Granted publication date: 20060510

Pledgee: Bank of Shanghai Limited by Share Ltd Tianjin branch

Pledgor: Tianjin Branch Blue Whale Information Technology Co., Ltd.

Registration number: 2012990000342

PLDC Enforcement, change and cancellation of contracts on pledge of patent right or utility model
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Data managing method for network storage system and network storage system constituted thereby

Effective date of registration: 20130815

Granted publication date: 20060510

Pledgee: Bank of Shanghai Limited by Share Ltd Tianjin branch

Pledgor: Tianjin Branch Blue Whale Information Technology Co., Ltd.

Registration number: 2013120000025

PLDC Enforcement, change and cancellation of contracts on pledge of patent right or utility model
PC01 Cancellation of the registration of the contract for pledge of patent right

Date of cancellation: 20140404

Granted publication date: 20060510

Pledgee: Bank of Shanghai Limited by Share Ltd Tianjin branch

Pledgor: Tianjin Branch Blue Whale Information Technology Co., Ltd.

Registration number: 2013120000025

PLDC Enforcement, change and cancellation of contracts on pledge of patent right or utility model
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Data managing method for network storage system and network storage system constituted thereby

Effective date of registration: 20140428

Granted publication date: 20060510

Pledgee: Bank of Shanghai Limited by Share Ltd Tianjin branch

Pledgor: Tianjin Branch Blue Whale Information Technology Co., Ltd.

Registration number: 2014120000025

PLDC Enforcement, change and cancellation of contracts on pledge of patent right or utility model
ASS Succession or assignment of patent right

Owner name: BEIJING ZHONGKE BLUEWHALE INFORMATION TECHNOLOGY C

Effective date: 20140813

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20140813

Address after: 300384 Tianjin Huayuan Industrial Park New Technology Industrial Park Development Road No. 6 6 Haitai green industry base building F 5 door No. 201

Patentee after: Tianjin Branch Blue Whale Information Technology Co., Ltd.

Patentee after: Beijing Zhongke blue whale Information Technology Co., Ltd.

Address before: 300384 Tianjin Huayuan Industrial Park New Technology Industrial Park Development Road No. 6 6 Haitai green industry base building F 5 door No. 201

Patentee before: Tianjin Branch Blue Whale Information Technology Co., Ltd.

PC01 Cancellation of the registration of the contract for pledge of patent right

Date of cancellation: 20150526

Granted publication date: 20060510

Pledgee: Bank of Shanghai Limited by Share Ltd Tianjin branch

Pledgor: Tianjin Branch Blue Whale Information Technology Co., Ltd.

Registration number: 2014120000025

PLDC Enforcement, change and cancellation of contracts on pledge of patent right or utility model
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Data managing method for network storage system and network storage system constituted thereby

Effective date of registration: 20150727

Granted publication date: 20060510

Pledgee: Bank of Shanghai Limited by Share Ltd Tianjin branch

Pledgor: Tianjin Zhongke blue whale Information Technology Co., Ltd.|Beijing Zhongke blue whale Information Technology Co., Ltd.

Registration number: 2015120000053

PLDC Enforcement, change and cancellation of contracts on pledge of patent right or utility model
PC01 Cancellation of the registration of the contract for pledge of patent right

Date of cancellation: 20161019

Granted publication date: 20060510

Pledgee: Bank of Shanghai Limited by Share Ltd Tianjin branch

Pledgor: Tianjin Zhongke blue whale Information Technology Co., Ltd.|Beijing Zhongke blue whale Information Technology Co., Ltd.

Registration number: 2015120000053

PLDC Enforcement, change and cancellation of contracts on pledge of patent right or utility model
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Data managing method for network storage system and network storage system constituted thereby

Effective date of registration: 20170302

Granted publication date: 20060510

Pledgee: Bank of Shanghai Limited by Share Ltd Tianjin branch

Pledgor: Tianjin Zhongke blue whale Information Technology Co., Ltd., Beijing Zhongke blue whale Information Technology Co., Ltd.

Registration number: 2017990000145

PE01 Entry into force of the registration of the contract for pledge of patent right
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20060510

Termination date: 20210605