WO2016004120A2 - Système de stockage avec des disques virtuels - Google Patents

Système de stockage avec des disques virtuels Download PDF

Info

Publication number
WO2016004120A2
WO2016004120A2 PCT/US2015/038687 US2015038687W WO2016004120A2 WO 2016004120 A2 WO2016004120 A2 WO 2016004120A2 US 2015038687 W US2015038687 W US 2015038687W WO 2016004120 A2 WO2016004120 A2 WO 2016004120A2
Authority
WO
WIPO (PCT)
Prior art keywords
virtual disk
storage
data
version
storage platform
Prior art date
Application number
PCT/US2015/038687
Other languages
English (en)
Other versions
WO2016004120A3 (fr
Inventor
Avinash LAKSHIMAN
Srinivas LAKSHIMAN
Chinmaya Manjunath
Original Assignee
Hedvig, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/322,855 external-priority patent/US9558085B2/en
Priority claimed from US14/322,832 external-priority patent/US9875063B2/en
Priority claimed from US14/322,813 external-priority patent/US10067722B2/en
Priority claimed from US14/322,867 external-priority patent/US9798489B2/en
Priority claimed from US14/322,850 external-priority patent/US9424151B2/en
Priority claimed from US14/322,868 external-priority patent/US9483205B2/en
Priority claimed from US14/322,871 external-priority patent/US9411534B2/en
Priority claimed from US14/684,086 external-priority patent/US9864530B2/en
Application filed by Hedvig, Inc. filed Critical Hedvig, Inc.
Publication of WO2016004120A2 publication Critical patent/WO2016004120A2/fr
Publication of WO2016004120A3 publication Critical patent/WO2016004120A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G06F3/0605—Improving or facilitating administration, e.g. storage management by facilitating the interaction with a user or administrator
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0617—Improving the reliability of storage systems in relation to availability
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/065—Replication mechanisms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0662—Virtualisation aspects
    • G06F3/0665—Virtualisation aspects at area level, e.g. provisioning of virtual or logical volumes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/1658—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit
    • G06F11/1662—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit the resynchronized component or unit being a persistent storage device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2094—Redundant storage or storage space
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G06F3/0635—Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0661—Format or protocol conversion arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Un administrateur fournit un disque virtuel dans une plateforme de stockage à distance et définit des politiques pour ce disque virtuel. Une machine virtuelle écrit sur la plateforme de stockage et lit à partir de cette dernière au moyen de n'importe quel protocole de stockage. Des données de disque virtuel dans un pool de stockage défaillant sont migrées vers différents pools de stockage tout en respectant les politiques de chaque disque virtuel. Des commandes d'instantané et d'inversion sont données pour un disque virtuel à un moment particulier et les frais généraux sont réduits à un minimum. Un disque virtuel est cloné au moyen d'informations d'instantanés. Aucune donnée n'a besoin d'être copiée. Un nombre quelconque de grappes Zookeeper s'exécutent de façon coordonnée sur la plateforme de stockage, ce qui permet d'augmenter le débit global. Une estampille temporelle est générée, et garantit un compteur à croissance monotone, même en cas de panne d'une machine virtuelle. N'importe quel disque virtuel comprend une politique "compatible avec un nuage hybride" selon laquelle une réplique du disque virtuel est stockée dans un nuage public.
PCT/US2015/038687 2014-07-02 2015-06-30 Système de stockage avec des disques virtuels WO2016004120A2 (fr)

Applications Claiming Priority (16)

Application Number Priority Date Filing Date Title
US14/322,855 US9558085B2 (en) 2014-07-02 2014-07-02 Creating and reverting to a snapshot of a virtual disk
US14/322,832 US9875063B2 (en) 2014-07-02 2014-07-02 Method for writing data to a virtual disk using a controller virtual machine and different storage and communication protocols
US14/322,813 US10067722B2 (en) 2014-07-02 2014-07-02 Storage system for provisioning and storing data to a virtual disk
US14/322,813 2014-07-02
US14/322,867 US9798489B2 (en) 2014-07-02 2014-07-02 Cloning a virtual disk in a storage platform
US14/322,868 2014-07-02
US14/322,850 US9424151B2 (en) 2014-07-02 2014-07-02 Disk failure recovery for virtual disk with policies
US14/322,871 2014-07-02
US14/322,855 2014-07-02
US14/322,868 US9483205B2 (en) 2014-07-02 2014-07-02 Writing to a storage platform including a plurality of storage clusters
US14/322,850 2014-07-02
US14/322,871 US9411534B2 (en) 2014-07-02 2014-07-02 Time stamp generation for virtual disks
US14/322,832 2014-07-02
US14/322,867 2014-07-02
US14/684,086 2015-04-10
US14/684,086 US9864530B2 (en) 2014-07-02 2015-04-10 Method for writing data to virtual disk using a controller virtual machine and different storage and communication protocols on a single storage platform

Publications (2)

Publication Number Publication Date
WO2016004120A2 true WO2016004120A2 (fr) 2016-01-07
WO2016004120A3 WO2016004120A3 (fr) 2016-02-25

Family

ID=53674331

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/038687 WO2016004120A2 (fr) 2014-07-02 2015-06-30 Système de stockage avec des disques virtuels

Country Status (1)

Country Link
WO (1) WO2016004120A2 (fr)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018164782A1 (fr) * 2017-03-10 2018-09-13 Pure Storage, Inc. Duplication synchrone d'ensembles de données et d'autres objets gérés vers des systèmes de stockage en nuage
US10564863B2 (en) 2018-04-24 2020-02-18 International Business Machines Corporation Identifying an availability of a system
CN111414127A (zh) * 2019-01-04 2020-07-14 阿里巴巴集团控股有限公司 计算集群系统及其数据获取方法以及电子设备
WO2021011051A1 (fr) * 2019-07-18 2021-01-21 Pure Storage, Inc. Récupération de données dans un système de stockage virtuel
US10997132B2 (en) 2017-02-07 2021-05-04 Oracle International Corporation Systems and methods for live data migration with automatic redirection
US11089105B1 (en) 2017-12-14 2021-08-10 Pure Storage, Inc. Synchronously replicating datasets in cloud-based storage systems
US11314687B2 (en) 2020-09-24 2022-04-26 Commvault Systems, Inc. Container data mover for migrating data between distributed data storage systems integrated with application orchestrators
CN114493856A (zh) * 2022-04-11 2022-05-13 支付宝(杭州)信息技术有限公司 用于处理数据的方法、系统、装置和介质
US11487468B2 (en) 2020-07-17 2022-11-01 Commvault Systems, Inc. Healing failed erasure-coded write attempts in a distributed data storage system configured with fewer storage nodes than data plus parity fragments
US11570243B2 (en) 2020-09-22 2023-01-31 Commvault Systems, Inc. Decommissioning, re-commissioning, and commissioning new metadata nodes in a working distributed data storage system
US11675520B2 (en) 2017-03-10 2023-06-13 Pure Storage, Inc. Application replication among storage systems synchronously replicating a dataset
LU501203B1 (en) * 2022-01-04 2023-07-04 Microsoft Technology Licensing Llc Dynamic storage resiliency
US11789830B2 (en) 2020-09-22 2023-10-17 Commvault Systems, Inc. Anti-entropy-based metadata recovery in a strongly consistent distributed data storage system
US11941279B2 (en) 2017-03-10 2024-03-26 Pure Storage, Inc. Data path virtualization

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010044879A1 (en) * 2000-02-18 2001-11-22 Moulton Gregory Hagan System and method for distributed management of data storage
US20080201535A1 (en) * 2007-02-21 2008-08-21 Hitachi, Ltd. Method and Apparatus for Provisioning Storage Volumes
US9489396B2 (en) * 2011-07-01 2016-11-08 V3 Systems Holdings, Inc. Intermediation of hypervisor file system and storage device models
JP2013045379A (ja) * 2011-08-26 2013-03-04 Fujitsu Ltd ストレージ制御方法、情報処理装置およびプログラム
US9141290B2 (en) * 2012-05-13 2015-09-22 Emc Corporation Snapshot mechanism
US10152398B2 (en) * 2012-08-02 2018-12-11 At&T Intellectual Property I, L.P. Pipelined data replication for disaster recovery

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10997132B2 (en) 2017-02-07 2021-05-04 Oracle International Corporation Systems and methods for live data migration with automatic redirection
US11675520B2 (en) 2017-03-10 2023-06-13 Pure Storage, Inc. Application replication among storage systems synchronously replicating a dataset
US11941279B2 (en) 2017-03-10 2024-03-26 Pure Storage, Inc. Data path virtualization
US11716385B2 (en) 2017-03-10 2023-08-01 Pure Storage, Inc. Utilizing cloud-based storage systems to support synchronous replication of a dataset
US10503427B2 (en) 2017-03-10 2019-12-10 Pure Storage, Inc. Synchronously replicating datasets and other managed objects to cloud-based storage systems
CN110392876B (zh) * 2017-03-10 2024-04-30 净睿存储股份有限公司 用于将数据集和其他受管理对象同步地复制到基于云的存储系统的方法
CN110392876A (zh) * 2017-03-10 2019-10-29 净睿存储股份有限公司 将数据集和其他受管理对象同步地复制到基于云的存储系统
WO2018164782A1 (fr) * 2017-03-10 2018-09-13 Pure Storage, Inc. Duplication synchrone d'ensembles de données et d'autres objets gérés vers des systèmes de stockage en nuage
US11086555B1 (en) 2017-03-10 2021-08-10 Pure Storage, Inc. Synchronously replicating datasets
US11089105B1 (en) 2017-12-14 2021-08-10 Pure Storage, Inc. Synchronously replicating datasets in cloud-based storage systems
US11354044B2 (en) 2018-04-24 2022-06-07 International Business Machines Corporation Identifying an availability of a system
US10564863B2 (en) 2018-04-24 2020-02-18 International Business Machines Corporation Identifying an availability of a system
CN111414127A (zh) * 2019-01-04 2020-07-14 阿里巴巴集团控股有限公司 计算集群系统及其数据获取方法以及电子设备
CN111414127B (zh) * 2019-01-04 2023-04-28 阿里巴巴集团控股有限公司 计算集群系统及其数据获取方法以及电子设备
WO2021011051A1 (fr) * 2019-07-18 2021-01-21 Pure Storage, Inc. Récupération de données dans un système de stockage virtuel
US11526408B2 (en) 2019-07-18 2022-12-13 Pure Storage, Inc. Data recovery in a virtual storage system
US11614883B2 (en) 2020-07-17 2023-03-28 Commvault Systems, Inc. Distributed data storage system using erasure coding on storage nodes fewer than data plus parity fragments
US11487468B2 (en) 2020-07-17 2022-11-01 Commvault Systems, Inc. Healing failed erasure-coded write attempts in a distributed data storage system configured with fewer storage nodes than data plus parity fragments
US11789830B2 (en) 2020-09-22 2023-10-17 Commvault Systems, Inc. Anti-entropy-based metadata recovery in a strongly consistent distributed data storage system
US11647075B2 (en) 2020-09-22 2023-05-09 Commvault Systems, Inc. Commissioning and decommissioning metadata nodes in a running distributed data storage system
US11570243B2 (en) 2020-09-22 2023-01-31 Commvault Systems, Inc. Decommissioning, re-commissioning, and commissioning new metadata nodes in a working distributed data storage system
US11314687B2 (en) 2020-09-24 2022-04-26 Commvault Systems, Inc. Container data mover for migrating data between distributed data storage systems integrated with application orchestrators
LU501203B1 (en) * 2022-01-04 2023-07-04 Microsoft Technology Licensing Llc Dynamic storage resiliency
WO2023133038A1 (fr) * 2022-01-04 2023-07-13 Microsoft Technology Licensing, Llc Résilience de stockage dynamique
CN114493856A (zh) * 2022-04-11 2022-05-13 支付宝(杭州)信息技术有限公司 用于处理数据的方法、系统、装置和介质

Also Published As

Publication number Publication date
WO2016004120A3 (fr) 2016-02-25

Similar Documents

Publication Publication Date Title
US9424151B2 (en) Disk failure recovery for virtual disk with policies
US10067722B2 (en) Storage system for provisioning and storing data to a virtual disk
US9483205B2 (en) Writing to a storage platform including a plurality of storage clusters
US9875063B2 (en) Method for writing data to a virtual disk using a controller virtual machine and different storage and communication protocols
US9798489B2 (en) Cloning a virtual disk in a storage platform
US9411534B2 (en) Time stamp generation for virtual disks
US9558085B2 (en) Creating and reverting to a snapshot of a virtual disk
US9864530B2 (en) Method for writing data to virtual disk using a controller virtual machine and different storage and communication protocols on a single storage platform
WO2016004120A2 (fr) Système de stockage avec des disques virtuels
US11755415B2 (en) Variable data replication for storage implementing data backup
JP7053682B2 (ja) データベーステナントマイグレーションのシステム及び方法
US9037822B1 (en) Hierarchical volume tree
US11237864B2 (en) Distributed job scheduler with job stealing
US20230325124A1 (en) Global de-duplication of virtual disks in a storage platform
US11614883B2 (en) Distributed data storage system using erasure coding on storage nodes fewer than data plus parity fragments
US20170371750A1 (en) Method and apparatus for restoring data from snapshots
US10089009B2 (en) Method for layered storage of enterprise data
US10216450B2 (en) Mirror vote synchronization
US10852996B2 (en) System and method for provisioning slave storage including copying a master reference to slave storage and updating a slave reference
US20230418716A1 (en) Anti-entropy-based metadata recovery in a strongly consistent distributed data storage system
US11442894B2 (en) Methods for scalable file backup catalogs and devices thereof
US11079960B2 (en) Object storage system with priority meta object replication
US11074002B2 (en) Object storage system with meta object replication
US11093465B2 (en) Object storage system with versioned meta objects

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15739129

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15739129

Country of ref document: EP

Kind code of ref document: A2