CN110612511B - 使用流选择性地向分配区域中存储数据 - Google Patents

使用流选择性地向分配区域中存储数据 Download PDF

Info

Publication number
CN110612511B
CN110612511B CN201880028884.8A CN201880028884A CN110612511B CN 110612511 B CN110612511 B CN 110612511B CN 201880028884 A CN201880028884 A CN 201880028884A CN 110612511 B CN110612511 B CN 110612511B
Authority
CN
China
Prior art keywords
data
storage device
allocation
stream
storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880028884.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN110612511A (zh
Inventor
R·德罗纳拉朱
K·D·斯特林
M·K·布哈塔查尔杰
M·古普塔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NetApp Inc
Original Assignee
NetApp Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NetApp Inc filed Critical NetApp Inc
Publication of CN110612511A publication Critical patent/CN110612511A/zh
Application granted granted Critical
Publication of CN110612511B publication Critical patent/CN110612511B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G06F3/0605—Improving or facilitating administration, e.g. storage management by facilitating the interaction with a user or administrator
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0626—Reducing size or complexity of storage systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/0644—Management of space entities, e.g. partitions, extents, pools
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/068—Hybrid storage device
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0689—Disk arrays, e.g. RAID, JBOD
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201880028884.8A 2017-03-09 2018-03-09 使用流选择性地向分配区域中存储数据 Active CN110612511B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/453,949 2017-03-09
US15/453,949 US10761750B2 (en) 2017-03-09 2017-03-09 Selectively storing data into allocation areas using streams
PCT/US2018/021659 WO2018165502A1 (en) 2017-03-09 2018-03-09 Selectively storing data into allocations areas using streams

Publications (2)

Publication Number Publication Date
CN110612511A CN110612511A (zh) 2019-12-24
CN110612511B true CN110612511B (zh) 2023-10-03

Family

ID=61832594

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880028884.8A Active CN110612511B (zh) 2017-03-09 2018-03-09 使用流选择性地向分配区域中存储数据

Country Status (5)

Country Link
US (2) US10761750B2 (https=)
EP (1) EP3593238B1 (https=)
JP (1) JP7097379B2 (https=)
CN (1) CN110612511B (https=)
WO (1) WO2018165502A1 (https=)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10776023B2 (en) * 2016-11-07 2020-09-15 Gaea LLC Data storage device with configurable policy-based storage device behavior
US10338842B2 (en) * 2017-05-19 2019-07-02 Samsung Electronics Co., Ltd. Namespace/stream management
US10877691B2 (en) * 2017-12-29 2020-12-29 Intel Corporation Stream classification based on logical regions
US11461023B1 (en) * 2018-01-31 2022-10-04 EMC IP Holding Company LLC Flexible expansion of data storage capacity
CN111078144A (zh) * 2019-11-30 2020-04-28 苏州浪潮智能科技有限公司 一种提高自动分层效率的方法、系统、终端及存储介质
KR102910546B1 (ko) * 2019-12-26 2026-01-12 삼성전자주식회사 비지도 학습 기법을 사용하는 스토리지 장치 및 그것의 메모리 관리 방법
CN113825687B (zh) * 2020-04-01 2025-03-11 御眼视觉技术有限公司 流控制完整性
KR102691862B1 (ko) * 2020-04-09 2024-08-06 에스케이하이닉스 주식회사 데이터 저장 장치 및 그 동작 방법
CN111782632B (zh) 2020-06-28 2024-07-09 百度在线网络技术（北京）有限公司 数据处理方法、装置、设备和存储介质
CN112118262B (zh) * 2020-09-21 2022-07-29 武汉中元华电科技股份有限公司 一种基于动态内存分配实现数据排序与合并的系统及方法
US11947803B2 (en) * 2020-10-26 2024-04-02 EMC IP Holding Company LLC Effective utilization of different drive capacities
US11405456B2 (en) * 2020-12-22 2022-08-02 Red Hat, Inc. Policy-based data placement in an edge environment
US20220244869A1 (en) * 2021-02-02 2022-08-04 Micron Technology, Inc. File system storage allocation based on zones of a memory device
US12366969B2 (en) * 2021-12-24 2025-07-22 Samsung Electronics Co., Ltd. Storage device including memory controller and operating method of the same
US20240184463A1 (en) * 2022-12-02 2024-06-06 Micron Technology, Inc. Data type based write management techniques
US20240345768A1 (en) * 2023-04-11 2024-10-17 SK Hynix NAND Product Solutions Corp. (dba Solidigm) System and methods for determining an optimal data relocation at an individual read disturb event using multiple write streams
US12411773B2 (en) 2023-05-25 2025-09-09 Sk Hynix Nand Product Solutions Corp. Host bandwidth optimized data stream memory writes
CN119473120A (zh) 2023-08-10 2025-02-18 戴尔产品有限公司 用于盘映射的方法、电子设备、程序产品
KR20250121805A (ko) * 2024-02-05 2025-08-12 에스케이하이닉스 주식회사 데이터 저장 시스템 및 메타 데이터 관리 방법
US12541312B1 (en) 2024-10-25 2026-02-03 Netapp, Inc. Storage operations based on enhanced contiguity awareness

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101495978A (zh) * 2006-07-27 2009-07-29 国际商业机器公司 减少总线连接的消费者和产生者之间的消息流
CN101663654A (zh) * 2007-04-23 2010-03-03 微软公司 用于连接到主机的存储设备的优化的提示模型和用于存储设备的写优化方案
CN102939765A (zh) * 2009-12-01 2013-02-20 博马里斯网络公司 动态服务群组发现
CN105051675A (zh) * 2013-03-20 2015-11-11 亚马逊技术股份有限公司 复制目标服务
US9471585B1 (en) * 2013-12-20 2016-10-18 Amazon Technologies, Inc. Decentralized de-duplication techniques for largescale data streams

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100855467B1 (ko) * 2006-09-27 2008-09-01 삼성전자주식회사 이종 셀 타입을 지원하는 비휘발성 메모리를 위한 맵핑장치 및 방법
JP4697146B2 (ja) * 2007-01-19 2011-06-08 Ｔｄｋ株式会社 メモリコントローラ及びメモリコントローラを備えるフラッシュメモリシステム、並びにフラッシュメモリの制御方法
KR101498673B1 (ko) * 2007-08-14 2015-03-09 삼성전자주식회사 반도체 드라이브, 그것의 데이터 저장 방법, 그리고 그것을포함한 컴퓨팅 시스템
JP2011515727A (ja) * 2008-02-12 2011-05-19 ネットアップ，インコーポレイテッド ハイブリッド媒体ストレージシステムアーキテクチャ
US8074043B1 (en) * 2009-01-30 2011-12-06 Symantec Corporation Method and apparatus to recover from interrupted data streams in a deduplication system
US20110107042A1 (en) 2009-11-03 2011-05-05 Andrew Herron Formatting data storage according to data classification
US8959284B1 (en) * 2010-06-28 2015-02-17 Western Digital Technologies, Inc. Disk drive steering write data to write cache based on workload
US10102117B2 (en) * 2012-01-12 2018-10-16 Sandisk Technologies Llc Systems and methods for cache and storage device coordination
US8751725B1 (en) * 2012-01-27 2014-06-10 Netapp, Inc. Hybrid storage aggregate
US9106721B2 (en) * 2012-10-02 2015-08-11 Nextbit Systems Application state synchronization across multiple devices
GB2528333A (en) * 2014-07-15 2016-01-20 Ibm Device and method for determining a number of storage devices for each of a plurality of storage tiers and an assignment of data to be stored in the plurality
US10552085B1 (en) * 2014-09-09 2020-02-04 Radian Memory Systems, Inc. Techniques for directed data migration
US9632927B2 (en) * 2014-09-25 2017-04-25 International Business Machines Corporation Reducing write amplification in solid-state drives by separating allocation of relocate writes from user writes
US9904480B1 (en) * 2014-12-18 2018-02-27 EMC IP Holding Company LLC Multiplexing streams without changing the number of streams of a deduplicating storage system
US10496304B2 (en) * 2015-01-02 2019-12-03 Reservoir Labs, Inc. Systems and methods for minimizing communications
US9696935B2 (en) * 2015-04-24 2017-07-04 Kabushiki Kaisha Toshiba Storage device that secures a block for a stream or namespace and system having the storage device
US10437671B2 (en) * 2015-06-30 2019-10-08 Pure Storage, Inc. Synchronizing replicated stored data
US10884914B2 (en) * 2016-02-19 2021-01-05 International Business Machines Corporation Regrouping data during relocation to facilitate write amplification reduction
US10284650B2 (en) * 2016-06-22 2019-05-07 Netscout Systems Texas, Llc Method and system for dynamic handling in real time of data streams with variable and unpredictable behavior
KR102318477B1 (ko) * 2016-08-29 2021-10-27 삼성전자주식회사 Ssd 어레이 관리를 위한 스트림 식별자 기반 스토리지 시스템
US10257258B2 (en) * 2016-10-31 2019-04-09 International Business Machines Corporation Transferring data between block and file storage systems
JP2018160195A (ja) * 2017-03-23 2018-10-11 東芝メモリ株式会社 メモリシステムおよび不揮発性メモリの制御方法
US10698808B2 (en) * 2017-04-25 2020-06-30 Samsung Electronics Co., Ltd. Garbage collection—automatic data placement
US11048624B2 (en) * 2017-04-25 2021-06-29 Samsung Electronics Co., Ltd. Methods for multi-stream garbage collection

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101495978A (zh) * 2006-07-27 2009-07-29 国际商业机器公司 减少总线连接的消费者和产生者之间的消息流
CN101663654A (zh) * 2007-04-23 2010-03-03 微软公司 用于连接到主机的存储设备的优化的提示模型和用于存储设备的写优化方案
CN102939765A (zh) * 2009-12-01 2013-02-20 博马里斯网络公司 动态服务群组发现
CN105051675A (zh) * 2013-03-20 2015-11-11 亚马逊技术股份有限公司 复制目标服务
US9471585B1 (en) * 2013-12-20 2016-10-18 Amazon Technologies, Inc. Decentralized de-duplication techniques for largescale data streams

Also Published As

Publication number Publication date
JP2020511714A (ja) 2020-04-16
US10761750B2 (en) 2020-09-01
JP7097379B2 (ja) 2022-07-07
EP3593238A1 (en) 2020-01-15
EP3593238B1 (en) 2025-06-04
US20180260154A1 (en) 2018-09-13
US20200356288A1 (en) 2020-11-12
CN110612511A (zh) 2019-12-24
WO2018165502A1 (en) 2018-09-13
US11409448B2 (en) 2022-08-09

Similar Documents

Publication Publication Date Title
CN110612511B (zh) 使用流选择性地向分配区域中存储数据
US11880578B2 (en) Composite aggregate architecture
US11620064B2 (en) Asynchronous semi-inline deduplication
US12282434B2 (en) Methods for managing input-output operations in zone translation layer architecture and devices thereof
US10769024B2 (en) Incremental transfer with unused data block reclamation
CN109313538B (zh) 内联去重
EP3659045B1 (en) Methods for managing distributed snapshot for low latency storage and devices thereof
US20150213047A1 (en) Coalescing sequences for host side deduplication

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant