CN110199512A - 存储系统中存储设备的管理方法及装置 - Google Patents

存储系统中存储设备的管理方法及装置 Download PDF

Info

Publication number
CN110199512A
CN110199512A CN201780002717.1A CN201780002717A CN110199512A CN 110199512 A CN110199512 A CN 110199512A CN 201780002717 A CN201780002717 A CN 201780002717A CN 110199512 A CN110199512 A CN 110199512A
Authority
CN
China
Prior art keywords
memory
memory node
address
management server
storage equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201780002717.1A
Other languages
English (en)
Other versions
CN110199512B (zh
Inventor
罗旦
刘玉
张巍
冒伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202011475355.8A priority Critical patent/CN112615917B/zh
Publication of CN110199512A publication Critical patent/CN110199512A/zh
Application granted granted Critical
Publication of CN110199512B publication Critical patent/CN110199512B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/10—Address translation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0688—Non-volatile semiconductor memory arrays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/65—Details of virtual memory and virtual address translation
    • G06F2212/657—Virtual address space management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本方案公开了一种存储系统中存储设备的管理方法，客户端可以根据获取访问请求指向的NVMe存储设备的队列的起始地址以及访问请求指向的NVMe存储设备的逻辑地址，向NVMe存储设备所在的存储节点发送远程直接内存访问命令，从而充分发挥了NVMe存储设备的性能，提高了存储系统的写性能。

Description

PCT国内申请，说明书已公开。

Claims (54)

  1. PCT国内申请，权利要求书已公开。
CN201780002717.1A 2017-12-26 2017-12-26 存储系统中存储设备的管理方法及装置 Active CN110199512B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011475355.8A CN112615917B (zh) 2017-12-26 2017-12-26 存储系统中存储设备的管理方法及存储系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/118650 WO2019127021A1 (zh) 2017-12-26 2017-12-26 存储系统中存储设备的管理方法及装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202011475355.8A Division CN112615917B (zh) 2017-12-26 2017-12-26 存储系统中存储设备的管理方法及存储系统

Publications (2)

Publication Number Publication Date
CN110199512A true CN110199512A (zh) 2019-09-03
CN110199512B CN110199512B (zh) 2020-12-22

Family

ID=67064268

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201780002717.1A Active CN110199512B (zh) 2017-12-26 2017-12-26 存储系统中存储设备的管理方法及装置
CN202011475355.8A Active CN112615917B (zh) 2017-12-26 2017-12-26 存储系统中存储设备的管理方法及存储系统

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202011475355.8A Active CN112615917B (zh) 2017-12-26 2017-12-26 存储系统中存储设备的管理方法及存储系统

Country Status (4)

Country Link
US (1) US11314454B2 (zh)
EP (2) EP3985949A1 (zh)
CN (2) CN110199512B (zh)
WO (1) WO2019127021A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111782268A (zh) * 2020-04-10 2020-10-16 北京京东尚科信息技术有限公司 分配硬件资源的方法、装置、设备和计算机可读介质

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11314608B1 (en) * 2020-10-02 2022-04-26 Dell Products L.P. Creating and distributing spare capacity of a disk array
US11334245B1 (en) * 2020-10-30 2022-05-17 Dell Products L.P. Native memory semantic remote memory access system
US11875046B2 (en) 2021-02-05 2024-01-16 Samsung Electronics Co., Ltd. Systems and methods for storage device resource management
CN114827178A (zh) * 2022-04-29 2022-07-29 济南浪潮数据技术有限公司 一种数据处理方法、装置、设备及可读存储介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102388357A (zh) * 2011-09-23 2012-03-21 华为技术有限公司 访问存储设备的方法及系统
CN103064797A (zh) * 2012-12-21 2013-04-24 华为技术有限公司 数据处理方法和虚拟机管理平台
US8595385B1 (en) * 2013-05-28 2013-11-26 DSSD, Inc. Method and system for submission queue acceleration
CN104111907A (zh) * 2014-06-27 2014-10-22 华为技术有限公司 一种访问NVMe存储设备的方法和NVMe存储设备
CN104951252A (zh) * 2015-06-12 2015-09-30 联想(北京)有限公司 一种数据访问方法及PCIe存储设备
US20160210062A1 (en) * 2014-05-07 2016-07-21 HGST Netherlands B.V. SYSTEM AND METHOD FOR PEER-TO-PEER PCIe STORAGE TRANSFERS
CN107111596A (zh) * 2015-12-14 2017-08-29 华为技术有限公司 一种集群中锁管理的方法、锁服务器及客户端
CN107229415A (zh) * 2016-03-24 2017-10-03 华为技术有限公司 一种数据写方法、数据读方法及相关设备、系统

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7801997B2 (en) * 2006-03-30 2010-09-21 International Business Machines Corporation Asynchronous interconnect protocol for a clustered DBMS
CN101291347B (zh) * 2008-06-06 2010-12-22 中国科学院计算技术研究所 一种网络存储系统
CN102968498B (zh) * 2012-12-05 2016-08-10 华为技术有限公司 数据处理方法及装置
US9986028B2 (en) * 2013-07-08 2018-05-29 Intel Corporation Techniques to replicate data between storage servers
US9311110B2 (en) * 2013-07-08 2016-04-12 Intel Corporation Techniques to initialize from a remotely accessible storage device
CN103634379B (zh) * 2013-11-13 2017-02-01 华为技术有限公司 一种分布式存储空间的管理方法和分布式存储系统
US9658782B2 (en) 2014-07-30 2017-05-23 Excelero Storage Ltd. Scalable data using RDMA and MMIO
US9112890B1 (en) * 2014-08-20 2015-08-18 E8 Storage Systems Ltd. Distributed storage over shared multi-queued storage device
US10061743B2 (en) * 2015-01-27 2018-08-28 International Business Machines Corporation Host based non-volatile memory clustering using network mapped storage
CN105989048B (zh) * 2015-02-05 2019-12-24 浙江大华技术股份有限公司 一种数据记录处理方法、设备及系统
CN104850502B (zh) * 2015-05-05 2018-03-09 华为技术有限公司 一种数据的访问方法、装置及设备
KR102430187B1 (ko) * 2015-07-08 2022-08-05 삼성전자주식회사 RDMA NVMe 디바이스의 구현 방법
CN106775434B (zh) * 2015-11-19 2019-11-29 华为技术有限公司 一种NVMe网络化存储的实现方法、终端、服务器及系统
US10423568B2 (en) * 2015-12-21 2019-09-24 Microsemi Solutions (U.S.), Inc. Apparatus and method for transferring data and commands in a memory management environment
US11086801B1 (en) * 2016-04-14 2021-08-10 Amazon Technologies, Inc. Dynamic resource management of network device
CN106155586B (zh) * 2016-05-31 2019-03-08 华为技术有限公司 一种存储方法、服务器及存储控制器
CN106469198B (zh) * 2016-08-31 2019-10-15 华为技术有限公司 键值存储方法、装置及系统

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102388357A (zh) * 2011-09-23 2012-03-21 华为技术有限公司 访问存储设备的方法及系统
CN103064797A (zh) * 2012-12-21 2013-04-24 华为技术有限公司 数据处理方法和虚拟机管理平台
US8595385B1 (en) * 2013-05-28 2013-11-26 DSSD, Inc. Method and system for submission queue acceleration
US20160210062A1 (en) * 2014-05-07 2016-07-21 HGST Netherlands B.V. SYSTEM AND METHOD FOR PEER-TO-PEER PCIe STORAGE TRANSFERS
CN104111907A (zh) * 2014-06-27 2014-10-22 华为技术有限公司 一种访问NVMe存储设备的方法和NVMe存储设备
CN104951252A (zh) * 2015-06-12 2015-09-30 联想(北京)有限公司 一种数据访问方法及PCIe存储设备
CN107111596A (zh) * 2015-12-14 2017-08-29 华为技术有限公司 一种集群中锁管理的方法、锁服务器及客户端
CN107229415A (zh) * 2016-03-24 2017-10-03 华为技术有限公司 一种数据写方法、数据读方法及相关设备、系统

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111782268A (zh) * 2020-04-10 2020-10-16 北京京东尚科信息技术有限公司 分配硬件资源的方法、装置、设备和计算机可读介质
CN111782268B (zh) * 2020-04-10 2024-05-17 北京京东尚科信息技术有限公司 分配硬件资源的方法、装置、设备和计算机可读介质

Also Published As

Publication number Publication date
CN112615917B (zh) 2024-04-12
CN110199512B (zh) 2020-12-22
EP3531666B1 (en) 2021-09-01
WO2019127021A1 (zh) 2019-07-04
US11314454B2 (en) 2022-04-26
EP3531666A1 (en) 2019-08-28
EP3985949A1 (en) 2022-04-20
US20200326891A1 (en) 2020-10-15
CN112615917A (zh) 2021-04-06
EP3531666A4 (en) 2019-08-28

Similar Documents

Publication Publication Date Title
CN110235098A (zh) 存储系统访问方法及装置
CN110199512A (zh) 存储系统中存储设备的管理方法及装置
CN102971732B (zh) 键/值存储器的集成分级查询处理的系统结构
US10218618B2 (en) Method and apparatus for processing operation request in storage system
JP5967673B2 (ja) データメンテナンス用の方法
KR20190117001A (ko) 유지관리 동작들을 위한 병합 트리 수정들
CN103312624B (zh) 一种消息队列服务系统和方法
CN103701957A (zh) Dns递归方法及其系统
US11321021B2 (en) Method and apparatus of managing mapping relationship between storage identifier and start address of queue of storage device corresponding to the storage identifier
EP3771169A1 (en) Message processing method and related device
CN103329111A (zh) 一种基于块存储的数据处理方法、装置及系统
US20220327102A1 (en) Data index management method and apparatus in storage system
CN107992270B (zh) 一种多控存储系统全局共享缓存的方法及装置
CN110245129A (zh) 一种分布式全局数据去重方法和装置
CN107908713A (zh) 一种基于Redis集群的分布式动态杜鹃过滤系统及其过滤方法
US10185783B2 (en) Data processing device, data processing method, and non-transitory computer readable medium
WO2016065610A1 (zh) 访问文件的方法、分布式存储系统和存储节点
CN116389322B (zh) 流量数据处理方法、装置、计算机设备和存储介质
US9069676B2 (en) Mapping engine for a storage device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant