CN110073321A - 一种存储控制器及io请求处理方法 - Google Patents

一种存储控制器及io请求处理方法 Download PDF

Info

Publication number
CN110073321A
CN110073321A CN201680091657.0A CN201680091657A CN110073321A CN 110073321 A CN110073321 A CN 110073321A CN 201680091657 A CN201680091657 A CN 201680091657A CN 110073321 A CN110073321 A CN 110073321A
Authority
CN
China
Prior art keywords
request
index
core
storage unit
handling ordered
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201680091657.0A
Other languages
English (en)
Other versions
CN110073321B (zh
Inventor
余思
龚骏辉
赵聪
王成
卢玥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN110073321A publication Critical patent/CN110073321A/zh
Application granted granted Critical
Publication of CN110073321B publication Critical patent/CN110073321B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0611—Improving I/O performance in relation to response time
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0613—Improving I/O performance in relation to throughput
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0653—Monitoring storage devices or systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种存储控制器，涉及存储技术领域。该存储控制器包括分发核心，多个排序核心和请求处理核心。这三种核心分别用于将输入输出IO请求分发至不同排序核心，为每个IO请求生成处理排序索引和按照各个IO请求的处理排序索引的大小处理IO请求，以灵活调度该存储控制器接收的IO请求。

Description

PCT国内申请，说明书已公开。

Claims (14)

  1. PCT国内申请，权利要求书已公开。
CN201680091657.0A 2016-12-29 2016-12-29 一种存储控制器及io请求处理方法 Active CN110073321B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/113083 WO2018119899A1 (zh) 2016-12-29 2016-12-29 一种存储控制器及io请求处理方法

Publications (2)

Publication Number Publication Date
CN110073321A true CN110073321A (zh) 2019-07-30
CN110073321B CN110073321B (zh) 2020-05-08

Family

ID=62710139

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680091657.0A Active CN110073321B (zh) 2016-12-29 2016-12-29 一种存储控制器及io请求处理方法

Country Status (5)

Country Link
US (1) US11003360B2 (zh)
EP (1) EP3550421B1 (zh)
JP (1) JP6773229B2 (zh)
CN (1) CN110073321B (zh)
WO (1) WO2018119899A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109254726A (zh) * 2018-08-16 2019-01-22 华为技术有限公司 分布式存储系统中服务质量保障方法、控制节点及系统
US11636059B2 (en) * 2020-03-31 2023-04-25 Samsung Electronics Co., Ltd. Scaling performance in a storage server with storage devices

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100262730A1 (en) * 2009-04-14 2010-10-14 Jibbe Mahmoud K System for handling parallel input/output threads with cache coherency in a multi-core based storage array
CN103577115A (zh) * 2012-07-31 2014-02-12 华为技术有限公司 数据的排布处理方法和装置
CN104679575A (zh) * 2013-11-28 2015-06-03 阿里巴巴集团控股有限公司 输入输出流的控制系统及其方法
CN105183375A (zh) * 2015-08-31 2015-12-23 成都华为技术有限公司 一种热点数据的服务质量的控制方法和装置
US20160299695A1 (en) * 2013-02-22 2016-10-13 Amazon Technologies, Inc. Managing Operational Parameters for Electronic Resources
US20160299697A1 (en) * 2015-04-08 2016-10-13 Prophetstor Data Services, Inc. Workload-aware i/o scheduler in software-defined hybrid storage system

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7917903B2 (en) 2003-03-27 2011-03-29 Hewlett-Packard Development Company, L.P. Quality of service controller and method for a data storage system
US7277984B2 (en) 2004-06-23 2007-10-02 International Business Machines Corporation Methods, apparatus and computer programs for scheduling storage requests
US7646779B2 (en) 2004-12-23 2010-01-12 Intel Corporation Hierarchical packet scheduler using hole-filling and multiple packet buffering
US7823154B2 (en) 2005-09-16 2010-10-26 Hewlett-Packard Development Company, L.P. System and method for providing, by a plurality of schedulers, differentiated service to consumers of distributed resources
JP2007257180A (ja) * 2006-03-22 2007-10-04 Hitachi Ltd ネットワークノード、スイッチ及びネットワーク障害回復方法
US11010076B2 (en) 2007-03-29 2021-05-18 Violin Systems Llc Memory system with multiple striping of raid groups and method for performing the same
CN101272334B (zh) 2008-03-19 2010-11-10 杭州华三通信技术有限公司 使用多核CPU处理QoS业务的方法、装置和设备
CN101299181A (zh) * 2008-07-08 2008-11-05 杭州华三通信技术有限公司 基于磁盘进行i/o请求缓存的方法和装置以及san存储设备
US20100030931A1 (en) 2008-08-04 2010-02-04 Sridhar Balasubramanian Scheduling proportional storage share for storage systems
CN101354664B (zh) 2008-08-19 2011-12-28 中兴通讯股份有限公司 多核处理器中断负载均衡方法和装置
CN102073461B (zh) 2010-12-07 2012-07-04 成都市华为赛门铁克科技有限公司 输入输出请求调度方法、相关装置和存储阵列
WO2012096652A1 (en) * 2011-01-11 2012-07-19 Hewlett-Packard Development Company, L.P. Concurrent request scheduling
US8793463B2 (en) * 2011-09-12 2014-07-29 Microsoft Corporation Allocation strategies for storage device sets
US8321627B1 (en) * 2011-10-06 2012-11-27 Google Inc. Memory operation command latency management
US8943505B2 (en) 2012-08-24 2015-01-27 National Instruments Corporation Hardware assisted real-time scheduler using memory monitoring
CN103338252B (zh) 2013-06-27 2017-05-24 南京邮电大学 一种分布式数据库并发存储虚拟请求机制的实现方法
CN103412790B (zh) 2013-08-07 2016-07-06 南京师范大学 移动安全中间件的多核并发调度方法与系统
US9170943B2 (en) * 2013-08-29 2015-10-27 Globalfoundries U.S. 2 Llc Selectively enabling write caching in a storage system based on performance metrics
US9983801B1 (en) 2013-09-21 2018-05-29 Avago Technologies General Ip (Singapore) Pte. Ltd. Priority queueing for low latency storage networks
JP2017512350A (ja) 2014-03-08 2017-05-18 ディアマンティ インコーポレイテッド 集中型ネットワーキング及びストレージのための方法及びシステム
CN105589829A (zh) 2014-09-15 2016-05-18 华为技术有限公司 基于多核处理器芯片的数据处理方法、装置以及系统
US9483187B2 (en) 2014-09-30 2016-11-01 Nimble Storage, Inc. Quality of service implementation in a networked storage system with hierarchical schedulers
WO2016101287A1 (zh) * 2014-12-27 2016-06-30 华为技术有限公司 一种存储系统数据分发的方法、分发装置与存储系统
US9720601B2 (en) * 2015-02-11 2017-08-01 Netapp, Inc. Load balancing technique for a storage array
CN106155764A (zh) 2015-04-23 2016-11-23 阿里巴巴集团控股有限公司 调度虚拟机输入输出资源的方法及装置
US9696935B2 (en) 2015-04-24 2017-07-04 Kabushiki Kaisha Toshiba Storage device that secures a block for a stream or namespace and system having the storage device
US9639280B2 (en) * 2015-06-18 2017-05-02 Advanced Micro Devices, Inc. Ordering memory commands in a computer system
US10313251B2 (en) * 2016-02-01 2019-06-04 Netapp, Inc. Methods and systems for managing quality of service in a networked storage environment
CN110851383B (zh) 2016-04-29 2023-08-22 华为技术有限公司 一种管理存储系统的方法及设备
CN109799956B (zh) * 2017-01-05 2023-11-17 华为技术有限公司 一种存储控制器及io请求处理方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100262730A1 (en) * 2009-04-14 2010-10-14 Jibbe Mahmoud K System for handling parallel input/output threads with cache coherency in a multi-core based storage array
CN103577115A (zh) * 2012-07-31 2014-02-12 华为技术有限公司 数据的排布处理方法和装置
US20160299695A1 (en) * 2013-02-22 2016-10-13 Amazon Technologies, Inc. Managing Operational Parameters for Electronic Resources
CN104679575A (zh) * 2013-11-28 2015-06-03 阿里巴巴集团控股有限公司 输入输出流的控制系统及其方法
US20160299697A1 (en) * 2015-04-08 2016-10-13 Prophetstor Data Services, Inc. Workload-aware i/o scheduler in software-defined hybrid storage system
CN105183375A (zh) * 2015-08-31 2015-12-23 成都华为技术有限公司 一种热点数据的服务质量的控制方法和装置

Also Published As

Publication number Publication date
CN110073321B (zh) 2020-05-08
US20190324662A1 (en) 2019-10-24
EP3550421A4 (en) 2019-12-18
JP6773229B2 (ja) 2020-10-21
EP3550421A1 (en) 2019-10-09
EP3550421B1 (en) 2021-06-30
US11003360B2 (en) 2021-05-11
JP2020503613A (ja) 2020-01-30
WO2018119899A1 (zh) 2018-07-05

Similar Documents

Publication Publication Date Title
CN106775493B (zh) 一种存储控制器及io请求处理方法
CN107688492B (zh) 资源的控制方法、装置和集群资源管理系统
CN108446176B (zh) 一种任务分配方法、计算机可读存储介质及终端设备
CN106233276B (zh) 网络可访问块存储装置的协调准入控制
Isard et al. Quincy: fair scheduling for distributed computing clusters
CN111381950A (zh) 一种面向边缘计算环境基于多副本的任务调度方法和系统
CN109408229A (zh) 一种调度方法及装置
Pakize A comprehensive view of Hadoop MapReduce scheduling algorithms
Bok et al. An efficient MapReduce scheduling scheme for processing large multimedia data
CN104881322A (zh) 一种基于装箱模型的集群资源调度方法及装置
CN108427602B (zh) 一种分布式计算任务的协同调度方法及装置
Delavar et al. A synthetic heuristic algorithm for independent task scheduling in cloud systems
CN107070965B (zh) 一种虚拟化容器资源下的多工作流资源供给方法
CN104156505B (zh) 一种基于用户行为分析的Hadoop集群作业调度方法及装置
CN110073321A (zh) 一种存储控制器及io请求处理方法
Shu-Jun et al. Optimization and research of hadoop platform based on fifo scheduler
Mana A feature based comparison study of big data scheduling algorithms
Singh et al. Market-inspired dynamic resource allocation in many-core high performance computing systems
CN110308991A (zh) 一种基于随机任务的数据中心节能优化方法及系统
Ru et al. Providing fairer resource allocation for multi-tenant cloud-based systems
KR101639947B1 (ko) 하둡 선점 데드라인 제약 스케줄링 방법 및 그 방법을 수행하는 컴퓨터프로그램과, 그 프로그램이 기록된 매체
Nzanywayingoma et al. Task scheduling and virtual resource optimising in Hadoop YARN-based cloud computing environment
CN110955644A (zh) 一种存储系统的io控制方法、装置、设备及存储介质
Liu et al. Cooperative job scheduling and data allocation for busy data-intensive parallel computing clusters
Jaiman Improving Performance Predictability in Cloud Data Stores

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant