CN110073321A - 一种存储控制器及io请求处理方法 - Google Patents
一种存储控制器及io请求处理方法 Download PDFInfo
- Publication number
- CN110073321A CN110073321A CN201680091657.0A CN201680091657A CN110073321A CN 110073321 A CN110073321 A CN 110073321A CN 201680091657 A CN201680091657 A CN 201680091657A CN 110073321 A CN110073321 A CN 110073321A
- Authority
- CN
- China
- Prior art keywords
- request
- index
- core
- storage unit
- handling ordered
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0613—Improving I/O performance in relation to throughput
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0653—Monitoring storage devices or systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
一种存储控制器,涉及存储技术领域。该存储控制器包括分发核心,多个排序核心和请求处理核心。这三种核心分别用于将输入输出IO请求分发至不同排序核心,为每个IO请求生成处理排序索引和按照各个IO请求的处理排序索引的大小处理IO请求,以灵活调度该存储控制器接收的IO请求。
Description
PCT国内申请,说明书已公开。
Claims (14)
- PCT国内申请,权利要求书已公开。
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2016/113083 WO2018119899A1 (zh) | 2016-12-29 | 2016-12-29 | 一种存储控制器及io请求处理方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110073321A true CN110073321A (zh) | 2019-07-30 |
CN110073321B CN110073321B (zh) | 2020-05-08 |
Family
ID=62710139
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201680091657.0A Active CN110073321B (zh) | 2016-12-29 | 2016-12-29 | 一种存储控制器及io请求处理方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US11003360B2 (zh) |
EP (1) | EP3550421B1 (zh) |
JP (1) | JP6773229B2 (zh) |
CN (1) | CN110073321B (zh) |
WO (1) | WO2018119899A1 (zh) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109254726A (zh) * | 2018-08-16 | 2019-01-22 | 华为技术有限公司 | 分布式存储系统中服务质量保障方法、控制节点及系统 |
US11636059B2 (en) * | 2020-03-31 | 2023-04-25 | Samsung Electronics Co., Ltd. | Scaling performance in a storage server with storage devices |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100262730A1 (en) * | 2009-04-14 | 2010-10-14 | Jibbe Mahmoud K | System for handling parallel input/output threads with cache coherency in a multi-core based storage array |
CN103577115A (zh) * | 2012-07-31 | 2014-02-12 | 华为技术有限公司 | 数据的排布处理方法和装置 |
CN104679575A (zh) * | 2013-11-28 | 2015-06-03 | 阿里巴巴集团控股有限公司 | 输入输出流的控制系统及其方法 |
CN105183375A (zh) * | 2015-08-31 | 2015-12-23 | 成都华为技术有限公司 | 一种热点数据的服务质量的控制方法和装置 |
US20160299695A1 (en) * | 2013-02-22 | 2016-10-13 | Amazon Technologies, Inc. | Managing Operational Parameters for Electronic Resources |
US20160299697A1 (en) * | 2015-04-08 | 2016-10-13 | Prophetstor Data Services, Inc. | Workload-aware i/o scheduler in software-defined hybrid storage system |
Family Cites Families (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7917903B2 (en) | 2003-03-27 | 2011-03-29 | Hewlett-Packard Development Company, L.P. | Quality of service controller and method for a data storage system |
US7277984B2 (en) | 2004-06-23 | 2007-10-02 | International Business Machines Corporation | Methods, apparatus and computer programs for scheduling storage requests |
US7646779B2 (en) | 2004-12-23 | 2010-01-12 | Intel Corporation | Hierarchical packet scheduler using hole-filling and multiple packet buffering |
US7823154B2 (en) | 2005-09-16 | 2010-10-26 | Hewlett-Packard Development Company, L.P. | System and method for providing, by a plurality of schedulers, differentiated service to consumers of distributed resources |
JP2007257180A (ja) * | 2006-03-22 | 2007-10-04 | Hitachi Ltd | ネットワークノード、スイッチ及びネットワーク障害回復方法 |
US11010076B2 (en) | 2007-03-29 | 2021-05-18 | Violin Systems Llc | Memory system with multiple striping of raid groups and method for performing the same |
CN101272334B (zh) | 2008-03-19 | 2010-11-10 | 杭州华三通信技术有限公司 | 使用多核CPU处理QoS业务的方法、装置和设备 |
CN101299181A (zh) * | 2008-07-08 | 2008-11-05 | 杭州华三通信技术有限公司 | 基于磁盘进行i/o请求缓存的方法和装置以及san存储设备 |
US20100030931A1 (en) | 2008-08-04 | 2010-02-04 | Sridhar Balasubramanian | Scheduling proportional storage share for storage systems |
CN101354664B (zh) | 2008-08-19 | 2011-12-28 | 中兴通讯股份有限公司 | 多核处理器中断负载均衡方法和装置 |
CN102073461B (zh) | 2010-12-07 | 2012-07-04 | 成都市华为赛门铁克科技有限公司 | 输入输出请求调度方法、相关装置和存储阵列 |
WO2012096652A1 (en) * | 2011-01-11 | 2012-07-19 | Hewlett-Packard Development Company, L.P. | Concurrent request scheduling |
US8793463B2 (en) * | 2011-09-12 | 2014-07-29 | Microsoft Corporation | Allocation strategies for storage device sets |
US8321627B1 (en) * | 2011-10-06 | 2012-11-27 | Google Inc. | Memory operation command latency management |
US8943505B2 (en) | 2012-08-24 | 2015-01-27 | National Instruments Corporation | Hardware assisted real-time scheduler using memory monitoring |
CN103338252B (zh) | 2013-06-27 | 2017-05-24 | 南京邮电大学 | 一种分布式数据库并发存储虚拟请求机制的实现方法 |
CN103412790B (zh) | 2013-08-07 | 2016-07-06 | 南京师范大学 | 移动安全中间件的多核并发调度方法与系统 |
US9170943B2 (en) * | 2013-08-29 | 2015-10-27 | Globalfoundries U.S. 2 Llc | Selectively enabling write caching in a storage system based on performance metrics |
US9983801B1 (en) | 2013-09-21 | 2018-05-29 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Priority queueing for low latency storage networks |
JP2017512350A (ja) | 2014-03-08 | 2017-05-18 | ディアマンティ インコーポレイテッド | 集中型ネットワーキング及びストレージのための方法及びシステム |
CN105589829A (zh) | 2014-09-15 | 2016-05-18 | 华为技术有限公司 | 基于多核处理器芯片的数据处理方法、装置以及系统 |
US9483187B2 (en) | 2014-09-30 | 2016-11-01 | Nimble Storage, Inc. | Quality of service implementation in a networked storage system with hierarchical schedulers |
WO2016101287A1 (zh) * | 2014-12-27 | 2016-06-30 | 华为技术有限公司 | 一种存储系统数据分发的方法、分发装置与存储系统 |
US9720601B2 (en) * | 2015-02-11 | 2017-08-01 | Netapp, Inc. | Load balancing technique for a storage array |
CN106155764A (zh) | 2015-04-23 | 2016-11-23 | 阿里巴巴集团控股有限公司 | 调度虚拟机输入输出资源的方法及装置 |
US9696935B2 (en) | 2015-04-24 | 2017-07-04 | Kabushiki Kaisha Toshiba | Storage device that secures a block for a stream or namespace and system having the storage device |
US9639280B2 (en) * | 2015-06-18 | 2017-05-02 | Advanced Micro Devices, Inc. | Ordering memory commands in a computer system |
US10313251B2 (en) * | 2016-02-01 | 2019-06-04 | Netapp, Inc. | Methods and systems for managing quality of service in a networked storage environment |
CN110851383B (zh) | 2016-04-29 | 2023-08-22 | 华为技术有限公司 | 一种管理存储系统的方法及设备 |
CN109799956B (zh) * | 2017-01-05 | 2023-11-17 | 华为技术有限公司 | 一种存储控制器及io请求处理方法 |
-
2016
- 2016-12-29 JP JP2019534231A patent/JP6773229B2/ja active Active
- 2016-12-29 WO PCT/CN2016/113083 patent/WO2018119899A1/zh unknown
- 2016-12-29 EP EP16925559.3A patent/EP3550421B1/en active Active
- 2016-12-29 CN CN201680091657.0A patent/CN110073321B/zh active Active
-
2019
- 2019-06-28 US US16/457,086 patent/US11003360B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100262730A1 (en) * | 2009-04-14 | 2010-10-14 | Jibbe Mahmoud K | System for handling parallel input/output threads with cache coherency in a multi-core based storage array |
CN103577115A (zh) * | 2012-07-31 | 2014-02-12 | 华为技术有限公司 | 数据的排布处理方法和装置 |
US20160299695A1 (en) * | 2013-02-22 | 2016-10-13 | Amazon Technologies, Inc. | Managing Operational Parameters for Electronic Resources |
CN104679575A (zh) * | 2013-11-28 | 2015-06-03 | 阿里巴巴集团控股有限公司 | 输入输出流的控制系统及其方法 |
US20160299697A1 (en) * | 2015-04-08 | 2016-10-13 | Prophetstor Data Services, Inc. | Workload-aware i/o scheduler in software-defined hybrid storage system |
CN105183375A (zh) * | 2015-08-31 | 2015-12-23 | 成都华为技术有限公司 | 一种热点数据的服务质量的控制方法和装置 |
Also Published As
Publication number | Publication date |
---|---|
CN110073321B (zh) | 2020-05-08 |
US20190324662A1 (en) | 2019-10-24 |
EP3550421A4 (en) | 2019-12-18 |
JP6773229B2 (ja) | 2020-10-21 |
EP3550421A1 (en) | 2019-10-09 |
EP3550421B1 (en) | 2021-06-30 |
US11003360B2 (en) | 2021-05-11 |
JP2020503613A (ja) | 2020-01-30 |
WO2018119899A1 (zh) | 2018-07-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106775493B (zh) | 一种存储控制器及io请求处理方法 | |
CN107688492B (zh) | 资源的控制方法、装置和集群资源管理系统 | |
CN108446176B (zh) | 一种任务分配方法、计算机可读存储介质及终端设备 | |
CN106233276B (zh) | 网络可访问块存储装置的协调准入控制 | |
Isard et al. | Quincy: fair scheduling for distributed computing clusters | |
CN111381950A (zh) | 一种面向边缘计算环境基于多副本的任务调度方法和系统 | |
CN109408229A (zh) | 一种调度方法及装置 | |
Pakize | A comprehensive view of Hadoop MapReduce scheduling algorithms | |
Bok et al. | An efficient MapReduce scheduling scheme for processing large multimedia data | |
CN104881322A (zh) | 一种基于装箱模型的集群资源调度方法及装置 | |
CN108427602B (zh) | 一种分布式计算任务的协同调度方法及装置 | |
Delavar et al. | A synthetic heuristic algorithm for independent task scheduling in cloud systems | |
CN107070965B (zh) | 一种虚拟化容器资源下的多工作流资源供给方法 | |
CN104156505B (zh) | 一种基于用户行为分析的Hadoop集群作业调度方法及装置 | |
CN110073321A (zh) | 一种存储控制器及io请求处理方法 | |
Shu-Jun et al. | Optimization and research of hadoop platform based on fifo scheduler | |
Mana | A feature based comparison study of big data scheduling algorithms | |
Singh et al. | Market-inspired dynamic resource allocation in many-core high performance computing systems | |
CN110308991A (zh) | 一种基于随机任务的数据中心节能优化方法及系统 | |
Ru et al. | Providing fairer resource allocation for multi-tenant cloud-based systems | |
KR101639947B1 (ko) | 하둡 선점 데드라인 제약 스케줄링 방법 및 그 방법을 수행하는 컴퓨터프로그램과, 그 프로그램이 기록된 매체 | |
Nzanywayingoma et al. | Task scheduling and virtual resource optimising in Hadoop YARN-based cloud computing environment | |
CN110955644A (zh) | 一种存储系统的io控制方法、装置、设备及存储介质 | |
Liu et al. | Cooperative job scheduling and data allocation for busy data-intensive parallel computing clusters | |
Jaiman | Improving Performance Predictability in Cloud Data Stores |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |