CN105900061A - 对象存储系统中的业务流控制方法、控制器和系统 - Google Patents

对象存储系统中的业务流控制方法、控制器和系统 Download PDF

Info

Publication number
CN105900061A
CN105900061A CN201480064791.2A CN201480064791A CN105900061A CN 105900061 A CN105900061 A CN 105900061A CN 201480064791 A CN201480064791 A CN 201480064791A CN 105900061 A CN105900061 A CN 105900061A
Authority
CN
China
Prior art keywords
request
subject
controller
storage device
subobject
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201480064791.2A
Other languages
English (en)
Other versions
CN105900061B (zh
Inventor
童燕群
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN105900061A publication Critical patent/CN105900061A/zh
Application granted granted Critical
Publication of CN105900061B publication Critical patent/CN105900061B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/14—Handling requests for interconnection or transfer
    • G06F13/36—Handling requests for interconnection or transfer for access to common bus or bus system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0613—Improving I/O performance in relation to throughput
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G06F3/0635—Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/546—Message passing systems or structures, e.g. queues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/26—Flow control; Congestion control using explicit feedback to the source, e.g. choke packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/26—Flow control; Congestion control using explicit feedback to the source, e.g. choke packets
    • H04L47/263—Rate modification at the source after receiving feedback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00
    • G06F2209/50—Indexing scheme relating to G06F9/50
    • G06F2209/5013—Request control
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00
    • G06F2209/50—Indexing scheme relating to G06F9/50
    • G06F2209/5022—Workload threshold
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Stored Programmes (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Computer And Data Communications (AREA)

Abstract

一种对象存储系统中的业务流控制方法、控制器和系统。对象存储系统中的业务流控制方法为：控制器接收第一对象IO请求，获取处理数量阈值和待处理数量；若待处理数量小于处理数量阈值，将第一对象IO请求发送给存储设备客户端并更新待处理数量；接收存储设备客户端返回的第一对象IO请求的第一响应消息，第一响应消息中携带第一对象IO请求的处理结果；满足预定的条件时，根据接收到的对象IO请求的处理结果调整处理数量阈值。通过根据存储设备对对象IO请求的处理结果调整所述处理数量阈值，可以控制发送给存储设备的对象IO请求的数量，使存储设备处的对象IO请求不过载，能将资源都用于对象IO请求的有效处理，提高对象存储系统的性能和成功率。

Description

PCT国内申请，说明书已公开。

Claims (40)

  1. PCT国内申请，权利要求书已公开。
CN201480064791.2A 2014-10-22 2014-10-22 对象存储系统中的业务流控制方法、控制器和系统 Active CN105900061B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/089180 WO2016061766A1 (zh) 2014-10-22 2014-10-22 对象存储系统中的业务流控制方法、控制器和系统

Publications (2)

Publication Number Publication Date
CN105900061A true CN105900061A (zh) 2016-08-24
CN105900061B CN105900061B (zh) 2018-01-16

Family

ID=55760058

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480064791.2A Active CN105900061B (zh) 2014-10-22 2014-10-22 对象存储系统中的业务流控制方法、控制器和系统

Country Status (5)

Country Link
US (2) US9804981B2 (zh)
EP (1) EP3128420B1 (zh)
JP (1) JP6403140B2 (zh)
CN (1) CN105900061B (zh)
WO (1) WO2016061766A1 (zh)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110096379A (zh) * 2019-04-30 2019-08-06 武汉斗鱼鱼乐网络科技有限公司 基于通用协议的消息分发方法、装置、设备及存储介质
CN110333770A (zh) * 2019-07-10 2019-10-15 合肥兆芯电子有限公司 存储器管理方法、存储器存储装置及存储器控制电路单元
CN110377536A (zh) * 2019-07-12 2019-10-25 深信服科技股份有限公司 数据处理方法、装置、设备及计算机可读存储介质
CN110740099A (zh) * 2018-07-18 2020-01-31 阿里巴巴集团控股有限公司 一种数据流控方法和装置
CN111190709A (zh) * 2019-11-19 2020-05-22 泰康保险集团股份有限公司 处理请求的方法、装置、电子设备及可读存储介质
CN111291104A (zh) * 2020-01-20 2020-06-16 中国银联股份有限公司 一种基于异步应答的传输数据的方法及系统
CN113741991A (zh) * 2021-11-04 2021-12-03 苏州浪潮智能科技有限公司 提升ssd服务质量方法、装置、计算机设备和存储介质

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180335975A1 (en) * 2017-05-16 2018-11-22 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Translating a host data storage command into multiple disk commands
US10719245B1 (en) * 2017-07-13 2020-07-21 EMC IP Holding Company LLC Transactional IO scheduler for storage systems with multiple storage devices
US10599340B1 (en) * 2017-07-13 2020-03-24 EMC IP Holding LLC Policy driven IO scheduler to improve read IO performance in hybrid storage systems
CN107465630B (zh) * 2017-08-30 2021-08-31 郑州云海信息技术有限公司 一种带宽流量监管方法及系统
CN107911840A (zh) * 2017-11-21 2018-04-13 青岛海信电器股份有限公司 流媒体传输的控制方法及装置
CN109101194A (zh) * 2018-07-26 2018-12-28 郑州云海信息技术有限公司 一种刷写性能优化方法和存储系统
US11157205B2 (en) * 2018-11-15 2021-10-26 Western Digital Technologies, Inc. Object storage system with control entity quota enforcement
US11580082B2 (en) 2018-11-15 2023-02-14 Western Digital Technologies, Inc. Object storage system with control entity quota usage mapping
US11204717B2 (en) 2018-11-15 2021-12-21 Western Digital Technologies, Inc. Object storage system with access control quota status check
WO2020236272A1 (en) 2019-05-23 2020-11-26 Cray Inc. System and method for facilitating fine-grain flow control in a network interface controller (nic)
CN110650206B (zh) * 2019-09-29 2022-03-11 北京天融信网络安全技术有限公司 分布式存储系统中io流量控制方法、装置和存储介质
CN112383486A (zh) * 2020-11-05 2021-02-19 北京同有飞骥科技股份有限公司 基于租约的分布式对象存储服务质量保证方法及系统
CN113849129B (zh) * 2021-09-18 2023-08-25 苏州浪潮智能科技有限公司 一种存储控制器间的io请求转发方法、装置及设备
US20230419927A1 (en) * 2022-06-22 2023-12-28 Deepen Shah Automated remote music identification device and system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101776946A (zh) * 2010-01-20 2010-07-14 中国人民解放军国防科学技术大学 一种基于对象存储系统的功耗控制方法
US20110153724A1 (en) * 2009-12-23 2011-06-23 Murali Raja Systems and methods for object rate limiting in multi-core system
CN103036956A (zh) * 2012-11-30 2013-04-10 航天恒星科技有限公司 一种分布式组态化海量数据归档系统及实现方法
CN103150225A (zh) * 2013-03-25 2013-06-12 中国人民解放军国防科学技术大学 基于应用级代理的对象并行存储系统磁盘满异常容错方法

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002108841A (ja) * 2000-10-03 2002-04-12 Shimadzu Corp 分散型制御システム
US7065767B2 (en) 2001-06-29 2006-06-20 Intel Corporation Managed hosting server auditing and change tracking
JP2004310652A (ja) * 2003-04-10 2004-11-04 Just Syst Corp 情報配信装置および情報配信装置に利用可能なアクセス管理方法
US7765555B2 (en) * 2005-06-17 2010-07-27 Oracle America, Inc. Facilitating bulk lock-unbiasing in an object-based system
EP1907957A4 (en) 2005-06-29 2013-03-20 Otrsotech Ltd Liability Company INVESTMENT METHODS AND SYSTEMS
CN100466625C (zh) * 2006-09-07 2009-03-04 华为技术有限公司 一种实现业务流量控制的方法及系统
US8151082B2 (en) * 2007-12-06 2012-04-03 Fusion-Io, Inc. Apparatus, system, and method for converting a storage request into an append data storage command
US9104599B2 (en) * 2007-12-06 2015-08-11 Intelligent Intellectual Property Holdings 2 Llc Apparatus, system, and method for destaging cached data
CN100476742C (zh) * 2007-02-09 2009-04-08 华中科技大学 基于对象存储设备的负载平衡方法
US7877556B2 (en) * 2007-03-30 2011-01-25 Hitachi, Ltd. Method and apparatus for a unified storage system
US8984216B2 (en) * 2010-09-09 2015-03-17 Fusion-Io, Llc Apparatus, system, and method for managing lifetime of a storage device
CN101957729B (zh) * 2010-09-27 2014-07-02 中兴通讯股份有限公司 逻辑块变换方法及基于该方法兼容用户读写的方法和装置
US9589029B2 (en) * 2010-12-28 2017-03-07 Citrix Systems, Inc. Systems and methods for database proxy request switching
US9164785B2 (en) * 2011-03-14 2015-10-20 Sap Se Predicting performance of a consolidated virtualized computing environment
US9705733B2 (en) * 2012-08-07 2017-07-11 Ca, Inc. Systems and methods for throttling polling
US20140153577A1 (en) * 2012-12-03 2014-06-05 Aruba Networks, Inc. Session-based forwarding
US9652514B2 (en) * 2014-05-20 2017-05-16 Citrix Systems, Inc. Systems and methods for redirect handling
US9639854B2 (en) * 2014-06-26 2017-05-02 Nuance Communications, Inc. Voice-controlled information exchange platform, such as for providing information to supplement advertising
US20160062832A1 (en) * 2014-09-02 2016-03-03 Netapp. Inc. Wide spreading data storage architecture
JP6443170B2 (ja) * 2015-03-26 2018-12-26 富士通株式会社 階層ストレージ装置，階層ストレージ制御装置，階層ストレージ制御プログラム及び階層ストレージ制御方法
US9787772B2 (en) * 2015-05-19 2017-10-10 Netapp, Inc. Policy based alerts for networked storage systems

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110153724A1 (en) * 2009-12-23 2011-06-23 Murali Raja Systems and methods for object rate limiting in multi-core system
CN101776946A (zh) * 2010-01-20 2010-07-14 中国人民解放军国防科学技术大学 一种基于对象存储系统的功耗控制方法
CN103036956A (zh) * 2012-11-30 2013-04-10 航天恒星科技有限公司 一种分布式组态化海量数据归档系统及实现方法
CN103150225A (zh) * 2013-03-25 2013-06-12 中国人民解放军国防科学技术大学 基于应用级代理的对象并行存储系统磁盘满异常容错方法

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110740099A (zh) * 2018-07-18 2020-01-31 阿里巴巴集团控股有限公司 一种数据流控方法和装置
CN110096379A (zh) * 2019-04-30 2019-08-06 武汉斗鱼鱼乐网络科技有限公司 基于通用协议的消息分发方法、装置、设备及存储介质
CN110096379B (zh) * 2019-04-30 2022-09-09 武汉斗鱼鱼乐网络科技有限公司 基于通用协议的消息分发方法、装置、设备及存储介质
CN110333770B (zh) * 2019-07-10 2023-05-09 合肥兆芯电子有限公司 存储器管理方法、存储器存储装置及存储器控制电路单元
CN110333770A (zh) * 2019-07-10 2019-10-15 合肥兆芯电子有限公司 存储器管理方法、存储器存储装置及存储器控制电路单元
CN110377536A (zh) * 2019-07-12 2019-10-25 深信服科技股份有限公司 数据处理方法、装置、设备及计算机可读存储介质
CN110377536B (zh) * 2019-07-12 2023-05-12 深信服科技股份有限公司 数据处理方法、装置、设备及计算机可读存储介质
CN111190709A (zh) * 2019-11-19 2020-05-22 泰康保险集团股份有限公司 处理请求的方法、装置、电子设备及可读存储介质
CN111190709B (zh) * 2019-11-19 2024-04-12 泰康保险集团股份有限公司 处理请求的方法、装置、电子设备及可读存储介质
CN111291104A (zh) * 2020-01-20 2020-06-16 中国银联股份有限公司 一种基于异步应答的传输数据的方法及系统
CN111291104B (zh) * 2020-01-20 2023-07-28 中国银联股份有限公司 一种基于异步应答的传输数据的方法及系统
CN113741991A (zh) * 2021-11-04 2021-12-03 苏州浪潮智能科技有限公司 提升ssd服务质量方法、装置、计算机设备和存储介质
CN113741991B (zh) * 2021-11-04 2022-02-18 苏州浪潮智能科技有限公司 提升ssd服务质量方法、装置、计算机设备和存储介质
WO2023077751A1 (zh) * 2021-11-04 2023-05-11 苏州浪潮智能科技有限公司 提升ssd服务质量方法、装置、计算机设备和存储介质

Also Published As

Publication number Publication date
US20170220500A1 (en) 2017-08-03
US20180018293A1 (en) 2018-01-18
JP6403140B2 (ja) 2018-10-10
EP3128420B1 (en) 2019-08-28
WO2016061766A1 (zh) 2016-04-28
EP3128420A4 (en) 2017-08-23
EP3128420A1 (en) 2017-02-08
US9984013B2 (en) 2018-05-29
JP2017514210A (ja) 2017-06-01
CN105900061B (zh) 2018-01-16
US9804981B2 (en) 2017-10-31

Similar Documents

Publication Publication Date Title
CN105900061A (zh) 对象存储系统中的业务流控制方法、控制器和系统
US9699260B2 (en) Scalable, real-time messaging system
US11157324B2 (en) Partitioning for delayed queues in a distributed network
US7872975B2 (en) File server pipelining with denial of service mitigation
JP4452185B2 (ja) 管理ポリシーに基づいた要求トラフィックのリソース認識管理
US9864749B2 (en) Methods for provisioning workloads in a storage system using machine learning and devices thereof
US10944683B1 (en) Hybrid queue system for request throttling
WO2017117148A1 (en) A system, method, and computer program product for securely delivering content between storage mediums
KR100671635B1 (ko) 스트리밍 미디어 서비스 관리 방법
CN105893429A (zh) 用于优化web缓存的方法及系统
JP6943790B2 (ja) セッション情報セットをキャッシュするサーバ、及び、セッション情報セットのキャッシュ制御方法
US8456994B2 (en) Transmit request management in a distributed shared storage system
CN107566341A (zh) 一种基于联邦分布式文件存储系统的数据持久化存储方法及系统
US20190319901A1 (en) Scalable, real-time messaging system
EP3855707B1 (en) Systems, methods, and storage media for managing traffic on a digital content delivery network
JP2004139200A (ja) ファイル管理プログラム及びファイル管理装置
WO2017215249A1 (zh) 分配网际协议ip磁盘的方法及装置
US8495238B1 (en) Facilitating self-tuning traffic shaping without a central traffic manager
JP4109624B2 (ja) 処理スケジュールの管理方法、サーバ、処理スケジュールの管理プログラム
CN118381671B (zh) 智慧医疗大数据安全风险处理方法及相关设备
JP5494363B2 (ja) ファイル管理プログラム，ファイル管理方法およびファイル管理装置
CN112559460B (zh) 基于人工智能的文件存储方法、装置、设备及存储介质
Ledwon et al. Streamlining XR Application Deployment with a Localized Docker Registry at the Edge
MP et al. An Effective Remedy To The Weaknesses Of WebCaches In HTTP Flooding
CN117459586A (zh) 访问请求的处理方法和装置、存储介质及电子装置

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant