CN107632790A - A kind of method that Disk bandwidth is controlled in distributed memory system - Google Patents

A kind of method that Disk bandwidth is controlled in distributed memory system Download PDF

Info

Publication number
CN107632790A
CN107632790A CN201710915966.1A CN201710915966A CN107632790A CN 107632790 A CN107632790 A CN 107632790A CN 201710915966 A CN201710915966 A CN 201710915966A CN 107632790 A CN107632790 A CN 107632790A
Authority
CN
China
Prior art keywords
space
size
throttling
read
write data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710915966.1A
Other languages
Chinese (zh)
Inventor
王伟波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Yunhai Information Technology Co Ltd
Original Assignee
Zhengzhou Yunhai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Yunhai Information Technology Co Ltd filed Critical Zhengzhou Yunhai Information Technology Co Ltd
Priority to CN201710915966.1A priority Critical patent/CN107632790A/en
Publication of CN107632790A publication Critical patent/CN107632790A/en
Pending legal-status Critical Current

Links

Abstract

The present invention discloses a kind of method that Disk bandwidth is controlled in distributed memory system, is related to technical field of distributed memory;On the premise of not causing disk performance to decline in disk, Disk bandwidth maximum upper limit capacity, it is Disk bandwidth maximum upper limit capacity to set throttling space total capacity, if the size that throttling space has free space is storage system just in the size of read/write data, then take the free space of the size of the data away from throttling space, if throttle space in without storage system just read/write data size free space, then carry out waiting until the size free space that the data in throttling space be present;When read/write data process terminates, throttling space discharges the free space that size of data during this occupies, and concurrently send semaphore activation to wait the read/write data process for taking free space.

Description

A kind of method that Disk bandwidth is controlled in distributed memory system
Technical field
The present invention discloses a kind of method for controlling Disk bandwidth, is related to technical field of distributed memory, specifically one The method that Disk bandwidth is controlled in kind distributed memory system.
Background technology
In distributed memory system, iops and bandwidth are always to weigh the index of systematic function, require software in theory Bandwidth is the bigger the better.When software receives data storage, it can be dumped on disk, if middle do not make software to data storage Limitation, the bandwidth of software all will reflect on Disk bandwidth, but Disk bandwidth has the upper limit, if simply give software Increase data storage pressure has been even more than the upper limit of Disk bandwidth, and the burden of disk will increase so as to cause disk performance Decline.
The present invention provides a kind of method that Disk bandwidth is controlled in distributed memory system, is set by throttling, and control is not The Disk bandwidth total amount taken with disk access person.
The content of the invention
Demand and weak point of the present invention for the development of current technology, there is provided control magnetic in a kind of distributed memory system The wide method of dribbling.
A kind of method that Disk bandwidth is controlled in distributed memory system, for not causing disk performance decline in disk Under the premise of, Disk bandwidth maximum upper limit capacity, it is Disk bandwidth maximum upper limit capacity to set throttling space total capacity,
It is storage system just in the size of read/write data that if throttling space, which has the size of free space, from throttling space Take the free space of the size of the data away,
If throttle space in without storage system just read/write data size free space, waited until The size free space of the data in throttling space be present;
When read/write data process terminates, throttling space discharges the free space that size of data during this occupies, and sends signal Amount activation waits the read/write data process for taking free space.
In throttling space in described method, set_max methods, the size of setting throttling space total capacity are used.
In throttling space in described method, using get methods, obtain just read/write data size free space, When the space occupied space that wherein throttles subtracts the space shared by the size of read/write data more than throttling space total capacity, use Get methods are waited, and the space occupied space that throttles subtracts the size institute of read/write data no more than throttling space total capacity During the space accounted for, take space shared by the size of read/write data away from throttling space using get methods, be then back to.
In throttling space in described method, using put methods, discharge shared by the read/write data process completed Free space, the read/write data process that currently used get methods wait for is activated by semaphore.
The present invention has an advantageous effect in that compared with prior art:
The present invention provides the implementation method that Disk bandwidth is controlled in a kind of distributed memory system, for not causing disk in disk On the premise of hydraulic performance decline, Disk bandwidth maximum upper limit capacity, throttling space total capacity is set to hold for Disk bandwidth maximum upper limit Amount, if it is storage system just in the size of read/write data that throttling space, which has the size of free space, taken from throttling space Walk the free space of the size of the data, if throttling space in without storage system just read/write data size sky Free space, then carry out waiting until the size free space that the data in throttling space be present;When read/write data process terminates, Throttling space discharges the free space that size of data during this occupies, and concurrently send semaphore activation to wait and takes free space Read/write data process;
The inventive method will retain by using throttle valve technology in the request of disk read/write data in software, reduce same To the read/write pressure of disk in one time point, the increase disk burden for avoiding simply causes the decline problem of disk performance, improves The performance of system.
Brief description of the drawings
Fig. 1 throttling space total capacity schematic diagrames;
Fig. 2 get methods obtain the free space schematic diagram in throttling space;
The schematic diagram that takes up space in Fig. 3 put methods release throttling space;
Fig. 4 the inventive method schematic flow sheets.
Embodiment
The present invention provides the implementation method that Disk bandwidth is controlled in a kind of distributed memory system, for not causing in disk On the premise of disk performance declines, Disk bandwidth maximum upper limit capacity, it is in Disk bandwidth maximum to set throttling space total capacity Limited capacity amount, if it is storage system just in the size of read/write data that throttling space, which has the size of free space, from throttling space In take away the data size free space, if throttling space in without storage system just in the size of read/write data Free space, then carry out waiting until the size free space of the data in throttling space be present;When read/write data process Terminate, throttling space discharges the free space that size of data during this occupies, concurrently send semaphore activation wait take it is idle The read/write data process in space.
For the object, technical solutions and advantages of the present invention are more clearly understood, below in conjunction with specific embodiment, to this hair Bright further description.
Using the inventive method, unless otherwise specified, bandwidth is unified unified according to unit bit/s, capacity or size of data According to unit bit,
On the premise of not causing disk performance to decline in disk, if Disk bandwidth maximum upper limit capacity N, then using set_ It is to represent that throttling space total capacity does not all have in Disk bandwidth maximum upper limit capacity N, Fig. 1 that max methods, which set throttling space total capacity, Different occupancy;
And client, when to storage system read/write data, size of data x uses get methods in the space that throttles,
If throttling space exist the size of free space for storage system just read/write data i.e. x unit of size free time Space, then take the free space of x unit away from throttling space, such as Fig. 2,
If carry out waiting until throttling space using get methods without the free space of x unit in the space that throttles The middle free space that x unit be present;
When read/write data process terminates, using the put methods in throttling space discharge that size of data during this occupies x singly The free space of position, such as Fig. 3, semaphore activation is concurrently sent to wait the read/write data process for taking free space;
And after the read/write data process of wait state receives semaphore by get methods, it is activated, again attempts to get methods Take the free space of process needs.
By above-mentioned steps, present invention is mainly used for the distribution for coordinating resource between different users, can use section Fluid space represents disk read-write bandwidth, the total amount of the Disk bandwidth for coordinating different disk visitor occupancy, avoids simply Increase disk burden causes the decline of disk performance.
And throttle space can image be referred to as choke valve Throttle, utilize the read/write bandwidth pressure of choke valve disk All the time the upper limit is handled not over Disk bandwidth, the increase disk burden so as to avoid simply causes the decline of disk performance Problem.

Claims (4)

1. the method for Disk bandwidth is controlled in a kind of distributed memory system, it is characterised in that for not causing disk in disk On the premise of declining, Disk bandwidth maximum upper limit capacity, it is Disk bandwidth maximum upper limit capacity to set throttling space total capacity,
It is storage system just in the size of read/write data that if throttling space, which has the size of free space, from throttling space Take the free space of the size of the data away,
If throttle space in without storage system just read/write data size free space, waited until The size free space of the data in throttling space be present;
When read/write data process terminates, throttling space discharges the free space that size of data during this occupies, and sends signal Amount activation waits the read/write data process for taking free space.
2. according to the method for claim 1, it is characterised in that in throttling space, using set_max methods, set throttling empty Between total capacity size.
3. according to the method for claim 2, it is characterised in that in throttling space, using get methods, obtain just in read/write The free space of the size of data, wherein throttling space occupied space, which is more than throttling space total capacity, subtracts read/write data During space shared by size, waited using get methods, and the space occupied space that throttles is no more than throttling space total capacity When subtracting the space shared by the size of read/write data, the size institute of read/write data is taken away from throttling space using get methods The space accounted for, is then back to.
4. according to the method for claim 3, it is characterised in that in throttling space, using put methods, discharge what is completed Free space shared by read/write data process, the read/write data mistake that currently used get methods wait for is activated by semaphore Journey.
CN201710915966.1A 2017-09-30 2017-09-30 A kind of method that Disk bandwidth is controlled in distributed memory system Pending CN107632790A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710915966.1A CN107632790A (en) 2017-09-30 2017-09-30 A kind of method that Disk bandwidth is controlled in distributed memory system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710915966.1A CN107632790A (en) 2017-09-30 2017-09-30 A kind of method that Disk bandwidth is controlled in distributed memory system

Publications (1)

Publication Number Publication Date
CN107632790A true CN107632790A (en) 2018-01-26

Family

ID=61105065

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710915966.1A Pending CN107632790A (en) 2017-09-30 2017-09-30 A kind of method that Disk bandwidth is controlled in distributed memory system

Country Status (1)

Country Link
CN (1) CN107632790A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101872303A (en) * 2010-06-03 2010-10-27 深圳天源迪科信息技术股份有限公司 Method for processing Diameter protocol message
CN102279714A (en) * 2011-08-26 2011-12-14 上海文广科技(集团)有限公司 Method and device for controlling input/output (IO) requests
CN105224237A (en) * 2014-05-26 2016-01-06 华为技术有限公司 A kind of date storage method and device
CN107566514A (en) * 2017-09-22 2018-01-09 郑州云海信息技术有限公司 A kind of method that metadata request quantity is controlled in distributed memory system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101872303A (en) * 2010-06-03 2010-10-27 深圳天源迪科信息技术股份有限公司 Method for processing Diameter protocol message
CN102279714A (en) * 2011-08-26 2011-12-14 上海文广科技(集团)有限公司 Method and device for controlling input/output (IO) requests
CN105224237A (en) * 2014-05-26 2016-01-06 华为技术有限公司 A kind of date storage method and device
CN107566514A (en) * 2017-09-22 2018-01-09 郑州云海信息技术有限公司 A kind of method that metadata request quantity is controlled in distributed memory system

Similar Documents

Publication Publication Date Title
CN104081366B (en) The apparatus and method of cache memory movement are provided by nonvolatile mass storage system
US9262077B2 (en) Solid state drive device
US20160124649A1 (en) METHOD TO REDUCE FLASH MEMORY IOs WITH HOST MAINTAINED ADDRESS MAPPING TABLE
US20230333774A1 (en) Buffer optimization for solid-state drives
EP1653339A3 (en) Storage system and method of controlling the same
CN109710175A (en) Device and method for data storage management
TW201104439A (en) Suspension of memory operations for reduced write latency in memory arrays
US9898413B2 (en) Auto-adaptive system to implement partial write buffering for storage systems dynamic caching method and system for data storage system
US8769319B2 (en) Reducing power consumption in memory line architecture
CN103049396B (en) The method of writing with a brush dipped in Chinese ink of data and device
CN103345368B (en) Data caching method in buffer storage
US20150302903A1 (en) System and method for deep coalescing memory management in a portable computing device
US20240037039A1 (en) Management of Programming Mode Transitions to Accommodate a Constant Size of Data Transfer between a Host System and a Memory Sub-System
CN110413211B (en) Storage management method, electronic device, and computer-readable medium
CN108139995A (en) By sensor device data buffer storage in a data storage device
US20120317376A1 (en) Row buffer register file
CN107632790A (en) A kind of method that Disk bandwidth is controlled in distributed memory system
US9588898B1 (en) Fullness control for media-based cache operating in a steady state
US9971522B2 (en) Memory system and method
CN108073475A (en) The method of the solid state disk backup table of comparisons
CN110347339B (en) Controllable continuous writing method, scheduler and storage system for mechanical hard disk
CN105867839B (en) A kind of data processing method, storage equipment and electronic equipment
KR102266166B1 (en) Memory controller and storage device including the same
TWI714116B (en) Memory controller, memory controlling method, and computer system
US20150205534A1 (en) Controller, solid-state drive and control method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180126