CN106534308A - Method and device for solving data block access hotspot problem in distributed storage system - Google Patents
Method and device for solving data block access hotspot problem in distributed storage system Download PDFInfo
- Publication number
- CN106534308A CN106534308A CN201611001205.7A CN201611001205A CN106534308A CN 106534308 A CN106534308 A CN 106534308A CN 201611001205 A CN201611001205 A CN 201611001205A CN 106534308 A CN106534308 A CN 106534308A
- Authority
- CN
- China
- Prior art keywords
- data block
- server
- hot spot
- spot data
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Abstract
The invention discloses a method and device for solving a data block access hotspot problem in a distributed storage system. The method comprises: existence of hotspot data blocks in a distributed storage system is determined and activating servers and backup servers which the hotspot data blocks belong to are determined; and when available solid-state hard drive capacities of the activating servers are determined not to meet a transfer requirement of hotspot data blocks and available solid-state hard drive capacities of the backup servers are determined to meet the transfer requirement of the hotspot data blocks, the hotspot data blocks in the backup servers are transferred from mechanical hard drives of the backup servers to the solid-state hard drives of the backup servers and the hotspot data blocks in the backup servers are activated. A plurality of node servers are arranged in the distributed storage system; data of each data block are stored into at least two node servers; and at least two node servers include the activating servers of the data blocks and backup servers of the data blocks. Therefore, the data block reading speed increases and the network consumption is reduced.
Description
Technical field
The present invention relates to internet big data art field, more particularly to number is solved in a kind of distributed memory system
According to the method and device of block access focus.
Background technology
Distributed memory system, is that data dispersion is stored on the equipment of multiple stage independence.Traditional network store system
All data are deposited using the storage server concentrated, storage server becomes the bottleneck of systematic function, and reliability and peace
The focus of full property, it is impossible to meet the needs of Mass storage application.Distributed network storage system is tied using extendible system
Structure, shares storage load using multiple stage storage server, positions storage information using location server, and it not only increases system
Reliability, availability and access efficiency, be also easy to extension.
Hbase (Hadoop Database, it is distributed, towards row PostgreSQL database) be to operate in Hadoop
NoSQL (Not Only SQL, non-relation in (Hadoop Distributed File System, distributed file system)
The database of type), it is a distributed and extendible big data warehouse, and in HBase, Master is responsible for distribution
On Region to each different Region Server, Region Server are responsible for storing actual data.In practical application
During, the access Jing of HBase data is commonly present hot issue, i.e., a part of Region has a substantial amounts of access request, and one
Divide Region then relative frees.The presence of data access hot issue, will certainly increase the request response time of busy Region,
Bad experience is brought to user.
In prior art, please by count in Hbase distributed memory systems data block on each data block server
The visit capacity for counting to predict data block future is sought, then the data block by number of request to be compared concentration is shared and compares idle
Server on, reach the purpose of balanced visit capacity.But the movement of data block needs to consume substantial amounts of Internet resources, focus
Problem can not be resolved at once, it is also possible to be further exacerbated by hot issue.
In sum, in the prior art, it is impossible to one kind is provided and is avoided network consumption and while is eliminated data block access heat
The method of point.
The content of the invention
The present invention solves the method and device of data block access focus in providing a kind of distributed memory system, for solving
Can not provide in prior art and a kind of avoid network consumption and the simultaneously problem of the method for elimination data block access focus.
The embodiment of the present invention solves the method for data block access focus, methods described in providing a kind of distributed memory system
Including：
There is hot spot data block in determining the distributed memory system, and determine the activation belonging to the hot spot data block
Server and backup server；
When it is determined that the transfer that solid state hard disc capacity that the activation server can be used is unsatisfactory for the hot spot data block will
Ask and when solid state hard disc capacity that the backup server can be used meets the transfer of the hot spot data block and requires, will be described standby
The hot spot data block in part server is transferred to the backup server from the mechanical hard disk of the backup server
In solid state hard disc and activate the hot spot data block in the backup server；
Wherein, there are multiple node servers in the distributed memory system, the data of each data block are stored respectively
In at least two node servers, at least two node server includes the activation server of the data block and institute
State the backup server of data block.
In the embodiment of the present invention, by it is determined that solid state hard disc capacity that the activation server can be used be unsatisfactory for it is described
The solid state hard disc capacity that the transfer of hot spot data block is required and the backup server can be used meets the hot spot data block
When transfer is required, the hot spot data block in the backup server is shifted from the mechanical hard disk of the backup server
To in the solid state hard disc of the backup server and the hot spot data block in the backup server is activated, i.e., by backup
Hot spot data block is transferred to from the mechanical hard disk of the backup server server solid state hard disc of the backup server
In, the movement of the data block being not related between cross-node solves the problems, such as data block access focus, and by hot spot data block
The solid state hard disc of backup server is stored in, reading speed is improve, network consumption is further reduced.
Further, methods described also includes：
When it is determined that the solid state hard disc capacity that the activation server belonging to the hot spot data block can be used meets the focus
When the transfer of data block is required, then by the hot spot data block in the activation server from the machinery of the activation server
It is transferred in hard disk in the solid state hard disc of the activation server.
In the embodiment of the present invention, however, it is determined that the solid state hard disc capacity that the activation server belonging to hot spot data block can be used is full
The transfer of the foot hot spot data block is required, by the hot spot data block in the activation server from the activation server
Mechanical hard disk in be transferred in the solid state hard disc of the activation server, it is ensured that the hot spot data block in activation server
Reading speed, preferably solves the problems, such as data block access focus.
Further, methods described also includes：
If it is determined that cold spot data block is stored in the solid state hard disc of the activation server belonging to the cold spot data block, then will
The cold spot data block is transferred in the mechanical hard disk of the activation server from the solid state hard disc of the activation server.
In the embodiment of the present invention, when it is determined that cold spot data block is stored in the activation server belonging to the cold spot data block
In solid state hard disc, then the cold spot data block is transferred to into the activation server from the solid state hard disc of the activation server
In mechanical hard disk, it is ensured that the capacity in activation server is sufficient, to store hot spot data block.
Further, there is hot spot data block in the determination distributed memory system, including：
The access times per second and request response time of each data block in distributed memory system described in real-time statistics；
For each data block, when it is determined that the access times per second of the data block are more than focus access times threshold value or
When person's request response time is more than focus response time threshold value, it is determined that the data block is hot spot data block；
For each data block, when it is determined that the access times per second of the data block are less than cold spot access times threshold value
Or request response time be less than cold spot access time threshold value when, it is determined that the data block be cold spot data block.
In the embodiment of the present invention, data are determined by the access times per second and request response time of each data block
Whether block is hot spot data block or cold spot data block, can preferably determine the database for occurring accessing focus.
Further, methods described also includes：
When it is determined that the solid state hard disc capacity that the activation server belonging to the hot spot data block can be used is unsatisfactory for the heat
The solid state hard disc capacity that backup server belonging to the transfer requirement of point data block and the hot spot data block can be used also is discontented with
When the transfer of the foot hot spot data block is required, it is determined that meet the hot spot data block transfer requirement and with the focus
The closest node server of node server belonging to data block is the server to be activated of the hot spot data block；
The hot spot data block is copied in the solid state hard disc of the server to be activated, and activates the clothes to be activated
The hot spot data block in business device.
In the embodiment of the present invention, however, it is determined that the solid state hard disc capacity that the node server described in hotspot database can be used is not
When meeting the transfer of hotspot database and requiring, need for hotspot database to carry out cross-node duplication, in order to reduce Internet resources
Consume, it is the hot spot data block to choose the node server closest with the node server belonging to the hot spot data block
Server to be activated, the hot spot data block is copied in the solid state hard disc of the server to be activated, network is reduced
The consumption of resource, solves the problems, such as data block access focus.
Further, it is described determine meet the hot spot data block transfer requirement and with belonging to the hot spot data block
The closest node server of node server be the hot spot data block server to be activated, including：
It is determined that meeting described in all node servers in addition to the node server belonging to the hot spot data block
The optional server set that the transfer of hot spot data block is required, the node server belonging to the hot spot data block include the heat
The backup server of the activation server of point data block and the hot spot data block；
Determine each in each node server belonging to the hot spot data block and the optional server set
The distance of individual node server；
Node server in the beeline corresponding optional set of service is defined as into the hot spot data block
Server to be activated.
In the embodiment of the present invention, as the node server described in hot spot data block has multiple, it is thus necessary to determine that each node
The distance of each node server in server and optional server set, and determine most short distance pair in all distances
Node server in the optional set of service answered is server to be activated, reduces the distance between node, advantageously reduces
The consumption of Internet resources.
Further, methods described also includes：
When it is determined that all node servers are all unsatisfactory for the hot spot data block in the distributed memory system
When transfer is required, the hot spot data block is split into into N number of sub- hot spot data block, wherein N is more than 2；
Determine each node server belonging to the hot spot data block and remove the node belonging to the hot spot data block
The distance of all node servers outside server, and determine that closest N number of node server is server to be activated；
The sub- hot spot data block is copied in the server to be activated, and is activated in the server to be activated
The sub- hot spot data block.
In the embodiment of the present invention, when it is determined that all node servers are all unsatisfactory for the institute in the distributed memory system
The transfer requirement of hot spot data block is stated, that is, the solid state hard disc capacity that can be used in not having node server can place hot spot data
Block, then need to be split hot spot data block, and by fractionation after sub- hot spot data block copy to belonging to hot spot data block
The closest N number of node server of each node server in, reduce what hot spot data block was moved among the nodes
Distance, advantageously reduces the consumption of Internet resources.
The embodiment of the present invention solves the device of data block access focus in providing a kind of distributed memory system, including：
Hot spot data block determining unit, for determining there is hot spot data block in the distributed memory system, and determines
Activation server and backup server belonging to the hot spot data block；
Buanch unit, for being unsatisfactory for the focus number when the solid state hard disc capacity that the determination activation server can be used
Require according to the transfer of block and the solid state hard disc capacity that can use of the backup server meet the transfer of the hot spot data block will
When asking, the hot spot data block in the backup server is transferred to from the mechanical hard disk of the backup server described
In the solid state hard disc of backup server and activate the hot spot data block in the backup server；
Wherein, there are multiple node servers in the distributed memory system, the data of each data block are stored respectively
In at least two node servers, at least two node server includes the activation server of the data block and institute
State the backup server of data block.
In the embodiment of the present invention, by it is determined that solid state hard disc capacity that the activation server can be used be unsatisfactory for it is described
The solid state hard disc capacity that the transfer of hot spot data block is required and the backup server can be used meets the hot spot data block
When transfer is required, the hot spot data block in the backup server is shifted from the mechanical hard disk of the backup server
To in the solid state hard disc of the backup server and the hot spot data block in the backup server is activated, i.e., by backup
Hot spot data block is transferred to from the mechanical hard disk of the backup server server solid state hard disc of the backup server
In, the movement of the data block being not related between cross-node solves the problems, such as data block access focus, and by hot spot data block
The solid state hard disc of backup server is stored in, reading speed is improve, network consumption is further reduced.
Further, the buanch unit is additionally operable to：
When it is determined that the solid state hard disc capacity that the activation server belonging to the hot spot data block can be used meets the focus
When the transfer of data block is required, then by the hot spot data block in the activation server from the machinery of the activation server
It is transferred in hard disk in the solid state hard disc of the activation server.
Further, the buanch unit, is additionally operable to：
If it is determined that cold spot data block is stored in the solid state hard disc of the activation server belonging to the cold spot data block, then will
The cold spot data block is transferred in the mechanical hard disk of the activation server from the solid state hard disc of the activation server.
Further, the hot spot data block determining unit, specifically for：
The access times per second and request response time of each data block in distributed memory system described in real-time statistics；
For each data block, when it is determined that the access times per second of the data block are more than focus access times threshold value or
When person's request response time is more than focus response time threshold value, it is determined that the data block is hot spot data block；
For each data block, when it is determined that the access times per second of the data block are less than cold spot access times threshold value
Or request response time be less than cold spot access time threshold value when, it is determined that the data block be cold spot data block.
Further, described device also includes：
Server determining unit to be activated, for what is can used when the activation server belonging to the determination hot spot data block
Solid state hard disc capacity be unsatisfactory for the hot spot data block transfer require and the hot spot data block belonging to backup server can
When the solid state hard disc capacity for using also is unsatisfactory for the transfer of the hot spot data block and requires, it is determined that meet the hot spot data block
Transfer require and the node server closest with the node server belonging to the hot spot data block is the focus
The server to be activated of data block；
Copied cells, for copying to the hot spot data block in the solid state hard disc of the server to be activated, and swashs
The hot spot data block in the work server to be activated.
Further, the server determining unit to be activated specifically for：
It is determined that meeting described in all node servers in addition to the node server belonging to the hot spot data block
The optional server set that the transfer of hot spot data block is required, the node server belonging to the hot spot data block include the heat
The backup server of the activation server of point data block and the hot spot data block；
Determine each in each node server belonging to the hot spot data block and the optional server set
The distance of individual node server；
Node server in the beeline corresponding optional set of service is defined as into the hot spot data block
Server to be activated.
Further, described device also includes：
Split cells, for when determining in the distributed memory system that it is described that all node servers are all unsatisfactory for
When the transfer of hot spot data block is required, the hot spot data block is split into into N number of sub- hot spot data block, wherein N is more than 2；
The server determining unit to be activated is additionally operable to：
Determine each node server belonging to the hot spot data block and remove the node belonging to the hot spot data block
The distance of all node servers outside server, and determine that closest N number of node server is server to be activated；
The copied cells is additionally operable to：
The sub- hot spot data block is copied in the server to be activated, and is activated in the server to be activated
The sub- hot spot data block.
Description of the drawings
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, below will be to making needed for embodiment description
Accompanying drawing is briefly introduced, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for this
For the those of ordinary skill in field, without having to pay creative labor, can be obtaining which according to these accompanying drawings
His accompanying drawing.
Fig. 1 is the method stream of solution data block access focus in a kind of distributed memory system provided in an embodiment of the present invention
Journey schematic diagram；
Fig. 2 is the method for solution data block access focus in another kind of distributed memory system provided in an embodiment of the present invention
Schematic diagram；
Fig. 3 is the device of solution data block access focus in a kind of distributed memory system provided in an embodiment of the present invention
Structural representation.
Specific embodiment
In order that the object, technical solutions and advantages of the present invention are clearer, below in conjunction with accompanying drawing the present invention is made into
One step ground is described in detail, it is clear that described embodiment is only present invention some embodiments, rather than the enforcement of whole
Example.Based on the embodiment in the present invention, what those of ordinary skill in the art were obtained under the premise of creative work is not made
All other embodiment, belongs to the scope of protection of the invention.
A kind of present invention solves data block access focus method in providing distributed memory system, as shown in figure 1, bag
Include：
, there is hot spot data block in determining the distributed memory system, and determine the hot spot data block institute in step 101
The activation server and backup server of category；
Step 102, when it is determined that the solid state hard disc capacity that the activation server can be used is unsatisfactory for the hot spot data block
Transfer require and when the solid state hard disc capacity that can use of the backup server meets the transfer of the hot spot data block and requires,
The hot spot data block in the backup server is transferred to into the backup from the mechanical hard disk of the backup server
In the solid state hard disc of server and activate the hot spot data block in the backup server；
Wherein, there are multiple node servers in the distributed memory system, the data of each data block are stored respectively
In at least two node servers, at least two node server includes the activation server of the data block and institute
State the backup server of data block.
In embodiments of the present invention, distributed memory system refers to data dispersion storage is stored to multiple data storages
In server, distributed memory system can be made up of a thousands of or even up to ten thousand machine, to realize mass data storage and height simultaneously
Send out.
In embodiments of the present invention, distributed memory system for HBase systems be a high reliability, high-performance, towards
Row, telescopic distributed memory system, can erect large-scale structure on cheap PC Server using HBase technologies
Storage cluster.
In embodiments of the present invention, there are multiple data blocks in distributed memory system, each data block one node of correspondence
Server, a node server manage multiple data blocks.
Optionally, in embodiments of the present invention, data block is exactly the Region in HBase systems, and node server is
Region Server。
In a step 101, it is first determined in distributed memory system, there is hot spot data block.In embodiments of the present invention,
For each data block in distributed memory system, the access times per second of real-time statistics each data blocks and request response
Time.When it is determined that the data block access times per second be more than focus access times threshold value when or request response time be more than
During focus response time threshold value, it is determined that the data block is hot spot data block.
In embodiments of the present invention, focus access times threshold value or focus response time threshold value be according to application scenarios or
Person's user configuring is configured.
Optionally, in embodiments of the present invention, it may also be determined that cold spot data block, for each data block, when it is determined that institute
The access times per second of data block are stated less than during cold spot access times threshold value or when request response time is accessed less than cold spot
Between threshold value when, it is determined that the data block be cold spot data block.
For example, in embodiments of the present invention, there are 500 data blocks in HBase systems, wherein there is the per second of a data block
Access times are 25 times, and the focus access times threshold value for setting is as 20 times, it is determined that the data block is hot spot data block；Or,
In embodiments of the present invention, the access times per second of a data block in HBase systems are 4 times, and the cold spot of setting accesses secondary
Number threshold value is 5 times, it is determined that the data block is cold spot data block.
In embodiments of the present invention, in distributed memory system corresponding at least two node serves of each data block
Device, one of node server are activation servers, i.e., the data block in activation server is state of activation, another
Node server is backup server, i.e., the data block in backup server is the state not activated.
Optionally, in embodiments of the present invention, the data duplication of each data block is at least three parts, that is to say, that every
One data block three node server of correspondence, a node server is activation server, and another two is backup server,
The state of the data block on activation server is state of activation.
In a step 102, after it is determined that there is hot spot data block in distributed memory system, need to eliminate hot spot data
The access focus of block, as the data of hot spot data block are stored in activation server by the activation server that hot spot data block is located
Mechanical hard disk in, need hot spot data block is transferred on the faster solid state hard disc of reading speed.
Mechanical hard disk is traditional common hard disc, mainly by：Disc, magnetic head, disc rotating shaft and controlled motor, magnetic head control
Several part compositions such as device, data converter, interface, caching.Solid state hard disc, referred to as consolidates disk, and solid state hard disc is deposited with solid-state electronic
Storage chip array and made by hard disk, be made up of control unit and memory cell (FLASH chip, dram chip).Solid state hard disc
Using flash memory as storage medium, reading speed relative mechanical hard disk is faster.
When it is determined that the solid state hard disc capacity that the activation server described in hot spot data block can be used is unsatisfactory for hot spot data block
Transfer when requiring, then it needs to be determined that the solid state hard disc capacity that can use of other backup servers belonging to hot spot data block.
In embodiments of the present invention, hot spot data block transfer is required to shift data block data from mechanical hard disk
Condition in solid state hard disc, optionally, in embodiments of the present invention, hot spot data block transfer requires the number for hot spot data block
According to amount size, that is to say, that after hot spot data block is determined, in addition it is also necessary to determine the data volume of hot spot data block, and determine heat
The solid state hard disc capacity that activation server belonging to point data block can be used.
If the solid state hard disc capacity that activation server can be used is unsatisfactory for the transfer of hot spot data block when requiring, need really
Determine the transfer requirement whether the solid state hard disc capacity that backup server can use meets hot spot data block, when it is determined that backup server
When the solid state hard disc capacity that can be used meets the transfer of the hot spot data block and requires, by the heat in the backup server
Point data block is transferred in the solid state hard disc of the backup server from the mechanical hard disk of the backup server.
For example, the size of data of hot spot data block is 50MB, and what the activation server A belonging to hot spot data block can be used consolidates
State hard-disk capacity is 40MB, then the activation server A belonging to hot spot data block is unsatisfactory for the transfer requirement of hot spot data block.It is determined that
The solid state hard disc capacity that backup server B or C described in hot spot data block can be used is 100MB, then described in hot spot data block
Backup server B or C meet the transfer requirement of hot spot data block.
If it is determined that the backup server of hot spot data block meets the transfer requirement of hot spot data block, then by hot spot data
In the backup server of block, hot spot data block is transferred in the solid state hard disc of backup server from mechanical internal memory, improves focus
The reading speed of data block, has effectively eliminated the access hot issue of hot spot data block.
Optionally, in embodiments of the present invention, when it is determined that the solid-state that can use of the activation server belonging to hot spot data block
When hard-disk capacity meets the transfer of hot spot data block and requires, then by the hot spot data block in activation server from activation server
It is transferred in the solid state hard disc of activation server in mechanical hard disk.
After step 101, in order to expand the solid state hard disc capacity for using of activation server, so determining
After there is cold spot data block in distributed memory system, in addition it is also necessary to determine the storage location of cold spot data block, if cold spot data
Block is stored in the solid state hard disc capacity of the activation server belonging to cold spot data block, then cold spot data block is transferred to activation clothes
In the mechanical hard disk of business device.
After step 102, when it is determined that the solid state hard disc capacity that the activation server belonging to hot spot data block can be used is discontented with
The solid state hard disc capacity that backup server belonging to the transfer requirement of sufficient hot spot data block and hot spot data block can be used also is discontented with
When the transfer of sufficient hot spot data block is required, in addition it is also necessary to it is determined that meet hot spot data block transfer requirement and with hot spot data block institute
To be activated server of the closest node server of the node server of category for hot spot data block, and hot spot data block is multiple
Make in the solid state hard disc of server to be activated, and activate the hot spot data block in server to be activated.
Optionally, in embodiments of the present invention, it is determined that meet the hot spot data block transfer requirement and with the heat
The closest node server of node server belonging to point data block is the server to be activated of the hot spot data block, tool
Body is：
It is determined that meeting described in all node servers in addition to the node server belonging to the hot spot data block
The optional server set that the transfer of hot spot data block is required, the node server belonging to the hot spot data block include the heat
The backup server of the activation server of point data block and the hot spot data block；
Determine each in each node server belonging to the hot spot data block and the optional server set
The distance of individual node server；
Node server in the beeline corresponding optional set of service is defined as into the hot spot data block
Server to be activated.
In embodiments of the present invention, it is assumed that in distributed memory system with the distance between rack node be a1, same to machine room
The distance between different rack nodes are a2, and the distance between across machine room node is a3.Here distance is also contemplated that network
Affect, according to the difference of the network bandwidth, different weights can be added.Wherein a1<a2<a3.
Determine that the solid-state that other node servers in addition to the node server belonging to hot spot data block can be used is hard first
Whether disk capacity meets the transfer requirement of hot spot data block, and for example, the data capacity of hot spot data block is 100MB, screens other
The solid state hard disc capacity that node server can be used for example has 4, respectively node serve more than the node server of 100MB
Device 1, node server 2, node server 3, node server 4, then this 4 node servers are optional server set.
For example, the node server belonging to hot spot data block has 3, i.e. activation server 1, backup server 2 and standby
Part server 3, then calculate the distance between 3 node servers and optional server set.Activation server 1 and optional service
The distance of the node server in device set is respectively a1,3a2+a1,2a1, a3+a1, backup server 2 and optional server set
The distance of the node server in conjunction is respectively 2a1+a2, a2+2a1, a2+a1,2a3+a1, backup server 3 and optional service
The distance of the node server in device set is respectively a3,4a1,4a1,5a1+a2, it is determined that activation services and can election server
The distance apart from a1 of the node server in set is beeline, then be defined as beeline corresponding node server
The server to be activated of hot spot data block.
By the data duplication in hot spot data block in server to be activated, and activate the focus number in server to be activated
According to block, while the hot spot data block in the activation server belonging to offline hot spot data block.
Optionally, in embodiments of the present invention, when it is determined that all node servers are all unsatisfactory in distributed memory system
When the transfer of hot spot data block is required, hot spot data block is split into into N number of sub- hot spot data block, wherein N is more than 2；Determine focus
Each node server belonging to data block and all node servers in addition to the node server belonging to hot spot data block
Distance, and determine closest N number of node server be server to be activated；Sub- hot spot data block is copied to be activated
In server, and activate the sub- hot spot data block in server to be activated.
In embodiments of the present invention, if all of node server is all unsatisfactory for the transfer of hot spot data block when requiring,
Illustrate that the solid state hard disc capacity for using of all node servers in distributed memory system is both less than hot spot data block
When, then need to be split hot spot data block.
In embodiments of the present invention, for example, hot spot data block is split into into 4 pieces, the data volume of each piece of fractionation can be
Respectively, or according to factors such as user's setting or application scenarios it is configured.
Optionally, in embodiments of the present invention, in order to eliminate the access focus of hot spot data block, by each sub- focus number
It is stored in the mechanical hard disk of the server N number of to be activated for determining closest, but in order to preferably improve focus number according to block
According to the reading speed of block, each sub- hot spot data block is stored in into the solid-state of the server N number of to be activated for determining closest
In hard disk.
If each sub- hot spot data block is stored in the mechanical hard disk of the server N number of to be activated for determining closest
In, optionally, it is necessary first to it is determined that whether Shi Yong the capacity of the mechanical hard disk of other nodes in addition to hot spot data block is full
The transfer of each sub- hot spot data block of foot is required.For example, the data flow of hot spot data block is 100MB, is equally divided into 4 son heat
Point data block, the data volume of each sub- hot spot data block is 25MB.It needs to be determined that other nodes in addition to hot spot data block
Mechanical hard disk Shi Yong capacity more than the optional server set of 25MB, and determine from optional server centered closest
4 node servers are server to be activated, determine 4 closest clothes to be activated by being stored in per individual sub- hot spot data block
In the mechanical hard disk of business device.
If each sub- hot spot data block is stored in the solid state hard disc of the server N number of to be activated for determining closest
In, optionally, it is necessary first to it is determined that whether Shi Yong the capacity of the solid state hard disc of other nodes in addition to hot spot data block is full
The transfer of each sub- hot spot data block of foot is required.For example, the data flow of hot spot data block is 100MB, is equally divided into 4 son heat
Point data block, the data volume of each sub- hot spot data block is 25MB.It needs to be determined that other nodes in addition to hot spot data block
Solid state hard disc Shi Yong capacity more than the optional server set of 25MB, and determine from optional server centered closest
4 node servers are server to be activated, determine 4 closest clothes to be activated by being stored in per individual sub- hot spot data block
In the solid state hard disc of business device.
Optionally, in embodiments of the present invention, when it is determined that distributed memory system is idle, also need to carry out data block weight
New to be distributed, the principle of distribution is as far as possible identical for the data number of blocks in node server, and in the solid state hard disc of node server
Data block quantity be also required to it is as far as possible identical.
It is easy to the understanding of those skilled in the art, here to illustrate for convenience.
As shown in Fig. 2 solving data block access focus in the embodiment of the present invention provides a kind of distributed memory system
Method, wherein, distributed memory system is HBase, and node server is Region Server, and data block is Region,
Activation server Region ServerA belonging to Region, the backup server belonging to Region are Region Server B
And Region Server C, solid state hard disc is SSD, and mechanical hard disk is HDD, and sub- hot spot data block is drawn for hot spot data block
Determine after being divided into two pieces, respectively region1 and region2 is specific as follows：
Step 201, the access times per second of each Region in real-time statistics HBase and request response time；
Step 202, for each Region, judges whether Region is focus Region, in embodiments of the present invention,
When it is determined that Region access times per second be more than focus access times threshold value when or request response time more than focus response
During time threshold, it is determined that Region is focus Region；If it is determined that Region is focus Region, then execution step 203, no
Then execution step 204；
Step 203, determines that whether the SSD of the Region ServerA belonging to focus Region can use capacity more than focus
The data capacity of Region, if being more than, execution step 205, otherwise execution step 206；
Step 204, judges whether Region is cold spot Region, in embodiments of the present invention, when it is determined that Region's is every
When second access times are less than cold spot access times threshold value or when request response time is less than cold spot response time threshold value, it is determined that
For cold spot point Region, if so, then execution step 207；Otherwise execution step 201；
Focus Region is transferred to the SSD of Region ServerA from the HDD of Region ServerA by step 205
In；
Step 206, determines that the SSD of the Region Server B or Region Server C belonging to Region can be used
Whether capacity is more than the data capacity of focus Region, if the SSD of Region Server B or Region Server C can
Using capacity, any one is more than the data capacity of focus Region, then execution step 208, otherwise execution step 209；In the present invention
In embodiment, if the SSD of Region Server B or Region Server C can be both greater than focus Region using capacity
Data capacity, then an optional execution step 208；
Step 207, determines whether cold spot Region is stored in the SSD of the Region ServerA belonging to cold spot Region
In, if so, then execution step 210；Otherwise execution step 201；
Focus Region is transferred to Region Server from the HDD of Region Server B or C by step 208
In the SSD of B or C；
Whether step 209, have the SSD for meeting Region Server use capacity in determining other Region Server
More than the data capacity of focus Region, if having, execution step 211；Otherwise execution step 212；
Step 210, will be transferred in the SSD of the Region Server A belonging to cold spot Region from cold spot Region
In the HDD of Region ServerA；
Step 211, it is determined that with the Region Server A belonging to focus Region, Region Server B and
Region Server C closest Region Server, execution step 213；
Step 212, it is determined that with the Region Server A belonging to focus Region, Region Server B and
2 Region Server C closest Region Server, execution step 214；
Step 213, focus Region is copied in the SSD of closest Region Server；
Step 214, sub- focus region1 and region2 is copied in the Region Server of closest 2.
Based on same design, the embodiment of the present invention solves data block access heat in also providing a kind of distributed memory system
The device of point, as shown in figure 3, including：
Hot spot data block determining unit 301, for determining there is hot spot data block in the distributed memory system, and really
Activation server and backup server belonging to the fixed hot spot data block；
Buanch unit 302, for being unsatisfactory for the heat when the solid state hard disc capacity that the determination activation server can be used
The solid state hard disc capacity that the transfer of point data block is required and the backup server can be used meets turning for the hot spot data block
When shifting is required, the hot spot data block in the backup server is transferred to from the mechanical hard disk of the backup server
In the solid state hard disc of the backup server and activate the hot spot data block in the backup server；
Wherein, there are multiple node servers in the distributed memory system, the data of each data block are stored respectively
In at least two node servers, at least two node server includes the activation server of the data block and institute
State the backup server of data block.
Further, the buanch unit 302 is additionally operable to：
When it is determined that the solid state hard disc capacity that the activation server belonging to the hot spot data block can be used meets the focus
When the transfer of data block is required, then by the hot spot data block in the activation server from the machinery of the activation server
It is transferred in hard disk in the solid state hard disc of the activation server.
Further, the buanch unit 302, is additionally operable to：
If it is determined that cold spot data block is stored in the solid state hard disc of the activation server belonging to the cold spot data block, then will
The cold spot data block is transferred in the mechanical hard disk of the activation server from the solid state hard disc of the activation server.
Further, the hot spot data block determining unit 301, specifically for：
The access times per second and request response time of each data block in distributed memory system described in real-time statistics；
For each data block, when it is determined that the access times per second of the data block are more than focus access times threshold value or
When person's request response time is more than focus response time threshold value, it is determined that the data block is hot spot data block；
For each data block, when it is determined that the access times per second of the data block are less than cold spot access times threshold value
Or request response time be less than cold spot access time threshold value when, it is determined that the data block be cold spot data block.
Further, described device also includes：
Server determining unit 303 to be activated, for making when the activation server belonging to the determination hot spot data block
Solid state hard disc capacity be unsatisfactory for the hot spot data block transfer require and the hot spot data block belonging to backup services
When the solid state hard disc capacity that device can be used also is unsatisfactory for the transfer of the hot spot data block and requires, it is determined that meet the focus number
Require according to the transfer of block and the node server closest with the node server belonging to the hot spot data block is described
The server to be activated of hot spot data block；
Copied cells 304, for the hot spot data block being copied in the solid state hard disc of the server to be activated, and
Activate the hot spot data block in the server to be activated.
Further, the server determining unit to be activated 303 specifically for：
It is determined that meeting described in all node servers in addition to the node server belonging to the hot spot data block
The optional server set that the transfer of hot spot data block is required, the node server belonging to the hot spot data block include the heat
The backup server of the activation server of point data block and the hot spot data block；
Determine each in each node server belonging to the hot spot data block and the optional server set
The distance of individual node server；
Node server in the beeline corresponding optional set of service is defined as into the hot spot data block
Server to be activated.
Further, described device also includes：
Split cells 305, for when determining in the distributed memory system that it is described that all node servers are all unsatisfactory for
When the transfer of the hot spot data block is required, the hot spot data block is split into into N number of sub- hot spot data block, wherein N is more than 2；
The server determining unit to be activated 303 is additionally operable to：
Determine each node server belonging to the hot spot data block and remove the node belonging to the hot spot data block
The distance of all node servers outside server, and determine that closest N number of node server is server to be activated；
The copied cells 304 is additionally operable to：
The sub- hot spot data block is copied in the server to be activated, and is activated in the server to be activated
The sub- hot spot data block.
The present invention be with reference to method according to embodiments of the present invention, equipment (system), and computer program flow process
Figure and/or block diagram are describing.It should be understood that can be by computer program instructions flowchart and/or each stream in block diagram
The combination of journey and/or square frame and flow chart and/or flow process and/or square frame in block diagram.These computer programs can be provided
The processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that produced for reality by the instruction of computer or the computing device of other programmable data processing devices
The device of the function of specifying in present one flow process of flow chart or one square frame of multiple flow processs and/or block diagram or multiple square frames.
These computer program instructions may be alternatively stored in and can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory is produced to be included referring to
Make the manufacture of device, the command device realize in one flow process of flow chart or one square frame of multiple flow processs and/or block diagram or
The function of specifying in multiple square frames.
These computer program instructions can be also loaded in computer or other programmable data processing devices so that in meter
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented process, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow process of flow chart or multiple flow processs and/or block diagram one
The step of function of specifying in individual square frame or multiple square frames.
, but those skilled in the art once know basic creation although preferred embodiments of the present invention have been described
Property concept, then can make other change and modification to these embodiments.So, claims are intended to be construed to include excellent
Select embodiment and fall into the had altered of the scope of the invention and change.
Obviously, those skilled in the art can carry out the essence of various changes and modification without deviating from the present invention to the present invention
God and scope.So, if these modifications of the present invention and modification belong to the scope of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to comprising these changes and modification.
Claims (14)
1. a kind of method that data block access focus is solved in distributed memory system, it is characterised in that include：
There is hot spot data block in determining the distributed memory system, and determine the activation service belonging to the hot spot data block
Device and backup server；
When it is determined that solid state hard disc capacity that the activation server can be used be unsatisfactory for the transfer requirement of the hot spot data block and
When the solid state hard disc capacity that the backup server can be used meets the transfer of the hot spot data block and requires, the backup is taken
The hot spot data block in business device is transferred to the solid-state of the backup server from the mechanical hard disk of the backup server
In hard disk and activate the hot spot data block in the backup server；
Wherein, there are multiple node servers in the distributed memory system, the data of each data block be respectively stored in
In few two node servers, at least two node server includes the activation server and the number of the data block
According to the backup server of block.
2. method according to claim 1, it is characterised in that methods described also includes：
When it is determined that the solid state hard disc capacity that the activation server belonging to the hot spot data block can be used meets the hot spot data
When the transfer of block is required, then by the hot spot data block in the activation server from the mechanical hard disk of the activation server
In be transferred in the solid state hard disc of the activation server.
3. method according to claim 1, it is characterised in that methods described also includes：
If it is determined that cold spot data block is stored in the solid state hard disc of the activation server belonging to the cold spot data block, then will be described
Cold spot data block is transferred in the mechanical hard disk of the activation server from the solid state hard disc of the activation server.
4. method according to claim 3, it is characterised in that there is focus in the determination distributed memory system
Data block, including：
The access times per second and request response time of each data block in distributed memory system described in real-time statistics；
For each data block, when it is determined that the access times per second of the data block are more than focus access times threshold value or please
When asking the response time to be more than focus response time threshold value, it is determined that the data block is hot spot data block；
For each data block, when it is determined that the access times per second of the data block are less than cold spot access times threshold value or
When request response time is less than cold spot access time threshold value, it is determined that the data block is cold spot data block.
5. the method according to any one of Claims 1-4, it is characterised in that methods described also includes：
When it is determined that the solid state hard disc capacity that the activation server belonging to the hot spot data block can be used is unsatisfactory for the focus number
According to the transfer of block require and the hot spot data block belonging to the solid state hard disc capacity that can use of backup server be also unsatisfactory for institute
When stating the transfer of hot spot data block and requiring, it is determined that meet the hot spot data block transfer requirement and with the hot spot data
The closest node server of node server belonging to block is the server to be activated of the hot spot data block；
The hot spot data block is copied in the solid state hard disc of the server to be activated, and activates the server to be activated
In the hot spot data block.
6. method according to claim 5, it is characterised in that the determination meets the transfer requirement of the hot spot data block
And the node server closest with the node server belonging to the hot spot data block is treating for the hot spot data block
Activation server, including：
It is determined that meeting the focus in all node servers in addition to the node server belonging to the hot spot data block
The optional server set that the transfer of data block is required, the node server belonging to the hot spot data block include the focus number
According to the backup server of the activation server and the hot spot data block of block；
Determine each section in each node server belonging to the hot spot data block and the optional server set
The distance of point server；
By the node server in the beeline corresponding optional set of service be defined as the hot spot data block wait swash
Server living.
7. method according to claim 6, it is characterised in that methods described also includes：
When it is determined that all node servers are all unsatisfactory for the transfer of the hot spot data block in the distributed memory system
During requirement, the hot spot data block is split into into N number of sub- hot spot data block, wherein N is more than 2；
Determine each node server belonging to the hot spot data block and remove the node serve belonging to the hot spot data block
The distance of all node servers outside device, and determine that closest N number of node server is server to be activated；
The sub- hot spot data block is copied in the server to be activated, and is activated described in the server to be activated
Sub- hot spot data block.
8. the device of data block access focus is solved in a kind of distributed memory system, it is characterised in that included：
Hot spot data block determining unit, for determining there is hot spot data block in the distributed memory system, and determines described
Activation server and backup server belonging to hot spot data block；
Buanch unit, for being unsatisfactory for the hot spot data block when the solid state hard disc capacity that the determination activation server can be used
Transfer require and when the solid state hard disc capacity that can use of the backup server meets the transfer of the hot spot data block and requires,
The hot spot data block in the backup server is transferred to into the backup from the mechanical hard disk of the backup server
In the solid state hard disc of server and activate the hot spot data block in the backup server；
Wherein, there are multiple node servers in the distributed memory system, the data of each data block be respectively stored in
In few two node servers, at least two node server includes the activation server and the number of the data block
According to the backup server of block.
9. device according to claim 8, it is characterised in that the buanch unit is additionally operable to：
When it is determined that the solid state hard disc capacity that the activation server belonging to the hot spot data block can be used meets the hot spot data
When the transfer of block is required, then by the hot spot data block in the activation server from the mechanical hard disk of the activation server
In be transferred in the solid state hard disc of the activation server.
10. device according to claim 8, it is characterised in that the buanch unit, is additionally operable to：
If it is determined that cold spot data block is stored in the solid state hard disc of the activation server belonging to the cold spot data block, then will be described
Cold spot data block is transferred in the mechanical hard disk of the activation server from the solid state hard disc of the activation server.
11. devices according to claim 10, it is characterised in that the hot spot data block determining unit, specifically for：
The access times per second and request response time of each data block in distributed memory system described in real-time statistics；
For each data block, when it is determined that the access times per second of the data block are more than focus access times threshold value or please
When asking the response time to be more than focus response time threshold value, it is determined that the data block is hot spot data block；
For each data block, when it is determined that the access times per second of the data block are less than cold spot access times threshold value or
When request response time is less than cold spot access time threshold value, it is determined that the data block is cold spot data block.
12. devices according to any one of claim 8 to 11, it is characterised in that described device also includes：
Server determining unit to be activated, for the solid-state that can be used when the activation server determined belonging to the hot spot data block
Hard-disk capacity be unsatisfactory for the hot spot data block transfer require and the hot spot data block belonging to backup server can use
Solid state hard disc capacity when being also unsatisfactory for the transfer of the hot spot data block and requiring, it is determined that meet turning for the hot spot data block
Move requirement and the node server closest with the node server belonging to the hot spot data block is the hot spot data
The server to be activated of block；
Copied cells, for copying to the hot spot data block in the solid state hard disc of the server to be activated, and activates institute
State the hot spot data block in server to be activated.
13. devices according to claim 12, it is characterised in that the server determining unit to be activated specifically for：
It is determined that meeting the focus in all node servers in addition to the node server belonging to the hot spot data block
The optional server set that the transfer of data block is required, the node server belonging to the hot spot data block include the focus number
According to the backup server of the activation server and the hot spot data block of block；
Determine each section in each node server belonging to the hot spot data block and the optional server set
The distance of point server；
By the node server in the beeline corresponding optional set of service be defined as the hot spot data block wait swash
Server living.
14. devices according to claim 13, it is characterised in that described device also includes：
For working as, split cells, determines that all node servers are all unsatisfactory for the focus in the distributed memory system
When the transfer of data block is required, the hot spot data block is split into into N number of sub- hot spot data block, wherein N is more than 2；
The server determining unit to be activated is additionally operable to：
Determine each node server belonging to the hot spot data block and remove the node serve belonging to the hot spot data block
The distance of all node servers outside device, and determine that closest N number of node server is server to be activated；
The copied cells is additionally operable to：
The sub- hot spot data block is copied in the server to be activated, and is activated described in the server to be activated
Sub- hot spot data block.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611001205.7A CN106534308B (en) | 2016-11-14 | 2016-11-14 | Method and device for solving data block access hot spot in distributed storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611001205.7A CN106534308B (en) | 2016-11-14 | 2016-11-14 | Method and device for solving data block access hot spot in distributed storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106534308A true CN106534308A (en) | 2017-03-22 |
| CN106534308B CN106534308B (en) | 2020-02-11 |
Family
ID=58351721
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611001205.7A Active CN106534308B (en) | 2016-11-14 | 2016-11-14 | Method and device for solving data block access hot spot in distributed storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106534308B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109284624A (en) * | 2018-09-03 | 2019-01-29 | 佛山科学技术学院 | A kind of data safety partition method and device based on the storage of block chain |
| CN109582509A (en) * | 2017-09-29 | 2019-04-05 | 中兴通讯股份有限公司 | Distributed file system disaster tolerance configuration method, device and readable storage medium storing program for executing |
| CN109992409A (en) * | 2018-01-02 | 2019-07-09 | 中国移动通信有限公司研究院 | Cutting method, device, system, electronic equipment and the medium of data storage areas |
| CN110019528A (en) * | 2017-12-26 | 2019-07-16 | 中国移动通信集团湖北有限公司 | Database manipulation load-balancing method, device, equipment and medium |
| CN111291040A (en) * | 2018-12-10 | 2020-06-16 | 中国移动通信集团四川有限公司 | Data processing method, device, equipment and medium |
| CN111385327A (en) * | 2018-12-28 | 2020-07-07 | 阿里巴巴集团控股有限公司 | Data processing method and system |
| CN113515411A (en) * | 2021-05-19 | 2021-10-19 | 中国工商银行股份有限公司 | Disaster recovery backup method, disaster recovery backup device, electronic device, storage medium, and program product |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101483668A (en) * | 2009-02-10 | 2009-07-15 | 成都市华为赛门铁克科技有限公司 | Network storage and access method, device and system for hot spot data |
| US20110283062A1 (en) * | 2010-05-14 | 2011-11-17 | Hitachi, Ltd. | Storage apparatus and data retaining method for storage apparatus |
| CN103186350A (en) * | 2011-12-31 | 2013-07-03 | 北京快网科技有限公司 | Hybrid storage system and hot spot data block migration method |
| CN103455577A (en) * | 2013-08-23 | 2013-12-18 | 中国科学院计算机网络信息中心 | Multi-backup nearby storage and reading method and system of cloud host mirror image file |
| CN103942112A (en) * | 2013-01-22 | 2014-07-23 | 深圳市腾讯计算机系统有限公司 | Magnetic disk fault-tolerance method, device and system |
-
2016
- 2016-11-14 CN CN201611001205.7A patent/CN106534308B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101483668A (en) * | 2009-02-10 | 2009-07-15 | 成都市华为赛门铁克科技有限公司 | Network storage and access method, device and system for hot spot data |
| US20110283062A1 (en) * | 2010-05-14 | 2011-11-17 | Hitachi, Ltd. | Storage apparatus and data retaining method for storage apparatus |
| CN103186350A (en) * | 2011-12-31 | 2013-07-03 | 北京快网科技有限公司 | Hybrid storage system and hot spot data block migration method |
| CN103942112A (en) * | 2013-01-22 | 2014-07-23 | 深圳市腾讯计算机系统有限公司 | Magnetic disk fault-tolerance method, device and system |
| CN103455577A (en) * | 2013-08-23 | 2013-12-18 | 中国科学院计算机网络信息中心 | Multi-backup nearby storage and reading method and system of cloud host mirror image file |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109582509A (en) * | 2017-09-29 | 2019-04-05 | 中兴通讯股份有限公司 | Distributed file system disaster tolerance configuration method, device and readable storage medium storing program for executing |
| CN110019528A (en) * | 2017-12-26 | 2019-07-16 | 中国移动通信集团湖北有限公司 | Database manipulation load-balancing method, device, equipment and medium |
| CN109992409A (en) * | 2018-01-02 | 2019-07-09 | 中国移动通信有限公司研究院 | Cutting method, device, system, electronic equipment and the medium of data storage areas |
| CN109992409B (en) * | 2018-01-02 | 2021-07-30 | 中国移动通信有限公司研究院 | Method, device and system for segmenting data storage area, electronic equipment and medium |
| CN109284624A (en) * | 2018-09-03 | 2019-01-29 | 佛山科学技术学院 | A kind of data safety partition method and device based on the storage of block chain |
| CN111291040A (en) * | 2018-12-10 | 2020-06-16 | 中国移动通信集团四川有限公司 | Data processing method, device, equipment and medium |
| CN111291040B (en) * | 2018-12-10 | 2022-10-18 | 中国移动通信集团四川有限公司 | Data processing method, device, equipment and medium |
| CN111385327A (en) * | 2018-12-28 | 2020-07-07 | 阿里巴巴集团控股有限公司 | Data processing method and system |
| CN111385327B (en) * | 2018-12-28 | 2022-06-14 | 阿里巴巴集团控股有限公司 | Data processing method and system |
| CN113515411A (en) * | 2021-05-19 | 2021-10-19 | 中国工商银行股份有限公司 | Disaster recovery backup method, disaster recovery backup device, electronic device, storage medium, and program product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106534308B (en) | 2020-02-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106534308A (en) | Method and device for solving data block access hotspot problem in distributed storage system | |
| EP3433737B1 (en) | Memory sharing for working data using rdma | |
| CN108810041A (en) | A kind of data write-in of distributed cache system and expansion method, device | |
| US10860494B2 (en) | Flushing pages from solid-state storage device | |
| US10356150B1 (en) | Automated repartitioning of streaming data | |
| WO2017020742A1 (en) | Load balancing method and device | |
| CN105426319B (en) | Dynamic buffering zone devices and method | |
| Tai et al. | Improving flash resource utilization at minimal management cost in virtualized flash-based storage systems | |
| US11093410B2 (en) | Cache management method, storage system and computer program product | |
| CN114860163B (en) | Storage system, memory management method and management node | |
| CN108900626B (en) | Data storage method, device and system in cloud environment | |
| CN106469018B (en) | Load monitoring method and device for distributed storage system | |
| CN107133228A (en) | A kind of method and device of fast resampling | |
| JP2007249468A (en) | Cpu allocation method, cpu allocation program, cpu allocation device and database management system | |
| US9063667B2 (en) | Dynamic memory relocation | |
| WO2022179294A1 (en) | Data pre-fetching method, device and system | |
| CN106326143A (en) | Cache distribution, data access and data sending method, processor and system | |
| US11320996B2 (en) | Methods, apparatuses and computer program products for reallocating resource in a disk system | |
| CN106155923B (en) | The method and apparatus of memory sharing | |
| CN105528303B (en) | Method and apparatus for managing storage system | |
| CN115495433A (en) | Distributed storage system, data migration method and storage device | |
| CN115686342A (en) | Data storage method and device in storage system | |
| CN115509437A (en) | Storage system, network card, processor, data access method, device and system | |
| JP6112193B2 (en) | Access control program, disk device, and access control method | |
| CN114253456A (en) | Cache load balancing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |