CN107480073A - A kind of storage system hot spot data cache pre-reading implementation method - Google Patents
A kind of storage system hot spot data cache pre-reading implementation method Download PDFInfo
- Publication number
- CN107480073A CN107480073A CN201710715559.6A CN201710715559A CN107480073A CN 107480073 A CN107480073 A CN 107480073A CN 201710715559 A CN201710715559 A CN 201710715559A CN 107480073 A CN107480073 A CN 107480073A
- Authority
- CN
- China
- Prior art keywords
- storage system
- hot spot
- storage
- spot data
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0862—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches with prefetch
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
The present invention relates to a kind of storage system hot spot data cache pre-reading implementation method, this method describes to instruct comprising X during the instruction of service application main frame issuing service application read block, it is integer number to instruct number X, in the X service application read block instruction of instruction number, wherein there is Y scope of the instruction more than hot spot data threshold value Z, threshold value Z is the positive integer more than 0, and threshold value Z can be generated with custom field numerical value or by storage system in thermonuclear point data ratio, that methods described can read the Y director data block more than threshold value Z scopes in caching C, it can be internal memory or non-volatile memory medium to cache C.
Description
Technical field
Patent of the present invention is related to computer field of storage.
Background technology
Storage system refers to various storage devices, control unit and the management information by storage program and data in computer
The equipment of scheduling（Hardware）And algorithm（Software）The system formed.The main storage of computer can not meet access speed simultaneously
Hurry up, the big requirement low with cost of memory capacity, must have in a computer speed from slow to fast, the descending multistage layer of capacity
External memory, with optimal control dispatching algorithm and rational cost, composition has the acceptable storage system of performance.
The main storage of computer can not meet that access speed is fast, the big requirement low with cost of memory capacity simultaneously, count
Must have in calculation machine speed from slow to fast, the descending multilevel hierarchy memory of capacity, with optimal control dispatching algorithm and
Rational cost, composition have the acceptable storage system of performance.The status of the performance of storage system in a computer is increasingly heavy
Will, main cause is：1. von Karman architecture is built on the basis of stored program concept, accessing operation accounts for center
Processor（CPU）70% or so of time.2. storage management and the quality of tissue have influence on overall efficiency.3. at modern information
Reason, such as requirement of image procossing, database, knowledge base, speech recognition, multimedia to storage system are very high.
The business that storage system externally provides can be divided into block storage, file storage and object storage, block storage and refer at one
RAID（RAID）Concentrate, a controller adds one group of disc driver, then provides fixed size
RAID blocks are as LUN（LUN）Volume.File storage is also known as NAS（Network Attached Storage：Network is attached
Category storage）Be it is a kind of will distribution, independent Data Integration be large-scale, centralized management data center, in order to different masters
The technology that machine and application server conduct interviews.Object storage object stores, also referred to as object-based storage, is for describing
Solve and the generic term of the method for processing discrete unit, these discrete units are called object.Just as file, object
Comprising data, but with file unlike, object there will be no hierarchical structure in a Rotating fields.Each object is one
In the same rank of the individual flat address space referred to as storage pool, an object will not belong to the next stage of another object.
Patent of invention content
Patent of the present invention is related to a kind of storage system hot spot data cache pre-reading implementation method, and this method describes service application main frame
Comprising X instruction when issuing service application read block instructs, instruction number X is integer number, in instruction X service application of number
In read block instruction, wherein there is Y scope of the instruction more than hot spot data threshold value Z, threshold value Z is the positive integer more than 0, and
Threshold value Z can be generated with custom field numerical value or by storage system in thermonuclear point data ratio, and that methods described can will exceed threshold
Y director data block of value Z scopes is read in caching C, and caching C can be internal memory or non-volatile memory medium.
Brief description of the drawings
Fig. 1 is a kind of storage system hot spot data cache pre-reading implementation method structural representation of patent of the present invention.
Embodiment
In order that the object, technical solution and advantage of patent of the present invention are more clearly understood, below in conjunction with accompanying drawing and implementation
Example, patent of the present invention is further elaborated.It should be appreciated that specific embodiment described herein is only explaining
Patent of the present invention, is not intended to limit the present invention patent.
Referring to Fig. 1, a kind of storage system hot spot data cache pre-reading implementation method structure that Fig. 1 is patent of the present invention is shown
It is intended to.
A kind of storage system hot spot data cache pre-reading implementation method, it is characterised in that methods described includes storage system
（10）, hot spot data（11）, caching（12）, memory（13）, data block（14）, storage（15）, business main frame（16）And reading
According to block instruction（17）, this method storage（15）By memory（13）It is supplied to business main frame（16）Access and use, business main frame
（16）Need to issue when reading data and read data block instruction（17）To storage system（10）, storage system（10）From memory
（13）Middle read block（14）, wherein to read block（14）In some data block reading times exceed storage system（10）
After the threshold value of setting, the data block data can be defined as hot spot data（11）, storage system（10）And can be by hot spot data
（11）Pre-read to caching（12）In.
A kind of storage system hot spot data cache pre-reading implementation method, it is characterised in that this method description is read data block and referred to
Order（17）For X, X is the positive integer more than or equal to 1, and wherein X is read data block instruction（17）In there is the Y to be hot spot data
（11）, Y span is less than or equal to X.
A kind of storage system hot spot data cache pre-reading implementation method, it is characterised in that this method describes hot spot data
（11）For more than storage system（10）The threshold value Z of setting, threshold value Z can be the numerical value or storage system of setting（10）Automatically generate
Numerical value, threshold value Z value is the positive integer more than 0.
A kind of storage system hot spot data cache pre-reading implementation method, it is characterised in that this method describes memory（13）
Can be single storage medium or multiple storage medium collection, simultaneous memory（13）Can be that NAS is shared or data block stores.
A kind of storage system hot spot data cache pre-reading implementation method, it is characterised in that this method description caching（12）Can
Think caching or non-volatile memory medium, but the caching（12）Performance be above memory（13）.
The preferred embodiment of patent of the present invention is the foregoing is only, is not intended to limit the invention patent, it is all at this
All any modification, equivalent and improvement made within the spirit and principle of patent of invention etc., should be included in patent of the present invention
Protection domain within.
Claims (5)
1. a kind of storage system hot spot data cache pre-reading implementation method, it is characterised in that methods described includes storage system
（10）, hot spot data（11）, caching（12）, memory（13）, data block（14）, storage（15）, business main frame（16）And reading
According to block instruction（17）, this method storage（15）By memory（13）It is supplied to business main frame（16）Access and use, business main frame
（16）Need to issue when reading data and read data block instruction（17）To storage system（10）, storage system（10）From memory
（13）Middle read block（14）, wherein to read block（14）In some data block reading times exceed storage system（10）
After the threshold value of setting, the data block data can be defined as hot spot data（11）, storage system（10）And can be by hot spot data
（11）Pre-read to caching（12）In.
A kind of 2. storage system hot spot data cache pre-reading implementation method according to claim 1, it is characterised in that the party
Data block instruction is read in method description（17）For X, X is the positive integer more than or equal to 1, and wherein X is read data block instruction（17）In have Y
Individual is hot spot data（11）, Y span is less than or equal to X.
A kind of 3. storage system hot spot data cache pre-reading implementation method according to claim 1, it is characterised in that the party
Method describes hot spot data（11）For more than storage system（10）The threshold value Z of setting, threshold value Z can be numerical value or the storage system of setting
System（10）The numerical value automatically generated, threshold value Z value is the positive integer more than 0.
A kind of 4. storage system hot spot data cache pre-reading implementation method according to claim 1, it is characterised in that the party
Method describes memory（13）Can be single storage medium or multiple storage medium collection, simultaneous memory（13）It can be deposited for block
Storage, file storage or object storage.
A kind of 5. storage system hot spot data cache pre-reading implementation method according to claim 1, it is characterised in that the party
Method description caching（12）Can be caching or non-volatile memory medium, but the caching（12）Performance be above memory
（13）.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710715559.6A CN107480073A (en) | 2017-08-20 | 2017-08-20 | A kind of storage system hot spot data cache pre-reading implementation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710715559.6A CN107480073A (en) | 2017-08-20 | 2017-08-20 | A kind of storage system hot spot data cache pre-reading implementation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107480073A true CN107480073A (en) | 2017-12-15 |
Family
ID=60600825
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710715559.6A Pending CN107480073A (en) | 2017-08-20 | 2017-08-20 | A kind of storage system hot spot data cache pre-reading implementation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107480073A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100077154A1 (en) * | 2008-09-24 | 2010-03-25 | Sun Microsystems, Inc. | Method and system for optimizing processor performance by regulating issue of pre-fetches to hot cache sets |
| CN102170460A (en) * | 2011-03-10 | 2011-08-31 | 浪潮(北京)电子信息产业有限公司 | Cluster storage system and data storage method thereof |
| CN102882928A (en) * | 2012-08-31 | 2013-01-16 | 浪潮电子信息产业股份有限公司 | Hierarchical storage management method of cloud storing system |
| CN103400598A (en) * | 2007-08-14 | 2013-11-20 | 三星电子株式会社 | Solid state memory, computer system including same, and method of operating same |
| CN103713861A (en) * | 2014-01-09 | 2014-04-09 | 浪潮(北京)电子信息产业有限公司 | File processing method and system based on hierarchical division |
| CN203930810U (en) * | 2014-05-26 | 2014-11-05 | 中国能源建设集团广东省电力设计研究院 | A kind of mixing storage system based on multidimensional data similarity |
| CN105653524A (en) * | 2014-11-10 | 2016-06-08 | 阿里巴巴集团控股有限公司 | Data storage method, device and system |
-
2017
- 2017-08-20 CN CN201710715559.6A patent/CN107480073A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103400598A (en) * | 2007-08-14 | 2013-11-20 | 三星电子株式会社 | Solid state memory, computer system including same, and method of operating same |
| US20100077154A1 (en) * | 2008-09-24 | 2010-03-25 | Sun Microsystems, Inc. | Method and system for optimizing processor performance by regulating issue of pre-fetches to hot cache sets |
| CN102170460A (en) * | 2011-03-10 | 2011-08-31 | 浪潮(北京)电子信息产业有限公司 | Cluster storage system and data storage method thereof |
| CN102882928A (en) * | 2012-08-31 | 2013-01-16 | 浪潮电子信息产业股份有限公司 | Hierarchical storage management method of cloud storing system |
| CN103713861A (en) * | 2014-01-09 | 2014-04-09 | 浪潮(北京)电子信息产业有限公司 | File processing method and system based on hierarchical division |
| CN203930810U (en) * | 2014-05-26 | 2014-11-05 | 中国能源建设集团广东省电力设计研究院 | A kind of mixing storage system based on multidimensional data similarity |
| CN105653524A (en) * | 2014-11-10 | 2016-06-08 | 阿里巴巴集团控股有限公司 | Data storage method, device and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220057940A1 (en) | Method and Apparatus for SSD Storage Access | |
| KR101502896B1 (en) | Distributed memory cluster control apparatus and method using map reduce | |
| TWI627536B (en) | System and method for a shared cache with adaptive partitioning | |
| US20180285414A1 (en) | Database management system cluster node subtasking data query | |
| CN102985909B (en) | Object for good lattice provides the method and apparatus of the high scalability network storage | |
| CN107450855B (en) | Model-variable data distribution method and system for distributed storage | |
| CN106534308B (en) | Method and device for solving data block access hot spot in distributed storage system | |
| CN108519856B (en) | Data block copy placement method based on heterogeneous Hadoop cluster environment | |
| CN108416054B (en) | Method for calculating number of copies of dynamic HDFS (Hadoop distributed File System) based on file access heat | |
| CN111737168A (en) | Cache system, cache processing method, device, equipment and medium | |
| CN103095788A (en) | Cloud resource scheduling policy based on network topology | |
| CN106339475A (en) | Distributed storage system for mass data | |
| CN106375425A (en) | Processing method and device for distributed caching | |
| CN103595799A (en) | Method for achieving distributed shared data bank | |
| CN106598724A (en) | Computing system memory management method | |
| CN108596723B (en) | Order pushing method, system, server and storage medium | |
| CN108121601A (en) | A kind of application resource dispatching device and method based on weight | |
| CN106201918B (en) | A kind of method and system based on big data quantity and extensive caching quick release | |
| CN103020077A (en) | Method for managing memory of real-time database of power system | |
| CN109766056A (en) | A kind of storage array controllers IO array dispatching method and device | |
| Zhou et al. | Hierarchical consistent hashing for heterogeneous object-based storage | |
| CN104750614B (en) | Method and apparatus for managing memory | |
| CN105528303B (en) | Method and apparatus for managing storage system | |
| CN107480073A (en) | A kind of storage system hot spot data cache pre-reading implementation method | |
| CN109491785A (en) | Internal storage access dispatching method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20171215 |
|
| WD01 | Invention patent application deemed withdrawn after publication |