CN107451042A - A kind of local cache method and device based on lease lock mechanism - Google Patents
A kind of local cache method and device based on lease lock mechanism Download PDFInfo
- Publication number
- CN107451042A CN107451042A CN201710638964.2A CN201710638964A CN107451042A CN 107451042 A CN107451042 A CN 107451042A CN 201710638964 A CN201710638964 A CN 201710638964A CN 107451042 A CN107451042 A CN 107451042A
- Authority
- CN
- China
- Prior art keywords
- file
- storage system
- data memory
- information statistics
- statistics component
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3452—Performance evaluation by statistical analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3034—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a storage system, e.g. DASD based or network based
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0643—Management of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0653—Monitoring storage devices or systems
Abstract
The invention discloses a kind of file access record statistical method and device, when detecting that client initiates file access request to storage system, starts Information Statistics component；The access record of file, generates acess control result in described information statistics component statistics preset time；The acess control result is periodically sent to data memory module.It can thus be appreciated that, the file access record in storage system is counted by Information Statistics component, and statistical result is sent to data memory module, so that user can be managed by the acess control result in data memory module to the memory space of storage system.The more efficient management company-data of user is contributed to by the method for the present invention, improves the reasonability that storage system space uses.
Description
Technical field
The present invention relates to the field of storage, more particularly to a kind of caching method and device of lease lock mechanism.
Background technology
With the development of Internet technology, storage system needs to support the data of magnanimity, but over time, use
The space that family business takes is more and more, and the space that can really use is fewer and fewer.Moreover, in occupied space, bag
Many files being infrequently accessed are included, user client manages memory space by handling the file that these are infrequently accessed.
But in the prior art, it can not definitely know that those files are often accessed in storage system, those texts
Part is infrequently accessed.
The content of the invention
In view of this, a kind of file access record statistical method provided in an embodiment of the present invention and device, are united by information
Meter component is counted to the access record for accessing file in storage system, and statistical result is sent into data memory module,
So that user can be managed by the acess control result in data memory module to the memory space of storage system.By
This, contributes to the management company-data that user is more efficient, improves the reasonability that storage system space uses
A kind of file access method, this method include disclosed in the embodiment of the present invention：
When detecting that client initiates file access request to storage system, start Information Statistics component；
The access record of file, generates acess control result in described information statistics component statistics preset time；
The acess control result is periodically sent to data memory module.
Optionally, the access of file records in described information statistics component statistics preset time, including：
Operated by access of the described information statistics component capture to file in the storage system；
The file access information package of the file access operation captured and correlation is generated into data object；
The data object is stored in the datarams table of described information statistics component.
Optionally, in addition to：
Initialization data memory table；
Start timer and send thread, the time cycle is set.
Optionally, the preset time is the time cycle that timer is set.
Optionally, in addition to：
According to the acess control result in the data memory module, the file in storage system is updated.
The embodiment of the present invention additionally provides a kind of file access record statistic device, and the device includes：
Start unit, for when detecting that client initiates file access request to storage system, starting Information Statistics
Component；
Statistic unit, for the access record of file in described information statistics component statistics preset time, generation accesses system
Count result；
Transmitting element, for the acess control result periodically to be sent into data memory module.
Optionally, the statistic unit, including：
Capturing unit, for being operated by access of the described information statistics component capture to file in the storage system；
Packaged unit, for the file access information package of the file access operation captured and correlation to be generated into data pair
As；
Storage unit, for the data object to be stored in the datarams table of described information statistics component.
Optionally, in addition to：
Initialization unit, for initialization data memory table；
Timer start unit, thread is sent for starting timer, the time cycle is set.
Optionally, the preset time is the time cycle that timer is set.
Optionally, in addition to：
Updating block, for according to the acess control result in the data memory module, to the file in storage system
It is updated.
In the present embodiment, by the Information Statistics component set in metadata cluster, to the file access in storage system
Record is counted, and statistical result is sent into data memory module, so that user can be by data memory module
Acess control result, the memory space of storage system is managed.Thus, the management cluster number that user is more efficient is contributed to
According to the reasonability that raising storage system space uses.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
The embodiment of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis
The accompanying drawing of offer obtains other accompanying drawings.
Fig. 1 shows a kind of schematic flow sheet of file access record statistical method provided in an embodiment of the present invention；
Fig. 2 shows a kind of structural representation of file access record statistic device provided in an embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other under the premise of creative work is not made
Embodiment, belong to the scope of protection of the invention.
A kind of schematic flow sheet of file access record statistical method provided in an embodiment of the present invention is shown with reference to figure 1,
In the present embodiment, methods described includes：
S101：When monitoring that client initiates file access request to storage system, start Information Statistics component；
, it is necessary to which explanation, Information Statistics component can be arranged in the metadata cluster of storage system in the present embodiment,
, it is necessary to by metadata cluster when client accesses the file in storage system, therefore letter can be set in metadata cluster
Cease statistics component, the access record of statistics file.
In the present embodiment, when the metadata cluster in storage system detects that client initiates file access to storage system
Request when, start metadata cluster in Information Statistics component.
S102：The access record of file, generates acess control result in Information Statistics component statistics preset time；
In the present embodiment, after Information Statistics component is activated, the file access operation that is detected within the default time
It will be recorded, wherein, file access operation includes：The operation such as the opening of file, establishment, deletion, renaming.
In the present embodiment, the access record of file includes access operation, access time of file etc..
It should be noted that file access result is within the default time, all statistical results.
The present embodiment, before S102 is performed, it can also include：
To Information Statistics assembly initialization.
Wherein, New Parent is initialized, specifically included：
Initialization data memory table；
Start timer and send thread, the time cycle is set.
In the present embodiment, initialization data memory table can be specifically to empty data record in Information Statistics component.
In the present embodiment, the default time mentioned in S102 can be the time cycle that timer is set, statistics
File access record in one time cycle.
In the present embodiment, the file access counted in Information Statistics component records, and is saved in datarams table, specifically
, S102 can include：
Operated by access of the statistics component capture to file in the storage system；
The file access information package of the file access operation captured and correlation is generated into data object；
The data object is stored in the datarams table of the statistics component.
It should be noted that related file access information can be the time accessed.
S103：Acess control result is periodically sent to data memory module；
In the present embodiment, the time cycle in the preset time and S103 mentioned in S102 can be the identical time, together
When can also be timer setting time cycle.
In the present embodiment, the time cycle that timer is set is the transmission cycle of statistical result, when Information Statistics component is united
After having counted the file access record in a time cycle, statistical result is sent to data memory module.
In the present embodiment, the time cycle that timer is set can also be able to be multiple for one, if setting multiple times
Cycle, then within multiple time cycles, the statistic record of a time cycle is often counted, acess control result is sent to data
Memory module.If timer set for a time cycle, then after having counted the statistic record in the periods of events, by this
Acess control result in cycle is sent to data memory module, and thus, S103 is specifically as follows：Timer sends thread cycle
Acess control result is sent to data memory module by property.After data memory module receives acess control result, Yong Huke
With the acess control result by data memory module check which file be often it is accessed, which file be infrequently by
Access, thus, user can be handled the file infrequently accessed, reach the purpose of management storage system.
In addition, can also be according to the access in statistical result after data memory module receives acess control result
Record is updated to the data in storage system.
In the present embodiment, by the Information Statistics component set in metadata cluster, to the file access in storage system
Record is counted, and statistical result is sent into data memory module, so that user can be by data memory module
Acess control result, the memory space of storage system is managed.Thus, the management cluster number that user is more efficient is contributed to
According to the reasonability that raising storage system space uses.
With reference to figure 2, show that a kind of file access provided in an embodiment of the present invention records the structural representation of statistic device,
In the present embodiment, the device includes：
Start unit 201, for when detecting that client initiates file access request to storage system, starting information system
Count component；
Statistic unit 202, for the access record of file in described information statistics component statistics preset time, generation accesses
Statistical result；
Transmitting element 203, for the acess control result periodically to be sent into data memory module.
Optionally, the statistic unit, including：
Capturing unit, for being operated by access of the statistics component capture to file in the storage system；
Packaged unit, for the file access information package of the file access operation captured and correlation to be generated into data pair
As；
Storage unit, for the data object to be stored in the datarams table of the statistics component.
Optionally, in addition to：
Initialization unit, for initialization data memory table；
Timer start unit, thread is sent for starting timer, the time cycle is set.
Optionally, the preset time is the time cycle that timer is set.
Optionally, in addition to：
Updating block, for according to the acess control result in the data memory module, to the file in storage system
It is updated.
In the present embodiment, by the Information Statistics component set in metadata cluster, to the file access in storage system
Record is counted, and statistical result is sent into data memory module, so that user can be by data memory module
Acess control result, the memory space of storage system is managed.Thus, by the device of the present embodiment, user is contributed to
More efficient management company-data, improve the reasonability that storage system space uses.
It should be noted that each embodiment in this specification is described by the way of progressive, each embodiment weight
Point explanation is all difference with other embodiment, between each embodiment identical similar part mutually referring to.
The foregoing description of the disclosed embodiments, professional and technical personnel in the field are enable to realize or using the present invention.
A variety of modifications to these embodiments will be apparent for those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, it is of the invention
The embodiments shown herein is not intended to be limited to, and is to fit to and principles disclosed herein and features of novelty phase one
The most wide scope caused.
Claims (10)
1. a kind of file access records statistical method, it is characterised in that including：
When detecting that client initiates file access request to storage system, start Information Statistics component；
The access record of file, generates acess control result in described information statistics component statistics preset time；
The acess control result is periodically sent to data memory module.
2. according to the method for claim 1, it is characterised in that file in described information statistics component statistics preset time
Record is accessed, including：
Operated by access of the described information statistics component capture to file in the storage system；
The file access information package of the file access operation captured and correlation is generated into data object；
The data object is stored in the datarams table of described information statistics component.
3. according to the method for claim 1, it is characterised in that also include：
Initialization data memory table；
Start timer and send thread, the time cycle is set.
4. according to the method described in right 3, it is characterised in that the preset time is week time that the timer is set
Phase.
5. according to the method for claim 1, it is characterised in that also include：
According to the acess control result in the data memory module, the file in storage system is updated.
6. a kind of file access records statistic device, it is characterised in that including：
Start unit, for when detecting that client initiates file access request to storage system, starting Information Statistics component；
Statistic unit, for the access record of file in described information statistics component statistics preset time, generate acess control knot
Fruit；
Transmitting element, for the acess control result periodically to be sent into data memory module.
7. device according to claim 6, it is characterised in that the statistic unit, including：
Capturing unit, for being operated by access of the described information statistics component capture to file in the storage system；
Packaged unit, for the file access information package of the file access operation captured and correlation to be generated into data object；
Storage unit, for the data object to be stored in the datarams table of described information statistics component.
8. device according to claim 6, it is characterised in that also include：
Initialization unit, for initialization data memory table；
Timer start unit, thread is sent for starting timer, the time cycle is set.
9. according to the device described in right 8, it is characterised in that the preset time is week time that the timer is set
Phase.
10. device according to claim 6, it is characterised in that also include：
Updating block, for according to the acess control result in the data memory module, being carried out to the file in storage system
Renewal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710638964.2A CN107451042A (en) | 2017-07-31 | 2017-07-31 | A kind of local cache method and device based on lease lock mechanism |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710638964.2A CN107451042A (en) | 2017-07-31 | 2017-07-31 | A kind of local cache method and device based on lease lock mechanism |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107451042A true CN107451042A (en) | 2017-12-08 |
Family
ID=60490522
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710638964.2A Pending CN107451042A (en) | 2017-07-31 | 2017-07-31 | A kind of local cache method and device based on lease lock mechanism |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107451042A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1838118A (en) * | 2005-03-24 | 2006-09-27 | 深圳市朗科科技有限公司 | File management method |
| CN101101563A (en) * | 2007-07-23 | 2008-01-09 | 清华大学 | Migration management based on massive data classified memory system |
| CN105653642A (en) * | 2015-12-25 | 2016-06-08 | 曙光信息产业股份有限公司 | Data management method and device of distributed file system |
-
2017
- 2017-07-31 CN CN201710638964.2A patent/CN107451042A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1838118A (en) * | 2005-03-24 | 2006-09-27 | 深圳市朗科科技有限公司 | File management method |
| CN101101563A (en) * | 2007-07-23 | 2008-01-09 | 清华大学 | Migration management based on massive data classified memory system |
| CN100451976C (en) * | 2007-07-23 | 2009-01-14 | 清华大学 | Migration management based on massive data classified memory system |
| CN105653642A (en) * | 2015-12-25 | 2016-06-08 | 曙光信息产业股份有限公司 | Data management method and device of distributed file system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10521358B2 (en) | System, apparatus and method for prioritizing the storage of content based on a threat index | |
| US10262005B2 (en) | Method, server and system for managing content in content delivery network | |
| US9641413B2 (en) | Methods and computer program products for collecting storage resource performance data using file system hooks | |
| US10645002B2 (en) | System, apparatus and method for managing redundancy elimination in packet storage during observation of data movement | |
| US9250811B1 (en) | Data write caching for sequentially written media | |
| JP6357243B2 (en) | Data stream ingestion and persistence policy | |
| CN104603740B (en) | Filing data identifies | |
| CN104040545B (en) | Intelligent data transmission and storage based on data characteristic | |
| KR102292471B1 (en) | Dynamic cache allocation and network management | |
| CN104978362B (en) | Data migration method, device and the meta data server of distributed file system | |
| US9639459B2 (en) | I/O latency and IOPs performance in thin provisioned volumes | |
| CN104243543B (en) | It is used for the method and system of smart polling frequency in data storage in computing environment | |
| CN111538875B (en) | Service index acquisition method and device and wind control equipment | |
| EP2187332A1 (en) | Storage area allocation method and a management server | |
| CN103577482B (en) | A kind of webpage collection method, device and browser | |
| US10558581B1 (en) | Systems and techniques for data recovery in a keymapless data storage system | |
| CN105824932A (en) | Archive system for storing OSS based on Aliskiu object | |
| CN105302801A (en) | Resource caching method and apparatus | |
| CN107608759A (en) | Local cache the Visual Implementation method, medium and equipment based on JVM internal memories | |
| US20140115112A1 (en) | Server system and message processing method thereof | |
| CN108205468A (en) | A kind of distributed system and implementation method towards massive video image | |
| CN110989935A (en) | Data processing and transmitting method and device of flash system | |
| KR101975634B1 (en) | Digital memory imaging system and method | |
| CN106406771B (en) | Log recording method and logger | |
| CN107451042A (en) | A kind of local cache method and device based on lease lock mechanism |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171208 |
|
| RJ01 | Rejection of invention patent application after publication |