CN108519861A - Dynamic storage method based on large-scale parallel access - Google Patents
Dynamic storage method based on large-scale parallel access Download PDFInfo
- Publication number
- CN108519861A CN108519861A CN201810282822.1A CN201810282822A CN108519861A CN 108519861 A CN108519861 A CN 108519861A CN 201810282822 A CN201810282822 A CN 201810282822A CN 108519861 A CN108519861 A CN 108519861A
- Authority
- CN
- China
- Prior art keywords
- file
- document
- access
- frequency
- file destination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 14
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0643—Management of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a dynamic storage method based on large-scale parallel access, which comprises the following steps: searching a target file, and searching a file address of the target file in a file system according to the name of the target file; acquiring the access frequency and the path of the target file, and acquiring the access frequency number and the path of the target file in a file frequency table and a file path record table; and judging whether the access frequency number of the target file exceeds a set value, if so, creating a new file copy and updating a file frequency table and a file path record table. The invention provides a dynamic storage method for large-scale parallel access, which automatically adjusts the number of file copies and copy storage paths according to the access frequency of a target file so as to provide large-scale parallel access, maximally provide the access speed of stored files and save storage space.
Description
Technical field
It is especially a kind of based on the dynamic storage method for providing large-scale parallel access the present invention relates to computer realm.
Background technology
The load balancing of traditional computer is realized by multiple servers, and stores text currently in order to accelerating to access
The load balancing that part is done can not maximumlly provide the access speed of storage file, while be also that can waste part storage
Space.
Invention content
In order to solve the above technical problems, the object of the present invention is to provide a kind of based on the dynamic for providing large-scale parallel access
Storage method.
The technical solution adopted by the present invention is：
A kind of dynamic storage method accessed based on offer large-scale parallel, is included the following steps：
It searches file destination and the file address of the file destination is searched in file system according to file destination name；
Access frequency and the path for obtaining the file destination obtain the mesh in document-frequency table and file path record sheet
Mark access frequency number and the path of file；
Judge whether the access frequency number of file destination is more than setting value, if so, creating new duplicate of the document and update
Document-frequency table and file path record sheet.
The invention also includes read file, according to document-frequency table and file path record sheet distribution file destination and/or
Duplicate of the document is read out for user, judges whether the reading frequency of file destination and/or duplicate of the document is more than setting value, if
It is then to create new duplicate of the document and update document-frequency table and file path record sheet.
The invention also includes duplicate of the document is deleted, judge whether the reading frequency number of file destination declines, if so, deleting
Partial document copy simultaneously updates document-frequency table and file path record sheet.
Beneficial effects of the present invention：
The present invention provides the dynamic storage method that large-scale parallel accesses, and text is automatically adjusted according to file destination access frequency
Part copy amount and copy store path, to provide large-scale concurrent access, maximumlly provide the access speed of storage file
Degree, while also saving memory space.
Description of the drawings
The specific implementation mode of the present invention is described further below in conjunction with the accompanying drawings.
Fig. 1 is the logic diagram of the present invention.
Specific implementation mode
As shown in Figure 1, it is a kind of based on the dynamic storage method for providing large-scale parallel access, include the following steps：
It searches file destination and the file address of the file destination is searched in file system according to file destination name, if not having
It finds, directly exits；
Access frequency and the path for obtaining the file destination obtain the mesh in document-frequency table and file path record sheet
Mark access frequency number and the path of file；
Judge whether the access frequency number of file destination is more than setting value, if so, creating new duplicate of the document and update
Document-frequency table and file path record sheet, in the present invention, the setting value of file destination access frequency number are preferably set to 10
Secondary/second.
The present invention provides the dynamic storage method that large-scale parallel accesses, and text is automatically adjusted according to file destination access frequency
Part copy amount and copy store path, to provide large-scale concurrent access, maximumlly provide the access speed of storage file
Degree, while also saving memory space.
The invention also includes read file, according to document-frequency table and file path record sheet distribution file destination and/or
Duplicate of the document is read out for user, judges whether the reading frequency of file destination and/or duplicate of the document is more than setting value, if
Then to create new duplicate of the document and update document-frequency table and file path record sheet, in the present invention, file destination and/
Or the setting value of duplicate of the document reading frequency is preferably set to 12 times/second.
The invention also includes duplicate of the document is deleted, judge whether the reading frequency number of file destination declines, if so, deleting
Partial document copy simultaneously updates document-frequency table and file path record sheet, and comparison conventional store method has more humanized
Memory space is adjusted, to improve file large scale accessing speed and utilize memory space as desired.
The foregoing is merely the preferred embodiments of the present invention, and the present invention is not limited to the above embodiments, as long as with
Essentially identical means realize that the technical solution of the object of the invention belongs within protection scope of the present invention.
Claims (3)
1. a kind of based on the dynamic storage method for providing large-scale parallel access, which is characterized in that include the following steps：
It searches file destination and the file address of the file destination is searched in file system according to file destination name；
Access frequency and the path for obtaining the file destination obtain target text in document-frequency table and file path record sheet
The access frequency number of part and path；
Judge whether the access frequency number of file destination is more than setting value, if so, creating new duplicate of the document and updating file
Frequency meter and file path record sheet.
2. according to claim 1 a kind of based on the dynamic storage method for providing large-scale parallel access, it is characterised in that：
Further include reading file, according to document-frequency table and file path record sheet distribution file destination and/or duplicate of the document for user
It is read out, judges whether the reading frequency of file destination and/or duplicate of the document is more than setting value, if so, creating new text
Part copy simultaneously updates document-frequency table and file path record sheet.
3. according to claim 2 a kind of based on the dynamic storage method for providing large-scale parallel access, it is characterised in that：
Further include deleting duplicate of the document, judges whether the reading frequency number of file destination declines, if so, deleting partial document copy simultaneously
Update document-frequency table and file path record sheet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810282822.1A CN108519861A (en) | 2018-04-02 | 2018-04-02 | Dynamic storage method based on large-scale parallel access |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810282822.1A CN108519861A (en) | 2018-04-02 | 2018-04-02 | Dynamic storage method based on large-scale parallel access |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108519861A true CN108519861A (en) | 2018-09-11 |
Family
ID=63431525
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810282822.1A Pending CN108519861A (en) | 2018-04-02 | 2018-04-02 | Dynamic storage method based on large-scale parallel access |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108519861A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111435342A (en) * | 2019-01-14 | 2020-07-21 | 深圳市茁壮网络股份有限公司 | Poster updating method, poster updating system and poster management system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1658560A (en) * | 2005-02-28 | 2005-08-24 | 中国人民解放军国防科学技术大学 | Quickly data copy method based on prediction |
| CN103838860A (en) * | 2014-03-19 | 2014-06-04 | 华存数据信息技术有限公司 | File storing system based on dynamic transcript strategy and storage method of file storing system |
| CN104754021A (en) * | 2013-12-31 | 2015-07-01 | 伊姆西公司 | Device and method for promoting access of data in distributed storage system |
| CN106598488A (en) * | 2016-11-24 | 2017-04-26 | 北京小米移动软件有限公司 | Distributed data reading method and device |
| CN107423422A (en) * | 2017-08-01 | 2017-12-01 | 武大吉奥信息技术有限公司 | Spatial data distributed storage and search method and system based on grid |
-
2018
- 2018-04-02 CN CN201810282822.1A patent/CN108519861A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1658560A (en) * | 2005-02-28 | 2005-08-24 | 中国人民解放军国防科学技术大学 | Quickly data copy method based on prediction |
| CN104754021A (en) * | 2013-12-31 | 2015-07-01 | 伊姆西公司 | Device and method for promoting access of data in distributed storage system |
| CN103838860A (en) * | 2014-03-19 | 2014-06-04 | 华存数据信息技术有限公司 | File storing system based on dynamic transcript strategy and storage method of file storing system |
| CN106598488A (en) * | 2016-11-24 | 2017-04-26 | 北京小米移动软件有限公司 | Distributed data reading method and device |
| CN107423422A (en) * | 2017-08-01 | 2017-12-01 | 武大吉奥信息技术有限公司 | Spatial data distributed storage and search method and system based on grid |
Non-Patent Citations (1)
| Title |
|---|
| 方尔正，等.: "《嵌入式技术及其应用》", 31 July 2008 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111435342A (en) * | 2019-01-14 | 2020-07-21 | 深圳市茁壮网络股份有限公司 | Poster updating method, poster updating system and poster management system |
| CN111435342B (en) * | 2019-01-14 | 2023-12-05 | 深圳市茁壮网络股份有限公司 | Poster updating method, poster updating system and poster management system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109213772B (en) | Data storage method and NVMe storage system | |
| US11468027B2 (en) | Method and apparatus for providing efficient indexing and computer program included in computer readable medium therefor | |
| US9871727B2 (en) | Routing lookup method and device and method for constructing B-tree structure | |
| CN103678556B (en) | The method and processing equipment of columnar database processing | |
| CN102521334B (en) | Data storage and query method based on classification characteristics and balanced binary tree | |
| CN104239237B (en) | A kind of TLB management methods and device | |
| WO2016082191A1 (en) | File access method and apparatus | |
| CN104484471B (en) | A kind of implementation method of high-performance data storage engines | |
| CN108897761A (en) | A kind of clustering storage method and device | |
| CN104750681A (en) | Method and device for processing mass data | |
| US20200257732A1 (en) | Systems and methods of managing an index | |
| CN103176754A (en) | Reading and storing method for massive amounts of small files | |
| CN104408044A (en) | File access method and system | |
| CN106682184B (en) | Lightweight merging method based on log merging tree structure | |
| US9292549B2 (en) | Method and system for index serialization | |
| CN106155934A (en) | Based on the caching method repeating data under a kind of cloud environment | |
| CN107766258B (en) | Memory storage method and device and memory query method and device | |
| CN103793475A (en) | Distributed file system data migration method | |
| US20080294673A1 (en) | Data transfer and storage based on meta-data | |
| CN103399915A (en) | Optimal reading method for index file of search engine | |
| CN105912696A (en) | DNS (Domain Name System) index creating method and query method based on logarithm merging | |
| CN103841168B (en) | Data trnascription update method and meta data server | |
| CN110008289B (en) | Relational database and power grid model data storage and retrieval method | |
| CN108519861A (en) | Dynamic storage method based on large-scale parallel access | |
| CN107133183A (en) | A kind of cache data access method and system based on TCMU Virtual Block Devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180911 |