CN109871185A - A method of blue light array data reading efficiency is improved using caching technology - Google Patents
A method of blue light array data reading efficiency is improved using caching technology Download PDFInfo
- Publication number
- CN109871185A CN109871185A CN201910166997.0A CN201910166997A CN109871185A CN 109871185 A CN109871185 A CN 109871185A CN 201910166997 A CN201910166997 A CN 201910166997A CN 109871185 A CN109871185 A CN 109871185A
- Authority
- CN
- China
- Prior art keywords
- data
- disk array
- array
- blue light
- grouping
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention belongs to blue-ray storage technical field, a kind of specifically method for improving blue light array data reading efficiency using caching technology.Method of the invention is mainly to pass through the disk array for increasing a low capacity to use as cooperation blue light array is cached, the storage method of data is set are as follows: when user storage data, data are classified according to file suffixes name first, the file of same suffix name is stored in as far as possible on same Blu-ray Disc, simultaneously, by cache replacement algorithm, judge whether that the data that will be just written are added in disk array.The read method of data is set are as follows: when user reads data, data are inquired whether in disk array, such as in disk array, then directly to user's returned data；As there is no the partial data in disk array, then the storage address of data in blue light array is inquired, reads data, and feed back to user；And by cache replacement algorithm, judge whether that the data that will have just read are added in disk array.To preferably solve the problems, such as that blue light array data reading efficiency is low, wider array of application scenarios are provided for this green of blue light array, energy-efficient storage scheme.
Description
Technical field
The invention belongs to blue-ray storage technical fields, specifically a kind of to improve blue light array data using caching technology
The method of reading efficiency.
Background technique
With Internet of Things, cloud computing, big data, high definition photo video equipment, network technology it is commonly used so that data
(including high definition video recording, photo, video, journal file etc.) is rapidly increasing, therefore to the demand and strategy of data storage
In rapid variation to adapt to such change.According to the basic principle that data generate, over time, data use frequency
Rate can reduce." cold data " is stored using traditional storage mode, can face that at high cost, the holding time is short, hardware is sharp
With the low problem of rate.This nearline storage mode of blue light array is more suitable for storing this kind of equipment, because it possesses data preservation
Time is longer, up to 50 years, cost is relatively low and it is lower with energy the features such as.
It is a kind of new trend of Future Data center and cloud storage platform using blue light array storing data, can satisfy
Compared with the associated mechanisms such as the use demand of conglomerate, such as manufacturing, including traffic, aviation, shipping, building, building, Ke Yiyong
It is retained in data such as measurement data, experimental data, manufaturing datas；Medical industry can be used for medical image data, patient's disease
The data such as example, doctor formula data are retained；Government bodies can be used for resident information, social insurance, all kinds of monitoring image datas
Etc. data retain；News Field can be used for all kinds of interview original video data, picture information, voice data, written historical materials etc.
Data retention；Bank finance field can be used for the data retentions ... such as all kinds of client trading information, customer data, account information
" cold data " is stored using blue light array, is reduced costs, has been saved energy consumption, increased data retention over time.
But the partial data, it is not to be never read, when user needs called data, the reading data of blue light array
Efficiency will become it and apply bottleneck.When user reads data in blue light array, system inquires number in the database first
According to storage address, then mobile mechanical arm to specified optical disk cartridge, takes disk and feeds back to the corresponding data of user after loading.Such as
In the case that fruit is multi-user, performance is especially low.
Summary of the invention
The object of the present invention is in view of the above-mentioned problems, provide it is a kind of using virtualization technology by disk array and blue light battle array
Column are unified to carry out resource allocation and management, and the method for blue-ray storage data reading performance using redundancy is improved using caching technology.
The technical scheme is that
A method of blue light array data reading efficiency is improved using caching technology, which is characterized in that including following step
It is rapid:
S1, disk array is added in blue light array resource pool using virtualization technology, i.e., by the data of every CD
Buffered packet is created in disk array respectively, corresponding access structure is chained list；
S2, the method for data storage is set are as follows:
When user storage data, data are classified according to file suffixes name first, by the file of same suffix name
It is stored on same Blu-ray Disc as far as possible, meanwhile, by cache replacement algorithm, judge whether that the data that will be just written are added to
In disk array.
S3, the read method of data is set are as follows:
When user reads data, data are inquired whether in disk array, such as in disk array, are then directly returned to user
Return data；As there is no the partial data in disk array, then the storage address of data in blue light array is inquired, reads data, and
Feed back to user；And by cache replacement algorithm, judge whether that the data that will have just read are added in disk array.
Further, step S2, cache replacement algorithm described in S3 specifically, by user request data in disk battle array
It is defined as hitting when in column, needs to read number from blue light array when not being defined as miss, i.e. miss in disk array
According to then including:
When user storage data, it is directly entered step S32, when user reads data, judges whether the data read hit,
If so, S31 is entered step, if it is not, then entering step S32；
S31, accessed data are moved to the foremost being grouped where the data, while the grouping is moved to entirely
The head of chained list；
S32, judge whether the data of the whole Zhang Guangpan where the data have part in disk array, if so, will visit
The data asked are placed on the foremost of the grouping, by remaining CD not the reading data in the grouping into disk array,
And it is placed on grouping backmost, while the grouping being moved to the head of entire chained list；If it is not, being then the CD where the data
A grouping is created in disk array, and by the reading data of this CD into this grouping, the data accessed are placed on
Grouping is finally inserted into the head of chained list by the foremost of grouping；When CD content is read in disk array, disk is judged
Whether array has expired, if so, eliminating the grouping of chained list tail portion.
Beneficial effects of the present invention are that the disk array by increasing a low capacity makes as caching cooperation blue light array
With improving the reading efficiency of data with this.Though increasing a part of cost, the preferable blue light array data that solves reads effect
The low problem of rate provides wider array of application scenarios for this green of blue light array, energy-efficient storage scheme.
Detailed description of the invention
Fig. 1 is system structure of the invention schematic diagram；
Fig. 2 is data manipulation flow chart of the present invention.
Specific embodiment
Bright technical solution of the present invention is described in detail with reference to the accompanying drawing.
As shown in Figure 1, in blue light array increase disk array be used as buffer memory device, user pass through client software or
Data are read in browser storage.The specific location of data storage is transparent to user, and user, which only uses, passes through client software or clear
Device of looking at sends specified order.
Because blue light array is mainly as filing, the nearline storage equipment of backup cold data, and data are to carve after write-in
In blue light disk, the user behavior that not can be carried out delete operation, therefore mainly consider is storing data and reading data for record.
As shown in Fig. 2, data are classified according to file suffixes name first, after same when user storage data
The file for sewing name is stored in as far as possible on same Blu-ray Disc, meanwhile, by cache replacement algorithm, judge whether just to be written
Data are added in disk array.When user selects to read data, data are inquired whether in disk array, such as in disk battle array
In column, then directly to user's returned data.As there is no the partial data in disk array, then depositing for data in blue light array is inquired
Address is stored up, reads data, and feed back to user.Meanwhile system judges that the data just read are added using cache replacement algorithm
Into disk array, to reduce the data by the time of this visit again, system effectiveness is improved.
The present invention is primarily to reduce the time that user data is read, therefore make disk array as buffer memory device
With.When user request data in disk array when cache hit, not in disk array when be miss, need to be from blue light battle array
Data are read in column.
When accessing one group of data in blue light array, it is necessary first to classify to data, the foundation of classification is data text
The suffix name of part.The file of identical suffix name is stored in as far as possible in same blue light array.After this operation, every CD
The data of middle storage hold inside or all certain relevant property on the time, as some data in a CD are often interviewed
It asks, a possibility that other data are accessed can increase therewith.Lru algorithm is improved, by data grouping and place CD
It is added and judges process.The improved specific principle of algorithm is as follows:
S41, when user's access data in disk array the miss and data of the whole Zhang Guangpan where data all do not have
Have in disk array.Then the CD where the data creates a buffered packet, and the data of this CD are added to
In this grouping, the data accessed are placed on the foremost of grouping, and grouping is finally inserted into the head of the chained list.
S42, when user's access data in disk array the miss but CD where data has partial data in magnetic
In disk array, CD where illustrating is having grouping, the data of access is placed on to the foremost of the grouping, by remaining CD
In data not in the grouping be placed on grouping backmost, while the grouping being moved to the head of entire chained list.
S43, when the data of user's access are hit in disk array, then accessed data are moved to the data institute
In the foremost of grouping, while the grouping being moved to the head of entire chained list.
If S44, disk array have been expired, that is, caching has expired, then by the data in the grouping of superseded chained list tail portion, each grouping
Internal superseded method is also based on LRU progress.
Compared to the simple method for carrying out storing data using blue light array, the present invention is by a disk array as number
According to buffer memory device, data reading performance using redundancy is effectively raised, it is low to compensate for speed caused by the mechanical arm addressing of blue light array
Problem.With lesser cost, the application scenarios of this inexpensive, energy saving, safety nearline storage equipment of blue light array are extended.
Claims (2)
1. a kind of method for improving blue light array data reading efficiency using caching technology, which comprises the following steps:
S1, disk array is added in blue light array resource pool using virtualization technology, i.e., distinguished the data of every CD
Buffered packet is created in disk array, corresponding access structure is chained list；
S2, the method for data storage is set are as follows:
When user storage data, data are classified first according to file suffixes name, the file of same suffix name is stored
On same Blu-ray Disc, meanwhile, by cache replacement algorithm, judge whether that the data that will be just written are added to disk array
In；
S3, the read method of data is set are as follows:
When user reads data, data are inquired whether in disk array, such as in disk array, then directly return to number to user
According to；As there is no the partial data in disk array, then the storage address of data in blue light array is inquired, reads data, and feed back
To user；And by cache replacement algorithm, judge whether that the data that will have just read are added in disk array.
2. a kind of method for improving blue light array data reading efficiency using caching technology according to claim 1, special
Sign is that step S2, the cache replacement algorithm described in S3 is specifically, the data that user is requested Shi Dingyi in disk array
For hit, needs to read data from blue light array when not being defined as miss, i.e. miss in disk array, then include:
When user storage data, it is directly entered step S32, when user reads data, judges whether the data read hit, if
It is then to enter step S31, if it is not, then entering step S32；
S31, accessed data are moved to the foremost being grouped where the data, while the grouping is moved to entire chained list
Head；
S32, judge whether the data of the whole Zhang Guangpan where the data have part in disk array, if so, by access
Data are placed on the foremost of the grouping, by the reading data in the grouping and is not put into disk array in remaining CD
Grouping backmost, while the grouping being moved to the head of entire chained list；If it is not, then the CD where the data is in magnetic
A grouping is created in disk array, and by the reading data of this CD into this grouping, the data accessed are placed on grouping
Foremost, grouping is finally inserted into the head of chained list；When CD content is read in disk array, disk array is judged
Whether expire, if so, eliminating the grouping of chained list tail portion.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910166997.0A CN109871185A (en) | 2019-03-06 | 2019-03-06 | A method of blue light array data reading efficiency is improved using caching technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910166997.0A CN109871185A (en) | 2019-03-06 | 2019-03-06 | A method of blue light array data reading efficiency is improved using caching technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109871185A true CN109871185A (en) | 2019-06-11 |
Family
ID=66919898
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910166997.0A Pending CN109871185A (en) | 2019-03-06 | 2019-03-06 | A method of blue light array data reading efficiency is improved using caching technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109871185A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114546276A (en) * | 2022-02-23 | 2022-05-27 | 华云数据控股集团有限公司 | High-availability data storage read-write method, system, device and equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101366011A (en) * | 2005-10-12 | 2009-02-11 | 存储器械有限公司 | Data backup devices and methods for backing up data |
| CN102576393A (en) * | 2009-05-08 | 2012-07-11 | 日立-Lg数据存储韩国公司 | Accessing, compressing, and tracking media stored in an optical disc storage system |
| CN105760255A (en) * | 2016-02-14 | 2016-07-13 | 北京艾森思科技有限公司 | RAID card configuration information backup and recovery method and device |
| CN107943420A (en) * | 2017-11-29 | 2018-04-20 | 四川九鼎智远知识产权运营有限公司 | A kind of date storage method based on mobile terminal |
| CN208422409U (en) * | 2018-05-21 | 2019-01-22 | 华录光存储研究院（大连）有限公司 | A kind of distributed document read-write system of optomagnetic fusion |
-
2019
- 2019-03-06 CN CN201910166997.0A patent/CN109871185A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101366011A (en) * | 2005-10-12 | 2009-02-11 | 存储器械有限公司 | Data backup devices and methods for backing up data |
| CN102576393A (en) * | 2009-05-08 | 2012-07-11 | 日立-Lg数据存储韩国公司 | Accessing, compressing, and tracking media stored in an optical disc storage system |
| CN105760255A (en) * | 2016-02-14 | 2016-07-13 | 北京艾森思科技有限公司 | RAID card configuration information backup and recovery method and device |
| CN107943420A (en) * | 2017-11-29 | 2018-04-20 | 四川九鼎智远知识产权运营有限公司 | A kind of date storage method based on mobile terminal |
| CN208422409U (en) * | 2018-05-21 | 2019-01-22 | 华录光存储研究院（大连）有限公司 | A kind of distributed document read-write system of optomagnetic fusion |
Non-Patent Citations (1)
| Title |
|---|
| 游丽: "基于蓝光存储的光盘存储系统的研究与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114546276A (en) * | 2022-02-23 | 2022-05-27 | 华云数据控股集团有限公司 | High-availability data storage read-write method, system, device and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104834607B (en) | A kind of hit rate for improving distributed caching and the method for reducing solid state hard disc abrasion | |
| CN103885728B (en) | A kind of disk buffering system based on solid-state disk | |
| US9449005B2 (en) | Metadata storage system and management method for cluster file system | |
| CN102521147B (en) | Management method by using rapid non-volatile medium as cache | |
| CN103577339B (en) | A kind of date storage method and system | |
| CN104035729B (en) | Block device thin-provisioning method for log mapping | |
| CN102760101B (en) | SSD-based (Solid State Disk) cache management method and system | |
| US20060010293A1 (en) | Cache for file system used in storage system | |
| CN108763508B (en) | Data page access method, storage engines and computer readable storage medium | |
| US9996557B2 (en) | Database storage system based on optical disk and method using the system | |
| CN110287044A (en) | Without lock shared drive processing method, device, electronic equipment and readable storage medium storing program for executing | |
| CN107066393A (en) | The method for improving map information density in address mapping table | |
| CN109062505A (en) | A kind of write performance optimization method under cache policy write-in layering hardware structure | |
| CN109947363A (en) | A kind of data cache method of distributed memory system | |
| CN107615254A (en) | The cache memory architectures and algorithm of blending objects storage device | |
| CN106201911A (en) | A kind of caching accelerated method based on solid state hard disc | |
| CN107391398A (en) | A kind of management method and system in flash cache area | |
| CN110532200B (en) | Memory system based on hybrid memory architecture | |
| CN110109927A (en) | Oracle database data processing method based on LSM tree | |
| CN110795363B (en) | Hot page prediction method and page scheduling method of storage medium | |
| CN109598156A (en) | Engine snapshot stream method is redirected when one kind is write | |
| CN106815152A (en) | A kind of method for optimizing page level flash translation layer (FTL) | |
| CN109739780A (en) | Dynamic secondary based on the mapping of page grade caches flash translation layer (FTL) address mapping method | |
| RU2525752C2 (en) | Method and apparatus for storing, reading and writing compound document | |
| WO2023000536A1 (en) | Data processing method and system, device, and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190611 |
|
| WD01 | Invention patent application deemed withdrawn after publication |