CN101202758A - Method for network virtual storage of multi-client terminals - Google Patents
Method for network virtual storage of multi-client terminals Download PDFInfo
- Publication number
- CN101202758A CN101202758A CNA2006101646971A CN200610164697A CN101202758A CN 101202758 A CN101202758 A CN 101202758A CN A2006101646971 A CNA2006101646971 A CN A2006101646971A CN 200610164697 A CN200610164697 A CN 200610164697A CN 101202758 A CN101202758 A CN 101202758A
- Authority
- CN
- China
- Prior art keywords
- data
- client
- cache memory
- server
- read
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Computer And Data Communications (AREA)
- Memory System Of A Hierarchy Structure (AREA)
- Information Transfer Between Computers (AREA)
Abstract
A multi-client network virtual preservation method comprises that a public data preservation area is loaded to a disk of a server and multiple data preservation areas are collocated correspondingly; a public high speed buffer memorizer is collocated for the data preservation of the public data preservation area and a special high speed buffer memorizer is collocated for the data preservation of each specific data preservation area; when a data writing operation is needed to be carried through, firstly, the relevant attributes of the data content to be written is recorded and then a data written command and the data to be written are transmitted to the server and whether the data written space of the special high speed buffer memorizer is full is judged, and the data to be written is written into the special high speed buffer memorizer according to the judged result. The method improves the data written speed of the virtual disk, reduces the disk operation time for reading the data again and realizes to speed up the network virtual preservation of a plurality of clients. Besides, the method realizes the optimization on the network virtual preservation of a plurality of clients.
Description
Technical field
The present invention relates to a kind of method for network virtual storage, relate in particular to a kind of by in the network virtual storage system public distinguish with the dedicated data stores zone and corresponding increases simultaneously public with dedicated cache memory (Cache), and then the network virtual storage of a plurality of client datas is realized the method for network virtual storage of the multi-client of acceleration and optimization.
Background technology
Now, along with improving constantly of network transmission speed, Network storage technology has obtained increasing approval, NAS (Network Attached Storage, network attached storage) and SAN (storage area network, Storage AreaNetwork) system to use more and more widely be exactly best illustration.The network storage has the cost of saving, disposes plurality of advantages such as simple, that operation maintenance is convenient.At present, Network storage technology is just developed towards virtualized direction by original single storage, and " virtual memory " become one of the most popular topic in present technique field.Virtual memory technique is presented to the end user pellucidly with storage area, and its realization details is finished at bottom all.Be the professional knowledge that developer or general usability user need not to grasp the network storage, also more needn't know concrete storage composition.Just because of this reason, the network virtual storage has obtained increasing welcome.
Traditional network virtual memory technology adopts man-to-man mode, i.e. a certain memory space on client corresponding with service device, and any data read-write operation of client all is to finish at the proprietary memory space of self.So, under the more situation of client terminal quantity, can cause disposing difficulty, maintenance workload is big, particularly can cause a large amount of wastes of memory space, and when client is more, if dispose one to one and maintenance can bring huge workload to traditional diskless system.
In addition, according to principle of locality, the reading and writing data program is always visited one section continuous local space in a period of time in carrying out the read-write operation process.A plurality of clients of carrying out similar reading and writing data task will constantly read identical data from server like this, thereby strengthen taking system disk.And, because the disk writing speed is generally slower, when many clients are carried out data write operation to virtual disk simultaneously, will inevitably cause part operation to wait as long for, the average speed of whole system operation and storage is corresponding slack-off.
Summary of the invention
In order to solve problem and the defective in the above-mentioned conventional art, the object of the present invention is to provide a kind of method for network virtual storage of multi-client, in order in having the Local Area Network virtual storage system of a server and a plurality of clients, to realize acceleration and optimization to the network virtual storage of a plurality of client datas.
The method for network virtual storage of a kind of multi-client provided by the present invention comprises following steps:
After the system start-up, server is loaded on a common data storage area territory on the disk of server according to using configuration, simultaneously, on the disk of server according to a plurality of dedicated data stores of the dynamically corresponding configuration of the quantity zone of client; Server is the corresponding configuration of a storage public cache memory (Cache) in common data storage area territory, and is respectively the corresponding configuration of a storage dedicated cache memory (Cache) in each dedicated data stores zone; When a client need be carried out data write operation, at first the association attributes of record data content to be written in the concordance list of this locality write all data instruction and data to be written then and sends to server by network; And server receive data write the instruction and data to be written after, whether the data of the dedicated cache memory of real-time judge client write the space full, if less than, then data to be written are write in the dedicated cache memory and all write in the dedicated cache memory until data to be written; If it is full, then the data content in the dedicated cache memory is displaced data to be written to be write in the dedicated cache memory after the part again and all write in the dedicated cache memory until data to be written by input and output on the server (Input/Output, be called for short I/O) controller.
In addition, the method for network virtual storage of a kind of multi-client provided by the present invention also comprises following steps:
After the data to be written of client have write in the dedicated cache memory, the input and output of server (I/O) controller will be coordinated to control the data that write in the dedicated cache memory and really be written in the entity disk of server, and the data that write in the dedicated cache memory of control can not be displaced to outside the dedicated cache memory in the given time, to satisfy data read demand in a short time.Client just thinks that after all data write cache memory write operation finishes.
In addition, the method for network virtual storage of a kind of multi-client provided by the present invention also further comprises following steps:
When client need be carried out data read operation, at first in the concordance list of this locality, search to determine whether data to be read are public data, when data content to be read was present in the concordance list, data then to be read were exclusive data, otherwise were public data; User end to server sends the data read instruction; Server is judged the data type that client need read after receiving the data read instruction; When the data that need read when client are public data, server is at first searched and is judged whether data to be read are stored in the public cache memory, if, direct reading of data and return to client from public cache memory then, otherwise reading of data and being stored in the public cache memory from the common data storage area territory, and then return to client; And the data that need read when client are when being exclusive data, server is at first searched and is judged whether data to be read are stored in the dedicated cache memory, if, direct reading of data and return to client from dedicated cache memory then, otherwise reading of data and being stored in the dedicated cache memory from the dedicated data stores zone, and then return to client.
In sum, the invention has the advantages that:
1, a plurality of clients are shared same disk mirroring in the method for the present invention, therefore can finish the deployment and the switching of network virtual storage system fast.
2, be example with the diskless system: suppose to have 100 clients, the system data of each client all will be stored on the server, if each FTP client FTP self need use the disk space of 2.5GB, and the data volume that need rewrite when wherein 0.5GB is for execution.If in the employing conventional art client and disk mirroring one to one mode need altogether: the disk space of 100 * 2.5=250GB, differentiation in the method for the present invention is public to be needed altogether with the mode dedicated data stores zone and adopt: the disk space of 2+100 * 0.5=52GB, wherein saved the disk space of (250-52) ÷ 250=79.2% altogether, therefore adopt method of the present invention effectively to reduce the required data space of FTP client FTP, saved hardware disk space and maintenance cost thereof in a whole set of storage system.
3, because method of the present invention can be loaded on a common data storage area territory on the server according to using configuration, and be the corresponding configuration of the storage public cache memory (Cache) in common data storage area territory, therefore, not only satisfied parallel the read demand of a plurality of clients to public data, and by public cache memory, only need disposable data read be come in, because the data read operation of each client executing is closely similar, then the hit rate that reads of follow-up data will improve greatly, and then the reading speed of public data brought up to the data reading speed that approaches internal storage, improved visit and the reading speed of client greatly to public data.
4, simultaneously, because method of the present invention can be according to a plurality of dedicated data stores of the dynamically corresponding configuration of the quantity zone of client, and the corresponding configure dedicated cache memory (Cache) of the storage that is respectively each dedicated data stores zone, therefore, can the exclusive data that client reads and writes be cushioned, reduced the stand-by period of single client, accelerated data write speed simultaneously and reduced disk operating time and the period of reservation of number of reading once more after data write.Whole system is write fast the average latency of then having reduced the client write operation.
5, because adopting, method of the present invention reads the data acess method that difference is write together, different clients all can change corresponding separately dedicated data stores zone over to the data rewriting request in common data storage area territory, original like this public data all the time can be not destroyed, avoided the data error problem that the different clients write-then-read occurs in the conventional art, and then not the disturbing mutually of exclusive data that had not only guaranteed the safe and reliable of public data but also guaranteed each client.
Description of drawings
Fig. 1 is the system block diagram of the system that method for network virtual storage moved of a kind of multi-client of the present invention;
Fig. 2 is the method flow diagram of the method for network virtual storage of a kind of multi-client of the present invention; And
Fig. 3 is the method flow diagram when client is carried out data read operation in the method for network virtual storage of a kind of multi-client of the present invention.
Main description of reference numerals:
10 servers
20 clients
30 common data storage area territories
40 dedicated data stores zones
50 public cache memories
60 dedicated cache memories
70 concordance lists
Step 100 server is loaded on a common data storage area territory on the server according to using configuration, simultaneously according to the dynamically corresponding a plurality of dedicated data stores zone that disposes of the quantity of client
Step 101 is public cache memory of stored configuration of public data, and is respectively dedicated cache memory of the corresponding configuration of storage of each client exclusive data
Step 102 writes down the association attributes of data content to be written in concordance list
Data are write instruction to step 103 and data to be written send to server
Step 104 judges whether the data of dedicated cache memory write the space full
Step 105 displaces a part with the data content in the dedicated cache memory
Step 106 writes data to be written in the dedicated cache memory
Step 107 judges whether data to be written have all write dedicated cache memory
Step 108 is coordinated to control the data that write and is written in the entity disk of server, and the data that control has write are not displaced to outside the dedicated cache memory in the given time
Embodiment
Below, will elaborate to better embodiment of the present invention in conjunction with the accompanying drawings.
Please refer to Fig. 1 and Fig. 2, Fig. 1 is the system block diagram of the system that method for network virtual storage moved of a kind of multi-client of the present invention.Fig. 2 is the method flow diagram of the method for network virtual storage of a kind of multi-client of the present invention, as shown in Figures 1 and 2, the method for network virtual storage of a kind of multi-client of the present invention, in order to realize that in Local Area Network virtual storage system the method comprises following steps to the acceleration and the optimization of the network virtual storage of a plurality of client datas with a server 10 and a plurality of client 20:
After the system start-up, in step 100, server 10 is loaded on a common data storage area territory 30 on the disk of server 10 according to using configuration, simultaneously, on the disk of server 10 according to a plurality of dedicated data stores of the dynamically corresponding configuration of the quantity zone 40 of client 20;
In step 101, server 10 is public cache memory 50 of the corresponding configuration of the storage in common data storage area territory 30, and is respectively a dedicated cache memory 60 of the corresponding configuration of storage in each dedicated data stores zone 40;
When client 20 need be carried out data write operation, at first in step 102, the association attributes of record data content to be written is searched when reading in the future in the concordance list 70 of this locality, all data is write instruction and data to be written send to server 10 by network in step 103 then;
After server 10 receives that data write instruction and data to be written, in step 104, whether the data of the dedicated cache memory 60 of real-time judge client 20 write the space full, if less than, then in step 106 data to be written are write in the dedicated cache memory 60, execution in step 107 then; If full, then after step 105 displaced a part with the data content in the dedicated cache memory 60 earlier by input and output (I/O) controller (not shown in the accompanying drawing) on the server 10, execution in step 106 again;
Whether the data to be written of judging client 20 in step 107 have all write in the dedicated cache memory 60, if, then execution in step 108, otherwise return step 104, wherein after all data to be written all write and are stored in the dedicated cache memory 60, client thinks that promptly data write operation finishes, and then in the middle of other the work of treatment that can enter himself;
After the data to be written of client 20 have all write in the dedicated cache memory 60, in step 108, the input and output of server 10 (I/O) controller will be coordinated to control the data that will write in the dedicated cache memory 60 and really be written in the entity disk of server 10, and the data that control has write in the dedicated cache memory 60 can not be displaced to outside the dedicated cache memory 60 in the given time, therefore, when corresponding client 20 will read the data that just write soon, can directly get final product by reading in the dedicated cache memory 60, save the operating time of reading by disk again, accelerated the reading speed of data to a certain extent.
In the method for network virtual storage of a kind of multi-client of the invention described above, because the writing speed of cache memory is higher than actual entity hard disk far away, so client has been equivalent to use the higher hard disk of writing speed, thereby improved writing speed, when one first client will write data, might one second client in disk, write data in addition, add behind the cache memory first client and need not only need write data in its dedicated cache memory 60 and get final product with other client shared disk equipment.And when the data that write in the dedicated cache memory for each client can be written in the entity disk of server veritably, then can carry out follow-up Coordination Treatment by input and output (I/O) controller of server, do not repeat them here.
Please refer to Fig. 3 now, Fig. 3 is the method flow diagram when client is carried out data read operation in the method for network virtual storage of a kind of multi-client of the invention described above, as Fig. 1 and shown in Figure 3, the method for network virtual storage of a kind of multi-client of the present invention can further comprise following steps:
When a client 20 need be carried out data read operation, at first in step 200, in the concordance list 70 of this locality, search to determine whether data to be read are public data, when data content to be read is present in the concordance list 70, prove that then data to be read once were modified, be exclusive data, otherwise be public data;
In step 201, client 20 sends the data read instruction to server 10;
In step 202, server 10 judges whether the data type that client 20 need read is public data after receiving the data read instruction;
When the data that need read when client 20 are public data, server 10 is at first searched in step 203 and is judged whether data to be read are stored in the public cache memory 50, if, then in step 205 direct reading of data from public cache memory 50, in step 209 data that read are returned to client 20 then, if do not store data to be read in the public cache memory 50, then in step 206 reading of data and being stored in the public cache memory 50 from common data storage area territory 30, and then the data that read are returned to client 20 in step 209, because for identical application demand, in same operating time section, to read a large amount of identical data contents usually, if be placed in the common data storage area territory 30 (being public disk space) then need disk is carried out repeatedly read operation, so just limited the acquisition speed of data, and adopt the mode of the public cache memory in the method for the present invention, only need disposable data read be come in, because the data read operation that each client 20 will be carried out is closely similar, then the hit rate that reads of follow-up data will improve greatly, thereby the reading speed of public data is brought up to the data reading speed that approaches internal storage, and the big more then data reading speed of public cache memory is fast more;
Then similar when reading public data for the steps flow chart that reads exclusive data, when the data that need read when client 20 are exclusive data, server 10 is at first searched in step 204 and is judged whether data to be read are stored in the dedicated cache memory 60, if, then in step 207 direct reading of data from dedicated cache memory 60, in step 209 data that read are returned to client 20 then, if do not store data to be read in the dedicated cache memory 60, then in reading of data from step 208 dedicated data stores zone 40 and be stored in the dedicated cache memory 60, and then the data that read are returned to client 20 in step 209.
The method for network virtual storage of a kind of multi-client of the invention described above, carry out in the process of data read operation in client, also can and read in addition record of situation in visit and when reading data in the cache memory, and choose the data of storing in the cache memory by input and output (I/O) controller of server according to visit of being write down and reading frequency and change to the operation that swaps out to increase client directly found and read desired data in cache memory hit rate according to the concrete visit of different pieces of information.
Though the present invention discloses as above with aforesaid better embodiment, yet it is not in order to limit the present invention.Those skilled in the art should recognize that change and the modification carried out all belong within the scope of patent protection of the present invention under the situation that does not break away from the scope and spirit of the present invention that claims scope of the present invention disclosed.Please refer to claims about protection scope of the present invention.
Claims (4)
1. the method for network virtual storage of a multi-client, in order to realize that in having the Local Area Network virtual storage system of a server and a plurality of clients the method includes the steps of to the acceleration and the optimization of the network virtual storage of a plurality of client datas:
After the system start-up, this server is loaded on a common data storage area territory on the disk of this server according to using configuration, simultaneously, and a plurality of dedicated data stores of the dynamically corresponding configuration of the quantity of the described client of foundation zone on the disk of this server;
This server is the corresponding configuration of the storage one public cache memory in common data storage area territory, and is respectively the corresponding configuration of storage one dedicated cache memory in described each dedicated data stores zone;
When a client need be carried out data write operation, at first the association attributes of record data content to be written in a concordance list of this locality write all data instruction and data to be written then and sends to this server by network; And
After this server receives that these data write instruction and data to be written, whether the data of the dedicated cache memory of this client of real-time judge write the space full, if less than, then should data to be written write in this dedicated cache memory and all write in this dedicated cache memory until these data to be written; If full, then the data content in this dedicated cache memory displaced after the part should data to be written to write in this dedicated cache memory again and all write in this dedicated cache memory until these data to be written by an IOC of this server.
2. method for network virtual storage as claimed in claim 1 wherein further comprises following steps:
After the data to be written of this client have write in this dedicated cache memory, the IOC of this server will be coordinated these data that write in the dedicated cache memory of control and really be written in the entity disk of this server, and control these data that write in the dedicated cache memory and can not be displaced to outside this dedicated cache memory in the given time.
3. method for network virtual storage as claimed in claim 1 wherein further comprises following steps:
When a client need be carried out data read operation, at first in this local concordance list, search to determine whether these data to be read are public data, when this data content to be read is present in this concordance list, then these data to be read are exclusive data, otherwise are public data;
This client sends the data read instruction to this server;
This server is judged the data type that this client need read after receiving this data read instruction; And
When the data that need read when this client are public data, this server is at first searched and is judged whether these data to be read are stored in this public cache memory, if, then from this public cache memory, directly read these data and return to this client, otherwise from this common data storage area territory, read these data and be stored in this public cache memory, and then return to this client.
4. method for network virtual storage as claimed in claim 3 wherein further comprises following steps:
When the data that need read when this client are exclusive data, this server is at first searched and is judged whether these data to be read are stored in this dedicated cache memory, if, then from this dedicated cache memory, directly read these data and return to this client, otherwise from this dedicated data stores zone, read these data and be stored in this dedicated cache memory, and then return to this client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006101646971A CN101202758B (en) | 2006-12-14 | 2006-12-14 | Method for network virtual storage of multi-client terminals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006101646971A CN101202758B (en) | 2006-12-14 | 2006-12-14 | Method for network virtual storage of multi-client terminals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101202758A true CN101202758A (en) | 2008-06-18 |
| CN101202758B CN101202758B (en) | 2010-08-25 |
Family
ID=39517718
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006101646971A Active CN101202758B (en) | 2006-12-14 | 2006-12-14 | Method for network virtual storage of multi-client terminals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101202758B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106331148A (en) * | 2016-09-14 | 2017-01-11 | 郑州云海信息技术有限公司 | Cache management method and cache management device for data reading by clients |
| CN108446399A (en) * | 2018-03-29 | 2018-08-24 | 重庆大学 | A kind of dynamic memory optimization method of structuring magnanimity real time data |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6453404B1 (en) * | 1999-05-27 | 2002-09-17 | Microsoft Corporation | Distributed data cache with memory allocation model |
| CN1308838C (en) * | 2002-12-09 | 2007-04-04 | 联想(北京)有限公司 | Method of utilizing virtual equipment file system in expanding memory capacity of movable device |
| CN100458744C (en) * | 2004-05-11 | 2009-02-04 | 深圳市朗科科技股份有限公司 | Method and device for remote storing data |
| CN100377065C (en) * | 2006-04-19 | 2008-03-26 | 华中科技大学 | Super large capacity virtual magnetic disk storage system |
-
2006
- 2006-12-14 CN CN2006101646971A patent/CN101202758B/en active Active
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106331148A (en) * | 2016-09-14 | 2017-01-11 | 郑州云海信息技术有限公司 | Cache management method and cache management device for data reading by clients |
| CN108446399A (en) * | 2018-03-29 | 2018-08-24 | 重庆大学 | A kind of dynamic memory optimization method of structuring magnanimity real time data |
| CN108446399B (en) * | 2018-03-29 | 2021-07-30 | 重庆大学 | Dynamic storage optimization method for structured massive real-time data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101202758B (en) | 2010-08-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7996642B1 (en) | Digital locked loop on channel tagged memory requests for memory optimization | |
| CN100371886C (en) | Memory region based data pre-fetching | |
| US4476526A (en) | Cache buffered memory subsystem | |
| US8032724B1 (en) | Demand-driven opportunistic garbage collection in memory components | |
| CN100362462C (en) | Method for managing magnetic disk array buffer storage | |
| CN104850358B (en) | A kind of magneto-optic electricity mixing storage system and its data acquisition and storage method | |
| CN102609360A (en) | Data processing method, data processing device and data processing system | |
| US9053019B2 (en) | Non-volatile memory device, a data processing device using the same, and a swapping method used by the data processing and non-volatile memory devices | |
| US11188262B2 (en) | Memory system including a nonvolatile memory and a volatile memory, and processing method using the memory system | |
| CN103186350A (en) | Hybrid storage system and hot spot data block migration method | |
| JPH03218514A (en) | Method of optimizing size of i/o buffer and computer apparatus with optimized i/o buffer | |
| CN1312590C (en) | Mass storage caching processes for power reduction | |
| CN101135952B (en) | Using an access log for disk drive transactions | |
| WO2016115957A1 (en) | Method and device for accelerating computers and intelligent devices for users and applications | |
| US20210271640A1 (en) | File loading method and apparatus, electronic device, and storage medium | |
| CN107888687B (en) | Proxy client storage acceleration method and system based on distributed storage system | |
| EP2293195A2 (en) | Memory drive that can be operated like optical disk drive and method for virtualizing memory drive as optical disk drive | |
| KR20170002866A (en) | Adaptive Cache Management Method according to the Access Chracteristics of the User Application in a Distributed Environment | |
| Son et al. | Optimizing I/O operations in file systems for fast storage devices | |
| CN103365926A (en) | Method and device for storing snapshot in file system | |
| CN113835614A (en) | SSD intelligent caching method and system based on distributed file storage client | |
| CN101853218B (en) | Method and system for reading redundant array of inexpensive disks (RAID) | |
| CN103177080A (en) | File pre-reading method and file pre-reading device | |
| CN109375868B (en) | Data storage method, scheduling device, system, equipment and storage medium | |
| CN101202758B (en) | Method for network virtual storage of multi-client terminals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right |
Owner name: I VALLEY HOLDINGS CO., LTD. Free format text: FORMER OWNER: YINGYEDA CO., LTD., TAIWAN Effective date: 20150730 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20150730 Address after: Cayman Islands, George Town Patentee after: IValley Holding Co., Ltd. Address before: Taipei City, Taiwan, China Patentee before: Inventec Corporation |