CN101453489B - Network additive storage device, data backup and data restoration method thereof - Google Patents
Network additive storage device, data backup and data restoration method thereof Download PDFInfo
- Publication number
- CN101453489B CN101453489B CN 200810204752 CN200810204752A CN101453489B CN 101453489 B CN101453489 B CN 101453489B CN 200810204752 CN200810204752 CN 200810204752 CN 200810204752 A CN200810204752 A CN 200810204752A CN 101453489 B CN101453489 B CN 101453489B
- Authority
- CN
- China
- Prior art keywords
- data
- memory cell
- formation
- synchrodata
- length
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
The invention discloses a network additional storage device, which comprises: a network interface, an NAS controller, a data processing unit, a data shared storage unit and a data backup storage unit, wherein the network interface is used for realizing data transmission in the network; the NAS controller is used for providing transmission control function of each data application, and receiving user data transmitted by the network interface; the data processing unit is used for storing user data received from the NAS controller in the shared storage unit, and synchronizing the user data to the data backup storage unit; the data shared storage unit is used for the shared storage of the user data by using high-speed magnetic disk media; and the data backup storage unit is used for the backup storage of the user data by using low-speed magnetic disk media. The data backup is realized inside the network additional storage device by using the low-speed magnetic disk media without the network transmission, thereby realizing low energy consumption, low cost and low occupation of network resources simultaneously. The invention also discloses a method for the data backup and the data recovery of the network additional storage device.
Description
Technical field
The present invention relates to the network attached storage technical field, particularly a kind of network additive storage device and data backup and data reconstruction method.
Background technology
Network attached storage (NAS; Network Attached Storage) is a kind of emerging network storage solutions; In the NAS storage organization, storage system no longer is attached to certain server or client computer through the I/O bus, and directly directly links to each other with network through network interface; Subscriber's main station can be through general internet file system (CIFS; Common Internet File System), NFS procotols such as (NFS, Net File System) directly visits the NAS device, and the data of wherein storage are carried out read-write operation.The NAS device is actually a memory device that has thin server, and its effect is similar to the file server of a special use.This specific store server has removed the original inapplicable most of computing functions of generic server, and file system function only is provided, and generally is used for institutional data networks such as government, school, enterprise and shares.
Fig. 1 is the structural representation of existing NAS device, and as shown in Figure 1, this device comprises:
Network interface is used to connect network, realizes the transmission of data in network.
The NAS controller links to each other with network interface, is used to provide the transmission controlled function of various data application, like FTP service, file-sharing service, streaming media on demand service etc.
Storage medium links to each other with the NAS controller, is used for the storage of data, can adopt any storage medium, like disk or tape etc.
Because the higher memory property of data sharing application need; Generally; Use hyperdisk based on system for serial small computer interface (SAS) or small computer system interface (SCSI) as storage medium among the NAS; This storage medium has advantages such as high-performance, high reliability, and the suitable data sharing class of frequent read-write that needs is used.
The NAS storage system is owing to reasons such as storage medium or misoperations; The shared data that is kept on the NAS device may face the risk of losing; Therefore, generally all need be NAS device configuration one cover standby system, through network with the data sync in the NAS device in standby system.Generally speaking, can use based on the standby system of the low speed disk of walking Advanced Technology Attachment (SATA) or Integrated Device Electronics (IDE) interface as storage medium.With respect to the SAS of 15000 commentaries on classics or the hyperdisk of scsi interface; The rotating speed of SATA or ide interface low speed disk is commonly 7200 to be changeed or 5400 commentaries on classics; Its energy consumption and unit capacity cost are all much lower than the hyperdisk of SAS or scsi interface, therefore are suitable for for the not too responsive data backup application of performance.
Though for the NAS device is provided with a sets of data standby system, can effectively improve the Information Security of NAS system, and cost is lower separately; But because in the data backup process, standby system need obtain the user data that needs backup from the NAS device, these data all will be transmitted through network; So when the user uses NAS device shared data; User data at first will be transferred in the NAS device, from the NAS device, is transferred in the standby system again, need carry out two data transfer like this and could accomplish data backup; Taken a large amount of Internet resources, the performance of sharing for whole network data all can have a negative impact.
In addition; Can also realize data backup through in same NAS device, using raid-array (RAID) or snapping technique (SnapShot) at present, thereby need not to take limited Internet resources, still; RAID Technology Need master's medium and backup medium are just the same; Therefore can't realize different characteristics, use different storage mediums, and be generally guaranteed performance according to data sharing and data backup; All need use hyperdisk as storage medium, thereby the whole cost of NAS device and energy resource consumption are improved.The SnapShot snapping technique then is the redundancy technique that is used for single medium, and shared data and Backup Data are kept on the same medium, is mainly used in the logic error when preventing to store; If this media damage, data can't be recovered, and the fail safe of its backup is unsatisfactory; Be not suitable for the data backup of big data quantity; Simultaneously, because shared data and Backup Data are present in same medium, therefore exist too and identical cost and the high problem of energy consumption of RAID technology.
Therefore also there is not at present a kind of NAS data backup scenario that can take into account low energy expenditure, low cost and low resource occupying.
Summary of the invention
The embodiment of the invention provides a kind of network additive storage device, can realize the data backup of low energy consumption, low cost and low resource occupying simultaneously.
The embodiment of the invention provides a kind of data back up method of network additive storage device, is used for the network additive storage device that the embodiment of the invention provides, and can realize the data backup of low energy consumption, low cost and low resource occupying simultaneously.
The embodiment of the invention provides a kind of data reconstruction method of network additive storage device, is used for the network additive storage device that the embodiment of the invention provides, and can realize simultaneously that the data of low energy consumption, low cost and low resource occupying are recovered.
For achieving the above object, technical scheme of the present invention specifically is achieved in that
A kind of network additive storage device, this device comprises:
Network interface is used to connect network, realizes the transmission of data in network;
The NAS controller links to each other with network interface, is used to provide the transmission controlled function of various data application, receives the user data that transmits through network interface;
Data processing unit; Link to each other respectively with the data backup memory cell with NAS controller and data sharing memory cell; The storage of subscriber data that is used for receiving from said NAS controller is to the process of said shared memory cell, with user data synchronization to said data backup memory cell;
The data sharing memory cell links to each other with data processing unit, is used for sharing storaging user data, adopts the hyperdisk medium;
The data backup memory cell links to each other with data processing unit, is used for the back-up storage user data, adopts the low speed magnetic disk media.
A kind of data back up method that is used for above-mentioned network additive storage device, this method comprises:
Receiving subscriber data from network;
In process with said storage of subscriber data inner data sharing memory cell to network additive storage device, through internal interface with user data synchronization to the inner data backup memory cell of network additive storage device.
A kind of data reconstruction method that is used for above-mentioned network additive storage device is characterized in that, this method comprises:
According to the data restore instruction that receives, from the data backup memory cell, reading needs data recovered and sends to user or the data sharing memory cell that needs restore data;
Rebuild instruction according to the backup that receives, the formatted data redundant memory cell, the ergodic data shared memory cell is obtained all sharing users data, and is synchronized to the data backup memory cell after the format one by one.
Visible by above-mentioned technical scheme; This network additive storage device of the present invention and data backup and restoration methods; Through having realized data backup in network additive storage device inside; Need not through Network Transmission, and data backup uses the low speed magnetic disk media, therefore realized the data backup and the data recovery of low energy consumption, low cost and low resource occupying simultaneously.
Description of drawings
Fig. 1 is the structural representation of existing NAS device;
Fig. 2 is the NAS apparatus structure sketch map of the embodiment of the invention;
Fig. 3 is the data processing unit structural representation of first embodiment of the invention;
Fig. 4 is the data processing unit structural representation of second embodiment of the invention;
Fig. 5 is the data conversion module structural representation of the embodiment of the invention;
Fig. 6 is the data processing unit structural representation of third embodiment of the invention;
Fig. 7 is the data back up method flow chart of the network additive storage device of the embodiment of the invention;
Fig. 8 is with the particular flow sheet of user data synchronization to the data backup memory cell in the embodiment of the invention;
Fig. 9 is with the particular flow sheet of user data synchronization to the data backup memory cell in another embodiment of the present invention;
Figure 10 is the synchrodata queue structure sketch map of the embodiment of the invention;
Figure 11 is for returning to the data object in the synchronous documents formation in the embodiment of the invention flow chart of synchrodata formation.
Embodiment
For making the object of the invention, technical scheme and advantage clearer, below with reference to the accompanying drawing embodiment that develops simultaneously, to further explain of the present invention.
The present invention is divided into independently data sharing memory cell and data backup memory cell with the storage medium in the NAS device, and the data sharing memory cell adopts hyperdisk as storage medium, with the performance that guarantees that data sharing is used; The data backup memory cell adopts the low speed disk as storage medium, to reduce the whole energy consumption and the cost of NAS device; Increase by a data process unit simultaneously; Connect data shared memory cell and data backup memory cell; Be used for the data sync in the data sharing memory cell being arrived the data backup memory cell, avoid taking the Internet resources backup data transmitting in NAS device inside.
Fig. 2 is the NAS apparatus structure sketch map of the embodiment of the invention, and as shown in Figure 2, this device comprises:
NAS controller 202 links to each other with network interface 201, is used to provide the transmission controlled function of various data application, receives the user data that transmits through network interface.
The function that the NAS controller is realized is existing mature technology, has just no longer detailed here.
Data sharing memory cell 204 links to each other with data processing unit 203, is used for sharing storaging user data, supplies the subscriber's main station visit and uses the data of sharing.For guaranteeing the data sharing performance, can adopt the hyperdisk medium that speed is fast, power consumption is big, unit cost is high, like the disk of SAS interface or scsi interface.
Data backup memory cell 205 links to each other with data processing unit 203, is used for the back-up storage user data, supplies subscriber's main station to recover or data sharing memory cell restore data.Therefore data backup need not higher readwrite performance, can adopt that unit cost is low, power saving, slow-footed low speed magnetic disk media, to reduce the energy consumption and the cost of NAS device, like the disk of SATA or ide interface.
After user data arrives the NAS device through Network Transmission; After the parsing and identification through network interface 201 and NAS controller 202; Via data processing unit 203; To data sharing memory cell 204, simultaneously, the user data backup that data processing unit 203 can adopt synchronization replication or asynchronous replication mode will be synchronized to data sharing memory cell 204 automatically arrives data backup memory cell 205 with user data synchronization.
Fig. 3 is the data processing unit structural representation of first embodiment of the invention, and as shown in Figure 3, data processing unit specifically comprises:
Data simultaneous module 304 links to each other with said data queue module 303, be used for regularly taking out data object from said synchrodata formation module 303 according to queue sequence, and with synchronization of data objects to said data backup memory cell 205.
In the embodiment of the invention; The concrete formation of synchrodata formation can be referring to Figure 10; Figure 10 is the synchrodata queue structure sketch map of the embodiment of the invention, and is shown in figure 10, arranging a plurality of data in buffer objects in the synchrodata formation; Data object is the user data information of data processing unit buffer memory in synchronizing process, and each data object all comprises filename, data block displacement, data block length and the data of the user data content information of determining.Wherein, the data block displacement is meant this data block absolute position hereof, and data block contents is concrete user data content, and data block length is mainly used in checking data.Certainly, specifically how to carry out formation and convert user data to which type of data object, all comprise in the data object being decided according to the actual requirements which information, comprise all required information of data backup in the data object as long as guarantee.User data is converted into data object and carries out the formation buffer memory, in the time of can avoiding carrying out data backup, read file from the data sharing memory cell once more, improve the performance of whole NAS device greatly.
Fig. 4 is the data processing unit structural representation of second embodiment of the invention; As shown in Figure 4; This data processing unit except that comprise with first embodiment in identical data sharing module 401, data conversion module 402, synchrodata formation module 403 and the data simultaneous module 404, also further comprise:
Synchronous documents formation module 405 links to each other with said data conversion module 402, is used for the data object that buffer memory discharges data block contents, forms the synchronous documents formation;
Said data conversion module 402 was further used for before data object being sent to said synchrodata formation module 403, judged whether the buffer memory capacity that the synchrodata formation of buffer memory in the said synchrodata formation module 403 takies reaches preset threshold value;
If the buffer memory capacity that the synchrodata formation of buffer memory takies in the said synchrodata formation module 403 reaches preset threshold value, then data object is sent to synchronous documents formation module 405, and the data block contents in the release data object; Otherwise normally send to synchrodata formation module 403.
If the buffer memory capacity that the synchrodata formation of buffer memory takies in the said synchrodata formation module 403 returns to below the preset threshold value; And the synchronous documents formation of buffer memory is not empty in the said synchronous documents formation module 405; Then according to subscriber data file name, data block displacement and data block length in the said data object that discharges data block contents; Read block content from said data sharing memory cell 204 reverts to complete data object and sends to institute and counts synchrodata formation module 403.
In the present embodiment, the structure of synchronous documents formation is similar with the synchrodata formation shown in Figure 10, just no longer comprises data block contents in the data object.
Increasing synchronous documents formation module is in order to reduce the capacity of the buffer memory that need take when backing up; Because the data backup memory cell adopts the storage medium of low performance; And the data sharing memory cell adopts high performance storage medium; Cause the processing speed of data sharing memory cell can be superior to the data backup memory cell, therefore may the buffer memory mass data in backup procedure and cause buffer memory not enough.Through the data block contents in the data object is partly discharged, can save a large amount of spatial caches, wait when vacating enough spatial caches, read this data block contents from the shared data memory cell again and get final product.
In addition, data sync formation module and data file formation module can use same memory to realize buffer memory, perhaps use independently memory respectively.
Fig. 5 is the data conversion module structural representation of the embodiment of the invention, and as shown in Figure 5, data conversion module specifically comprises:
Data decomposition submodule 501 links to each other with said data sharing module 401, is used for the user data that surpasses preset data length is decomposed into a plurality of continuous data block, and the data length of each decomposed data piece is all less than preset data length;
Data object generates submodule 502; Link to each other with said data decomposition submodule 501; Be used to write down filename, data block displacement, data block length and the data block contents of decomposed data piece, filename, data block displacement, data block length and the data block contents of each decomposed data piece are formed a data object; Data length is then directly converted into data object less than the user data of preset data length, and at this moment, the data block displacement in the data object is 0, and data block length is the length of complete user data, and data block contents is complete user data content.
The data that user data is decomposed into fritter can reduce the data volume of single data sync, reduce the issuable risk of the big file of backup, and reduce the required buffer memory capacity of data queue.Certainly, if enough buffer memory capacity are arranged, can user data not decomposed yet.
Fig. 6 is the data processing unit structural representation of third embodiment of the invention; As shown in Figure 6; This data processing unit also further comprises except that comprising the data sharing module 601 identical with second embodiment, data conversion module 602, synchrodata formation module 603, data simultaneous module 604, synchronous documents formation module 605:
Said data conversion module 602 further links to each other with said data recovery module 606, is data object with said sharing users data transaction, and is sent to data queue's module 603.
Certainly, comprise further that on the basis of first embodiment data recovery module also is fine, implementation is similar, has just no longer detailed here.
Through data recovery module, the NAS device can be realized the function that data are recovered, and after the data in the subscriber's main station in the network suffered damage, the data that can from backup data storage unit, recover to lose were to subscriber's main station; After the data in the shared data memory cell suffered partially or completely to damage, the some or all data that can from backup data storage unit, recover to lose were to the shared data memory cell; After the data in the backup data storage unit suffer to damage fully, also can from the shared data memory cell, back up all data again to backup data storage unit.
The data back up method of the network additive storage device of the embodiment of the invention will be specifically introduced below, the NAS device described in the embodiment of the invention can be used for.
Fig. 7 is the data back up method flow chart of the network additive storage device of the embodiment of the invention, and is as shown in the figure, and this method comprises:
Storage of subscriber data is carried out to the process of data backup memory cell to the process of data sharing memory cell with user data synchronization simultaneously, is a kind of asynchronous and synchronous mode, is independent of each other between mutually.Internal interface is not meant and carries out transfer of data through network interface; But directly use the inner interface of NAS device to carry out transfer of data; Specifically be that which kind of internal interface can be decided according to concrete needs, the embodiment of the invention is the type of restricted internal interface not.
Wherein, can be referring to Fig. 8 with user data synchronization to the concrete grammar of said data backup memory cell, Fig. 8 is in the embodiment of the invention that user data synchronization is as shown in Figure 8 to the particular flow sheet of data backup memory cell, this flow process comprises:
Step 801 converts user data into data object;
Step 802 is added said data object to the synchrodata formation;
Step 803 is regularly taken out data object according to queue sequence from the synchrodata formation, and synchronization of data objects is arrived said data backup memory cell.
Wherein, When converting user data into data object; Can the user data that surpass preset data length be decomposed into a plurality of continuous data block; The data length that each decomposed data is determined is all less than preset data length, and filename, data block displacement, data block length and the data block contents of record decomposed data piece are formed a data object with filename, data block displacement, data block length and the data block contents of each decomposed data piece; The user data of data length less than preset data length do not decomposed; Directly convert data object into, at this moment, the data block displacement in the data object is 0; Data block length is the length of complete user data, and data block contents is complete user data content.In addition, as long as enough buffer memory capacity are arranged, can the bigger subscriber data file of buffer memory, can user data not decomposed yet.
Fig. 9 is with the particular flow sheet of user data synchronization to the data backup memory cell in another embodiment of the present invention; As shown in Figure 9; Buffer memory capacity demand when data being backed up for further minimizing; Can be again user data be converted into after the data object, data object is added to before the synchrodata formation, judge further whether the buffer memory capacity that said synchrodata formation takies reaches preset threshold value; If the buffer memory capacity that said synchrodata formation takies has reached preset threshold value, then data object is added the synchronous documents formation, and the data block contents in the release data object; If the buffer memory capacity that said synchrodata formation takies does not reach preset threshold value, then add data object to the synchrodata formation.
Concrete steps are following:
Step 901 converts user data into data object;
Step 902 judges whether the buffer memory capacity that said synchrodata formation takies reaches preset threshold value; If, execution in step 904, otherwise execution in step 903.
Step 903 is added data object to the synchrodata formation.
Step 904 is added data object to the synchronous documents formation, and the data block contents in the release data object.
In addition; If the buffer memory capacity that the synchrodata formation takies returns to below the preset threshold value; Then can be according to filename, data block displacement and the data block length in the said data object that discharges data block contents; Read block content from said data sharing memory cell reverts to complete data object and also adds to again in the synchrodata formation.The process that data object in the synchronous documents formation is returned to the synchrodata formation can regularly be carried out perhaps according to whether the shared caching situation decision of synchrodata formation is carried out; For example: can from the synchrodata formation, take out data object; And be synchronized to after the said data backup memory cell, judge further whether said synchronous documents formation is empty; If be not empty; Then according to subscriber data file name, data block displacement and data block length in the said data object that discharges data block contents; Read block content from said data sharing memory cell reverts to complete data object and adds in the synchrodata formation.
Figure 11 is for returning to the data object in the synchronous documents formation in the embodiment of the invention flow chart of synchrodata formation, and shown in figure 11, this flow process comprises the steps:
Step 1101, the formation of timer access synchrodata;
Step 1102 judges whether the synchrodata formation is empty, if, then return 1101, otherwise execution in step 1103;
Step 1103 is taken out data object;
Step 1104 arrives the data backup memory cell with synchronization of data objects;
Step 1105 judges whether the synchronous documents formation is empty, if, then return 1101, otherwise execution in step 1106;
Step 1106 is taken out the synchronous documents object from the synchronous documents formation, return to the synchrodata formation.
Step 1101～1104th is with the user data synchronization of buffer memory in the synchrodata formation concrete steps to the data backup memory cell; After execution is once arrived the operation of data backup memory cell with synchronization of data objects; Must vacate the space of a data object in the formation of formation synchrodata, therefore just can a data object in the synchronous documents formation have been returned to the synchrodata formation this moment.
In addition; For the user data that is kept at the data backup memory cell; Can also realize the recovery of data, like the data restore instruction that basis receives, from the data backup memory cell, reading needs data recovered and sends to user or the data sharing memory cell that needs restore data; Rebuild instruction according to the backup that receives, the formatted data redundant memory cell, the ergodic data shared memory cell is obtained all sharing users data, and is synchronized to the data backup memory cell after the format one by one.
Specifically, corrupted data after taking place in main frame, and subscriber's main station can be browsed the user data of backup through data processing unit; After the data of selecting to damage, to data processing unit request restore data; Data processing unit reads the user data of backup and returns to main frame according to the request of main frame.
After the data division that is kept at the data sharing memory cell suffered damage, as being deleted by mistake, subscriber's main station can be browsed the user data of backup through data processing unit; After the data of selecting to damage, arrive the data sharing memory cell to data processing unit request restore data; Data processing unit is according to the data storage location in the user data locator data shared memory cell of backup; The user data of backup is written to the data sharing memory cell.
When the data that are kept at the shared data memory cell will all be damaged; Storage medium like the shared data memory cell damages; Then the user can initiate the request of data reconstruction shared memory cell to data processing unit; Process of reconstruction comprises medium process of reconstruction and data reconstruction processes, and the medium process of reconstruction normally is applied to storage device with new medium, and is formatted as read-write memory cell;
Data reconstruction processes is that data processing unit recovers the process of all data to shared cell from the data backup memory cell; Comprise: data processing unit ergodic data redundant memory cell; Obtain the last state of the user data of all backups; Last state is meant in backup procedure when keeping a plurality of copy, a up-to-date copy of selection; The user data of backup is returned to the data sharing memory cell by the file name information in when backup.In addition, if do not preserve a plurality of copies, then can not carry out the step of the last state that obtains all Backup Datas.
In addition; After backup data storage unit is damaged, the data that are kept at backup data storage unit will all be lost, at this moment; The user can initiate the request of data reconstruction redundant memory cell to data processing unit; Process of reconstruction comprises medium process of reconstruction and data reconstruction processes, and the medium process of reconstruction normally is applied to storage device with new medium, and is formatted as read-write memory cell;
Data reconstruction processes is that data processing unit backs up the process of all data to shared cell again from the data sharing memory cell, specifically comprises: data processing unit ergodic data shared memory cell obtains all user data of sharing; One by one the user data backup of sharing is arrived the data backup memory cell; One by one that the user data backup of sharing is in fact identical with the normal data backup procedure to the process of data backup memory cell; Only backed up data is the sharing users data from the data sharing memory cell; Rather than, just no longer detailed here from the user data of subscriber's main station.
Visible by the above embodiments; This network additive storage device of the present invention and data backup and restoration methods; Through having realized data backup in network additive storage device inside; Need not through Network Transmission, and data backup uses the low speed magnetic disk media, therefore realized the data backup and the data recovery of low energy consumption, low cost and low resource occupying simultaneously.
Institute is understood that; The above is merely preferred embodiments of the present invention, and is not used in qualification protection scope of the present invention, and is all within spirit of the present invention and principle; Any modification of being made, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (14)
1. a network additive storage device is characterized in that, this device comprises:
Network interface is used to connect network, realizes the transmission of data in network;
Network attached storage NAS controller links to each other with network interface, is used to provide the transmission controlled function of various data application, receives the user data that transmits through network interface;
Data processing unit; Link to each other respectively with the data backup memory cell with NAS controller and data sharing memory cell; The storage of subscriber data that is used for receiving from said NAS controller is to the process of said shared memory cell, with user data synchronization to said data backup memory cell;
The data sharing memory cell links to each other with data processing unit, is used for sharing storaging user data, adopts the hyperdisk medium;
The data backup memory cell links to each other with data processing unit, is used for the back-up storage user data, adopts the low speed magnetic disk media.
2. network additive storage device as claimed in claim 1 is characterized in that, said data processing unit comprises:
The data sharing module links to each other with said NAS controller, is used for receiving subscriber data, and storage of subscriber data is arrived said data sharing memory cell;
Data conversion module links to each other with said data sharing module, is used for converting said user data into data object, and is sent to data queue's module;
Synchrodata formation module links to each other with said data conversion module, is used for the data object that the said data conversion module of buffer memory sends, and forms the synchrodata formation;
Data simultaneous module links to each other with said data queue module, be used for regularly taking out data object from said synchrodata formation module according to queue sequence, and with synchronization of data objects to said data backup memory cell.
3. network additive storage device as claimed in claim 2 is characterized in that, said data conversion module comprises:
The data decomposition submodule links to each other with said data sharing module, is used for the user data that surpasses preset data length is decomposed into a plurality of continuous data block, and the data length of each decomposed data piece is all less than preset data length;
Data object generates submodule; Link to each other with said data decomposition submodule; Be used to write down filename, data block displacement, data block length and the data block contents of decomposed data piece, filename, data block displacement, data block length and the data block contents of each decomposed data piece are formed a data object; Data length is then directly converted into data object less than the user data of preset data length, and at this moment, the data block displacement in the data object is 0, and data block length is the length of complete user data, and data block contents is complete user data content.
4. network additive storage device as claimed in claim 3 is characterized in that, said data processing unit further comprises:
Synchronous documents formation module links to each other with said data conversion module, is used for the data object that buffer memory discharges data block contents, forms the synchronous documents formation;
Said data conversion module was further used for before data object being sent to said synchrodata formation module, judged whether the buffer memory capacity that the synchrodata formation of buffer memory in the said synchrodata formation module takies reaches preset threshold value;
If the buffer memory capacity that the synchrodata formation of buffer memory takies in the said synchrodata formation module reaches preset threshold value, then data object is sent to synchronous documents formation module, and the data block contents in the release data object;
If the buffer memory capacity that the synchrodata formation of buffer memory takies in the said synchrodata formation module returns to below the preset threshold value; And the synchronous documents formation of buffer memory is not empty in the said synchronous documents formation module; Then according to subscriber data file name, data block displacement and data block length in the said data object that discharges data block contents; Read block content from said data sharing memory cell reverts to complete data object and sends to said synchrodata formation module.
5. like the described network additive storage device of each claim among the claim 2-4, it is characterized in that said data processing unit further comprises:
Data recovery module links to each other with said NAS controller, and according to the data restore instruction that receives, from the data backup memory cell, reading needs data recovered and send to user or the data sharing memory cell that needs restore data; Rebuild instruction according to the backup that receives, format said data backup memory cell; Travel through said data sharing memory cell, obtain all sharing users data, and send to said data conversion module;
Said data conversion module further links to each other with said data recovery module, is data object with said sharing users data transaction, and is sent to data queue's module.
6. like the described network additive storage device of each claim among the claim 1-4, it is characterized in that said hyperdisk medium is the disk of SAS or scsi interface, said low speed disk is the disk of SATA or ide interface.
7. a data back up method that is used for the described network additive storage device of claim 1 is characterized in that, this method comprises:
Receiving subscriber data from network;
In process with said storage of subscriber data inner data sharing memory cell to network additive storage device, through internal interface with user data synchronization to the inner data backup memory cell of network additive storage device.
8. the data back up method of network additive storage device as claimed in claim 7 is characterized in that, said user data synchronization is comprised to said data backup memory cell:
Convert user data into data object;
Add said data object to the synchrodata formation;
Regularly from the synchrodata formation, take out data object, and synchronization of data objects is arrived said data backup memory cell according to queue sequence.
9. the data back up method of network additive storage device as claimed in claim 8 is characterized in that, saidly converts user data into data object and comprises:
To be decomposed into a plurality of continuous data block above the user data of preset data length; The data length of each decomposed data piece is all less than preset data length; Filename, data block displacement, data block length and the data block contents of record decomposed data piece are formed a data object with filename, data block displacement, data block length and the data block contents of each decomposed data piece;
The user data of data length less than preset data length do not decomposed; Directly convert data object into, at this moment, the data block displacement in the data object is 0; Data block length is the length of complete user data, and data block contents is complete user data content.
10. like the data back up method of the described network additive storage device of each claim among the claim 7-9; It is characterized in that; Said user data is converted into after the data object; Data object is added to before the synchrodata formation, and this method further comprises: judge whether the buffer memory capacity that said synchrodata formation takies reaches preset threshold value;
If the buffer memory capacity that said synchrodata formation takies has reached preset threshold value, then data object is added the synchronous documents formation, and the data block contents in the release data object;
If the buffer memory capacity that the synchrodata formation takies returns to below the preset threshold value; And the synchronous documents formation is not empty; Then according to filename, data block displacement and data block length in the said data object that discharges data block contents; Read block content from said data sharing memory cell reverts to complete data object and adds in the synchrodata formation.
11. a data reconstruction method that is used for the described network additive storage device of claim 1 is characterized in that, this method comprises:
According to the data restore instruction that receives, from the data backup memory cell, reading needs data recovered and sends to user or the data sharing memory cell that needs restore data;
Rebuild instruction according to the backup that receives, the formatted data redundant memory cell, the ergodic data shared memory cell is obtained all sharing users data, and is synchronized to the data backup memory cell after the format one by one.
12. the data reconstruction method of network additive storage device as claimed in claim 11 is characterized in that, said with all sharing users data sync to the format after the data backup memory cell comprise:
The sharing users data transaction is data object and adds the synchrodata formation to, regularly synchronization of data objects is arrived said data backup memory cell according to queue sequence.
13. the data reconstruction method of network additive storage device as claimed in claim 12 is characterized in that, saidly converts the user data of sharing into data object and comprises:
To above the sharing users data decomposition of preset data length a plurality of continuous data block; The data length of each decomposed data piece is all less than preset data length; Filename, data block displacement, data block length and the data block contents of record decomposed data piece are formed a data object with filename, data block displacement, data block length and the data block contents of each decomposed data piece;
Data length is not decomposed less than the sharing users data of preset data length; Directly convert data object into, at this moment, the data block displacement in the data object is 0; Data block length is the length of complete sharing users data, and data block contents is complete sharing users data content.
14. the data reconstruction method of network additive storage device as claimed in claim 13; It is characterized in that; If the buffer memory capacity that said synchrodata formation takies reaches preset threshold value, then follow-up data object is added the synchronous documents formation, and the data block contents in the release data object;
If the buffer memory capacity that the synchrodata formation takies returns to below the preset threshold value; And the synchronous documents formation is not empty; Then according to filename, data block displacement and data block length in the said data object that discharges data block contents; Read block content from said data sharing memory cell reverts to complete data object and adds in the synchrodata formation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810204752 CN101453489B (en) | 2008-12-17 | 2008-12-17 | Network additive storage device, data backup and data restoration method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810204752 CN101453489B (en) | 2008-12-17 | 2008-12-17 | Network additive storage device, data backup and data restoration method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101453489A CN101453489A (en) | 2009-06-10 |
| CN101453489B true CN101453489B (en) | 2012-12-19 |
Family
ID=40735509
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200810204752 Expired - Fee Related CN101453489B (en) | 2008-12-17 | 2008-12-17 | Network additive storage device, data backup and data restoration method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101453489B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102088361B (en) * | 2009-12-02 | 2015-04-15 | 华为数字技术（成都）有限公司 | Data backup equipment, method and system |
| CN101902498B (en) * | 2010-07-02 | 2013-03-27 | 广州鼎甲计算机科技有限公司 | Network technology based storage cloud backup method |
| JP5150696B2 (en) * | 2010-09-28 | 2013-02-20 | 株式会社バッファロー | Storage processing apparatus and failover control method |
| CN102469120A (en) * | 2010-10-28 | 2012-05-23 | 智微科技股份有限公司 | Network storage system and network storage method |
| CN102325171B (en) * | 2011-08-26 | 2014-06-25 | 杭州华三通信技术有限公司 | Data storage method in monitoring system and system |
| CN102521072B (en) * | 2011-11-25 | 2013-09-11 | 华为数字技术（成都）有限公司 | Virtual tape library equipment and data recovery method |
| CN102611745B (en) * | 2011-12-31 | 2015-02-25 | 华为数字技术（成都）有限公司 | On-line file moving method, device and system |
| CN103312623B (en) * | 2012-03-08 | 2016-08-17 | 百度在线网络技术（北京）有限公司 | Task cooperation device and method |
| CN103618769A (en) * | 2013-11-15 | 2014-03-05 | 华为技术有限公司 | Redundancy configuration method, system and related device |
| CN105446830A (en) * | 2015-11-09 | 2016-03-30 | 上海爱数信息技术股份有限公司 | Data backup method based on NDMP (Network Data Management Protocol) disk-to-disk replication technology |
| CN106648963B (en) * | 2016-10-11 | 2020-10-20 | 广东工业大学 | Method and system for recovering synchronous backup of data |
| WO2020135284A1 (en) * | 2018-12-28 | 2020-07-02 | Huawei Technologies Co., Ltd. | Method, device and system for asynchronous directory replication |
| CN113434344A (en) * | 2021-07-22 | 2021-09-24 | 咪咕数字传媒有限公司 | File storage method and device, computing equipment and computer storage medium |
| CN115396386B (en) * | 2022-08-09 | 2023-11-17 | 伟志股份公司 | Data sharing system, method and application thereof |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1815475A (en) * | 2005-02-04 | 2006-08-09 | 国际商业机器公司 | Method, system and computer program product for backing up and recovering a database |
-
2008
- 2008-12-17 CN CN 200810204752 patent/CN101453489B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1815475A (en) * | 2005-02-04 | 2006-08-09 | 国际商业机器公司 | Method, system and computer program product for backing up and recovering a database |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101453489A (en) | 2009-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101453489B (en) | Network additive storage device, data backup and data restoration method thereof | |
| JP6522812B2 (en) | Fast Crash Recovery for Distributed Database Systems | |
| JP6538780B2 (en) | System-wide checkpoint avoidance for distributed database systems | |
| US11755415B2 (en) | Variable data replication for storage implementing data backup | |
| CN102955720B (en) | A kind of method improving ext file system stability | |
| CA2906522C (en) | Log record management | |
| CA2906547C (en) | In place snapshots | |
| US8689047B2 (en) | Virtual disk replication using log files | |
| US8712962B1 (en) | Snapshots in de-duplication | |
| US8914595B1 (en) | Snapshots in deduplication | |
| US8543609B1 (en) | Snapshots in deduplication | |
| EP2948849B1 (en) | System and method for replicating data | |
| EP2218006B1 (en) | Local flash memory and remote server hybrid continuous data protection | |
| CN106407040A (en) | Remote data copy method and system | |
| CN104077380B (en) | A kind of data de-duplication method, apparatus and system | |
| US20070106712A1 (en) | Replication arbitration apparatus, method and program | |
| US7979651B1 (en) | Method, system, and computer readable medium for asynchronously processing write operations for a data storage volume having a copy-on-write snapshot | |
| CN101945131B (en) | Storage virtualization-based data migration method | |
| CN103516736A (en) | Data recovery method of distributed cache system and a data recovery device of distributed cache system | |
| CN103095843A (en) | Method and client of data backup based on version vectors | |
| CN103455577A (en) | Multi-backup nearby storage and reading method and system of cloud host mirror image file | |
| CN110109778A (en) | A kind of a large amount of small data file backup methods and restoration methods | |
| CN103023996A (en) | Cloud data storage system | |
| CN104583966A (en) | Backup and restore system for a deduplicated file system and corresponding server and method | |
| CN102820998A (en) | Dual-fault-tolerant service system applicable to office applications and data storage method of dual-fault-tolerant service system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP03 | Change of name, title or address |
Address after: 201112, room 25, 204 Zhenkang Road, Cambridge, Shanghai, Pudong New Area Patentee after: SHANGHAI EISOO INFORMATION TECHNOLOGY CO., LTD. Address before: 201103, room 25, 204 Zhenkang Road, Cambridge, Shanghai, Pudong New Area Patentee before: Shanghai Eisoo Software Co.,Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20121219 Termination date: 20191217 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |