CN104407940A - Method for quickly recovering CDP system - Google Patents
Method for quickly recovering CDP system Download PDFInfo
- Publication number
- CN104407940A CN104407940A CN201410692614.0A CN201410692614A CN104407940A CN 104407940 A CN104407940 A CN 104407940A CN 201410692614 A CN201410692614 A CN 201410692614A CN 104407940 A CN104407940 A CN 104407940A
- Authority
- CN
- China
- Prior art keywords
- cdp
- volume
- data
- recovery
- responsible
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a method for quickly recovering a CDP system. The CDP system is interrupted temporarily, a monitoring volume change data bit map table sectionalized by set thresholds is maintained inside a CDP core driver module; after the CDP system is restarted next time, initialized copying is performed on only the region of variation of a monitoring path according to the change data bit map table maintained by the CDP core driver module. Compared with the prior art, the method for quickly recovering the CDP system is capable of greatly reducing the initialized copied regions, removing a large amount of redundant data and quickly recovering the CDP system.
Description
Technical field
The present invention relates to data backup field, especially relate to a kind of method of fast quick-recovery CDP system.
Background technology
Along with the arriving of information age; computing machine of today has been deep into the every aspect of our life; overwhelming majority enterprise all relies on computer system to run its core business; thus; the mass data that system produces also becomes the most valuable wealth of enterprise, the focus of enterprises pay attention of how having protected these data also to become.
A lot of applications requires very strict to the availability of data and promptness, if do not have good scheme that these data protections are good, once it will be so fatal to the strike of enterprise that disaster occurs.
Nowadays we have stepped into large data age, and the data volume in production system is increasing.In the face of the production system that a large amount of data and high PTO (Recovery Time Objective), PRO (Recovery Point Objective) require, common data protection mode cannot meet the demand of enterprise operation system data protection, CDP technology is current popular, and a kind of real time data protection scheme that RTO and RPO is higher, its backup principle is as follows: 1) at initial phase, generate a complete data copy by block level duplication technology; 2) in incremental stages, catch I/O data block in real time by CDP module and generate incremental data copy.
But, if because any reason causes CDP tasks interrupt in CDP system copies process, then after starting next time, reduction CDP system needs to reinitialize whole supervised path, this process is not only consuming time longer, and have the backup of mass of redundancy data, be a kind of waste greatly to storage space and network bandwidth resources.
Summary of the invention
Object of the present invention is exactly provide a kind of method of fast quick-recovery CDP system to overcome defect that above-mentioned prior art exists, in CDP system because after any reason temporary break, copy without the need to again doing initialization to whole supervised path after restarting CDP system next time, only need back up the incremental data not completing transmission before interrupting last time, and initialization is done to the region of supervised path localized variation during CDP system break copy, can fast quick-recovery CDP system.
Object of the present invention can be achieved through the following technical solutions:
A kind of method of fast quick-recovery CDP system, it is characterized in that, when after CDP system temporary break, CDP kernel-driven inside modules safeguards that one to set the monitoring volume delta data bitmap table of threshold values segmentation, after restarting CDP system next time, according to the delta data bitmap table that CDP kernel-driven module is safeguarded, only need to carry out initialization to the region of variation of supervised path to copy, This greatly reduces the region that initialization copies, eliminate mass of redundancy data, can fast quick-recovery CDP system.
Described volume delta data bitmap table is carried in internal memory, is responsible for a linear list of record CDP intercourse monitoring volume region of variation.
Described linear list size determines by monitoring volume size S and predefine section threshold values B, whether the address area A of its this monitoring of Bit bit-identify volume there is data variation, as kernel-driven module monitors drops in monitoring volume region to an IRP (I/ORequest Packet), then according to writing skew Offset, with length Length, corresponding region in bitmap table is put 1.When S=1TB, B=4KB, the size BS=S/B=32MB of bitmap table.
Described CDP kernel-driven module is loaded when system starts, within the whole system cycle of operation, all keep stable operation;
When CDP system is in normal operating condition, be responsible for catching in real time the I/O data block in supervised path region, and I/O data chunk be made into setting data form and be stored in daily record volume, extract for CDP scheduler module and be transferred to storage medium end;
When CDP system is in stopping or abnormality, is responsible for creating and safeguards with the monitoring setting threshold values segmentation volume delta data bitmap table.
Described CDP scheduler module is responsible for carrying out alternately with CDP kernel-driven module, as sent startup, stopping, removing the relevant control instructions such as path monitoring, and be responsible for initialization CDP supervised path, read the I/O delta data block in daily record volume, be transferred to storage medium end by data channel.
Compared with prior art, the present invention has the following advantages:
1, can be protected subscriber service system data in real time by the present invention.
2, the present invention is passed through; can at CDP system operation because any reason causes having no progeny in data protection; restart next time and can avoid that initialization is done again to whole supervised path and copy, decrease the reproduction process of redundant data, thus recover CDP system fast.
Accompanying drawing explanation
Fig. 1 is ICP/IP protocol 4 layer model schematic diagram;
Fig. 2 is the structural representation of CDP system of the present invention;
Fig. 3 is CDP working-flow figure of the present invention.
Embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is described in detail.
Embodiment
The present invention is based on the improvement on original CDP standby system.Former standby system structural reference Fig. 2, is made up of client and control desk, is connected between the two by Ethernet, and the host-host protocol of employing is TCP/IP.ICP/IP protocol 4 layer model as shown in Figure 1.In order to the quick restore funcitons after realize CDP system break on this CDP standby system, only need amendment CDP kernel-driven module and CDP scheduler module.Co-operating module is all in client, and whole process is transparent concerning control desk.
As shown in Figure 3, specific embodiment of the invention process is as follows:
1, need, on protected operation system main frame, CDP client is installed; simultaneously; need additionally to provide a main frame; CDP control desk is installed; described client, comprises CDP kernel-driven module, CDP scheduler module, data transmission module and control module, described CDP control desk; mainly comprise data memory module and administration module, the correlation function such as task management and storage medium management is mainly provided.
2, CDP system is from interrupting the flow process of recovering state to normal condition.
2.1CDP task creation: by the CDP task CDPJob1 of CDP control desk interface creating based on customer service main frame SM, supervised path is the business datum volume D on SM, and size is 1TB, and select the volume E on SM to roll up as CDP daily record, size is 100GB.
2.2 initialization duplicate stage: CDP scheduler module sends and starts monitoring message to CDP kernel-driven module, and CDP kernel-driven module starts to catch the I/O data block in volume D region, and I/O data chunk is made into particular data form and is stored into daily record volume E; Meanwhile, CDP scheduler module, according to the file system on volume D, is volume D in conjunction with file system bitmap table and is carried out initialization and copy, initialization data block is sent to control desk by data channel, gives data memory module process.
The 2.3 incremental replication stages: CDP scheduler module completes copying of valid data from volume D reference position to end position region according to file system bitmap table, start to extract incremental data block from daily record volume E, control desk is sent to by data channel, give data memory module process, after current data block process success, CDP scheduler module deletes this data block from daily record volume.
2.4CDP tasks interrupt: sometime, CDPJob1 is because passive stopping or user are stopped by control desk initiative extremely, CDP kernel-driven module detects that CDPJob1 stops, start the monitoring volume D of threshold values to CDPJob1 according to a preconcerted arrangement and carry out area segmentation, set up bitmap table BtiMap1, whether a Bit position there is data variation for the region identifying a 4KB on volume D after CDP system break, the bitmap table size of then rolling up D corresponding is ITB/4KB/8=32MB, initialization bit chart BtiMap1, supervisory system I/O, if change region is positioned at volume D region, then ask package informatin according to I/O, BtiMap1 corresponding region is put 1.
2.5CDP task recovery: sometime, user performs CDPJob1 by control desk initiative, after client receives message, notice CDP scheduler module, CDP scheduler module sends message to CDP kernel-driven module, BtiMap1 is replaced BitMapFIle corresponding to daily record volume from internal memory by CDP kernel-driven module, starts normal flow process: the I/O data block of catching volume D region, and I/O data chunk is made into particular data form and is stored into daily record volume E.CDP scheduler module first checks whether daily record volume has the incremental data block be not transmitted in implementation last time, and some words, complete transmission.Then BitMapFIle file is read to internal memory, partial copy is carried out to the regional address corresponding to 1 in volume D bitmap table, after completing local initializations replicate run, to remove from internal memory as icon and from deletion BitMapFIle file, then in backup log volume E, CDPJob1 restarts the incremental data block of rear generation, so far, CDPJob1 recovers.
Claims (5)
1. the method for a fast quick-recovery CDP system, it is characterized in that, when after CDP system temporary break, CDP kernel-driven inside modules safeguards that one to set the monitoring volume delta data bitmap table of threshold values segmentation, after restarting CDP system next time, according to the delta data bitmap table that CDP kernel-driven module is safeguarded, only need that initialization is carried out to the region of variation of supervised path and copy.
2. the method for a kind of fast quick-recovery CDP system according to claim 1, it is characterized in that, described volume delta data bitmap table is carried in internal memory, is responsible for a linear list of record CDP intercourse monitoring volume region of variation.
3. the method for a kind of fast quick-recovery CDP system according to claim 1, is characterized in that, described linear list size determines by monitoring volume size S and predefine section threshold values B, is calculated as follows:
The size BS=S/B of bitmap table.
4. the method for a kind of fast quick-recovery CDP system according to claim 1, it is characterized in that, described CDP kernel-driven module is loaded when system starts, within the whole system cycle of operation, all keep stable operation;
When CDP system is in normal operating condition, be responsible for catching in real time the I/O data block in supervised path region, and I/O data chunk be made into setting data form and be stored in daily record volume, extract for CDP scheduler module and be transferred to storage medium end;
When CDP system is in stopping or abnormality, is responsible for creating and safeguards with the monitoring setting threshold values segmentation volume delta data bitmap table.
5. the method for a kind of fast quick-recovery CDP system according to claim 4, it is characterized in that, described CDP scheduler module is responsible for carrying out alternately with CDP kernel-driven module, and be responsible for initialization CDP supervised path, read the I/O delta data block in daily record volume, be transferred to storage medium end by data channel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410692614.0A CN104407940A (en) | 2014-11-26 | 2014-11-26 | Method for quickly recovering CDP system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410692614.0A CN104407940A (en) | 2014-11-26 | 2014-11-26 | Method for quickly recovering CDP system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104407940A true CN104407940A (en) | 2015-03-11 |
Family
ID=52645573
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410692614.0A Pending CN104407940A (en) | 2014-11-26 | 2014-11-26 | Method for quickly recovering CDP system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104407940A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105302668A (en) * | 2015-10-21 | 2016-02-03 | 上海爱数信息技术股份有限公司 | Method for optimizing block device data access performance in object-based storage system |
| CN107885616A (en) * | 2017-09-29 | 2018-04-06 | 上海爱数信息技术股份有限公司 | A kind of mass small documents back-up restoring method based on file system parsing |
| CN109992448A (en) * | 2017-12-31 | 2019-07-09 | 中国移动通信集团山西有限公司 | File change incremental backup method, device, equipment and medium |
| CN110209530A (en) * | 2019-05-09 | 2019-09-06 | 上海爱数信息技术股份有限公司 | A kind of efficient method and system for restoring CDP system I/O data |
| CN112464044A (en) * | 2020-12-09 | 2021-03-09 | 上海爱数信息技术股份有限公司 | File data block change information monitoring and management system and method thereof |
| CN114546244A (en) * | 2020-11-18 | 2022-05-27 | 云坞科技(北京)有限公司 | Cache space filtering method based on block-level continuous data protection |
| CN114625575A (en) * | 2022-05-16 | 2022-06-14 | 深圳市科力锐科技有限公司 | Business system synchronization method, device, equipment and storage medium |
| CN117591345A (en) * | 2024-01-18 | 2024-02-23 | 柏科数据技术（深圳）股份有限公司 | Ceph-specific data synchronization method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8051044B1 (en) * | 2008-04-01 | 2011-11-01 | Acronis, Inc. | Method and system for continuous data protection |
| CN102508739A (en) * | 2011-10-20 | 2012-06-20 | 浪潮(北京)电子信息产业有限公司 | Method and device for acquiring performance information of continuous data protection of post-traumatic system |
| CN103365745A (en) * | 2013-06-07 | 2013-10-23 | 上海爱数软件有限公司 | Block level backup method based on content-addressed storage and system |
| CN103530204A (en) * | 2013-10-15 | 2014-01-22 | 上海爱数软件有限公司 | Method and system for real-time data backup |
-
2014
- 2014-11-26 CN CN201410692614.0A patent/CN104407940A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8051044B1 (en) * | 2008-04-01 | 2011-11-01 | Acronis, Inc. | Method and system for continuous data protection |
| CN102508739A (en) * | 2011-10-20 | 2012-06-20 | 浪潮(北京)电子信息产业有限公司 | Method and device for acquiring performance information of continuous data protection of post-traumatic system |
| CN103365745A (en) * | 2013-06-07 | 2013-10-23 | 上海爱数软件有限公司 | Block level backup method based on content-addressed storage and system |
| CN103530204A (en) * | 2013-10-15 | 2014-01-22 | 上海爱数软件有限公司 | Method and system for real-time data backup |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105302668A (en) * | 2015-10-21 | 2016-02-03 | 上海爱数信息技术股份有限公司 | Method for optimizing block device data access performance in object-based storage system |
| CN105302668B (en) * | 2015-10-21 | 2018-09-25 | 上海爱数信息技术股份有限公司 | A kind of method of block device data access performance in optimization object storage system |
| CN107885616A (en) * | 2017-09-29 | 2018-04-06 | 上海爱数信息技术股份有限公司 | A kind of mass small documents back-up restoring method based on file system parsing |
| CN109992448A (en) * | 2017-12-31 | 2019-07-09 | 中国移动通信集团山西有限公司 | File change incremental backup method, device, equipment and medium |
| CN110209530A (en) * | 2019-05-09 | 2019-09-06 | 上海爱数信息技术股份有限公司 | A kind of efficient method and system for restoring CDP system I/O data |
| CN110209530B (en) * | 2019-05-09 | 2024-02-09 | 上海爱数信息技术股份有限公司 | Method and system for recovering IO data of CDP system |
| CN114546244A (en) * | 2020-11-18 | 2022-05-27 | 云坞科技(北京)有限公司 | Cache space filtering method based on block-level continuous data protection |
| CN114546244B (en) * | 2020-11-18 | 2023-11-03 | 云坞科技(北京)有限公司 | Cache space filtering method based on block-level continuous data protection |
| CN112464044A (en) * | 2020-12-09 | 2021-03-09 | 上海爱数信息技术股份有限公司 | File data block change information monitoring and management system and method thereof |
| CN114625575A (en) * | 2022-05-16 | 2022-06-14 | 深圳市科力锐科技有限公司 | Business system synchronization method, device, equipment and storage medium |
| CN117591345A (en) * | 2024-01-18 | 2024-02-23 | 柏科数据技术（深圳）股份有限公司 | Ceph-specific data synchronization method, device, equipment and storage medium |
| CN117591345B (en) * | 2024-01-18 | 2024-05-14 | 柏科数据技术（深圳）股份有限公司 | Ceph-specific data synchronization method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104407940A (en) | Method for quickly recovering CDP system | |
| CN105389230B (en) | A kind of continuous data protection system and method for combination snapping technique | |
| CN105550062B (en) | The data reflow method restored based on continuous data protection and time point browsing | |
| US8868858B2 (en) | Method and apparatus of continuous data backup and access using virtual machines | |
| JP6232427B2 (en) | Deduplication of attachments and automatic repair of attachments in message delivery | |
| CN106776130B (en) | Log recovery method, storage device and storage node | |
| CN110389858B (en) | Method and device for recovering faults of storage device | |
| CN109582443A (en) | Virtual machine standby system based on distributed storage technology | |
| US11892922B2 (en) | State management methods, methods for switching between master application server and backup application server, and electronic devices | |
| CN105302667B (en) | High reliability data backup and restoration methods based on aggregated structure | |
| CN106919473B (en) | Data disaster backup system and service processing method | |
| CN102792276A (en) | Buffer disk in flashcopy cascade | |
| CN104461776A (en) | Application disaster tolerance method based on CDP and iSCSI virtual disk technology | |
| CN111708488B (en) | Distributed memory disk-based Ceph performance optimization method and device | |
| CN111949445B (en) | Incremental backup data storage method, device, equipment and product | |
| CN104461773A (en) | Backup deduplication method of virtual machine | |
| CN111176900A (en) | Distributed storage system and data recovery method, device and medium thereof | |
| CN102968360A (en) | Storage system with N+1 redundancy function and method | |
| CN110597661A (en) | Virtual machine backup method and device | |
| US8639968B2 (en) | Computing system reliability | |
| CN103384266A (en) | Parastor200 management node high availability method based on real-time synchronization at file level | |
| CN105389231A (en) | Database dual-computer backup method and system | |
| CN103544081B (en) | The management method of double base data server and device | |
| JP5154843B2 (en) | Cluster system, computer, and failure recovery method | |
| CN106445746A (en) | Method and device for disaster recovery backup facing emergency replacement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 201112 Shanghai, Minhang District, United Airlines route 1188, building second layer A-1 unit 8 Applicant after: SHANGHAI EISOO INFORMATION TECHNOLOGY CO., LTD. Address before: 201112 Shanghai, Minhang District, United Airlines route 1188, building second layer A-1 unit 8 Applicant before: Shanghai Eisoo Software Co.,Ltd. |
|
| COR | Change of bibliographic data | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150311 |
|
| RJ01 | Rejection of invention patent application after publication |