CN109542681B - Time navigation system based on file backup, and visual data recovery method and device - Google Patents
Time navigation system based on file backup, and visual data recovery method and device Download PDFInfo
- Publication number
- CN109542681B CN109542681B CN201811357993.2A CN201811357993A CN109542681B CN 109542681 B CN109542681 B CN 109542681B CN 201811357993 A CN201811357993 A CN 201811357993A CN 109542681 B CN109542681 B CN 109542681B
- Authority
- CN
- China
- Prior art keywords
- file
- backup
- time
- file system
- system description
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 230000000007 visual effect Effects 0.000 title claims abstract description 15
- 238000011084 recovery Methods 0.000 title claims description 17
- 239000000463 material Substances 0.000 claims abstract description 4
- 230000008859 change Effects 0.000 claims description 10
- 238000005516 engineering process Methods 0.000 claims description 10
- 230000004048 modification Effects 0.000 claims description 10
- 238000012986 modification Methods 0.000 claims description 10
- 230000009467 reduction Effects 0.000 claims description 8
- 239000003795 chemical substances by application Substances 0.000 claims description 3
- 239000003086 colorant Substances 0.000 claims description 3
- 238000012217 deletion Methods 0.000 claims description 3
- 230000037430 deletion Effects 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 238000011161 development Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1469—Backup restoration techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a time navigation system based on file backup, comprising: the control module is arranged on the backup server, tracks each backup, filing and restoring session executed, and records time information, file attributes and position information stored in the medium module, wherein the time information, the file attributes and the position information are contained in time navigation; the agent module: the backup server is arranged at the application client, allows the control module to track the configuration of the application client and allows the backup server to backup the formulated file system; a media module: storing the backed-up data, including a common hard disk, a material tape library or a virtual tape library; the management software module: and displaying a file list under a certain time node on a time axis, and operating backup and restoration actions, wherein the file list comprises files existing in the current time node and deleted files. The method and the device for recovering the visual data can guide personnel to quickly search the deleted file and quickly restore the file to a version of a certain past historical moment through a time navigation axis.
Description
Technical Field
The invention relates to the technical field of data management, in particular to a time navigation system based on file backup, a visual data recovery method and a visual data recovery device.
Background
With the development of e-commerce, the role of data in enterprises becomes more and more important, and more enterprises are beginning to pay attention to storage products and backup schemes. The following problems are encountered in the application of these storage products:
1. the problem of backup speed: with the continuous development of services, data is more and more, updating is faster and faster, so that the backup of the content is not time to backup in the rest time, and the backup in the working time can influence the system performance.
2. The operation is simplified: data backup is applied to different fields, and operators for data backup are also in different levels. Whether the operation is simple or not directly influences the operation effect and the data safety.
3. Protection of data consistency issues: some critical tasks are to run 24 hours without shutdown, and some files may still be open at the time of backup.
4. Fault tolerance problem-data backup is damaged and how to recover it in the shortest time.
Disclosure of Invention
The invention aims to provide a time navigation system based on file backup, a visual data recovery method and a visual data recovery device, which can quickly search for files existing in any time node or deleted and carry out reduction backup operation.
In order to achieve the purpose, the invention adopts the following technical scheme:
the invention provides a time navigation system based on file backup in a first aspect, which comprises:
the control module is arranged on the backup server, tracks each backup, filing and restoring session executed, and records time information, file attributes and position information stored in the medium module, wherein the time information, the file attributes and the position information are contained in time navigation;
the agent module: the backup server is arranged at the application client, allows the control module to track the configuration of the application client and allows the backup server to backup the formulated file system;
a media module: storing the backed-up data, including a common hard disk, a material tape library or a virtual tape library;
the management software module: and displaying a file list under a certain time node on a time axis, and operating backup and restoration actions, wherein the file list comprises files existing in the current time node and deleted files.
The second aspect of the present invention provides a visual data recovery method, including the following steps:
backup application client data to a backup server by adopting a snapshot technology, and establishing a file system description area;
establishing a time navigation axis through time information in a Table in a file system description area;
and selecting a time node of a time navigation axis, and performing reduction or backup operation on the file.
With reference to the second aspect, in a first possible implementation manner of the second aspect, the backing up the application client data to the backup server by using the snapshot technology to establish the file system description area specifically includes:
copying the file system description and establishing a disk buffer area;
when the data block of the application client is modified, the data block before change is stored in the disk buffer area.
With reference to the second aspect, in a second possible implementation manner of the second aspect, the establishing a time navigation axis through time information in a Table in a file system description area specifically includes:
periodically extracting file system description information of a backup object, and storing the file system description information to a backup server database;
and if the backup object changes in the time interval of two times of extraction, the time navigation axis marks the backup object as a change file.
With reference to the second aspect, in a third possible implementation manner of the second aspect, the periodically extracting file system description information of the backup object and storing the file system description information in the backup server database specifically includes:
if the backup object is a file in a disk directory, storing file attribute information;
and if the backup object is a database, storing a sub-database below the database and table information contained in the database.
With reference to the second aspect, in a fourth possible implementation manner of the second aspect, the labeling, by the time navigation axis, the backup object as a change file specifically includes:
and the time navigation axis mounts corresponding files of the backup object at different time points on the time line and displays the files in different colors.
With reference to the second aspect, in a fifth possible implementation manner of the second aspect, the selecting a time node of a time navigation axis to perform a restore or backup operation on a file specifically includes:
judging whether the file is deleted before the current time point, if so, restoring the deleted file by accessing the file snapshot of the deletion time node; if not, accessing the file snapshot backup of the modification time node according to the file modification time, and realizing the access operation of the file before modification.
A third aspect of the present invention provides a visual data recovery apparatus, including:
the data backup module is used for backing up the data of the application client to a backup server by adopting a snapshot technology and establishing a file system description area;
the time navigation module establishes a time navigation axis through the time information in the Table in the file system description area;
and the file recovery module selects a time node of the time navigation axis and performs reduction or backup operation on the file.
The visualized data restoring apparatus according to the third aspect of the present invention can implement the method according to the second aspect, and achieve the same effects.
The effect provided in the summary of the invention is only the effect of the embodiment, not all the effects of the invention, and one of the above technical solutions has the following advantages or beneficial effects:
the invention can display the state of the files in the file system at any time point in the past or present moment instantly, including the existing or deleted files. The position of the deleted file can be quickly searched through the time axis. The state of the time point that the snapshot is taken in the past can be quickly restored through the time axis. The user can select the time depth, such as the past day, the past three days, and the past week, and search the snapshots that have been performed in the past time areas through the time axis, so that the user can selectively perform the restore operation.
Drawings
FIG. 1 is a schematic diagram of a file backup based time navigation system of the present invention;
FIG. 2 is a flow chart of a visual data recovery method of the present invention;
FIG. 3 is a schematic diagram illustrating a process for extracting status information of a file corresponding to a time axis according to an embodiment of the present invention;
FIG. 4 is a first schematic diagram of a reduction architecture according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a second exemplary embodiment of a reduction architecture;
fig. 6 is a schematic structural diagram of a visual data recovery device according to the present invention.
Detailed Description
In order to clearly explain the technical features of the present invention, the following detailed description of the present invention is provided with reference to the accompanying drawings. The following disclosure provides many different embodiments, or examples, for implementing different features of the invention. To simplify the disclosure of the present invention, the components and arrangements of specific examples are described below. Furthermore, the present invention may repeat reference numerals and/or letters in the various examples. This repetition is for the purpose of simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or configurations discussed. It should be noted that the components illustrated in the figures are not necessarily drawn to scale. Descriptions of well-known components and processing techniques and procedures are omitted so as to not unnecessarily limit the invention.
As shown in fig. 1, a time navigation system based on file backup includes:
the control module is arranged on the backup server, tracks each backup, filing and restoring session executed, and records time information, file attributes and position information stored in the medium module, wherein the time information, the file attributes and the position information are contained in time navigation;
the agent module: the backup server is arranged at the application client, allows the control module to track the configuration of the application client and allows the backup server to backup the formulated file system;
a media module: storing the backed-up data, including a common hard disk, a material tape library or a virtual tape library;
the management software module: and displaying a file list under a certain time node on a time axis, and operating backup and restoration actions, wherein the file list comprises files existing in the current time node and deleted files.
As shown in fig. 2, a visual data recovery method includes the following steps:
s1, backing up the application client data to the backup server by adopting the snapshot technology, and establishing a file system description area;
s2, establishing a time navigation axis through time information in a Table in a file system description area;
and S3, selecting a time navigation axis time node, and performing restoration or backup operation on the file.
In step S1, the application client data is backed up to the backup server by using snapshot technology, and a file system description area is established, which specifically includes:
s11, copying the file system description, and establishing a disk buffer area;
and S12, when the data block of the application client is modified, storing the data block before change into a disk buffer.
The file system description is a series of pointers that record the logical relationship of the data blocks on the disk. Assuming now that a data snapshot was generated at 10:00 am, then at 10:00 at this point, the snapshot function has to do the following three things: 1. the file system description is copied to a copy. 2. A buffer is created in disk free space. 3. And adding a judgment in the write operation of the file system to judge whether the application modifies the data for the first time. In the following 10: after 00, when an application wants to modify a data block, the snapshot function keeps the original data block in the buffer, and simultaneously, the access entry of the data snapshot is changed to point to the buffer. In the following 10: after 00, when an application wants to modify a data block, the snapshot function keeps the original data block in the buffer, and simultaneously, the access entry of the data snapshot is changed to point to the buffer.
In step S2, a time navigation axis is established through the time information in the Table in the file system description area, which specifically includes:
s21, periodically extracting the file system description information of the backup object, and storing the file system description information in a backup server database;
and S22, if the backup object changes in the time interval of two times of extraction, marking the backup object as a change file by the time navigation axis.
In step S21, the periodically extracting and storing the file system description information of the backup object in the backup server database specifically includes:
if the backup object is a file in a disk directory, storing file attribute information;
and if the backup object is a database, storing a sub-database below the database and table information contained in the database.
As shown in fig. 3, in step S22, the time navigation axis marks the backup object as a change file, which specifically includes: and the time navigation axis mounts corresponding files of the backup object at different time points on the time line and displays the files in different colors.
In step S3, selecting a time node of the time navigation axis to perform a restore or backup operation on the file, which specifically includes: judging whether the file is deleted before the current time point, if so, restoring the deleted file by accessing the file snapshot of the deletion time node; if not, accessing the file snapshot backup of the modification time node according to the file modification time, and realizing the access operation of the file before modification.
As shown in fig. 4 and 5, the user designates a certain time point, and displays the existence status of the files in the file system on the management software module, and the partially deleted files are represented by a blurring chart to represent that the files are currently deleted. The existing files can be normally backed up and restored; the deleted files can only be restored to the file form at any time point which has been backed up in the past. Through the time depth, such as the past day, the past three days, and the past week, snapshots which have been performed in the past time areas are searched through the time axis, so that the user can selectively perform the restoring operation.
As shown in fig. 6, a visual data recovery apparatus includes:
the data backup module 11 is used for backing up application client data to a backup server by adopting a snapshot technology and establishing a file system description area;
the time navigation module 12 establishes a time navigation axis through the time information in the Table in the file system description area;
and the file recovery module 13 selects a time node of the time navigation axis to perform reduction or backup operation on the file.
Although the embodiments of the present invention have been described with reference to the accompanying drawings, it is not intended to limit the scope of the present invention, and it should be understood by those skilled in the art that various modifications and variations can be made without inventive efforts by those skilled in the art based on the technical solution of the present invention.
Claims (6)
1. A time navigation system based on file backup is characterized by comprising: the control module is arranged on the backup server, tracks each backup, filing and restoring session executed, and records time information, file attributes and position information stored in the medium module, wherein the time information, the file attributes and the position information are contained in time navigation; the agent module: the backup server is arranged at the application client, allows the control module to track the configuration of the application client and allows the backup server to backup the formulated file system; a media module: storing the backed-up data, including a common hard disk, a material tape library or a virtual tape library; the management software module: displaying a file list under a certain time node on a time axis, and operating backup and restoration actions, wherein the file list comprises files existing in the current time node and deleted files; the method for establishing the file system description area by using the snapshot technology to backup application client data to a backup server specifically comprises the following steps: copying the file system description and establishing a disk buffer area; when the data block of the application client is modified, storing the data block before change into a disk buffer area; periodically extracting file system description information of a backup object, and storing the file system description information to a backup server database, wherein the method specifically comprises the following steps: if the backup object is a file in a disk directory, storing file attribute information; and if the backup object is a database, storing a sub-database below the database and table information contained in the database.
2. A visual data recovery method using the system of claim 1, comprising the steps of: backup application client data to a backup server by adopting a snapshot technology, and establishing a file system description area; establishing a time navigation axis through time information in a Table in a file system description area; and selecting a time node of a time navigation axis, and performing reduction or backup operation on the file.
3. The method according to claim 2, wherein the establishing a time navigation axis through the time information in the Table in the file system description area specifically comprises: periodically extracting file system description information of a backup object, and storing the file system description information to a backup server database; and if the backup object changes in the time interval of two times of extraction, the time navigation axis marks the backup object as a change file.
4. The method as claimed in claim 3, wherein the time navigation axis marks the backup object as a change file, and specifically comprises: and the time navigation axis mounts corresponding files of the backup object at different time points on the time line and displays the files in different colors.
5. The method as claimed in claim 2, wherein said selecting a time navigation axis time node to perform a restore or backup operation on the file comprises: judging whether the file is deleted before the current time point, if so, restoring the deleted file by accessing the file snapshot of the deletion time node; if not, accessing the file snapshot backup of the modification time node according to the file modification time, and realizing the access operation of the file before modification.
6. A visual data recovery apparatus, comprising: the data backup module is used for backing up the data of the application client to a backup server by adopting a snapshot technology and establishing a file system description area; the time navigation module establishes a time navigation axis through the time information in the Table in the file system description area; the file recovery module selects a time node of a time navigation axis and performs reduction or backup operation on the file; the method for establishing the file system description area by using the snapshot technology to backup application client data to a backup server specifically comprises the following steps: copying the file system description and establishing a disk buffer area; when the data block of the application client is modified, storing the data block before change into a disk buffer area; periodically extracting file system description information of a backup object, and storing the file system description information to a backup server database, wherein the method specifically comprises the following steps: if the backup object is a file in a disk directory, storing file attribute information; and if the backup object is a database, storing a sub-database below the database and table information contained in the database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811357993.2A CN109542681B (en) | 2018-11-15 | 2018-11-15 | Time navigation system based on file backup, and visual data recovery method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811357993.2A CN109542681B (en) | 2018-11-15 | 2018-11-15 | Time navigation system based on file backup, and visual data recovery method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109542681A CN109542681A (en) | 2019-03-29 |
| CN109542681B true CN109542681B (en) | 2021-11-26 |
Family
ID=65847526
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811357993.2A Active CN109542681B (en) | 2018-11-15 | 2018-11-15 | Time navigation system based on file backup, and visual data recovery method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109542681B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110362424B (en) * | 2019-05-23 | 2020-12-04 | 上海英方软件股份有限公司 | Rapid recovery method and system based on continuous data protection |
| CN110633129A (en) * | 2019-08-23 | 2019-12-31 | 北京浪潮数据技术有限公司 | Continuous data protection method, device and equipment for virtualization platform |
| CN114218013A (en) * | 2021-12-13 | 2022-03-22 | 北京字节跳动网络技术有限公司 | Searching method, searching device and electronic equipment storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101216794A (en) * | 2008-01-18 | 2008-07-09 | 杭州华三通信技术有限公司 | Improved Server-Less backup method, memory apparatus and backup server |
| CN103098016A (en) * | 2010-07-15 | 2013-05-08 | 戴尔菲克斯公司 | De-duplication based backup of file systems |
| CN104040481A (en) * | 2011-11-18 | 2014-09-10 | 戴尔软件股份有限公司 | Method Of And System For Merging, Storing And Retrieving Incremental Backup Data |
| CN104933133A (en) * | 2015-06-12 | 2015-09-23 | 中国科学院计算技术研究所 | Metadata snap storage and access method in distributed file system |
| CN105808381A (en) * | 2016-03-05 | 2016-07-27 | 成都云祺科技有限公司 | Instant recovery method of virtual machine |
| CN106354582A (en) * | 2016-08-18 | 2017-01-25 | 无锡华云数据技术服务有限公司 | Continuous data protection method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8548959B2 (en) * | 2010-11-29 | 2013-10-01 | Ca, Inc. | System and method for minimizing data recovery window |
| US9563518B2 (en) * | 2014-04-02 | 2017-02-07 | Commvault Systems, Inc. | Information management by a media agent in the absence of communications with a storage manager |
-
2018
- 2018-11-15 CN CN201811357993.2A patent/CN109542681B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101216794A (en) * | 2008-01-18 | 2008-07-09 | 杭州华三通信技术有限公司 | Improved Server-Less backup method, memory apparatus and backup server |
| CN103098016A (en) * | 2010-07-15 | 2013-05-08 | 戴尔菲克斯公司 | De-duplication based backup of file systems |
| CN104040481A (en) * | 2011-11-18 | 2014-09-10 | 戴尔软件股份有限公司 | Method Of And System For Merging, Storing And Retrieving Incremental Backup Data |
| CN104933133A (en) * | 2015-06-12 | 2015-09-23 | 中国科学院计算技术研究所 | Metadata snap storage and access method in distributed file system |
| CN105808381A (en) * | 2016-03-05 | 2016-07-27 | 成都云祺科技有限公司 | Instant recovery method of virtual machine |
| CN106354582A (en) * | 2016-08-18 | 2017-01-25 | 无锡华云数据技术服务有限公司 | Continuous data protection method |
Non-Patent Citations (1)
| Title |
|---|
| 广域网络备份系统中数据备份代理的研究与实现;代玥;《万方平台》;20110314;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109542681A (en) | 2019-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10997035B2 (en) | Using a snapshot as a data source | |
| US9934104B2 (en) | Metadata generation for incremental backup | |
| CN109542681B (en) | Time navigation system based on file backup, and visual data recovery method and device | |
| CN110851302B (en) | Database information backup method and database information recovery method | |
| US8868507B2 (en) | Method and apparatus for data recovery using storage based journaling | |
| AU700681B2 (en) | A method of operating a computer system | |
| US8170994B2 (en) | Techniques for virtual archiving | |
| US7802134B1 (en) | Restoration of backed up data by restoring incremental backup(s) in reverse chronological order | |
| US20070208918A1 (en) | Method and apparatus for providing virtual machine backup | |
| US9529806B1 (en) | Method and apparatus for performing granular restoration of data objects from machine images stored on sequential backup media | |
| US11579986B2 (en) | Data query method and apparatus | |
| EP3451173A1 (en) | Restoring a database using a fully hydrated backup | |
| EP1470485A2 (en) | Method and system for providing image incremental and disaster recovery | |
| US10275315B2 (en) | Efficient backup of virtual data | |
| JP2017514223A (en) | Method, system and computer program for maintaining source data in a repository | |
| CN104360914A (en) | Incremental snapshot method and device | |
| CN112256400A (en) | Virtual machine snapshot management method and device | |
| US11461190B2 (en) | Filesystem operation bookmarking for any point in time replication | |
| CN110471796B (en) | File directory-oriented full and incremental backup recovery method | |
| WO2017067397A1 (en) | Data recovery method and device | |
| US11403192B1 (en) | Enabling point-in-time recovery for databases that change transaction log recovery models | |
| CN115658391A (en) | Backup recovery method of WAL mechanism based on QianBase MPP database | |
| CN113986616A (en) | Method and system suitable for Hive data warehouse to perform data backup and recovery | |
| WO2023098984A1 (en) | Control unit for controlling a data storage system and method of recovering data from an object storage | |
| CN117931514A (en) | Backup method, recovery method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |