CN112948181A - Data modification backup recovery system - Google Patents
Data modification backup recovery system Download PDFInfo
- Publication number
- CN112948181A CN112948181A CN202110301518.9A CN202110301518A CN112948181A CN 112948181 A CN112948181 A CN 112948181A CN 202110301518 A CN202110301518 A CN 202110301518A CN 112948181 A CN112948181 A CN 112948181A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- backup
- modification
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012986 modification Methods 0.000 title claims abstract description 64
- 230000004048 modification Effects 0.000 title claims abstract description 64
- 238000011084 recovery Methods 0.000 title claims abstract description 42
- 238000000034 method Methods 0.000 claims description 15
- 230000002159 abnormal effect Effects 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 claims description 3
- 230000001960 triggered effect Effects 0.000 claims description 3
- 238000012545 processing Methods 0.000 abstract description 6
- 238000012827 research and development Methods 0.000 abstract description 2
- 238000012550 audit Methods 0.000 description 6
- 238000007726 management method Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/44—Program or device authentication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/64—Protecting data integrity, e.g. using checksums, certificates or signatures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Quality & Reliability (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention belongs to the technical field of software, and particularly relates to a data modification backup recovery system which comprises a receiving module, a generating module, an executing module, a backup module, a modifying module and a data recovery module, wherein the receiving module is used for receiving a data modification request which is provided by a user and carries SQL statements and creating information to be modified; the execution module is used for responding to a data modification request of a user and executing an SQL statement; the data modification backup recovery system of the invention better improves the safety and stability of the modified data, reduces the manual processing flow when the system needs to reply, greatly reduces the time efficiency of research and development personnel for processing the problem, has strong universality, can solve the problem that the data cannot be recovered and recorded due to modification of rear-end developers, and more safely and stably ensures the completeness of the system data; data recovery can be automatically performed as required, so that the integrity of data is guaranteed, and the storage space is saved.
Description
Technical Field
The invention belongs to the technical field of software, and particularly relates to a set of data modification backup and recovery system.
Background
Software is a series of computer data and instruction sets organized in a specific order, generally, the software is divided into system software, application software and middleware between the two, the software includes not only computer programs that can run on a computer (the computer is a computer in a broad sense), but also documents related to the computer programs are generally considered as a part of the software, and simply, the software is a collection of programs and documents, and also generally refers to a management system, an ideological form, an ideological thinking, a legal regulation and the like in a social structure.
The structured query language is a high-level non-procedural programming language, allows a user to work on a high-level data structure, does not require the user to specify a storage method for data, and does not need the user to know a specific data storage mode, so that different database systems with completely different underlying structures can use the same structured query language as an interface for data input and management, and structured query language statements can be nested, so that the structured query language has great flexibility and powerful functions.
In normal system maintenance, some data in a database needs to be modified, deleted and added, and this part of data may affect normal service functions due to missing, and the currently common remedy is: gradually restoring the data before modification according to the modified data; the method needs to accurately record and store the modified data, but if the modified data volume is huge or the stored record is lost, and the modified record and the service to be recovered can be processed after a long time, more time needs to be spent.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides a set of data modification backup recovery system which has the characteristics of convenient processing and rapid processing.
In order to achieve the purpose, the invention provides the following technical scheme: the data modification backup recovery system comprises a receiving module, a generating module, an executing module, a backup module, a modifying module and a data recovery module, wherein the receiving module is used for receiving a data modification request which is provided by a user and carries SQL statements and creating information to be modified;
the execution module is used for responding to a data modification request of a user and executing an SQL statement;
the backup module is used for backing up the information to be modified to generate backup data;
the modification module is used for modifying the information to be modified into target information;
the data recovery module is used for executing data recovery operation on the target information according to the requirement.
As a preferred technical solution of the present invention, the information to be modified includes a target script name, a target problem management number, a table name of a source table, a field to be modified, and a modification type.
As a preferred technical solution of the present invention, the data modification backup and recovery system includes an audit module, and the audit module is configured to audit the target information and the backup information and determine whether the data modification is accurate.
As a preferred technical solution of the present invention, the backup module includes the following steps:
the method comprises the following steps: setting two data nodes on a control node, and setting the two data nodes as a main data node and a backup data node respectively;
step two: establishing a transmission path of a main data node and a backup data node;
step three: and backing up the memory data on the control node according to the received data to be backed up and sending the backup data to the backup data node.
As a preferred technical solution of the present invention, the backup module further includes:
step four: and judging whether the information of the backup data is the same as the information of the target data.
As a preferred technical solution of the present invention, the modifying module includes the steps of:
the method comprises the following steps: a user puts forward a data modification request carrying SQL statements, creates information to be modified and generates a modification script;
step two: and executing the SQL statement, and executing modification operation on the data to be modified according to the modification script information.
As a preferred technical solution of the present invention, the modification module further obtains a correct modification type according to the modification script information, and modifies the information to be modified into the target information.
As a preferred technical solution of the present invention, the data recovery module includes the following steps:
the method comprises the following steps: acquiring the information of backup data and the judgment result of target data;
step two: returning the judgment result to the main data node;
step three: if the target data is abnormal, a recovery request is sent to the main data node;
step four: data recovery is performed.
As a preferred technical solution of the present invention, the recovery request is an SQL request.
As a preferred technical solution of the present invention, the method further includes setting a trigger module on the primary data node, and when the primary data node receives the target data exception information, the trigger module is triggered and automatically executes a data recovery request, and returns the target data to the data to be modified.
Compared with the prior art, the invention has the beneficial effects that: the data modification backup recovery system of the invention better improves the safety and stability of the modified data, reduces the manual processing flow when the system needs to reply, greatly reduces the time efficiency of research and development personnel for processing the problem, has strong universality, can solve the problem that the data cannot be recovered and recorded due to modification of rear-end developers, and more safely and stably ensures the completeness of the system data; data recovery can be automatically performed as required, so that the integrity of data is guaranteed, and the storage space is saved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention.
In the drawings: FIG. 1 is a schematic process flow diagram of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the present invention provides the following technical solutions: the data modification backup recovery system comprises a receiving module, a generating module, an executing module, a backup module, a modifying module and a data recovery module, wherein the receiving module is used for receiving a data modification request which is provided by a user and carries SQL statements and creating information to be modified;
the execution module is used for responding to a data modification request of a user and executing the SQL statement;
the backup module is used for backing up the information to be modified and generating backup data;
the modification module is used for modifying the information to be modified into target information;
the data recovery module is used for executing data recovery operation on the target information according to the requirement.
Specifically, in this embodiment, the information to be modified includes a target script name, a target problem management number, a table name of a source table, a field to be modified, and a modification type.
Specifically, in this embodiment, the data modification backup and recovery system includes an auditing module, where the auditing module is configured to audit the target information and the backup information and determine whether the data modification is accurate.
Specifically, in this embodiment, the backup module includes the following steps:
the method comprises the following steps: setting two data nodes on a control node, and setting the two data nodes as a main data node and a backup data node respectively;
step two: establishing a transmission path of a main data node and a backup data node;
step three: and backing up the memory data on the control node according to the received data to be backed up and sending the backup data to the backup data node.
Specifically, in this embodiment, the backup module further includes:
step four: and judging whether the information of the backup data is the same as the information of the target data.
Specifically, in this embodiment, the modifying module includes the following steps:
the method comprises the following steps: a user puts forward a data modification request carrying SQL statements, creates information to be modified and generates a modification script;
step two: and executing the SQL statement, and executing modification operation on the data to be modified according to the modification script information.
Specifically, in this embodiment, the modifying module further obtains a correct modification type according to the modification script information, and modifies the information to be modified into the target information.
Specifically, in this embodiment, the data recovery module includes the following steps:
the method comprises the following steps: acquiring the information of backup data and the judgment result of target data;
step two: returning the judgment result to the main data node;
step three: if the target data is abnormal, a recovery request is sent to the main data node;
step four: data recovery is performed.
Specifically, in this embodiment, the recovery request is an SQL request.
Specifically, in this embodiment, the method further includes setting a trigger module on the master data node, and when the master data node receives the target data exception information, the trigger module is triggered and automatically executes a data recovery request, and returns the target data to the data to be modified.
S1, the developer writes the SQL sentence to be executed, and submits the SQL sentence in the system, and according to the SQL sentence, the system can automatically evaluate the data volume to be adjusted by the SQL;
s2, the SQL reviewer audits according to the evaluation condition given by the system, and after the audit is passed, the SQL statement is issued and executed, and the system data is backed up;
and S3, after the execution, the system stores the history record, and if the recovery condition exists, the system can perform one-key recovery to reduce the slow condition caused by the recovery.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A set of data modification backup recovery system is characterized in that: comprises a receiving module, a generating module, an executing module, a backup module, a modifying module and a data restoring module, wherein,
the receiving module is used for receiving a data modification request which is provided by a user and carries SQL statements and creating information to be modified;
the execution module is used for responding to a data modification request of a user and executing an SQL statement;
the backup module is used for backing up the information to be modified to generate backup data;
the modification module is used for modifying the information to be modified into target information;
the data recovery module is used for executing data recovery operation on the target information according to the requirement.
2. The set of data modification backup-restore systems of claim 1, wherein: the information to be modified comprises a target script name, a target problem management number, a table name of a source table, a field to be modified and a modification type.
3. The set of data modification backup-restore systems of claim 1, wherein: the data modification backup recovery system comprises an auditing module, and the auditing module is used for auditing the target information and the backup information and judging whether the data modification is accurate or not.
4. The set of data modification backup-restore systems of claim 1, wherein: the backup module comprises the following steps:
the method comprises the following steps: setting two data nodes on a control node, and setting the two data nodes as a main data node and a backup data node respectively;
step two: establishing a transmission path of a main data node and a backup data node;
step three: and backing up the memory data on the control node according to the received data to be backed up and sending the backup data to the backup data node.
5. The set of data modification backup-restore systems of claim 4, wherein: the backup module further comprises:
step four: and judging whether the information of the backup data is the same as the information of the target data.
6. The set of data modification backup-restore systems of claim 1, wherein: the modification module comprises the following steps:
the method comprises the following steps: a user puts forward a data modification request carrying SQL statements, creates information to be modified and generates a modification script;
step two: and executing the SQL statement, and executing modification operation on the data to be modified according to the modification script information.
7. The set of data modification backup-restore systems of claim 6, wherein: the modification module also acquires a correct modification type according to the modification script information and modifies the information to be modified into target information.
8. The set of data modification backup-restore systems of claim 4, wherein: the data recovery module comprises the following steps:
the method comprises the following steps: acquiring the information of backup data and the judgment result of target data;
step two: returning the judgment result to the main data node;
step three: if the target data is abnormal, a recovery request is sent to the main data node;
step four: data recovery is performed.
9. The set of data modification backup-restore systems of claim 8, wherein: the recovery request is an SQL request.
10. The set of data modification backup-restore systems of claim 9, wherein: the method also comprises the step of setting a trigger module on the main data node, wherein after the main data node receives the target data abnormal information, the trigger module is triggered and automatically executes a data recovery request, and the target data is returned to the data to be modified.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110301518.9A CN112948181A (en) | 2021-03-22 | 2021-03-22 | Data modification backup recovery system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110301518.9A CN112948181A (en) | 2021-03-22 | 2021-03-22 | Data modification backup recovery system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112948181A true CN112948181A (en) | 2021-06-11 |
Family
ID=76227455
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110301518.9A Pending CN112948181A (en) | 2021-03-22 | 2021-03-22 | Data modification backup recovery system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112948181A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104866388A (en) * | 2014-02-24 | 2015-08-26 | 腾讯科技（北京）有限公司 | Data processing method and device |
| US20160371152A1 (en) * | 2015-06-19 | 2016-12-22 | Kaspersky Lab Zao | System and method of restoring modified data |
| CN106547646A (en) * | 2015-09-23 | 2017-03-29 | 阿里巴巴集团控股有限公司 | A kind of data backup and restoration methods, data backup and recovery device |
| CN109471857A (en) * | 2018-09-25 | 2019-03-15 | 中国平安人寿保险股份有限公司 | Data modification method, device and storage medium based on SQL statement |
| CN110716828A (en) * | 2019-10-09 | 2020-01-21 | 苏州听风见雨网络科技有限公司 | Real-time database backup method |
| CN110941630A (en) * | 2019-10-25 | 2020-03-31 | 泰康保险集团股份有限公司 | Database operation and maintenance method, device and system |
| CN111880966A (en) * | 2020-07-09 | 2020-11-03 | 腾讯科技（深圳）有限公司 | Database data recovery method and device |
-
2021
- 2021-03-22 CN CN202110301518.9A patent/CN112948181A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104866388A (en) * | 2014-02-24 | 2015-08-26 | 腾讯科技（北京）有限公司 | Data processing method and device |
| US20160371152A1 (en) * | 2015-06-19 | 2016-12-22 | Kaspersky Lab Zao | System and method of restoring modified data |
| CN106547646A (en) * | 2015-09-23 | 2017-03-29 | 阿里巴巴集团控股有限公司 | A kind of data backup and restoration methods, data backup and recovery device |
| CN109471857A (en) * | 2018-09-25 | 2019-03-15 | 中国平安人寿保险股份有限公司 | Data modification method, device and storage medium based on SQL statement |
| CN110716828A (en) * | 2019-10-09 | 2020-01-21 | 苏州听风见雨网络科技有限公司 | Real-time database backup method |
| CN110941630A (en) * | 2019-10-25 | 2020-03-31 | 泰康保险集团股份有限公司 | Database operation and maintenance method, device and system |
| CN111880966A (en) * | 2020-07-09 | 2020-11-03 | 腾讯科技（深圳）有限公司 | Database data recovery method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8108343B2 (en) | De-duplication and completeness in multi-log based replication | |
| US8938421B2 (en) | Method and a system for synchronizing data | |
| CN102262680B (en) | Distributed database proxy system based on massive data access requirement | |
| US8874519B1 (en) | Method and apparatus for restoring a table in a database | |
| CN103514223A (en) | Data synchronism method and system of database | |
| CN111930489B (en) | Task scheduling method, device, equipment and storage medium | |
| US12093241B2 (en) | Method for replaying log on data node, data node, and system | |
| CN106371953B (en) | Compact binary event log generation method and system | |
| CN110489310B (en) | Method and device for recording user operation, storage medium and computer equipment | |
| CN110674161A (en) | Method, system, storage medium and SQL operation platform for online SQL | |
| US20200089792A1 (en) | Consistency checks between database systems | |
| CN112559140B (en) | Transaction control method, system, equipment and storage medium for data consistency | |
| CN111240891A (en) | Data recovery method and device based on data consistency among multiple tables of database | |
| CN112395307A (en) | Statement execution method, statement execution device, server and storage medium | |
| CN116501700B (en) | APP formatted file offline storage method, device, equipment and storage medium | |
| CN111259082B (en) | Method for realizing full data synchronization in big data environment | |
| CN108280097B (en) | Fault processing method and device for database system | |
| CN117290449A (en) | Database idempotent data increment synchronization method and system for statement level log | |
| CN113760491A (en) | Task scheduling system, method, equipment and storage medium | |
| CN112948181A (en) | Data modification backup recovery system | |
| CN112835887A (en) | Database management method, database management device, computing equipment and storage medium | |
| KR20170130911A (en) | Method for Performing Real-Time Changed Data Publish Service of DDS-DBMS Integration Tool | |
| CN112765126B (en) | Database transaction management method, device, computer equipment and storage medium | |
| CN113626423B (en) | Log management method, device and system of business database | |
| CN114443371A (en) | Timing backup method and system based on domestic distributed database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210611 |
|
| RJ01 | Rejection of invention patent application after publication |