CN106708830A - Data recovery method based on large database - Google Patents
Data recovery method based on large database Download PDFInfo
- Publication number
- CN106708830A CN106708830A CN201510466242.4A CN201510466242A CN106708830A CN 106708830 A CN106708830 A CN 106708830A CN 201510466242 A CN201510466242 A CN 201510466242A CN 106708830 A CN106708830 A CN 106708830A
- Authority
- CN
- China
- Prior art keywords
- data
- database
- field
- record
- data recovery
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data recovery method based on a large database. The data recovery method comprises the following steps that S1, a database backup or a database design document is found out; S2, a data table needing data recovery is found; S3, the logical structure relation of records is determined; S4, structures of fields are determined; S5, all record heads are analyzed; S6, the fields are separated; S7, data is extracted. The data recovery method has the advantages that the records and fields in the data table are parsed by adopting a database structure, structural division data of heads of all the records and the fields is found and then is extracted, the data recovery efficiency is high, fragment-level databases with damaged data and discontinuous data can be also normally extracted and recovered, the data recovery success rate is high, and loss caused by database damage is effectively reduced.
Description
Technical field
The present invention relates to field of information security technology, more particularly to a kind of data reconstruction method based on large database.
Background technology
Database (Database) is the warehouse that data are organized, store and managed according to data structure, it was resulted from before more than 60 years the present, with the development in information technology and market, particularly after nineteen nineties, data management is no longer only to store and management data, and the mode of the various data managements required for being transformed into user.Database has number of different types, is all widely used in all fields to the large-scale database system that can carry out mass data storage from the form of the simplest various data that are stored with；Database (DataBase, DB) refers to the associated structured data acquisition system rationally deposited in the storage device of computer.One database contains various composition, including table, view, storing process, record, field, index etc.；
But database can also break down sometimes, lead to not access data, have following several the reason for wherein database corruption is common：Transaction journal problem.Such as transaction log file is lost；Transaction log file is deleted by mistake in operation；Transaction log file is damaged and transaction log file is excessive, causes insufficient space of hard disk etc.；Unexpected power down or abnormal forced shutdown, cause data file to damage, and major database is shut down during read-write extremely；The table of database is destroyed or index etc. is destroyed, or other objects of database are destroyed or lose etc.；Delete data file, or the name that have changed it；Hard disk corruptions, cause data and journal file read-write error etc.；These wrong some databases oneself can be to take disaster tolerance mechanism to process, ensure that data can be accessed normally, but it is directed to database table destruction, database is deleted, or data file is deleted, now database cannot be repaired in itself, it is accomplished by a special method to solve these problems, solution is mostly the database file for recovering to lose, and then recovery record, but if file is stored in the form of fragment, there are some methods for recovering database just to have no way of doing it on the market；It is accomplished by using according to the method for recording feature at this moment completing data recovery, farthest saves the integrality of critical data from damage.
The present invention relates to part technical term：
Database：It refer to the associated structured data acquisition system rationally deposited in the storage device of computer.One database contains various composition, including table, view, storing process, record, field, index etc., the database used in Visual Basic is relevant database (Relational Database).One database is made up of one or one group of tables of data.Each database is stored on disk in the form of a file, i.e., corresponding to a physical file.Different databases, mode corresponding with physical file is also different.For dBASE, for the database of FoxPro and Paradox forms, a tables of data is exactly a single database file, and for the database of Microsoft Access, Btrieve forms, a database file can contain multiple tables of data.
Tables of data：Abbreviation table, is made up of one group of data record, and the data in database are organized in units of table.One table is one group of related data by rows；Information containing same type in each table.
Record：Every a line in table is referred to as a record, and it is made up of several fields.
Field：Also referred to as domain.Each row in table are referred to as a field.Each field has corresponding description information, such as data type, data width.
The content of the invention
A kind of defect of the present invention for prior art, there is provided data reconstruction method based on large database, can effectively solve the problem that the problem that above-mentioned prior art is present.
In order to realize above goal of the invention, the technical scheme that the present invention takes is as follows：
A kind of data reconstruction method based on large database, comprises the following steps：
S1：DB Backup or database design documentation are found, the parameter in database is determined：Determine data list structure；
S2：DB Backup or database design documentation in S1 select and find the tables of data for needing to recover data, and obtain the information of table；
S3：Tables of data according to S2 determines the logical construction relation of each record in tables of data；
S4：Data type, data length, data row's logical order of each field in record are determined according to S3；
S5：The head feature of all records is analyzed, the head position of all records is found；
S6：Field structure information according to S4, the field after all record heads is separated according to field size；
S7：Whole parameters according to S1, S2, S3, S4 extract the data in database according to record with the spaced relation of field.
Compared with prior art the advantage of the invention is that：By database structure, record and field in parsing tables of data, the structure for finding every head for recording and field divides extraction after data, recover data efficiency high, to corrupted data, the discontinuous fragment DBMS storehouse of data can also normal extraction and recovery, data recovery success rate is high, and effective reduction factor damages the loss for bringing according to storehouse.
Specific embodiment
To make the objects, technical solutions and advantages of the present invention become more apparent, by the following examples, the present invention is described in further details.
A kind of data reconstruction method based on large database, comprises the following steps：
S1：DB Backup or database design documentation are found, the parameter in database is determined：Determine data list structure；
S2：DB Backup or database design documentation in S1 select and find the tables of data for needing to recover data, and obtain the information of table；
S3：Tables of data according to S2 determines the logical construction relation of each record in tables of data；
S4：Data type, data length, data row's logical order of each field in record are determined according to S3；
S5：Can there is a feature string and mark every head of record in database, retrieve the head feature of all records in bottom storage, all, find the head of all records；
S6：In tables of data record determine field composition structure, can according to record put in order, the field structure that the data type of field, data width information are obtained, according to said structure separate it is all record heads behind fields；
S7：The data in database are extracted with the spaced relation of field according to record.
Data are extracted according to relation chain, relation chain draws according to field with actual data storage, elongated relation and fixed length relation can be divided into.
Elongated relation be exactly when bottom is stored field length record in information before field contents, field length description plus field contents structure.
In bottom, each field is stored according to fixed length to fixed length relation, and field is distinguished by fixed length, extracts data.
Embodiment one：A kind of data reconstruction method based on SQLServer databases
S1：SQLServer DB Backups or database design documentation are looked for, the parameter in database is determined；
S2：DB Backup or database design documentation in S1 select and find the tables of data for needing to recover data, and obtain all information of table；
S3：Tables of data according to S2 can obtain the logical construction relation of each record in tables of data；For example there is the relation of the fields such as vip_no, vip_name, vip_pass, sex, brithday in table
S4：Type declaration according to database can obtain the specifying information of field with the design documentation of database；Each field has corresponding description information, such as data type, data length, data row's logical order, it is char that we obtain vip_no types in this embodiment, length is that 20 bytes, vip_name types are char, char when length is 20 bytes, vip_pass types, int when length is 10 bytes, sex types, length is that 4 bytes, brithday types are T_data：Datatime length is 8 bytes etc..
S5：Can there is a feature string and mark every head of record in database, retrieve the head feature of all records in bottom storage, all, find the head of all records；It is usually to use four bytes as data characteristics head in sqlserver databases, for example：" 0x1000A001 " four bytes are exactly a data characteristics head.
S6：In tables of data record determine field composition structure, can according to record put in order, the field structure that the data type of field, data width information are obtained, according to said structure separate it is all record heads behind fields；
S7：The data in database are extracted with the spaced relation of field according to record.For example in the present embodiment, every record uses vip_no, vip_name, vip_pass, sex, brithday etc.；Field vip_no types are char, and length is that 20 bytes, vip_name types are char, char when length is 20 bytes, vip_pass types, int when length is 10 bytes, sex types, and length is that 4 bytes, brithday types are T_data：Datatime length is 8 bytes etc., and the type and length of each field are fixed, and we extract data according to record with the relation of field.
One of ordinary skill in the art will be appreciated that embodiment described here is to aid in reader and understands implementation of the invention, it should be understood that protection scope of the present invention is not limited to such especially statement and embodiment.One of ordinary skill in the art can make various other various specific deformations and combination for not departing from essence of the invention according to these technical inspirations disclosed by the invention, and these deformations and combination are still within the scope of the present invention.
Claims (1)
1. a kind of data reconstruction method based on large database, it is characterised in that comprise the following steps：
S1：DB Backup or database design documentation are found, the parameter in database is determined：Determine number
According to table structure；
S2：DB Backup or database design documentation in S1 select and find to need to recover number
According to tables of data, and obtain the information of table；
S3：Tables of data according to S2 determines the logical construction relation of each record in tables of data；
S4：Data type, data length, data row's logic of each field in record are determined according to S3
Sequentially；
S5：The head feature of all records is analyzed, the head position of all records is found；
S6：Field structure information according to S4, the field after all record heads is separated according to field size；
S7：Whole parameters according to S1, S2, S3, S4 are extracted according to record with the spaced relation of field
Data in database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510466242.4A CN106708830B (en) | 2015-08-03 | 2015-08-03 | Data recovery method based on large database |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510466242.4A CN106708830B (en) | 2015-08-03 | 2015-08-03 | Data recovery method based on large database |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106708830A true CN106708830A (en) | 2017-05-24 |
| CN106708830B CN106708830B (en) | 2020-08-14 |
Family
ID=58923198
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510466242.4A Active CN106708830B (en) | 2015-08-03 | 2015-08-03 | Data recovery method based on large database |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106708830B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109492001A (en) * | 2018-10-15 | 2019-03-19 | 四川巧夺天工信息安全智能设备有限公司 | A method of crumb data in ACCESS database is extracted in classification |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1492362A (en) * | 2002-10-25 | 2004-04-28 | 联想(北京)有限公司 | Data back up and recovering method of embedded data bank |
| CN102063491A (en) * | 2010-12-30 | 2011-05-18 | 浪潮集团山东通用软件有限公司 | Data structure capable of realizing data back-up and restoration of different types of databases and realization method |
| CN102117623A (en) * | 2009-12-30 | 2011-07-06 | 北大方正集团有限公司 | Method and device for recovering magnetic tape metadata |
| US20140279930A1 (en) * | 2013-03-15 | 2014-09-18 | Amazon Technologies, Inc. | Fast crash recovery for distributed database systems |
-
2015
- 2015-08-03 CN CN201510466242.4A patent/CN106708830B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1492362A (en) * | 2002-10-25 | 2004-04-28 | 联想(北京)有限公司 | Data back up and recovering method of embedded data bank |
| CN102117623A (en) * | 2009-12-30 | 2011-07-06 | 北大方正集团有限公司 | Method and device for recovering magnetic tape metadata |
| CN102063491A (en) * | 2010-12-30 | 2011-05-18 | 浪潮集团山东通用软件有限公司 | Data structure capable of realizing data back-up and restoration of different types of databases and realization method |
| US20140279930A1 (en) * | 2013-03-15 | 2014-09-18 | Amazon Technologies, Inc. | Fast crash recovery for distributed database systems |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109492001A (en) * | 2018-10-15 | 2019-03-19 | 四川巧夺天工信息安全智能设备有限公司 | A method of crumb data in ACCESS database is extracted in classification |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106708830B (en) | 2020-08-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105068887B (en) | It is a kind of based on the data reconstruction method for being damaged SQLServer database | |
| CN105068888A (en) | Oracle database based data recovery method | |
| US9727422B2 (en) | Tracking files excluded from backup | |
| US8949190B2 (en) | Point-in-time database recovery using log holes | |
| CN104933133B (en) | Meta-data snap in distributed file system stores and accesses method | |
| US9058371B2 (en) | Distributed database log recovery | |
| CN1707481B (en) | Systems and methods for automatic database or file system maintenance and repair | |
| CN108319602B (en) | Database management method and database system | |
| US9298578B2 (en) | Method and apparatus for power loss recovery in a flash memory-based SSD | |
| US8667033B1 (en) | Persistent file system objects for management of databases | |
| CN103914359B (en) | A kind of data reconstruction method and device | |
| CN105677876B (en) | A kind of database journal method for digging based on physical level | |
| US7406489B2 (en) | Apparatus, system and method for persistently storing data in a data synchronization process | |
| CN103617277A (en) | Method for restoring data table content deleted mistakenly | |
| US9471622B2 (en) | SCM-conscious transactional key-value store | |
| US10459804B2 (en) | Database rollback using WAL | |
| CN109101365A (en) | A kind of data backup and resume method deleted again based on source data | |
| CN107111460A (en) | Use the data de-duplication of block file | |
| CN106897174B (en) | Fragment recovery method for MYSQL database | |
| CN105447168A (en) | Method for restoring and recombining fragmented files in MP4 format | |
| CN102521385B (en) | Method for setting forced access control on database system graph | |
| CN106708830A (en) | Data recovery method based on large database | |
| CN103207916A (en) | Metadata processing method and device | |
| CN110764943B (en) | Data processing method and device of Oracle database | |
| CN105068893A (en) | Database state restoration method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 641000 Sichuan province Neijiang City Songshan Road No. 183 Applicant after: SICHUAN XLY INFORMATION SAFETY TECHNOLOGY CO., LTD. Address before: 641000 Sichuan province Neijiang City Songshan Road No. 183 Applicant before: Sichuan SalvationData Information Safety Technology Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |