CN101887388A - Data backup system and method based on memory database - Google Patents
Data backup system and method based on memory database Download PDFInfo
- Publication number
- CN101887388A CN101887388A CN2010102073244A CN201010207324A CN101887388A CN 101887388 A CN101887388 A CN 101887388A CN 2010102073244 A CN2010102073244 A CN 2010102073244A CN 201010207324 A CN201010207324 A CN 201010207324A CN 101887388 A CN101887388 A CN 101887388A
- Authority
- CN
- China
- Prior art keywords
- data
- backup
- memory database
- module
- access
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses data backup system and method based on a memory database. The system comprises the memory database, a proxy module and a backup manager, wherein the backup manager is used for issuing a backup strategy to the proxy module, wherein the backup strategy contains data that needs to be backed-up; and the proxy module is used for accessing data in the memory database according to the backup strategy through an application program interface (API) provided by the memory database and transmitting the accessed data into the backup manager so as to carry out backup. The invention avoids the problems of the interference on the saving operation of the memory database and the occupying of read-write (IO) resource of the memory database and realizes the backup to designated object data.
Description
Technical field
The present invention relates to the communications field, in particular to a kind of data backup system and method based on memory database.
Background technology
At present, in research, mainly contain following dual mode: utilize mode that storage file duplicates and the mode of utilizing internal storage data to derive at the backup method of the data in the memory database to the backup procedure of memory database.
Wherein, the backup mode that employing is duplicated storage file, because reproduction process relates to take (exclusivity of duplicating) to the storage file in the memory database, thereby in backup procedure, can cause interference to the deposit process of normal memory database to duplicating of storage file.The backup mode (the similar mode that saves as) that adopts internal storage data to derive can take a large amount of system memory resources at short notice like this, thereby cause the decline of the response speed of memory database, promptly can the performance of memory database be exerted an influence.
Summary of the invention
Fundamental purpose of the present invention is to provide a kind of data backup system and method based on memory database, to solve above-mentioned meeting causes interference to the normal storage process of memory database problem at least.
According to an aspect of the present invention, provide a kind of data backup system, having comprised: memory database, proxy module and backup manager based on memory database, wherein, backup manager is used for issuing backup policy to proxy module, wherein, comprise data to back up in the backup policy; The data of the application programming interfaces API Access memory database that provides by memory database according to backup policy are provided proxy module; The data that visit is obtained send backup manager to back up.
According to a further aspect in the invention, provide a kind of data back up method, having comprised: determine to want backed up data based on memory database; By the data in the application programming interfaces API Access memory database; The data that visit is obtained back up.
By the present invention, utilize agency mechanism that the data in the memory database are carried out backup operation, the API that utilizes memory database self to provide particularly, make the backup behavior be converted into a kind of normal access mode to memory database, because memory database allows concurrent visit for normal access services, thereby avoided interference, and, realized backup the intended target data to the occupation problem of memory database read-write (IO) resource to the deposit of memory database operation.
Description of drawings
Accompanying drawing described herein is used to provide further understanding of the present invention, constitutes the application's a part, and illustrative examples of the present invention and explanation thereof are used to explain the present invention, do not constitute improper qualification of the present invention.In the accompanying drawings:
Fig. 1 is the synoptic diagram based on the data backup system of memory database according to the embodiment of the invention;
Fig. 2 is the process flow diagram that carries out data backup based on the data backup system of memory database according to the embodiment of the invention;
Fig. 3 be according to the preferred embodiment of the invention the Agent module to the accessing operation process flow diagram of memory database;
Fig. 4 is the process flow diagram based on the data back up method of memory database according to the embodiment of the invention.
Embodiment
Hereinafter will describe the present invention with reference to the accompanying drawings and in conjunction with the embodiments in detail.Need to prove that under the situation of not conflicting, embodiment and the feature among the embodiment among the application can make up mutually.
Fig. 1 is the data backup system based on memory database according to the embodiment of the invention, comprising: memory database 10, proxy module 20 and backup manager 30, wherein,
Backup manager 30 is used for issuing backup policy to proxy module 20, wherein, comprises data to back up (can be the data in one/a plurality of tables of data) in the backup policy;
Agency's (Agent) module 20, API (the Application Programming Interface that provides by memory database 10 according to this backup policy is provided, application programming interfaces are also referred to as application programming interface) data above-mentioned to back up in the access memory database 10; The data that visit is obtained send backup manager 30 to back up.
The preferred embodiment utilizes agency mechanism that the data in the memory database are carried out backup operation, the API that utilizes memory database self to provide particularly, make the backup behavior be converted into a kind of normal access mode to memory database, because memory database allows concurrent visit for normal access services, thereby avoided interference, and the occupation problem of memory database being read and write (IO) resource to the deposit operation of memory database.By in backup policy, specifying data to back up, realized backup to the intended target data.
In the process that reality is implemented, above-mentioned memory database 10, Agent module 20 can be arranged in the foreground application system, and backup manager 30 can be arranged in the background management system.
Preferably, proxy module 20 comprises: the application module, be used for also comprising under the situation of access time, visit data amount and access speed at above-mentioned backup policy, according to the preceding station server request for data buffer area of this visit data amount to own place, wherein, the size of data buffer area is not less than the visit data amount; Access modules is used in the application of application module after data buffer area, in the above-mentioned access time, according to above-mentioned access speed, by the data in the tables of data in the API Access memory database 10 of memory database 10; First writing module is used for the data that visit obtains are write the data buffer area of applying for; Sending module is used for the data of data buffer area are sent to backup manager 20.
The preferred embodiment provides the specific embodiments of proxy module to the memory database visit data.By in backup policy, specifying access speed, can be in the performance range of memory database, with influence and the interference of avoiding the performance of memory database is brought with the speed limit of visit data.In addition, by in backup policy, specifying the access time, can also make proxy module in the less data of the data access peak period of memory database visit, in the more data of non-peak period visit, large-scale system resource takies situation in the short time that the backup activity brings thereby greatly alleviate, thereby has guaranteed memory database reliability of operation and stability.
Preferably, backup manager 30 data from proxy module 20 that also are used for receiving are written to storage medium.Like this, can manage by the Backup Data of backup manager storage.
Preferably, backup manager 30 comprises: compression module, be used for also comprising data backup location mode and back-up storage path at above-mentioned backup policy, wherein, the deposit data mode comprises carries out form to the data from proxy module 20 that receive and compresses under the situation that form compresses, single table is deposited or whole table is deposited; Second writing module is used for the data after the compression are written to according to above-mentioned data backup location mode in the storage space of above-mentioned back-up storage path indication of storage medium.Like this, Backup Data can be compressed earlier, store again after the compression, reach the effect of saving storage space.
Preferably, backup manager 30 comprises: configuration module, be used to receive configuration-direct from the user, and in backup manager, increase, upgrade backup policy according to configuration-direct.Like this, can dispose corresponding backup policy, back up in the time of appointment, thereby can satisfy user's various demands with the data that the user is concerned about according to user's actual backup requirements.
To sum up, backup manager mainly is responsible for management, the configuration of backup policy, the issuing of backup policy, and the reception of memory database data, the management of compression, Backup Data; The reception of Agent module basic load backup policy, the API that utilizes memory database to provide according to backup policy conducts interviews to memory database, and the data of the memory database that visit is obtained send to backup manager to carry out back-up storage according to form.
Wherein, in the process that reality is implemented, backup policy can also comprise except that foregoing: foreground and background data communication size, so that carry out communication with this parameter between backup manager and the Agent module.
In conjunction with Fig. 1, this data backup system realizes that flow process that the data in the memory database are backed up as shown in Figure 2, mainly may further comprise the steps:
Step S202, operating personnel at this internal storage data library backup, increase or revise backup policy newly in backup manager 30;
Step S204 is connected by communication process in the backup manager and the communication process in the Agent module 20 by the managing process in the backup manager 30, and the mode of backup policy by message is sent in the managing process of Agent module 20;
Step S206 is by the managing process startup Backup Data backup of Agent module 20;
Step S208 is to step S214, after Agent module 20 starts the Backup Data functions, utilizes the data access process to send data access request to memory database 10 according to backup policy, and memory database 10 is according to data access request, return data; After the whole transmission of the data that will visit finished, the managing process return data visit of memory database 10 in Agent module 20 replied.Agent module 20 sends to backup management module with the data in the data buffer area;
Wherein, above-mentioned steps S208 is based on to the access process among the step S212 that the API Access mode of operation of internal storage data carries out.
Step S216 after Agent module 20 receives the data of returning, is transferred to the managing process of backup manager 30, according to backup policy, utilizes storage process to finish storage to data by backup manager 30;
Step S218, Agent module 20 judges according to backup policy whether backup finishes, and after the end, sends Backup end message to backup management module 30, the relevant data storage operations of notice backup management management.
Wherein, the accessing operation flow process of 20 pairs of memory databases of Agent module (corresponding to above-mentioned step S208 to step S214) as shown in Figure 3, mainly may further comprise the steps:
Step S302, according to the backup policy that receives, to the preceding station server request for data buffer zone at own place, the size of this data buffer should be not less than data volume to back up;
Step S304 is to step S308, and according to backup policy, the API that provides by memory database 10 obtains tables of data list information to be backed up;
Step S306 is to step S312, tabulate according to backup sheet, carry out the tables of data backup operation successively, mainly comprise: reading of data table information, write tables of data information in the data buffer and the operating position of judgment data buffer zone, as meet data and send condition, then carry out data and send, data are sent to backup manager 30;
Step S314 behind the tables of data Backup end, discharges the data buffer of application.
Fig. 4 is the data back up method based on memory database according to the embodiment of the invention, may further comprise the steps:
Step S402 determines to want backed up data;
Step S404 is by the data in API (application programming interfaces) the access memory database;
Step S406, the data that visit is obtained back up.
This embodiment only conducts interviews to data designated by specifying data to back up, and large-scale memory source takies in the short time that the backup activity that exists in the correlation technique brings thereby solved, thereby influences the problem of the performance of memory database.In addition, the API that provides by memory database conducts interviews to data and backs up to obtain data, thereby the backup activity is optimized for a kind of normal data access behavior, has solved the storing process that exists in the correlation technique and brought the problem of interference memory database self.
Preferably, when determining to want backed up data among the step S402, also determine access time and access speed; Step S404 comprises: in the above-mentioned access time, according to above-mentioned access speed, by the data in the tables of data in the API Access memory database of memory database.Like this, can further avoid influence that the performance of memory database is brought by limiting access speed.
Preferably, when determining to want backed up data among the step S402, also specified data backs up location mode and back-up storage path, and wherein, the deposit data mode comprises that form compression, single table are deposited or whole showing deposited; Step S406 comprises: the data that visit obtains are carried out the form compression; Data after the compression are written in the storage space of the back-up storage path indication in the storage medium according to above-mentioned data backup location mode.Compression earlier storage again can be saved storage space.
Above-mentioned step S402 and step S406 can be carried out by the backup manager in the foregoing description 30, and step S404 is carried out by Agent module 20.
As can be seen from the above description, the present invention has realized following technique effect:
(1) by the backup of agency mechanism realization, the backup activity is handled as a kind of normal data access, shielded the interference of backup activity memory database normal storage process to memory database;
(2), can alleviate greatly that large-scale system resource takies situation in the short time that the backup activity brings, thereby guarantee memory database system reliability of operation and stability by backup policy;
(3) be the data read mode (being API) of memory database self owing to what adopt, thereby the versatility of data backup system and method is better, only need revise data read and write interface in the migration process and get final product, improvement cost is lower, is convenient to transplant.
Obviously, those skilled in the art should be understood that, above-mentioned each module of the present invention or each step can realize with the general calculation device, they can concentrate on the single calculation element, perhaps be distributed on the network that a plurality of calculation element forms, alternatively, they can be realized with the executable program code of calculation element, thereby, they can be stored in the memory storage and carry out by calculation element, and in some cases, can carry out step shown or that describe with the order that is different from herein, perhaps they are made into each integrated circuit modules respectively, perhaps a plurality of modules in them or step are made into the single integrated circuit module and realize.Like this, the present invention is not restricted to any specific hardware and software combination.
The above is the preferred embodiments of the present invention only, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.Within the spirit and principles in the present invention all, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (8)
1. the data backup system based on memory database is characterized in that, comprising: memory database, proxy module and backup manager, wherein,
Described backup manager is used for issuing backup policy to described proxy module, wherein, comprises data to back up in the described backup policy;
The described data of the described memory database of application programming interfaces API Access that provides by described memory database according to described backup policy are provided described proxy module; The described data that visit is obtained send described backup manager to back up.
2. system according to claim 1 is characterized in that, described proxy module comprises:
The application module, be used for also comprising under the situation of access time, visit data amount and access speed at described backup policy, according to the preceding station server request for data buffer area of described visit data amount to own place, wherein, the size of described data buffer area is not less than described visit data amount;
Access modules is used in the application of described application module after described data buffer area, in the described access time, according to described access speed, by the described data in the tables of data in the described memory database of described API Access of described memory database;
First writing module is used for the described data that visit obtains are write the described data buffer area of applying for;
Sending module is used for the data of described data buffer area are sent to described backup manager.
3. system according to claim 1 is characterized in that, the data from described proxy module that described backup manager also is used for receiving are written to storage medium.
4. system according to claim 3 is characterized in that, described backup manager comprises:
Compression module, be used for also comprising data backup location mode and back-up storage path at described backup policy, wherein, described deposit data mode comprises that form compresses, single table is deposited or put in order under the situation of showing to deposit, and the described data that receive is carried out form compress;
Second writing module is used for the data after the compression are written to according to described data backup location mode in the storage space of described back-up storage path indication of described storage medium.
5. system according to claim 1 is characterized in that, described backup manager comprises: configuration module, be used to receive configuration-direct from the user, and in described backup manager, increase, upgrade backup policy according to described configuration-direct.
6. the data back up method based on memory database is characterized in that, comprising:
Determine to want backed up data;
By the described data in the described memory database of application programming interfaces API Access;
The described data that visit is obtained back up.
7. method according to claim 6 is characterized in that, when determining described data, also determines access time and access speed; Comprise by the described data in the described memory database of application programming interfaces API Access:
In the described access time, according to described access speed, by the described data in the tables of data in the described memory database of described API Access of described memory database.
8. method according to claim 6 is characterized in that, when determining described data, and also specified data backup location mode and back-up storage path, wherein, described deposit data mode comprises that form compression, single table are deposited or whole table is deposited; The described data that visit is obtained back up and comprise:
The described data that visit obtains are carried out the form compression;
Data after the compression are written in the storage space of the described back-up storage path indication in the storage medium according to described data backup location mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010207324.4A CN101887388B (en) | 2010-06-18 | 2010-06-18 | Data backup system and method based on memory database |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010207324.4A CN101887388B (en) | 2010-06-18 | 2010-06-18 | Data backup system and method based on memory database |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101887388A true CN101887388A (en) | 2010-11-17 |
| CN101887388B CN101887388B (en) | 2014-03-12 |
Family
ID=43073316
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010207324.4A Active CN101887388B (en) | 2010-06-18 | 2010-06-18 | Data backup system and method based on memory database |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101887388B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012071920A1 (en) * | 2010-12-02 | 2012-06-07 | 华为技术有限公司 | Method, system, token conreoller and memory database for implementing distribute-type main memory database system |
| CN102541694A (en) * | 2012-01-18 | 2012-07-04 | 浪潮(北京)电子信息产业有限公司 | Method and device for database backup |
| WO2012151912A1 (en) * | 2011-08-16 | 2012-11-15 | 中兴通讯股份有限公司 | Method and device for operating data of memory database |
| CN103838762A (en) * | 2012-11-26 | 2014-06-04 | 中国银联股份有限公司 | Uninterrupted data processing device and method based on data table rotation |
| CN104424275A (en) * | 2013-08-29 | 2015-03-18 | 中兴通讯股份有限公司 | Database system and data synchronization method |
| CN105138420A (en) * | 2015-07-31 | 2015-12-09 | 小米科技有限责任公司 | Data backup method, apparatus and system and data recovery method, apparatus and system |
| CN105183584A (en) * | 2015-08-18 | 2015-12-23 | 深圳市雪球科技有限公司 | Application cloud backup method and system thereof |
| CN105843819A (en) * | 2015-01-15 | 2016-08-10 | 中国移动通信集团河南有限公司 | Method and device for exporting data |
| CN106293678A (en) * | 2015-06-09 | 2017-01-04 | 北京京东尚科信息技术有限公司 | A kind of method and system of the variable managing application service |
| CN107122262A (en) * | 2017-04-21 | 2017-09-01 | 杭州狮说教育科技有限公司 | Database intelligent backup system based on agent |
| CN107193687A (en) * | 2017-04-18 | 2017-09-22 | 北京潘达互娱科技有限公司 | Database backup method and controlling equipment |
| CN113468153A (en) * | 2020-12-01 | 2021-10-01 | 王跃 | Medical data management system based on big data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1153234A (en) * | 1997-08-08 | 1999-02-26 | N T T Data:Kk | Database utilization system |
| CN1731364A (en) * | 2005-08-05 | 2006-02-08 | 北京九州软件有限公司 | Method for compression and search of database backup data |
| CN1797397A (en) * | 2004-12-24 | 2006-07-05 | 许继集团有限公司 | Real time database management system for automatic system of electric power, and implementation method |
| CN101183323A (en) * | 2007-12-10 | 2008-05-21 | 华中科技大学 | Data stand-by system based on finger print |
-
2010
- 2010-06-18 CN CN201010207324.4A patent/CN101887388B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1153234A (en) * | 1997-08-08 | 1999-02-26 | N T T Data:Kk | Database utilization system |
| CN1797397A (en) * | 2004-12-24 | 2006-07-05 | 许继集团有限公司 | Real time database management system for automatic system of electric power, and implementation method |
| CN1731364A (en) * | 2005-08-05 | 2006-02-08 | 北京九州软件有限公司 | Method for compression and search of database backup data |
| CN101183323A (en) * | 2007-12-10 | 2008-05-21 | 华中科技大学 | Data stand-by system based on finger print |
Non-Patent Citations (2)
| Title |
|---|
| 《计算机与数字工程》 20060131 余以胜 ORACLE数据库备份解决方案的研究 第118页至第121页 8 第34卷, * |
| 余以胜: "ORACLE数据库备份解决方案的研究", 《计算机与数字工程》, vol. 34, 31 January 2006 (2006-01-31), pages 118 - 121 * |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012071920A1 (en) * | 2010-12-02 | 2012-06-07 | 华为技术有限公司 | Method, system, token conreoller and memory database for implementing distribute-type main memory database system |
| WO2012151912A1 (en) * | 2011-08-16 | 2012-11-15 | 中兴通讯股份有限公司 | Method and device for operating data of memory database |
| CN102541694A (en) * | 2012-01-18 | 2012-07-04 | 浪潮(北京)电子信息产业有限公司 | Method and device for database backup |
| CN102541694B (en) * | 2012-01-18 | 2015-05-13 | 浪潮(北京)电子信息产业有限公司 | Method and device for database backup |
| CN103838762B (en) * | 2012-11-26 | 2017-09-29 | 中国银联股份有限公司 | Uninterrupted data processing unit and method based on tables of data rotation |
| CN103838762A (en) * | 2012-11-26 | 2014-06-04 | 中国银联股份有限公司 | Uninterrupted data processing device and method based on data table rotation |
| CN104424275A (en) * | 2013-08-29 | 2015-03-18 | 中兴通讯股份有限公司 | Database system and data synchronization method |
| CN105843819A (en) * | 2015-01-15 | 2016-08-10 | 中国移动通信集团河南有限公司 | Method and device for exporting data |
| CN105843819B (en) * | 2015-01-15 | 2020-07-10 | 中国移动通信集团河南有限公司 | Data export method and device |
| CN106293678A (en) * | 2015-06-09 | 2017-01-04 | 北京京东尚科信息技术有限公司 | A kind of method and system of the variable managing application service |
| CN106293678B (en) * | 2015-06-09 | 2020-11-24 | 北京京东尚科信息技术有限公司 | Method and system for managing variables of application service |
| CN105138420A (en) * | 2015-07-31 | 2015-12-09 | 小米科技有限责任公司 | Data backup method, apparatus and system and data recovery method, apparatus and system |
| CN105183584A (en) * | 2015-08-18 | 2015-12-23 | 深圳市雪球科技有限公司 | Application cloud backup method and system thereof |
| CN107193687A (en) * | 2017-04-18 | 2017-09-22 | 北京潘达互娱科技有限公司 | Database backup method and controlling equipment |
| CN107122262A (en) * | 2017-04-21 | 2017-09-01 | 杭州狮说教育科技有限公司 | Database intelligent backup system based on agent |
| CN113468153A (en) * | 2020-12-01 | 2021-10-01 | 王跃 | Medical data management system based on big data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101887388B (en) | 2014-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101887388B (en) | Data backup system and method based on memory database | |
| CN101493826B (en) | Database system based on WEB application and data management method thereof | |
| CN102265277B (en) | Operation method and device for data memory system | |
| CN101888405B (en) | Cloud computing file system and data processing method | |
| CN103905537A (en) | System for managing industry real-time data storage in distributed environment | |
| CN105549905A (en) | Method for multiple virtual machines to access distributed object storage system | |
| CN102158540A (en) | System and method for realizing distributed database | |
| CN100527081C (en) | Computer processing system for implementing data update and data updating method | |
| CN102136003A (en) | Large-scale distributed storage system | |
| CN103037004A (en) | Implement method and device of cloud storage system operation | |
| CN103377100B (en) | A kind of data back up method, network node and system | |
| CN103942011A (en) | Differential snapshot system and use method thereof | |
| CN102708158A (en) | PostgreSQL (postgres structured query language) cloud storage filing and scheduling system | |
| CN102012899A (en) | Method, system and equipment for updating data | |
| CN105516284A (en) | Clustered database distributed storage method and device | |
| WO2010077549A2 (en) | Data integrity in a database environment through background synchronization | |
| CN109862090A (en) | A kind of high degree of safety distribution cloud storage system | |
| CN112181723A (en) | Financial disaster recovery method and device, storage medium and electronic equipment | |
| CN102045399A (en) | Cloud computing mode file system and file reading method | |
| CN102541693A (en) | Multi-copy storage management method and system of data | |
| CN101778131A (en) | Data synchronization system | |
| CN113885798A (en) | Data operation method, device, equipment and medium | |
| CN105468643A (en) | Distributed file system access method and system | |
| CN101789963A (en) | Data synchronization system | |
| CN100486345C (en) | Business system based on PC server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |