CN101364217B - Data maintenance method, equipment and system thereof in data-base - Google Patents
Data maintenance method, equipment and system thereof in data-base Download PDFInfo
- Publication number
- CN101364217B CN101364217B CN2007100757083A CN200710075708A CN101364217B CN 101364217 B CN101364217 B CN 101364217B CN 2007100757083 A CN2007100757083 A CN 2007100757083A CN 200710075708 A CN200710075708 A CN 200710075708A CN 101364217 B CN101364217 B CN 101364217B
- Authority
- CN
- China
- Prior art keywords
- database
- daily record
- attended operation
- data
- physical medium
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention relates to the database technology, and discloses a method, equipment and the system thereof for maintaining data in a database. The data is created, modified or deleted, the reliability of the in-memory database can be ensured under the condition of not affecting or affecting performance of an in-memory database as little as possible. The method comprises the following steps of receiving an maintenance operation request for the in-memory database; generating a maintenance operation log for recording the operation according to the data maintenance operation request for the in-memory database; and indicating that the data maintenance operation is carried out to the database based on a nonvolatile physical medium according to the maintenance operation log. A server where the in-memory database is positioned and a server for indicating that the data maintenance operation is carried out to the database based on the nonvolatile physical medium are two independent servers.
Description
Technical field
The present invention relates to database technology, particularly data maintenance technology in the database.
Background technology
Along with the progress of network technology, increasing user proposes higher requirement to rapid data and transaction services.Many industries such as telecommunications and financial service markets all press for can provide the business data of real-time service management system.Yet traditional data base management system (DBMS) based on disk can not satisfy so a large amount of, processing requirements at a high speed.In order to break through the restriction on this performance that causes owing to the database bottleneck, novel efficient main memory DBM system provides effective solution for the user.Compare with traditional disk database, memory database has high data access speed and extremely strong concurrent access ability.
At present, in the prior art, in order to guarantee the reliability of database, the special-purpose memory database of a lot of software system developments, generally depend on database (being commercial physical database), do not do the persistence mechanism of improving, query function only is provided based on non-volatile physical medium.The database of direct control based on non-volatile physical medium adopted in the data maintenance operation, refreshes memory database again, or upgrades database and memory database based on non-volatile physical medium synchronously.Thereby guarantee that data updated can be because of reason obliterated datas such as the unexpected power down of server or the machines of delaying.
Yet, the present inventor finds, the user more during new data, it or not the database that directly upgrades based on non-volatile physical medium, be exactly memory database and upgrade synchronously based on the database of non-volatile physical medium, like this for using, because the speed of the database processing data of non-volatile physical medium is not very fast, therefore when carrying out the mass data operation if desired, its low performance will have influence on the high system of performance requirement (as the telecommunications Online Charging System etc.).
Summary of the invention
The technical problem underlying that embodiment of the present invention will solve provides data maintaining method, equipment and system thereof in a kind of database, make when establishment, modification or deleted data, do not influence or influence less under the situation of memory database performance as far as possible, can guarantee the reliability of this memory database.
For solving the problems of the technologies described above, embodiments of the present invention provide data maintaining method in a kind of database, may further comprise the steps:
Reception is to the attended operation request of memory database;
According to the data maintenance operation requests of memory database, generate the attended operation daily record of this operation of record, whether described attended operation daily record comprises table sign, field identification to described operation, is the record of band transaction operation;
According to the attended operation daily record, indication is carried out the data maintenance operation based on the database of non-volatile physical medium.
Embodiments of the present invention also provide data maintenance system in a kind of database, comprising:
Receiving element is used to receive the attended operation request to memory database;
Generation unit, be used for the attended operation request to memory database of receiving according to receiving element, generate the attended operation daily record of this operation of record, whether described attended operation daily record comprises table sign, field identification to described operation, is the record of band transaction operation;
Indicating member is used for the attended operation daily record according to the generation unit generation, and indication is carried out the data maintenance operation based on the database of non-volatile physical medium.
Embodiments of the present invention also provide a kind of data maintenance equipment, comprising:
Receiving element is used to receive the attended operation request to memory database;
Generation unit, be used for the attended operation request to memory database of receiving according to receiving element, generate the attended operation daily record of this operation of record, whether described attended operation daily record comprises table sign, field identification to described operation, is the record of band transaction operation;
Indicating member is used for the attended operation daily record according to the generation unit generation, and indication is carried out the data maintenance operation based on the database of non-volatile physical medium.
Embodiment of the present invention compared with prior art, main effect is:
Can be in time from memory database, user's data updated be persisted in the database based on non-volatile physical medium, make at (especially at establishment, modification or deleted data time) under the situation that does not influence or influence less the memory database performance as far as possible, can guarantee the reliability of this memory database, improve the situation that the efficient and reliability of present memory database can not and be deposited.
Description of drawings
Fig. 1 is according to data maintaining method synoptic diagram in the database of first embodiment of the invention;
Fig. 2 is according to data maintaining method process flow diagram in the database of first embodiment of the invention;
Fig. 3 is according to data maintaining method process flow diagram in the database of second embodiment of the invention;
Fig. 4 is according to data maintenance system construction drawing in the database of third embodiment of the invention.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, embodiments of the present invention are described in further detail below in conjunction with accompanying drawing.
First embodiment of the present invention relates to data maintaining method in a kind of database, in the present embodiment, as shown in Figure 1, when user's request memory database is carried out the data maintenance operation and (comprise the increase of data, deletion or modification) time, reception is to the attended operation request of memory database, generate the attended operation daily record of this operation of record, and be cached in the memory database logic log, by the data persistence service processes each the attended operation daily record in the memory database logic log file is resolved again, and the data persistence after will resolving is to the database based on non-volatile physical medium.Wherein, normally based on the database of hard disk, but also can be based on database of tape, flash memory or optical storage media etc. based on the database of non-volatile physical medium.
Flow process to data maintaining method in a kind of database of present embodiment is specifically described below, as shown in Figure 2.
In step 201, what receive the user carries out the data maintenance request of operating to memory database, and is generated the attended operation daily record of this operation of record by the server at memory database place.For convenience of description, in the present embodiment server at memory database place is called first server.Specifically, when user's request is carried out data maintenance operation (comprising increase, deletion or the modification of data) to memory database, by what first server received this user memory database is carried out the data maintenance request of operating, and according to the user's data attended operation request generates the daily record of user's attended operation in time, the data maintenance operation of carrying out with recording user.Wherein, write down in the attended operation daily record active user's operation table sign, field identification, data maintenance operation memory address and whether have information such as transaction operation.
Then, enter step 202, buffer memory carried out in the attended operation daily record, promptly generate the memory database logic log, and with this daily record from first Server Transport to second server.Wherein, second server is the data maintenance operation is carried out in indication based on the database of non-volatile physical medium a server.Owing to adopted two independently servers, further guaranteed the performance of current memory database place server.
Then, enter step 203, judge by the data persistence service processes in the second server whether the operation of writing down in the current attended operation daily record of reading is the band transaction operation, if band transaction operation, then enter step 207,, then enter step 204 if be not with transaction operation.Wherein, the data persistence service processes is a memory database background process.
Specifically, the data persistence service processes reads the attended operation log record in each memory database logic log file one by one, by whether being that the record of band transaction operation judges whether the operation of writing down in the attended operation daily record is to be with transaction operation in the current attended operation daily record of reading, if band transaction operation, then enter step 207, otherwise enter step 204.
In step 204, the data persistence service processes judges whether operated table needs to carry out synchronously, does not then enter step 206 synchronously if do not need to carry out; Carry out if desired then entering step 205 synchronously.Wherein, be meant that synchronously data persistence in the memory database is to based on the database of non-volatile physical medium.
Specifically, the data persistence service processes removes the table name of definition in the Query Database table dictionary table (DBTable Dict) according to the table sign of recording user operation in the attended operation daily record, judges whether this table needs synchronously, synchronous if desired, then enter step 205; Otherwise, enter step 206.Wherein, the database table dictionary table has defined table name, the table sign of subscriber's meter and whether has needed definition such as synchronous.
In step 205, the second server indication is carried out the data maintenance operation based on the database of non-volatile physical medium.Specifically, after judgement needs synchronously, memory address assembly unit according to the service data that writes down in field type information and the attended operation daily record goes out the actual needs data in synchronization, and then the data type and the field name of definition in the pairing data sheet field dictionaries of data (DBField_Dict) that go out according to the assembly unit table, carry out assembly unit with the table name that defines in the database table dictionary, obtain the standard SQL statement, again data persistence is upgraded in the database based on non-volatile physical medium in the family of usefulness.
In step 206, the daily record of data persistence service processes deletion attended operation that is to say, after the data persistence service processes judges that operated table does not need to carry out synchronously, directly with this attended operation daily record deletion.
Be not difficult to find, because data maintenance operation to memory database, by the attended operation daily record, in based on the database of non-volatile physical medium, also done corresponding maintenance, promptly from memory database, user's data updated has been persisted in the database based on non-volatile physical medium in time, make under the situation that does not influence the memory database performance, can guarantee the reliability of this memory database, improved the situation that the efficient and reliability of present memory database can not and be deposited.And before data persistence is arrived the database based on non-volatile physical medium, show the judgement of level earlier, thereby filter out data, the performance of data persistence is improved without persistence.
In step 207, the data persistence service processes reads and operates all operations that belongs to same affairs in batches, and the state of affairs is judged.Specifically, after the current operation that is operating as the band affairs of reading of data persistence service processes judgement, read all operations that belongs to same affairs with this operation in batches, and the state of these affairs is judged, if these affairs are not submitted to as yet, then enter step 208; If the rollback of these affairs then enters step 209; If these affairs are submitted to, then enter step 210.
In step 208, the data persistence service processes is ignored the processing to the attended operation daily record of each operation of reading in batches, that is to say, if the affairs under operating are submitted to as yet, then each attended operation daily record of operating of reading is not in batches handled.
In step 209, attended operation daily record of each operation that data persistence service processes deletion is read in batches that is to say, if the affairs under the operation during rollback, are not persisted to each operation of reading in batches the database based on non-volatile physical medium.Certainly, can each operation of reading in batches be persisted to database by ignoring processing to each attended operation daily record of operating of reading in batches based on non-volatile physical medium yet.
In step 210, the data persistence service processes judges synchronously to the execution list of respectively operating respectively that reads in batches, and according to judged result this daily record handled, and wherein, table judges to be exactly to judge whether operated table is needed synchronously synchronously.Specifically, if the affairs under the operation are submitted to, then the execution list of respectively operating respectively that reads is in batches judged synchronously, if judge when operated table needs are synchronous, then indicate database to carry out the data maintenance operation based on non-volatile physical medium by second server, do not need when synchronous if judge operated table, then by the daily record of data persistence process-kill attended operation.
This shows, when affairs are handled, need earlier the state of these affairs to be judged, only under the state that these affairs have been submitted to, according to each operation relevant with these affairs of reading in batches, whether need synchronous judgement, to reduce invalid operation if carrying out operated table respectively again.Such as, can avoid each operation to the affairs of rollback, in based on the database of non-volatile physical medium, carry out invalid data maintenance operation.
Need to prove, in the present embodiment, the table of the operation of writing down in the attended operation daily record by buffer memory identifies judges whether operated table needs to be synchronized to the database based on non-volatile physical medium, but in actual applications, also can dispose the occupancy of the central processing unit of judging second server according to the user, and then whether decision needs to be synchronized to the database based on non-volatile physical medium.
In addition, what deserves to be mentioned is, because when data persistence service processes and memory database are in two different servers, can greatly reduce performance consumption to memory database place server, therefore in the present embodiment server with data persistence service processes place, with the server at memory database place is that two different servers are that example describes, but in actual applications, the data persistence service processes also can be in same server with memory database.
Second embodiment of the present invention relates to data maintaining method in a kind of database equally, the present embodiment and first embodiment are roughly the same, its difference is, in the first embodiment, the data persistence service processes is after judging that operated table needs synchronously, and directly indication is carried out the data maintenance operation based on the database of non-volatile physical medium; And in the present embodiment, after judging that operated table needs synchronously, the data persistence service processes goes this table of defining in the data query literary name segment dictionary table in requisition for the field of carrying out data sync according to the field identification of the attended operation that writes down in the attended operation daily record again, further judge whether operated field needs to be synchronized in the database based on non-volatile physical medium, synchronous if desired, then indicate database to carry out the data maintenance operation based on non-volatile physical medium; Then do not delete the attended operation daily record synchronously if do not need.Idiographic flow as shown in Figure 3.
In the present embodiment from step 301 to step 304 with first embodiment step 201 identical to step 204, be not described in detail in this.
In step 305, the data persistence service processes judges whether operated field needs if desired, then to enter step 307 synchronously, otherwise, enter step 306.Specifically, the data persistence service processes is after judging that operated table needs synchronously, go this table of defining in the data query literary name segment dictionary table in requisition for the field of carrying out data sync according to the field identification of the attended operation that writes down in the attended operation daily record again, judge whether operated field needs to be synchronized in the database based on non-volatile physical medium, synchronous if desired, then enter step 307, otherwise, step 306 entered.
In step 306, the daily record of data persistence service processes deletion attended operation that is to say, after the data persistence service processes judges that operated field does not need to carry out synchronously, directly with this attended operation daily record deletion.
In step 307, the second server indication is carried out the data maintenance operation based on the database of non-volatile physical medium.This step is identical with step 205, does not repeat them here.
This shows, in the present embodiment, earlier judge whether operated table needs to be synchronized to this database based on non-volatile physical medium, if desired, further judge whether operated field needs to be synchronized in this database based on non-volatile physical medium again, if desired, then indicate database to carry out the data maintenance operation again based on non-volatile physical medium.That is to say that embodiments of the present invention can be according to user's the demand custom table level or the data persistence of field level, thereby filter out data without persistence, for data persistence has brought very big dirigibility, and the raising of performance.
The step 308 of present embodiment is similar to step 210 with the step 207 of first embodiment respectively to step 311, does not repeat them here.
What deserves to be mentioned is that all or part of step in the respective embodiments described above also can indicate related hardware to finish by programmed instruction.
The 3rd embodiment of the present invention relates to data maintenance system in a kind of database, as shown in Figure 4, comprising: receiving element is used to receive the attended operation request to memory database; Generation unit, be used for the attended operation request to memory database of receiving according to this receiving element, generate the attended operation daily record of this operation of record, whether the attended operation daily record of generation comprises the table sign of operation, field identification, is the record of band transaction operation; Indicating member is used for the attended operation daily record according to the generation unit generation, and indication is carried out the data maintenance operation based on the database of non-volatile physical medium.
Owing to from memory database, user's data updated has been persisted in the database based on non-volatile physical medium in time, make under the situation that does not influence the memory database performance, can guarantee the reliability of this memory database, improve the situation that the efficient and reliability of present memory database can not and be deposited.
Can also comprise in the data maintenance system in this database: buffer unit is used for buffer memory is carried out in the attended operation daily record that generates.This generation unit is input to this buffer unit with the attended operation daily record that generates, by this buffer unit with the attended operation log transmission of buffer memory to this indicating member.
Receiving element in the present embodiment, generation unit and buffer unit can be positioned at first server at memory database place, and indicating member can be arranged in second server.By adopting two independently servers, further guaranteed the performance of current memory database place server.
In this second server, can also comprise: first judging unit, be used for the table sign of the operation of writing down according to the attended operation daily record of buffer memory, judge whether operated table needs to be synchronized to the database based on non-volatile physical medium; When indicating member judged that at first judging unit operated table needs are synchronous, indication was carried out the data maintenance operation based on the database of non-volatile physical medium; The deletion control module is used for judging that at first judging unit operated table does not need when synchronous the daily record of deletion attended operation.
In this second server, can also comprise: second judging unit, be used for when first judging unit judges that operated table needs are synchronous, field identification according to the operation of writing down in the attended operation daily record, judge whether operated field needs to be synchronized to the database based on non-volatile physical medium, and judge to need when synchronous, the indication of notice indicating member is carried out the data maintenance operation based on the database of non-volatile physical medium; This deletion control module also is used for judging that at second judging unit operated field does not need when synchronous the daily record of deletion attended operation.
This shows, earlier judge whether operated table needs to be synchronized to this database based on non-volatile physical medium, if desired, can judge further whether operated field needs to be synchronized in this database based on non-volatile physical medium, if desired, then indicate database to carry out the data maintenance operation again based on non-volatile physical medium.That is to say, can be according to user's the demand custom table level or the data persistence of field level, thus filter out data without persistence, for data persistence has brought very big dirigibility, and the raising of performance.
In this second server, can also comprise: the 3rd judging unit, be used for judging whether the operation that the attended operation daily record of buffer memory is write down is the band transaction operation, and judging that this is operating as when not being with transaction operation, whether indicate first judging unit directly to carry out operated table needs synchronous judgement; Reading unit in batches, be used for the 3rd judging unit judge that the attended operation daily record of buffer memory writes down be operating as the band transaction operation time, read all operations that belongs to same affairs with this operation in batches; The 4th judging unit is used for the state of the affairs under the decision operation; Issued transaction unit, the state that is used for judging these affairs at the 4th judging unit when submitting to, each operation of indicating first judging unit that the batch reading unit is read, whether carry out operated table respectively needs synchronous judgement; The state of judging affairs at the 4th judging unit is during for rollback, attended operation daily record of deletion each operation that reading unit read in batches, or ignore processing to each attended operation daily record of operating of reading in batches; The state of judging affairs at the 4th judging unit is ignored the processing of each attended operation daily record of operating that the batch reading unit is read when not submitting to as yet.
Be not difficult to find, when affairs are handled, need earlier the state of these affairs to be judged, only under the state that these affairs have been submitted to, according to each operation relevant with these affairs of reading in batches, whether need synchronous judgement, to reduce invalid operation if carrying out operated table respectively again.Such as, can avoid each operation to the affairs of rollback, in based on the database of non-volatile physical medium, carry out invalid data maintenance operation.
In addition, what deserves to be mentioned is that each unit in the present embodiment can be a logical block, in actual applications, various physics realization mode can be arranged.
Need to prove, be with receiving element and generation unit in the present embodiment, is arranged in indicating member that different servers describes, but in actual applications, receiving element, generation unit and indicating member also can all be arranged in same server.
In sum, in embodiments of the present invention, reception is to the attended operation request of memory database, according to attended operation request to memory database, generate the attended operation daily record of this operation of record, and according to the attended operation daily record that generates, indication is carried out the data maintenance operation based on the database of non-volatile physical medium.Because data maintenance operation to memory database, by the attended operation daily record, in based on the database of non-volatile physical medium, also done corresponding maintenance, promptly from memory database, user's data updated has been persisted in the database based on non-volatile physical medium in time, make under the situation that does not influence the memory database performance, can guarantee the reliability of this memory database, improve the situation that the efficient and reliability of present memory database can not and be deposited.
The server at memory database place carries out the server that data maintenance is operated with indicating the database based on non-volatile physical medium, is two independently servers, has further guaranteed the performance of current memory database place server.
In the data maintenance operation is carried out in indication based on the database of non-volatile physical medium before, earlier judge whether operated table needs to be synchronized to this database based on non-volatile physical medium, if desired, then indicate database to carry out the data maintenance operation again, otherwise delete this attended operation daily record based on non-volatile physical medium.Further, can be after judging that operated table need be synchronized to this database based on non-volatile physical medium, further judge whether operated field needs to be synchronized in this database based on non-volatile physical medium, if desired, then indicate database to carry out the data maintenance operation again, otherwise delete this attended operation daily record based on non-volatile physical medium.That is to say, can be according to user's the demand custom table level or the data persistence of field level, thus filter out data without persistence, for data persistence has brought very big dirigibility, and the raising of performance.
When affairs are handled, need earlier the state of these affairs to be judged, only under the state that these affairs have been submitted to, again according to each operation relevant of reading in batches with these affairs, whether need synchronous judgement, to reduce invalid operation if carrying out operated table respectively.For example, can avoid each operation, in based on the database of non-volatile physical medium, carry out invalid data maintenance operation the affairs of rollback.
Though pass through with reference to some of the preferred embodiment of the invention; the present invention is illustrated and describes; but those of ordinary skill in the art should be understood that; can do various changes to it in the form and details; and without departing from the spirit and scope of the present invention, do not break away from protection scope of the present invention.
Claims (14)
1. data maintaining method in the database is characterized in that, may further comprise the steps:
Reception is to the attended operation request of memory database;
According to the data maintenance operation requests of memory database, generate the attended operation daily record of this operation of record, whether described attended operation daily record comprises table sign, field identification to described operation, is the record of band transaction operation;
According to described attended operation daily record, indication is carried out the data maintenance operation based on the database of non-volatile physical medium.
2. data maintaining method in the database according to claim 1 is characterized in that, and is before described indication is carried out the step of data maintenance operation based on the database of non-volatile physical medium, further comprising the steps of:
Buffer memory is carried out in the described attended operation daily record that generates;
Carry out in the step of data maintenance operation at the database of described indication based on non-volatile physical medium, according to the described attended operation daily record that is buffered, indication is carried out the data maintenance operation based on the database of non-volatile physical medium.
3. data maintaining method in the database according to claim 2, it is characterized in that, described the step of buffer memory is carried out in the attended operation daily record, and described indication carries out between the step of data maintenance operation based on the database of non-volatile physical medium, further comprising the steps of:
First server at described memory database place, with the described attended operation log transmission of buffer memory in second server;
Carry out the data maintenance operation is carried out in described indication based on the database of non-volatile physical medium step by described second server.
4. data maintaining method in the database according to claim 1 is characterized in that, and is before described indication is carried out the step of data maintenance operation based on the database of non-volatile physical medium, further comprising the steps of:
According to the table sign of the described operation of writing down in the described attended operation daily record, judge whether operated table needs to be synchronized to described database based on non-volatile physical medium;
If operated table needs synchronously, then carry out the data maintenance operation is carried out in described indication based on the database of non-volatile physical medium step.
5. data maintaining method in the database according to claim 4, it is characterized in that, after the operated table of described judgement needs synchronously, carry out described indication and carry out before the step of data maintenance operation based on the database of non-volatile physical medium, further comprising the steps of:
Field identification according to the described operation of writing down in the described attended operation daily record, further judge whether operated field needs to be synchronized in the described database based on non-volatile physical medium, synchronous if desired, then carry out the data maintenance operation is carried out in described indication based on the database of non-volatile physical medium step.
6. according to data maintaining method in claim 4 or the 5 described databases, it is characterized in that this method is further comprising the steps of:
Read all operations that belongs to same affairs with described operation in batches;
If the affairs under the described operation are submitted to, then each operation that described batch is read is carried out respectively and is describedly judged whether operated table needs synchronous step;
If each attended operation daily record of operating that described batch reads is then deleted in the affairs rollback under the described operation, or ignore the processing of the attended operation daily record of each operation that described batch is read;
If the affairs under the described operation are not submitted to as yet, then ignore the processing of the attended operation daily record of each operation that described batch is read.
7. according to data maintaining method in claim 4 or the 5 described databases, it is characterized in that if transaction operation is not with in being operating as of writing down in the described attended operation daily record, then directly execution is described judges whether operated table needs synchronous step.
8. data maintenance system in the database is characterized in that, comprising:
Receiving element is used to receive the attended operation request to memory database;
Generation unit, be used for the attended operation request to memory database of receiving according to described receiving element, generate the attended operation daily record of this operation of record, whether described attended operation daily record comprises table sign, field identification to described operation, is the record of band transaction operation;
Indicating member is used for the attended operation daily record according to described generation unit generation, and indication is carried out the data maintenance operation based on the database of non-volatile physical medium.
9. data maintenance system in the database according to claim 8 is characterized in that, also comprises buffer unit, is used for buffer memory is carried out in the described attended operation daily record that generates;
Described generation unit is input to described buffer unit with the attended operation daily record that generates, by this buffer unit with the attended operation log transmission of buffer memory to described indicating member.
10. data maintenance system in the database according to claim 9 is characterized in that,
Described receiving element, generation unit and buffer unit are positioned at first server at described memory database place, and described indicating member is arranged in second server.
11. the data maintenance system is characterized in that in the database according to claim 8, also comprises:
First judging unit is used for the table sign of the described operation of writing down according to the attended operation daily record that described generation unit generates, and judges whether operated table needs to be synchronized to described database based on non-volatile physical medium;
When described indicating member judges that at described first judging unit operated table needs are synchronous, carry out described indication;
The deletion control module is used for judging that at described first judging unit operated table does not need to delete described attended operation daily record when synchronous.
12. data maintenance system in the database according to claim 11, it is characterized in that, second judging unit, be used for when described first judging unit judges that operated table needs are synchronous, field identification according to the described operation of writing down in the described attended operation daily record, judge whether operated field needs to be synchronized to described database based on non-volatile physical medium, and when judging that needs are synchronous, notify described indicating member to carry out described indication;
Described deletion control module also is used for judging that at described second judging unit operated field does not need to delete described attended operation daily record when synchronous.
13. according to data maintenance system in claim 11 or the 12 described databases, it is characterized in that, also comprise:
The 3rd judging unit, be used for judging whether the operation that attended operation daily record that described generation unit generates is write down is the band transaction operation, and judging that this is operating as when not being with transaction operation, whether indicate described first judging unit directly to carry out operated table needs synchronous judgement;
Reading unit in batches, be used for described the 3rd judging unit judge that the attended operation daily record writes down be operating as the band transaction operation time, read all operations that belongs to same affairs with this operation in batches;
The 4th judging unit is used to judge the state of the affairs under the described operation;
Issued transaction unit, the state that is used for judging described affairs at described the 4th judging unit when submitting to, each operation of indicating described first judging unit that described batch reading unit is read, whether carry out operated table respectively needs synchronous judgement; The state of judging described affairs at described the 4th judging unit is during for rollback, deletes attended operation daily record of each operation that described batch reading unit read, or ignores the processing of the attended operation daily record of each operation that described batch is read; The state of judging described affairs at described the 4th judging unit is ignored the processing of the attended operation daily record of each operation that described batch reading unit is read when not submitting to as yet.
14. a data maintenance equipment is characterized in that, comprising:
Receiving element is used to receive the attended operation request to memory database;
Generation unit, be used for the attended operation request to memory database of receiving according to described receiving element, generate the attended operation daily record of this operation of record, whether described attended operation daily record comprises table sign, field identification to described operation, is the record of band transaction operation;
Indicating member is used for the attended operation daily record according to described generation unit generation, and indication is carried out the data maintenance operation based on the database of non-volatile physical medium.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2007100757083A CN101364217B (en) | 2007-08-08 | 2007-08-08 | Data maintenance method, equipment and system thereof in data-base |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2007100757083A CN101364217B (en) | 2007-08-08 | 2007-08-08 | Data maintenance method, equipment and system thereof in data-base |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101364217A CN101364217A (en) | 2009-02-11 |
| CN101364217B true CN101364217B (en) | 2011-06-22 |
Family
ID=40390588
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007100757083A Active CN101364217B (en) | 2007-08-08 | 2007-08-08 | Data maintenance method, equipment and system thereof in data-base |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101364217B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106936862A (en) * | 2015-12-29 | 2017-07-07 | 优信拍（北京）信息科技有限公司 | Method of data synchronization, apparatus and system |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102929983B (en) * | 2012-10-18 | 2016-11-16 | 京信通信系统（中国）有限公司 | Embedded database is synchronized to the method and apparatus in flash data storehouse |
| CN103838757B (en) * | 2012-11-26 | 2017-06-09 | 腾讯科技（深圳）有限公司 | To the processing system and method for the relation chain data long of user |
| CN104035938A (en) * | 2013-03-07 | 2014-09-10 | 阿里巴巴集团控股有限公司 | Performance continuous integration data processing method and device |
| CN103268351B (en) * | 2013-05-31 | 2017-05-03 | 网易（杭州）网络有限公司 | Method and device for data synchronism |
| CN104424392A (en) * | 2013-09-10 | 2015-03-18 | 上海联影医疗科技有限公司 | Maintenance method for medical system and device |
| CN104714957B (en) * | 2013-12-13 | 2018-11-23 | 阿里巴巴集团控股有限公司 | A kind of variation and device of table structure |
| CN105373541B (en) * | 2014-08-22 | 2019-03-22 | 博雅网络游戏开发（深圳）有限公司 | The processing method and system of the data operation request of database |
| CN104462353B (en) * | 2014-12-04 | 2017-12-22 | 北京国双科技有限公司 | Database batch synchronization processing method and processing device |
| CN106484565B (en) * | 2016-09-22 | 2019-06-28 | 华为数字技术（成都）有限公司 | Method of data synchronization and relevant device between multiple data centers |
| CN106506661A (en) * | 2016-11-18 | 2017-03-15 | 浪潮软件集团有限公司 | Method, server and system for dynamically returning data |
| CN109996089B (en) * | 2019-02-20 | 2021-09-28 | 视联动力信息技术股份有限公司 | Method and system for processing operation log and streaming media server |
| CN110941623A (en) * | 2019-11-12 | 2020-03-31 | 北京达佳互联信息技术有限公司 | Data synchronization method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20040065464A (en) * | 2003-01-14 | 2004-07-22 | 삼성전자주식회사 | Apparatus and method for duplication of database management system |
| CN1619545A (en) * | 2000-10-09 | 2005-05-25 | 最佳收益有限公司 | Method and apparatus for data processing |
| CN1821978A (en) * | 2006-01-16 | 2006-08-23 | 深圳创维－Rgb电子有限公司 | Method for operating data in non-volatile storage in embedded system |
| CN1858745A (en) * | 2006-04-05 | 2006-11-08 | 华为技术有限公司 | Processing method for realizing consistency of internal storage data and data bank data service |
-
2007
- 2007-08-08 CN CN2007100757083A patent/CN101364217B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1619545A (en) * | 2000-10-09 | 2005-05-25 | 最佳收益有限公司 | Method and apparatus for data processing |
| KR20040065464A (en) * | 2003-01-14 | 2004-07-22 | 삼성전자주식회사 | Apparatus and method for duplication of database management system |
| CN1821978A (en) * | 2006-01-16 | 2006-08-23 | 深圳创维－Rgb电子有限公司 | Method for operating data in non-volatile storage in embedded system |
| CN1858745A (en) * | 2006-04-05 | 2006-11-08 | 华为技术有限公司 | Processing method for realizing consistency of internal storage data and data bank data service |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106936862A (en) * | 2015-12-29 | 2017-07-07 | 优信拍（北京）信息科技有限公司 | Method of data synchronization, apparatus and system |
| CN106936862B (en) * | 2015-12-29 | 2019-11-01 | 优信拍（北京）信息科技有限公司 | Method of data synchronization, apparatus and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101364217A (en) | 2009-02-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101364217B (en) | Data maintenance method, equipment and system thereof in data-base | |
| CN108319654B (en) | Computing system, cold and hot data separation method and device, and computer readable storage medium | |
| CN101493826B (en) | Database system based on WEB application and data management method thereof | |
| CN101233497B (en) | Revenue management system and method | |
| CN101183322B (en) | Method for deferred logging and apparatus thereof | |
| CN111563102A (en) | Cache updating method, server, system and storage medium | |
| US8250590B2 (en) | Apparatus, system, and method for seamless multiple format metadata abstraction | |
| CN100590620C (en) | System and method for moving records between partitions | |
| CN103390041A (en) | Method and system for providing data service based on middleware | |
| CN105164674A (en) | Queries involving multiple databases and execution engines | |
| CN102272751B (en) | Data integrity in a database environment through background synchronization | |
| CN102955792A (en) | Method for implementing transaction processing for real-time full-text search engine | |
| CN110737682A (en) | cache operation method, device, storage medium and electronic equipment | |
| WO2022095366A1 (en) | Redis-based data reading method and apparatus, device, and readable storage medium | |
| CN105653720A (en) | Database hierarchical storage optimization method capable of achieving flexible configuration | |
| CN105787058A (en) | User label system and data pushing system based on same | |
| WO2020238860A1 (en) | Distributed file batch processing method and apparatus, and readable storage medium | |
| US20130318059A1 (en) | Transfer of data from transactional data sources to partitioned databases in restartable environment | |
| CN110889754B (en) | Method for improving processing efficiency of non-overdraft hot spot account | |
| US20130304707A1 (en) | Data Archiving Approach Leveraging Database Layer Functionality | |
| CN101853278A (en) | Application method of data storage system | |
| EP3082050A1 (en) | Mass data fusion storage method and system | |
| CN111913973A (en) | Data synchronization method, device and storage medium | |
| CN111506628A (en) | Data processing method and device | |
| CN113468150A (en) | Horizontal segmentation capacity expansion and migration method for payment subscription data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |