CN103838762A - Uninterrupted data processing device and method based on data table rotation - Google Patents

Uninterrupted data processing device and method based on data table rotation Download PDF

Info

Publication number
CN103838762A
CN103838762A CN201210485502.9A CN201210485502A CN103838762A CN 103838762 A CN103838762 A CN 103838762A CN 201210485502 A CN201210485502 A CN 201210485502A CN 103838762 A CN103838762 A CN 103838762A
Authority
CN
China
Prior art keywords
data
backup
data processing
allocation list
task
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201210485502.9A
Other languages
Chinese (zh)
Other versions
CN103838762B (en
Inventor
杨森
陈林
华锦芝
杨燕明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Unionpay Co Ltd
Original Assignee
China Unionpay Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Unionpay Co Ltd filed Critical China Unionpay Co Ltd
Priority to CN201210485502.9A priority Critical patent/CN103838762B/en
Publication of CN103838762A publication Critical patent/CN103838762A/en
Application granted granted Critical
Publication of CN103838762B publication Critical patent/CN103838762B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors

Abstract

The invention provides an uninterrupted data processing device and method based on data table rotation. The uninterrupted data processing method includes the steps that a configuration table is regularly modified based on user configuration instructions, wherein the configuration table comprises a data processing date field, current official task data table number fields and a status switching field; one of the two official task data tables is used based on the configuration table so that data processing tasks from external systems can be processed in real time; data backup operation and data cleaning operation are periodically conducted based on the configuration table and through at least one backup historical data table. According to the uninterrupted data processing device and method based on the data table rotation, the influences of data fragments on data processing performance can be eliminated, and stable resource consumption can be kept.

Description

Uninterrupted data treating apparatus and method based on tables of data rotation
Technical field
The present invention relates to data processing equipment and method, more specifically, relate to uninterrupted data treating apparatus and method based on tables of data rotation.
Background technology
At present, along with becoming increasingly abundant of the class of business of the increasingly extensive and different field of cyber-net application, uninterrupted data processing (for example transaction processing server in financial field) device and method becomes more and more important.
Existing uninterrupted data treating apparatus and method are used data table access data conventionally. but, there are the following problems for it: along with the long-time running of data processing equipment and the continuous increase of data volume, will cause the continuous reduction of data base read-write performance and the continuous increase of system resources consumption.
In order to address the above problem, existing uninterrupted data treating apparatus and method adopt the mode of cleaning historical information conventionally.But, owing to using a tables of data, therefore generally can only use the mode of deleting the data before special time to carry out cleaning operation.The cleaning operation of this form can cause staying a large amount of data fragments in data-carrier store, and along with being on the increase of data fragment, data access operation still can continue to increase to the consumption of system resource.
Therefore, there is following demand: provide and can eliminate data fragment to the impact of data processing performance and can keep uninterrupted data treating apparatus and the method for stable resource consumption.
Summary of the invention
Can eliminate data fragment to the impact of data processing performance and can keep uninterrupted data treating apparatus and the method for stable resource consumption in order to solve the existing problem of above-mentioned prior art scheme, to the present invention proposes.
The object of the invention is to be achieved through the following technical solutions:
A uninterrupted data treating apparatus based on tables of data rotation, the described uninterrupted data treating apparatus based on tables of data rotation comprises:
Configuration module, the configuration-direct of described configuration module timing based on user revised allocation list, and wherein, described allocation list comprises data processing date field, current formal task data sheet number field and switching state field;
Data processing module, described data processing module uses in two formal task data sheets and processes in real time the data processing task from external system based on described allocation list;
Backup cleaning module, described backup cleaning module based on described allocation list and by least one backup historical data table periodically executing data backup and cleaning operation;
Memory module, described memory module is stored described allocation list, described two formal task data sheets and described at least one backup historical data table.
In the above in disclosed scheme, preferably, described at least one backup historical data table comprises multiple backup historical data tables (exemplarily, described at least one backup historical data table comprises 4 backup historical data tables, and first backup historical data table is for first, five and the historical data in September, second backup historical data table is for second, six and the historical data in October, the 3rd backup historical data table is for the 3rd, seven and the historical data in November and the 4th backup historical data table for the 4th, eight and the historical data in Dec).
In the above in disclosed scheme, preferably, the value of the data processing date field in described allocation list is indicated current data processing actual date, the numbering of the formal task data sheet that the value indication current period of the current formal task data sheet number field in described allocation list should use, the value indication switching state of the switching state field in described allocation list.
In disclosed scheme, preferably, in the time that the configuration-direct of timing based on user revised allocation list, the value of the switching state field in the described allocation list of described configuration module is set to " in switching " in the above.
In the above in disclosed scheme, preferably, described data processing module is executing data Processing tasks as follows: obtain numbering and the switching state of the formal task data sheet that current period should use from described allocation list, and the new formal task data sheet that uses as current period of the formal task data sheet of the numbering of the formal task data sheet that described current period should be used indication; If switching state is " in non-switching ", described data processing module is directly carried out described data processing task for described new formal task data sheet, and wherein, described data processing task comprises search, renewal and/or update; If switching state is " in switching ", according to the type of data processing task executing data Processing tasks as follows: if data processing task is update, directly carry out described update for described new formal task data sheet, if and data processing task is search or upgrades operation, in new formal task data sheet and old formal task data sheet, carry out respectively this search or upgrade operation; If data processing task is the operation for backup historical data table, processes the date according to historical data and determine corresponding backup historical data table, and directly carry out described data processing task for the backup historical data table of described correspondence.
In the above in disclosed scheme, preferably, described backup cleaning module periodic test carry out backup and cleaning operation as follows: (1) obtains numbering, switching state and the current data processing actual date of the formal task data sheet that current period should use from described allocation list; (2) if described switching state is " in switching ", whether the duration of judgement " in switching " state exceedes predetermined threshold value, and if the duration of " in switching " state exceedes predetermined threshold value, the value of the switching state field in described allocation list is revised as to " in non-switching " and backup cleaning mark and is set to " backup cleaning "; If described switching state is " in non-switching ", the value of judgement backup cleaning mark, and if the value of described backup cleaning mark is " not backup cleaning ", the backup of executing data table and cleaning operation, if and the value of described backup cleaning mark is " having backed up cleaning ", enter dormant state and return to afterwards step (1) in predetermined time section (this predetermined time section can be pre-arranged by configuration operation).
In the above in disclosed scheme, preferably, described tables of data backup and cleaning operation comprise: executing data backup operation as follows: derive the data of the formal task data sheet of the value indication of " the current formal task data sheet numbering " field in non-described allocation list in the mode of file, and the file of the data that comprise derivation is imported to the backup historical data table corresponding to current data processing actual date of the value indication of " data processing date " field in described allocation list; After data backup has operated, the formal task data sheet of the value indication to " the current formal task data sheet numbering " field in non-described allocation list and next month, and the value that after clear up successfully, mark is cleared up in described backup was set to " having backed up cleaning " by the backup historical data table of use to carry out full table cleaning operation without the mode of fragment.
Object of the present invention also can be achieved through the following technical solutions:
A uninterrupted data disposal route based on tables of data rotation, described method comprises the following steps:
(A1) configuration-direct of timing based on user revised allocation list, and wherein, described allocation list comprises data processing date field, current formal task data sheet number field and switching state field;
(A2) use in two formal task data sheets and process in real time the data processing task from external system based on described allocation list;
(A3) based on described allocation list and by least one backup historical data table periodically executing data backup and cleaning operation.
Uninterrupted data treating apparatus and method based on tables of data rotation disclosed in this invention has the following advantages: process application for uninterrupted data, can eliminate data fragment to the impact of data processing performance and can keep stable resource consumption.
Accompanying drawing explanation
By reference to the accompanying drawings, technical characterictic of the present invention and advantage will be understood better by those skilled in the art, wherein:
Fig. 1 is the schematic diagram of the uninterrupted data treating apparatus based on tables of data rotation according to an embodiment of the invention;
Fig. 2 is the process flow diagram of the uninterrupted data disposal route based on tables of data rotation according to an embodiment of the invention.
Embodiment
Fig. 1 is the schematic diagram of the uninterrupted data treating apparatus based on tables of data rotation according to an embodiment of the invention.As shown in Figure 1, the uninterrupted data treating apparatus based on tables of data rotation disclosed in this invention comprises configuration module 1, data processing module 2, backup cleaning module 3 and memory module 4.Wherein, the configuration-direct of described configuration module 1 timing (for example, every day) based on user revised allocation list, and wherein, described allocation list comprises data processing date field, current formal task data sheet number field and switching state field.Described data processing module 2 uses in two formal task data sheets and processes in real time the data processing task from external system based on described allocation list.Described backup cleaning module 3 based on described allocation list and by least one backup historical data table the periodically backup of (for example, every day) executing data and cleaning operation.Described memory module 4 is stored described allocation list, described two formal task data sheets and described at least one backup historical data table.
Preferably, in the uninterrupted data treating apparatus based on tables of data rotation disclosed in this invention, described at least one backup historical data table comprises multiple backup historical data tables (exemplarily, described at least one backup historical data table comprises 4 backup historical data tables, and first backup historical data table is for first, five and the historical data in September, second backup historical data table is for second, six and the historical data in October, the 3rd backup historical data table is for the 3rd, seven and the historical data in November and the 4th backup historical data table for the 4th, eight and the historical data in Dec, in addition, exemplarily, every day by the previous day used formal task data sheet backup to backup historical data table in time according to using a corresponding backup historical data table exact date of the previous day, in other words, use 4 backup historical data tables can retain the historical data of 2 months, and it will be understood by those skilled in the art that: according to the actual demand of the time length to the historical data retaining, can use more or fewer backup historical data table).
Preferably, in the uninterrupted data treating apparatus based on tables of data rotation disclosed in this invention, the value of the data processing date field in described allocation list indicates current data processing actual date (for example, with the form of date, can determine the backup historical data table that current period should use by it, be which backup historical data table is current period service application should be used), the numbering of the formal task data sheet that the value indication current period of the current formal task data sheet number field in described allocation list should use (for example 1 or 2), (for example 1 represents " in switching " to the value indication switching state of the switching state field in described allocation list, and 0 expression " in non-switching ").
Preferably, in the uninterrupted data treating apparatus based on tables of data rotation disclosed in this invention, in the time that the configuration-direct of timing based on user revised allocation list, the value of the switching state field in the described allocation list of described configuration module 1 is set to " in switching ".
Preferably, in the uninterrupted data treating apparatus based on tables of data rotation disclosed in this invention, described data processing module 2 executing data Processing tasks as follows: obtain numbering and the switching state of the formal task data sheet that current period should use from described allocation list, and the new formal task data sheet that uses as current period of the formal task data sheet of the numbering of the formal task data sheet that described current period should be used indication, if switching state is " in non-switching ", described data processing module 2 is directly carried out described data processing task for described new formal task data sheet, and wherein, described data processing task comprises search, renewal and/or update, if switching state is " in switching ", according to the type of data processing task executing data Processing tasks as follows: for example, if data processing task is update (inserting the new data for the treatment of subsequent treatment), directly carry out described update (so that the subsequent treatment of data can be carried out in new formal task data sheet) for described new formal task data sheet, if and data processing task is search or upgrades operation, in new formal task data sheet and old formal task data sheet, carry out respectively this search or upgrade operation (so that untreated complete task is processed in time between new and old tables of data transfer period in old formal task data sheet, thereby prevent switching front newly-increased data in old table and do not obtained the risk of processing in time), if data processing task is the operation for backup historical data table, processes the date according to historical data and determine corresponding backup historical data table, and directly carry out described data processing task for the backup historical data table of described correspondence.
Preferably, in the uninterrupted data treating apparatus based on tables of data rotation disclosed in this invention, described backup cleaning module 3 periodically checks and carries out backup and cleaning operation as follows: (1) obtains numbering, switching state and the current data processing actual date of the formal task data sheet that current period should use from described allocation list, (2) if described switching state is " in switching ", whether the duration of judgement " in switching " state exceedes predetermined threshold value (this threshold value is determined by actual business processing speed), and if the duration of " in switching " state exceedes predetermined threshold value, the value of the switching state field in described allocation list being revised as to " in non-switching " and backup cleaning mark is set to " backup cleaning " (backup cleaning mark is safeguarded the complicacy that can reduce systematic parameter maintenance by backing up cleaning inside modules, , if backup cleaning module is restarted, backup cleaning mark is reset, also just the formal tables of data increase of having cleared up is once backed up and cleaning operation, the historical data table of having cleared up is increased to a cleaning operation, and can not affect the function of system and can not increase the burden of system), if described switching state is " in non-switching ", the value of judgement backup cleaning mark, and if the value of described backup cleaning mark is " not backup cleaning ", the backup of executing data table and cleaning operation, if and the value of described backup cleaning mark is " having backed up cleaning ", enter dormant state and return to afterwards step (1) in predetermined time section (this predetermined time section can be pre-arranged by configuration operation).
Preferably, in the uninterrupted data treating apparatus based on tables of data rotation disclosed in this invention, described tables of data backup and cleaning operation comprise: executing data backup operation as follows: derive the data of the formal task data sheet of the value indication of " the current formal task data sheet numbering " field in non-described allocation list in the mode of file, and the file of the data that comprise derivation is imported to the backup historical data table corresponding to current data processing actual date of the value indication of " data processing date " field in described allocation list; After data backup has operated, the formal task data sheet of the value indication to " the current formal task data sheet numbering " field in non-described allocation list and next month by the backup historical data table of use to carry out full table cleaning operation (exemplarily without the mode of fragment, can guarantee to change day brand-new formal task data sheet of rear use by this mode, change month brand-new backup historical data table of rear use), and after clearing up successfully, the value of described backup cleaning mark is set to " having backed up cleaning ".Wherein, adopt the mode of file to derive and import data, can improve the efficiency that tables of data backup is transplanted, and the data fragment of the system performance of can guaranteeing not exert an influence.
Therefore the uninterrupted data treating apparatus based on tables of data rotation disclosed in this invention has following advantages: process application for uninterrupted data, can eliminate data fragment to the impact of data processing performance and can keep stable resource consumption.
Fig. 2 is the process flow diagram of the uninterrupted data disposal route based on tables of data rotation according to an embodiment of the invention.As shown in Figure 2, uninterrupted data disposal route based on tables of data rotation disclosed in this invention comprises the following steps: that (A1) regularly (for example, every day) revise allocation list based on user's configuration-direct, wherein, described allocation list comprises data processing date field, current formal task data sheet number field and switching state field; (A2) use in two formal task data sheets and process in real time the data processing task from external system based on described allocation list; (A3) based on described allocation list and by least one backup historical data table periodically (for example, every day) executing data backup and cleaning operation.
Preferably, in the uninterrupted data disposal route based on tables of data rotation disclosed in this invention, described at least one backup historical data table comprises multiple backup historical data tables (exemplarily, described at least one backup historical data table comprises 4 backup historical data tables, and first backup historical data table is for first, five and the historical data in September, second backup historical data table is for second, six and the historical data in October, the 3rd backup historical data table is for the 3rd, seven and the historical data in November and the 4th backup historical data table for the 4th, eight and the historical data in Dec, in addition, exemplarily, every day by the previous day used formal task data sheet backup to backup historical data table in time according to using a corresponding backup historical data table exact date of the previous day, in other words, use 4 backup historical data tables can retain the historical data of 2 months, and it will be understood by those skilled in the art that: according to the actual demand of the time length to the historical data retaining, can use more or fewer backup historical data table).
Preferably, in the uninterrupted data disposal route based on tables of data rotation disclosed in this invention, the value of the data processing date field in described allocation list indicates current data processing actual date (for example, with the form of date, can determine the backup historical data table that current period should use by it, be which backup historical data table is current period service application should be used), the numbering of the formal task data sheet that the value indication current period of the current formal task data sheet number field in described allocation list should use (for example 1 or 2), (for example 1 represents " in switching " to the value indication switching state of the switching state field in described allocation list, and 0 expression " in non-switching ").
Preferably, in the uninterrupted data disposal route based on tables of data rotation disclosed in this invention, described step (A1) comprising: the value of the switching state field when configuration-direct in timing based on user is revised allocation list in described allocation list is set to " in switching ".
Preferably, in the uninterrupted data disposal route based on tables of data rotation disclosed in this invention, described step (A2) further comprises: obtain numbering and the switching state of the formal task data sheet that current period should use from described allocation list, and the new formal task data sheet that uses as current period of the formal task data sheet of the numbering of the formal task data sheet that described current period should be used indication, if switching state is " in non-switching ", directly carry out described data processing task for described new formal task data sheet, wherein, described data processing task comprises search, renewal and/or update, if switching state is " in switching ", according to the type of data processing task executing data Processing tasks as follows: for example, if data processing task is update (inserting the new data for the treatment of subsequent treatment), directly carry out described update (so that the subsequent treatment of data can be carried out in new formal task data sheet) for described new formal task data sheet, if and data processing task is search or upgrades operation, in new formal task data sheet and old formal task data sheet, carry out respectively this search or upgrade operation (so that untreated complete task is processed in time between new and old tables of data transfer period in old formal task data sheet, thereby prevent switching front newly-increased data in old table and do not obtained the risk of processing in time), if data processing task is the operation for backup historical data table, processes the date according to historical data and determine corresponding backup historical data table, and directly carry out described data processing task for the backup historical data table of described correspondence.
Preferably, in the uninterrupted data disposal route based on tables of data rotation disclosed in this invention, described step (A3) further comprises: periodically check as follows and carry out backup and cleaning operation: (1) obtains numbering, switching state and the current data processing actual date of the formal task data sheet that current period should use from described allocation list; (2) if described switching state is " in switching ", whether the duration of judgement " in switching " state exceedes predetermined threshold value (this threshold value is determined by actual business processing speed), and if the duration of " in switching " state exceedes predetermined threshold value, the value of the switching state field in described allocation list is revised as to " in non-switching " and backup cleaning mark and is set to " backup cleaning "; If described switching state is " in non-switching ", the value of judgement backup cleaning mark, and if the value of described backup cleaning mark is " not backup cleaning ", the backup of executing data table and cleaning operation, if and the value of described backup cleaning mark is " having backed up cleaning ", enter dormant state and return to afterwards step (1) in predetermined time section (this predetermined time section can be pre-arranged by configuration operation).
Preferably, in the uninterrupted data disposal route based on tables of data rotation disclosed in this invention, described tables of data backup and cleaning operation comprise: executing data backup operation as follows: derive the data of the formal task data sheet of the value indication of " the current formal task data sheet numbering " field in non-described allocation list in the mode of file, and the file of the data that comprise derivation is imported to the backup historical data table corresponding to current data processing actual date of the value indication of " data processing date " field in described allocation list; After data backup has operated, the formal task data sheet of the value indication to " the current formal task data sheet numbering " field in non-described allocation list and next month by the backup historical data table of use to carry out full table cleaning operation (exemplarily without the mode of fragment, can guarantee to change day brand-new formal task data sheet of rear use by this mode, change month brand-new backup historical data table of rear use), and after clearing up successfully, the value of described backup cleaning mark is set to " having backed up cleaning ".Wherein, adopt the mode of file to derive and import data, can improve the efficiency that tables of data backup is transplanted, and the data fragment of the system performance of can guaranteeing not exert an influence.
Therefore the uninterrupted data disposal route based on tables of data rotation disclosed in this invention has following advantages: process application for uninterrupted data, can eliminate data fragment to the impact of data processing performance and can keep stable resource consumption.
Although the present invention is described by above-mentioned preferred implementation, its way of realization is not limited to above-mentioned embodiment.Should be realized that: in the situation that not departing from purport of the present invention and scope, those skilled in the art can make different variations and modification to the present invention.

Claims (8)

1. the uninterrupted data treating apparatus based on tables of data rotation, the described uninterrupted data treating apparatus based on tables of data rotation comprises:
Configuration module, the configuration-direct of described configuration module timing based on user revised allocation list, and wherein, described allocation list comprises data processing date field, current formal task data sheet number field and switching state field;
Data processing module, described data processing module uses in two formal task data sheets and processes in real time the data processing task from external system based on described allocation list;
Backup cleaning module, described backup cleaning module based on described allocation list and by least one backup historical data table periodically executing data backup and cleaning operation;
Memory module, described memory module is stored described allocation list, described two formal task data sheets and described at least one backup historical data table.
2. the uninterrupted data treating apparatus based on tables of data rotation according to claim 1, is characterized in that, described at least one backup historical data table comprises multiple backup historical data tables.
3. the uninterrupted data treating apparatus based on tables of data rotation according to claim 2, it is characterized in that, the value of the data processing date field in described allocation list is indicated current data processing actual date, the numbering of the formal task data sheet that the value indication current period of the current formal task data sheet number field in described allocation list should use, the value indication switching state of the switching state field in described allocation list.
4. the uninterrupted data treating apparatus based on tables of data rotation according to claim 3, it is characterized in that, in the time that the configuration-direct of timing based on user revised allocation list, the value of the switching state field in the described allocation list of described configuration module is set to " in switching ".
5. the uninterrupted data treating apparatus based on tables of data rotation according to claim 4, it is characterized in that, described data processing module is executing data Processing tasks as follows: obtain numbering and the switching state of the formal task data sheet that current period should use from described allocation list, and the new formal task data sheet that uses as current period of the formal task data sheet of the numbering of the formal task data sheet that described current period should be used indication; If switching state is " in non-switching ", described data processing module is directly carried out described data processing task for described new formal task data sheet, and wherein, described data processing task comprises search, renewal and/or update; If switching state is " in switching ", according to the type of data processing task executing data Processing tasks as follows: if data processing task is update, directly carry out described update for described new formal task data sheet, if and data processing task is search or upgrades operation, in new formal task data sheet and old formal task data sheet, carry out respectively this search or upgrade operation; If data processing task is the operation for backup historical data table, processes the date according to historical data and determine corresponding backup historical data table, and directly carry out described data processing task for the backup historical data table of described correspondence.
6. the uninterrupted data treating apparatus based on tables of data rotation according to claim 5, it is characterized in that described backup cleaning module periodic test carry out backup and cleaning operation as follows: (1) obtains numbering, switching state and the current data processing actual date of the formal task data sheet that current period should use from described allocation list; (2) if described switching state is " in switching ", whether the duration of judgement " in switching " state exceedes predetermined threshold value, and if the duration of " in switching " state exceedes predetermined threshold value, the value of the switching state field in described allocation list is revised as to " in non-switching " and backup cleaning mark and is set to " backup cleaning "; If described switching state is " in non-switching ", the value of judgement backup cleaning mark, and if the value of described backup cleaning mark is " not backup cleaning ", the backup of executing data table and cleaning operation, if and the value of described backup cleaning mark is " having backed up cleaning ", enter dormant state and return to step (1) after predetermined time section.
7. the uninterrupted data treating apparatus based on tables of data rotation according to claim 6, it is characterized in that, described tables of data backup and cleaning operation comprise: executing data backup operation as follows: derive the data of the formal task data sheet of the value indication of " the current formal task data sheet numbering " field in non-described allocation list in the mode of file, and the file of the data that comprise derivation is imported to the backup historical data table corresponding to current data processing actual date of the value indication of " data processing date " field in described allocation list; After data backup has operated, the formal task data sheet of the value indication to " the current formal task data sheet numbering " field in non-described allocation list and next month, and the value that after clear up successfully, mark is cleared up in described backup was set to " having backed up cleaning " by the backup historical data table of use to carry out full table cleaning operation without the mode of fragment.
8. the uninterrupted data disposal route based on tables of data rotation, described method comprises the following steps:
(A1) configuration-direct of timing based on user revised allocation list, and wherein, described allocation list comprises data processing date field, current formal task data sheet number field and switching state field;
(A2) use in two formal task data sheets and process in real time the data processing task from external system based on described allocation list;
(A3) based on described allocation list and by least one backup historical data table periodically executing data backup and cleaning operation.
CN201210485502.9A 2012-11-26 2012-11-26 Uninterrupted data processing unit and method based on tables of data rotation Active CN103838762B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210485502.9A CN103838762B (en) 2012-11-26 2012-11-26 Uninterrupted data processing unit and method based on tables of data rotation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210485502.9A CN103838762B (en) 2012-11-26 2012-11-26 Uninterrupted data processing unit and method based on tables of data rotation

Publications (2)

Publication Number Publication Date
CN103838762A true CN103838762A (en) 2014-06-04
CN103838762B CN103838762B (en) 2017-09-29

Family

ID=50802273

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210485502.9A Active CN103838762B (en) 2012-11-26 2012-11-26 Uninterrupted data processing unit and method based on tables of data rotation

Country Status (1)

Country Link
CN (1) CN103838762B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104036001A (en) * 2014-06-13 2014-09-10 上海新炬网络技术有限公司 Dynamic hotlist priority scheduling based quick data cleaning method
CN105653621A (en) * 2015-12-25 2016-06-08 中国建设银行股份有限公司 Uninterrupted business system, data export method thereof and streaming data service module
WO2019109514A1 (en) * 2017-12-08 2019-06-13 平安科技(深圳)有限公司 Datasheet backup method, device, electronic apparatus and medium
CN110019477A (en) * 2017-12-27 2019-07-16 航天信息股份有限公司 A kind of method and system carrying out big data processing using HIVE backup table
CN111800512A (en) * 2020-07-07 2020-10-20 深圳前海百递网络有限公司 Data transmission method and server

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101145156A (en) * 2007-04-17 2008-03-19 中兴通讯股份有限公司 Network management history data multi-table processing method
CN101419616A (en) * 2008-12-10 2009-04-29 阿里巴巴集团控股有限公司 Data synchronization method and apparatus
US20090198855A1 (en) * 2008-02-06 2009-08-06 Broadcom Corporation Ic for handheld computing unit of a computing device
CN101887388A (en) * 2010-06-18 2010-11-17 中兴通讯股份有限公司 Data backup system and method based on memory database
CN102073697A (en) * 2010-12-28 2011-05-25 中兴通讯股份有限公司 Data processing method and data processing device
CN102200972A (en) * 2010-03-24 2011-09-28 腾讯科技(北京)有限公司 Database maintenance method and database maintenance equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101145156A (en) * 2007-04-17 2008-03-19 中兴通讯股份有限公司 Network management history data multi-table processing method
US20090198855A1 (en) * 2008-02-06 2009-08-06 Broadcom Corporation Ic for handheld computing unit of a computing device
CN101419616A (en) * 2008-12-10 2009-04-29 阿里巴巴集团控股有限公司 Data synchronization method and apparatus
CN102200972A (en) * 2010-03-24 2011-09-28 腾讯科技(北京)有限公司 Database maintenance method and database maintenance equipment
CN101887388A (en) * 2010-06-18 2010-11-17 中兴通讯股份有限公司 Data backup system and method based on memory database
CN102073697A (en) * 2010-12-28 2011-05-25 中兴通讯股份有限公司 Data processing method and data processing device

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104036001A (en) * 2014-06-13 2014-09-10 上海新炬网络技术有限公司 Dynamic hotlist priority scheduling based quick data cleaning method
CN104036001B (en) * 2014-06-13 2017-05-10 上海新炬网络信息技术有限公司 Dynamic hotlist priority scheduling based quick data cleaning method
CN105653621A (en) * 2015-12-25 2016-06-08 中国建设银行股份有限公司 Uninterrupted business system, data export method thereof and streaming data service module
WO2019109514A1 (en) * 2017-12-08 2019-06-13 平安科技(深圳)有限公司 Datasheet backup method, device, electronic apparatus and medium
CN110019477A (en) * 2017-12-27 2019-07-16 航天信息股份有限公司 A kind of method and system carrying out big data processing using HIVE backup table
CN111800512A (en) * 2020-07-07 2020-10-20 深圳前海百递网络有限公司 Data transmission method and server

Also Published As

Publication number Publication date
CN103838762B (en) 2017-09-29

Similar Documents

Publication Publication Date Title
CN102142006B (en) File processing method and device of distributed file system
CN102473122B (en) fault-tolerant batch processing
CN103838762A (en) Uninterrupted data processing device and method based on data table rotation
CN103092903A (en) Database Log Parallelization
CN104516959B (en) A kind of method and device for managing database journal
CN103092712A (en) Method and device for recovering interrupt tasks
CN102521269A (en) Index-based computer continuous data protection method
CN104021043A (en) Interruption reentry method and system of batch applications
CN106970921A (en) A kind of data migration method and device
CN103647935A (en) Method for storing video data and video monitoring device
CN102567184A (en) Journal storage method based on Flash
CN104102535B (en) Process migration method and transportable operating system
US9459949B2 (en) Methods and apparatus to provide failure detection
CN104424186A (en) Method and device for realizing persistence in flow calculation application
CN102750317A (en) Method and device for data persistence processing and data base system
CN103514216A (en) Serial number generating method based on database system
CN106020735A (en) Data storage method and device
CN103678051A (en) On-line fault tolerance method in cluster data processing system
CN103176920A (en) Nor flash power down protection method and Nor flash power down protection device
CN105302602A (en) Smooth online upgrade method for cloud platform application
CN102591993A (en) Asynchronous processing method and device for hotlist data update
CN102023926A (en) Method and device for data overtime aging processing
CN103957229A (en) Active updating method, device and server for physical machines in IaaS cloud system
CN105243003A (en) Memory allocation monitoring method and apparatus
CN103218256B (en) A kind of backing method of host batch and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant