CN105279261A - Dynamic extensible database filing method and system - Google Patents
Dynamic extensible database filing method and system Download PDFInfo
- Publication number
- CN105279261A CN105279261A CN201510696350.0A CN201510696350A CN105279261A CN 105279261 A CN105279261 A CN 105279261A CN 201510696350 A CN201510696350 A CN 201510696350A CN 105279261 A CN105279261 A CN 105279261A
- Authority
- CN
- China
- Prior art keywords
- filing
- task
- data
- database
- copy
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a dynamic extensible database filing method which is used for filing the filed data from an original database to a target database. The method comprises the following steps: starting a filing thread according to a filing task, wherein the filing task appoints an original database and a target database of the filed data, the original database serves as a database which is the source of filed data and the target database serves as a database to which the data is to be filed; inquiring the filed data in the original database, packaging each page of filed data into a copy task and putting the copy task in a copy task thread pool; executing the copy tasks in the copy task thread pool and copying the filed data to the target database; after each copy task is completely executed, packaging the page of data into a deletion task and putting the deletion task in a deletion task thread pool; and executing the deletion task in the deletion task thread pool. The invention furthermore provides a dynamic extensible database filing system.
Description
Technical field
Present invention relates in general to data processing, more specifically, relate to a kind of dynamic scalable database filing method and system.
Background technology
Database filing system is the key that Internet enterprises solves growing mass data.Database filing system is done badly, and may cause that enterprise web site performance declines day by day, customer loss, even can cause loss of data, bring irremediable fame and economic loss to enterprise.Present Internet enterprises website visiting amount is huge and increase fast, the also sharp increase of various data, brings huge challenge to enterprise database filing.
For the filing of data, existing technical scheme mainly contains following several:
(1) data base administrator's filing: data base administrator as required filing data and service logic etc. artificially performs filing.Comprise the selection of filing data, the execution time of filing and archival solution etc.But although the basic operation in data administrator's acquaint with data storehouse, he is unfamiliar with needing the data service of filing.People, for writing filing script and performing filing, likely causes the mistake filing of data and loses.
(2) service application filing: according to business need, service application judges that those data need filing, then for needing the data of filing to realize filing voluntarily.The program comprises exploitation and realizes the program of filing function, the selection etc. of time of filing.This scheme to a certain degree can solve the unfamiliar problem of data service to needing filing, but each operation system needs oneself to realize the filing to data, and the realization of each operation system may be different, cannot ensure the unitarity of filing.
(3) temporally file: operation system according to the different time as year, the moon etc., by databases different for deposit data.This scheme can solve the disunity of data filing, also can determine the time granularity of filing and the correlativity of data by application system.But each system needs multiple database, each a period of time needs switch data storehouse.When system is many, relate to database many time, such operation is just difficult to realize.
Summary of the invention
One aspect of the present invention provides a kind of dynamic scalable database filing method, for by filing data from former database filing to target database, the method comprises: according to filing task start filing thread, filing task specifies former database and the target database of filing data, former database is the database as filing data source, and target database is the database that data will be archived; Inquire about the filing data in former database, every one page filing data is packaged into a copy task and puts into copy mission thread pond; Perform the copy task in copy mission thread pond, copy filing data to target database; After each copy tasks carrying completes, this page data is packaged into a deletion task and puts into deletion mission thread pond; And perform the deletion task of deleting in thread pool.
Alternatively, the method also comprises: when filing new database, add the data source information of this database to filing system; If and/or do not need to file certain database again, delete the data source information of this database from filing system.
Alternatively, the data source information of database comprises the IP of this database, user name, password, table name and type of database.
Alternatively, the method also comprises: management filing task, filing task also comprise following at least one item: former table, object table, filing execution time, filing perform frequency, filing condition and file number at every turn, wherein: former table is the database table in the source of depositing filing data; Object table is the database table depositing archive copy data; Filing condition specifies the data needs filing meeting what condition; And each filing number specifies the paging size of each inquiry raw data.
Alternatively, manage filing task comprise following at least one item: the maintenance of filing task, the test of filing task, the timer-triggered scheduler of filing task and the state of filing task control.
Alternatively, the method also comprises: after all copy thread pools and the deletion thread pool of this filing task execute, generating report forms data, then by report data stored in filing system database, this report data comprise following at least one item: the execution of this filing task is consuming time, filing quantity and filing quantity information per second.
Alternatively, inquiry filing data, every one page filing data is packaged into a copy task to put into copy mission thread pond and comprise: according to quantity and the ID scope of filing condition query filing data, then according to the restriction paging query filing data of ID scope, every one page filing data is packaged into a copy task and puts into copy mission thread pond.
Alternatively, the copy task performed in copy mission thread pond comprises: according to target database duplicate removal, is repeated copy to prevent data.
Alternatively, the method also comprises: under inquiry one page filing data, put into copy mission thread pond and delete before mission thread pond, first judge the state of filing task, if task suspends, wait task starts, if task terminates, exits tasks carrying.
Alternatively, the method also comprises: in response to user's inquiry, with the form of form display filing report data.
Another aspect of the present invention provides a kind of dynamic scalable database filing system, for by filing data from former database filing to target database, this system comprises filing execution module, this module comprises: for the device according to filing task start filing thread, filing task specifies former database and the target database of filing data, former database is the database as filing data source, and target database is the database that data will be archived; For inquiring about the filing data in former database, every one page filing data is packaged into the device that a copy task puts into copy mission thread pond; For performing the copy task in copy mission thread pond, filing data is copied to the device of target database; For after each copy tasks carrying completes, this page data is packaged into a deletion task and puts into the device deleting mission thread pond; And for performing the device of the deletion task of deleting in thread pool.
Alternatively, this system also comprises data source modules, and this module comprises: for when filing new database, the data source information of this database is added to the device of filing system; If and/or again certain database is filed for not needing, delete the device of the data source information of this database from filing system.
Alternatively, the data source information of database comprises the IP of this database, user name, password, table name and type of database.
Alternatively, this system also comprises filing task module, this module comprises: for managing the device of filing task, filing task comprises former database and the target database of filing data, and comprise following at least one item: former table, object table, filing execution time, filing perform frequency, filing condition and file number at every turn, wherein: former table is the database table in the source of depositing filing data; Object table is the database table depositing archive copy data; Filing condition specifies the data needs filing meeting what condition; And each filing number specifies the paging size of each inquiry raw data.
Alternatively, manage filing task comprise following at least one item: the maintenance of filing task, the test of filing task, the timer-triggered scheduler of filing task and the state of filing task control.
Alternatively, filing execution module also comprises: for after all copy thread pools of this filing task execute with deletion thread pool, generating report forms, then by form stored in the device in filing system database, this form comprise following at least one item: the execution of this filing task is consuming time, filing quantity and filing quantity information per second.
Alternatively, inquiry filing data, every one page filing data is packaged into a copy task to put into copy mission thread pond and comprise: according to quantity and the ID scope of filing condition query filing data, then according to the restriction paging query filing data of ID scope, every one page filing data is packaged into a copy task and puts into copy mission thread pond.
Alternatively, the copy task performed in copy mission thread pond comprises: according to target database duplicate removal, is repeated copy to prevent data.
Alternatively, this system also comprises: for one page filing data under inquiry, put into copy mission thread pond and delete before mission thread pond, first judge the device of the state of filing task, if task suspends, wait task starts, if task terminates, exits tasks carrying.
Alternatively, this system also comprises filing Reports module, for: in response to user's inquiry, with the form of form display filing report data.
Accompanying drawing explanation
In order to more completely understand the present invention and advantage thereof, referring now to following description by reference to the accompanying drawings, wherein:
Fig. 1 diagrammatically illustrates the structured flowchart of the dynamic scalable database filing system according to the embodiment of the present invention; And
Fig. 2 diagrammatically illustrates the processing flow chart of the filing execution module according to the embodiment of the present invention.
Embodiment
According to by reference to the accompanying drawings to the following detailed description of exemplary embodiment of the present, other side of the present invention, advantage and prominent feature will become apparent for those skilled in the art.
In the present invention, term " comprises " and " containing " and derivative thereof mean and to comprise and unrestricted; Term "or" is inclusive, mean and/or.
In this manual, the following various embodiments for describing the principle of the invention just illustrate, should not be interpreted as by any way limiting scope of invention.With reference to the following description of accompanying drawing for helping complete understanding by the exemplary embodiment of the present invention of claim and equivalents thereof.Following description comprises multiple detail and helps understand, but these details should think it is only exemplary.Therefore, those of ordinary skill in the art it should be understood that when not deviating from scope and spirit of the present invention, can carry out multiple change and amendment to embodiment described herein.In addition, for clarity and brevity, the description of known function and structure is eliminated.In addition, run through accompanying drawing, same reference numbers is used for identity function and operation.
Fig. 1 diagrammatically illustrates the structured flowchart of the dynamic scalable database filing system 100 according to the embodiment of the present invention.This system comprises data source modules 110, filing task module 120, filing execution module 130 and filing Reports module 140.
When filing, needing to add database data source, then creating a filing task.User can arrange the execution time, filing condition, filing quantity etc. of filing task.First archiving user creates a filing task according to the business need of self filing data, need the former database that filing is set (as the database in filing data source, also claim former storehouse), former table, target database (database that data are archived also claims object library), object table, filing execution time, filing perform frequency, filing condition, each filing number etc.Former table is the database table in the source of depositing filing data, and object table is the database table depositing archive copy data.Filing condition specifies the data needs filing meeting what condition, and such as how many days former data need filing, etc.Each filing number specifies the paging size of each inquiry raw data.If the former storehouse of needs filing and object library are not in systems in which, first user needs these databases to add in DSN.Filing task, when task execution time arrives, is distributed to filing execution module by filing task module.Filing execution module realizes fast and reliable filing by technology such as multithreading, batch operation data technique, major key limited fields.By the filing number of filing tasks carrying, the statistics generating report forms such as consuming time after filing task completes, then by statistical report directly stored in filing system database, this database can be such as relevant database RDBMS.Then when carrying out the inquiry reported, directly read data from RDBMS.
Below illustrate the operation of each module.
data source modules 110
Data source modules 110 is for managing the former database and target database that are archived system filing.When filing new database, add the data source information (IP, user name, password, table name, type of database (MYSQL/ORACLE) etc. of such as database) of this database to filing system by data source modules 110.If do not need to file certain database again, deleted the data source information of this database from filing system by data source modules 110.By data source modules 110, can add easily, delete the former database and target database that need filing, make the archiving services that database filing system 100 can provide general.
filing task module 120
Filing task module 120 for managing filing task, comprise following at least one item: filing task maintenance (such as add/delete/preserve), filing task test, filing task timer-triggered scheduler and filing task state control.When filing, add filing task by filing task module 120, filing task comprises the attributes such as Yuan Ku, former table, object library, object table, filing execution time, filing execution frequency, filing condition, each filing number.Create the test function that can also be provided by filing system successfully, whether the configuration of test filing task is correct and verify whether filing accurately realizes.When performing test function, provide a web operation interface, user can hit testing, and system once can specify the data of filing data to the appointment table of target database from the appointment table copy in former storehouse according to filing tasks carrying.The filing execution time is a plan target cron expression formula, uses job scheduling framework Quartz to realize timed task scheduling.After establishment filing task, filing task can be added in the scheduling of Quartz by filing task module 120.After edit-modify filing task, filing task module 120 can change the scheduling of the Quartz of this task again, to realize the adjustment of filing task dynamic, comprises the dynamic conditioning of filing condition and filing execution time.When filing tasks carrying, the controls such as filing task module 120 can suspend filing task, stopping, to realize filing the dynamically controlled in real time of tasks carrying process.
filing execution module 130
Filing execution module 130 is for according to filing tasks carrying data filing, and the report data of statistics filing.The treatment scheme of filing execution module 130 as shown in Figure 2.
The switching of filing former database and targeted database data source is realized by Spring data source switching at runtime technology, and uses thread local (thread-local) variable save current data source.Filing execution module 130 can according to filing task start one the filing thread execution filing performed.First can according to the quantity, ID scope etc. of the condition query filing data of filing.The ID of filing data is the major key field of database table automatic increase.Then, according to the restriction paging query filing data of ID scope, every one page is packaged into a copy task and puts into the execution of copy mission thread pond.Restriction paging refers to that Query Database realizes reducing the quantity of scan database data by the access of ID, thus realizes large data volume table paging query fast
According to target database duplicate removal, copy can be repeated to prevent data during copy tasks carrying.The data encapsulation of this page can be become a deletion task to put into after copy tasks carrying completes and delete the execution of mission thread pond.If copy unsuccessful, then perform the step judging whether copy task.If without deletion task, then perform and judge the step whether thread pool is finished.If delete unsuccessful, then perform the step judging whether deletion task.Until this task all copy thread pools and delete after thread pool executes, by consuming time for the execution of task, one or more information generating report forms data such as filing quantity, filing quantity per second etc., then by report data directly stored in filing system database.Under inquiry one page filing data, put into copy mission thread pond and delete before mission thread pond, system first can judge the state of filing task.If task suspends wait task to start, if task terminates directly to exit tasks carrying.
filing Reports module 140
Filing Reports module 140 is for inquiring about in response to user, filing report data is shown with the form of filing form, filing system supvr can carry out system optimization by these report datas, quantity, speed etc. that filing system uses user's task of can checking to file, can adjust the execution parameter of filing task to improve filing efficiency.
Database filing system 100 of the present invention, data source modules 110, filing task module 120, filing execution module 130 and filing Reports module 140 can realize by there being the electronic equipment of computing power (such as CPU) to perform the software comprising computer instruction.Now, above-mentioned each module is the functional module realizing corresponding function.Performing such instruction makes electronic equipment be configured to perform according to above-mentioned operations of the present invention.These softwares can store in a computer-readable storage medium.Computer-readable recording medium stores one or more program (software module), described one or more program comprises instruction, when the one or more processors in electronic equipment perform described instruction, described instruction makes electronic equipment perform method of the present invention.
These softwares can be stored as the form (memory device such as such as similar ROM) of volatile memory or Nonvolatile memory devices, no matter be erasable or rewritable, or be stored as the form (such as RAM, memory chip, equipment or integrated circuit) of storer, or be stored in (such as, CD, DVD, disk or tape etc.) on light computer-readable recording medium or magnetic computer-readable recording medium.It should be appreciated that memory device and storage medium are the embodiments being suitable for the machine-readable storage device storing one or more program, a described program or multiple program comprise instruction, when executed, realize embodiments of the invention.Embodiment provides program and stores the machine-readable storage device of this program, and described program comprises the code for realizing device described in any one claim of the present invention or method.In addition, can transmit these programs via any medium (such as, the signal of communication carried via wired connection or wireless connections) incoming call, multiple embodiment suitably comprises these programs.
The dynamic scalable database filing system that the present invention proposes can be avoided artificial operation to cause the loss of data, also the filing business of user to filing data can be avoided to be unfamiliar with cause the mistake of data file, while each operation system also can be avoided to realize data filing function.System provides data source administration module can add the former database and target database that need filing easily, only needs establishment filing task for filing data.Filing system is dispatched by the timed task that realizes of task by QUARTZ, can ensure that the timing of filing task performs and periodically performs.First filing implementation can ensure that data copy success just can perform data and delete, and fundamentally ensure that the loss of data.And use multithreading and filing data scope restriction technologies to prepare fast complete filing.
The present invention by data source modules to realize the dynamic expansion in filing data storehouse and target database.Filing task module realizes the establishment of filing task, the timing of Accuracy Verification and filing, periodic scheduling, also achieves dynamic interpolation and the control of filing task.Filing execution module completes filing task quickly and accurately.Filing Reports module provides filing effect form.The program achieves the data filing of controlled, dynamic, quick, accurate, easy expansion.
Although illustrate and describe the present invention with reference to certain exemplary embodiments of the present invention, but those skilled in the art should understand that, when not deviating from the spirit and scope of the present invention of claims and equivalents thereof, the multiple change in form and details can be carried out to the present invention.Therefore, scope of the present invention should not be limited to above-described embodiment, but should not only be determined by claims, is also limited by the equivalent of claims.
Claims (20)
1. a dynamic scalable database filing method, for by filing data from former database filing to target database, the method comprises:
According to filing task start filing thread, filing task specifies former database and the target database of filing data, and former database is the database as filing data source, and target database is the database that data will be archived;
Inquire about the filing data in former database, every one page filing data is packaged into a copy task and puts into copy mission thread pond;
Perform the copy task in copy mission thread pond, copy filing data to target database;
After each copy tasks carrying completes, this page data is packaged into a deletion task and puts into deletion mission thread pond; And
Perform the deletion task of deleting in thread pool.
2. method according to claim 1, also comprises:
When filing new database, add the data source information of this database to filing system; And/or
If do not need to file certain database again, delete the data source information of this database from filing system.
3. method according to claim 2, wherein the data source information of database comprises the IP of this database, user name, password, table name and type of database.
4. method according to claim 1, also comprises:
Management filing task, filing task also comprise following at least one item: former table, object table, filing execution time, filing perform frequency, filing condition and file number at every turn, wherein:
Former table is the database table in the source of depositing filing data;
Object table is the database table depositing archive copy data;
Filing condition specifies the data needs filing meeting what condition; And
Each filing number specifies the paging size of each inquiry raw data.
5. method according to claim 4, wherein manage filing task comprise following at least one item: the maintenance of filing task, the test of filing task, the timer-triggered scheduler of filing task and the state of filing task control.
6. method according to claim 1, also comprises:
After all copy thread pools of this filing task execute with deletion thread pool, generating report forms data, then by report data stored in filing system database, this report data comprise following at least one item: the execution of this filing task is consuming time, filing quantity and filing quantity information per second.
7. method according to claim 1, wherein inquires about filing data, every one page filing data is packaged into a copy task put into copy mission thread pond comprise:
According to quantity and the ID scope of filing condition query filing data, then according to the restriction paging query filing data of ID scope, every one page filing data is packaged into a copy task and puts into copy mission thread pond.
8. method according to claim 1, the copy task wherein performed in copy mission thread pond comprises:
According to target database duplicate removal, repeated copy to prevent data.
9. method according to claim 1, also comprises:
Under inquiry one page filing data, put into copy mission thread pond and delete before mission thread pond, first judge the state of filing task, if task suspends, wait task startup, if task terminates, exits tasks carrying.
10. method according to claim 1, also comprises:
In response to user's inquiry, with the form of form display filing report data.
11. 1 kinds of dynamic scalable database filing systems, for by filing data from former database filing to target database, this system comprises filing execution module, and this module comprises:
For the device according to filing task start filing thread, filing task specifies former database and the target database of filing data, and former database is the database as filing data source, and target database is the database that data will be archived;
For inquiring about the filing data in former database, every one page filing data is packaged into the device that a copy task puts into copy mission thread pond;
For performing the copy task in copy mission thread pond, filing data is copied to the device of target database;
For after each copy tasks carrying completes, this page data is packaged into a deletion task and puts into the device deleting mission thread pond; And
For performing the device of the deletion task of deleting in thread pool.
12. systems according to claim 11, also comprise data source modules, and this module comprises:
For when filing new database, the data source information of this database is added to the device of filing system; And/or
If filed certain database again for not needing, delete the device of the data source information of this database from filing system.
13. systems according to claim 12, wherein the data source information of database comprises the IP of this database, user name, password, table name and type of database.
14. systems according to claim 12, also comprise filing task module, and this module comprises:
For managing the device of filing task, filing task comprises former database and the target database of filing data, and comprise following at least one item: former table, object table, filing execution time, filing perform frequency, filing condition and file number at every turn, wherein:
Former table is the database table in the source of depositing filing data;
Object table is the database table depositing archive copy data;
Filing condition specifies the data needs filing meeting what condition; And
Each filing number specifies the paging size of each inquiry raw data.
15. systems according to claim 14, wherein manage filing task comprise following at least one item: the maintenance of filing task, the test of filing task, the timer-triggered scheduler of filing task and the state of filing task control.
16. systems according to claim 11, wherein file execution module and also comprise:
For after all copy thread pools of this filing task execute with deletion thread pool, generating report forms, then by form stored in the device in filing system database, this form comprise following at least one item: the execution of this filing task is consuming time, filing quantity and filing quantity information per second.
17. systems according to claim 11, wherein inquire about filing data, every one page filing data is packaged into a copy task put into copy mission thread pond comprise:
According to quantity and the ID scope of filing condition query filing data, then according to the restriction paging query filing data of ID scope, every one page filing data is packaged into a copy task and puts into copy mission thread pond.
18. systems according to claim 11, the copy task wherein performed in copy mission thread pond comprises:
According to target database duplicate removal, repeated copy to prevent data.
19. systems according to claim 11, also comprise:
For one page filing data under inquiry, put into copy mission thread pond and delete before mission thread pond, first judging the device of the state of filing task, if task suspends, wait task startup, if task terminates, exits tasks carrying.
20. systems according to claim 11, also comprise filing Reports module, for:
In response to user's inquiry, with the form of form display filing report data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510696350.0A CN105279261B (en) | 2015-10-23 | 2015-10-23 | Dynamic scalable database filing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510696350.0A CN105279261B (en) | 2015-10-23 | 2015-10-23 | Dynamic scalable database filing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105279261A true CN105279261A (en) | 2016-01-27 |
| CN105279261B CN105279261B (en) | 2019-07-02 |
Family
ID=55148275
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510696350.0A Active CN105279261B (en) | 2015-10-23 | 2015-10-23 | Dynamic scalable database filing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105279261B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108304473A (en) * | 2017-12-28 | 2018-07-20 | 石化盈科信息技术有限责任公司 | Data transmission method between data source and system |
| CN108664525A (en) * | 2017-04-01 | 2018-10-16 | 北京京东尚科信息技术有限公司 | Data processing method and device for data processing server |
| CN108733671A (en) * | 2017-04-14 | 2018-11-02 | 北京京东尚科信息技术有限公司 | The method and apparatus of data history filing |
| WO2019169764A1 (en) * | 2018-03-06 | 2019-09-12 | 平安科技（深圳）有限公司 | Electronic device, linked archiving method for data, system, and storage medium |
| CN110825695A (en) * | 2019-11-04 | 2020-02-21 | 泰康保险集团股份有限公司 | Data processing method, device, medium and electronic equipment |
| CN110908979A (en) * | 2019-11-29 | 2020-03-24 | 北京明略软件系统有限公司 | Code item database archiving method and device, electronic equipment and storage medium |
| CN111538699A (en) * | 2020-03-31 | 2020-08-14 | 首钢京唐钢铁联合有限责任公司 | Data archiving method and device |
| CN112269781A (en) * | 2020-11-13 | 2021-01-26 | 网易（杭州）网络有限公司 | Data life cycle management method, device, medium and electronic equipment |
| CN112416937A (en) * | 2020-11-24 | 2021-02-26 | 平安普惠企业管理有限公司 | Data archiving method and device, electronic equipment and storage medium |
| CN114595291A (en) * | 2022-05-10 | 2022-06-07 | 城云科技（中国）有限公司 | Collection task adjusting method and device based on database annotation |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002101582A1 (en) * | 2001-06-12 | 2002-12-19 | Sap Aktiengesellschaft | Modification of a data structure, used by an application program to access database systems in a computer system |
| CN101364897A (en) * | 2008-09-17 | 2009-02-11 | 中兴通讯股份有限公司 | System for historical data archiving and implementing method |
| CN102542007A (en) * | 2011-12-13 | 2012-07-04 | 中国电子科技集团公司第十五研究所 | Method and system for synchronization of relational databases |
| CN103514295A (en) * | 2013-10-10 | 2014-01-15 | 中国电子科技集团公司第十五研究所 | Method and device for archiving historical data |
| CN103617294A (en) * | 2013-12-17 | 2014-03-05 | 江苏名通信息科技有限公司 | User behavior analysis method under LINUX system |
| CN104281704A (en) * | 2014-10-22 | 2015-01-14 | 新华瑞德（北京）网络科技有限公司 | Database data copying method and device |
| CN104376082A (en) * | 2014-11-18 | 2015-02-25 | 中国建设银行股份有限公司 | Method for importing data in data source file to database |
| CN104503989A (en) * | 2014-12-03 | 2015-04-08 | 中建材国际贸易有限公司 | Method for completing collection of isomerous database |
-
2015
- 2015-10-23 CN CN201510696350.0A patent/CN105279261B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002101582A1 (en) * | 2001-06-12 | 2002-12-19 | Sap Aktiengesellschaft | Modification of a data structure, used by an application program to access database systems in a computer system |
| CN101364897A (en) * | 2008-09-17 | 2009-02-11 | 中兴通讯股份有限公司 | System for historical data archiving and implementing method |
| CN102542007A (en) * | 2011-12-13 | 2012-07-04 | 中国电子科技集团公司第十五研究所 | Method and system for synchronization of relational databases |
| CN103514295A (en) * | 2013-10-10 | 2014-01-15 | 中国电子科技集团公司第十五研究所 | Method and device for archiving historical data |
| CN103617294A (en) * | 2013-12-17 | 2014-03-05 | 江苏名通信息科技有限公司 | User behavior analysis method under LINUX system |
| CN104281704A (en) * | 2014-10-22 | 2015-01-14 | 新华瑞德（北京）网络科技有限公司 | Database data copying method and device |
| CN104376082A (en) * | 2014-11-18 | 2015-02-25 | 中国建设银行股份有限公司 | Method for importing data in data source file to database |
| CN104503989A (en) * | 2014-12-03 | 2015-04-08 | 中建材国际贸易有限公司 | Method for completing collection of isomerous database |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108664525A (en) * | 2017-04-01 | 2018-10-16 | 北京京东尚科信息技术有限公司 | Data processing method and device for data processing server |
| CN108664525B (en) * | 2017-04-01 | 2022-08-12 | 北京京东尚科信息技术有限公司 | Data processing method and device for data processing server |
| CN108733671B (en) * | 2017-04-14 | 2020-11-03 | 北京京东尚科信息技术有限公司 | Method and device for archiving data history |
| CN108733671A (en) * | 2017-04-14 | 2018-11-02 | 北京京东尚科信息技术有限公司 | The method and apparatus of data history filing |
| CN108304473A (en) * | 2017-12-28 | 2018-07-20 | 石化盈科信息技术有限责任公司 | Data transmission method between data source and system |
| CN108304473B (en) * | 2017-12-28 | 2020-09-04 | 石化盈科信息技术有限责任公司 | Data transmission method and system between data sources |
| WO2019169764A1 (en) * | 2018-03-06 | 2019-09-12 | 平安科技（深圳）有限公司 | Electronic device, linked archiving method for data, system, and storage medium |
| US11106649B2 (en) * | 2018-03-06 | 2021-08-31 | Ping An Technology (Shenzhen) Co., Ltd. | Electronic apparatus, data chain archiving method, system and storage medium |
| CN110825695A (en) * | 2019-11-04 | 2020-02-21 | 泰康保险集团股份有限公司 | Data processing method, device, medium and electronic equipment |
| CN110908979A (en) * | 2019-11-29 | 2020-03-24 | 北京明略软件系统有限公司 | Code item database archiving method and device, electronic equipment and storage medium |
| CN111538699A (en) * | 2020-03-31 | 2020-08-14 | 首钢京唐钢铁联合有限责任公司 | Data archiving method and device |
| CN112269781A (en) * | 2020-11-13 | 2021-01-26 | 网易（杭州）网络有限公司 | Data life cycle management method, device, medium and electronic equipment |
| CN112269781B (en) * | 2020-11-13 | 2023-07-25 | 网易（杭州）网络有限公司 | Data life cycle management method, device, medium and electronic equipment |
| CN112416937A (en) * | 2020-11-24 | 2021-02-26 | 平安普惠企业管理有限公司 | Data archiving method and device, electronic equipment and storage medium |
| CN114595291A (en) * | 2022-05-10 | 2022-06-07 | 城云科技（中国）有限公司 | Collection task adjusting method and device based on database annotation |
| CN114595291B (en) * | 2022-05-10 | 2022-08-02 | 城云科技（中国）有限公司 | Collection task adjusting method and device based on database annotation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105279261B (en) | 2019-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105279261A (en) | Dynamic extensible database filing method and system | |
| US11467866B2 (en) | Scheduling framework for organization migrations | |
| CN106970921B (en) | Data migration method and device | |
| US10331483B1 (en) | Scheduling data access jobs based on job priority and predicted execution time using historical execution data | |
| EP3195117B1 (en) | Automated configuration of log-coordinated storage groups | |
| US20180052620A1 (en) | Segmented database migration | |
| US10809922B2 (en) | Providing data protection to destination storage objects on remote arrays in response to assignment of data protection to corresponding source storage objects on local arrays | |
| WO2019109854A1 (en) | Data processing method and device for distributed database, storage medium, and electronic device | |
| KR20120109533A (en) | Managing queries | |
| CN109271435A (en) | A kind of data pick-up method and system for supporting breakpoint transmission | |
| CN109033124A (en) | A kind of method and device of Data Migration | |
| CN109885642B (en) | Hierarchical storage method and device for full-text retrieval | |
| US11507277B2 (en) | Key value store using progress verification | |
| US11176004B2 (en) | Test continuous log replay | |
| US20170046195A1 (en) | Method and system for scheduling transactions in a data system | |
| US20200034041A1 (en) | Utilizing groups of data protection policies that are assignable to storage objects | |
| US10838931B1 (en) | Use of stream-oriented log data structure for full-text search oriented inverted index metadata | |
| US10261718B1 (en) | Adaptively controlling data copy operations that copy data in an electronic environment | |
| CN114168595A (en) | Data analysis method and device | |
| CN113792026A (en) | Deployment method and device of database script and computer readable storage medium | |
| CN109684381A (en) | Data hot statistics method and device | |
| US10664309B2 (en) | Use of concurrent time bucket generations for scalable scheduling of operations in a computer system | |
| CN116431290A (en) | Job scheduling method, apparatus, device, medium and program product | |
| US7337195B2 (en) | Method and device for establishing synchronized recovery log points | |
| CN110069481B (en) | Unified cleaning method and related equipment for production library data based on big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |