CN105279261B - Dynamic scalable database filing method and system - Google Patents
Dynamic scalable database filing method and system Download PDFInfo
- Publication number
- CN105279261B CN105279261B CN201510696350.0A CN201510696350A CN105279261B CN 105279261 B CN105279261 B CN 105279261B CN 201510696350 A CN201510696350 A CN 201510696350A CN 105279261 B CN105279261 B CN 105279261B
- Authority
- CN
- China
- Prior art keywords
- filing
- task
- database
- data
- copy
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Abstract
The present invention provides a kind of dynamic scalable database filing methods, for data will to be filed from original database filing to target database, this method comprises: filing thread according to filing task start, the original database and target database of the specified filing data of filing task, original database is as the database of filing data source, and target database is the data database to be archived arrived；The filing data in original database are inquired, every page filing data are packaged into a copy task and are put into copy mission thread pond；The copy task in copy mission thread pond is executed, by filing data copy to target database；After the completion of each copy task execution, which is packaged into a deletion task and is put into deletion mission thread pond；And execute the deletion task deleted in thread pool.The present invention also provides a kind of dynamic scalable database filing systems.
Description
Technical field
Present invention relates in general to data processing, more particularly, to a kind of dynamic scalable database filing method and
System.
Background technique
Database filing system is the key that Internet enterprises solve growing mass data.Database filing system
Do badly, may result in enterprise web site performance increasingly decline, customer churn, result even in loss of data, give enterprise's band
Come irremediable fame and economic loss.Present Internet enterprises website visiting amount is huge and rapid growth, various
Data also sharp increase, to enterprise database filing bring huge challenge.
Filing for data, existing technical solution mainly include the following types:
(1) database administrator is filed: database administrator is filed data and service logic etc. as needed and is artificially executed
Filing.Selection including filing data, the execution time of filing and archival solution etc..But although data administrator is familiar with number
According to the basic operation in library, but the data service that he files needs is unfamiliar with.It artificially writes filing script and executes filing, having can
It can lead to the mistake filing of data and lose.
(2) service application is filed: service application judges that those data need to file according to business need, then for needs
The data of filing voluntarily realize filing.The program includes program, the selection of time of filing etc. that filing function is realized in exploitation.It is this
Scheme can solve the problems, such as that the data service filed to needs is unfamiliar to a certain degree, but each operation system requires oneself
Realize the filing to data, the realization of each operation system may be different, not can guarantee the uniformity of filing.
(3) temporally file: data are stored different databases according to different time such as year, the moon by operation system.
This scheme can solve the disunity of data filing, and the time granularity of filing and the phase of data can also be determined by application system
Guan Xing.But each system has required multiple databases, each a period of time requires switch data library.When system is more, relate to
And database it is more when, such operation is difficult to realize.
Summary of the invention
One aspect of the present invention provides a kind of dynamic scalable database filing method, for that will file data from original
Database filing is to target database, this method comprises: filing thread, the specified filing number of filing task according to filing task start
According to original database and target database, original database be as filing data source database, target database is data
The database to be archived arrived；The filing data in original database are inquired, every page filing data are packaged into a copy and are appointed
Business is put into copy mission thread pond；The copy task in copy mission thread pond is executed, by filing data copy to target data
Library；After the completion of each copy task execution, which is packaged into a deletion task and is put into deletion mission thread pond；With
And execute the deletion task deleted in thread pool.
Optionally, this method further include: when to file to new database, by the data source information of the database
It is added to filing system；And/or if you do not need to file again to some database, the data are deleted from filing system
The data source information in library.
Optionally, the data source information of database includes IP, user name, password, table name and the class database of the database
Type.
Optionally, this method further include: management filing task, filing task further includes at least one of the following: former table,
Object table, filing execute the time, filing executes frequency, archive condition and file number every time, in which: former table is that storage is returned
The database table in the source of file data；Object table is the database table for storing archive copy data；Archive condition is specified meet it is assorted
The data of condition need to file；And filing number specifies the paging size of inquiry initial data every time every time.
Optionally, management filing task include at least one of the following: file task maintenance, filing task test,
The timer-triggered scheduler of filing task and the state control of filing task.
Optionally, this method further include: after all copy thread pools and deletion thread pool of the filing task have executed,
Report data is generated, then report data is stored in filing system database, which includes at least one in following
: the filing task executes time-consuming, filing quantity and filing quantity information per second.
Optionally, every page filing data are packaged into a copy task and are put into copy task line by inquiry filing data
Cheng Chi includes: the quantity and ID range that filing data are inquired according to archive condition, then according to the limitation paging query of ID range
File data, every page filing data are packaged into a copy task and are put into copy mission thread pond.
Optionally, the copy task executed in copy mission thread pond includes: according to target database duplicate removal, to prevent from counting
It is copied according to being repeated.
Optionally, this method further include: one page files data, is put into copy mission thread pond and deletes task under inquiry
Before thread pool, the state of filing task is first judged, task start is waited if task is to suspend, if end if it is task
Exit task execution.
Optionally, this method further include: in response to user query, show filing report data in the form of statements.
Another aspect of the present invention provides a kind of dynamic scalable database filing system, for will file data from
Original database filing is to target database, which includes filing execution module, which includes: for being opened according to filing task
The device of dynamic filing thread, the original database and target database of the specified filing data of filing task, original database are as returning
The database in file data source, target database are the data databases to be archived arrived；For inquiring returning in original database
Every page filing data are packaged into the device that a copy task is put into copy mission thread pond by file data；It is copied for executing
Copy task in shellfish mission thread pond will file device of the data copy to target database；For in each copy task
After the completion of execution, which is packaged into the device that a deletion task is put into deletion mission thread pond；And for executing
Delete the device of the deletion task in thread pool.
Optionally, which further includes data source modules, which includes: for file to new database
When, the data source information of the database is added to the device of filing system；And/or for if you do not need to again to some
Database is filed, and the device of the data source information of the database is deleted from filing system.
Optionally, the data source information of database includes IP, user name, password, table name and the class database of the database
Type.
Optionally, which further includes filing task module, which includes: the device for managing filing task, is returned
Shelves task includes the original database and target database of filing data, and including at least one of the following: former table, target
Table, filing execute the time, filing executes frequency, archive condition and file number every time, in which: former table is storage filing number
According to source database table；Object table is the database table for storing archive copy data；Archive condition is specified to meet any item
The data of part need to file；And filing number specifies the paging size of inquiry initial data every time every time.
Optionally, management filing task include at least one of the following: file task maintenance, filing task test,
The timer-triggered scheduler of filing task and the state control of filing task.
Optionally, file execution module further include: for all copy thread pools in the filing task and delete thread
After pond has executed, generate report, then by report be stored in filing system database in device, the report include in following extremely
One item missing: the filing task executes time-consuming, filing quantity and filing quantity information per second.
Optionally, every page filing data are packaged into a copy task and are put into copy task line by inquiry filing data
Cheng Chi includes: the quantity and ID range that filing data are inquired according to archive condition, then according to the limitation paging query of ID range
File data, every page filing data are packaged into a copy task and are put into copy mission thread pond.
Optionally, the copy task executed in copy mission thread pond includes: according to target database duplicate removal, to prevent from counting
It is copied according to being repeated.
Optionally, the system further include: under inquiry one page filing data, be put into copy mission thread pond and deletion
Before mission thread pond, the device of the state of filing task is first judged, wait task start if task is to suspend, if it is
Task terminates, and exits task execution.
Optionally, which further includes filing Reports module, is used for: in response to user query, showing in the form of statements
File report data.
Detailed description of the invention
For a more complete understanding of the present invention and its advantage, referring now to being described below in conjunction with attached drawing, in which:
Fig. 1 diagrammatically illustrates the structural block diagram of dynamic scalable database filing system according to an embodiment of the present invention；
And
Fig. 2 diagrammatically illustrates the process flow diagram of filing execution module according to an embodiment of the present invention.
Specific embodiment
According in conjunction with attached drawing to the described in detail below of exemplary embodiment of the present, other aspects of the invention, advantage
Those skilled in the art will become obvious with prominent features.
In the present invention, term " includes " and " containing " and its derivative mean including rather than limit；Term "or" is packet
Containing property, mean and/or.
In the present specification, following various embodiments for describing the principle of the invention only illustrate, should not be with any
Mode is construed to the range of limitation invention.Referring to attached drawing the comprehensive understanding described below that is used to help by claim and its equivalent
The exemplary embodiment of the present invention that object limits.Described below includes a variety of details to help to understand, but these details are answered
Think to be only exemplary.Therefore, it will be appreciated by those of ordinary skill in the art that without departing substantially from scope and spirit of the present invention
In the case where, embodiment described herein can be made various changes and modifications.In addition, for clarity and brevity,
The description of known function and structure is omitted.In addition, running through attached drawing, same reference numbers are used for identity function and operation.
Fig. 1 diagrammatically illustrates the structural frames of dynamic scalable database filing system 100 according to an embodiment of the present invention
Figure.The system includes data source modules 110, filing task module 120, filing execution module 130 and filing Reports module 140.
It in filing, needs to add database data source, then creates a filing task.User can be set filing and appoint
Execution time of business, archive condition, filing quantity etc..Archiving user creates according to the business need of itself filing data first
One filing task, need to be arranged the original database (as the database of filing data source, also referred to as former library) of filing, former table,
Target database (database that data are archived, also referred to as object library), object table, filing execute the time, filing execute frequency,
Archive condition, every time filing number etc..Former table is the database table in the source of storage filing data, and object table is that storage filing is copied
The database table of shellfish data.The specified data for meeting what condition of archive condition need to file, for example, how many days pervious data
Need to file, etc..The paging size of the specified initial data of inquiry every time of filing number every time.If necessary to filing former library and
Not in systems, user is added in system data source object library firstly the need of these databases.It is in office to file task module
When business executes time arrival, filing task is distributed to filing execution module.File execution module and passes through multithreading, batch
The technologies such as operation data technology, major key limitation range realize fast and reliable filing.Task execution will be filed after the completion of filing task
Filing number, the statistics such as time-consuming generate report, then statistical report is directly stored in filing system database, the database example
It such as can be relevant database RDBMS.Then in the inquiry reported, data directly are read from RDBMS.
The operation of each module of detailed description below.
Data source modules 110
Data source modules 110 are used to manage the original database and target database for being archived system filing.To new number
When being filed according to library, by data source modules 110 by the data source information of the database (such as the IP of database, user name,
Password, table name, type of database (MYSQL/ORACLE) etc.) it is added to filing system.If you do not need to again to some database
Filed, deletes the data source information of the database from filing system by data source modules 110.Pass through data source modules
110, it adds with can be convenient, delete and need the original database and target database filed, make database filing system 100 can be with
General archiving services are provided.
File task module 120
Filing task module 120 is for managing filing task, including at least one of the following: filing the maintenance of task
(such as addition/deletion/preservation), the test of filing task, the state control of the timer-triggered scheduler of filing task and filing task.Returning
When shelves, filing task is added by filing task module 120, filing task includes Yuan Ku, former table, object library, object table, filing
Execute the time, filing executes frequency, archive condition, the every time attributes such as filing number.Can also be by filing after creating successfully
Whether the configuration of the test function of system offer, test filing task is correct and whether accurately verifying files realization.Executing test
When function, a web operation interface is provided, user can click test, and system can be according to filing task execution once from Yuan Ku
The specified filing data of specified table copy data into the specified table of target database.The filing execution time is that a plan is appointed
Business cron expression formula realizes that timed task is dispatched using job scheduling frame Quartz.After creating a filing task, return
Filing task can be added in the scheduling of Quartz by shelves task module 120.After edit-modify filing task, file task mould
Block 120 can change the scheduling of the Quartz of the task again, to realize that filing task is dynamically adapted, including archive condition and return
Shelves execute the dynamic adjustment of time.When filing task execution, filing task module 120 filing task can be suspended,
The control such as stopping, to realize the real-time dynamic of filing task execution process controllably.
File execution module 130
File execution module 130 to be used for according to filing task execution data filing, and counts the report data of filing.Filing
The process flow of execution module 130 is as shown in Figure 2.
The switching in filing original database and targeted database data source is real by Spring data source switching at runtime technology
Existing, and use thread local (thread-local) variable save current data source.Filing execution module 130 can be according to execution
One filing thread of filing task start execute filing.Quantity, the ID of data can be filed according to the condition query of filing first
Range etc..The ID of filing data is the major key field of database table automatic increase.Then, according to the limitation paging query of ID range
File data, every page is packaged into a copy task and is put into the execution of copy mission thread pond.Limitation paging refers to inquiry data
The quantity for reducing scan database data is realized in library by the access of ID, to realize to the quick paging query of large data volume table
It can be according to target database duplicate removal, to prevent data to be repeated copy when copying task execution.Copy task execution
The data of this page can be packaged into a deletion task after the completion and be put into the execution of deletion mission thread pond.If copy is unsuccessful,
Execution judges whether there is the step of copy task.If executing and the step of whether thread pool is finished being judged without the task of deletion.
If deletion is unsuccessful, the step of judging whether there is deletion task is executed.All copy thread pools and strikethrough to the task
After Cheng Chi has been executed, the one or more information such as time-consuming, filing quantity, filing quantity per second that execute of task are generated into report number
According to then report data is directly stored in filing system database.One page files data, is put into copy task line under inquiry
For Cheng Chi with before deleting mission thread pond, system can first judge the state of filing task.If task is that pause waits for appointing
Business starting, terminates directly exit task execution if it is task.
File Reports module 140
File Reports module 140 to be used in response to user query, filing report data is shown in the form of filing report, is returned
Shelves system operator can carry out system optimization by these report datas, and filing system can check that task is filed using user
Quantity, speed etc., the execution parameter of adjustable filing task is to improve filing efficiency.
Database filing system 100 of the invention, data source modules 110, filing task module 120, filing execution module
130 can be by there is the electronic equipment of computing capability (such as CPU) to execute comprising computer instruction with filing Reports module 140
Software is realized.At this point, above-mentioned each module is to realize the functional module of corresponding function.Such instruction is executed so that electronic equipment
It is configured as executing above-mentioned operations according to the present invention.These softwares may be stored in a computer readable storage medium.
Computer-readable recording medium storage one or more program (software module), one or more of programs include instruction, when
When one or more processors in electronic equipment execute described instruction, described instruction makes electronic equipment execute side of the invention
Method.
These softwares can store the form for volatile memory or non-volatile memory device (such as similar to ROM etc.
Store equipment), it is whether erasable or rewritable, or it is stored as form (such as the RAM, storage core of memory
Piece, equipment or integrated circuit), or be stored on light readable medium or magnetic readable medium (for example, CD, DVD, disk or magnetic
Band etc.).It should be appreciated that storage equipment and storage medium are adapted for storing the machine readable storage dress of one or more programs
The embodiment set, one program or multiple programs include instruction, when executed, realize implementation of the invention
Example.Embodiment provides program and stores the machine-readable storage device of this program, and described program includes for realizing the present invention
Any one claim described in device or method code.Furthermore, it is possible to via any medium (for example, via wired
Connection is wirelessly connected the signal of communication carried) it sends a telegram here and transmits these programs, multiple embodiments uitably include these programs.
Dynamic scalable database filing system proposed by the present invention can be caused to avoid artificial operation data loss,
Can also be unfamiliar with to avoid business of the filing user to filing data leads to the mistake filing of data while also to avoid each
A operation system realizes data filing function.System provides data source management module add the original for needing to file with can be convenient
Database and target database only need to create a filing task for filing data.Filing system is logical by task
Cross QUARTZ come realize timed task dispatch, it is ensured that file task timing execute and periodically execute.Filing executes
Process can guarantee that data copy success can just execute data deletion first, fundamentally ensure that the loss of data.And it uses more
The completion filing that thread and filing data area restriction technologies can quickly prepare.
The present invention realizes the dynamic expansion of filing database and target database by data source modules.Filing task mould
Block realizes the creation of filing task, the timing of Accuracy Verification and filing, periodic scheduling, also achieves the dynamic of filing task
Addition and control.Filing execution module quickly and accurately completes filing task.File Reports module and filing effect report is provided.It should
Scheme realize controllable, dynamic, quickly, the accurate, data filing that easily extends.
Although the present invention, art technology has shown and described referring to certain exemplary embodiments of the invention
Personnel it should be understood that in the case where the spirit and scope of the present invention limited without departing substantially from the following claims and their equivalents,
A variety of changes in form and details can be carried out to the present invention.Therefore, the scope of the present invention should not necessarily be limited by above-described embodiment,
But should be not only determined by appended claims, also it is defined by the equivalent of appended claims.
Claims (22)
1. a kind of dynamic scalable database filing method is filed from original database to target database for that will file data,
This method comprises:
File thread, the original database and target database of the specified filing data of filing task, former number according to filing task start
It is as the database of filing data source according to library, target database is the data database to be archived arrived；
The filing data in original database are inquired, every page filing data are packaged into a copy task and are put into copy task line
Cheng Chi, wherein the filing data in the inquiry original database include: in the limitation paging query original database according to ID range
Filing data；
The copy task in copy mission thread pond is executed, by filing data copy to target database；
After the completion of each copy task execution, which is packaged into a deletion task and is put into deletion mission thread pond；
And
Execute the deletion task deleted in thread pool.
2. according to the method described in claim 1, further include:
When to file to new database, the data source information of the database is added to filing system；And/or
If you do not need to filing again to some database, the data source information of the database is deleted from filing system.
3. according to the method described in claim 2, wherein the data source information of database include the IP of the database, user name,
Password, table name and type of database.
4. according to the method described in claim 1, further include:
Manage filing task, filing task further includes at least one of the following: former table, object table, filing execute time, filing
It executes frequency, archive condition and files number every time, in which:
Former table is the database table in the source of storage filing data；
Object table is the database table for storing archive copy data；
The specified data for meeting what condition of archive condition need to file；And
The paging size of the specified initial data of inquiry every time of filing number every time.
5. according to the method described in claim 4, wherein management filing task includes at least one of the following: filing task
Maintenance, the test of filing task, the state control of the timer-triggered scheduler of filing task and filing task.
6. according to the method described in claim 1, further include:
After all copy thread pools and deletion thread pool of the filing task have executed, report data is generated, then by report
Data be stored in filing system database in, which includes at least one of the following: the filing task execute time-consuming,
File quantity and filing quantity information per second.
7. every page filing data are packaged into a copy according to the method described in claim 1, wherein data are filed in inquiry
Task is put into copy mission thread pond
The quantity and ID range of filing data are inquired according to archive condition, and number is then filed according to the limitation paging query of ID range
According to, by every page filing data be packaged into a copy task be put into copy mission thread pond.
8. according to the method described in claim 1, the copy task wherein executed in copy mission thread pond includes:
According to target database duplicate removal, to prevent data to be repeated copy.
9. according to the method described in claim 1, further include:
Before one page files data, is put into copy mission thread pond and deletes mission thread pond under inquiry, first judgement filing times
The state of business waits task start if task is to suspend, terminates if it is task, exit task execution.
10. according to the method described in claim 1, further include:
In response to user query, filing report data is shown in the form of statements.
11. a kind of dynamic scalable database filing system is filed from original database to target database for that will file data,
The system includes filing execution module, which includes:
For the device according to filing task start filing thread, the original database and number of targets of the specified filing data of filing task
According to library, original database is as the database of filing data source, and target database is the data database to be archived arrived；
For the filing data in the limitation paging query original database according to ID range, every page filing data are packaged into one
A copy task is put into the device in copy mission thread pond；
For executing the copy task in copy mission thread pond, device of the data copy to target database will be filed；
For which being packaged into a deletion task and is put into deletion mission thread after the completion of each copy task execution
The device in pond；And
For executing the device for deleting the deletion task in thread pool.
12. system according to claim 11 further includes data source modules, which includes:
For when to file to new database, the data source information of the database to be added to the dress of filing system
It sets；And/or
For deleting the data source information of the database from filing system if you do not need to file again to some database
Device.
13. system according to claim 12, wherein the data source information of database includes the IP of the database, user
Name, password, table name and type of database.
14. system according to claim 12, further includes filing task module, which includes:
For managing the device of filing task, filing task includes filing the original database and target database of data, and wrap
Include at least one of the following: former table, object table, filing executes the time, filing executes frequency, archive condition and returns every time
Gear number mesh, in which:
Former table is the database table in the source of storage filing data；
Object table is the database table for storing archive copy data；
The specified data for meeting what condition of archive condition need to file；And
The paging size of the specified initial data of inquiry every time of filing number every time.
15. system according to claim 14, wherein management filing task includes at least one of the following: filing task
Maintenance, filing task test, filing task timer-triggered scheduler and file task state control.
16. system according to claim 11, wherein filing execution module further include:
After having executed for all copy thread pools in the filing task with deletion thread pool, report is generated, then by report
The device being stored in filing system database, which includes at least one of the following: the filing task executes time-consuming, returns
Gear number amount and filing quantity information per second.
17. system according to claim 11, wherein every page filing data are packaged into one and copied by inquiry filing data
Shellfish task is put into copy mission thread pond
The quantity and ID range of filing data are inquired according to archive condition, and number is then filed according to the limitation paging query of ID range
According to, by every page filing data be packaged into a copy task be put into copy mission thread pond.
18. system according to claim 11, wherein the copy task executed in copy mission thread pond includes:
According to target database duplicate removal, to prevent data to be repeated copy.
19. system according to claim 11, further includes:
For before one page files data, is put into copy mission thread pond and deletes mission thread pond under inquiry, first judgement to be returned
The device of the state of shelves task, waits task start if task is to suspend, terminates if it is task, exit task execution.
20. system according to claim 11 further includes filing Reports module, is used for:
In response to user query, filing report data is shown in the form of statements.
21. a kind of dynamic scalable database filing device, comprising:
One or more processors；
Storage device, for storing executable instruction, the executable instruction is realized when being executed by the processor according to power
Benefit require any one of 1~10 described in method.
22. a kind of computer readable storage medium, is stored thereon with executable instruction, which realizes root when being executed by processor
According to method according to any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510696350.0A CN105279261B (en) | 2015-10-23 | 2015-10-23 | Dynamic scalable database filing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510696350.0A CN105279261B (en) | 2015-10-23 | 2015-10-23 | Dynamic scalable database filing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105279261A CN105279261A (en) | 2016-01-27 |
| CN105279261B true CN105279261B (en) | 2019-07-02 |
Family
ID=55148275
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510696350.0A Active CN105279261B (en) | 2015-10-23 | 2015-10-23 | Dynamic scalable database filing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105279261B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108664525B (en) * | 2017-04-01 | 2022-08-12 | 北京京东尚科信息技术有限公司 | Data processing method and device for data processing server |
| CN108733671B (en) * | 2017-04-14 | 2020-11-03 | 北京京东尚科信息技术有限公司 | Method and device for archiving data history |
| CN108304473B (en) * | 2017-12-28 | 2020-09-04 | 石化盈科信息技术有限责任公司 | Data transmission method and system between data sources |
| CN108470045B (en) * | 2018-03-06 | 2020-02-18 | 平安科技（深圳）有限公司 | Electronic device, data chain archiving method and storage medium |
| CN110825695A (en) * | 2019-11-04 | 2020-02-21 | 泰康保险集团股份有限公司 | Data processing method, device, medium and electronic equipment |
| CN110908979A (en) * | 2019-11-29 | 2020-03-24 | 北京明略软件系统有限公司 | Code item database archiving method and device, electronic equipment and storage medium |
| CN111538699A (en) * | 2020-03-31 | 2020-08-14 | 首钢京唐钢铁联合有限责任公司 | Data archiving method and device |
| CN112269781B (en) * | 2020-11-13 | 2023-07-25 | 网易（杭州）网络有限公司 | Data life cycle management method, device, medium and electronic equipment |
| CN112416937A (en) * | 2020-11-24 | 2021-02-26 | 平安普惠企业管理有限公司 | Data archiving method and device, electronic equipment and storage medium |
| CN114595291B (en) * | 2022-05-10 | 2022-08-02 | 城云科技（中国）有限公司 | Collection task adjusting method and device based on database annotation |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002101582A1 (en) * | 2001-06-12 | 2002-12-19 | Sap Aktiengesellschaft | Modification of a data structure, used by an application program to access database systems in a computer system |
| CN101364897A (en) * | 2008-09-17 | 2009-02-11 | 中兴通讯股份有限公司 | System for historical data archiving and implementing method |
| CN102542007A (en) * | 2011-12-13 | 2012-07-04 | 中国电子科技集团公司第十五研究所 | Method and system for synchronization of relational databases |
| CN103514295A (en) * | 2013-10-10 | 2014-01-15 | 中国电子科技集团公司第十五研究所 | Method and device for archiving historical data |
| CN103617294A (en) * | 2013-12-17 | 2014-03-05 | 江苏名通信息科技有限公司 | User behavior analysis method under LINUX system |
| CN104281704A (en) * | 2014-10-22 | 2015-01-14 | 新华瑞德（北京）网络科技有限公司 | Database data copying method and device |
| CN104376082A (en) * | 2014-11-18 | 2015-02-25 | 中国建设银行股份有限公司 | Method for importing data in data source file to database |
| CN104503989A (en) * | 2014-12-03 | 2015-04-08 | 中建材国际贸易有限公司 | Method for completing collection of isomerous database |
-
2015
- 2015-10-23 CN CN201510696350.0A patent/CN105279261B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002101582A1 (en) * | 2001-06-12 | 2002-12-19 | Sap Aktiengesellschaft | Modification of a data structure, used by an application program to access database systems in a computer system |
| CN101364897A (en) * | 2008-09-17 | 2009-02-11 | 中兴通讯股份有限公司 | System for historical data archiving and implementing method |
| CN102542007A (en) * | 2011-12-13 | 2012-07-04 | 中国电子科技集团公司第十五研究所 | Method and system for synchronization of relational databases |
| CN103514295A (en) * | 2013-10-10 | 2014-01-15 | 中国电子科技集团公司第十五研究所 | Method and device for archiving historical data |
| CN103617294A (en) * | 2013-12-17 | 2014-03-05 | 江苏名通信息科技有限公司 | User behavior analysis method under LINUX system |
| CN104281704A (en) * | 2014-10-22 | 2015-01-14 | 新华瑞德（北京）网络科技有限公司 | Database data copying method and device |
| CN104376082A (en) * | 2014-11-18 | 2015-02-25 | 中国建设银行股份有限公司 | Method for importing data in data source file to database |
| CN104503989A (en) * | 2014-12-03 | 2015-04-08 | 中建材国际贸易有限公司 | Method for completing collection of isomerous database |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105279261A (en) | 2016-01-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105279261B (en) | Dynamic scalable database filing method and system | |
| US11397709B2 (en) | Automated configuration of log-coordinated storage groups | |
| CN109460349B (en) | Test case generation method and device based on log | |
| US11467866B2 (en) | Scheduling framework for organization migrations | |
| US10241960B2 (en) | Historical data replay utilizing a computer system | |
| US10373247B2 (en) | Lifecycle transitions in log-coordinated data stores | |
| Herodotou et al. | Profiling, what-if analysis, and cost-based optimization of mapreduce programs | |
| CA2785398C (en) | Managing queries | |
| EP3195117B1 (en) | Automated configuration of log-coordinated storage groups | |
| CN106844682B (en) | Method for interchanging data, apparatus and system | |
| Haftmann et al. | A framework for efficient regression tests on database applications | |
| CN109271435A (en) | A kind of data pick-up method and system for supporting breakpoint transmission | |
| CN105786955A (en) | Data replication in a database management system | |
| CN105069134A (en) | Method for automatically collecting Oracle statistical information | |
| US10372726B2 (en) | Consistent query execution in hybrid DBMS | |
| WO2014089190A1 (en) | Integrating event processing with map-reduce | |
| CN112740195A (en) | Techniques for maintaining statistics in a database system | |
| CN109885642B (en) | Hierarchical storage method and device for full-text retrieval | |
| CN110058958A (en) | For managing the method, equipment and computer program product of data backup | |
| US20200310925A1 (en) | Test continuous log replay | |
| US20200034041A1 (en) | Utilizing groups of data protection policies that are assignable to storage objects | |
| US20200082004A1 (en) | Automatic detection of database criticality | |
| US10261718B1 (en) | Adaptively controlling data copy operations that copy data in an electronic environment | |
| US10664309B2 (en) | Use of concurrent time bucket generations for scalable scheduling of operations in a computer system | |
| WO2020057369A1 (en) | Query plan acquisition method, and data query method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |