CN111538699A - Data archiving method and device - Google Patents
Data archiving method and device Download PDFInfo
- Publication number
- CN111538699A CN111538699A CN202010246029.3A CN202010246029A CN111538699A CN 111538699 A CN111538699 A CN 111538699A CN 202010246029 A CN202010246029 A CN 202010246029A CN 111538699 A CN111538699 A CN 111538699A
- Authority
- CN
- China
- Prior art keywords
- data
- archival
- file
- archive
- archived
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000003860 storage Methods 0.000 claims abstract description 21
- 238000012216 screening Methods 0.000 claims abstract description 10
- 230000004044 response Effects 0.000 claims description 15
- 238000013439 planning Methods 0.000 claims description 11
- 239000000126 substance Substances 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims 1
- 238000012423 maintenance Methods 0.000 abstract description 8
- 238000004519 manufacturing process Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 4
- 238000012217 deletion Methods 0.000 description 3
- 230000037430 deletion Effects 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- QRZUPJILJVGUFF-UHFFFAOYSA-N 2,8-dibenzylcyclooctan-1-one Chemical compound C1CCCCC(CC=2C=CC=CC=2)C(=O)C1CC1=CC=CC=C1 QRZUPJILJVGUFF-UHFFFAOYSA-N 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000002356 single layer Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
- G06F16/113—Details of archiving
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/162—Delete operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
Abstract
The invention provides a data archiving method and a device, wherein the method comprises the following steps: acquiring historical data from a current database of the ERP system; determining the filing range and the filing frequency of each filing object; screening each archived object according to the archived range to generate an archived file; aiming at the archive file corresponding to each archive object, establishing an information index of the archive file in a target database; storing each archived file and the corresponding information index into an information structure index table based on the archiving frequency, and deleting the online data corresponding to the archived file in the current database; therefore, the historical data are filed into the target database, the storage space of the current database can be greatly released, the stability of the system performance is improved, and the later-stage data operation and maintenance cost is reduced; and when the archived data needs to be accessed, the archived data can be directly inquired from the target database, and the access efficiency of the archived data can be ensured because a large amount of online data is not stored in the target database.
Description
Technical Field
The invention belongs to the technical field of data processing, and particularly relates to a data archiving method and device.
Background
Data management policies for Enterprise Resource Planning (ERP) include: data avoidance, data summarization, data deletion and data archiving. The data avoidance and data summarization are based on data analysis, and the related configuration of invalid data is cancelled and modified, so that the aim of avoiding the generation of invalid data is fulfilled; the data deletion mainly aims at establishing a life cycle management strategy for a part of system data tables and user-defined data tables, and regularly cleaning the data; data archiving is mainly applied to business data and main data archiving and querying.
The purpose of data archiving mainly comprises three aspects: firstly, online data of an ERP system database is reduced, and system performance is improved to the greatest extent. By reducing online data, the response speed of a functional program and a report program of the system is improved, the system synchronization and backup time is shortened, and the downtime of operations such as system upgrading is shortened. Second, the management cost of data is reduced. The overall growth speed of system data is reduced through filing, the investment of subsequent backup equipment and storage equipment is reduced, and the operation and maintenance management cost of the data is reduced. And thirdly, establishing a long-term archiving strategy of the ERP system. The data space of the system database is guaranteed to reach a relatively stable state for a long time, and the stability of the system is improved.
In the data filing mode in the prior art, all data and data indexes are stored in a database in a self-table-building mode, the storage space of the database is occupied in a large range, the data volume is rapidly increased along with the establishment of more information structures in the later period, the system performance is seriously influenced, capacity expansion storage hardware is required in later-period maintenance, the access efficiency of filed data and the access efficiency of online data are reduced, and the capacity expansion cost and the maintenance cost are increased.
Disclosure of Invention
Aiming at the problems in the prior art, the embodiment of the invention provides a data archiving method and device, which are used for solving the technical problems that in the prior art, in the data archiving process of an ERP system, the storage space of a database is insufficient, the access efficiency of archived data is reduced and the maintenance cost is increased.
The invention provides a data archiving method, which is applied to an ERP system and comprises the following steps: acquiring historical data from a current database of an Enterprise Resource Planning (ERP) system;
determining an archival object in the historical data;
aiming at different archival objects, determining an archival range and an archival frequency of each archival object;
screening each archived object according to the archiving range to generate an archived file;
storing the archived file into a target database based on the archiving frequency, and deleting online data corresponding to the archived file in the current database; wherein the content of the first and second substances,
the storing the archived file into a target database based on the archiving frequency comprises:
aiming at an archive file corresponding to each archive object, establishing an information index of the archive file in the target database;
and storing each archived file and the corresponding information index into an information structure index table based on the archiving frequency.
Optionally, the determining the archive object in the history data includes:
acquiring various types of data in the historical data;
and determining the archival object based on the data volume, the data growth speed, the access frequency and the response time of the current database to various types of data.
Optionally, the screening the archived objects according to the archive range to generate an archived file includes:
acquiring the archival data which accords with the corresponding archival range for each archival object;
generating the archive file based on the archive data.
Optionally, before storing the archived file into a target database based on the archiving frequency, the method further includes:
and configuring the server name, the port number and the host IP address of the target server in the ERP system so as to integrate the front server and the target server.
The present invention also provides a data archiving apparatus, the apparatus comprising:
the acquisition unit is used for acquiring historical data from a current database of the Enterprise Resource Planning (ERP) system;
a determination unit configured to determine an archive object based on the history data; aiming at different archival objects, determining an archival range and an archival frequency of each archival object;
the generating unit is used for screening the archival objects according to the archival range to generate an archival file;
the storage unit is used for storing the archived file into a target database based on the archiving frequency, and the deleting unit is used for deleting the online data corresponding to the archived file in the current database;
wherein the storage unit is specifically configured to:
aiming at an archive file corresponding to each archive object, establishing an information index of the archive file in the target database;
and storing each archived file and the corresponding information index into an information structure index table based on the archiving frequency.
Optionally, the determining unit is specifically configured to:
acquiring various types of data in the historical data;
and determining the archival object based on the data volume, the data growth speed, the access frequency and the response time of the current database to various types of data.
Optionally, the generating unit is specifically configured to:
acquiring the archival data which accords with the corresponding archival range for each archival object;
generating the archive file based on the archive data.
Optionally, the apparatus further comprises: a configuration unit for configuring the configuration unit,
and the system is used for configuring the server name, the port number and the host IP address of the target server in the ERP system before the archived file is stored in a target database based on the archiving frequency so as to integrate the former server with the target server.
The invention provides a data archiving method and a device, wherein the method comprises the following steps: acquiring historical data from a current database of an Enterprise Resource Planning (ERP) system; determining an archival object based on the historical data; aiming at different archival objects, determining an archival range and an archival frequency of each archival object; screening each archived object according to the archiving range to generate an archived file; storing the archived file into a target database based on the archiving frequency, and deleting online data corresponding to the archived file in the current database; the storing the archived file into a target database based on the archiving frequency comprises: aiming at an archive file corresponding to each archive object, establishing an information index of the archive file in the target database; storing each of the archived files and the corresponding information index into an information structure index table based on the archiving frequency; therefore, the historical data are filed in the target database, the storage space of the current database can be greatly released, the stability of the system performance is improved, and the operation and maintenance cost of the later-stage data is reduced; and when the archived data needs to be accessed, the archived data can be directly inquired from the target database, and because a large amount of online data is not stored in the target database and different information indexes are set during storage of the archived files, the access efficiency of the archived data can be ensured.
Drawings
Fig. 1 is a schematic flow chart of a data archiving method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a data archiving apparatus according to an embodiment of the present invention.
Detailed Description
The method aims to solve the technical problems that in the prior art, in the data archiving process of an ERP system, the storage space of a database is insufficient, the access efficiency of archived data is reduced, and the maintenance cost is increased. The invention provides a data archiving method and device.
The technical solution of the present invention is further described in detail by the accompanying drawings and the specific embodiments.
Example one
The embodiment provides a data archiving method, which is applied to an ERP system, and as shown in fig. 1, the method includes:
s110, acquiring historical data from a current database of the Enterprise Resource Planning (ERP) system;
the current database of the ERP system is an SAP application server, and as the running time of the ERP system is gradually increased, the data of purchase, quality, equipment, production, sales, finance and the like in the ERP system are also continuously increased, and the increasing speed of the data is continuously accelerated. The performance of an ERP system is severely affected by a large amount of outdated and redundant historical data. Generally, after the ERP system runs for 3-5 years, when the growth direction of data is clear, the historical data needs to be archived. Therefore, in this embodiment, the historical data needs to be obtained from the current database of the enterprise resource planning, ERP, system.
Generally, when data is archived, an ERP system needs to retain data for one year. So the historical data is obtained from data prior to the last year when it was obtained.
S111, determining an archival object in the historical data;
according to the method and the device, all historical data are not required to be archived, so that after the historical data are obtained, the archived objects in the historical data need to be determined.
As an alternative embodiment, the determining an archival object in the history data includes:
acquiring various types of data in the historical data;
and determining the archive object based on the data volume, the data growth speed, the access frequency and the response time of the database to various types of data of each type of data.
Specifically, for example, the history data may include: purchase data, quality data, equipment data, production data, sales data, financial data, and the like. In various types of data, the data volume, the data growth speed and the access frequency of each type of data and the response time of the database to the data are evaluated, and the data with low access frequency or slow response time of the database to the data are determined as archival objects aiming at the data with large data volume and high data growth speed.
In the present application, when data in an ERP system is archived, 20 archive objects are determined according to the above method, and these archive objects are related to finance, production, equipment, and sales modules, as shown in table 1:
TABLE 1
S112, aiming at different archival objects, determining an archival range and an archival frequency of each archival object;
because different archive objects have different characteristics in actual business, the corresponding archive range needs to be determined by combining actual business conditions. Different archive objects may have different indexes for determining the archive range. Such as: factory, cost center, order type, etc.; to illustrate by order type, if the index of the filing range is order type A, B, the filing range is data corresponding to order type a and order type B.
Further, the archive frequency may also be different for different archive objects, such as the archive frequency may include: once a year, once a half year, once a month, or once when the business ends.
S113, screening each archived object according to the archiving range to generate an archived file;
after the filing object and the filing range corresponding to the filing object are determined, screening the corresponding filing object based on the filing range to obtain data conforming to the filing range, and generating a filing file based on the data conforming to the filing range.
S114, storing the archived file into a target database based on the archiving frequency, and deleting the online data corresponding to the archived file in the current database.
After the archive file is generated, the archive file is stored in a target database based on the archive frequency. And in order to ensure the storage space of the current database, deleting the online data corresponding to the archived file in the current database, and recombining the current database after deleting the online data, thereby achieving the purposes of releasing the storage space of the current data and improving the system performance, and enabling the data in the current database to achieve a relatively stable growth state.
As an alternative embodiment, the storing the archived file into a target database based on the archiving frequency includes:
aiming at an archive file corresponding to each archive object, establishing an information index of the archive file in the target database;
and storing each archived file and the corresponding information index into an information structure index table based on the archiving frequency.
Here, in order to meet the requirement of the user for query-by-time access to the archived file, before storing the archived file into the target database based on the archiving frequency, the method further includes:
and configuring the server name, the port number and the host IP address of the target server in an ERP system through the DBCO so as to integrate the current server with the target server. Therefore, after data is archived, the query performance of the archived file is not influenced, and if a user wants to query or access the archived file, the user can still directly query or access the archived file in the target database through the current database; or directly querying the archived file through the target database.
Therefore, the target server is equivalent to an index server structure, and index data are processed more flexibly and more reliably. Because the bottleneck of data access for archived data is mainly reading data, especially when the data volume is large, the archive file can be read circularly, the performance is extremely low, and even errors of insufficient memory or overtime operation can occur during operation. Therefore, in order to improve the query speed, the method and the device have the advantages that the keyword query fields or the information indexes are arranged in the target database, the space of the current database in the ERP system is not occupied, the query efficiency or the access efficiency can be obviously improved under the condition that the data in the current database is not increased sharply, and the frequency of circularly reading the archived files is reduced. Similarly, after the requirement for reading the archived data is solved, the information structure index table in the current database does not need to be filled with too much data, and the space of the current database of the ERP system is greatly saved.
For example, when the inquiry request includes an object code MB5B, which refers to an inventory inquiry on the posting date, the inquiry response speed of the target database to the code in practical application is increased by nearly one time; the single-layer processing of the material ledger is operated in the monthly account process, which originally needs more than 2.5 hours, the operation time is reduced to more than 1 hour after filing, and the response speed is nearly doubled compared with the original speed.
In practical application, when data in a certain ERP system is archived, the archivable data volume is about 1.3T, and the space that can be released by the current database is about 900G according to the empirical compression ratio of the traditional archiving method. After the archiving method is adopted, the current database releases 1.07T of space. Compared with the traditional archiving method, the space of nearly 200G is released.
Further, when a user needs to query a related archive file, the query request may be packaged, where the query request includes: a data index of the target archive file or a key query field (e.g., transaction code) of the target archive file, then a query of the archive file may be made directly based on the query request.
In actual application, the traditional program needs to be modified to meet the requirements of filing and query performance; the involved procedures are shown in table 2:
TABLE 2
Based on the same inventive concept, the application also provides a data archiving device, which is detailed in the second embodiment.
Example two
The present embodiment provides a data archiving apparatus, as shown in fig. 2, the apparatus includes: an acquisition unit 21, a determination unit 22, a generation unit 23, a storage unit 24, and a deletion unit 25; wherein the content of the first and second substances,
the acquiring unit 21 is used for acquiring historical data from a current database of the Enterprise Resource Planning (ERP) system;
a determination unit 22 for determining an archival object based on the history data; aiming at different archival objects, determining an archival range and an archival frequency of each archival object;
a generating unit 23, configured to filter each of the archive objects according to the archive range, and generate an archive file;
a storage unit 24, configured to store the archive file into a target database based on the archive frequency, and a deleting unit 25, configured to delete the online data corresponding to the archive file in the current database.
Specifically, the current database of the ERP system is the SAP application server, and as the running time of the ERP system is gradually increased, the data of purchase, quality, equipment, production, sales, finance and the like in the ERP system are also continuously increased, and the increasing speed of the data is continuously accelerated. The performance of an ERP system is severely affected by a large amount of outdated and redundant historical data. Generally, after the ERP system runs for 3-5 years, when the growth direction of data is clear, the historical data needs to be archived. Therefore, the obtaining unit 21 in this embodiment first needs to obtain the historical data from the current database of the enterprise resource planning, ERP, system.
Generally, when data is archived, an ERP system needs to retain data for one year. The acquisition unit 21 acquires history data from data before the last year.
Since all the history data need not be archived, the determination unit 22 needs to determine the archive objects in the history data after the history data is acquired.
As an optional embodiment, the determining unit 22 is specifically configured to:
acquiring various types of data in the historical data;
and determining the archive object based on the data volume, the data growth speed, the access frequency and the response time of the database to various types of data of each type of data.
Specifically, for example, the history data may include: purchase data, quality data, equipment data, production data, sales data, financial data, and the like. In various types of data, the data volume, the data growth speed and the access frequency of each type of data and the response time of the database to the data are evaluated, and the data with low access frequency or slow response time of the database to the data are determined as archival objects aiming at the data with large data volume and high data growth speed.
In the present application, when archiving data in an ERP system, the determining unit 22 determines 20 archive objects according to the above method, where the archive objects are related to finance, production, equipment, and sales modules, as shown in table 1:
TABLE 1
Since different archive objects have different characteristics in the actual service, the determination unit 22 needs to determine the corresponding archive range in combination with the actual service condition. Different archive objects may have different indexes for determining the archive range. Such as: factory, cost center, order type, etc.; to illustrate by order type, if the index of the filing range is order type A, B, the filing range is data corresponding to order type a and order type B.
Further, the archive frequency may also be different for different archive objects, such as the archive frequency may include: once a year, once a half year, once a month, or once when the business ends.
After the archive object and the archive range corresponding to the archive object are determined, the generating unit 23 is configured to screen the corresponding archive object based on the archive range, obtain data that conforms to the archive range, and generate an archive file based on the data that conforms to the archive range.
After the generation of the archive file, the storage unit 24 is configured to store the archive file in the target database based on the archive frequency. And in order to ensure the storage space of the current database, the deleting unit 25 is configured to delete the online data corresponding to the archived file in the current database, and reorganize the current database after deleting the online data, so as to release the storage space of the current data and improve the system performance, so that the data in the current database reaches a relatively stable growth state.
As an alternative embodiment, the storage unit 24 is specifically configured to:
aiming at an archive file corresponding to each archive object, establishing an information index of the archive file in the target database;
and storing each archived file and the corresponding information index into an information structure index table based on the archiving frequency.
Here, in order to meet the requirement of the user for query access to the archived file at any time, the apparatus further includes: the configuration unit 26 is specifically configured to:
and configuring the server name, the port number and the host IP address of the target server in an ERP system through the DBCO so as to integrate the current server with the target server. Therefore, after data is archived, the query performance of the archived file is not influenced, and if a user wants to query or access the archived file, the user can still directly query or access the archived file in the target database through the current database; or directly querying the archived file through the target database.
Therefore, the target server is equivalent to an index server structure, and index data are processed more flexibly and more reliably. Because the bottleneck of data access for archived data is mainly reading data, especially when the data volume is large, the archive file can be read circularly, the performance is extremely low, and even errors of insufficient memory or overtime operation can occur during operation. Therefore, in order to improve the query speed, the method and the device have the advantages that the keyword query fields or the information indexes are arranged in the target database, the space of the current database in the ERP system is not occupied, the query efficiency or the access efficiency can be obviously improved under the condition that the data in the current database is not increased sharply, and the frequency of circularly reading the archived files is reduced. Similarly, after the requirement for reading the archived data is solved, the information structure index table in the current database does not need to be filled with too much data, and the space of the current database of the ERP system is greatly saved.
For example, when the inquiry request includes an object code MB5B, which refers to an inventory inquiry on the posting date, the inquiry response speed of the target database to the code in practical application is increased by nearly one time; the single-layer processing of the material ledger is operated in the monthly account process, which originally needs more than 2.5 hours, the operation time is reduced to more than 1 hour after filing, and the response speed is nearly doubled compared with the original speed.
In practical application, when data in a certain ERP system is archived, the archivable data volume is about 1.3T, and the space that can be released by the current database is about 900G according to the empirical compression ratio of the traditional archiving method. After the archiving method is adopted, the current database releases 1.07T of space. Compared with the traditional archiving method, the space of nearly 200G is released.
Further, when a user needs to query a related archive file, the query request may be packaged, where the query request includes: a data index of the target archive file or a key query field (e.g., transaction code) of the target archive file, then a query of the archive file may be made directly based on the query request.
In actual application, the traditional program needs to be modified to meet the requirements of filing and query performance; the involved procedures are shown in table 2:
TABLE 2
The data archiving method and the data archiving device provided by the embodiment of the invention have the following beneficial effects that:
the invention provides a data archiving method and a device, wherein the method comprises the following steps: acquiring historical data from a current database of an Enterprise Resource Planning (ERP) system; determining an archival object based on the historical data; aiming at different archival objects, determining an archival range and an archival frequency of each archival object; screening each archived object according to the archiving range to generate an archived file; storing the archived file into a target database based on the archiving frequency, and deleting online data corresponding to the archived file in the current database; the storing the archived file into a target database based on the archiving frequency comprises: aiming at an archive file corresponding to each archive object, establishing an information index of the archive file in the target database; storing each of the archived files and the corresponding information index into an information structure index table based on the archiving frequency; therefore, compared with the prior art that a large amount of data is stored in the current database, the historical data is filed in the target database, the storage space of the current database can be greatly released, the stability of the current database is improved, the stability of the system performance is improved, and the operation and maintenance cost of the later-stage data is reduced; when the archived data needs to be accessed, the archived data can be directly inquired from the target database without traversing mass data, so that the inquiry efficiency is improved; because a large amount of online data are not stored in the target database, and different information indexes are set when the archived files are stored, the access efficiency of the online data can be ensured; meanwhile, the backup time and the system synchronization time of the online data can be shortened, and the downtime of operations such as system upgrading and the like can be shortened.
The above description is only exemplary of the present invention and should not be taken as limiting the scope of the present invention, and any modifications, equivalents, improvements, etc. that are within the spirit and principle of the present invention should be included in the present invention.
Claims (8)
1. A data archiving method is applied to an ERP system, and the method comprises the following steps:
acquiring historical data from a current database of an Enterprise Resource Planning (ERP) system;
determining an archival object in the historical data;
aiming at different archival objects, determining an archival range and an archival frequency of each archival object;
screening each archived object according to the archiving range to generate an archived file;
storing the archived file into a target database based on the archiving frequency, and deleting online data corresponding to the archived file in the current database; wherein the content of the first and second substances,
the storing the archived file into a target database based on the archiving frequency comprises:
aiming at an archive file corresponding to each archive object, establishing an information index of the archive file in the target database;
and storing each archived file and the corresponding information index into an information structure index table based on the archiving frequency.
2. The method of claim 1, wherein the determining an archival object in the historical data comprises:
acquiring various types of data in the historical data;
and determining the archival object based on the data volume, the data growth speed, the access frequency and the response time of the current database to various types of data.
3. The method of claim 1, wherein said filtering each of said archival objects according to said archival scope to generate an archival file comprises:
acquiring the archival data which accords with the corresponding archival range for each archival object;
generating the archive file based on the archive data.
4. The method of claim 1, wherein prior to storing the archived file into a target database based on the archiving frequency, the method further comprises:
and configuring the server name, the port number and the host IP address of the target server in the ERP system so as to integrate the front server and the target server.
5. A data archiving apparatus, the apparatus comprising:
the acquisition unit is used for acquiring historical data from a current database of the Enterprise Resource Planning (ERP) system;
a determination unit configured to determine an archive object based on the history data; aiming at different archival objects, determining an archival range and an archival frequency of each archival object;
the generating unit is used for screening the archival objects according to the archival range to generate an archival file;
a storage unit for storing the archive file into a target database based on the archive frequency,
a deleting unit, configured to delete online data corresponding to the archive file in the current database;
wherein the storage unit is specifically configured to:
aiming at an archive file corresponding to each archive object, establishing an information index of the archive file in the target database;
and storing each archived file and the corresponding information index into an information structure index table based on the archiving frequency.
6. The apparatus of claim 5, wherein the determination unit is specifically configured to:
acquiring various types of data in the historical data;
and determining the archival object based on the data volume, the data growth speed, the access frequency and the response time of the current database to various types of data.
7. The apparatus of claim 5, wherein the generating unit is specifically configured to:
acquiring the archival data which accords with the corresponding archival range for each archival object;
generating the archive file based on the archive data.
8. The apparatus of claim 5, wherein the apparatus further comprises: a configuration unit for configuring the configuration unit,
and the system is used for configuring the server name, the port number and the host IP address of the target server in the ERP system before the archived file is stored in a target database based on the archiving frequency so as to integrate the former server with the target server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010246029.3A CN111538699A (en) | 2020-03-31 | 2020-03-31 | Data archiving method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010246029.3A CN111538699A (en) | 2020-03-31 | 2020-03-31 | Data archiving method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111538699A true CN111538699A (en) | 2020-08-14 |
Family
ID=71952209
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010246029.3A Pending CN111538699A (en) | 2020-03-31 | 2020-03-31 | Data archiving method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111538699A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112148687A (en) * | 2020-09-27 | 2020-12-29 | 上海七牛信息技术有限公司 | Method and system for deleting or archiving files in object storage |
| CN112199329A (en) * | 2020-09-24 | 2021-01-08 | 上海上讯信息技术股份有限公司 | Double-machine operation and maintenance data filing and cleaning method and equipment based on fortress machine |
| CN113377386A (en) * | 2021-06-23 | 2021-09-10 | 支付宝(杭州)信息技术有限公司 | Installation package installation method, device and equipment without decompression |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1783063A (en) * | 2004-11-29 | 2006-06-07 | 中兴通讯股份有限公司 | Device and method for archiving and inquiry historical data |
| CN104102737A (en) * | 2014-07-28 | 2014-10-15 | 中国农业银行股份有限公司 | Historical data storage method and system |
| CN105279261A (en) * | 2015-10-23 | 2016-01-27 | 北京京东尚科信息技术有限公司 | Dynamic extensible database filing method and system |
| CN109598228A (en) * | 2018-11-30 | 2019-04-09 | 泰华智慧产业集团股份有限公司 | Paper document electronization is recorded to the method and system of filing |
| US20190146946A1 (en) * | 2017-08-02 | 2019-05-16 | Zhongan Information Technology Service Co., Ltd. | Method and device for archiving block data of blockchain and method and device for querying the same |
| CN110362531A (en) * | 2019-06-17 | 2019-10-22 | 众安在线财产保险股份有限公司 | A kind of automatic archiving method and device |
| CN110716895A (en) * | 2019-09-17 | 2020-01-21 | 平安科技（深圳）有限公司 | Target data archiving method and device, computer equipment and medium |
| CN110837592A (en) * | 2019-11-08 | 2020-02-25 | 京东数字科技控股有限公司 | Method, apparatus and computer readable storage medium for data archiving |
-
2020
- 2020-03-31 CN CN202010246029.3A patent/CN111538699A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1783063A (en) * | 2004-11-29 | 2006-06-07 | 中兴通讯股份有限公司 | Device and method for archiving and inquiry historical data |
| CN104102737A (en) * | 2014-07-28 | 2014-10-15 | 中国农业银行股份有限公司 | Historical data storage method and system |
| CN105279261A (en) * | 2015-10-23 | 2016-01-27 | 北京京东尚科信息技术有限公司 | Dynamic extensible database filing method and system |
| US20190146946A1 (en) * | 2017-08-02 | 2019-05-16 | Zhongan Information Technology Service Co., Ltd. | Method and device for archiving block data of blockchain and method and device for querying the same |
| CN109598228A (en) * | 2018-11-30 | 2019-04-09 | 泰华智慧产业集团股份有限公司 | Paper document electronization is recorded to the method and system of filing |
| CN110362531A (en) * | 2019-06-17 | 2019-10-22 | 众安在线财产保险股份有限公司 | A kind of automatic archiving method and device |
| CN110716895A (en) * | 2019-09-17 | 2020-01-21 | 平安科技（深圳）有限公司 | Target data archiving method and device, computer equipment and medium |
| CN110837592A (en) * | 2019-11-08 | 2020-02-25 | 京东数字科技控股有限公司 | Method, apparatus and computer readable storage medium for data archiving |
Non-Patent Citations (1)
| Title |
|---|
| 赵军平、任连中等, 人民军医出版社 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112199329A (en) * | 2020-09-24 | 2021-01-08 | 上海上讯信息技术股份有限公司 | Double-machine operation and maintenance data filing and cleaning method and equipment based on fortress machine |
| CN112199329B (en) * | 2020-09-24 | 2023-08-18 | 上海上讯信息技术股份有限公司 | Double-machine operation and maintenance data archiving and cleaning method and device based on fort machine |
| CN112148687A (en) * | 2020-09-27 | 2020-12-29 | 上海七牛信息技术有限公司 | Method and system for deleting or archiving files in object storage |
| CN113377386A (en) * | 2021-06-23 | 2021-09-10 | 支付宝(杭州)信息技术有限公司 | Installation package installation method, device and equipment without decompression |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11816126B2 (en) | Large scale unstructured database systems | |
| JP6560308B2 (en) | System and method for implementing a data storage service | |
| Dong et al. | Optimizing Space Amplification in RocksDB. | |
| CN111538699A (en) | Data archiving method and device | |
| CN104933112B (en) | Distributed interconnection Transaction Information storage processing method | |
| CN111913909A (en) | Re-fragmentation method and system in distributed storage system | |
| EP3238106A1 (en) | Compaction policy | |
| CN104657459A (en) | Massive data storage method based on file granularity | |
| CN103366015A (en) | OLAP (on-line analytical processing) data storage and query method based on Hadoop | |
| US20140012867A1 (en) | Method And Process For Enabling Distributing Cache Data Sources For Query Processing And Distributed Disk Caching Of Large Data And Analysis Requests | |
| EP3788505B1 (en) | Storing data items and identifying stored data items | |
| CN111241177B (en) | Data acquisition method, system and network equipment | |
| WO2017165914A1 (en) | "methods and systems for database optimisation" | |
| US11777983B2 (en) | Systems and methods for rapidly generating security ratings | |
| US10990573B2 (en) | Fast index creation system for cloud big data database | |
| CN111367994A (en) | Method and system for synchronously backing up incremental data of database | |
| CN115599807A (en) | Data access method, device, application server and storage medium | |
| CN111831661A (en) | Database filing method based on express business logic | |
| CN110704442A (en) | Real-time acquisition method and device for big data | |
| CN110381136A (en) | A kind of method for reading data, terminal, server and storage medium | |
| CN111858767A (en) | Synchronous data processing method, device, equipment and storage medium | |
| CN108153874B (en) | Rapid paging method for large-data high-time-consumption query result set | |
| CN110019192B (en) | Database retrieval method and device | |
| CN115712654A (en) | Method and device for inquiring transaction state | |
| CN113468150A (en) | Horizontal segmentation capacity expansion and migration method for payment subscription data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200814 |
|
| RJ01 | Rejection of invention patent application after publication |