CN117667884A - Data migration method, device, equipment and storage medium - Google Patents
Data migration method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN117667884A CN117667884A CN202311376597.5A CN202311376597A CN117667884A CN 117667884 A CN117667884 A CN 117667884A CN 202311376597 A CN202311376597 A CN 202311376597A CN 117667884 A CN117667884 A CN 117667884A
- Authority
- CN
- China
- Prior art keywords
- data
- data table
- target
- migration
- source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013508 migration Methods 0.000 title claims abstract description 162
- 230000005012 migration Effects 0.000 title claims abstract description 162
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000003860 storage Methods 0.000 title claims abstract description 13
- 238000006243 chemical reaction Methods 0.000 claims abstract description 85
- 238000013499 data model Methods 0.000 claims abstract description 19
- 238000013515 script Methods 0.000 claims description 24
- 238000004590 computer program Methods 0.000 claims description 12
- 238000004140 cleaning Methods 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 5
- 230000009466 transformation Effects 0.000 claims 2
- 238000012545 processing Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013524 data verification Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a data migration method, a data migration device, data migration equipment and a storage medium, and relates to the technical field of databases. Wherein the method comprises the following steps: acquiring a corresponding relation between a source data table set in a source system and a target data table set in a target system by analyzing a pre-established data model; generating data table objects of all target data tables in the target data table set according to the pre-created data table class and the corresponding relation; generating a data migration conversion statement according to the data table object and a predefined data migration conversion rule; and executing the data migration conversion statement, and migrating the data of the source data table set to the target data table set. The data migration method and device can improve efficiency and accuracy of data migration.
Description
Technical Field
The present disclosure relates to the field of database technologies, and in particular, to a data migration method, apparatus, device, and storage medium.
Background
When data migration is performed among different systems, it is important to ensure the efficiency and accuracy of data migration.
Currently, when data migration is implemented, a conversion script and a check script for data migration are generally written manually. However, the number of tables involved in data migration is large, the data fields are changed greatly, and the field design is changed in the implementation process, so that the manual script writing mode is low in efficiency and high in error rate.
Disclosure of Invention
The application provides a data migration method, a device, equipment and a storage medium, which are used for solving the problems of low data migration efficiency and high error rate in the prior art.
In a first aspect, the present application provides a data migration method, including:
acquiring a corresponding relation between a source data table set in a source system and a target data table set in a target system by analyzing a pre-established data model;
generating data table objects of all target data tables in the target data table set according to the pre-created data table class and the corresponding relation;
generating a data migration conversion statement according to the data table object and a predefined data migration conversion rule;
and executing the data migration conversion statement, and migrating the data of the source data table set to the target data table set.
In a second aspect, the present application provides a data migration apparatus, including:
the data model analysis module is used for acquiring the corresponding relation between a source data table set in the source system and a target data table set in the target system by analyzing a pre-established data model;
the data table object generating module is used for generating data table objects of all target data tables in the target data table set according to the pre-created data table class and the corresponding relation;
the data migration conversion statement generation module is used for generating a data migration conversion statement according to the data table object and a predefined data migration conversion rule;
and the data migration conversion statement execution module is used for executing the data migration conversion statement and migrating the data of the source data table set to the target data table set.
In a third aspect, the present application also provides an electronic device comprising a processor, and a memory communicatively coupled to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored by the memory to implement the data migration method as described in any of the embodiments herein.
In a fourth aspect, the present application further provides a computer-readable storage medium having stored therein computer-executable instructions that, when executed by a processor, are configured to implement a data migration method according to any embodiment of the present application.
In a fifth aspect, the present application also provides a computer program product comprising a computer program which, when executed by a processor, implements a data migration method as described in any embodiment of the present application.
According to the data migration method, the device, the equipment and the storage medium, the data table objects of all target data tables in the target data table set are generated based on the corresponding relation between the source data table set in the source system and the target data table set in the target system and the pre-established data table class, then the data migration conversion statement is generated according to the data table objects and the pre-defined data migration conversion rule, the data migration conversion statement is executed, and the data migration of the source data table set to the target data table set is realized. Therefore, through establishing unified data table classes, generating data table objects based on the data table classes, abstracting the corresponding relation of new and old data tables through object attributes, automatically generating data migration conversion sentences based on migration conversion rules, and executing the data migration conversion sentences can migrate data of a source data table set to a target data table set without manually writing migration scripts or manually updating the scripts when the source data tables are changed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
FIG. 1 is a flowchart of a data migration method according to an embodiment of the present application;
FIG. 2 is a flowchart of a data migration method according to an embodiment of the present application;
FIG. 3 is a flowchart of a data migration method according to an embodiment of the present application;
FIG. 4 is a flowchart of a data migration method according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a data migration device according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Specific embodiments thereof have been shown by way of example in the drawings and will herein be described in more detail. These drawings and the written description are not intended to limit the scope of the inventive concepts in any way, but to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments.
Detailed Description
The present application is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present application are shown in the drawings.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only to distinguish the description, and are not to be construed as indicating or implying relative importance. The data acquisition, storage, use, processing and the like in the technical scheme meet the relevant regulations of national laws and regulations.
Fig. 1 is a flowchart of a data migration method provided in an embodiment of the present application. The present embodiment may be applied to a case of data migration between different systems, and the method may be performed by a data migration apparatus, where the apparatus may be implemented in software and/or hardware, and is preferably configured in an electronic device, for example, a computer device or a server. As shown in fig. 1, the method specifically includes:
s101, acquiring a corresponding relation between a source data table set in a source system and a target data table set in a target system by analyzing a pre-established data model.
S102, generating data table objects of all target data tables in the target data table set according to the pre-created data table class and the corresponding relation.
S103, generating a data migration conversion statement according to the data table object and a predefined data migration conversion rule.
S104, executing a data migration conversion statement, and migrating the data of the source data table set to the target data table set.
First, a data model is built according to system design requirements and business meaning of data fields in a source system. The data model is used for showing the corresponding relation between the fields of different types in the source data table set and the target data table set. Taking the Chinese and English names and data types of the data items as examples, the data model can define what the Chinese and English names and data types of the data items of the source system are respectively, and define what the Chinese and English names and data types of the corresponding data items are respectively in the target system. Therefore, the corresponding relation between the source data table set in the source system and the target data table set in the target system can be obtained by analyzing the data model. Here, the correspondence may refer to correspondence of different fields between two data tables.
The data table class is an abstraction of different types of data tables in the target system, and according to the data table class and the obtained corresponding relation, data table objects of each target data table in the target data table set can be generated. For example, attributes in a data table class that may define a data table include the Chinese and English names of the table, the field list of the table, the index list of the table, the corresponding old table, the field list of the corresponding old table, and so forth. Therefore, based on the corresponding relation between the source data table set and the target data table set, specific parameters of each target data table in the target data table set on attributes such as Chinese and English names of the tables, field lists of the tables, index lists of the tables, corresponding old tables and field lists of the corresponding old tables can be obtained, and data table objects of each target data table can be generated.
That is, the data table object has a plurality of table attributes, the values of the table attributes are used to describe the target data table, and the target data table determined based on the correspondence relationship corresponds to the source data table in the source data table set. The number of table attributes may be configured as required, which is not limited in the present application. The table attributes of the data table object include at least: a target data table name, a field list of the target data table, an index list of the target data table, a corresponding source data table name and a field list thereof; wherein a field of the target data table is represented by a field object, which is described by a plurality of field attributes. That is, a list of table fields in a table object is described by a field object that also has a plurality of attributes, such as the chinese-english name of the field, the type of the field, the database type, etc., by which the fields of the table are described.
The data migration conversion rule may be predefined according to specific migration scenarios and requirements, which are not limited in this application. For example, for the case that the data types and lengths of the target data table and the source data table are consistent, or the data types are consistent but the lengths are inconsistent and greater than the field lengths of the source data table, or the data types are inconsistent, the required conversion rules need to be defined respectively, so as to generate data migration conversion sentences according to the data table objects and the predefined data migration conversion rules. The data migration conversion statement is different from a manually written migration script in the prior art, the data migration conversion statement is based on a program language and a database used in a migration scene, the data migration conversion statement is automatically generated after a rule for generating the migration conversion statement is preset, and the data migration conversion statement can migrate the data of the source data table set to the target data table set by executing the data migration conversion statement aiming at a data table object to make a specific description on how to migrate the data of the source data table to the target data table. For example, in the SQL (Structured Query Language) database, the data migration conversion statement may be an insert statement or an update statement, or the like. Therefore, even if the fields in the source data table change, the script does not need to be manually changed, the attribute values in the abstract data table objects naturally change along with the changes of the fields in the source data table, and migration is performed according to the changed field values when the data migration conversion statement is executed. Therefore, the efficiency of implementing data migration is improved, meanwhile, errors caused by manual script change can be avoided, and the accuracy of data migration is improved naturally.
In addition, each time the data migration is executed, the executed data migration conversion statement can be cleaned up, so that the data migration can be executed for a plurality of times based on the new statement, and the correction of the table which is executed in error in the migration process is facilitated. The execution mode of the cleaning data migration conversion statement can be realized through a pre-written script. The script for cleaning the data may be executed in stages or may be executed in loops, which is not limited in this application.
According to the technical scheme, the unified data table class is established, then the data table object is generated based on the data table class, the corresponding relation of the new data table and the old data table is abstracted through the object attribute, the data migration conversion sentences can be automatically generated based on the migration conversion rules, the data of the source data table set can be migrated to the target data table set by executing the data migration conversion sentences, a migration script is not required to be written manually, and the script is not required to be updated manually when the source data table is changed, so that the technical scheme of the application not only improves the efficiency of data migration, but also improves the accuracy of data migration.
Fig. 2 is a flowchart of a data migration method provided in an embodiment of the present application, where how to perform data verification is further described based on the foregoing embodiments. As shown in fig. 2, the method includes:
s201, acquiring a corresponding relation between a source data table set in a source system and a target data table set in a target system by analyzing a pre-established data model.
S202, generating data table objects of all target data tables in the target data table set according to the pre-created data table class and the corresponding relation.
S203, generating a data migration conversion statement according to the data table object and a predefined data migration conversion rule.
S204, executing a data migration conversion statement, and migrating the data of the source data table set to the target data table set.
S205, generating a data check statement according to the data table object and a predefined data check rule.
S206, executing a data check statement to check the data migrated to the target data table set.
In this embodiment, the details of S201 to S204 are the same as those of the above embodiments, and will not be repeated here. Unlike the above embodiments, the data migration method of the present embodiment further includes data checking.
Specifically, the purpose of data checking is to further ensure the integrity and correctness of data migration, which is an important link after data migration. Because the technical scheme of the application abstracts the corresponding relation between the source data table and the target data table on the basis of creating the data model, and generates the data table object of the target data table on the basis of uniformly established data table classes, the data checking statement can be automatically generated according to the data table object and a predefined data checking rule. Then, by executing the data check statement, the data check, that is, the check of the data migrated to the target data table set, can be automatically performed.
Wherein the data check statement and the data migration conversion statement may be generated based on the same program language and database. Illustratively, the data check statement may include a comparison of the total amount in the target data table with the total amount in its corresponding source data table, a comparison of the amount type, or a code value conversion comparison, etc. And comparing the contents through a data checking statement, and determining the result of data checking according to the comparison result. If the data check passes, the current data migration is determined to be complete and accurate, otherwise, the current data migration is determined to have problems, and meanwhile, the data table with the specific problems can be positioned through the field according to the check condition, so that the errors are corrected in time.
In addition, the execution of the data check statement may be based on a pre-written script implementation. Specifically, the check may be performed on the migration data in a batch at one time, may be performed in batches, may be performed at regular intervals, or the like, and the present application is not limited in this respect.
According to the technical scheme, the unified data table class is established, then the data table object is generated based on the data table class, the corresponding relation of the new data table and the old data table is abstracted through the object attribute, the data migration conversion statement can be automatically generated based on the migration conversion rule, meanwhile, the data check statement can be generated based on the data check rule, the data of the source data table set can be migrated to the target data table set by executing the data migration conversion statement and the data check statement, the integrity and the accuracy of migration data can be checked timely, the migration script does not need to be written manually, and the script does not need to be updated manually when the source data table is changed, so that the technical scheme of the application not only improves the efficiency of data migration, but also improves the integrity and the accuracy of data migration.
Fig. 3 is a flowchart of a data migration method according to an embodiment of the present application, where how to execute a data migration conversion statement is further described based on the foregoing embodiments. As shown in fig. 3, the method includes:
s301, acquiring a corresponding relation between a source data table set in a source system and a target data table set in a target system by analyzing a pre-established data model.
S302, generating data table objects of all target data tables in the target data table set according to the pre-created data table class and the corresponding relation.
S303, generating a data migration conversion statement according to the data table object and a predefined data migration conversion rule.
S304, executing data migration conversion sentences in batches through a pre-written data migration conversion script, and migrating the data of the source data table set to the target data table set.
In this embodiment, the details of S301 to S303 are the same as those of the above embodiments, and will not be repeated here. In the data migration method of the present embodiment, data migration conversion statements are executed in batch by a data migration conversion script written in advance so as to migrate data of a source data table set to a target data table set.
In particular, data migration is typically performed multiple times, so it is necessary to have a unified data migration operation script. By writing the data migration conversion script, one-key data migration can be realized. In one embodiment, the data migration conversion script executes the data migration conversion sentences in batches, which may be specific to all source data tables in the source system or may be specific to part of source data tables, and may be specifically preconfigured according to the data migration requirement, which is not limited in this application.
According to the technical scheme, the data migration conversion sentences can be automatically generated, the data of the source data table set is migrated to the target data table set by executing the data migration conversion sentences, and meanwhile, the data migration can be executed through the data migration conversion script in a one-key mode, so that the data migration efficiency is further improved, and the labor cost is reduced.
Fig. 4 is a flowchart of a data migration method according to an embodiment of the present application. As shown in fig. 4, in the present embodiment, a source database of a source system and a target database of a target system in a production environment represent databases to which a source data table set and a target data table set in the present application belong, respectively. In the data migration process, firstly, carrying out production unloading from a source database, and placing source data in a data migration environment; secondly, loading source data to be migrated into a database table to be migrated of a source system through production data loading; thirdly, performing data migration conversion, namely converting data migration in a source system into a target system to obtain a converted database table; fourth, data checking is carried out on the data before and after the migration and conversion between the database table to be migrated of the source system and the database table after the conversion of the target system; fifthly, synchronizing the data which has been migrated and converted to a target database; and sixthly, performing data check on the data between the database table after the conversion of the target system and the target database in the synchronous production library. Through the steps, the data migration from the source database to the target database is completed.
Fig. 5 is a schematic structural diagram of a data migration apparatus according to an embodiment of the present application. The embodiment can be applied to the case of data migration between different systems. As shown in fig. 5, the data migration apparatus 50 includes:
the data model analysis module 510 is configured to obtain a corresponding relationship between a source data table set in the source system and a target data table set in the target system by analyzing a pre-established data model;
a data table object generating module 520, configured to generate a data table object of each target data table in the target data table set according to a pre-created data table class and the correspondence;
a data migration conversion statement generating module 530, configured to generate a data migration conversion statement according to the data table object and a predefined data migration conversion rule;
and the data migration conversion statement execution module 540 is configured to execute the data migration conversion statement and migrate the data of the source data table set to the target data table set.
Optionally, the data table object has a plurality of table attributes, and values of the table attributes are used for describing the target data table, and a source data table corresponding to the target data table in the source data table set is determined based on the corresponding relation.
Optionally, the table attribute of the data table object at least includes: a target data table name, a field list of the target data table, an index list of the target data table, a corresponding source data table name and a field list thereof; wherein the fields of the target data table are represented by field objects, which are described by a plurality of field attributes.
Optionally, the apparatus further includes:
the data checking module is used for generating a data checking statement according to the data table object and a predefined data checking rule; and executing the data checking statement to check the data migrated to the target data table set.
Optionally, the data migration conversion statement execution module is specifically configured to:
and executing the data migration conversion sentences in batches through a pre-written data migration conversion script, and migrating the data of the source data table set to the target data table set.
Optionally, the apparatus further includes:
and the cleaning module is used for cleaning the executed data migration conversion statement.
The data migration device provided in the embodiment of the present application may be used to execute the technical scheme of the data migration method in the above embodiment, and its implementation principle and technical effects are similar, and are not described herein again.
It should be noted that, it should be understood that the division of the modules of the above apparatus is merely a division of a logic function, and may be fully or partially integrated into a physical entity or may be physically separated. And these modules may all be implemented in software in the form of calls by the processing element; or can be realized in hardware; the method can also be realized in a form of calling software by a processing element, and the method can be realized in a form of hardware by a part of modules. For example, the data model analysis module 510 may be a processing element that is set up separately, may be implemented in a chip of the above-described apparatus, or may be stored in a memory of the above-described apparatus in the form of program codes, and the functions of the data model analysis module 510 may be called and executed by a processing element of the above-described apparatus. The implementation of the other modules is similar. In addition, all or part of the modules can be integrated together or can be independently implemented. The processing element here may be an integrated circuit with signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in a software form.
In the technical scheme of the application, the related processes of collecting, storing, using, processing, transmitting, providing, disclosing and the like of the personal information of the user accord with the regulations of related laws and regulations, and the public order colloquial is not violated.
Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application. As shown in fig. 6, the electronic device may include: transceiver 610, processor 620, memory 630.
Processor 620 executes the computer-executable instructions stored in the memory, causing processor 620 to perform the aspects of the embodiments described above. The processor 620 may be a general-purpose processor including a central processing unit CPU, a network processor (network processor, NP), etc.; but may also be a digital signal processor DSP, an application specific integrated circuit ASIC, a field programmable gate array FPGA or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component.
The memory 630 is coupled to the processor 620 via a system bus and communicates with each other, and the memory 630 is used for storing computer program instructions.
The transceiver 610 may be used to obtain a task to be run and configuration information for the task to be run.
The system bus may be a peripheral component interconnect standard (peripheral component interconnect, PCI) bus or an extended industry standard architecture (extended industry standard architecture, EISA) bus, among others. The system bus may be classified into an address bus, a data bus, a control bus, and the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus. The transceiver is used to enable communication between the database access device and other computers (e.g., clients, read-write libraries, and read-only libraries). The memory may include random access memory (random access memory, RAM) and may also include non-volatile memory (non-volatile memory).
The electronic device provided in the embodiment of the present application may be a terminal device in the above embodiment.
The embodiment of the application also provides a computer readable storage medium, wherein the computer readable storage medium stores computer instructions, and when the computer instructions run on a computer, the computer is caused to execute the technical scheme of the data migration method of the embodiment.
The embodiment of the application also provides a computer program product, which comprises a computer program, wherein the computer program is stored in a computer readable storage medium, and at least one processor can read the computer program from the computer readable storage medium, and the technical scheme of the data migration method in the embodiment can be realized when the at least one processor executes the computer program.
Computer program product in the implementation, the computer program code for carrying out the operations of the present application may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present application and the technical principle applied. Those skilled in the art will appreciate that the present application is not limited to the particular embodiments described herein, but is capable of numerous obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the present application. Therefore, while the present application has been described in connection with the above embodiments, the present application is not limited to the above embodiments, but may include many other equivalent embodiments without departing from the spirit of the present application, the scope of which is defined by the scope of the appended claims.
Claims (15)
1. A method of data migration, comprising:
acquiring a corresponding relation between a source data table set in a source system and a target data table set in a target system by analyzing a pre-established data model;
generating data table objects of all target data tables in the target data table set according to the pre-created data table class and the corresponding relation;
generating a data migration conversion statement according to the data table object and a predefined data migration conversion rule;
and executing the data migration conversion statement, and migrating the data of the source data table set to the target data table set.
2. The method of claim 1, wherein the data table object has a plurality of table attributes, values of the table attributes describing the target data table, and a corresponding source data table of the target data table in the set of source data tables determined based on the correspondence.
3. The method of claim 2, wherein the table attributes of the data table object include at least: a target data table name, a field list of the target data table, an index list of the target data table, a corresponding source data table name and a field list thereof; wherein the fields of the target data table are represented by field objects, which are described by a plurality of field attributes.
4. The method as recited in claim 1, further comprising:
generating a data check statement according to the data table object and a predefined data check rule;
and executing the data checking statement to check the data migrated to the target data table set.
5. The method of claim 1, wherein the executing the data migration transformation statement to migrate data of the source data table set to the target data table set comprises:
and executing the data migration conversion sentences in batches through a pre-written data migration conversion script, and migrating the data of the source data table set to the target data table set.
6. The method as recited in claim 1, further comprising:
the executed data migration translation statement is cleaned up.
7. A data migration apparatus, comprising:
the data model analysis module is used for acquiring the corresponding relation between a source data table set in the source system and a target data table set in the target system by analyzing a pre-established data model;
the data table object generating module is used for generating data table objects of all target data tables in the target data table set according to the pre-created data table class and the corresponding relation;
the data migration conversion statement generation module is used for generating a data migration conversion statement according to the data table object and a predefined data migration conversion rule;
and the data migration conversion statement execution module is used for executing the data migration conversion statement and migrating the data of the source data table set to the target data table set.
8. The apparatus of claim 7, wherein the data table object has a plurality of table attributes, values of the table attributes describing the target data table, and a corresponding source data table of the target data table in the set of source data tables determined based on the correspondence.
9. The apparatus of claim 7, wherein the table attributes of the data table object comprise at least: a target data table name, a field list of the target data table, an index list of the target data table, a corresponding source data table name and a field list thereof; wherein the fields of the target data table are represented by field objects, which are described by a plurality of field attributes.
10. The apparatus as recited in claim 7, further comprising:
the data checking module is used for generating a data checking statement according to the data table object and a predefined data checking rule; and executing the data checking statement to check the data migrated to the target data table set.
11. The apparatus of claim 7, wherein the data migration transformation sentence execution module is specifically configured to:
and executing the data migration conversion sentences in batches through a pre-written data migration conversion script, and migrating the data of the source data table set to the target data table set.
12. The apparatus as recited in claim 7, further comprising:
and the cleaning module is used for cleaning the executed data migration conversion statement.
13. An electronic device, comprising: a processor, and a memory communicatively coupled to the processor;
the memory stores computer-executable instructions;
the processor executes computer-executable instructions stored in the memory to implement the data migration method of any one of claims 1-6.
14. A computer readable storage medium having stored therein computer executable instructions which when executed by a processor are for implementing the data migration method of any one of claims 1-6.
15. A computer program product comprising a computer program which, when executed by a processor, implements the data migration method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311376597.5A CN117667884A (en) | 2023-10-23 | 2023-10-23 | Data migration method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311376597.5A CN117667884A (en) | 2023-10-23 | 2023-10-23 | Data migration method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117667884A true CN117667884A (en) | 2024-03-08 |
Family
ID=90072255
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311376597.5A Pending CN117667884A (en) | 2023-10-23 | 2023-10-23 | Data migration method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117667884A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118312502A (en) * | 2024-06-11 | 2024-07-09 | 天津南大通用数据技术股份有限公司 | Migration method, migration device, migration equipment and migration storage medium for database storage process |
-
2023
- 2023-10-23 CN CN202311376597.5A patent/CN117667884A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118312502A (en) * | 2024-06-11 | 2024-07-09 | 天津南大通用数据技术股份有限公司 | Migration method, migration device, migration equipment and migration storage medium for database storage process |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108459962B (en) | Code normalization detection method and device, terminal equipment and storage medium | |
| US11080305B2 (en) | Relational log entry instituting system | |
| CN108319460B (en) | Method and device for generating application program installation package, electronic equipment and storage medium | |
| CN111722839A (en) | Code generation method and device, electronic equipment and storage medium | |
| CN113127347A (en) | Interface testing method, device, equipment and readable storage medium | |
| CN117667884A (en) | Data migration method, device, equipment and storage medium | |
| US20240256613A1 (en) | Data processing method and apparatus, readable storage medium, and electronic device | |
| CN111240987B (en) | Method and device for detecting migration program, electronic equipment and computer readable storage medium | |
| CN114780109B (en) | Python project third-party library dependent automatic analysis and installation method | |
| CN116414774A (en) | File migration method, device, equipment and storage medium | |
| CN115599359A (en) | Code generation method, device, equipment and medium | |
| CN113495728A (en) | Dependency relationship determination method, dependency relationship determination device, electronic equipment and medium | |
| CN110737431A (en) | Software development method, development platform, terminal device and storage medium | |
| US11347533B2 (en) | Enhanced virtual machine image management system | |
| US11604629B1 (en) | Automatic workflow generation based on annotated code statements | |
| CN114328965A (en) | Knowledge graph updating method and device and computer equipment | |
| CN113760237A (en) | Compiling address updating method and device, terminal equipment and readable storage medium | |
| CN112685309A (en) | Unit testing method, unit testing device, storage medium and computer equipment | |
| CN111736848A (en) | Packet conflict positioning method and device, electronic equipment and readable storage medium | |
| CN116755684B (en) | OAS Schema generation method, device, equipment and medium | |
| CN110688430A (en) | Method and device for obtaining data bypass and electronic equipment | |
| CN116501744B (en) | Automatic form building and warehousing method and device for simulation data and computer equipment | |
| CN111782183B (en) | Method and device for judging component dependency, electronic device and medium | |
| CN111722996B (en) | Interactive standard compliance testing method and device | |
| CN115981657A (en) | Code generation method and device, electronic equipment and readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |