CN105205117B - A kind of tables of data moving method and device - Google Patents

A kind of tables of data moving method and device Download PDF

Info

Publication number
CN105205117B
CN105205117B CN201510570573.2A CN201510570573A CN105205117B CN 105205117 B CN105205117 B CN 105205117B CN 201510570573 A CN201510570573 A CN 201510570573A CN 105205117 B CN105205117 B CN 105205117B
Authority
CN
China
Prior art keywords
field
data
source
target
configuration file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510570573.2A
Other languages
Chinese (zh)
Other versions
CN105205117A (en
Inventor
文帅营
刘建辉
闫艳利
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZHENGZHOU XIZHI INFORMATION TECHNOLOGY Co Ltd
Original Assignee
ZHENGZHOU XIZHI INFORMATION TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZHENGZHOU XIZHI INFORMATION TECHNOLOGY Co Ltd filed Critical ZHENGZHOU XIZHI INFORMATION TECHNOLOGY Co Ltd
Priority to CN201510570573.2A priority Critical patent/CN105205117B/en
Publication of CN105205117A publication Critical patent/CN105205117A/en
Application granted granted Critical
Publication of CN105205117B publication Critical patent/CN105205117B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/214Database migration support
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the present application provides a kind of tables of data moving method and device, this method comprises: obtaining the target data in current target source field to be migrated from the source data table of source database;Call the field transitional information of user configuration in configuration file, field transitional information includes: the corresponding relationship between source field and destination field, and source field data format and destination field data format between transfer function, wherein destination field be purpose tables of data in field;It is the data format of the corresponding destination field of target source field by the Data Format Transform of target data based on field transitional information;Target data after change data format is migrated into purpose tables of data in the corresponding destination field of target source field.This method and device can reduce the data for the code write needed for Data Migration, reduce the complexity of written in code.

Description

A kind of tables of data moving method and device
Technical field
This application involves technical field of data processing, more particularly to a kind of tables of data moving method and device.
Background technique
Database migration refers to the data in tables of data from the tables of data that source database is transferred to purpose database.
If the data list structure of source database and purpose database is inconsistent, i.e., source database is different with purpose database Structure database, then before carrying out Data Migration, it is also necessary to the data tableau format in source database be converted, and will be turned Database table after changing moves to purpose database.In order to realize the conversion of tables of data format in Data Migration, carrying out every time Before heterogeneous database migration, business personnel is required to write phase according to data list structure in source database and purpose database The migration code answered, the data volume of written in code is big, so that data migration process is complex.
Summary of the invention
In view of this, this application provides a kind of tables of data moving method and devices, to reduce the data volume of written in code, Reduce the complexity of written in code.
To achieve the above object, the application provides the following technical solutions: a kind of tables of data moving method, comprising:
From the source data table of source database, the target data in current target source field to be migrated is obtained;
The field transitional information of user configuration in configuration file is called, the field transitional information includes: source field and mesh Field between corresponding relationship and source field data format and destination field data format between transfer function, Wherein, destination field is the field in purpose tables of data;
It is based on the field transitional information, the Data Format Transform of the target data is corresponding for the target source field Destination field data format;
The target data after change data format is migrated to target source field pair described in the purpose tables of data In the destination field answered.
Preferably, in the source data table from source database, the target in current target source field to be migrated is obtained Data, comprising:
The configuration file is called, source data table and purpose tables of data based on user configuration in the configuration file, from In the source data table of source database, the target data in current target source field to be migrated is obtained.
Preferably, in the source data table from source database, the target in current target source field to be migrated is obtained Data, comprising:
Preset migration code is executed, to trigger from the source data table of source database, obtains current target to be migrated Target data in source field;
Then, the field transitional information for calling user configuration in configuration file, comprising:
During executing the migration code, the editable configuration file of the migration code binding is called, from The field transitional information of user configuration is obtained in the editable configuration file.
Preferably, in the source data table from source database, the mesh in current target source field to be migrated is obtained Before mark data, further includes:
Obtain source field set and destination field set, wherein the source field in the source field set refers to for user The field in the source data table in fixed source database;Destination field in the destination field set is what user specified Field in target database in purpose tables of data;
Receive the field transitional information of user configuration;
The field transitional information is stored into the specified configuration file.
Preferably, the field transitional information for receiving user configuration, comprising:
By preset specified interface, the field transitional information that user configures into the configuration file is received.
On the other hand, present invention also provides a kind of tables of data moving apparatus, comprising:
Data capture unit, for from the source data table of source database, obtaining in current target source field to be migrated Target data;
File call unit, for calling the field transitional information of user configuration in configuration file, the field conversion letter Breath includes: the data format of the corresponding relationship and source field between source field and destination field and the data lattice of destination field Transfer function between formula, wherein destination field is the field in purpose tables of data;
Format conversion unit, for being based on the field transitional information, the Data Format Transform by the target data is The data format of the corresponding destination field of the target source field;
Migration process unit, for migrating the target data after change data format into the purpose tables of data In the corresponding destination field of the target source field.
Preferably, the data capture unit, comprising:
First obtains subelement, for calling the configuration file, the source number based on user configuration in the configuration file According to table and purpose tables of data, from the source data table of source database, the number of targets in current target source field to be migrated is obtained According to.
Preferably, the data capture unit, comprising:
Second obtains subelement, for executing preset migration code, to trigger from the source data table of source database, obtains Take the target data in current target source field to be migrated;
Then, the file call unit, comprising:
File calls subelement, for during executing the migration code, calling the migration code binding Editable configuration file obtains the field transitional information of user configuration from the editable configuration file.
Preferably, further includes:
Field acquiring unit, in the data capture unit from the source data table of source database, obtain currently to Before target data in the target source field of migration, source field set and destination field set are obtained, wherein the source word Source field in Duan Jihe is the field in the source data table in the source database that user specifies;The destination field set In destination field be field in the target database specified of user in purpose tables of data;
Receiving unit is configured, for receiving the field transitional information of user configuration;
Information memory cell, for storing the field transitional information into the specified configuration file.
Preferably, comprising:
Receiving subelement is configured, for receiving what user configured into the configuration file by preset specified interface The field transitional information.
It can be seen via above technical scheme that in data migration process, the current target to be migrated from source data table After getting target data in source field, the configuration file of user configuration can be called, and turn based on the field in configuration file Information is changed, is to meet the data format of the corresponding destination field in purpose tables of data by the Data Format Transform of target data, it is real The field transitional information according to user configuration is showed to realize Data Format Transform, and migrate to the data after conversion.And Due to all identical to the program code of the migration part of data in each transition process, changed is only in configuration file The field transitional information of configuration, thus user it is only necessary to configuration file carry out easy configuration, without writing a whole set of migration Code greatly reduces written in code amount, reduces the complexity of Data Migration, improves the efficiency of Data Migration.
Detailed description of the invention
Technical solution in ord to more clearly illustrate embodiments of the present application, below will be to required use in embodiment description Attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only embodiments herein, for this field For those of ordinary skill, without creative efforts, it can also be obtained according to the attached drawing of offer other attached Figure.
Fig. 1 shows a kind of flow diagram of tables of data moving method one embodiment of the application;
Fig. 2 shows a kind of flow diagrams of another embodiment of tables of data moving method of the application;
Fig. 3 shows a kind of structural schematic diagram of tables of data moving apparatus one embodiment of the application;
Fig. 4 shows a kind of structural schematic diagram of another embodiment of tables of data moving apparatus of the application.
Specific embodiment
The embodiment of the present application provides a kind of tables of data moving method and device, by providing general code migration journey Sequence, user only need to modify less configuration data, without rewriting migration code, reduce the data of written in code Amount, reduces the complexity of written in code.
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall in the protection scope of this application.
Present inventor is by carrying out research discovery to existing heterogeneous database transition process: due to isomeric data In the transition process of library, need to carry out field conversion, and field included in different source databases and purpose database is not It is identical, and the transformational relation between different field is not also identical, therefore, every time before migration, is required to move for this respectively The source database and purpose database of shifting develops corresponding code.And the code write every time be all by field transcode with Migrator code mixes, and therefore, writes code every time and requires copy migrator code, and search the migration one by one The code for the field conversion portion being related in program code, then modifies one by one, so that the complexity of written in code is high, Increase the complexity of heterogeneous database migration.
Inventor further study show that, if a set of general code can be provided, so that it is only necessary to simple by user Configuration data transformational relation can then greatly reduce the complexity that user writes code, improve data migration efficiency.
First below, a kind of tables of data moving method of the embodiment of the present application is introduced.
Referring to Fig. 1, it illustrates a kind of flow diagram of tables of data moving method one embodiment of the application, this implementations The method of example can be applied in any migration platform or computer, and the method for the present embodiment may include:
101, from the source data table of source database, obtain the target data in current target source field to be migrated.
Wherein, source data table refers to tables of data to be migrated, and the database where source data table is known as source database, and source Field in tables of data is known as source field.
For the ease of distinguishing, the embodiment of the present application is by source word belonging to target data to be migrated current in the source data table Section is known as target source field.
102, call the field transitional information of user configuration in configuration file.
Wherein, which includes the number of the corresponding relationship and source field between source field and destination field According to the transfer function between format and the data format of destination field.Wherein, which is to be received and stores transport number According to purpose data database in field in purpose tables of data.It then can be by the number of targets in source field based on the transfer function According to Data Format Transform at the data format for meeting corresponding destination field in purpose tables of data.
Wherein, the content in the configuration file can be edited by, and user, can be to this before carrying out Data Migration The transformational relation in source database and purpose database to be migrated in tables of data between field is configured in configuration file.Thus may be used See, the part that user modifies needed for migrating every time is only field transitional information in the configuration file, without to entirely moving Program is moved to modify.
103, it is based on the field transitional information, is that the target source field is corresponding by the Data Format Transform of the target data Data format in destination field.
After corresponding relationship in being configured with source data table and purpose tables of data in configuration file between field, it can determine Destination field corresponding to target source field belonging to target data out, and according to the target source field in configuration file and the mesh The Data Format Transform function between the corresponding destination field of source field is marked, which can be formatted, from And the target data in the target source field is converted to meet the corresponding destination field of target source field needed for data deposit Storage form.
What it is such as the phone field storage in source data table is json data, for example, [' 86 ', ' 0371 ', ' 654783 ']), Then the data after format transformation be wait store the data format in purpose tables of data in purpose phone field, such as: 86- 0371-654783。
104, the target data after change data format is migrated to corresponding with the source field in the purpose tables of data In destination field.
In the embodiment of the present application, in data migration process, from target source field to be migrated current in source data table After getting target data, the configuration file of user configuration can be called, and based on the field transitional information in configuration file, it will The Data Format Transform of target data is to meet the data format of the corresponding destination field in purpose tables of data, realize according to The field transitional information of family configuration migrates the data after conversion to realize Data Format Transform.And due to moving every time All identical to the program code of the migration part of data during shifting, changed is only the field configured in configuration file Transitional information, therefore user, without writing a whole set of migration code, subtracts significantly it is only necessary to carry out easy configuration to configuration file Lack written in code amount, reduced the complexity of Data Migration, improves the efficiency of Data Migration.
Simultaneously as user is it is only necessary to modify configuration file before migration every time, without complicated written in code, The general of migration code is realized, user greatly reduces it is only necessary to simply configure to can be carried out Data Migration to generation The technical requirements that code is write.
It should be noted that the target data after format transformation is migrated the corresponding destination field into the purpose database Target data after can be based on format transformation generates SQL statement, holds SQL statement for the target data and be written to the target In the target matrix of database.Certainly, the process for migrating the target data after format transformation can also be with existing arbitrary data The process of migrating data is similar in transition process, and details are not described herein.
It is understood that the corresponding relationship in the field transitional information of user configuration between source field and destination field can To be that source field and destination field correspond, it is also possible to a source field and corresponds to multiple destination fields or multiple sources Field corresponds to a destination field.Such as, include in source data table source field " name ", and in purpose tables of data include destination field " surname " and " name " then can establish the corresponding relationship of source field " name " Yu destination field " surname " and " name ", so that one A source field corresponds to two destination fields.
When a source field corresponds to multiple destination fields, the transfer function of configuration then includes by this source field and turning Transfer function needed for shifting to multiple destination fields corresponding with the source field, e.g., the still above source field " name " and the purpose For corresponding between field " surname " and destination field " name ", then transfer function can be the surname in the data of extraction source field, And surname is stored into the destination field " surname ", and the data except surname in the source field are stored to destination field " name " In.
The case where destination field corresponding for multiple source fields, which equally includes multiple source fields and one Transfer function between a destination field, specifically multiple destination fields corresponding with the source field of front one are similar.
It is understood that in practical applications, source data table can be specified in real time with purpose database table by user, It can be and be pre-configured in the configuration file.Optionally, configuration file can be called, determines user configuration in configuration file Source data table and purpose tables of data;Then, it from the source data table of source database, obtains in current target source field to be migrated Target data.It is understood that can also include the IP address of source database, source database and source data in configuration file The information such as the username and password of table.
Referring to fig. 2, it illustrates a kind of flow diagram of another embodiment of tables of data moving method of the application, this realities The method for applying example may include:
201, obtain source field set and destination field set.
Wherein, the field in the source data table in source database that the source field in the source field set is specified for user; Field in the target database that destination field in the destination field set is specified for user in purpose tables of data.
In the present embodiment, user can specify source database and purpose database, and then system obtains in source database Source field included in source data table, and the destination field for including in purpose tables of data in purpose database is obtained, with after an action of the bowels Continuous user establishes the corresponding relationship between source field and destination field.
202, receive the field transitional information of user configuration.
Wherein, the data format of the corresponding relationship between field transitional information source field and destination field and source field Transfer function between the data format of destination field.
It is understood that in practical applications, the corresponding pass between source field and destination field can be inputted by user System.It is also possible to after getting source field set and destination field set, output source set of fields and destination field set, so as to User establishes corresponding relationship between field by the modes such as clicking or choosing.
203, which is stored into specified configuration file.
It is understood that the specified configuration file is also possible to the configuration file of the required calling in transition process. Optionally, when the program code of transition process is migration code, then the configuration file is configuration bound in the migration code File.
It certainly, in practical applications, can also include the information of source database and purpose database in the configuration file, The IP address of such as source database.
204, from the source data table of source database, obtain the target data in current source field to be migrated.
205, call the field transitional information of user configuration in configuration file.
206, it is based on the field transitional information, is the corresponding purpose word of the source field by the Data Format Transform of target data The data format of section.
207, the target data after change data format is migrated into the aiming field of purpose tables of data.
The related introduction that step 204 may refer to preceding embodiment to 207, details are not described herein.
Optionally, in practical applications, preset interface can be set, and by preset specified interface, receive user to The field transitional information configured in configuration file.
It is understood that in the application any of the above one embodiment, can preset migration code, the migration code It is bundled with editable configuration file, it can be in the Data Migration other than data conversion relationship by the migration code General migration code.Then from the source data table of source database, the target data in current target source field to be migrated is obtained, It is specifically as follows:
Preset migration code is executed, to trigger from the source data table of source database, obtains current target to be migrated Target data in source field;
Then, the field transitional information for calling user configuration in configuration file, specifically includes:
During executing the migration code, the editable configuration file of migration code binding is called, can be compiled from this The field transitional information of user configuration is obtained in the configuration file collected.
It is understood that in the embodiment of one method of the application any of the above, after having invoked configuration file, It can also include being parsed to configuration file, to obtain the field transitional information configured in configuration file.
A kind of tables of data moving method of corresponding the embodiment of the present application, the embodiment of the present application also provides a kind of tables of data to move Moving device.
Referring to Fig. 3, it illustrates a kind of structural schematic diagram of tables of data moving apparatus one embodiment of the application, this implementations The device of example may include: data capture unit 301, file call unit 302, format conversion unit 303 and migration process list Member 304.
Wherein, data capture unit 301, for from the source data table of source database, obtaining current target to be migrated Target data in source field;
File call unit 302, for calling the field transitional information of user configuration in configuration file, the field conversion Information includes: the data format of the corresponding relationship and source field between source field and destination field and the data of destination field Transfer function between format, wherein destination field is the field in purpose tables of data;
Format conversion unit 303, for being based on the field transitional information, by the Data Format Transform of the target data For the data format of the corresponding destination field of the target source field;
Migration process unit 304, for migrating the target data after change data format to the purpose data In the corresponding destination field of target source field described in table.
In the embodiment of the present application, in data migration process, from target source field to be migrated current in source data table After getting target data, the configuration file of user configuration can be called, and based on the field transitional information in configuration file, it will The Data Format Transform of target data is to meet the data format of the corresponding destination field in purpose tables of data, realize according to The field transitional information of family configuration migrates the data after conversion to realize Data Format Transform.And due to moving every time All identical to the program code of the migration part of data during shifting, changed is only the field configured in configuration file Transitional information, therefore user, without writing a whole set of migration code, subtracts significantly it is only necessary to carry out easy configuration to configuration file Lack written in code amount, reduced the complexity of Data Migration, improves the efficiency of Data Migration.
Simultaneously as user is it is only necessary to modify configuration file before migration every time, without complicated written in code, The general of migration code is realized, user greatly reduces it is only necessary to simply configure to can be carried out Data Migration to generation The technical requirements that code is write.
Optionally, the data capture unit, comprising:
First obtains subelement, for calling the configuration file, the source number based on user configuration in the configuration file According to table and purpose tables of data, from the source data table of source database, the number of targets in current target source field to be migrated is obtained According to.
Optionally, in the embodiment of one device of any of the above, the data capture unit may include:
Second obtains subelement, for executing preset migration code, to trigger from the source data table of source database, obtains Take the target data in current target source field to be migrated;
Then, the file call unit may include:
File calls subelement, for during executing the migration code, calling the migration code binding Editable configuration file obtains the field transitional information of user configuration from the editable configuration file.
Referring to fig. 4, it illustrates a kind of structural representations of another embodiment of tables of data moving apparatus of the embodiment of the present application Figure, the device and preceding embodiment of the present embodiment the difference is that:
The device of the present embodiment is in addition to including: data capture unit 301, file call unit 302, format conversion unit 303 and migration process unit 304 except, further includes:
Field acquiring unit 305, it is current for from the source data table of source database, being obtained in the data capture unit Before target data in target source field to be migrated, source field set and destination field set are obtained, wherein the source Source field in set of fields is the field in the source data table in the source database that user specifies;The destination field collection Field in the target database that destination field in conjunction is specified for user in purpose tables of data.
Receiving unit 306 is configured, for receiving the field transitional information of user configuration.
Information memory cell 307, for storing the field transitional information into the specified configuration file.
It is understood that in the embodiment of the present application, data capture unit 301, file call unit 302, format turn The function of changing unit 303 and migration process unit 304 is identical as preceding embodiment introduction, and it is related real specifically to may refer to front Apply the introduction of example.
Further, in the present embodiment, which may include:
Receiving subelement is configured, for receiving what user configured into the configuration file by preset specified interface The field transitional information.
Each embodiment in this specification is described in a progressive manner, the highlights of each of the examples are with other The difference of embodiment, the same or similar parts in each embodiment may refer to each other.For device disclosed in embodiment For, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is said referring to method part It is bright.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered Think beyond the scope of this invention.
The foregoing description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, as defined herein General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, of the invention It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one The widest scope of cause.

Claims (8)

1. a kind of tables of data moving method characterized by comprising from the source data table of source database, obtain currently wait move Target data in the target source field of shifting;
The field transitional information of user configuration in configuration file is called, the field transitional information includes: source field and purpose word The transfer function between the data format of corresponding relationship and source field and the data format of destination field between section, wherein Destination field is the field in purpose tables of data;
Based on the field transitional information, it is corresponding that the data format of the target data is converted directly into the target source field Destination field data format;
The target data after change data format is migrated corresponding to target source field described in the purpose tables of data In destination field;
Wherein, in the source data table from source database, the target data in current target source field to be migrated, packet are obtained It includes:
Preset migration code is executed, to trigger from the source data table of source database, obtains current target source word to be migrated Target data in section;
Then, the field transitional information for calling user configuration in configuration file, comprising:
During executing the migration code, the editable configuration file of the migration code binding is called, from described The field transitional information of user configuration is obtained in editable configuration file.
2. the method according to claim 1, wherein being obtained current in the source data table from source database Target data in target source field to be migrated, comprising:
The configuration file is called, source data table and purpose tables of data based on user configuration in the configuration file, from source number According to the target data in the source data table in library, obtained in current target source field to be migrated.
3. method according to claim 1 or 2, which is characterized in that in the source data table from source database, obtain Before target data in current target source field to be migrated, further includes:
Obtain source field set and destination field set, wherein the source field in the source field set is what user specified The field in the source data table in source database;Destination field in the destination field set is the target that user specifies Field in database in purpose tables of data;
Receive the field transitional information of user configuration;
The field transitional information is stored into the specified configuration file.
4. according to the method described in claim 3, it is characterized in that, the field transitional information for receiving user configuration, comprising:
By preset specified interface, the field transitional information that user configures into the configuration file is received.
5. a kind of tables of data moving apparatus characterized by comprising
Data capture unit, for from the source data table of source database, obtaining the mesh in current target source field to be migrated Mark data;
File call unit, for calling the field transitional information of user configuration in configuration file, the field transitional information packet Include: the data format of the data format of corresponding relationship and source field between source field and destination field and destination field it Between transfer function, wherein destination field be purpose tables of data in field;
The data format of the target data is converted directly by format conversion unit for being based on the field transitional information The data format of the corresponding destination field of the target source field;
Migration process unit, for migrating the target data after change data format to described in the purpose tables of data In the corresponding destination field of target source field;
Wherein, the data capture unit, comprising:
Second obtains subelement, and for executing preset migration code, to trigger from the source data table of source database, acquisition is worked as Target data in preceding target source field to be migrated;
Then, the file call unit, comprising:
File calls subelement, for calling compiling for the migration code binding during executing the migration code The configuration file collected obtains the field transitional information of user configuration from the editable configuration file.
6. device according to claim 5, which is characterized in that the data capture unit, comprising:
First obtains subelement, for calling the configuration file, the source data table based on user configuration in the configuration file The target data in current target source field to be migrated is obtained from the source data table of source database with purpose tables of data.
7. device according to claim 5 or 6, which is characterized in that further include:
Field acquiring unit, it is current to be migrated for from the source data table of source database, being obtained in the data capture unit Target source field in target data before, obtain source field set and destination field set, wherein the source field collection Source field in conjunction is the field in the source data table in the source database that user specifies;In the destination field set Field in the target database that destination field is specified for user in purpose tables of data;
Receiving unit is configured, for receiving the field transitional information of user configuration;
Information memory cell, for storing the field transitional information into the specified configuration file.
8. device according to claim 7, which is characterized in that the configuration receiving unit, comprising:
Receiving subelement is configured, described in by preset specified interface, reception user configures into the configuration file Field transitional information.
CN201510570573.2A 2015-09-09 2015-09-09 A kind of tables of data moving method and device Active CN105205117B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510570573.2A CN105205117B (en) 2015-09-09 2015-09-09 A kind of tables of data moving method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510570573.2A CN105205117B (en) 2015-09-09 2015-09-09 A kind of tables of data moving method and device

Publications (2)

Publication Number Publication Date
CN105205117A CN105205117A (en) 2015-12-30
CN105205117B true CN105205117B (en) 2019-03-05

Family

ID=54952800

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510570573.2A Active CN105205117B (en) 2015-09-09 2015-09-09 A kind of tables of data moving method and device

Country Status (1)

Country Link
CN (1) CN105205117B (en)

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105373599B (en) * 2015-10-28 2017-05-31 北京汇商融通信息技术有限公司 Data mover system based on various data storing platforms
CN105701599B (en) * 2015-12-31 2020-02-14 中国石油天然气股份有限公司 Role characteristic comparison processing method
CN106021517A (en) * 2016-05-24 2016-10-12 乐视控股(北京)有限公司 Network data inputting method and device
CN106095940A (en) * 2016-06-14 2016-11-09 齐鲁工业大学 A kind of data migration method of task based access control load
WO2018023497A1 (en) * 2016-08-03 2018-02-08 深圳中兴力维技术有限公司 Data migration method and device
CN106326466A (en) * 2016-08-31 2017-01-11 天津南大通用数据技术股份有限公司 Method and device for data exchange between heterogeneous tables
CN106407306A (en) * 2016-08-31 2017-02-15 天津南大通用数据技术股份有限公司 Data persistence distribution method and device
CN106446064B (en) * 2016-09-05 2020-07-21 中国银行股份有限公司 Data conversion method and device
CN108197091B (en) * 2016-12-08 2022-12-09 腾讯科技(深圳)有限公司 Method, system and related equipment for creating data table
CN106815317A (en) * 2016-12-23 2017-06-09 中国银联股份有限公司 A kind of data copy method and system based on disparate databases
CN106777290A (en) * 2016-12-29 2017-05-31 中国建设银行股份有限公司 A kind of method and device for deriving data
CN107423334A (en) * 2017-04-24 2017-12-01 云宏信息科技股份有限公司 A kind of automatic data migration method and device for supporting multi-data source
CN107463409A (en) * 2017-08-11 2017-12-12 深圳乐信软件技术有限公司 A kind of interface conversion method, interface convertor, storage medium and electric terminal
CN107480225B (en) * 2017-09-11 2021-06-22 爱普(福建)科技有限公司 Method for realizing data sharing between control station and third-party database
CN109697199A (en) * 2017-10-24 2019-04-30 中移(苏州)软件技术有限公司 A kind of office automation OA searching method and equipment based on solr realization
CN107992559B (en) * 2017-11-28 2019-03-26 江苏中威科技软件系统有限公司 The data migration method of multi-data source
CN110019309A (en) * 2017-12-29 2019-07-16 北京小度信息科技有限公司 Data access method, device, electronic equipment and computer readable storage medium
CN110309174A (en) * 2018-03-02 2019-10-08 阿里巴巴集团控股有限公司 A kind of data query method, apparatus and server
CN108959430B (en) * 2018-06-11 2020-06-26 北京金山安全软件有限公司 Advertisement promotion data acquisition method, device and equipment
CN109002474A (en) * 2018-06-15 2018-12-14 北京信安世纪科技股份有限公司 A kind of data migration method and device
CN108933828A (en) * 2018-07-04 2018-12-04 中国银行股份有限公司 A kind of data synchronizer and method
CN109241026B (en) * 2018-07-18 2021-10-15 创新先进技术有限公司 Data management method, device and system
CN111062189A (en) * 2018-10-16 2020-04-24 鸿合科技股份有限公司 Data analysis method and device and electronic equipment
CN109564567B (en) * 2018-10-17 2023-07-25 北京算能科技有限公司 Data storage method, device, electronic equipment and computer readable storage medium
CN111367975B (en) * 2018-12-25 2023-11-03 中国移动通信集团浙江有限公司 Multi-protocol data conversion processing method and device
CN111797070A (en) * 2019-04-08 2020-10-20 杭州晨熹多媒体科技有限公司 Ticket data processing method and device
CN110222119B (en) * 2019-05-23 2021-08-31 武汉达梦数据库股份有限公司 Data conversion synchronization method, equipment and storage medium for heterogeneous database
CN110222117A (en) * 2019-05-23 2019-09-10 武汉达梦数据库有限公司 A kind of data conversion synchronous method, equipment and the storage medium of heterogeneous database
CN110334141B (en) * 2019-05-30 2023-11-21 平安科技(深圳)有限公司 Method, device, computer equipment and storage medium for data conversion
CN110471970B (en) * 2019-08-08 2023-04-18 紫光云技术有限公司 Flexible and configurable rule engine data forwarding method
CN112650799A (en) * 2019-10-12 2021-04-13 中国石油化工股份有限公司 Method and apparatus for analyzing seismic interpretation data text
CN111090640A (en) * 2019-11-13 2020-05-01 山东中磁视讯股份有限公司 ETL data cleaning method and system
CN111241182A (en) * 2020-01-19 2020-06-05 北京奇艺世纪科技有限公司 Data processing method and apparatus, storage medium, and electronic apparatus
CN111367895B (en) * 2020-03-31 2023-11-24 中国建设银行股份有限公司 Data migration method and device
CN111563366A (en) * 2020-04-29 2020-08-21 维沃移动通信有限公司 Document processing method and device and electronic equipment
CN112632176A (en) * 2020-12-31 2021-04-09 中国农业银行股份有限公司 Interaction method and device for supervising submission database
CN112783960A (en) * 2021-01-22 2021-05-11 北京澎思科技有限公司 Data processing system and method, electronic device, computer-readable storage medium
CN113190534A (en) * 2021-05-26 2021-07-30 中国工商银行股份有限公司 Database data migration method and device
CN113641652A (en) * 2021-08-09 2021-11-12 挂号网(杭州)科技有限公司 Data synchronization method, device and system and server
CN113656427B (en) * 2021-10-20 2022-02-08 腾讯科技(深圳)有限公司 Data synchronization method and related equipment
CN113901031A (en) * 2021-10-21 2022-01-07 掌阅科技股份有限公司 Database migration method, electronic device and storage medium
CN114661723A (en) * 2022-03-29 2022-06-24 杭州数梦工场科技有限公司 Data processing method and device and electronic equipment
CN116521652B (en) * 2023-07-03 2023-11-21 南方电网数字电网研究院有限公司 Method, system and medium for realizing migration of distributed heterogeneous database based on DataX

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101958987A (en) * 2009-07-14 2011-01-26 中国电信股份有限公司 Method and system for dynamically converting telecommunications service data
CN102004743A (en) * 2009-09-02 2011-04-06 中国银联股份有限公司 System and method for copying data among heterogeneous databases
CN102713888A (en) * 2009-10-28 2012-10-03 Cpa软件有限公司 Modular interface for database conversion
CN102999537A (en) * 2011-09-19 2013-03-27 阿里巴巴集团控股有限公司 System and method for data migration
CN104318481A (en) * 2014-05-04 2015-01-28 国家电网公司 Power-grid-operation-oriented holographic time scale measurement data extraction conversion method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101958987A (en) * 2009-07-14 2011-01-26 中国电信股份有限公司 Method and system for dynamically converting telecommunications service data
CN102004743A (en) * 2009-09-02 2011-04-06 中国银联股份有限公司 System and method for copying data among heterogeneous databases
CN102713888A (en) * 2009-10-28 2012-10-03 Cpa软件有限公司 Modular interface for database conversion
CN102999537A (en) * 2011-09-19 2013-03-27 阿里巴巴集团控股有限公司 System and method for data migration
CN104318481A (en) * 2014-05-04 2015-01-28 国家电网公司 Power-grid-operation-oriented holographic time scale measurement data extraction conversion method

Also Published As

Publication number Publication date
CN105205117A (en) 2015-12-30

Similar Documents

Publication Publication Date Title
CN105205117B (en) A kind of tables of data moving method and device
CN109992595A (en) Different database conversion method, apparatus, equipment and storage medium
CN104484216A (en) Method and device for generating service interface document and on-line test tool
JP2014520300A (en) Support for new insert stream (ISTREAM) operations in complex event processing (CEP)
CN102609255B (en) A kind of generation method of Spring IOC configuration file
CN104714858A (en) Data backup method, data recovery method and device
CA2901738C (en) Versatile data model
US20140156849A1 (en) Map-reduce workflow processing apparatus and method, and storage media storing the same
CN102566983B (en) Object based on Windows system pulls implementation method and system thereof
CN103827778B (en) Enterprise tools strengthen
CN105677561B (en) The multi-platform test method of mobile product and system
CN104598570B (en) The grasping means of resource and device
CN109634607A (en) A kind of method and device of Code automatic build
CN108377232A (en) A kind of multi-protocol communication method and device
CN108320136A (en) A kind of setting method and device of Electronic Signature
CN109241037A (en) A kind of method, apparatus that realizing database processing, equipment and storage medium
CN109933742A (en) Content of pages rearranges a volume method and device in a kind of process
CN105718468A (en) Method and device for building ODS layer of data warehouse
CN106446064A (en) Data conversion method and device
CN109669678A (en) Template engine integration method, device, electronic equipment and storage medium
CN104932982B (en) A kind of Compilation Method and relevant apparatus of message memory access
CN103092617A (en) High reliability workflow development method based on backup services
CN109815455A (en) Item file treating method and apparatus
Bartelt et al. Collaborative Creativity: From Hand Drawn Sketches to Formal Domain Specific Models and Back Again.
CN108984178A (en) A kind of communication means and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant