CN103440273B - A kind of data cross-platform migration method and device - Google Patents

A kind of data cross-platform migration method and device Download PDF

Info

Publication number
CN103440273B
CN103440273B CN201310338272.8A CN201310338272A CN103440273B CN 103440273 B CN103440273 B CN 103440273B CN 201310338272 A CN201310338272 A CN 201310338272A CN 103440273 B CN103440273 B CN 103440273B
Authority
CN
China
Prior art keywords
data
database
private
information
key
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201310338272.8A
Other languages
Chinese (zh)
Other versions
CN103440273A (en
Inventor
李睿
吕江花
马世龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beihang University
Original Assignee
Beihang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihang University filed Critical Beihang University
Priority to CN201310338272.8A priority Critical patent/CN103440273B/en
Publication of CN103440273A publication Critical patent/CN103440273A/en
Application granted granted Critical
Publication of CN103440273B publication Critical patent/CN103440273B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention is a kind of data cross-platform migration method and device, in order to the Data Migration between disparate databases system. Device comprises SDI module, target data information module, modular converter, SQLEngine, packet encapsulation, transmission and parsing module, and SQL statement Executive Module. By SDI module and target data information module, the information of the information of source data platform and target data platform is described, obtain table from source database and generate Table object, according to the XML file of the mapping relations of field between descriptive data base, Table object is carried out format conversion by modular converter, SQLEngine is by the information architecture SQL statement after changing, and SQL statement is encapsulated, be transferred to the platform that target database is positioned at, target platform performs SQL statement, complete Data Migration. Present invention achieves level and smooth, the lossless migration of data between heterogeneous platform disparate databases.

Description

A kind of data cross-platform migration method and device
Technical field
The invention belongs to the cross-platform migration of application software field, especially a kind of data cross-platform migration method and device.
Background technology
Data Migration refer to by the data in database and all list structure thereof, table and storing process (major key, external key,Index etc.) etc. move on another database server, and can move completely, another database server can be fortuneRow is on different machines, and can be to operate in different operating system, also can be another data base management system. Send outThe reason of raw Data Migration has a variety of, or because the application system that it supports has moved on another platform, orBecause existing Database Systems need to be upgraded to higher version, also or because the platform at data place need to carry out hardware,The upgrading of a series of basic softwares such as operating system, etc. such reason. Whole transition process can relate to many stepsAnd factor. Data migration method has extraction/change/load, copy and manual script etc., but these methods are faced with some problems,When one side data volume is increasing, and the downtime allowing on the other hand is when reducing, and this work will become especially complicated.
Bloor research institute lists following statistics in " global metadata migration in the 2000 " report of issuing in September, 2007:
16% data migration portion project achieves successfully
37% budget overruns
64% does not complete on time
Data Migration, not a duck soup will be carried out as can be seen here. This is because the technical tactic that Database Systems production firm takesWith select technology path different, for market competition etc. reason, the development & application of disparate databases system the utilization of resources,There is larger difference in table structure, library structure etc. everyway. The difficult point that may face in data migration process has:
(1) the character set difference supported of disparate databases system, the modal problem that migration occurs is Confused-code;
(2) the unique function of Database Systems self and technology is can not be identified by other Database Systems;
(3) in different Database Systems, different to definition and the processing method of field, event, operation etc., thus causeIn the identification of partial content with resolve and have conflict;
How complete, to realize the needs solution that Data Migration is a pendulum personage in the field of business exactly difficult problem.
Summary of the invention
For realizing Data Migration problems faced at present, the present invention proposes a kind of data cross-platform migration method and device,Without under the prerequisite of any intermediate storage process, realize almost nondestructively Data Migration.
Data cross-platform migration method provided by the invention, comprises the steps:
Step 1: be a SrcDatabase object by the information creating of source data platform;
Step 2: be a DesDatabase object by the information creating of target data platform;
Step 3: call execute method, completes whole transition process;
SrcDatabase object and the DesDatabase object set up, all comprise following information: type of database, databaseIP address, database side slogan, user name, password and the database-name of place main frame;
Described execute method, comprises the steps:
Step 3.1: obtained a tables of data from source database end by SrcDatabase object is extracted data structure from tables of dataBuild corresponding Table object; The information that Table object comprises has: the structural information of the schema name of table, table name, all fields of table,All index information in the foreign key information that comprises in the major key information that comprises in table, table and table;
Step 3.2: according to the mapping relations of field between source database and target database, Table object is converted to number of targetsAccording to the table in storehouse;
Step 3.3: the information after conversion is passed to SQL statement and build engine SQLEngine, according to encapsulate target dataThe DesDatabase object of library information, builds corresponding SQL statement;
Step 3.4: SQL statement is packaged into packet, passes to the platform that target database is positioned at;
Step 3.5: perform SQL statement on target platform, the data of source database are inserted in target database, completed numberAccording to migration.
Data cross-platform moving apparatus provided by the invention, comprises following part: SDI module, number of targets it is believed thatBreath module, modular converter, SQLEngine, packet encapsulation, transmission and parsing module, and SQL statement Executive Module.
It is a SrcDatabase object by the information creating of source data platform that SDI module is used for; Described number of targets it is believed thatIt is a DesDatabase object by the information creating of target data platform that breath module is used for. Described SrcDatabase object andDesDatabase object, all comprises following information: type of database, the IP address of database place main frame, database portNumber, user name, password and database-name.
Modular converter, for obtaining a tables of data according to SrcDatabase object from source database, extracts data structure from tables of dataBuild corresponding Table object, then according to DesDatabase object, utilize the mapping of field between source database and target databaseRelation, is converted to the table that meets target data library format by Table object.
SQLEngine, for according to DesDatabase object, builds corresponding SQL statement.
Packet encapsulation, transmission and parsing module for the SQL statement of structure is packaged into packet, and transfer to target dataThe platform at place, storehouse, and on platform at target database place to data Packet analyzing, the SQL statement that parsing obtains is givenSQL statement Executive Module.
SQL statement Executive Module is used for performing SQL statement, and the data of source database are inserted in target database.
Data cross-platform migration method of the present invention and device, its advantage and good effect are:
(1) mapping relations between XML stored data base system field, make full use of the cross-platform characteristic of XML file,Make data cross-platform moving apparatus that the restriction of operating system and software platform need not be subject to;
(2) storage of XML adopts hashmap, is easy to expansion;
(3) without the need to any intermediate storage process, save the storage resources of system, reduce the difficulty of Data Migration;
(4) upwards shield the otherness between source database system and target database system, achieve one-touch migration;
(5) adopt custom-designed transmission packet, be simply easy to resolve irredundant information, improve the efficiency of migration further.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of data cross-platform migration method of the present invention;
Fig. 2 is the flow chart of the execute method that uses in data cross-platform migration method of the present invention;
Fig. 3 adopts HashMap to store the exemplary plot of the XML file of mapping relations between descriptive data base field;
Fig. 4 is by the schematic diagram of the packet that SQL statement is packaged into;
Fig. 5 is the structural representation of data cross-platform moving apparatus of the present invention;
Fig. 6 is the information description figure of source database and target database in the embodiment of the present invention;
Fig. 7 is the schematic diagram of the table of source database in the embodiment of the present invention;
Fig. 8 is the schematic diagram of table equipment in target database in the embodiment of the present invention;
Fig. 9 is the structural representation of table asset in source database in the embodiment of the present invention;
Figure 10 is the schematic diagram of the index information of the shown table of Fig. 9;
Figure 11 is the structural representation that migrates to table asset in target database MySQL;
Figure 12 is the structural representation of table users in source database in the embodiment of the present invention;
Figure 13 is the structural representation of table users after migrating to target database MySQL;
Figure 14 is the schematic diagram data of table asset in source database in the embodiment of the present invention;
Figure 15 is the schematic diagram data of table asset after migrating to target database MySQL;
Figure 16 is the schematic diagram data of table users in source database in the embodiment of the present invention;
Figure 17 is the schematic diagram data of table users after migrating to target database MySQL.
Detailed description of the invention
Below in conjunction with drawings and Examples, the present invention is described in further detail.
A kind of data cross-platform migration method provided by the invention and device, in order to will be arranged in Database Systems on a certain platformData Migration is in the Database Systems on another heterogeneous platform. The technology used in the present invention is mainly: by source data platformInformation creating be a SrcDatabase object, be a DesDatabase object by the information creating of target data platform,Then call execute method and complete whole transition process. The concrete execution flow process of execute method is, first passes through to obtainSrcDatabase object obtains a Table object from source database end, is passed to conversion (Transfer) module and carries out phaseThe format conversion of answering, then the information after conversion is passed to SQL (Structured Query Language, SQL)Sentence builder engine SQLEngine, according to the DesDatabase object of the information that encapsulates target database, builds correspondingSQL statement, and SQL statement is packaged into packet, passes to the platform that target database is positioned at, flat in target afterwardsPlatform performs SQL statement, complete Data Migration. Whether the process of whole Data Migration is (to comprise according to base table structure and beEmpty, default value), the order of index, major key, automatic increase, data message moves. Treat that all tables of data have been movedCheng Hou, then the migration of carrying out external key. The present invention is for solving integrality and the standard of Data Migration in the cross-platform migration of application softwareReally the technical problem of property, achieves level and smooth, the lossless migration of data between heterogeneous platform disparate databases
As shown in Figure 1, be data cross-platform migration method provided by the invention, comprise following three steps:
Step 1: be a SrcDatabase object by the information creating of source data platform;
Step 2: be a DesDatabase object by the information creating of target data platform;
Step 3: call execute method, completes whole transition process.
The information that the SrcDatabase object set up and DesDatabase object comprise has: type of database, database placeThe information such as the IP address of main frame, database side slogan, user name, password, database-name.
As shown in Figure 2, be the implementation of execute method, comprise the steps:
Step 3.1: obtained a tables of data from source database end by SrcDatabase object is extracted data structure from tables of dataBuild corresponding Table object.
The information that Table object comprises has: the master who comprises in the structural information of the schema name of table, table name, all fields of table, tableAll index information in the foreign key information that comprises and table in key information, table.
Table schema name schemaName, for private(privately owned) variable, data type is String(character types).
Table name tableName is private variable, String data type.
Showing the structural information columnList of all fields, is private variable, with array ArrayList<Column>record each wordSection. The structural information of field is as shown in table 1:
The structural information of table 1 field
Title Access rights Data type Describe
colName private String The title of field
dataType private int The value of Types in the JDBC that the data type of field is corresponding
typeName private String The title of data type in field data storehouse
colSize private int Field size, corresponding precision during decimal, corresponding length during character
decimalDigits private int Field represents decimal digits when being decimal, otherwise is 0
nullable private boolean Whether field allows for sky
colDef private String The default value of field
autoincrement private boolean Whether automatic increase of field
Int is integer, and boolean is Boolean type. JDBC(Java Data Base Connectivity, java DataBase combining)A kind of for performing the Java API of SQL statement.
The major key information pk comprising in table, being private variable, is major key PrimaryKey. Major key attribute description asShown in table 2, ArrayList<String>represent the other list structure that a parameter is character types.
Table 2 major key attribute information
The foreign key information fk comprising in table is private variable, is the major key PrimaryKey of other table. The genus of external keyProperty describes as shown in table 3:
Table 3 external key attribute information
Title Access rights Data type Describe
pkTableSchema private String The schema name of the major key place table of foreign key reference
pkTableName private String The table name of the major key place table of foreign key reference claims
pkColNames private ArrayList<String> The title of the major key composition row of foreign key reference
pkName private String The major key title of foreign key reference
fkTableSchema private String The schema name of external key place table
fkTableName private String The table name of external key place table
fkColNames private String The title of external key composition row
fkName private String The title of external key
updataRule private short Operation when major key upgrades
deleteRule private short Operation when major key is deleted
Short represents the data type of short.
All index information indexList in table is private variable, with array ArrayList<Index>carry out recording indexes letterBreath. The description of index attributes is as shown in table 4.
Table 4 index attributes describes
Step 3.2: the Table object of acquisition is carried out to corresponding format conversion; Concrete format conversion method is: according to source dataThe mapping relations of field between storehouse and target database, are converted to the table of target database by Table object.
Between source database and target database, the mapping relations XML file of field describes, and XML file is stored in data knotIn structure Hashmap.
As shown in Figure 3, adopt HashMap to store and describe the XML file of mapping relations, each XML file only forThe mapping relations of field between two certain database are described. HashMap has property value KEY and VALUE, in KEY valueWhat store is character string, and for identifying two databases that carry out field mappings, the value of for example KEY is DB2TOOracle,Representing two databases that carry out field mappings is DB2 and Oracle. The storage of VALUE value be the preservation position of XML file.
Wherein frequently-used data storehouse system IBM DB2, Oracle, Sybase, SQL Server, Informix and IBM ContentThe conventional field mapping table of Manager is as follows:
The mapping relations of the field of every two kinds of databases with described by an XML file, when Table object is changed,First, from HashMap, corresponding XML file is found according to the character string of identification database, then, according to XMLFile, is converted to the field corresponding to target database by the field in Table, finally obtains the table of target database. Work as needWhen adding the field corresponding relation of new database, with the corresponding relation of XML file description field, and in HashMapAdd corresponding KEY and VALUE value.
Step 3.3: the information after conversion is passed to SQLEngine, according to the information that encapsulates target databaseDesDatabase object, builds corresponding SQL statement; SQLEngine can generate for specific database correspondingSQL statement. The data of source database are inserted in target database for realizing by the SQL statement generating, and comprise insert languageSentence, create statement, update statement etc.
Step 3.4: SQL statement is packaged into packet, passes to the platform that target database is positioned at.
As shown in Figure 4, be the structure of the packet encapsulating, the packet of use is made up of data packet head and data volume, eliminatesPacket tail, so simplification not only allows the structure of whole packet seem more simple, and meanwhile, the flow that transmission needs is less,The more summary of work of encapsulation/parsing, coding is realized also simpler.
Data packet head is the description of whole packet, comprises the bag beginning flag of 4 bytes, the protocol version of 4 bytes, 2The bag size of individual byte, CRC (Cyclic Redundancy Check, the CRC) identifying code of 4 bytes. Data bodyDivide then for the SQL statement of target database place platform need to be transferred to.
Step 3.5: perform SQL statement on target platform, the data of source database are inserted in target database, completed numberAccording to migration.
The process of whole Data Migration, be according to base table structure (whether comprise is empty, default value), index, major key, automaticallyThe order of growth, data message is moved. After all tables of data have been moved, then carry out the migration of external key.
As shown in Figure 5, be the structural representation of data cross-platform moving apparatus provided by the invention. Data cross-platform moving apparatusComprise as lower module: SDI module 1, target data information module 2, modular converter 3, SQLEngine4, packetEncapsulation, transmission and parsing module 5 and SQL statement Executive Module 6.
SDI module 1, also referred to as SrcDatabase module, for being created as the relevant information of source data platformSrcDatabase object.
Target data information module 2, also becomes DesDatabase module, for the relevant information of target data platform is created asDesDatabase object.
The information that SrcDatabase object and DesDatabase object comprise has: the IP of type of database, database place main frameThe information such as address, database side slogan, user name, password and database-name.
Modular converter 3, also becomes Transfer module, for obtaining data according to SrcDatabase object from source databaseTable extracts Table object corresponding to data construct from tables of data, then according to DesDatabase object, utilize source database withThe mapping relations of field between target database, are converted to the table that meets target data library format by Table object.
SQLEngine4 is an engine, for according to DesDatabase object, generates corresponding SQL statement.
Packet encapsulation, transmission and parsing module 5 for the SQL statement of structure is packaged into packet, and transfer to number of targetsAccording to the platform at system place, storehouse, and on platform at target database place, packet is resolved, finally parsing is obtainedSQL statement is given SQL statement Executive Module 6.
The data of source database, for the execution of SQL statement, are inserted in target database by SQL statement Executive Module 6.
The effect of data cross-platform migration method of the present invention and device is described below by running example.
As shown in Figure 6, for Data Migration arranges interface schematic diagram. Running example with data from be positioned at Windows operating system itOn SQL server2008(source database) migrate to the MySQL(target database being positioned on (SuSE) Linux OS)For example, the migration of setting arranges interface, for the information in source database and destination data storehouse is set, as shown below. Click and " openThe migration of beginning " after button, start the migration of source database being carried out to data, index, table and list structure.
Next, correctness and the integrality of Data Migration is verified.
Several tables in original SQL server2008 database equipment database, each table all has major key, field automaticThe attributes such as growth, data in form, index information.
(1) table: the table that is illustrated in figure 7 source database. By Data Migration in MySQL, database equipment'sTable as shown in Figure 8.
(2) list structure:
The list structure of asset in source database, as shown in Figure 9. Shown in Figure 10 of index information institute in asset table, index is assetname。
Migrate to the list structure of asset table in MySQL, as shown in figure 11. MUL in the key attribute of assetname in Figure 11Be the index information of this table.
The list structure of users in source database, as shown in figure 12.
After migrating to MySQL, the list structure of users table as shown in figure 13.
(3) data in table:
In source database, in asset form, data as shown in figure 14.
Migrate in MySQL in asset table data as shown in figure 15.
In source database Users form data as shown in figure 16.
After migrating to MySQL, in Users table, data are as shown in figure 17.
Result shows:
(1) adopt technical scheme of the present invention, according to database table field, corresponding field conversion can be carried out automatically, thusThe conflict that avoids factor data bank field difference and may cause;
(2) by the content in same table in contrast source database and target database, demonstrate well data of the present invention acrossPlatform migration method and device possess integrality and accuracy in data migration process;
(3) data cross-platform migration method of the present invention and device can automatically, the quantity of the table in identification database effectively,And move accordingly respectively;
(4) data cross-platform migration method of the present invention and device can in a network environment, without the need to intermediate storage processes, realizeThe level and smooth lossless migration of data between heterogeneous platform disparate databases.

Claims (4)

1. a data cross-platform migration method, is characterized in that, comprises the steps:
Step 1: be a SrcDatabase object by the information creating of source data platform;
Step 2: be a DesDatabase object by the information creating of target data platform;
Step 3: call execute method, completes whole transition process;
SrcDatabase object and the DesDatabase object set up, all comprise following information: type of database, databaseIP address, database side slogan, user name, password and the database-name of place main frame;
Described execute method, comprises the steps:
Step 3.1: obtained a tables of data from source database end by SrcDatabase object is extracted data structure from tables of dataBuild corresponding Table object; The information that Table object comprises has: the structural information of the schema name of table, table name, all fields of table,All index information in the foreign key information that comprises in the major key information that comprises in table, table and table;
Step 3.2: according to the mapping relations of field between source database and target database, Table object is converted to number of targetsAccording to the table in storehouse;
The mapping relations of field between described source database and target database, adopt XML file to describe, XML file is depositedStorage is in data structure Hashmap, and HashMap has two property value: KEY and VALUE; The character string of KEY storage,For two databases of identification field mapping; VALUE storage be the preservation position of XML file;
The mapping relations of the field of every two kinds of databases with described by an XML file, when Table object is changed,First, from HashMap, corresponding XML file is found according to the character string of identification database, then, according to XMLFile, is converted to the field corresponding to target database by the field in Table, finally obtains the table of target database; Work as needWhen adding the field corresponding relation of new database, with the corresponding relation of XML file description field, and in HashMapAdd corresponding KEY and VALUE value;
Step 3.3: the information after conversion is passed to SQL statement and build engine SQLEngine, according to encapsulate target dataThe DesDatabase object of library information, builds corresponding SQL statement;
Step 3.4: SQL statement is packaged into packet, passes to the platform that target database is positioned at;
Step 3.5: perform SQL statement on target platform, the data of source database are inserted in target database, completed numberAccording to migration;
Described Table object, the structural information of wherein showing all fields comprises following information:
Private represents private variable, and String is character types, and int is integer, and boolean is Boolean type; JDBC representsJava DataBase combining;
The major key information comprising in table is private variable, is major key PrimaryKey; Major key attribute comprises following information:
ArrayList<String>to represent a parameter be character types other list structure;
The foreign key information comprising in table is private variable, and the attribute of external key comprises following information:
Title Access rights Data type Describe pkTableSchema private String The schema name of the major key place table of foreign key reference pkTableName private String The table name of the major key place table of foreign key reference claims pkColNames private ArrayList<String> The title of the major key composition row of foreign key reference pkName private String The major key title of foreign key reference fkTableSchema private String The schema name of external key place table fkTableName private String The table name of external key place table fkColNames private String The title of external key composition row fkName private String The title of external key updataRule private short Operation when major key upgrades deleteRule private short Operation when major key is deleted
Short represents the data type of short;
In table, all index informations are private variable, with array ArrayList<Index>carry out recording indexes information, index belongs toProperty comprises following information:
ASC is that ascending order arranges, and DESC is descending.
2. data cross-platform migration method according to claim 1, is characterized in that, described in step 3.4 by SQLThe packet that statement is packaged into, is made up of data packet head and data volume; Data packet head comprises the bag beginning flag of 4 bytes, 4The protocol version of individual byte, the bag size of 2 bytes, and the cyclic redundancy identifying code of 4 bytes; Data volume is for needingBe transferred to the SQL statement of target database place platform.
3. a data cross-platform moving apparatus, is characterized in that, comprises as lower module: SDI module, target dataInformation module, modular converter, SQLEngine, packet encapsulation, transmission and parsing module, and SQL statement Executive Module;
It is a SrcDatabase object by the information creating of source data platform that described SDI module is used for; Described number of targetsBeing used for according to information module is a DesDatabase object by the information creating of target data platform; Described SrcDatabase coupleResemble and DesDatabase object, all comprise following information: IP address, the database of type of database, database place main framePort numbers, user name, password and database-name;
Described modular converter, for obtaining a tables of data according to SrcDatabase object from source database, extracts number from tables of dataAccording to building corresponding Table object, then according to DesDatabase object, utilize field between source database and target databaseMapping relations, are converted to the table that meets target data library format by Table object;
The information that described Table object comprises has: institute in the structural information of the schema name of table, table name, all fields of table, tableAll index information in the foreign key information that comprises in the major key information that comprises, table and table;
The structural information of wherein showing all fields comprises following information:
Title Access rights Data type Describe colName private String The title of field dataType private int The value of Types in the JDBC that the data type of field is corresponding typeName private String The title of data type in field data storehouse colSize private int Field size, corresponding precision during decimal, corresponding length during character decimalDigits private int Field represents decimal digits when being decimal, otherwise is 0 nullable private boolean Whether field allows for sky colDef private String The default value of field autoincrement private boolean Whether automatic increase of field
Private represents private variable, and String is character types, and int is integer, and boolean is Boolean type; JDBC representsJava DataBase combining;
The major key information comprising in table is private variable, is major key PrimaryKey; Major key attribute comprises following information:
ArrayList<String>to represent a parameter be character types other list structure;
The foreign key information comprising in table is private variable, and the attribute of external key comprises following information:
Title Access rights Data type Describe pkTableSchema private String The schema name of the major key place table of foreign key reference pkTableName private String The table name of the major key place table of foreign key reference claims pkColNames private ArrayList<String> The title of the major key composition row of foreign key reference pkName private String The major key title of foreign key reference fkTableSchema private String The schema name of external key place table fkTableName private String The table name of external key place table fkColNames private String The title of external key composition row fkName private String The title of external key updataRule private short Operation when major key upgrades deleteRule private short Operation when major key is deleted
Short represents the data type of short;
In table, all index informations are private variable, with array ArrayList<Index>carry out recording indexes information, index belongs toProperty comprises following information:
ASC is that ascending order arranges, and DESC is descending;
The mapping relations of field between the source database that described modular converter utilizes and target database, adopt XML fileDescribe, XML file is stored in data structure Hashmap, and HashMap has two property value: KEY and VALUE;The character string of KEY storage, for two databases of identification field mapping; VALUE storage be the preservation position of XML filePut; The mapping relations of the field of every two kinds of databases with described by an XML file, when Table object is changed,First, from HashMap, corresponding XML file is found according to the character string of identification database, then, according to XMLFile, is converted to the field corresponding to target database by the field in Table, finally obtains the table of target database; Work as needWhen adding the field corresponding relation of new database, with the corresponding relation of XML file description field, and in HashMapAdd corresponding KEY and VALUE value;
Described SQLEngine, for according to DesDatabase object, builds corresponding SQL statement;
Described packet encapsulation, transmission and parsing module for the SQL statement of structure is packaged into packet, and transfer to targetThe platform at database place, and on platform at target database place to data Packet analyzing, the SQL statement that parsing obtains is handed overGive SQL statement Executive Module;
Described SQL statement Executive Module is used for performing SQL statement, and the data of source database are inserted in target database.
4. data cross-platform moving apparatus according to claim 3, is characterized in that, described packet encapsulation, transmissionAnd parsing module packet that SQL statement is packaged into, is made up of data packet head and data volume; Data packet head comprises 4 bytesBag beginning flag, the protocol version of 4 bytes, the bag size of 2 bytes, and the cyclic redundancy identifying code of 4 bytes;Data volume is the SQL statement that target database place platform need to be transferred to.
CN201310338272.8A 2013-08-06 2013-08-06 A kind of data cross-platform migration method and device Expired - Fee Related CN103440273B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310338272.8A CN103440273B (en) 2013-08-06 2013-08-06 A kind of data cross-platform migration method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310338272.8A CN103440273B (en) 2013-08-06 2013-08-06 A kind of data cross-platform migration method and device

Publications (2)

Publication Number Publication Date
CN103440273A CN103440273A (en) 2013-12-11
CN103440273B true CN103440273B (en) 2016-08-24

Family

ID=49693965

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310338272.8A Expired - Fee Related CN103440273B (en) 2013-08-06 2013-08-06 A kind of data cross-platform migration method and device

Country Status (1)

Country Link
CN (1) CN103440273B (en)

Families Citing this family (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104834635A (en) * 2014-02-07 2015-08-12 中国移动通信集团广东有限公司 Data processing method and device
CN104915341B (en) * 2014-03-10 2018-06-26 中国科学院沈阳自动化研究所 Visualize multiple database ETL integrated approaches and system
CN105786932B (en) * 2014-12-26 2020-03-27 北大医疗信息技术有限公司 Query method and query device for clinical business in medical system
CN104573122B (en) * 2015-02-09 2017-10-13 浪潮电子信息产业股份有限公司 Oracle database migration tool for migrating from AIX platform to K-UX platform
CN104699799A (en) * 2015-03-19 2015-06-10 神华集团有限责任公司 Data transmission method based on cross system
CN106156656B (en) * 2015-04-02 2021-03-16 腾讯科技(深圳)有限公司 Cross-system implementation method of data platform and data platform
CN105373599B (en) * 2015-10-28 2017-05-31 北京汇商融通信息技术有限公司 Data mover system based on various data storing platforms
CN106649378B (en) * 2015-11-02 2020-07-14 北大方正集团有限公司 Data synchronization method and device
CN105446809B (en) * 2015-11-30 2019-01-25 中国建设银行股份有限公司 Platform migration method and device
CN105677738A (en) * 2015-12-28 2016-06-15 国云科技股份有限公司 Universal method for migrating heterogeneous relational database
CN106970921B (en) * 2016-01-14 2020-10-16 阿里巴巴集团控股有限公司 Data migration method and device
CN105808675B (en) * 2016-03-01 2020-04-28 万达信息股份有限公司 Method for migrating from Informix database to Renminburgh database
CN105740462A (en) * 2016-03-02 2016-07-06 上海新炬网络信息技术有限公司 Method for supporting data migration between different environments
CN105956191B (en) * 2016-06-13 2019-12-31 苏州浪潮智能科技有限公司 Data migration method and system
CN106326466A (en) * 2016-08-31 2017-01-11 天津南大通用数据技术股份有限公司 Method and device for data exchange between heterogeneous tables
CN108241618B (en) * 2016-12-23 2022-05-17 航天信息股份有限公司 Database migration method and device and service program migration method and device
CN106599322A (en) * 2017-01-03 2017-04-26 北京网智天元科技股份有限公司 Data desensitization method and device
CN106980679A (en) * 2017-03-30 2017-07-25 广东电网有限责任公司信息中心 A kind of information system Domestic Database migration remodeling method and device
CN107704568B (en) * 2017-09-29 2019-03-26 马上消费金融股份有限公司 A kind of method and device of test data addition
CN110069489B (en) * 2017-10-17 2023-01-31 株式会社日立制作所 Information processing method, device and equipment and computer readable storage medium
CN107729570B (en) * 2017-11-20 2021-06-08 北京百度网讯科技有限公司 Data migration method and device for server
CN107967316A (en) * 2017-11-22 2018-04-27 平安科技(深圳)有限公司 A kind of method of data synchronization, equipment and computer-readable recording medium
CN107992559B (en) * 2017-11-28 2019-03-26 江苏中威科技软件系统有限公司 The data migration method of multi-data source
CN107958057B (en) * 2017-11-29 2022-04-05 苏宁易购集团股份有限公司 Code generation method and device for data migration in heterogeneous database
CN108133007A (en) * 2017-12-22 2018-06-08 北京明朝万达科技股份有限公司 A kind of method of data synchronization and system
CN108491364A (en) * 2018-01-25 2018-09-04 苏州麦迪斯顿医疗科技股份有限公司 Medical treatment and nursing paperwork management system
CN108614869A (en) * 2018-04-17 2018-10-02 国家电网公司 A kind of method of historical data in different automation system platform synchronous migrations
CN108629035B (en) * 2018-05-10 2022-05-27 福建星瑞格软件有限公司 JDBC agent-based heterogeneous database application migration method
CN109002474A (en) * 2018-06-15 2018-12-14 北京信安世纪科技股份有限公司 A kind of data migration method and device
CN108829867A (en) * 2018-06-22 2018-11-16 深圳云之家网络有限公司 A kind of intelligent acquisition method and system of big data
CN110659255A (en) * 2018-06-28 2020-01-07 武汉斗鱼网络科技有限公司 Data migration method, device and system and storage medium
CN110740291A (en) * 2018-07-20 2020-01-31 视联动力信息技术股份有限公司 synchronization method and device based on video networking monitoring data
CN109299068A (en) * 2018-08-31 2019-02-01 安徽四创电子股份有限公司 From relevant database to the data flow migration method of HBase database
CN109284281A (en) * 2018-09-10 2019-01-29 北京百度网讯科技有限公司 Method and apparatus for migrating data
CN111382140B (en) * 2018-12-29 2023-06-16 方正国际软件(北京)有限公司 Database sequence migration method and electronic equipment
CN111797070A (en) * 2019-04-08 2020-10-20 杭州晨熹多媒体科技有限公司 Ticket data processing method and device
CN110275914A (en) * 2019-04-26 2019-09-24 武汉众邦银行股份有限公司 Data migration method, device and the storage medium of integration across database
CN110297825B (en) * 2019-05-23 2024-06-11 中国平安人寿保险股份有限公司 Data processing method, device, computer equipment and storage medium
CN110489469B (en) * 2019-07-12 2023-12-08 中国平安人寿保险股份有限公司 Data transmission method, device, computer equipment and storage medium
CN110688378B (en) * 2019-09-06 2024-05-24 中国平安财产保险股份有限公司 Migration method and system for database storage process
CN110609826A (en) * 2019-09-20 2019-12-24 四川长虹电器股份有限公司 Data extraction method
CN110674113A (en) * 2019-09-24 2020-01-10 咪咕音乐有限公司 One-key migration method and device for data, electronic equipment and storage medium
CN110825800A (en) * 2019-11-02 2020-02-21 国网甘肃省电力公司信息通信公司 Automatic transmission and verification method for service data in multipoint heterogeneous environment
CN110990482A (en) * 2019-11-11 2020-04-10 中国建设银行股份有限公司 Data synchronization method and device between asynchronous databases
CN111090638B (en) * 2019-12-25 2023-07-04 中国工商银行股份有限公司 Comparison method and device for transaction functions in database migration
CN113127259B (en) * 2019-12-30 2024-03-12 北京懿医云科技有限公司 Data deployment method, device, equipment and storage medium
CN111367894B (en) * 2020-03-31 2023-08-18 中国工商银行股份有限公司 Data comparison method and device based on database migration
CN111680024A (en) * 2020-06-11 2020-09-18 北京计算机技术及应用研究所 Universal heterogeneous database data migration method
CN112035461B (en) * 2020-06-17 2024-05-10 深圳市法本信息技术股份有限公司 Method and system for migrating table data files of database
CN112328680B (en) * 2020-11-03 2023-06-06 大唐智联科技(杭州)有限公司 Electronic component data processing method, data interface and management system
CN112527815A (en) * 2020-12-02 2021-03-19 平安医疗健康管理股份有限公司 Script migration method and device for database, computer equipment and storage medium
CN112632050B (en) * 2020-12-24 2023-09-05 安徽航天信息科技有限公司 Data quality inspection method, device and storage medium for cross-platform synchronous data
CN112632177A (en) * 2020-12-31 2021-04-09 中国农业银行股份有限公司 Data loading operation generation method
CN112749151A (en) * 2021-01-13 2021-05-04 叮当快药科技集团有限公司 Data migration method and device among different types of databases and storage medium
CN112799859B (en) * 2021-01-26 2021-09-07 奇秦科技(北京)股份有限公司 Data interaction method of hybrid cloud
CN113032471A (en) * 2021-03-23 2021-06-25 广东电网有限责任公司 Database processing method and device, electronic equipment and medium
CN113254446B (en) * 2021-05-26 2023-05-12 深圳壹账通智能科技有限公司 Data fusion method, device, electronic equipment and medium
CN114401278B (en) * 2021-12-27 2023-11-17 深圳软牛科技有限公司 Cross-platform transmission method, system, equipment and storage medium for Line App data
CN114398366B (en) * 2021-12-28 2022-12-27 重庆允成互联网科技有限公司 Heterogeneous data input method and data factory configuration system
CN115563088B (en) * 2022-12-08 2023-07-25 广东睿江云计算股份有限公司 Data migration method and migration system for databases of different types
CN116340411B (en) * 2023-05-31 2024-02-27 物产中大数字科技有限公司 Data processing method and device
CN117349267B (en) * 2023-12-04 2024-03-22 和元达信息科技有限公司 Database migration processing method and system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6996589B1 (en) * 2002-01-16 2006-02-07 Convergys Cmg Utah, Inc. System and method for database conversion
CN103019845A (en) * 2012-12-10 2013-04-03 中国人民解放军理工大学 Method for zero-modification migration of application program under heterogeneous database platforms

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6996589B1 (en) * 2002-01-16 2006-02-07 Convergys Cmg Utah, Inc. System and method for database conversion
CN103019845A (en) * 2012-12-10 2013-04-03 中国人民解放军理工大学 Method for zero-modification migration of application program under heterogeneous database platforms

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
卓越亚马逊新旧系统的数据迁移研究;陈健;《中国优秀硕士学位论文全文数据库 信息科技辑》;20120315(第3期);论文摘要,第3.2节-第4.3节,第5.4.2节 *

Also Published As

Publication number Publication date
CN103440273A (en) 2013-12-11

Similar Documents

Publication Publication Date Title
CN103440273B (en) A kind of data cross-platform migration method and device
US20210279221A1 (en) Methods and Systems for Performing Transparent Object Migration Across Storage Tiers
US11475034B2 (en) Schemaless to relational representation conversion
CN111259006B (en) Universal distributed heterogeneous data integrated physical aggregation, organization, release and service method and system
CN107402988B (en) Distributed NewSQL database system and semi-structured data query method
US8543539B2 (en) Method and system for capturing change of data
US7096231B2 (en) Export engine which builds relational database directly from object model
US7761411B2 (en) Delta operations on a large object in a database
US11500868B2 (en) Efficient identification of vertices and edges for graph indexes in an RDBMS
CN109213820B (en) Method for realizing fusion use of multiple types of databases
CN103995854A (en) Equipment cross-version upgrading method and device
CN110377666A (en) Based on the synchronous method of data between CMSP message-oriented middleware progress different source data library
US10671586B2 (en) Optimal sort key compression and index rebuilding
EP2874079B1 (en) Mobile database initialization and update for offline consumption
JP2009537895A (en) Efficient piecewise update of binary encoded XML data
CN104615713A (en) SQL executing method and device based on multiple database types
US10437564B1 (en) Object mapping and conversion system
EP2874080A1 (en) Dynamic database mapping
CN110990425B (en) JDBC driving method and device of hardware database
US10762068B2 (en) Virtual columns to expose row specific details for query execution in column store databases
CN114443656A (en) Customizable automated data model analysis tool and use method thereof
CN110879857B (en) Tunnel operation data analysis method and system
CN116627448A (en) Method for creating micro-service and related equipment
CN105335436A (en) Method and equipment for upgrading database structure
CN111259003B (en) Database establishment method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Li Rui

Inventor after: Lv Jianghua

Inventor after: Ma Shilong

Inventor before: Li Rui

Inventor before: Ma Shilong

COR Change of bibliographic data
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160824

Termination date: 20200806