CN102346775A - Method for synchronizing multiple heterogeneous source databases based on log - Google Patents
Method for synchronizing multiple heterogeneous source databases based on log Download PDFInfo
- Publication number
- CN102346775A CN102346775A CN2011102878144A CN201110287814A CN102346775A CN 102346775 A CN102346775 A CN 102346775A CN 2011102878144 A CN2011102878144 A CN 2011102878144A CN 201110287814 A CN201110287814 A CN 201110287814A CN 102346775 A CN102346775 A CN 102346775A
- Authority
- CN
- China
- Prior art keywords
- sql
- data
- script
- source database
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a method for synchronizing multiple heterogeneous source databases based on log. The method comprises the following steps of: 1) reading source data, extracting operation on a source database according to a log file of the source database at the source database end, and reversely generating an SQL (structured query language) execution script of data operation; 2) transferring the SQL script; 3) processing data conflict; and 4) writing target data. The method disclosed by the invention is used for realizing data synchronization between multiple heterogeneous source databases and a target database, can overcome the obstacle caused by heterogeneous databases, and does not bring any influence on the performance and structure of the source databases.
Description
Technical field
The invention belongs to the database synchronization field, be specifically related to a kind of isomerous multi-source database synchronization method based on daily record.
Background technology
In the database synchronization field, the data sync between the homogeneous data storehouse has fairly perfect method at present, duplicates, issues like the data of SQL Server.
Data sync between the heterogeneous database also has more mode, like the integration middleware of heterogeneous database data, heterogeneous database correlation techniques such as data sync based on SQL, but all not too perfect, exist some problems.
Particular problem comprises:
1, source database there is read data operation, has influenced the performance of source database;
2, need set up middle table in target database, influence the integrality of target database;
3, can only between single isomery source database and the target database synchronously, can not be to the multi-source data storehouse and the simple target database synchronization of isomery.
And data sync can not have any performance and structure that any influence is arranged to source database, otherwise can cause great puzzlement to the management of source database.
And the isomerous multi-source database is a kind of database synchronization interface mode that presses in the integrated projects such as informationization at present is integrated, solution information island synchronously.
In the database synchronization field, seeking the method for corresponding solution always, be one of current important research and development problem.
Summary of the invention
Not enough for overcoming in the prior art; The present invention aims to provide a kind of isomerous multi-source database synchronization method based on daily record; This method is so that data can be between multi-source data storehouse and target database synchronously; Can cross over the obstacle of database isomery, and source database is had no the influence of performance and structure aspects.
For realizing above-mentioned technical purpose, for reaching above-mentioned technique effect, the present invention realizes through following concrete technical scheme:
A kind of isomerous multi-source database synchronization based on daily record is provided, and may further comprise the steps:
The step 1) source data reads, at the journal file of source database end according to source database, and the operation of extraction source database, the SQL that oppositely generates data manipulation carries out script.
At the built-in system function of source database end through source database:: fn_dblog reads the journal file of SQL; With being referred to as all daily records that querying condition obtains wanting synchronous meter as the good table name that needs synchrodata of parameter configuration in advance; And the statement that " LOP_INSERT_ROWS ", " LOP_DELETE_ROWS " and " LOP_UPDATE_ROWS " three parameters are increased newly, delete, revise to operate synchronous meter as conditional filtering; Obtain binary line data at last, like " 01220E02025200E7F2C01F29A03004500E20200 ".
Through DBCC log (dbid | dbname}, [, type={0 | 1 }] analyzes binary line data; Get fixed-length field earlier; According to the list structure designated length, ignore random length field and other fields of not supporting and need not considering, circulation variable-length field tabulation reading of data; Obtain the corresponding form of line data at this point; Field type, field title, take the content of columns, elongated and row corresponding field, this content is spliced, the SQL that obtains corresponding increase, deletion, modification carries out script.
According to claiming, from binary line data, obtain the list structure of this table then, become the attached script of SQL as the table name of the good needs synchrodata of parameter configuration.
Step 2:SQL scripts pass;
SQL carries out script and generates, and transmits and accomplishes signal, and destination data storehouse end obtains SQL from the source database end and carries out script; The type of database of the source database that then this script mark is obtained, version, IP address, database-name also also serve as a mark the attached script of SQL, at last this SQL are carried out script and attaches mark deposits temporary table in.
Be by according to service needed and network presence the interval time of source database end and target database end SQL scripts pass, and the transmission interval parameters SENDTIME that configured in advance is good confirms.
Step 3: data collision is handled;
Source database is different with the target database data type, and SQL carries out script can not be general, needs format transformation, handles; The multi-source data storehouse to the object table synchrodata of target database, has data collision simultaneously, need carry out series processing.
Read the temporary table data, source database SQL is carried out script, according to the attached script of SQL; According to target the data of database type is changed, the field type of conversion table structure, the storage format of the data content of conversion row corresponding field; According to above conversion SQL is carried out script and change accordingly by corresponding mode, generation can be carried out the statement inspection with the SQL analysis order of target database at the smooth SQL statement of carrying out of target database; Inspection is passed through, and the SQL that deposits in after the conversion carries out script, gets into next step; Otherwise, change SQL again and carry out script, finish up to reading temporary table;
The data of same object table in the temporary table were sorted by the execution time in source database, delete the SQL that repeats in the different source databases and carry out script, according to the processing logic that pre-sets SQL is carried out script and be optimized.
Optimal way is inserted statement with many data and is merged into a batch data insertion statement; A data deletion statement merged in many data deletion statements; Many the line data to same major key are revised statement merge into a data modification statement; After batch data is inserted statement, increase the nologging option, when it is carried out, improve execution speed.
Again carry out series processing by the time then.
Step 4: target data writes.
With the sequence number of the SQL script in the cycle by mark, end is carried out one by one in the destination data storehouse, during wall scroll SQL script executing, does not carry out database and submits to, all complete after, the unified submission to.
Compared with prior art, the present invention has following beneficial effect and is:
1, the isomerous multi-source database synchronization method based on daily record of the present invention, the data read operation that can have no source database has no influence to the performance of source database;
2, the isomerous multi-source database synchronization method based on daily record of the present invention can not influence the integrality of target database;
3, the isomerous multi-source database synchronization method based on daily record of the present invention can carry out data sync to the multiple source database and the simple target database of isomery, can be adapted to the integrated project of large-scale datumization.
4, the isomerous multi-source database synchronization method based on daily record of the present invention; Carry out script optimization through the SQL in data collision is handled; Can greatly reduce the execution time of the SQL script of target database; Strengthen the sync response speed of target database, be applicable to 1,000,000 grades data sync in enormous quantities.
Above-mentioned explanation only is the general introduction of technical scheme of the present invention, understands technological means of the present invention in order can more to know, and can implement according to the content of instructions, below with preferred embodiment of the present invention and conjunction with figs. specify as after.Embodiment of the present invention is provided by following examples and accompanying drawing thereof in detail.
Description of drawings
Accompanying drawing described herein is used to provide further understanding of the present invention, constitutes the application's a part, and illustrative examples of the present invention and explanation thereof are used to explain the present invention, do not constitute improper qualification of the present invention.In the accompanying drawings:
Fig. 1 is the schematic flow sheet of a kind of isomerous multi-source database synchronization method based on daily record of the present invention.
Embodiment
Below with reference to accompanying drawing and combine embodiment, specify the present invention.
Referring to shown in Figure 1, a kind of isomerous multi-source database synchronization method based on daily record is characterized in that, may further comprise the steps:
The step 1) source data reads, at the journal file of source database end according to source database, and the operation of extraction source database, the SQL that oppositely generates data manipulation carries out script;
Step 2) SQL scripts pass;
The step 3) data collision is handled;
The step 4) target data writes.
Further, the concrete steps of said step 1 are following:
Step 1.1) at the built-in system function of source database end through source database:: fn_dblog reads the journal file of SQL; With being referred to as all daily records that querying condition obtains wanting synchronous meter as the good table name that needs synchrodata of parameter configuration in advance; And, obtain binary line data at last with the statement that " LOP_INSERT_ROWS ", " LOP_DELETE_ROWS ", " LOP_UPDATE_ROWS " three parameters increase newly, delete, revise to operate synchronous meter as conditional filtering;
Step 1.2) through DBCC log (dbid | dbname}; [, type={0 | 1 }] binary line data is analyzed: get fixed-length field earlier, according to the list structure designated length; Ignore random length field and other fields of not supporting and need not considering; Circulation variable-length field tabulation reading of data obtains the corresponding form of line data at this point, field type, field title, takies the content of columns, elongated and row corresponding field; Then this content is spliced, the SQL that obtains corresponding increase, deletion, modification carries out script
Step 1.3) according to claiming, from binary line data, obtains the list structure of this table, become the attached script of SQL as the table name of the good needs synchrodata of parameter configuration.
Further, the concrete steps of said step 2 are following:
Step 2.1) SQL carries out the script generation, transmits and accomplishes signal, and destination data storehouse end obtains SQL from the source database end and carries out script;
Step 2.2) said SQL is carried out the type of database, version, IP address, database-name of the source database that the script mark obtains and the attached script of SQL is also served as a mark;
Step 2.3) deposits said SQL execution script and attaches mark thereof in temporary table.
Further, the concrete steps of said step 3 are following:
Read the temporary table data, source database SQL is carried out script, according to the attached script of SQL; According to target the data of database type is changed, the field type of conversion table structure, the storage format of the data content of conversion row corresponding field; According to above conversion SQL is carried out script and change accordingly by corresponding mode, generation can be carried out the statement inspection with the SQL analysis order of target database at the smooth SQL statement of carrying out of target database; Inspection is passed through, and the SQL that deposits in after the conversion carries out script, gets into next step; Otherwise, change SQL again and carry out script, finish up to reading temporary table;
The data of same object table in the temporary table were sorted by the execution time in source database; Delete the SQL that repeats in the different source databases and carry out script; According to the processing logic that pre-sets SQL is carried out script and be optimized, carry out series processing again by the time then.
Further, the method for said optimization is following:
1) many data is inserted statement and merge into a batch data insertion statement;
2) a data deletion statement merged in many data deletion statements;
3) many line data to same major key are revised statement and merge into a data modification statement;
4) after batch data is inserted statement, increase the nologging option, when it is carried out, improve execution speed.
Further, the concrete steps of said step 4 are following:
With the sequence number of the SQL script in the cycle by mark, end is carried out one by one in the destination data storehouse, during wall scroll SQL script executing, does not carry out database and submits to, all complete after, the unified submission to.
The present invention has realized that data carry out synchronous promptness and high efficiency between multi-source heterogeneous database, has outstanding real-time characteristics and obvious improvement technically.
The above is merely the preferred embodiments of the present invention, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.All within spirit of the present invention and principle, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (6)
1. the isomerous multi-source database synchronization method based on daily record is characterized in that, may further comprise the steps:
The step 1) source data reads, at the journal file of source database end according to source database, and the operation of extraction source database, the SQL that oppositely generates data manipulation carries out script;
Step 2) SQL scripts pass;
The step 3) data collision is handled;
The step 4) target data writes.
2. the isomerous multi-source database synchronization method based on daily record according to claim 1 is characterized in that the concrete steps of said step 1 are following:
Step 1.1) at the built-in system function of source database end through source database:: fn_dblog reads the journal file of SQL; With being referred to as all daily records that querying condition obtains wanting synchronous meter as the good table name that needs synchrodata of parameter configuration in advance; And, obtain binary line data at last with the statement that " LOP_INSERT_ROWS ", " LOP_DELETE_ROWS ", " LOP_UPDATE_ROWS " three parameters increase newly, delete, revise to operate synchronous meter as conditional filtering;
Step 1.2) through DBCC log (dbid | dbname}; [, type={0 | 1 }] binary line data is analyzed: get fixed-length field earlier, according to the list structure designated length; Ignore random length field and other fields of not supporting and need not considering; Circulation variable-length field tabulation reading of data obtains the corresponding form of line data at this point, field type, field title, takies the content of columns, elongated and row corresponding field; Then this content is spliced, the SQL that obtains corresponding increase, deletion, modification carries out script
Step 1.3) according to claiming, from binary line data, obtains the list structure of this table, become the attached script of SQL as the table name of the good needs synchrodata of parameter configuration.
3. the isomerous multi-source database synchronization method based on daily record according to claim 1 is characterized in that the concrete steps of said step 2 are following:
Step 2.1) SQL carries out the script generation, transmits and accomplishes signal, and destination data storehouse end obtains SQL from the source database end and carries out script;
Step 2.2) said SQL is carried out the type of database, version, IP address, database-name of the source database that the script mark obtains and the attached script of SQL is also served as a mark;
Step 2.3) deposits said SQL execution script and attaches mark thereof in temporary table.
4. the isomerous multi-source database synchronization method based on daily record according to claim 1 is characterized in that the concrete steps of said step 3 are following:
Read the temporary table data, source database SQL is carried out script, according to the attached script of SQL; According to target the data of database type is changed, the field type of conversion table structure, the storage format of the data content of conversion row corresponding field; According to above conversion SQL is carried out script and change accordingly by corresponding mode, generation can be carried out the statement inspection with the SQL analysis order of target database at the smooth SQL statement of carrying out of target database; Inspection is passed through, and the SQL that deposits in after the conversion carries out script, gets into next step; Otherwise, change SQL again and carry out script, finish up to reading temporary table;
The data of same object table in the temporary table were sorted by the execution time in source database; Delete the SQL that repeats in the different source databases and carry out script; According to the processing logic that pre-sets SQL is carried out script and be optimized, carry out series processing again by the time then.
5. the isomerous multi-source database synchronization method based on daily record according to claim 4 is characterized in that the method for said optimization is following:
1) many data is inserted statement and merge into a batch data insertion statement;
2) a data deletion statement merged in many data deletion statements;
3) many line data to same major key are revised statement and merge into a data modification statement;
4) after batch data is inserted statement, increase the nologging option, when it is carried out, improve execution speed.
6. according to claim 1 or 2 or 3 or 4 or 5 described isomerous multi-source database synchronization methods, it is characterized in that the concrete steps of said step 4 are following based on daily record:
With the sequence number of the SQL script in the cycle by mark, end is carried out one by one in the destination data storehouse, during wall scroll SQL script executing, does not carry out database and submits to, all complete after, the unified submission to.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011102878144A CN102346775A (en) | 2011-09-26 | 2011-09-26 | Method for synchronizing multiple heterogeneous source databases based on log |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011102878144A CN102346775A (en) | 2011-09-26 | 2011-09-26 | Method for synchronizing multiple heterogeneous source databases based on log |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102346775A true CN102346775A (en) | 2012-02-08 |
Family
ID=45545452
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011102878144A Pending CN102346775A (en) | 2011-09-26 | 2011-09-26 | Method for synchronizing multiple heterogeneous source databases based on log |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102346775A (en) |
Cited By (45)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102752372A (en) * | 2012-06-18 | 2012-10-24 | 天津神舟通用数据技术有限公司 | File based database synchronization method |
| CN102915377A (en) * | 2012-11-14 | 2013-02-06 | 深圳市宏电技术股份有限公司 | Method and system for converting or synchronizing databases |
| CN102982171A (en) * | 2012-12-17 | 2013-03-20 | 山东神思电子技术股份有限公司 | Database synchronization method |
| CN103064976A (en) * | 2013-01-14 | 2013-04-24 | 浙江水利水电专科学校 | Data for exchanging data among homogenous and heterogenous DBMSs (database management systems) on basis of active database technology |
| CN103793514A (en) * | 2014-02-11 | 2014-05-14 | 华为技术有限公司 | Database synchronization method and databases |
| CN104376017A (en) * | 2013-08-15 | 2015-02-25 | 阿里巴巴集团控股有限公司 | Method and system for inter-database data synchronization |
| CN104462517A (en) * | 2014-12-22 | 2015-03-25 | 北京奇虎科技有限公司 | Data synchronizing method and device |
| CN104462353A (en) * | 2014-12-04 | 2015-03-25 | 北京国双科技有限公司 | Batch synchronous processing method and device for databases |
| CN104778175A (en) * | 2014-01-13 | 2015-07-15 | 世纪禾光科技发展（北京）有限公司 | Method and system for realizing data synchronization of heterogeneous database |
| CN105335482A (en) * | 2015-10-14 | 2016-02-17 | 西北工业大学 | Batch insert method facing mass distributed database |
| CN105373621A (en) * | 2015-12-07 | 2016-03-02 | 高新兴科技集团股份有限公司 | Rapid database-system-across data increment migration method |
| CN105760174A (en) * | 2016-03-09 | 2016-07-13 | 浪潮软件集团有限公司 | Suggested data extraction method based on Windows timed task |
| CN105955970A (en) * | 2015-11-12 | 2016-09-21 | 中国银联股份有限公司 | Log analysis-based database copying method and device |
| WO2017050176A1 (en) * | 2015-09-25 | 2017-03-30 | 阿里巴巴集团控股有限公司 | Data synchronization method and device |
| CN106649837A (en) * | 2016-12-29 | 2017-05-10 | 成都三零盛安信息系统有限公司 | Database compatible method |
| CN106649835A (en) * | 2016-12-29 | 2017-05-10 | 成都三零盛安信息系统有限公司 | Database compatible device |
| CN106709043A (en) * | 2016-12-30 | 2017-05-24 | 江苏瑞中数据股份有限公司 | Data synchronous loading method based on database log |
| CN107169069A (en) * | 2017-05-08 | 2017-09-15 | 山大地纬软件股份有限公司 | Distributed hierarchical extracts many application processes and data pick-up applicator |
| CN107295039A (en) * | 2016-03-31 | 2017-10-24 | 阿里巴巴集团控股有限公司 | Data access treating method and apparatus |
| CN107665233A (en) * | 2017-07-24 | 2018-02-06 | 上海壹账通金融科技有限公司 | Database data processing method, device, computer equipment and storage medium |
| CN107967316A (en) * | 2017-11-22 | 2018-04-27 | 平安科技（深圳）有限公司 | A kind of method of data synchronization, equipment and computer-readable recording medium |
| WO2018082079A1 (en) * | 2016-11-07 | 2018-05-11 | 深圳中兴力维技术有限公司 | Method and apparatus for dynamically managing data exchange |
| CN108241676A (en) * | 2016-12-26 | 2018-07-03 | 阿里巴巴集团控股有限公司 | Realize the method and apparatus that data synchronize |
| CN108241706A (en) * | 2016-12-27 | 2018-07-03 | 北京金山云网络技术有限公司 | A kind of data storage method and device |
| CN108280126A (en) * | 2017-12-13 | 2018-07-13 | 浙江工商职业技术学院 | A kind of big data analysis processing method |
| CN108363791A (en) * | 2018-02-13 | 2018-08-03 | 沈阳东软医疗系统有限公司 | A kind of method of data synchronization and device of database |
| CN109408589A (en) * | 2018-09-14 | 2019-03-01 | 新华三大数据技术有限公司 | Method of data synchronization and device |
| CN109614444A (en) * | 2018-11-12 | 2019-04-12 | 武汉达梦数据库有限公司 | A kind of data initialization method when data are synchronous |
| CN109634975A (en) * | 2018-12-10 | 2019-04-16 | 拉扎斯网络科技（上海）有限公司 | Method of data synchronization and device, electronic equipment and computer readable storage medium |
| CN110069567A (en) * | 2019-04-02 | 2019-07-30 | 北京信安世纪科技股份有限公司 | Method of data synchronization and system between a kind of database |
| CN110222119A (en) * | 2019-05-23 | 2019-09-10 | 武汉达梦数据库有限公司 | A kind of data conversion synchronous method, equipment and the storage medium of heterogeneous database |
| CN110471970A (en) * | 2019-08-08 | 2019-11-19 | 紫光云技术有限公司 | A kind of regulation engine data forwarding method that can flexibly match |
| CN110515913A (en) * | 2019-08-02 | 2019-11-29 | 北京互金新融科技有限公司 | Log processing method and device |
| CN110990475A (en) * | 2019-12-13 | 2020-04-10 | 深圳前海环融联易信息科技服务有限公司 | Batch task insertion method and device, computer equipment and storage medium |
| CN111158997A (en) * | 2019-12-24 | 2020-05-15 | 河南文正电子数据处理有限公司 | Safety monitoring method and device for multi-log system |
| CN112231396A (en) * | 2020-09-15 | 2021-01-15 | 山东浪潮通软信息科技有限公司 | Method for incrementally synchronizing data across databases |
| CN112328696A (en) * | 2020-11-17 | 2021-02-05 | 北京金和网络股份有限公司 | Method and device for synchronizing data in MySQL database to SQL Server database |
| CN112800136A (en) * | 2021-01-30 | 2021-05-14 | 上海宝旗信息科技有限公司 | Data selective cascade synchronization tool and synchronization method thereof |
| CN112825069A (en) * | 2019-11-21 | 2021-05-21 | 阿里巴巴集团控股有限公司 | Method, device and system for analyzing database data and storage medium |
| CN113051347A (en) * | 2021-03-25 | 2021-06-29 | 未鲲(上海)科技服务有限公司 | Method, system, equipment and storage medium for data synchronization between heterogeneous databases |
| CN113220785A (en) * | 2021-05-21 | 2021-08-06 | 上海申铁信息工程有限公司 | Database change record synchronization method and device based on primary key comparison |
| CN113326247A (en) * | 2021-04-28 | 2021-08-31 | 上海淇馥信息技术有限公司 | Cloud data migration method and device and electronic equipment |
| CN114647659A (en) * | 2020-12-17 | 2022-06-21 | 金篆信科有限责任公司 | Data processing method and device, electronic equipment and storage medium |
| CN115391457A (en) * | 2022-08-23 | 2022-11-25 | 昆仑数智科技有限责任公司 | Cross-database data synchronization method and device and storage medium |
| CN117370470A (en) * | 2023-12-08 | 2024-01-09 | 北京大数元科技发展有限公司 | System and method for realizing data synchronization by dynamic request interface |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004036412A1 (en) * | 2002-10-18 | 2004-04-29 | Nokia Corporation | Method and system for recalling details regarding past events |
| CN101187888A (en) * | 2007-12-11 | 2008-05-28 | 浪潮电子信息产业股份有限公司 | Method for coping database data in heterogeneous environment |
| CN101369283A (en) * | 2008-09-25 | 2009-02-18 | 中兴通讯股份有限公司 | Data synchronization method and system for internal memory database physical data base |
-
2011
- 2011-09-26 CN CN2011102878144A patent/CN102346775A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004036412A1 (en) * | 2002-10-18 | 2004-04-29 | Nokia Corporation | Method and system for recalling details regarding past events |
| CN101187888A (en) * | 2007-12-11 | 2008-05-28 | 浪潮电子信息产业股份有限公司 | Method for coping database data in heterogeneous environment |
| CN101369283A (en) * | 2008-09-25 | 2009-02-18 | 中兴通讯股份有限公司 | Data synchronization method and system for internal memory database physical data base |
Cited By (68)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102752372A (en) * | 2012-06-18 | 2012-10-24 | 天津神舟通用数据技术有限公司 | File based database synchronization method |
| CN102915377A (en) * | 2012-11-14 | 2013-02-06 | 深圳市宏电技术股份有限公司 | Method and system for converting or synchronizing databases |
| CN102915377B (en) * | 2012-11-14 | 2016-08-03 | 深圳市宏电技术股份有限公司 | Data base's conversion or synchronous method and system |
| CN102982171A (en) * | 2012-12-17 | 2013-03-20 | 山东神思电子技术股份有限公司 | Database synchronization method |
| CN103064976B (en) * | 2013-01-14 | 2015-10-28 | 浙江水利水电学院 | Based on active database technology same isomery DBMS between method for interchanging data |
| CN103064976A (en) * | 2013-01-14 | 2013-04-24 | 浙江水利水电专科学校 | Data for exchanging data among homogenous and heterogenous DBMSs (database management systems) on basis of active database technology |
| CN104376017A (en) * | 2013-08-15 | 2015-02-25 | 阿里巴巴集团控股有限公司 | Method and system for inter-database data synchronization |
| CN104376017B (en) * | 2013-08-15 | 2018-10-23 | 阿里巴巴集团控股有限公司 | The method and system of data synchronization are carried out between database |
| CN104778175A (en) * | 2014-01-13 | 2015-07-15 | 世纪禾光科技发展（北京）有限公司 | Method and system for realizing data synchronization of heterogeneous database |
| CN103793514A (en) * | 2014-02-11 | 2014-05-14 | 华为技术有限公司 | Database synchronization method and databases |
| CN103793514B (en) * | 2014-02-11 | 2017-09-19 | 华为技术有限公司 | Database synchronization method and database |
| CN104462353A (en) * | 2014-12-04 | 2015-03-25 | 北京国双科技有限公司 | Batch synchronous processing method and device for databases |
| CN104462353B (en) * | 2014-12-04 | 2017-12-22 | 北京国双科技有限公司 | Database batch synchronization processing method and processing device |
| CN104462517A (en) * | 2014-12-22 | 2015-03-25 | 北京奇虎科技有限公司 | Data synchronizing method and device |
| CN106557497A (en) * | 2015-09-25 | 2017-04-05 | 阿里巴巴集团控股有限公司 | A kind of method of data synchronization and device |
| WO2017050176A1 (en) * | 2015-09-25 | 2017-03-30 | 阿里巴巴集团控股有限公司 | Data synchronization method and device |
| CN105335482A (en) * | 2015-10-14 | 2016-02-17 | 西北工业大学 | Batch insert method facing mass distributed database |
| CN105335482B (en) * | 2015-10-14 | 2018-07-03 | 西北工业大学 | Towards the batch insertion method of magnanimity distributed data base |
| CN105955970A (en) * | 2015-11-12 | 2016-09-21 | 中国银联股份有限公司 | Log analysis-based database copying method and device |
| CN105373621A (en) * | 2015-12-07 | 2016-03-02 | 高新兴科技集团股份有限公司 | Rapid database-system-across data increment migration method |
| CN105760174A (en) * | 2016-03-09 | 2016-07-13 | 浪潮软件集团有限公司 | Suggested data extraction method based on Windows timed task |
| CN107295039A (en) * | 2016-03-31 | 2017-10-24 | 阿里巴巴集团控股有限公司 | Data access treating method and apparatus |
| WO2018082079A1 (en) * | 2016-11-07 | 2018-05-11 | 深圳中兴力维技术有限公司 | Method and apparatus for dynamically managing data exchange |
| CN108241676A (en) * | 2016-12-26 | 2018-07-03 | 阿里巴巴集团控股有限公司 | Realize the method and apparatus that data synchronize |
| CN108241676B (en) * | 2016-12-26 | 2022-09-02 | 阿里云计算有限公司 | Method and equipment for realizing data synchronization |
| CN108241706B (en) * | 2016-12-27 | 2020-12-25 | 北京金山云网络技术有限公司 | Data warehousing method and device |
| CN108241706A (en) * | 2016-12-27 | 2018-07-03 | 北京金山云网络技术有限公司 | A kind of data storage method and device |
| CN106649837B (en) * | 2016-12-29 | 2019-10-22 | 成都三零盛安信息系统有限公司 | Database compatibility method |
| CN106649835B (en) * | 2016-12-29 | 2019-10-22 | 成都三零盛安信息系统有限公司 | Database compatible apparatus |
| CN106649835A (en) * | 2016-12-29 | 2017-05-10 | 成都三零盛安信息系统有限公司 | Database compatible device |
| CN106649837A (en) * | 2016-12-29 | 2017-05-10 | 成都三零盛安信息系统有限公司 | Database compatible method |
| CN106709043A (en) * | 2016-12-30 | 2017-05-24 | 江苏瑞中数据股份有限公司 | Data synchronous loading method based on database log |
| CN107169069A (en) * | 2017-05-08 | 2017-09-15 | 山大地纬软件股份有限公司 | Distributed hierarchical extracts many application processes and data pick-up applicator |
| CN107169069B (en) * | 2017-05-08 | 2020-01-07 | 山大地纬软件股份有限公司 | Distributed hierarchical extraction multi-application method and data extraction applicator |
| CN107665233A (en) * | 2017-07-24 | 2018-02-06 | 上海壹账通金融科技有限公司 | Database data processing method, device, computer equipment and storage medium |
| CN107665233B (en) * | 2017-07-24 | 2020-07-31 | 深圳壹账通智能科技有限公司 | Database data processing method and device, computer equipment and storage medium |
| CN107967316A (en) * | 2017-11-22 | 2018-04-27 | 平安科技（深圳）有限公司 | A kind of method of data synchronization, equipment and computer-readable recording medium |
| CN108280126A (en) * | 2017-12-13 | 2018-07-13 | 浙江工商职业技术学院 | A kind of big data analysis processing method |
| CN108363791A (en) * | 2018-02-13 | 2018-08-03 | 沈阳东软医疗系统有限公司 | A kind of method of data synchronization and device of database |
| CN109408589A (en) * | 2018-09-14 | 2019-03-01 | 新华三大数据技术有限公司 | Method of data synchronization and device |
| CN109408589B (en) * | 2018-09-14 | 2020-08-14 | 新华三大数据技术有限公司 | Data synchronization method and device |
| CN109614444A (en) * | 2018-11-12 | 2019-04-12 | 武汉达梦数据库有限公司 | A kind of data initialization method when data are synchronous |
| CN109614444B (en) * | 2018-11-12 | 2023-05-16 | 武汉达梦数据库股份有限公司 | Data initialization method during data synchronization |
| CN109634975A (en) * | 2018-12-10 | 2019-04-16 | 拉扎斯网络科技（上海）有限公司 | Method of data synchronization and device, electronic equipment and computer readable storage medium |
| CN110069567A (en) * | 2019-04-02 | 2019-07-30 | 北京信安世纪科技股份有限公司 | Method of data synchronization and system between a kind of database |
| CN110222119B (en) * | 2019-05-23 | 2021-08-31 | 武汉达梦数据库股份有限公司 | Data conversion synchronization method, equipment and storage medium for heterogeneous database |
| CN110222119A (en) * | 2019-05-23 | 2019-09-10 | 武汉达梦数据库有限公司 | A kind of data conversion synchronous method, equipment and the storage medium of heterogeneous database |
| CN110515913B (en) * | 2019-08-02 | 2022-08-09 | 北京互金新融科技有限公司 | Log processing method and device |
| CN110515913A (en) * | 2019-08-02 | 2019-11-29 | 北京互金新融科技有限公司 | Log processing method and device |
| CN110471970A (en) * | 2019-08-08 | 2019-11-19 | 紫光云技术有限公司 | A kind of regulation engine data forwarding method that can flexibly match |
| CN112825069A (en) * | 2019-11-21 | 2021-05-21 | 阿里巴巴集团控股有限公司 | Method, device and system for analyzing database data and storage medium |
| CN110990475B (en) * | 2019-12-13 | 2023-09-08 | 深圳前海环融联易信息科技服务有限公司 | Batch task inserting method and device, computer equipment and storage medium |
| CN110990475A (en) * | 2019-12-13 | 2020-04-10 | 深圳前海环融联易信息科技服务有限公司 | Batch task insertion method and device, computer equipment and storage medium |
| CN111158997B (en) * | 2019-12-24 | 2023-05-23 | 广西电网有限责任公司 | Safety monitoring method and device for multi-log system |
| CN111158997A (en) * | 2019-12-24 | 2020-05-15 | 河南文正电子数据处理有限公司 | Safety monitoring method and device for multi-log system |
| CN112231396A (en) * | 2020-09-15 | 2021-01-15 | 山东浪潮通软信息科技有限公司 | Method for incrementally synchronizing data across databases |
| CN112328696A (en) * | 2020-11-17 | 2021-02-05 | 北京金和网络股份有限公司 | Method and device for synchronizing data in MySQL database to SQL Server database |
| CN114647659A (en) * | 2020-12-17 | 2022-06-21 | 金篆信科有限责任公司 | Data processing method and device, electronic equipment and storage medium |
| CN112800136A (en) * | 2021-01-30 | 2021-05-14 | 上海宝旗信息科技有限公司 | Data selective cascade synchronization tool and synchronization method thereof |
| CN113051347A (en) * | 2021-03-25 | 2021-06-29 | 未鲲(上海)科技服务有限公司 | Method, system, equipment and storage medium for data synchronization between heterogeneous databases |
| CN113051347B (en) * | 2021-03-25 | 2024-03-29 | 未鲲(上海)科技服务有限公司 | Method, system, equipment and storage medium for synchronizing data between heterogeneous databases |
| CN113326247A (en) * | 2021-04-28 | 2021-08-31 | 上海淇馥信息技术有限公司 | Cloud data migration method and device and electronic equipment |
| CN113326247B (en) * | 2021-04-28 | 2023-02-21 | 上海淇馥信息技术有限公司 | Cloud data migration method and device and electronic equipment |
| CN113220785A (en) * | 2021-05-21 | 2021-08-06 | 上海申铁信息工程有限公司 | Database change record synchronization method and device based on primary key comparison |
| CN115391457A (en) * | 2022-08-23 | 2022-11-25 | 昆仑数智科技有限责任公司 | Cross-database data synchronization method and device and storage medium |
| CN115391457B (en) * | 2022-08-23 | 2023-09-12 | 昆仑数智科技有限责任公司 | Cross-database data synchronization method, device and storage medium |
| CN117370470A (en) * | 2023-12-08 | 2024-01-09 | 北京大数元科技发展有限公司 | System and method for realizing data synchronization by dynamic request interface |
| CN117370470B (en) * | 2023-12-08 | 2024-03-12 | 北京大数元科技发展有限公司 | System and method for realizing data synchronization by dynamic request interface |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102346775A (en) | Method for synchronizing multiple heterogeneous source databases based on log | |
| CN107273506B (en) | Method for multi-table combined query of database | |
| CN105138661A (en) | Hadoop-based k-means clustering analysis system and method of network security log | |
| CN104899295B (en) | A kind of heterogeneous data source data relation analysis method | |
| CN109829011B (en) | Data synchronization method and device for distributed heterogeneous database | |
| CN103020204A (en) | Method and system for carrying out multi-dimensional regional inquiry on distribution type sequence table | |
| CN103678491A (en) | Method based on Hadoop small file optimization and reverse index establishment | |
| CN106126601A (en) | A kind of social security distributed preprocess method of big data and system | |
| CN107066546B (en) | MPP engine-based cross-data center quick query method and system | |
| CN103761318A (en) | Method and system for data synchronization of relational heterogeneous databases | |
| CN109558452B (en) | Synchronization method for query table building operation | |
| CN105740337A (en) | Rapid event matching method in content-based publishing subscription system | |
| CN106484329A (en) | A kind of big data transmission integrity protection mechanism based on multistage storage | |
| CN104504001A (en) | Massive distributed relational database-oriented cursor creation method | |
| CN104598531A (en) | Incremental data migration method among heterogeneous relational databases based on trigger | |
| CN106339498A (en) | Method, device and system for synchronizing data | |
| CN109241156A (en) | The method updated based on ETL tool from relevant database to non-relational database | |
| CN103177094A (en) | Cleaning method of data of internet of things | |
| CN103226599A (en) | Method and system for accurately extracting webpage content | |
| CN104317899A (en) | Big-data analyzing and processing system and access method | |
| CN103136244A (en) | Parallel data mining method and system based on cloud computing platform | |
| CN105447105A (en) | NoSQL-based single field section index query method for distributed Internet of things data | |
| CN101645073A (en) | Method for guiding prior database file into embedded type database | |
| CN109165225A (en) | A kind of kudu data import system and method based on bytestream format | |
| CN107291938A (en) | Order Query System and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120208 |