CN101369283A - Data synchronization method and system for internal memory database physical data base - Google Patents
Data synchronization method and system for internal memory database physical data base Download PDFInfo
- Publication number
- CN101369283A CN101369283A CNA2008102163741A CN200810216374A CN101369283A CN 101369283 A CN101369283 A CN 101369283A CN A2008102163741 A CNA2008102163741 A CN A2008102163741A CN 200810216374 A CN200810216374 A CN 200810216374A CN 101369283 A CN101369283 A CN 101369283A
- Authority
- CN
- China
- Prior art keywords
- synchronization
- data
- log file
- database
- synchronization log
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a data synchronization method between a storage database and a physical database and a system, comprising: a storage database, a physical database and a data synchronization unit. The method comprises that: the storage database generates a synchronization log file for recording the data modification operation information according to the established criterion when performing data modification, and stores the file in a host computer of the storage database; the data synchronization unit timely obtains the synchronization log file which is generated novelly from the host computer of the storage database, and stores in an established list locally, then resolves the file, transforms into basic SQL sentences which match with syntactic rules of an object physical database, then builds connection with the object physical database, executes the basic SQL sentences. The invention not only ensures synchronization real-time, but also effectively controls data size of synchronization, accelerates synchronization speed, which is used in a plurality of operating system platforms.
Description
Technical field
The present invention relates to method of data synchronization and system between a kind of memory database and physical database.
Background technology
Along with the social informatization degree progressively deeply, the application of database in all trades and professions is more and more wider, communication field especially, professional data volume is very big, performance requirement is more and more higher, and safety of data is had very high requirement.Memory database has the advantage that speed is fast, performance is high, so increasing application system has all been developed the specific store program based on the internal memory computing voluntarily, metadata cache commonly used in internal memory, is accelerated access speed.But, the security deficiency of memory database, under the situation of delay unusually machine or power down, the data in the internal memory will be lost, and so, just need the backstage to have a corresponding physical database to do the data backup; In addition, peripheral routines such as the door of a lot of application systems or interface need visit tables of data in the internal memory by physical database, so a kind of synchronization mechanism that data variation in the memory database is updated to physical database must be arranged.Particularly, after the data in the memory database are modified, application program is by a kind of method, automatically the Data Update in the memory database is synchronized to physical database, can satisfy the query demand at door or interface like this, the carrying out safety backup of data be can guarantee again, thereby the safety and the stable operation of whole application system guaranteed.Yet this stationary problem never is resolved, and a lot of peripheral routines can't be realized existing function, and safety of data also can't be guaranteed.
Summary of the invention
Technical matters to be solved by this invention provides the method for data synchronization between a kind of memory database and the physical database, and the data synchronous system of realizing this method.
For solving the problems of the technologies described above, the present invention is achieved by the following technical solutions:
A kind of data synchronous system comprises memory database and target physical database, also comprises data synchronization unit, and comprises the synchronization log generation module in the described memory database;
Described memory database when carrying out the data modification operation, calls described synchronization log generation module at every turn, generates the synchronization log file in order to record data retouching operation information, and preserves this synchronization log file;
Described data synchronization unit, be used for regularly obtaining the newly-generated synchronization log file of described memory database by file transfer protocol (FTP), this synchronization log file is resolved, convert thereof into the basic SQL statement of the syntax rule that meets the target physical database, carry out described SQL statement after connecting with the target physical database.
Wherein, described data synchronization unit comprises:
The synchronization log document transmission module is used for regularly obtaining newly-generated synchronization log file from described memory database, and it is deposited in the local assigned catalogue;
Synchronization log document analysis module is used for the synchronization log file of described assigned catalogue is resolved line by line, converts thereof into the basic SQL statement of the syntax rule that meets the target physical database;
The synchronization log file module of reforming is used for setting up and safeguarding the physical database connection pool, the described basic SQL statement of back execution that connects of driver and the target physical database by the invocation target physical database.
Wherein, described data synchronization unit also comprises log management module, is used for the synchronization log file that the assigned catalogue of the described this locality of quantitative check is preserved, and deletion is the synchronization log file of dissection process wherein.
Method of data synchronization between a kind of memory database and physical database comprises:
Memory database whenever carries out data modification when operation, generates synchronization log file in order to record data retouching operation information according to set standard, and this document is stored in memory database place main frame;
Data synchronization unit regularly obtains newly-generated synchronization log file from described memory database place main frame, it is stored in the local assigned catalogue, then this document is resolved, convert thereof into the basic SQL statement of the syntax rule that meets the target physical database, connect with the target physical database afterwards, carry out described basic SQL statement.
Said method also comprises: the synchronization log file of being preserved in the assigned catalogue of described data synchronization unit quantitative check this locality, delete wherein the synchronization log file of dissection process.
Wherein, the content of described synchronization log file comprises: whether log serial number, daily record length, this daily record need title, the table name of sync id, table to claim length and data modification information.
Wherein, described synchronization log file is a binary format.
The invention solves data synchronization problems and safety problem between memory database and the physical data, have following beneficial effect:
1) the internal storage data library only need write the synchronization log file with the change operation information of data, follow-up data sync key step (transmission of synchronization log file, parsing, SQL reform etc.) can be carried out on other main frame, can not increase the system burden of memory database place main frame too much, to be reduced to minimum degree to the influence of this applied host machine, and guarantee real-time property of synchronizing;
2) generate in being embedded in memory database owing to the synchronization log file, belong to the realization of bottom, therefore, the data modification no matter who is initiated to memory database is operated or what approach to be initiated the data modification operation by, what write down in the synchronization log file all is original binary data code stream, realize type of database independence and operating platform independence, made follow-up file transfer and parsing convenient freely;
3) can flexible customization need the synchronous table of increment, operation or data message, control the data in synchronization amount effectively, accelerate synchronous speed;
4) the synchronization log file uses the file transfer protocol (FTP) of standard, can shift between distinct device, and is therefore irrelevant with operating system and type of database, can use favorable expandability on the several operation systems platform.
Description of drawings
Fig. 1 is the structural representation of the data synchronous system in the embodiment of the invention;
Fig. 2 is the process flow diagram of the method for data synchronization in the embodiment of the invention;
Fig. 3 is the synchronization log document transmission method process flow diagram in the embodiment of the invention;
Fig. 4 is the resolving synoptic diagram in the embodiment of the invention.
Embodiment
The present invention is described in further detail below in conjunction with drawings and the specific embodiments:
See also Fig. 1, this figure is depicted as data synchronous system proposed by the invention, comprises special-purpose memory database A
1-A
N, physical database B
1-B
N, data synchronization unit; Wherein, all include the synchronization log file generating module in the memory database, data synchronization unit comprises synchronization log document transmission module, synchronization log document analysis module, the synchronization log file module of reforming.The acting as of each several part in the said system:
Each memory database, when carrying out the data modification operation at every turn, call its synchronization log generation module respectively, generate synchronization log file, and preserve this synchronization log file in the main frame at this memory database place in order to the binary format of record data retouching operation information;
The synchronization log document transmission module is used for regularly obtaining new synchronization log file respectively from each memory database place main frame, and it is stored in the local assigned catalogue;
Synchronization log document analysis module, the synchronization log file that is used for this locality is stored is resolved respectively line by line, converts thereof into the basic SQL statement of the syntax rule that meets its target physical database;
The synchronization log file module of reforming is used for setting up and safeguarding the physical database connection pool, the above-mentioned basic SQL statement of back execution that connects of driver and the target physical database by the invocation target physical database.
Data synchronization unit also can comprise log management module, is used for the synchronization log file that the assigned catalogue of quantitative check this locality is preserved, and deletion is the synchronization log file of dissection process wherein, to keep the lasting available of storage space.
See also Fig. 2, this figure is depicted as memory database proposed by the invention and the method for data synchronization between physical database, may further comprise the steps:
201, each memory database and data synchronization unit carry out initial configuration respectively:
For memory database, need carry out following configuration: log serial number (lsn) variable and the file sequence number variable of the unified distribution of the 1. definition overall situation; 2. define action types such as increasing, delete, change, article one, sql command resolves into a plurality of basic operations when reality is carried out, and basic operation has 3 kinds: more row (INSERT_RECORD) is write down in the value of newer field (UPDATE_FIELD), deletion record row (DELETE_RECORD), insertion; The attribute of definition tuple structure field_desc: field name (name), the length of field name (name_len), the data type of field (type), the value of field (data), the length of value (data_len);
For data synchronization unit, the host address, FTP user's name and the password that need initial configuration memory database (be source database, can have a plurality of), and physical database (is a target database, can have a plurality ofly, also can be dissimilar) host address.
202, generate the synchronization log file: memory database when carrying out the data modification operation at every turn, call its synchronization log generation module, generate synchronization log file according to set standard, and this document is stored in this memory database place main frame in order to record data retouching operation information.
The name form of the synchronization log file that at first, memory database generated is: XLOG_ memory database host ip _ file date of formation _ file sequence number.Wherein, XLOG is self-defined file prefix; The memory database host ip is the IP address of this memory database place main frame, is used to distinguish the synchronization log file that different memory databases generate; File date of formation form is YYYYMMDDHHMM, for example 2008060111230; The file sequence number is a monotonically increasing numeral, for example 001,002 etc.
For the ease of follow-up transmission and dissection process to the synchronization log file, also adopting in the present embodiment uses the mode of different suffix names to represent synchronization log file present located state: for the file of newly opening, the suffix name is set to " .w ", writes data in the expression memory database forward presents; For the file after closing, the suffix name is set to " .r ", and the expression memory database writes data to presents and finishes, but also handles without data synchronization unit; For removed file, the suffix name is set to " .o ", and the expression presents is taken away processing by data synchronization unit.
Secondly, long for fear of transmission and the parsing data sync time delays that overlong time caused to file, need control the size of synchronization log file.Control method has following several:
(i) record strip is set and counts maximal value,, then close current synchronization log file, generate new synchronization log file and continue write record if the lsn record strip number that writes in the current synchronization log file surpasses maximal value;
The file size threshold value (ii) is set, when the size of current synchronization log file reaches this threshold value, closes current synchronization log file, generate new synchronization log file and continue write record;
(iii) require to be provided with time limit write time,, then close current synchronization log file, generate new synchronization log file and continue write record if the data write time of current synchronization log file surpasses this time bar according to real-time.
Moreover the ablation process of synchronization log file content is:
Suppose to have known in advance the memory database list structure of wanting synchronous and the major key of table, only synchronization log is write in operations such as UPDATE, INSERT, DELETE, the synchronization log file is logical block with the SQL statement, is the basic composition element with the field.The synchronization log of each SQL statement comprises statement bracket, when being each operation that increases, deletes, changes execution of memory database, write left parenthesis " lsn:len:sync:op_BEGIN:tn_len:table_name " earlier, write the concrete content of operation that increases, deletes, changes then, write right parenthesis " lsn:len:sync:op_END " after running succeeded, if carry out failure, then write right parenthesis " lsn:len:sync:op_ABORT ".
Wherein, lsn is a log serial number, is global variable in the memory database, and like this, in certain period, each sql command all has unique lsn, thereby can be used to represent the execution sequence of sql command; Len represents the length of this daily record; Sync represents whether this daily record needs to be synchronized to physical database, and 0 expression does not need synchronously, and other expressions need synchronously, and are flexibly customized during application; Op represents concrete sql command, as UPDATE, DELETE, INSERT etc.; The title that table_name then represents; Tn_len represents the length of table_name; Count represents field_desc tuple example number.
Of particular note, what write down in the synchronization log file is the binary code stream of raw data, be indifferent to concrete data type and operating system platform type, so, the synchronization log file is the file of a binary format, so promptly make and write efficient and convenient that daily record becomes, also increased facility simultaneously for follow-up transmission and parsing.
203, transmitting synchronous journal file: data synchronization unit regularly obtains new synchronization log file (being the synchronization log file of suffix " .r " by name) and preservation from memory database place main frame.
See also Fig. 3, this step specifically may further comprise the steps:
301, the timer (assumption period is N minute) in a fixed length cycle is set, and timing enters step 302 after arriving.
302, data synchronization unit and memory database place main frame connect.
303, new synchronization log file on the main frame of data synchronization unit audit memory database place.
304, data synchronization unit obtains above-mentioned new synchronization log file by File Transfer Protocol successively by the file sequence number, and it is saved in the local assigned catalogue.
305, the suffix name of the synchronization log file that will be have been obtained by data synchronization unit of memory database changes to " .o ".
204, resolve the synchronization log file: data synchronization unit is resolved the synchronization log file under the local assigned catalogue, generates the basic SQL statement of corresponding syntax rule according to the type of target physical database.For example, the transfer function of date type is just different in the SQL grammer of ORACLE and SYBASE database, and the former is to_date (), and the latter is convert ().Resolving synoptic diagram as shown in Figure 4.
205, the SQL statement of reforming: data synchronization unit connects by the driver and the target physical database of invocation target physical database, carry out above-mentioned basic SQL statement afterwards, after a synchronization log document analysis finishes, with Bulk Rename Utility is the suffix of .o, and expression this document is processed.
206, local scratch file management: the synchronization log file of preserving in the assigned catalogue of data synchronization unit quantitative check this locality, delete wherein the synchronization log file of dissection process, avoid disk space to be taken by scratch file.
Below be an application case of the present invention:
Amount of user data is very big in existing " cell SMS operation system ", and the paging call amount is very high, and performance requirement is also very high.The common database based on the fixed disk file storage can't reach this requirement, and in order to satisfy these demands, user data need be buffered in the database based on internal memory of special exploitation.For example, data such as user IMSI and phone number corresponding relation, sub-district advertisement, blacklist, white list, gray list, keyword filtration all are buffered in the internal memory.How like this, just a problem having appearred: after the data in the memory database are revised by call flow, to be synchronized to the ORACLE database on backstage? after using the present invention, promptly ideally address this problem.
Above embodiment is only unrestricted in order to technical scheme of the present invention to be described, only with reference to preferred embodiment the present invention is had been described in detail.Those of ordinary skill in the art should be appreciated that and can make amendment or be equal to replacement technical scheme of the present invention, and do not break away from the spirit and scope of technical solution of the present invention, all should be encompassed in the middle of the claim scope of the present invention.
Claims (7)
1, a kind of data synchronous system comprises memory database and physical database, it is characterized in that, this system also comprises data synchronization unit, and comprises the synchronization log generation module in the described memory database;
Described memory database when carrying out the data modification operation, calls described synchronization log generation module at every turn, generates the synchronization log file in order to record data retouching operation information, and preserves this synchronization log file;
Described data synchronization unit, be used for regularly obtaining the newly-generated synchronization log file of described memory database by file transfer protocol (FTP), this synchronization log file is resolved, convert thereof into the basic SQL statement of the syntax rule that meets the target physical database, carry out described SQL statement after connecting with the target physical database.
2, data synchronous system as claimed in claim 1 is characterized in that, described data synchronization unit comprises:
The synchronization log document transmission module is used for regularly obtaining newly-generated synchronization log file from described memory database, and it is deposited in the local assigned catalogue;
Synchronization log document analysis module is used for the synchronization log file of described assigned catalogue is resolved line by line, converts thereof into the basic SQL statement of the syntax rule that meets the target physical database;
The synchronization log file module of reforming is used for setting up and safeguarding the physical database connection pool, the described basic SQL statement of back execution that connects of driver and the target physical database by the invocation target physical database.
3, data synchronous system as claimed in claim 2, it is characterized in that, described data synchronization unit also comprises log management module, is used for the synchronization log file that the assigned catalogue of the described this locality of quantitative check is preserved, and deletion is the synchronization log file of dissection process wherein.
4, the method for data synchronization between a kind of memory database and physical database is characterized in that, comprising:
Memory database whenever carries out data modification when operation, generates synchronization log file in order to record data retouching operation information according to set standard, and this document is stored in memory database place main frame;
Data synchronization unit regularly obtains newly-generated synchronization log file from described memory database place main frame, it is stored in the local assigned catalogue, then this document is resolved, convert thereof into the basic SQL statement of the syntax rule that meets the target physical database, connect with the target physical database afterwards, carry out described basic SQL statement.
5, method of data synchronization as claimed in claim 4 is characterized in that, described method also comprises: the synchronization log file of being preserved in the assigned catalogue of described data synchronization unit quantitative check this locality, delete wherein the synchronization log file of dissection process.
6, as claim 4 or 5 described method of data synchronization, it is characterized in that the content of described synchronization log file comprises: whether log serial number, daily record length, this daily record need title, the table name of sync id, table to claim length and data modification information.
As claim 4 or 5 described method of data synchronization, it is characterized in that 7, described synchronization log file is a binary format.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008102163741A CN101369283A (en) | 2008-09-25 | 2008-09-25 | Data synchronization method and system for internal memory database physical data base |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008102163741A CN101369283A (en) | 2008-09-25 | 2008-09-25 | Data synchronization method and system for internal memory database physical data base |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101369283A true CN101369283A (en) | 2009-02-18 |
Family
ID=40413098
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2008102163741A Pending CN101369283A (en) | 2008-09-25 | 2008-09-25 | Data synchronization method and system for internal memory database physical data base |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101369283A (en) |
Cited By (44)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101808121A (en) * | 2010-02-24 | 2010-08-18 | 深圳市五巨科技有限公司 | Method and device for writing server log of mobile terminal into database |
| CN101815261A (en) * | 2010-02-23 | 2010-08-25 | 深圳市五巨科技有限公司 | Method and device for generating mobile terminal report forms |
| WO2010145277A1 (en) * | 2009-10-23 | 2010-12-23 | 中兴通讯股份有限公司 | Method, device and system for implementing data synchronization between source database and target database |
| CN101944114A (en) * | 2010-09-16 | 2011-01-12 | 深圳天源迪科信息技术股份有限公司 | Data synchronization method between memory database and physical database |
| CN102158345A (en) * | 2010-06-23 | 2011-08-17 | 青岛海信传媒网络技术有限公司 | Method, device and system for data management |
| CN102222071A (en) * | 2010-04-16 | 2011-10-19 | 华为技术有限公司 | Method, device and system for data synchronous processing |
| CN102289469A (en) * | 2011-07-26 | 2011-12-21 | 国电南瑞科技股份有限公司 | Method for supporting universal database to synchronize data based on physical isolating equipment |
| CN101719149B (en) * | 2009-12-03 | 2012-02-08 | 联动优势科技有限公司 | Data synchronization method and device |
| CN102346775A (en) * | 2011-09-26 | 2012-02-08 | 苏州博远容天信息科技有限公司 | Method for synchronizing multiple heterogeneous source databases based on log |
| CN102508835A (en) * | 2011-09-22 | 2012-06-20 | 用友软件股份有限公司 | Incremental data real-time synchronizing device based on log management packet and incremental data real-time synchronizing method based on same |
| CN102752372A (en) * | 2012-06-18 | 2012-10-24 | 天津神舟通用数据技术有限公司 | File based database synchronization method |
| CN102841897A (en) * | 2011-06-23 | 2012-12-26 | 阿里巴巴集团控股有限公司 | Incremental data extracting method, device and system |
| CN102929657A (en) * | 2012-09-27 | 2013-02-13 | 北京百度网讯科技有限公司 | Internal memory data sharing method, device and system |
| CN103020071A (en) * | 2011-09-22 | 2013-04-03 | 中兴通讯股份有限公司 | Data synchronization method and data synchronization device |
| CN103902409A (en) * | 2013-10-21 | 2014-07-02 | 华为技术有限公司 | Log backup method and log backup device |
| CN104184822A (en) * | 2014-08-29 | 2014-12-03 | 海视云（北京）科技有限公司 | Data synchronism method and system |
| CN104915380A (en) * | 2015-05-13 | 2015-09-16 | 福建省纳金网信息技术有限公司 | Historian database and MongoDB database data synchronization method |
| CN105373541A (en) * | 2014-08-22 | 2016-03-02 | 博雅网络游戏开发（深圳）有限公司 | Processing method and system for data operation request of database |
| CN105721531A (en) * | 2014-12-05 | 2016-06-29 | 华为软件技术有限公司 | Message synchronization method and apparatus |
| CN106302499A (en) * | 2016-08-26 | 2017-01-04 | 迈普通信技术股份有限公司 | A kind of security log acquisition method, Apparatus and system |
| CN106709043A (en) * | 2016-12-30 | 2017-05-24 | 江苏瑞中数据股份有限公司 | Data synchronous loading method based on database log |
| CN107016016A (en) * | 2016-10-10 | 2017-08-04 | 阿里巴巴集团控股有限公司 | A kind of method and device of data processing |
| CN107247719A (en) * | 2016-12-21 | 2017-10-13 | 常熟市顺网网络技术服务有限公司 | A kind of design method of quick foundation index |
| CN107423303A (en) * | 2016-05-24 | 2017-12-01 | 北京京东尚科信息技术有限公司 | The method and system of data syn-chronization |
| CN107885824A (en) * | 2017-11-07 | 2018-04-06 | 北京锐安科技有限公司 | A kind of data read-write method and system |
| WO2018113484A1 (en) * | 2016-12-22 | 2018-06-28 | 华为技术有限公司 | Method and apparatus for recovering multi-replica data |
| CN105407143B (en) * | 2015-10-26 | 2018-10-23 | 山东金质信息技术有限公司 | A kind of synchronous method of normal data |
| CN109271448A (en) * | 2018-09-25 | 2019-01-25 | 武汉达梦数据库有限公司 | It is the data synchronous system and method for platform based on database |
| CN110147411A (en) * | 2019-05-20 | 2019-08-20 | 平安科技（深圳）有限公司 | Method of data synchronization, device, computer equipment and storage medium |
| CN110209642A (en) * | 2018-02-05 | 2019-09-06 | 北京智明星通科技股份有限公司 | Method, apparatus, server and the computer-readable medium of information processing |
| CN110515913A (en) * | 2019-08-02 | 2019-11-29 | 北京互金新融科技有限公司 | Log processing method and device |
| CN110941623A (en) * | 2019-11-12 | 2020-03-31 | 北京达佳互联信息技术有限公司 | Data synchronization method and device |
| CN111448560A (en) * | 2017-12-14 | 2020-07-24 | 谷歌有限责任公司 | Database synchronization |
| CN111694799A (en) * | 2020-04-30 | 2020-09-22 | 武汉达梦数据库有限公司 | Parallel log analysis method and data synchronization system based on log analysis synchronization |
| CN112307060A (en) * | 2019-08-01 | 2021-02-02 | 北京京东振世信息技术有限公司 | Method and device for processing picking task |
| CN112667650A (en) * | 2020-12-28 | 2021-04-16 | 北京华大智宝电子系统有限公司 | Database updating method and device |
| CN112883040A (en) * | 2021-02-04 | 2021-06-01 | 中国工商银行股份有限公司 | Data synchronization method, device and equipment |
| CN113010607A (en) * | 2021-04-06 | 2021-06-22 | 工银科技有限公司 | Method, device, computer system and storage medium for data synchronization between systems |
| CN113297150A (en) * | 2021-06-22 | 2021-08-24 | 中国农业银行股份有限公司 | Database log processing method, device, equipment and storage medium |
| CN113396407A (en) * | 2018-12-04 | 2021-09-14 | 泽乌科技公司 | System and method for augmenting database applications using blockchain techniques |
| CN113420037A (en) * | 2021-06-27 | 2021-09-21 | 杭州迪普科技股份有限公司 | Real-time asset data changing method and device |
| CN114003622A (en) * | 2021-12-30 | 2022-02-01 | 天津南大通用数据技术股份有限公司 | Huge transaction increment synchronization method between transaction type databases |
| CN114416868A (en) * | 2021-12-30 | 2022-04-29 | 联通智网科技股份有限公司 | Data synchronization method, device, equipment and storage medium |
| CN115941120A (en) * | 2023-01-10 | 2023-04-07 | 北京东远润兴科技有限公司 | Data synchronization method, device, equipment and storage medium |
-
2008
- 2008-09-25 CN CNA2008102163741A patent/CN101369283A/en active Pending
Cited By (63)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010145277A1 (en) * | 2009-10-23 | 2010-12-23 | 中兴通讯股份有限公司 | Method, device and system for implementing data synchronization between source database and target database |
| US8655836B2 (en) | 2009-10-23 | 2014-02-18 | Zte Corporation | Method, device and system for implementing data synchronization between source database and target database |
| CN101719149B (en) * | 2009-12-03 | 2012-02-08 | 联动优势科技有限公司 | Data synchronization method and device |
| CN101815261A (en) * | 2010-02-23 | 2010-08-25 | 深圳市五巨科技有限公司 | Method and device for generating mobile terminal report forms |
| CN101808121A (en) * | 2010-02-24 | 2010-08-18 | 深圳市五巨科技有限公司 | Method and device for writing server log of mobile terminal into database |
| CN102222071B (en) * | 2010-04-16 | 2014-04-02 | 华为技术有限公司 | Method, device and system for data synchronous processing |
| CN102222071A (en) * | 2010-04-16 | 2011-10-19 | 华为技术有限公司 | Method, device and system for data synchronous processing |
| CN102158345A (en) * | 2010-06-23 | 2011-08-17 | 青岛海信传媒网络技术有限公司 | Method, device and system for data management |
| CN102158345B (en) * | 2010-06-23 | 2013-06-05 | 青岛海信传媒网络技术有限公司 | Method, device and system for data management |
| CN101944114B (en) * | 2010-09-16 | 2012-07-25 | 深圳天源迪科信息技术股份有限公司 | Data synchronization method between memory database and physical database |
| CN101944114A (en) * | 2010-09-16 | 2011-01-12 | 深圳天源迪科信息技术股份有限公司 | Data synchronization method between memory database and physical database |
| CN102841897A (en) * | 2011-06-23 | 2012-12-26 | 阿里巴巴集团控股有限公司 | Incremental data extracting method, device and system |
| CN102841897B (en) * | 2011-06-23 | 2016-03-02 | 阿里巴巴集团控股有限公司 | A kind of method, Apparatus and system realizing incremental data and extract |
| CN102289469A (en) * | 2011-07-26 | 2011-12-21 | 国电南瑞科技股份有限公司 | Method for supporting universal database to synchronize data based on physical isolating equipment |
| CN102508835A (en) * | 2011-09-22 | 2012-06-20 | 用友软件股份有限公司 | Incremental data real-time synchronizing device based on log management packet and incremental data real-time synchronizing method based on same |
| CN103020071B (en) * | 2011-09-22 | 2017-11-28 | 中兴通讯股份有限公司 | Method of data synchronization and device |
| CN103020071A (en) * | 2011-09-22 | 2013-04-03 | 中兴通讯股份有限公司 | Data synchronization method and data synchronization device |
| CN102346775A (en) * | 2011-09-26 | 2012-02-08 | 苏州博远容天信息科技有限公司 | Method for synchronizing multiple heterogeneous source databases based on log |
| CN102752372A (en) * | 2012-06-18 | 2012-10-24 | 天津神舟通用数据技术有限公司 | File based database synchronization method |
| CN102929657A (en) * | 2012-09-27 | 2013-02-13 | 北京百度网讯科技有限公司 | Internal memory data sharing method, device and system |
| CN103902409A (en) * | 2013-10-21 | 2014-07-02 | 华为技术有限公司 | Log backup method and log backup device |
| CN105373541B (en) * | 2014-08-22 | 2019-03-22 | 博雅网络游戏开发（深圳）有限公司 | The processing method and system of the data operation request of database |
| CN105373541A (en) * | 2014-08-22 | 2016-03-02 | 博雅网络游戏开发（深圳）有限公司 | Processing method and system for data operation request of database |
| CN104184822A (en) * | 2014-08-29 | 2014-12-03 | 海视云（北京）科技有限公司 | Data synchronism method and system |
| CN105721531B (en) * | 2014-12-05 | 2020-01-31 | 华为软件技术有限公司 | message synchronization method and device |
| CN105721531A (en) * | 2014-12-05 | 2016-06-29 | 华为软件技术有限公司 | Message synchronization method and apparatus |
| CN104915380A (en) * | 2015-05-13 | 2015-09-16 | 福建省纳金网信息技术有限公司 | Historian database and MongoDB database data synchronization method |
| CN104915380B (en) * | 2015-05-13 | 2018-07-27 | 福建省纳金网信息技术有限公司 | A kind of method of Historian databases and MongoDB database in phase |
| CN105407143B (en) * | 2015-10-26 | 2018-10-23 | 山东金质信息技术有限公司 | A kind of synchronous method of normal data |
| CN107423303B (en) * | 2016-05-24 | 2021-02-26 | 北京京东尚科信息技术有限公司 | Method and system for data synchronization |
| CN107423303A (en) * | 2016-05-24 | 2017-12-01 | 北京京东尚科信息技术有限公司 | The method and system of data syn-chronization |
| CN106302499A (en) * | 2016-08-26 | 2017-01-04 | 迈普通信技术股份有限公司 | A kind of security log acquisition method, Apparatus and system |
| CN106302499B (en) * | 2016-08-26 | 2019-08-27 | 迈普通信技术股份有限公司 | A kind of security log acquisition method, apparatus and system |
| CN107016016A (en) * | 2016-10-10 | 2017-08-04 | 阿里巴巴集团控股有限公司 | A kind of method and device of data processing |
| CN107247719A (en) * | 2016-12-21 | 2017-10-13 | 常熟市顺网网络技术服务有限公司 | A kind of design method of quick foundation index |
| WO2018113484A1 (en) * | 2016-12-22 | 2018-06-28 | 华为技术有限公司 | Method and apparatus for recovering multi-replica data |
| US11132265B2 (en) | 2016-12-22 | 2021-09-28 | Huawei Technologies Co., Ltd. | Multi-replica data restoration method and apparatus |
| CN106709043A (en) * | 2016-12-30 | 2017-05-24 | 江苏瑞中数据股份有限公司 | Data synchronous loading method based on database log |
| CN107885824A (en) * | 2017-11-07 | 2018-04-06 | 北京锐安科技有限公司 | A kind of data read-write method and system |
| CN111448560A (en) * | 2017-12-14 | 2020-07-24 | 谷歌有限责任公司 | Database synchronization |
| CN110209642A (en) * | 2018-02-05 | 2019-09-06 | 北京智明星通科技股份有限公司 | Method, apparatus, server and the computer-readable medium of information processing |
| CN109271448A (en) * | 2018-09-25 | 2019-01-25 | 武汉达梦数据库有限公司 | It is the data synchronous system and method for platform based on database |
| CN113396407A (en) * | 2018-12-04 | 2021-09-14 | 泽乌科技公司 | System and method for augmenting database applications using blockchain techniques |
| CN110147411A (en) * | 2019-05-20 | 2019-08-20 | 平安科技（深圳）有限公司 | Method of data synchronization, device, computer equipment and storage medium |
| CN110147411B (en) * | 2019-05-20 | 2024-05-28 | 平安科技（深圳）有限公司 | Data synchronization method, device, computer equipment and storage medium |
| CN112307060A (en) * | 2019-08-01 | 2021-02-02 | 北京京东振世信息技术有限公司 | Method and device for processing picking task |
| CN112307060B (en) * | 2019-08-01 | 2024-04-23 | 北京京东振世信息技术有限公司 | Method and device for processing picking task |
| CN110515913B (en) * | 2019-08-02 | 2022-08-09 | 北京互金新融科技有限公司 | Log processing method and device |
| CN110515913A (en) * | 2019-08-02 | 2019-11-29 | 北京互金新融科技有限公司 | Log processing method and device |
| CN110941623A (en) * | 2019-11-12 | 2020-03-31 | 北京达佳互联信息技术有限公司 | Data synchronization method and device |
| CN111694799A (en) * | 2020-04-30 | 2020-09-22 | 武汉达梦数据库有限公司 | Parallel log analysis method and data synchronization system based on log analysis synchronization |
| CN111694799B (en) * | 2020-04-30 | 2023-04-25 | 武汉达梦数据库股份有限公司 | Parallel log analysis method and data synchronization system based on log analysis synchronization |
| CN112667650A (en) * | 2020-12-28 | 2021-04-16 | 北京华大智宝电子系统有限公司 | Database updating method and device |
| CN112667650B (en) * | 2020-12-28 | 2024-05-28 | 北京华大智宝电子系统有限公司 | Database updating method and device |
| CN112883040A (en) * | 2021-02-04 | 2021-06-01 | 中国工商银行股份有限公司 | Data synchronization method, device and equipment |
| CN113010607A (en) * | 2021-04-06 | 2021-06-22 | 工银科技有限公司 | Method, device, computer system and storage medium for data synchronization between systems |
| CN113297150A (en) * | 2021-06-22 | 2021-08-24 | 中国农业银行股份有限公司 | Database log processing method, device, equipment and storage medium |
| CN113420037A (en) * | 2021-06-27 | 2021-09-21 | 杭州迪普科技股份有限公司 | Real-time asset data changing method and device |
| CN114416868A (en) * | 2021-12-30 | 2022-04-29 | 联通智网科技股份有限公司 | Data synchronization method, device, equipment and storage medium |
| CN114416868B (en) * | 2021-12-30 | 2023-02-17 | 联通智网科技股份有限公司 | Data synchronization method, device, equipment and storage medium |
| CN114003622B (en) * | 2021-12-30 | 2022-04-08 | 天津南大通用数据技术股份有限公司 | Huge transaction increment synchronization method between transaction type databases |
| CN114003622A (en) * | 2021-12-30 | 2022-02-01 | 天津南大通用数据技术股份有限公司 | Huge transaction increment synchronization method between transaction type databases |
| CN115941120A (en) * | 2023-01-10 | 2023-04-07 | 北京东远润兴科技有限公司 | Data synchronization method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101369283A (en) | Data synchronization method and system for internal memory database physical data base | |
| US10853340B2 (en) | Static sorted index replication | |
| WO2022126974A1 (en) | Kafka-based incremental data synchronization method and apparatus, device, and medium | |
| CN102521269B (en) | Index-based computer continuous data protection method | |
| US7392263B2 (en) | File system represented inside a database | |
| CN103294710B (en) | A kind of data access method and device | |
| US9418094B2 (en) | Method and apparatus for performing multi-stage table updates | |
| CN103902410B (en) | The data backup accelerated method of cloud storage system | |
| US11308030B2 (en) | Log-structured merge-tree with blockchain properties | |
| CN107016027A (en) | The method and apparatus for realizing business information fast search | |
| US20220035786A1 (en) | Distributed database management system with dynamically split b-tree indexes | |
| CN105373541A (en) | Processing method and system for data operation request of database | |
| AU2015316450A1 (en) | Method for updating data table of KeyValue database and apparatus for updating table data | |
| CN111367991B (en) | MongoDB data real-time synchronization method and system based on message queue | |
| WO2019040146A1 (en) | Key ticketing system with lock-free concurrency and versioning | |
| CN110442645B (en) | Data indexing method and device | |
| US11210212B2 (en) | Conflict resolution and garbage collection in distributed databases | |
| CN116975159B (en) | Incremental data synchronization processing method | |
| CN107342944B (en) | A kind of distribution of ID mark and persistence method and system | |
| CN104584015A (en) | Digital aging system and method for operating same | |
| CN111026764B (en) | Data storage method and device, electronic product and storage medium | |
| CN115794819A (en) | Data writing method and electronic equipment | |
| CN116821232A (en) | Data synchronization method and related device | |
| CN110287172B (en) | Method for formatting HBase data | |
| CN111782721A (en) | Data synchronization method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20090218 |