CN110275893A - A kind of data manipulation method and device - Google Patents
A kind of data manipulation method and device Download PDFInfo
- Publication number
- CN110275893A CN110275893A CN201910499930.9A CN201910499930A CN110275893A CN 110275893 A CN110275893 A CN 110275893A CN 201910499930 A CN201910499930 A CN 201910499930A CN 110275893 A CN110275893 A CN 110275893A
- Authority
- CN
- China
- Prior art keywords
- log
- database
- sql
- data
- obtains
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of data manipulation method and devices, comprising: after determining that the first log in first database, first log are included in first time, log that application server increases the first database, is deleted or modified;According to first log, the second log is obtained;According to second log, second database is operated.By the method and device in the embodiment of the present application, it can be achieved that the data stored in two databases are consistent.
Description
Technical field
This application involves computer field more particularly to a kind of data manipulation methods and device.
Background technique
In computer field, there are multiple databases, such as first database and the second database etc..How to guarantee not
It is consistent with the day data stored in database, it is current research hotspot.For example, application server carries out first database
How the operation such as add drop/change, guarantee that the second database also carries out corresponding operation, to guarantee the number stored in two databases
According to consistent.
Summary of the invention
The embodiment of the present application provides a kind of data manipulation method and device, to guarantee the number stored at least two databases
According to consistent.
In a first aspect, providing a kind of data manipulation method, comprising: determine the first log in first database, described
After one log is included in first time, log that application server increases the first database, is deleted or modified;Root
According to first log, the second log is obtained;According to second log, second database is operated.
The first log in a kind of possible design, in the determining first database, comprising: caught using data change
CDC function is obtained, the first log in the first database is obtained.
It is described according to first log in a kind of possible design, obtain the second log, comprising:
Using the first programming language, first log is decapsulated, is obtained corresponding to first log
Source code, the first programming language is that the first database writes language;Using the second programming language,
The source code is packaged, second log is obtained, the second programming language is second database
Write language.
In a kind of possible design, the first database is SQL server, and second database is My SQL.
The first log in a kind of possible design, in the determining first database, comprising: record first number
According to generation change or the potential sentence changed in library;The sentence is saved in binary form, obtains first log.
It is described according to first log in a kind of possible design, obtain the second log, comprising:
First log is parsed, third log is obtained;Third log is pushed into first queue;Utilize first
Script explains the third log in the first queue, obtains second log.
In a kind of possible design, the first database is My SQL, and second database is SQLserver.
It is described that second database is operated according to second log in a kind of possible design, packet
It includes: if second log is written to the corresponding position in second database to increase log by second log;
If second log is modification log, in second database, modify operation to corresponding log;If described
Two logs are to delete log to delete corresponding log then in second database.
Second aspect provides a kind of data operation device, comprising: determining module, for determining in first database
One log, after first log is included in first time, application server increases the first database, delete or
The log of modification;Module is obtained, for obtaining the second log according to first log;Operation module, for according to described the
Two logs operate second database.
About determining module, the concrete function of module and operation module is obtained, reference can be made to the record of above-mentioned first aspect,
No longer illustrate herein.
The third aspect provides a kind of data operation device, comprising: memory and processor;Memory, for storing journey
Sequence instruction;Processor executes above-mentioned first party according to the program of acquisition for calling the program instruction stored in the memory
Method in face or any possible design of first aspect.
Fourth aspect, provides a kind of computer readable storage medium, and the computer-readable recording medium storage has calculating
Machine instruction, when the computer instruction is run on computers, so that computer executes above-mentioned first aspect or first aspect
The method of any possible design.
Therefore in the embodiment of the present application, determine that the first log of first database is obtained according to the first log
Second log operates the second database according to the second log, that is, can guarantee in first database and the second database
Data are consistent.
Detailed description of the invention
Fig. 1 is the schematic diagram of program dual operation provided by the embodiment of the present application;
Fig. 2 is the flow diagram provided by the embodiments of the present application to data manipulation method;
Fig. 3 is the configuration diagram of data migration operation provided by the embodiments of the present application;
Fig. 4 is a flow diagram of data migration operation provided by the embodiments of the present application;
Fig. 5 is the configuration diagram of data-backoff provided by the embodiments of the present application operation;
Fig. 6 is a kind of structural schematic diagram of device provided by the embodiments of the present application;
Fig. 7 is another structural schematic diagram of device provided by the embodiments of the present application.
Specific embodiment
In order to keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with attached drawing to this Shen
Please embodiment be described in further detail, it is clear that described embodiment is only the embodiment of the present application a part of the embodiment,
Instead of all the embodiments.Based on the embodiment in the embodiment of the present application, those of ordinary skill in the art are not making wound
All other embodiment obtained under the premise of the property made labour, belongs to the range of the embodiment of the present application protection.
In internet industry, open source brings many advantages, has pushed and Windows (windows) is largely gone to change
Project.Wherein, to include: development language move to Java from C# or .net for most crucial work, and relevant database is from structuring
Query language server (structured query language server, SQL server) moves to My SQL.
Wherein, in the data migration process for carrying out SQL server to My SQL, if application server is to SQL
Data in server carry out the operations such as add drop/change, and how to guarantee that the data in the two are consistent, are the hot spots currently paid close attention to.
Common solution are as follows: application server carries out program dual operation to SQL server and My SQL.For example, such as
Shown in Fig. 1, database administrator is in 0 point to 1 point progress Data Migration of morning, between 0 point to 1 point of morning, application server
Can be to the data in My SQL and SQL server, while the operation such as carry out add drop/change.After 1 point, Data Migration is completed,
Database administrator can carry out data check to SQL server and My SQL, to guarantee the completely the same of data in the two.It
Afterwards, database formally can be moved to My SQL by SQL server, application server only to My SQL carry out the increasing of one way sequence/
The operation such as change/delete.
Since SQL server and My SQL are the database languages for adhering to different company separately, bottom-layer design, development language,
Realization principle and product function are very different, and are operated using above-mentioned dual program, are needed the code to original application program
It is transformed, and improved code is also online by multiple test ability, increases system complexity.
Further, in the embodiment of the present application, when by the data in SQL server, after moving to My SQL, if My
SQL occurs abnormal, how by the data in My SQL, then return back in SQL server and the embodiment of the present application to be solved
Certainly the problem of.
It is understood that above-mentioned scene is only illustrating for the embodiment of the present application, it is not intended as implementing the application
The restriction of example.For example, scheme provided by the embodiment of the present application, applies also in other scenes in addition to above-mentioned scene.The
One ", the vocabulary such as " second " are only used for distinguishing the purpose of description, are not understood to indicate or imply relative importance, can not
It is interpreted as indication or suggestion sequence.
As shown in Fig. 2, providing a kind of process of data manipulation method, the first database in the process can be above-mentioned scene
In SQL server, the second database can be the My SQL in above-mentioned scene, alternatively, first database can be in above-mentioned scene
My SQL, the second database can be the SQL server in above-mentioned scene, comprising:
Step 201: determining the first log in first database.
Step 202: according to the first log, obtaining the second log.
Step 203: the second database being operated according to the second log.
It is exemplary, if second log is to increase log, second log can be written to second database
In corresponding position;If second log is modification, log modifies to corresponding log in second database
Operation;If second log is to delete log to delete corresponding log in second database.
Therefore in the embodiment of the present application, determine that the first log of first database is obtained according to the first log
Second log operates the second database according to the second log, that is, can guarantee in first database and the second database
Data are consistent.
Example one
Scheme in the embodiment of the present application can be applied to the process of Data Migration, during being applied to Data Migration,
First database in process shown in above-mentioned Fig. 2 can be SQL server, and the second database can be My SQL.
The specific implementation process of above-mentioned S201 can are as follows: can open data change capture (the change data of first database
Capture, CDC) function, using CDC capturing function, capture takes the increase of first database, the log being deleted or modified, described
The log increase, being deleted or modified, the first log of process shown in as above-mentioned Fig. 2.
The specific implementation process of above-mentioned S202 can are as follows: and the first programming language is utilized, the first log is decapsulated,
The corresponding source code of the first log is obtained, the first programming language writes language for first database.Utilize second
Programming language, is packaged source code, obtains the second log, and the second programming language is writing for the second database
Language.For example, realizing above-mentioned first log to the second log using the open source projects yugong that group, Alibaba provides
Conversion process.
Exemplary, in the embodiment of the present application, with first database for SQL server, the second database is My SQL,
The process of above-mentioned Data Migration is described in detail.Data consistency in the two database can guarantee using the above method.
As shown in figure 3, in the embodiment of the present application, using CDC function, the tables of data captured in SQL server becomes
More, tables of data change may include the deletion of specified table, modification or increase log, i.e., above-mentioned first log, then using Ah
The open source projects yugong that Li Baba group provides moves to the above-mentioned log of capture on My SQL.My SQL is being received
After the log of above-mentioned capture, according to the log of above-mentioned capture, My SQL is operated.On how to according to the log of capture,
My SQL is operated, reference can be made to the record in process shown in above-mentioned Fig. 2, no longer illustrates herein.
Based on above-mentioned framework shown in Fig. 3, as shown in figure 4, providing a kind of specific data manipulation process.Whole flow process packet
Include three phases, respectively preparation stage, migration phase and switch step.
Wherein, in the preparation stage, the CDC capturing function of SQL server can be first turned on.It then will be from SQL
Data on stock is exported in server.The data on stock can refer to the total data stored in current SQL server.Then will
Data on stock imported into My SQL.It is understood that above-mentioned export data on stock from SQL server, it is directed into My SQL's
In the process, it needs to spend certain duration.In this process, it is also necessary to provide service for application server, application server can
It the operation such as can be increased SQL server, modified or be deleted.Data in order to guarantee the two are consistent, also lead above-mentioned
Out/importing data, are synchronized in My SQL.In the embodiment of the present application, incremental data will be persistently consumed using yugong,
It is synchronized in My SQL, the persistently consumption incremental data is the application service during data of above-mentioned export/importing
The data that device increases SQL server, revises or modify.
For example, in the embodiment of the present application, at 0 point to 1 point of morning, the total data in SQL server is directed into
In My server, then, in the above process, application server or labor management system etc. may be in SQL server
Data modify, delete or increase.In the embodiment of the present application, using yugong function, by above-mentioned 0 point to 1 point
In the process, the data for modification occurring in SQL server, deleting or increasing newly, are synchronized in My SQL.
, can be by application switching to read-only status, in a read-only state in migration phase, application server can only read SQL
The data in SQL server cannot be modified or be increased to the data of server.Using yugong function, above-mentioned consumption incremental data
It synchronously completes.I.e. above-mentioned 0 point to the 1 point data that modification occurs, increases or deletes, it is fully synchronized into My SQL.Then, may be used
Consistency desired result is carried out, so-called consistency desired result is whether the data verified in SQL server and My SQL are completed unanimously.
It is switched to My SQL in switch step, including reading flow and writes flow and be switched to My SQL.It is understood that
In the embodiment of the present application, being originally SQL server provides read-write service, i.e. the reading flow of application server for application server
With write process, be to be carried out in SQL server.It in the embodiment of the present application, can be first after the completion of the migration of database
First the reading flow of application server is switched in My SQL, then the process of writing of application server is switched in My SQL.
Example two
The scheme of the embodiment of the present application, during can be applied to data-backoff, during being applied to data-backoff,
First database in process shown in above-mentioned Fig. 2 can be My SQL, and the second database can be SQL server.
The specific implementation process of above-mentioned S201 can are as follows: records and change occurs in the first database or potential changes
Sentence;The sentence is saved in binary form, obtains first log.For example, in the embodiment of the present application, can record
Change or the potential SQL statement for sending change occur in first database, and saves the sentence in the form of binary, with two
The sentence that binary form saves can also be also referred to as the first log in process shown in above-mentioned Fig. 2, first log
Binlog log.
The specific implementation process of above-mentioned S203 can are as follows: parses to first log, obtains third log;To described
First log is parsed, and third log is obtained;The third log in the first queue is explained using the first script,
Obtain second log.For example, being parsed using open source projects canal to the first log, after the canal parsing
Log can be described as third log.The first queue can be kafka queue, the log after can parsing canal, i.e. third day
Will pushes to kafka queue.First script can be python script, using python script in kafka queue
Third log is parsed, and third log is parsed into SQL server format.The SQL obtained after the parsing server days
Will, as the second log.
Exemplary, in the embodiment of the present application, with first database for My SQL, the second database is SQL server,
The process of above-mentioned data-backoff is described in detail.Using the above method, it can be achieved that data in My SQL, retract completely to SQL
In server.
As shown in figure 5, in the embodiment of the present application, My SQL will record data and change occur or potential changes
SQL statement, and be stored in disk in the form of binary namely binlog log.Utilize the open source item of group, Alibaba
Mesh canal realizes parsing binlog log, and the autoincrementing operation being resolved to is pushed to kafka message queue.Finally use python
Script is to the message interpretation in kafka queue, and the data after explaining, is inserted into the specified table in SQL server, from
And realize rollback operation of the data from My SQL to SQL server.
It is identical as above-mentioned design, as shown in fig. 6, the application also provides a kind of device 600, comprising:
Determining module 601, for determining that the first log in first database, first log are included at the first time
Afterwards, the log that application server increases the first database, is deleted or modified;
Module 602 is obtained, for obtaining the second log according to first log;
Operation module 603, for being operated to second database according to second log.
About determining module 601, the specific implementation process of module 602 and operation module 603 is obtained, reference can be made to above-mentioned side
Record in method implementation, no longer illustrates herein.It is understood that being schematic to the division of module in the embodiment of the present application
, only a kind of logical function partition, there may be another division manner in actual implementation, in addition, in each reality of the application
Each functional module applied in example can integrate in a processor, be also possible to physically exist alone, can also be two or two
It is a to be integrated in a module with upper module.Above-mentioned integrated module both can take the form of hardware realization, can also use
The form of software function module is realized.
It is identical as above-mentioned design, as shown in fig. 7, the embodiment of the present application provides a kind of device 700, for realizing above-mentioned Fig. 2
Method in shown process.
Device 700 includes at least one processor 701, for realizing the method in process shown in Fig. 2 in the above method.Show
Example ground, processor 701 can determine the first log in first database;According to first log, the second log is obtained;According to
Second log operates second database, referring specifically to the detailed description in method, no longer illustrates herein.
Device 700 can also include at least one processor 702, for storing program instruction and/or data.Memory
702 and processor 701 couple.Coupling in the embodiment of the present application is interval coupling or the communication between device, unit or module
Connection can be electrical property, mechanical or other forms, for the information exchange between device, unit or module.Processor 701
It can be with 702 cooperating of memory.Processor 701 may execute the program instruction stored in memory 702.Described at least one
At least one of a memory may include in processor.
Device 700 can also include communication interface 703, for being communicated by transmission medium and other equipment, thus
It can be communicated with other equipment for the device in device 700.Illustratively, communication interface 703 can be transceiver, electricity
Road, bus, module or other types of communication interface, other equipment can be second terminal equipment or the network equipment.Processing
Device 701 utilizes 703 sending and receiving data of communication interface, and for realizing the method in above-described embodiment.
The connection between above-mentioned communication device 703, processor 701 and memory 702 is not limited in the embodiment of the present application
Medium.The embodiment of the present application is being connected in Fig. 7 with passing through bus 704 between memory 702, processor 701 and communication interface 703
It connects, bus is indicated in Fig. 7 with thick line, and the connection type between other components is only to be schematically illustrated, does not regard it as
Limit.The bus can be divided into address bus, data/address bus, control bus etc..It is only thick with one in Fig. 7 for the ease of indicating
Line indicates, it is not intended that an only bus or a type of bus.
In the embodiment of the present application, processor can be general processor, digital signal processor, specific integrated circuit,
Field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components,
It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present application.General processor can be
Microprocessor or any conventional processor etc..The step of method in conjunction with disclosed in the embodiment of the present application, can directly embody
Execute completion for hardware processor, or in processor hardware and software module combination execute completion.
In the embodiment of the present application, memory can be nonvolatile memory, such as hard disk (hard disk drive,
HDD) or solid state hard disk (solid-state drive, SSD) etc., it can also be volatile memory (volatile
), such as random access memory (random-access memory, RAM) memory.Memory can be used for carrying or deposit
Store up the desired program code with instruction or data structure form and can be by any other medium of computer access, but not
It is limited to this.Memory in the embodiment of the present application can also be circuit or other devices that arbitrarily can be realized store function,
For storing program instruction and/or data.
It, can be wholly or partly by software, hardware, firmware or it is any in method provided by the embodiments of the present application
Combination is to realize.When implemented in software, it can entirely or partly realize in the form of a computer program product.The meter
Calculation machine program product includes one or more computer instructions.Load and execute on computers the computer program instructions
When, it entirely or partly generates according to process or function described in the embodiment of the present invention.The computer can be general-purpose computations
Machine, special purpose computer, computer network, the network equipment, user equipment or other programmable devices.The computer instruction can
To store in a computer-readable storage medium, or computer-readable deposit from a computer readable storage medium to another
Storage media transmission, for example, the computer instruction can pass through from a web-site, computer, server or data center
Wired (such as coaxial cable, optical fiber, Digital Subscriber Line (digital subscriber line, abbreviation DSL)) or wireless (example
Such as infrared, wireless, microwave) mode transmitted to another web-site, computer, server or data center.It is described
Computer readable storage medium can be any usable medium that computer can access or include one or more available
The data storage devices such as medium integrated server, data center.The usable medium can be magnetic medium (for example, floppy disk,
Hard disk, tape), optical medium (for example, digital video disk (digital video disc, abbreviation DVD)) or semiconductor be situated between
Matter (such as SSD) etc..
Obviously, those skilled in the art can carry out various modification and variations without departing from the model of the application to the application
It encloses.In this way, if these modifications and variations of the application belong within the scope of the claim of this application and its equivalent technologies, then
The application is also intended to include these modifications and variations.
In the embodiment of the present application, "at least one" refers to one or more, and " multiple " refer to two or more.
"and/or" describes the incidence relation of affiliated partner, indicates may exist three kinds of relationships, for example, A and/or B, can indicate: single
Solely there are A, A and B are existed simultaneously, the case where individualism B, wherein A, B can be odd number or plural number.The general table of character "/"
Show that forward-backward correlation object is a kind of relationship of "or".At least one of " following (a) " or its similar expression, refer to these in
Any combination, any combination including individual event (a) or complex item (a).For example, at least one (a) in a, b or c, it can
To indicate: a, b, c, a and b, a and c, b and c or a and b and c, wherein a, b, c can be individually, be also possible to multiple.
Claims (18)
1. a kind of data manipulation method characterized by comprising
After determining that the first log in first database, first log are included in first time, application server is to described
The log that first database is increased, is deleted or modified;
According to first log, the second log is obtained;
According to second log, second database is operated.
2. the method as described in claim 1, which is characterized in that the first log in the determining first database, comprising:
Capture CDC function is changed using data, obtains the first log in the first database.
3. the method as described in claim 1, which is characterized in that described to obtain the second log according to first log, packet
It includes:
Using the first programming language, first log is decapsulated, obtains source corresponding to first log
Code, the first programming language write language for the first database;
Using the second programming language, the source code is packaged, obtains second log, second program is compiled
It writes language and writes language for second database.
4. method as described in any one of claims 1 to 3, which is characterized in that the first database is SQL server, institute
Stating the second database is My SQL.
5. the method as described in claim 1, which is characterized in that the first log in the determining first database, comprising:
It records and change or the potential sentence changed occurs in the first database;
The sentence is saved in binary form, obtains first log.
6. the method as described in claim 1, which is characterized in that described to obtain the second log according to first log, packet
It includes:
First log is parsed, third log is obtained;
Third log is pushed into first queue;
The third log in the first queue is explained using the first script, obtains second log.
7. such as the described in any item methods of claim 1,5,6, which is characterized in that the first database is My SQL, described
Second database is SQL server.
8. such as the described in any item methods of claim 1,2,3,5,6, which is characterized in that it is described according to second log, it is right
Second database is operated, comprising:
If second log is to increase log, second log is written to the corresponding positions in second database
It sets;
If second log is modification log, in second database, modify operation to corresponding log;
If second log is to delete log to delete corresponding log in second database.
9. a kind of data operation device characterized by comprising
Determining module, after determining that the first log in first database, first log are included in first time, application
The log that server increases the first database, is deleted or modified;
Module is obtained, for obtaining the second log according to first log;
Operation module, for being operated to second database according to second log.
10. device as claimed in claim 9, which is characterized in that the determining module is specifically used for:
Capture CDC function is changed using data, obtains the first log in the first database.
11. device as claimed in claim 9, which is characterized in that it is described to obtain module, it is specifically used for:
Using the first programming language, first log is decapsulated, obtains source corresponding to first log
Code, the first programming language write language for the first database;
Using the second programming language, the source code is packaged, obtains second log, second program is compiled
It writes language and writes language for second database.
12. such as the described in any item devices of claim 9 to 11, which is characterized in that the first database is SQL server,
Second database is My SQL.
13. device as claimed in claim 9, which is characterized in that the determining module is specifically used for:
It records and change or the potential sentence changed occurs in the first database;
The sentence is saved in binary form, obtains first log.
14. device as claimed in claim 9, which is characterized in that it is described to obtain module, it is specifically used for:
First log is parsed, third log is obtained;
Third log is pushed into first queue;
The third log in the first queue is explained using the first script, obtains second log.
15. such as the described in any item devices of claim 9,13,14, which is characterized in that the first database is My SQL, institute
Stating the second database is SQL server.
16. such as the described in any item devices of claim 9,10,11,13,14, which is characterized in that the operation module is specific to use
In:
If second log is to increase log, second log is written to the corresponding positions in second database
It sets;
If second log is modification log, in second database, modify operation to corresponding log;
If second log is to delete log to delete corresponding log in second database.
17. a kind of data operation device characterized by comprising
Memory and processor;
Memory, for storing program instruction;
Processor requires 1 to 8 according to the program execution benefit of acquisition for calling the program instruction stored in the memory
Described in any item methods.
18. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer to refer to
It enables, when the computer instruction is run on computers, so that computer perform claim requires described in any one of 1 to 8
Method.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910499930.9A CN110275893A (en) | 2019-06-11 | 2019-06-11 | A kind of data manipulation method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910499930.9A CN110275893A (en) | 2019-06-11 | 2019-06-11 | A kind of data manipulation method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110275893A true CN110275893A (en) | 2019-09-24 |
Family
ID=67962049
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910499930.9A Pending CN110275893A (en) | 2019-06-11 | 2019-06-11 | A kind of data manipulation method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110275893A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110990365A (en) * | 2019-12-03 | 2020-04-10 | 北京奇艺世纪科技有限公司 | Data synchronization method, device, server and storage medium |
CN112527903A (en) * | 2020-12-11 | 2021-03-19 | 北京首汽智行科技有限公司 | Data synchronization method based on canal platform |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106933703A (en) * | 2015-12-30 | 2017-07-07 | 阿里巴巴集团控股有限公司 | A kind of method of database data backup, device and electronic equipment |
CN107491526A (en) * | 2017-08-18 | 2017-12-19 | 国云科技股份有限公司 | A kind of system and method for Achieve Database Synchronization |
CN108647237A (en) * | 2018-03-30 | 2018-10-12 | 厦门海迈科技股份有限公司 | Method of data synchronization between isomeric relationship type database |
US10185627B2 (en) * | 2015-10-23 | 2019-01-22 | Oracle International Corporation | Synchronized test master |
-
2019
- 2019-06-11 CN CN201910499930.9A patent/CN110275893A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10185627B2 (en) * | 2015-10-23 | 2019-01-22 | Oracle International Corporation | Synchronized test master |
CN106933703A (en) * | 2015-12-30 | 2017-07-07 | 阿里巴巴集团控股有限公司 | A kind of method of database data backup, device and electronic equipment |
CN107491526A (en) * | 2017-08-18 | 2017-12-19 | 国云科技股份有限公司 | A kind of system and method for Achieve Database Synchronization |
CN108647237A (en) * | 2018-03-30 | 2018-10-12 | 厦门海迈科技股份有限公司 | Method of data synchronization between isomeric relationship type database |
Non-Patent Citations (2)
Title |
---|
浩子淘天下: "《异构数据库迁移与同步(一)之yugong》", 《HTTP://BLOG.CHUANGZHI8.CN/POSTS/%E5%BC%82%E6%9E%84%E6%95%B0%E6%8D%AE%E5%BA%93%E8%BF%81%E7%A7%BB%E4%B8%8E%E5%90%8C%E6%AD%A5-%E4%B8%80-%E4%B9%8BYUGONG.HTML》 * |
浩子淘天下: "异构数据库迁移与同步(一)之yugong", 《HTTPS://WWW.JIANSHU.COM/P/76DCC5A7873B》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110990365A (en) * | 2019-12-03 | 2020-04-10 | 北京奇艺世纪科技有限公司 | Data synchronization method, device, server and storage medium |
CN112527903A (en) * | 2020-12-11 | 2021-03-19 | 北京首汽智行科技有限公司 | Data synchronization method based on canal platform |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107506451B (en) | Abnormal information monitoring method and device for data interaction | |
US20230325287A1 (en) | Data backup method and apparatus, data recovery method and apparatus, and storage medium | |
CN110309218B (en) | Data exchange system and data writing method | |
CN106446159B (en) | A kind of method of storage file, the first virtual machine and name node | |
US11397538B2 (en) | Data migration method and apparatus | |
US11977532B2 (en) | Log record identification using aggregated log indexes | |
CN111143476B (en) | Intelligent contract data rapid query method based on database | |
CN103649926A (en) | Providing access to mainframe data objects in a heterogeneous computing environment | |
CN109918352B (en) | Memory system and method of storing data | |
US10359964B2 (en) | Reducing time to read many files from tape | |
CN113672627B (en) | Method and device for constructing index of elastic search engine | |
CN108427728A (en) | Management method, equipment and the computer-readable medium of metadata | |
CN111367873A (en) | Log data storage method and device, terminal and computer storage medium | |
US20130138612A1 (en) | Provisioning and/or synchronizing using common metadata | |
CN110275893A (en) | A kind of data manipulation method and device | |
CN110147203A (en) | A kind of file management method, device, electronic equipment and storage medium | |
US20150378835A1 (en) | Managing data storage system | |
CN108418859A (en) | The method and apparatus for writing data | |
CN109408539A (en) | Data manipulation method, device, server and storage medium | |
CN111628996A (en) | Electronic data communication method and system based on Internet of things | |
US11474981B2 (en) | Database dual-core storage system based on optical disk and method using the system | |
CN109241110A (en) | Order management method and system, electronic equipment, storage medium | |
CN114896276A (en) | Data storage method and device, electronic equipment and distributed storage system | |
US20200065162A1 (en) | Transparent, event-driven provenance collection and aggregation | |
US20210334166A1 (en) | Method, device, and computer storage medium for managing trace record |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190924 |