CN110275893A - A kind of data manipulation method and device - Google Patents

A kind of data manipulation method and device Download PDF

Info

Publication number
CN110275893A
CN110275893A CN201910499930.9A CN201910499930A CN110275893A CN 110275893 A CN110275893 A CN 110275893A CN 201910499930 A CN201910499930 A CN 201910499930A CN 110275893 A CN110275893 A CN 110275893A
Authority
CN
China
Prior art keywords
log
database
sql
data
obtains
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910499930.9A
Other languages
Chinese (zh)
Inventor
余修凯
李铁铮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Lake Information Technology Co Ltd
Original Assignee
Shanghai Lake Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Lake Information Technology Co Ltd filed Critical Shanghai Lake Information Technology Co Ltd
Priority to CN201910499930.9A priority Critical patent/CN110275893A/en
Publication of CN110275893A publication Critical patent/CN110275893A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2365Ensuring data consistency and integrity
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a kind of data manipulation method and devices, comprising: after determining that the first log in first database, first log are included in first time, log that application server increases the first database, is deleted or modified;According to first log, the second log is obtained;According to second log, second database is operated.By the method and device in the embodiment of the present application, it can be achieved that the data stored in two databases are consistent.

Description

A kind of data manipulation method and device
Technical field
This application involves computer field more particularly to a kind of data manipulation methods and device.
Background technique
In computer field, there are multiple databases, such as first database and the second database etc..How to guarantee not It is consistent with the day data stored in database, it is current research hotspot.For example, application server carries out first database How the operation such as add drop/change, guarantee that the second database also carries out corresponding operation, to guarantee the number stored in two databases According to consistent.
Summary of the invention
The embodiment of the present application provides a kind of data manipulation method and device, to guarantee the number stored at least two databases According to consistent.
In a first aspect, providing a kind of data manipulation method, comprising: determine the first log in first database, described After one log is included in first time, log that application server increases the first database, is deleted or modified;Root According to first log, the second log is obtained;According to second log, second database is operated.
The first log in a kind of possible design, in the determining first database, comprising: caught using data change CDC function is obtained, the first log in the first database is obtained.
It is described according to first log in a kind of possible design, obtain the second log, comprising:
Using the first programming language, first log is decapsulated, is obtained corresponding to first log Source code, the first programming language is that the first database writes language;Using the second programming language, The source code is packaged, second log is obtained, the second programming language is second database Write language.
In a kind of possible design, the first database is SQL server, and second database is My SQL.
The first log in a kind of possible design, in the determining first database, comprising: record first number According to generation change or the potential sentence changed in library;The sentence is saved in binary form, obtains first log.
It is described according to first log in a kind of possible design, obtain the second log, comprising:
First log is parsed, third log is obtained;Third log is pushed into first queue;Utilize first Script explains the third log in the first queue, obtains second log.
In a kind of possible design, the first database is My SQL, and second database is SQLserver.
It is described that second database is operated according to second log in a kind of possible design, packet It includes: if second log is written to the corresponding position in second database to increase log by second log; If second log is modification log, in second database, modify operation to corresponding log;If described Two logs are to delete log to delete corresponding log then in second database.
Second aspect provides a kind of data operation device, comprising: determining module, for determining in first database One log, after first log is included in first time, application server increases the first database, delete or The log of modification;Module is obtained, for obtaining the second log according to first log;Operation module, for according to described the Two logs operate second database.
About determining module, the concrete function of module and operation module is obtained, reference can be made to the record of above-mentioned first aspect, No longer illustrate herein.
The third aspect provides a kind of data operation device, comprising: memory and processor;Memory, for storing journey Sequence instruction;Processor executes above-mentioned first party according to the program of acquisition for calling the program instruction stored in the memory Method in face or any possible design of first aspect.
Fourth aspect, provides a kind of computer readable storage medium, and the computer-readable recording medium storage has calculating Machine instruction, when the computer instruction is run on computers, so that computer executes above-mentioned first aspect or first aspect The method of any possible design.
Therefore in the embodiment of the present application, determine that the first log of first database is obtained according to the first log Second log operates the second database according to the second log, that is, can guarantee in first database and the second database Data are consistent.
Detailed description of the invention
Fig. 1 is the schematic diagram of program dual operation provided by the embodiment of the present application;
Fig. 2 is the flow diagram provided by the embodiments of the present application to data manipulation method;
Fig. 3 is the configuration diagram of data migration operation provided by the embodiments of the present application;
Fig. 4 is a flow diagram of data migration operation provided by the embodiments of the present application;
Fig. 5 is the configuration diagram of data-backoff provided by the embodiments of the present application operation;
Fig. 6 is a kind of structural schematic diagram of device provided by the embodiments of the present application;
Fig. 7 is another structural schematic diagram of device provided by the embodiments of the present application.
Specific embodiment
In order to keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with attached drawing to this Shen Please embodiment be described in further detail, it is clear that described embodiment is only the embodiment of the present application a part of the embodiment, Instead of all the embodiments.Based on the embodiment in the embodiment of the present application, those of ordinary skill in the art are not making wound All other embodiment obtained under the premise of the property made labour, belongs to the range of the embodiment of the present application protection.
In internet industry, open source brings many advantages, has pushed and Windows (windows) is largely gone to change Project.Wherein, to include: development language move to Java from C# or .net for most crucial work, and relevant database is from structuring Query language server (structured query language server, SQL server) moves to My SQL.
Wherein, in the data migration process for carrying out SQL server to My SQL, if application server is to SQL Data in server carry out the operations such as add drop/change, and how to guarantee that the data in the two are consistent, are the hot spots currently paid close attention to.
Common solution are as follows: application server carries out program dual operation to SQL server and My SQL.For example, such as Shown in Fig. 1, database administrator is in 0 point to 1 point progress Data Migration of morning, between 0 point to 1 point of morning, application server Can be to the data in My SQL and SQL server, while the operation such as carry out add drop/change.After 1 point, Data Migration is completed, Database administrator can carry out data check to SQL server and My SQL, to guarantee the completely the same of data in the two.It Afterwards, database formally can be moved to My SQL by SQL server, application server only to My SQL carry out the increasing of one way sequence/ The operation such as change/delete.
Since SQL server and My SQL are the database languages for adhering to different company separately, bottom-layer design, development language, Realization principle and product function are very different, and are operated using above-mentioned dual program, are needed the code to original application program It is transformed, and improved code is also online by multiple test ability, increases system complexity.
Further, in the embodiment of the present application, when by the data in SQL server, after moving to My SQL, if My SQL occurs abnormal, how by the data in My SQL, then return back in SQL server and the embodiment of the present application to be solved Certainly the problem of.
It is understood that above-mentioned scene is only illustrating for the embodiment of the present application, it is not intended as implementing the application The restriction of example.For example, scheme provided by the embodiment of the present application, applies also in other scenes in addition to above-mentioned scene.The One ", the vocabulary such as " second " are only used for distinguishing the purpose of description, are not understood to indicate or imply relative importance, can not It is interpreted as indication or suggestion sequence.
As shown in Fig. 2, providing a kind of process of data manipulation method, the first database in the process can be above-mentioned scene In SQL server, the second database can be the My SQL in above-mentioned scene, alternatively, first database can be in above-mentioned scene My SQL, the second database can be the SQL server in above-mentioned scene, comprising:
Step 201: determining the first log in first database.
Step 202: according to the first log, obtaining the second log.
Step 203: the second database being operated according to the second log.
It is exemplary, if second log is to increase log, second log can be written to second database In corresponding position;If second log is modification, log modifies to corresponding log in second database Operation;If second log is to delete log to delete corresponding log in second database.
Therefore in the embodiment of the present application, determine that the first log of first database is obtained according to the first log Second log operates the second database according to the second log, that is, can guarantee in first database and the second database Data are consistent.
Example one
Scheme in the embodiment of the present application can be applied to the process of Data Migration, during being applied to Data Migration, First database in process shown in above-mentioned Fig. 2 can be SQL server, and the second database can be My SQL.
The specific implementation process of above-mentioned S201 can are as follows: can open data change capture (the change data of first database Capture, CDC) function, using CDC capturing function, capture takes the increase of first database, the log being deleted or modified, described The log increase, being deleted or modified, the first log of process shown in as above-mentioned Fig. 2.
The specific implementation process of above-mentioned S202 can are as follows: and the first programming language is utilized, the first log is decapsulated, The corresponding source code of the first log is obtained, the first programming language writes language for first database.Utilize second Programming language, is packaged source code, obtains the second log, and the second programming language is writing for the second database Language.For example, realizing above-mentioned first log to the second log using the open source projects yugong that group, Alibaba provides Conversion process.
Exemplary, in the embodiment of the present application, with first database for SQL server, the second database is My SQL, The process of above-mentioned Data Migration is described in detail.Data consistency in the two database can guarantee using the above method.
As shown in figure 3, in the embodiment of the present application, using CDC function, the tables of data captured in SQL server becomes More, tables of data change may include the deletion of specified table, modification or increase log, i.e., above-mentioned first log, then using Ah The open source projects yugong that Li Baba group provides moves to the above-mentioned log of capture on My SQL.My SQL is being received After the log of above-mentioned capture, according to the log of above-mentioned capture, My SQL is operated.On how to according to the log of capture, My SQL is operated, reference can be made to the record in process shown in above-mentioned Fig. 2, no longer illustrates herein.
Based on above-mentioned framework shown in Fig. 3, as shown in figure 4, providing a kind of specific data manipulation process.Whole flow process packet Include three phases, respectively preparation stage, migration phase and switch step.
Wherein, in the preparation stage, the CDC capturing function of SQL server can be first turned on.It then will be from SQL Data on stock is exported in server.The data on stock can refer to the total data stored in current SQL server.Then will Data on stock imported into My SQL.It is understood that above-mentioned export data on stock from SQL server, it is directed into My SQL's In the process, it needs to spend certain duration.In this process, it is also necessary to provide service for application server, application server can It the operation such as can be increased SQL server, modified or be deleted.Data in order to guarantee the two are consistent, also lead above-mentioned Out/importing data, are synchronized in My SQL.In the embodiment of the present application, incremental data will be persistently consumed using yugong, It is synchronized in My SQL, the persistently consumption incremental data is the application service during data of above-mentioned export/importing The data that device increases SQL server, revises or modify.
For example, in the embodiment of the present application, at 0 point to 1 point of morning, the total data in SQL server is directed into In My server, then, in the above process, application server or labor management system etc. may be in SQL server Data modify, delete or increase.In the embodiment of the present application, using yugong function, by above-mentioned 0 point to 1 point In the process, the data for modification occurring in SQL server, deleting or increasing newly, are synchronized in My SQL.
, can be by application switching to read-only status, in a read-only state in migration phase, application server can only read SQL The data in SQL server cannot be modified or be increased to the data of server.Using yugong function, above-mentioned consumption incremental data It synchronously completes.I.e. above-mentioned 0 point to the 1 point data that modification occurs, increases or deletes, it is fully synchronized into My SQL.Then, may be used Consistency desired result is carried out, so-called consistency desired result is whether the data verified in SQL server and My SQL are completed unanimously.
It is switched to My SQL in switch step, including reading flow and writes flow and be switched to My SQL.It is understood that In the embodiment of the present application, being originally SQL server provides read-write service, i.e. the reading flow of application server for application server With write process, be to be carried out in SQL server.It in the embodiment of the present application, can be first after the completion of the migration of database First the reading flow of application server is switched in My SQL, then the process of writing of application server is switched in My SQL.
Example two
The scheme of the embodiment of the present application, during can be applied to data-backoff, during being applied to data-backoff, First database in process shown in above-mentioned Fig. 2 can be My SQL, and the second database can be SQL server.
The specific implementation process of above-mentioned S201 can are as follows: records and change occurs in the first database or potential changes Sentence;The sentence is saved in binary form, obtains first log.For example, in the embodiment of the present application, can record Change or the potential SQL statement for sending change occur in first database, and saves the sentence in the form of binary, with two The sentence that binary form saves can also be also referred to as the first log in process shown in above-mentioned Fig. 2, first log Binlog log.
The specific implementation process of above-mentioned S203 can are as follows: parses to first log, obtains third log;To described First log is parsed, and third log is obtained;The third log in the first queue is explained using the first script, Obtain second log.For example, being parsed using open source projects canal to the first log, after the canal parsing Log can be described as third log.The first queue can be kafka queue, the log after can parsing canal, i.e. third day Will pushes to kafka queue.First script can be python script, using python script in kafka queue Third log is parsed, and third log is parsed into SQL server format.The SQL obtained after the parsing server days Will, as the second log.
Exemplary, in the embodiment of the present application, with first database for My SQL, the second database is SQL server, The process of above-mentioned data-backoff is described in detail.Using the above method, it can be achieved that data in My SQL, retract completely to SQL In server.
As shown in figure 5, in the embodiment of the present application, My SQL will record data and change occur or potential changes SQL statement, and be stored in disk in the form of binary namely binlog log.Utilize the open source item of group, Alibaba Mesh canal realizes parsing binlog log, and the autoincrementing operation being resolved to is pushed to kafka message queue.Finally use python Script is to the message interpretation in kafka queue, and the data after explaining, is inserted into the specified table in SQL server, from And realize rollback operation of the data from My SQL to SQL server.
It is identical as above-mentioned design, as shown in fig. 6, the application also provides a kind of device 600, comprising:
Determining module 601, for determining that the first log in first database, first log are included at the first time Afterwards, the log that application server increases the first database, is deleted or modified;
Module 602 is obtained, for obtaining the second log according to first log;
Operation module 603, for being operated to second database according to second log.
About determining module 601, the specific implementation process of module 602 and operation module 603 is obtained, reference can be made to above-mentioned side Record in method implementation, no longer illustrates herein.It is understood that being schematic to the division of module in the embodiment of the present application , only a kind of logical function partition, there may be another division manner in actual implementation, in addition, in each reality of the application Each functional module applied in example can integrate in a processor, be also possible to physically exist alone, can also be two or two It is a to be integrated in a module with upper module.Above-mentioned integrated module both can take the form of hardware realization, can also use The form of software function module is realized.
It is identical as above-mentioned design, as shown in fig. 7, the embodiment of the present application provides a kind of device 700, for realizing above-mentioned Fig. 2 Method in shown process.
Device 700 includes at least one processor 701, for realizing the method in process shown in Fig. 2 in the above method.Show Example ground, processor 701 can determine the first log in first database;According to first log, the second log is obtained;According to Second log operates second database, referring specifically to the detailed description in method, no longer illustrates herein.
Device 700 can also include at least one processor 702, for storing program instruction and/or data.Memory 702 and processor 701 couple.Coupling in the embodiment of the present application is interval coupling or the communication between device, unit or module Connection can be electrical property, mechanical or other forms, for the information exchange between device, unit or module.Processor 701 It can be with 702 cooperating of memory.Processor 701 may execute the program instruction stored in memory 702.Described at least one At least one of a memory may include in processor.
Device 700 can also include communication interface 703, for being communicated by transmission medium and other equipment, thus It can be communicated with other equipment for the device in device 700.Illustratively, communication interface 703 can be transceiver, electricity Road, bus, module or other types of communication interface, other equipment can be second terminal equipment or the network equipment.Processing Device 701 utilizes 703 sending and receiving data of communication interface, and for realizing the method in above-described embodiment.
The connection between above-mentioned communication device 703, processor 701 and memory 702 is not limited in the embodiment of the present application Medium.The embodiment of the present application is being connected in Fig. 7 with passing through bus 704 between memory 702, processor 701 and communication interface 703 It connects, bus is indicated in Fig. 7 with thick line, and the connection type between other components is only to be schematically illustrated, does not regard it as Limit.The bus can be divided into address bus, data/address bus, control bus etc..It is only thick with one in Fig. 7 for the ease of indicating Line indicates, it is not intended that an only bus or a type of bus.
In the embodiment of the present application, processor can be general processor, digital signal processor, specific integrated circuit, Field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present application.General processor can be Microprocessor or any conventional processor etc..The step of method in conjunction with disclosed in the embodiment of the present application, can directly embody Execute completion for hardware processor, or in processor hardware and software module combination execute completion.
In the embodiment of the present application, memory can be nonvolatile memory, such as hard disk (hard disk drive, HDD) or solid state hard disk (solid-state drive, SSD) etc., it can also be volatile memory (volatile ), such as random access memory (random-access memory, RAM) memory.Memory can be used for carrying or deposit Store up the desired program code with instruction or data structure form and can be by any other medium of computer access, but not It is limited to this.Memory in the embodiment of the present application can also be circuit or other devices that arbitrarily can be realized store function, For storing program instruction and/or data.
It, can be wholly or partly by software, hardware, firmware or it is any in method provided by the embodiments of the present application Combination is to realize.When implemented in software, it can entirely or partly realize in the form of a computer program product.The meter Calculation machine program product includes one or more computer instructions.Load and execute on computers the computer program instructions When, it entirely or partly generates according to process or function described in the embodiment of the present invention.The computer can be general-purpose computations Machine, special purpose computer, computer network, the network equipment, user equipment or other programmable devices.The computer instruction can To store in a computer-readable storage medium, or computer-readable deposit from a computer readable storage medium to another Storage media transmission, for example, the computer instruction can pass through from a web-site, computer, server or data center Wired (such as coaxial cable, optical fiber, Digital Subscriber Line (digital subscriber line, abbreviation DSL)) or wireless (example Such as infrared, wireless, microwave) mode transmitted to another web-site, computer, server or data center.It is described Computer readable storage medium can be any usable medium that computer can access or include one or more available The data storage devices such as medium integrated server, data center.The usable medium can be magnetic medium (for example, floppy disk, Hard disk, tape), optical medium (for example, digital video disk (digital video disc, abbreviation DVD)) or semiconductor be situated between Matter (such as SSD) etc..
Obviously, those skilled in the art can carry out various modification and variations without departing from the model of the application to the application It encloses.In this way, if these modifications and variations of the application belong within the scope of the claim of this application and its equivalent technologies, then The application is also intended to include these modifications and variations.
In the embodiment of the present application, "at least one" refers to one or more, and " multiple " refer to two or more. "and/or" describes the incidence relation of affiliated partner, indicates may exist three kinds of relationships, for example, A and/or B, can indicate: single Solely there are A, A and B are existed simultaneously, the case where individualism B, wherein A, B can be odd number or plural number.The general table of character "/" Show that forward-backward correlation object is a kind of relationship of "or".At least one of " following (a) " or its similar expression, refer to these in Any combination, any combination including individual event (a) or complex item (a).For example, at least one (a) in a, b or c, it can To indicate: a, b, c, a and b, a and c, b and c or a and b and c, wherein a, b, c can be individually, be also possible to multiple.

Claims (18)

1. a kind of data manipulation method characterized by comprising
After determining that the first log in first database, first log are included in first time, application server is to described The log that first database is increased, is deleted or modified;
According to first log, the second log is obtained;
According to second log, second database is operated.
2. the method as described in claim 1, which is characterized in that the first log in the determining first database, comprising:
Capture CDC function is changed using data, obtains the first log in the first database.
3. the method as described in claim 1, which is characterized in that described to obtain the second log according to first log, packet It includes:
Using the first programming language, first log is decapsulated, obtains source corresponding to first log Code, the first programming language write language for the first database;
Using the second programming language, the source code is packaged, obtains second log, second program is compiled It writes language and writes language for second database.
4. method as described in any one of claims 1 to 3, which is characterized in that the first database is SQL server, institute Stating the second database is My SQL.
5. the method as described in claim 1, which is characterized in that the first log in the determining first database, comprising:
It records and change or the potential sentence changed occurs in the first database;
The sentence is saved in binary form, obtains first log.
6. the method as described in claim 1, which is characterized in that described to obtain the second log according to first log, packet It includes:
First log is parsed, third log is obtained;
Third log is pushed into first queue;
The third log in the first queue is explained using the first script, obtains second log.
7. such as the described in any item methods of claim 1,5,6, which is characterized in that the first database is My SQL, described Second database is SQL server.
8. such as the described in any item methods of claim 1,2,3,5,6, which is characterized in that it is described according to second log, it is right Second database is operated, comprising:
If second log is to increase log, second log is written to the corresponding positions in second database It sets;
If second log is modification log, in second database, modify operation to corresponding log;
If second log is to delete log to delete corresponding log in second database.
9. a kind of data operation device characterized by comprising
Determining module, after determining that the first log in first database, first log are included in first time, application The log that server increases the first database, is deleted or modified;
Module is obtained, for obtaining the second log according to first log;
Operation module, for being operated to second database according to second log.
10. device as claimed in claim 9, which is characterized in that the determining module is specifically used for:
Capture CDC function is changed using data, obtains the first log in the first database.
11. device as claimed in claim 9, which is characterized in that it is described to obtain module, it is specifically used for:
Using the first programming language, first log is decapsulated, obtains source corresponding to first log Code, the first programming language write language for the first database;
Using the second programming language, the source code is packaged, obtains second log, second program is compiled It writes language and writes language for second database.
12. such as the described in any item devices of claim 9 to 11, which is characterized in that the first database is SQL server, Second database is My SQL.
13. device as claimed in claim 9, which is characterized in that the determining module is specifically used for:
It records and change or the potential sentence changed occurs in the first database;
The sentence is saved in binary form, obtains first log.
14. device as claimed in claim 9, which is characterized in that it is described to obtain module, it is specifically used for:
First log is parsed, third log is obtained;
Third log is pushed into first queue;
The third log in the first queue is explained using the first script, obtains second log.
15. such as the described in any item devices of claim 9,13,14, which is characterized in that the first database is My SQL, institute Stating the second database is SQL server.
16. such as the described in any item devices of claim 9,10,11,13,14, which is characterized in that the operation module is specific to use In:
If second log is to increase log, second log is written to the corresponding positions in second database It sets;
If second log is modification log, in second database, modify operation to corresponding log;
If second log is to delete log to delete corresponding log in second database.
17. a kind of data operation device characterized by comprising
Memory and processor;
Memory, for storing program instruction;
Processor requires 1 to 8 according to the program execution benefit of acquisition for calling the program instruction stored in the memory Described in any item methods.
18. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer to refer to It enables, when the computer instruction is run on computers, so that computer perform claim requires described in any one of 1 to 8 Method.
CN201910499930.9A 2019-06-11 2019-06-11 A kind of data manipulation method and device Pending CN110275893A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910499930.9A CN110275893A (en) 2019-06-11 2019-06-11 A kind of data manipulation method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910499930.9A CN110275893A (en) 2019-06-11 2019-06-11 A kind of data manipulation method and device

Publications (1)

Publication Number Publication Date
CN110275893A true CN110275893A (en) 2019-09-24

Family

ID=67962049

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910499930.9A Pending CN110275893A (en) 2019-06-11 2019-06-11 A kind of data manipulation method and device

Country Status (1)

Country Link
CN (1) CN110275893A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110990365A (en) * 2019-12-03 2020-04-10 北京奇艺世纪科技有限公司 Data synchronization method, device, server and storage medium
CN112527903A (en) * 2020-12-11 2021-03-19 北京首汽智行科技有限公司 Data synchronization method based on canal platform

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106933703A (en) * 2015-12-30 2017-07-07 阿里巴巴集团控股有限公司 A kind of method of database data backup, device and electronic equipment
CN107491526A (en) * 2017-08-18 2017-12-19 国云科技股份有限公司 A kind of system and method for Achieve Database Synchronization
CN108647237A (en) * 2018-03-30 2018-10-12 厦门海迈科技股份有限公司 Method of data synchronization between isomeric relationship type database
US10185627B2 (en) * 2015-10-23 2019-01-22 Oracle International Corporation Synchronized test master

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10185627B2 (en) * 2015-10-23 2019-01-22 Oracle International Corporation Synchronized test master
CN106933703A (en) * 2015-12-30 2017-07-07 阿里巴巴集团控股有限公司 A kind of method of database data backup, device and electronic equipment
CN107491526A (en) * 2017-08-18 2017-12-19 国云科技股份有限公司 A kind of system and method for Achieve Database Synchronization
CN108647237A (en) * 2018-03-30 2018-10-12 厦门海迈科技股份有限公司 Method of data synchronization between isomeric relationship type database

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
浩子淘天下: "《异构数据库迁移与同步(一)之yugong》", 《HTTP://BLOG.CHUANGZHI8.CN/POSTS/%E5%BC%82%E6%9E%84%E6%95%B0%E6%8D%AE%E5%BA%93%E8%BF%81%E7%A7%BB%E4%B8%8E%E5%90%8C%E6%AD%A5-%E4%B8%80-%E4%B9%8BYUGONG.HTML》 *
浩子淘天下: "异构数据库迁移与同步(一)之yugong", 《HTTPS://WWW.JIANSHU.COM/P/76DCC5A7873B》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110990365A (en) * 2019-12-03 2020-04-10 北京奇艺世纪科技有限公司 Data synchronization method, device, server and storage medium
CN112527903A (en) * 2020-12-11 2021-03-19 北京首汽智行科技有限公司 Data synchronization method based on canal platform

Similar Documents

Publication Publication Date Title
CN107506451B (en) Abnormal information monitoring method and device for data interaction
US20230325287A1 (en) Data backup method and apparatus, data recovery method and apparatus, and storage medium
CN110309218B (en) Data exchange system and data writing method
CN106446159B (en) A kind of method of storage file, the first virtual machine and name node
US11397538B2 (en) Data migration method and apparatus
US11977532B2 (en) Log record identification using aggregated log indexes
CN111143476B (en) Intelligent contract data rapid query method based on database
CN103649926A (en) Providing access to mainframe data objects in a heterogeneous computing environment
CN109918352B (en) Memory system and method of storing data
US10359964B2 (en) Reducing time to read many files from tape
CN113672627B (en) Method and device for constructing index of elastic search engine
CN108427728A (en) Management method, equipment and the computer-readable medium of metadata
CN111367873A (en) Log data storage method and device, terminal and computer storage medium
US20130138612A1 (en) Provisioning and/or synchronizing using common metadata
CN110275893A (en) A kind of data manipulation method and device
CN110147203A (en) A kind of file management method, device, electronic equipment and storage medium
US20150378835A1 (en) Managing data storage system
CN108418859A (en) The method and apparatus for writing data
CN109408539A (en) Data manipulation method, device, server and storage medium
CN111628996A (en) Electronic data communication method and system based on Internet of things
US11474981B2 (en) Database dual-core storage system based on optical disk and method using the system
CN109241110A (en) Order management method and system, electronic equipment, storage medium
CN114896276A (en) Data storage method and device, electronic equipment and distributed storage system
US20200065162A1 (en) Transparent, event-driven provenance collection and aggregation
US20210334166A1 (en) Method, device, and computer storage medium for managing trace record

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190924