CN104731956A - Method and system for synchronizing data and related database - Google Patents
Method and system for synchronizing data and related database Download PDFInfo
- Publication number
- CN104731956A CN104731956A CN201510155678.1A CN201510155678A CN104731956A CN 104731956 A CN104731956 A CN 104731956A CN 201510155678 A CN201510155678 A CN 201510155678A CN 104731956 A CN104731956 A CN 104731956A
- Authority
- CN
- China
- Prior art keywords
- database
- data
- synchronous task
- multiple synchronous
- thread
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Abstract
The invention provides a method and system for synchronizing data and a related database. The synchronizing method is applied to databases with a principal and subordinate structure, and at least two transmission interfaces of the subordinate database are activated to receive data transmitted by the principal database. The method comprises the steps that data to be synchronized are obtained from the principal database, multiple synchronization tasks are generated according to the data to be synchronized, at least two concurrent threads are called, the multiple synchronization tasks are allocated to the at least two concurrent threads according to preset rues, and the multiple synchronization tasks are sent to the subordinate database through the at least two concurrent threads for the subordinate database to achieve data synchronization with the principal database according to the multiple synchronization tasks. According to the technical scheme, the problem of synchronization time delay of the principal database and the subordinate database is solved, real-time synchronization can be achieved, and therefore the demand of providing subsequent data services is met.
Description
Technical field
The present invention relates to field of computer technology, particularly a kind of method of synchrodata, system and Relational database.
Background technology
MySQL is a kind of Relational DBMS, and its client/server uses one of maximum database schema at present, especially for the website that charge capacity is larger.MySQL in client/server, the operation such as master data base carries out writing, upgrade, deletion, and by predetermined synchronization policy these are operated in from database and also perform a time, thus reach the consistance of data in master-slave database.
In correlation technique, the synchronous process of MySQL master-slave database is: after MySQL master data base having the operations such as write, renewal, deletion, himself can be inner to binary log (binary log) by these operation notes, as shown in Figure 1, in order to ensure the accuracy of synchrodata, only have a synchronizing thread order from database and read the binary log of master data base in real time, and performing from playback on database according to the record order of binary log, thus make to be consistent from the data database and master data base.
But, when the operation such as write, renewal, deletion of master data base is more, especially master data base is under the triggering of a large number of services, to from producing a large amount of write demand during database synchronization, but carry out write operation in the record order according to binary log in playback from but only having thread when database synchronization, the single-threaded processing speed to data is limited, the data exceeding its processing speed need be ranked wait, if still have mass data to write in the process that there is data queue, then can increase queuing duration further.Therefore, can cause from database synchronization time delay because of the restriction of single-threaded processing speed when master data base writing is very large, and the increase of factor data amount may time delay increasing, and then cause meeting the follow-up demand that data, services is provided.
Summary of the invention
In view of the above problems, the present invention is proposed to provide a kind of method, system and the Relational database that overcome the problems referred to above or the synchrodata that solves the problem at least in part.
According to one aspect of the present invention, provide a kind of method of synchrodata, be applied to and there is hypotactic database, wherein be activated from the transmission interface of at least two database, to receive the data of master data base transmission, described method comprises: obtain data to be synchronized, and according to the multiple synchronous task of described data genaration to be synchronized; Call at least two concurrent threads, wherein, each thread carries out data transmission with described from the different transmission interfaces database respectively; Described multiple synchronous task is distributed on described at least two concurrent threads according to preset rules; And at least two concurrent threads described in utilizing, transmit described multiple synchronous task to described from the different transmission interfaces database, to realize according to described multiple synchronous task and data syn-chronization between described master data base from database root for described.
Alternatively, describedly distribute described multiple synchronous task according to preset rules and comprise further to the step on described at least two concurrent threads: distribute described multiple synchronous task according to the object identity in described multiple synchronous task, the synchronous task possessing same object mark is dispensed in same thread; Or distribute described multiple synchronous task according to the tables of data mark in described multiple synchronous task, the synchronous task possessing identical data table mark is dispensed in same thread.
Alternatively, described the step that is dispensed in same thread of synchronous task possessing same object mark to be comprised further: the synchronous task possessing same object mark is dispensed in same thread according to sequential or clooating sequence.
Alternatively, described the step that is dispensed in same thread of synchronous task possessing identical data table mark to be comprised further: the synchronous task possessing identical data table mark is dispensed in same thread according to sequential or clooating sequence.
Alternatively, describedly call at least two concurrent threads, distribute described multiple synchronous task according to preset rules to comprise further to the step on described at least two concurrent threads: according to the quantity of described multiple synchronous task, call the concurrent thread of respective numbers; Be dispensed to man-to-man for described multiple synchronous task in the concurrent thread of described respective numbers.
Alternatively, described described in utilizing at least two concurrent threads, transmit described multiple synchronous task to described from the process of the different transmission interfaces database, if get new data to be synchronized, then new according to described data genaration to be synchronized newly multiple synchronous tasks.
Alternatively, after described multiple synchronous tasks new according to described data genaration to be synchronized newly, also comprise: distribute described multiple synchronous tasks newly in described at least two concurrent threads according to described preset rules; Or call new thread, and distribute in described multiple synchronous tasks newly to described new thread according to described preset rules, send described multiple synchronous tasks newly to described from database to utilize described new thread.
Alternatively, described to realize from database root according to described multiple synchronous task and data syn-chronization between described master data base process, the described executing location information synchronous from data-base recording self, to obtain synchronization log.
Alternatively, the step of described acquisition data to be synchronized comprises further: obtain the journal file of described master data base and the described synchronization log from database; And more described journal file and the described synchronization log from database, to determine described data to be synchronized.
According to another aspect of the present invention, provide a kind of method of synchrodata, be applied to and there is hypotactic database, wherein be activated from the transmission interface of at least two database, to receive the data of master data base transmission, described method comprises: utilize described from the transmission interface of at least two database, the multiple synchronous tasks from described master data base are received from the thread that at least two to its transmission data are concurrent, wherein, described at least two concurrent threads and described at least two transmission interfaces are one to one; And according to described multiple synchronous task, the data syn-chronization between realization and described master data base.
Alternatively, described at least two concurrent threads are called by described master data, and distribute described multiple synchronous task on described at least two concurrent threads according to preset rules.
Alternatively, described method also comprises: in the process of the data syn-chronization realized and between described master data base, and the described executing location information synchronous from data-base recording self, obtains synchronization log.
Alternatively, after obtaining described synchronization log, also comprise: described synchronization log is uploaded to Cloud Server.
According to an also aspect of the present invention, provide a kind of master data base, the data syn-chronization on it to from database, to be describedly activated from the transmission interface of at least two database by described master data base, to receive the data of described master data base transmission, described master data base comprises:
Acquisition module, is suitable for obtaining data to be synchronized;
Generation module, is suitable for according to the multiple synchronous task of described data genaration to be synchronized;
Calling module, be suitable for calling at least two concurrent threads, wherein, each thread carries out data transmission with described from the different transmission interfaces database respectively;
Distribution module, is suitable for distributing described multiple synchronous task on described at least two concurrent threads according to preset rules; And
Transport module, at least two concurrent threads described in being suitable for utilizing, transmit described multiple synchronous task to described from the different transmission interfaces database, to realize and data syn-chronization between described master data base from database root for described according to described multiple synchronous task.
Alternatively, described distribution module is also suitable for: distribute described multiple synchronous task according to the object identity in described multiple synchronous task, is dispensed in same thread by the synchronous task possessing same object mark; Or distribute described multiple synchronous task according to the tables of data mark in described multiple synchronous task, the synchronous task possessing identical data table mark is dispensed in same thread.
Alternatively, described distribution module is also suitable for: be dispensed in same thread according to sequential or clooating sequence by the synchronous task possessing same object mark.
Alternatively, described distribution module is also suitable for: be dispensed in same thread according to sequential or clooating sequence by the synchronous task possessing identical data table mark.
Alternatively, described calling module, is also suitable for the quantity according to described multiple synchronous task, calls the concurrent thread of respective numbers; Described distribution module, is also suitable for being dispensed to man-to-man for described multiple synchronous task in the concurrent thread of described respective numbers.
Alternatively, described transport module is at least two concurrent threads described in utilizing, transmit described multiple synchronous task to described from the process of the different transmission interfaces database, if described acquisition module gets new data to be synchronized, then described generation module is also suitable for: the multiple synchronous tasks new according to described data genaration to be synchronized newly.
Alternatively, described distribution module is also suitable for: distribute described multiple synchronous tasks newly in described at least two concurrent threads according to described preset rules.
Alternatively, described calling module is also suitable for calling new thread; And described distribution module is also suitable for distributing in described multiple synchronous tasks newly to described new thread according to described preset rules, send described multiple synchronous tasks newly to described from database to utilize described new thread.
Alternatively, described to realize from database root according to described multiple synchronous task and data syn-chronization between described master data base process, the described executing location information synchronous from data-base recording self, to obtain synchronization log.
Alternatively, described acquisition module is also suitable for: obtain the journal file of described master data base and the described synchronization log from database; And more described journal file and the described synchronization log from database, determine described data to be synchronized.
According to an also aspect of the present invention, provide a kind of from database, to be describedly activated from the transmission interface of at least two database, to receive the data of master data base transmission, describedly to comprise from database:
Receiver module, be suitable for utilization described from the transmission interface of at least two database, the multiple synchronous tasks from described master data base are received from the thread that at least two to its transmission data are concurrent, wherein, described at least two concurrent threads and described at least two transmission interfaces are one to one; And
Synchronization module, is suitable for according to described multiple synchronous task, the data syn-chronization between realization and described master data base.
Alternatively, described at least two concurrent threads are called by described master data, and distribute described multiple synchronous task on described at least two concurrent threads according to preset rules.
Alternatively, described synchronization module is also suitable for: in the process of the data syn-chronization realized and between described master data base, records self synchronous executing location information, obtains synchronization log.
Alternatively, after obtaining described synchronization log, described synchronization module is also suitable for: described synchronization log is uploaded to Cloud Server.
According to an also aspect of the present invention, provide a kind of system of synchrodata, comprise above-mentioned any one master data base and above-mentioned any one from database.
In embodiments of the present invention, the data of synchronous master data base are to during from database, be activated from the transmission interface of at least two database, the data of master data base transmission can be received, master data base obtains the data to be synchronized on it, generate multiple synchronous task, call at least two concurrent threads afterwards, and then distribute multiple synchronous task at least two concurrent threads according to preset rules.Utilize the thread that at least two concurrent subsequently, transmit multiple synchronous task to from the different transmission interfaces database, for the data syn-chronization realized according to multiple synchronous task from database root and between master data base.It can thus be appreciated that, master data base can call at least two concurrent threads, and then utilize at least two concurrent thread synchronization to transmit multiple synchronous task to from the different transmission interfaces database, compare with the single-threaded locking phase in correlation technique, can send within the unit interval and be several times as much as single-threaded synchronous task, the efficiency of synchrodata can be improved, shorten synchronous required duration, thus solve the problem of the single-threaded synchronizing relay of master-slave database in correlation technique, realize real-time synchronization, meet the follow-up demand that data, services is provided.Further, the processing mode of multithreading can substantially reduce data queue duration, alleviates the pressure of buffer memory parts, discharges resource space as early as possible, improves the utilization factor of system resource.In addition, master data base can arrange preset rules according to actual conditions, realizes the multiple synchronous task of dynamic assignment at least two concurrent threads, improves the efficiency of synchrodata further.
Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to technological means of the present invention can be better understood, and can be implemented according to the content of instructions, and can become apparent, below especially exemplified by the specific embodiment of the present invention to allow above and other objects of the present invention, feature and advantage.
According to hereafter by reference to the accompanying drawings to the detailed description of the specific embodiment of the invention, those skilled in the art will understand above-mentioned and other objects, advantage and feature of the present invention more.
Accompanying drawing explanation
By reading hereafter detailed description of the preferred embodiment, various other advantage and benefit will become cheer and bright for those of ordinary skill in the art.Accompanying drawing only for illustrating the object of preferred implementation, and does not think limitation of the present invention.And in whole accompanying drawing, represent identical parts by identical reference symbol.In the accompanying drawings:
Fig. 1 shows the structural representation of synchrodata between master-slave database in prior art;
Fig. 2 shows the schematic flow sheet of the method for the synchrodata being applied to master data base according to an embodiment of the invention;
Fig. 3 shows the schematic flow sheet of the method for the synchrodata be applied to according to an embodiment of the invention from database;
Fig. 4 shows the structural representation of master data base according to an embodiment of the invention;
Fig. 5 shows according to an embodiment of the invention from the structural representation of database;
Fig. 6 shows the structural representation of the system of synchrodata according to an embodiment of the invention; And
Fig. 7 shows the structural representation of the system of synchrodata in accordance with another embodiment of the present invention.
Embodiment
Below with reference to accompanying drawings exemplary embodiment of the present disclosure is described in more detail.Although show exemplary embodiment of the present disclosure in accompanying drawing, however should be appreciated that can realize the disclosure in a variety of manners and not should limit by the embodiment set forth here.On the contrary, provide these embodiments to be in order to more thoroughly the disclosure can be understood, and complete for the scope of the present disclosure can be conveyed to those skilled in the art.
For solving the problems of the technologies described above, embodiments provide a kind of method of synchrodata, be applied to and there is hypotactic database, wherein be activated from the transmission interface of at least two database, to receive the data of master data base transmission, Fig. 2 shows the schematic flow sheet of the method for the synchrodata being applied to master data base according to an embodiment of the invention.As shown in Figure 2, the method can comprise the following steps S202, step S204, step S206 and step S208.
Step S202, obtain data to be synchronized, and according to the multiple synchronous task of data genaration to be synchronized.
Step S204, call at least two concurrent threads, wherein, each thread carries out data transmission respectively with from the different transmission interfaces on database.
Step S206, distribute multiple synchronous task at least two concurrent threads according to preset rules.
Step S208, utilize at least two concurrent threads, transmit multiple synchronous task to from the different transmission interfaces database, realize and data syn-chronization between master data base according to multiple synchronous task for from database root.
In embodiments of the present invention, the data of synchronous master data base are to during from database, be activated from the transmission interface of at least two database, the data of master data base transmission can be received, master data base obtains the data to be synchronized on it, generate multiple synchronous task, call at least two concurrent threads afterwards, and then distribute multiple synchronous task at least two concurrent threads according to preset rules.Utilize the thread that at least two concurrent subsequently, transmit multiple synchronous task to from the different transmission interfaces database, for the data syn-chronization realized according to multiple synchronous task from database root and between master data base.It can thus be appreciated that, master data base can call at least two concurrent threads, and then utilize at least two concurrent thread synchronization to transmit multiple synchronous task to from the different transmission interfaces database, compare with the single-threaded locking phase in correlation technique, can send within the unit interval and be several times as much as single-threaded synchronous task, the efficiency of synchrodata can be improved, shorten synchronous required duration, thus solve the problem of the single-threaded synchronizing relay of master-slave database in correlation technique, realize real-time synchronization, meet the follow-up demand that data, services is provided.Further, the processing mode of multithreading can substantially reduce data queue duration, alleviates the pressure of buffer memory parts, discharges resource space as early as possible, improves the utilization factor of system resource.In addition, master data base can arrange preset rules according to actual conditions, realizes the multiple synchronous task of dynamic assignment at least two concurrent threads, improves the efficiency of synchrodata further.
In the process of the data syn-chronization realized from database root according to multiple synchronous task and between master data base, self synchronous executing location information can be recorded from database, obtain synchronization log, now step S202 obtains data to be synchronized and may be embodied as the acquisition journal file of master data base and the synchronization log from database, compare the journal file of master data base and the synchronization log from database subsequently, determine data to be synchronized.Here, the form of data to be synchronized can be multiple format, and as JSON form, it is a kind of data interchange language of lightweight, is easy to people and reads and write, and be also easy to machine simultaneously and resolve and generate, and network transfer speeds is fast.In addition, master data base or can be MySQL database from database in the embodiment of the present invention.As previously mentioned, when the operation such as write, renewal, deletion of master data base is more, especially master data base is under the triggering of a large number of services, the concurrent write of multiple thread may be had, but MySQL is from but only having a thread when database synchronization in the record order according to binary log in playback, cause from database synchronization time delay when master data base writing is very large like this, and may time delay increasing, and then cause meeting the follow-up demand that data, services is provided.In the embodiment of the present invention, the data of synchronous master data base are to during from database, be activated from the transmission interface of at least two database, the data of master data base transmission can be received, thus master data base calls at least two concurrent threads in step S204, wherein, each thread carries out data transmission respectively with from the different transmission interfaces on database, solves the single-threaded problem synchronously causing synchronizing relay of MySQL thus, realize real-time synchronization, for user provides data, services.
Above-mentioned steps S206 distributes multiple synchronous task at least two concurrent threads according to preset rules, and the embodiment of the present invention can realize in several ways, as utilized object identity or tables of data mark etc. to distribute, describes in detail respectively below.
In first kind of way, multiple synchronous task can be distributed according to the object identity in multiple synchronous task, the synchronous task possessing same object mark is dispensed in same thread, the synchronous task possessing same object mark like this can be dispensed in same thread sequentially (as sequential or clooating sequence) and to assign to from database, sequentially perform synchronous operation by from database, thus ensure that the accuracy of data syn-chronization.Such as, 5 synchronous tasks are the deletion action of the write operation of object A, the write operation of object B, the renewal rewards theory of object B, the deletion action of object B and object C respectively, now, three threads can be called, thread 1,2 and 3 respectively, can the write operation of object A be dispensed in thread 1, the deletion action of the write operation of object B, the renewal rewards theory of object B and object B be dispensed in thread 2, the deletion action of object C is dispensed in thread 3.Certainly, the number of synchronous task and the number of thread are only schematic herein, and in actual applications, synchronous task may be thousands of, up to ten thousand even 1,000,000, according to the reasonable invokes thread of the number of synchronous task, and can distribute according to object identity.
In the second way, multiple synchronous task can be distributed according to the tables of data mark in multiple synchronous task, the synchronous task possessing identical data table mark is dispensed in same thread, the synchronous task possessing identical data table mark like this can be dispensed in same thread sequentially (as sequential or clooating sequence) and to assign to from database, sequentially perform synchronous operation by from database, thus ensure that the accuracy of data syn-chronization and improve the efficiency of data syn-chronization.Such as, 4 synchronous tasks are the deletion action of the object C in the renewal rewards theory of object B in the write operation of object B in the write operation of object A in tables of data 1, tables of data 1, tables of data 1 and tables of data 2 respectively.Now, two threads can be called, thread 1 and 2 respectively, can the renewal rewards theory of the object B in the write operation of the object B in the write operation of object A in tables of data 1, tables of data 1, tables of data 1 be dispensed in thread 1, the deletion action of the object C in tables of data 2 is dispensed in thread 2.It should be noted that, the number of synchronous task and the number of thread are only schematic herein, and in actual applications, synchronous task may be thousands of, up to ten thousand even 1,000,000, according to the reasonable invokes thread of the number of synchronous task, and can distribute according to tables of data mark.
In the third mode, can according to the quantity of multiple synchronous task, call the concurrent thread of respective numbers, and then be dispensed in the concurrent thread of respective numbers by man-to-man for multiple synchronous task, synchronous task can be received in time like this from database, can realize from database real-time synchronization, meet the follow-up demand that data, services is provided.
Further, in the thread that step S208 utilization at least two is concurrent, transmit multiple synchronous task extremely from the process of the different transmission interfaces database, if get new data to be synchronized, and during according to multiple synchronous task that new data genaration to be synchronized is new, the embodiment of the present invention can also process new multiple synchronous tasks in time, effectively, to realize new multiple synchronous tasks to be issued in time from database.Such as, new multiple synchronous tasks are distributed at least two concurrent threads according to above-mentioned preset rules.And for example, call new thread, and distribute new multiple synchronous tasks in new thread according to above-mentioned preset rules, send new multiple synchronous tasks extremely from database to utilize new thread, multiple synchronous tasks new like this, without the need to waiting for, can improve the efficiency of data syn-chronization.
In addition, the embodiment of the present invention additionally provides the synchronous scheme of monitor data, can realize the function such as breakpoint transmission and fault recovery.Namely, in the process of the data syn-chronization realized from database root according to multiple synchronous task and between master data base, from the executing location information that data-base recording self is synchronous, synchronization log is obtained.Now, master data base monitoring is from the state of the data syn-chronization of database, interrupt from the data syn-chronization of database if monitor, then obtain the synchronization log from database, and read from the executing location information of database synchronization from the synchronization log of database, thus according to the executing location Information recovering data syn-chronization from database synchronization.Here, may many factors be had from the data syn-chronization generation interruption of database, as hard disk break down, operating system collapse, from server power-off etc.Further, be uploaded to Cloud Server from the synchronization log of database, now can obtain the synchronization log from database from this from database or Cloud Server, can prevent like this from server on-hook or from faults such as the loss of datas of database.
Accordingly, Fig. 3 shows the process flow diagram of the method for the synchrodata be applied to according to an embodiment of the invention from database, is activated from the transmission interface of at least two database, to receive the data of master data base transmission.As shown in Figure 3, the method can comprise the following steps S302 and step S304.
Step S302, utilize from the transmission interface of at least two database, multiple synchronous tasks of autonomous database are received from the thread that at least two to its transmission data are concurrent, wherein, at least two concurrent threads are one to one with at least two transmission interfaces.
Step S304, according to multiple synchronous task, realize and master data base between data syn-chronization.
In the embodiment of the present invention, multiple synchronous tasks of autonomous database are received from least two transmission interfaces of data base manipulation it, thus solve the problem of the single-threaded synchronizing relay of master-slave database in correlation technique, realize real-time synchronization, meet the follow-up demand that data, services is provided.
In the process of the data syn-chronization between step S304 realization and master data base, from the executing location information that data-base recording self is synchronous, obtain synchronization log, subsequently synchronization log is uploaded to Cloud Server, can prevent like this from server on-hook or from faults such as the loss of datas of database.
Based on same inventive concept, the embodiment of the present invention additionally provides a kind of master data base, and this master data base by the data syn-chronization on it to from database, can be activated from the transmission interface of at least two database, can receive the data of master data base transmission.Fig. 4 shows the structural representation of master data base according to an embodiment of the invention.See Fig. 4, this master data base at least comprises: acquisition module 410, generation module 420, calling module 430, distribution module 440 and transport module 450.
Now introduce the annexation between each composition of the master data base of the embodiment of the present invention or the function of device and each several part:
Acquisition module 410, is suitable for obtaining data to be synchronized;
Generation module 420, couples mutually with acquisition module 410, is suitable for according to the multiple synchronous task of described data genaration to be synchronized;
Calling module 430, couples mutually with generation module 420, and be suitable for calling at least two concurrent threads, wherein, each thread carries out data transmission with described from the different transmission interfaces database respectively;
Distribution module 440, couples mutually with calling module 430, is suitable for distributing described multiple synchronous task on described at least two concurrent threads according to preset rules;
Transport module 450, couple mutually with distribution module 440, at least two concurrent threads described in being suitable for utilizing, transmit described multiple synchronous task to described from the different transmission interfaces database, to realize according to described multiple synchronous task and data syn-chronization between described master data base from database root for described.
In one embodiment of the invention, above-mentioned distribution module 440 is also suitable for: distribute described multiple synchronous task according to the object identity in described multiple synchronous task, is dispensed in same thread by the synchronous task possessing same object mark; Or distribute described multiple synchronous task according to the tables of data mark in described multiple synchronous task, the synchronous task possessing identical data table mark is dispensed in same thread.
In one embodiment of the invention, above-mentioned distribution module 440 is also suitable for: be dispensed in same thread according to sequential or clooating sequence by the synchronous task possessing same object mark.
In one embodiment of the invention, above-mentioned distribution module 440 is also suitable for: be dispensed in same thread according to sequential or clooating sequence by the synchronous task possessing identical data table mark.
In one embodiment of the invention, above-mentioned calling module 430, is also suitable for the quantity according to described multiple synchronous task, calls the concurrent thread of respective numbers; Above-mentioned distribution module 440, is also suitable for being dispensed to man-to-man for described multiple synchronous task in the concurrent thread of described respective numbers.
In one embodiment of the invention, at least two concurrent threads described in utilizing, transport module 450 is extremely described from the process of the different transmission interfaces database at the described multiple synchronous task of transmission, if get new data to be synchronized, then multiple synchronous tasks that above-mentioned generation module 420 is new according to described data genaration to be synchronized newly.
In one embodiment of the invention, after described generation module 420 is according to multiple synchronous tasks that described data genaration to be synchronized is newly new, above-mentioned distribution module 440 is also suitable for: distribute described multiple synchronous tasks newly in described at least two concurrent threads according to described preset rules.
In one embodiment of the invention, after described generation module 420 is according to multiple synchronous tasks that described data genaration to be synchronized is newly new, above-mentioned calling module 430 is also suitable for calling new thread; And above-mentioned distribution module 440 is also suitable for: distribute in described multiple synchronous tasks newly to described new thread according to described preset rules, send described multiple synchronous tasks newly to described from database to utilize described new thread.
In one embodiment of the invention, described to realize from database root according to described multiple synchronous task and data syn-chronization between described master data base process, the described executing location information synchronous from data-base recording self, to obtain synchronization log.
In one embodiment of the invention, above-mentioned acquisition module 410 is also suitable for: obtain the journal file of described master data base and the described synchronization log from database; And more described journal file and the described synchronization log from database, determine described data to be synchronized.
Accordingly, Fig. 5 shows according to an embodiment of the invention from the structural representation of database.See Fig. 5, at least should comprise from database: receiver module 510 and synchronization module 520.
Now introduce the annexation between each composition from database of the embodiment of the present invention or the function of device and each several part:
Receiver module 510, be suitable for utilization described from the transmission interface of at least two database, the multiple synchronous tasks from described master data base are received from the thread that at least two to its transmission data are concurrent, wherein, described at least two concurrent threads and described at least two transmission interfaces are one to one;
Synchronization module 520, couples mutually with receiver module 510, is suitable for according to described multiple synchronous task, the data syn-chronization between realization and described master data base.
In one embodiment of the invention, described master data call described at least two concurrent threads, and distribute described multiple synchronous task on described at least two concurrent threads according to preset rules.
In one embodiment of the invention, above-mentioned synchronization module 520 is also suitable for: in the process of the data syn-chronization realized and between described master data base, records self synchronous executing location information, obtains synchronization log.
In one embodiment of the invention, after obtaining described synchronization log, above-mentioned synchronization module 520 is also suitable for: described synchronization log is uploaded to Cloud Server.
Based on the method and apparatus of the synchrodata that each embodiment above provides, based on same inventive concept, the embodiment of the present invention additionally provides a kind of system of synchrodata, shown in Figure 6, this system at least can comprise: the master data base 610 (as shown in Figure 4) introduced above and from database 620 (as shown in Figure 5).
Master data base and the scheme from the data syn-chronization between database to be synchronized in the present invention is introduced in detail below by specific embodiment, namely the data of synchronous master data base are to during from database, be activated from the transmission interface of at least two database, the data of master data base transmission can be received.Fig. 7 shows the structural representation of the system of synchrodata in accordance with another embodiment of the present invention.As shown in Figure 7, be activated from least two transmission interfaces database 720, the data that master data base 710 is transmitted can be received.Master data base 710 obtains data to be synchronized, and according to the multiple synchronous task of data genaration to be synchronized (as 10 synchronous tasks, its details are as shown in table 1).
Table 1
| Synchronous task | Tables of data identifies | Object identity | Data manipulation |
| 1 | D1 | Object B | Write |
| 2 | D1 | Object B | Upgrade |
| 3 | D1 | Object B | Write |
| 4 | D1 | Object A | Delete |
| 5 | D2 | Object C | Write |
| 6 | D2 | Object C | Delete |
| 7 | D1 | Object B | Upgrade |
| 8 | D3 | Object D | Write |
| 9 | D3 | Object D | Upgrade |
| 10 | D4 | Object E | Write |
Now, at least two concurrent threads can be called according to previously described first kind of way, the second way or the third mode, and distribute synchronous task at least two concurrent threads.Such as, according to shown in table 1, four threads can be called, be respectively thread 1, 2, 3 and 4, by synchronous task 1, 2, 3, 4 and 7 are dispensed in thread 1 according to sequential or clooating sequence, synchronous task 5 and 6 is dispensed in thread 2 according to sequential or clooating sequence, synchronous task 8 and 9 is dispensed in thread 3 according to sequential or clooating sequence, and synchronous task 10 is dispensed in thread 4, thus utilize thread 1, 2, 3 and 4 synchronized transmission 10 synchronous tasks are extremely from database 720, for the data syn-chronization realized from database 720 according to 10 synchronous tasks and between master data base 710.And for example, distribute according to object identity, five threads can be called, be respectively thread 1, 2, 3, 4 and 5, by synchronous task 1, 2, 3 and 7 are dispensed in thread 1 according to sequential or clooating sequence, synchronous task 4 is dispensed in thread 2, synchronous task 5 and 6 is dispensed in thread 3 according to sequential or clooating sequence, synchronous task 8 and 9 is dispensed in thread 4 according to sequential or clooating sequence, and synchronous task 10 is dispensed in thread 5, thus utilize thread 1, 2, 3, 4 and 5 synchronized transmission 10 synchronous tasks are extremely from database 720, for the data syn-chronization realized from database 720 according to 10 synchronous tasks and between master data base 710.It should be noted that, the number of synchronous task, the number of thread and data manipulation type are only schematic herein, in actual applications, synchronous task may be thousands of, up to ten thousand even 1,000,000, can distribute according to the reasonable invokes thread of the number of synchronous task.
Further, if master data base 710 gets new data to be synchronized, and during according to multiple synchronous task that new data genaration to be synchronized is new, the embodiment of the present invention can also process new multiple synchronous tasks in time, effectively, to realize new multiple synchronous tasks to be issued in time from database 720.Such as, distribute new multiple synchronous tasks at least two concurrent threads according to above-mentioned preset rules, reasonable distribution can be carried out according to object identity or tables of data mark.And for example, call new thread, and distribute new multiple synchronous tasks in new thread according to above-mentioned preset rules, send new multiple synchronous tasks extremely from database 720 to utilize new thread, multiple synchronous tasks new like this, without the need to waiting for, can improve the efficiency of data syn-chronization.
In addition, the embodiment of the present invention additionally provides the synchronous scheme of monitor data, can realize the function such as breakpoint transmission and fault recovery, described in can refer to above, repeats no more herein.
According to the combination of any one preferred embodiment above-mentioned or multiple preferred embodiment, the embodiment of the present invention can reach following beneficial effect:
In embodiments of the present invention, the data of synchronous master data base are to during from database, be activated from the transmission interface of at least two database, the data of master data base transmission can be received, master data base obtains the data to be synchronized on it, generate multiple synchronous task, call at least two concurrent threads afterwards, and then distribute multiple synchronous task at least two concurrent threads according to preset rules.Utilize the thread that at least two concurrent subsequently, transmit multiple synchronous task to from the different transmission interfaces database, for the data syn-chronization realized according to multiple synchronous task from database root and between master data base.It can thus be appreciated that, master data base can call at least two concurrent threads, and then utilize at least two concurrent thread synchronization to transmit multiple synchronous task to from the different transmission interfaces database, compare with the single-threaded locking phase in correlation technique, can send within the unit interval and be several times as much as single-threaded synchronous task, the efficiency of synchrodata can be improved, shorten synchronous required duration, thus solve the problem of the single-threaded synchronizing relay of master-slave database in correlation technique, realize real-time synchronization, meet the follow-up demand that data, services is provided.Further, the processing mode of multithreading can substantially reduce data queue duration, alleviates the pressure of buffer memory parts, discharges resource space as early as possible, improves the utilization factor of system resource.In addition, master data base can arrange preset rules according to actual conditions, realizes the multiple synchronous task of dynamic assignment at least two concurrent threads, improves the efficiency of synchrodata further.
In instructions provided herein, describe a large amount of detail.But can understand, embodiments of the invention can be put into practice when not having these details.In some instances, be not shown specifically known method, structure and technology, so that not fuzzy understanding of this description.
Similarly, be to be understood that, in order to simplify the disclosure and to help to understand in each inventive aspect one or more, in the description above to exemplary embodiment of the present invention, each feature of the present invention is grouped together in single embodiment, figure or the description to it sometimes.But, the method for the disclosure should be construed to the following intention of reflection: namely the present invention for required protection requires feature more more than the feature clearly recorded in each claim.Or rather, as claims below reflect, all features of disclosed single embodiment before inventive aspect is to be less than.Therefore, the claims following embodiment are incorporated to this embodiment thus clearly, and wherein each claim itself is as independent embodiment of the present invention.
Those skilled in the art are appreciated that and adaptively can change the module in the equipment in embodiment and they are arranged in one or more equipment different from this embodiment.Module in embodiment or unit or assembly can be combined into a module or unit or assembly, and multiple submodule or subelement or sub-component can be put them in addition.Except at least some in such feature and/or process or unit be mutually repel except, any combination can be adopted to combine all processes of all features disclosed in this instructions (comprising adjoint claim, summary and accompanying drawing) and so disclosed any method or equipment or unit.Unless expressly stated otherwise, each feature disclosed in this instructions (comprising adjoint claim, summary and accompanying drawing) can by providing identical, alternative features that is equivalent or similar object replaces.
In addition, those skilled in the art can understand, although embodiments more described herein to comprise in other embodiment some included feature instead of further feature, the combination of the feature of different embodiment means and to be within scope of the present invention and to form different embodiments.Such as, in detail in the claims, the one of any of embodiment required for protection can use with arbitrary array mode.
All parts embodiment of the present invention with hardware implementing, or can realize with the software module run on one or more processor, or realizes with their combination.It will be understood by those of skill in the art that the some or all functions that microprocessor or digital signal processor (DSP) can be used in practice to realize according to the some or all parts in the equipment and system of the synchrodata of the embodiment of the present invention.The present invention can also be embodied as part or all equipment for performing method as described herein or device program (such as, computer program and computer program).Realizing program of the present invention and can store on a computer-readable medium like this, or the form of one or more signal can be had.Such signal can be downloaded from internet website and obtain, or provides on carrier signal, or provides with any other form.
The present invention will be described instead of limit the invention to it should be noted above-described embodiment, and those skilled in the art can design alternative embodiment when not departing from the scope of claims.In the claims, any reference symbol between bracket should be configured to limitations on claims.Word " comprises " not to be got rid of existence and does not arrange element in the claims or step.Word "a" or "an" before being positioned at element is not got rid of and be there is multiple such element.The present invention can by means of including the hardware of some different elements and realizing by means of the computing machine of suitably programming.In the unit claim listing some devices, several in these devices can be carry out imbody by same hardware branch.Word first, second and third-class use do not represent any order.Can be title by these word explanations.
So far, those skilled in the art will recognize that, although multiple exemplary embodiment of the present invention is illustrate and described herein detailed, but, without departing from the spirit and scope of the present invention, still can directly determine or derive other modification many or amendment of meeting the principle of the invention according to content disclosed by the invention.Therefore, scope of the present invention should be understood and regard as and cover all these other modification or amendments.
The invention also discloses: a kind of method of A1, synchrodata, is applied to and has hypotactic database, be wherein activated from the transmission interface of at least two database, to receive the data of master data base transmission, described method comprises:
Obtain data to be synchronized, and according to the multiple synchronous task of described data genaration to be synchronized;
Call at least two concurrent threads, wherein, each thread carries out data transmission with described from the different transmission interfaces database respectively;
Described multiple synchronous task is distributed on described at least two concurrent threads according to preset rules; And
At least two concurrent threads described in utilization, transmit described multiple synchronous task to described from the different transmission interfaces database, to realize and data syn-chronization between described master data base from database root for described according to described multiple synchronous task.
A2, method according to A1, wherein, describedly distribute described multiple synchronous task according to preset rules and comprise further to the step on described at least two concurrent threads:
Distribute described multiple synchronous task according to the object identity in described multiple synchronous task, the synchronous task possessing same object mark is dispensed in same thread; Or
Distribute described multiple synchronous task according to the tables of data mark in described multiple synchronous task, the synchronous task possessing identical data table mark is dispensed in same thread.
A3, method according to A2, wherein, describedly to comprise the step that the synchronous task possessing same object mark is dispensed in same thread further:
The synchronous task possessing same object mark is dispensed in same thread according to sequential or clooating sequence.
A4, method according to A2 or A3, wherein, describedly to comprise the step that the synchronous task possessing identical data table mark is dispensed in same thread further:
The synchronous task possessing identical data table mark is dispensed in same thread according to sequential or clooating sequence.
A5, method according to any one of A1-A4, wherein, described in call at least two concurrent threads, distribute described multiple synchronous task according to preset rules and comprise further to the step on described at least two concurrent threads:
According to the quantity of described multiple synchronous task, call the concurrent thread of respective numbers; And
Be dispensed to man-to-man for described multiple synchronous task in the concurrent thread of described respective numbers.
A6, method according to any one of A1-A5, wherein, described described in utilizing at least two concurrent threads, transmit described multiple synchronous task to described from the process of the different transmission interfaces database, if get new data to be synchronized, then new according to described data genaration to be synchronized newly multiple synchronous tasks.
A7, method according to A6, wherein, described method also comprises:
Described multiple synchronous tasks are newly distributed in described at least two concurrent threads according to described preset rules; Or
Call new thread, and distribute in described multiple synchronous tasks newly to described new thread according to described preset rules, send described multiple synchronous tasks newly to described from database to utilize described new thread.
A8, method according to any one of A1-A7, wherein, described to realize from database root according to described multiple synchronous task and data syn-chronization between described master data base process, the described executing location information synchronous from data-base recording self, to obtain synchronization log.
A9, method according to any one of A1-A8, wherein, the step of described acquisition data to be synchronized comprises further:
Obtain the journal file of described master data base and the described synchronization log from database; And
More described journal file and the described synchronization log from database, to determine described data to be synchronized.
A kind of method of B10, synchrodata, is applied to and has hypotactic database, is wherein activated from the transmission interface of at least two database, and to receive the data of master data base transmission, described method comprises:
Utilize described from the transmission interface of at least two database, the multiple synchronous tasks from described master data base are received from the thread that at least two to its transmission data are concurrent, wherein, described at least two concurrent threads and described at least two transmission interfaces are one to one; And
According to described multiple synchronous task, the data syn-chronization between realization and described master data base.
B11, method according to B10, wherein, described at least two concurrent threads are called by described master data base, and distribute described multiple synchronous task on described at least two concurrent threads according to preset rules.
B12, method according to B10 or B11, wherein, described method also comprises:
In the process of the data syn-chronization realized and between described master data base, the described executing location information synchronous from data-base recording self, obtains synchronization log.
B13, method according to B12, wherein, after obtaining described synchronization log, describedly also to comprise:
Described synchronization log is uploaded to Cloud Server.
C14, a kind of master data base, the data syn-chronization on it to from database, to be describedly activated from the transmission interface of at least two database by described master data base, and to receive the data of described master data base transmission, described master data base comprises:
Acquisition module, is suitable for obtaining data to be synchronized;
Generation module, is suitable for according to the multiple synchronous task of described data genaration to be synchronized;
Calling module, be suitable for calling at least two concurrent threads, wherein, each thread carries out data transmission with described from the different transmission interfaces database respectively;
Distribution module, is suitable for distributing described multiple synchronous task on described at least two concurrent threads according to preset rules; And
Transport module, at least two concurrent threads described in being suitable for utilizing, transmit described multiple synchronous task to described from the different transmission interfaces database, to realize and data syn-chronization between described master data base from database root for described according to described multiple synchronous task.
C15, master data base according to C14, wherein, described distribution module is also suitable for:
Distribute described multiple synchronous task according to the object identity in described multiple synchronous task, the synchronous task possessing same object mark is dispensed in same thread; Or
Distribute described multiple synchronous task according to the tables of data mark in described multiple synchronous task, the synchronous task possessing identical data table mark is dispensed in same thread.
C16, master data base according to C15, wherein, described distribution module is also suitable for:
The synchronous task possessing same object mark is dispensed in same thread according to sequential or clooating sequence.
C17, master data base according to C15 or C16, wherein, described distribution module is also suitable for:
The synchronous task possessing identical data table mark is dispensed in same thread according to sequential or clooating sequence.
C18, master data base according to any one of C14-C17, wherein,
Described calling module, is also suitable for the quantity according to described multiple synchronous task, calls the concurrent thread of respective numbers; And
Described distribution module, is also suitable for being dispensed to man-to-man for described multiple synchronous task in the concurrent thread of described respective numbers.
C19, master data base according to any one of C14-C18, wherein, at least two concurrent threads described in utilizing at described transport module, transmit described multiple synchronous task to described from the process of the different transmission interfaces database, if described acquisition module gets new data to be synchronized, then described generation module is also suitable for:
The multiple synchronous tasks new according to described data genaration to be synchronized newly.
C20, master data base according to C19, wherein, described distribution module is also suitable for:
Described multiple synchronous tasks are newly distributed in described at least two concurrent threads according to described preset rules.
C21, master data base according to C19, wherein,
Described calling module is also suitable for calling new thread; And
Described distribution module is also suitable for distributing in described multiple synchronous tasks newly to described new thread according to described preset rules, sends described multiple synchronous tasks newly to described from database to utilize described new thread.
C22, master data base according to any one of C14-C21, wherein, described to realize from database root according to described multiple synchronous task and data syn-chronization between described master data base process, the described executing location information synchronous from data-base recording self, to obtain synchronization log.
C23, master data base according to any one of C14-C22, wherein, described acquisition module is also suitable for:
Obtain the journal file of described master data base and the described synchronization log from database; And
More described journal file and the described synchronization log from database, determine described data to be synchronized.
D24, a kind of from database, to be describedly activated from the transmission interface of at least two database, to receive the data of master data base transmission, describedly to comprise from database:
Receiver module, be suitable for utilization described from the transmission interface of at least two database, the multiple synchronous tasks from described master data base are received from the thread that at least two to its transmission data are concurrent, wherein, described at least two concurrent threads and described at least two transmission interfaces are one to one; And
Synchronization module, is suitable for according to described multiple synchronous task, the data syn-chronization between realization and described master data base.
D25, according to D24 from database, wherein, described at least two concurrent threads are called by described master data, and distribute described multiple synchronous task on described at least two concurrent threads according to preset rules.
D26, according to D24 or D25 from database, wherein, described synchronization module is also suitable for:
In the process of the data syn-chronization realized and between described master data base, record self synchronous executing location information, obtain synchronization log.
D27, according to D26 from database, wherein, after obtaining described synchronization log, described synchronization module is also suitable for:
Described synchronization log is uploaded to Cloud Server.
The system of E28, a kind of synchrodata, comprise described in master data base described in any one of C14-C23 and any one of D24-D27 from database.
Claims (10)
1. a method for synchrodata, is applied to and has hypotactic database, is wherein activated from the transmission interface of at least two database, and to receive the data of master data base transmission, described method comprises:
Obtain data to be synchronized, and according to the multiple synchronous task of described data genaration to be synchronized;
Call at least two concurrent threads, wherein, each thread carries out data transmission with described from the different transmission interfaces database respectively;
Described multiple synchronous task is distributed on described at least two concurrent threads according to preset rules; And
At least two concurrent threads described in utilization, transmit described multiple synchronous task to described from the different transmission interfaces database, to realize and data syn-chronization between described master data base from database root for described according to described multiple synchronous task.
2. method according to claim 1, wherein, describedly distribute described multiple synchronous task according to preset rules and comprise further to the step on described at least two concurrent threads:
Distribute described multiple synchronous task according to the object identity in described multiple synchronous task, the synchronous task possessing same object mark is dispensed in same thread; Or
Distribute described multiple synchronous task according to the tables of data mark in described multiple synchronous task, the synchronous task possessing identical data table mark is dispensed in same thread.
3. method according to claim 2, wherein, describedly to comprise the step that is dispensed in same thread of synchronous task possessing same object mark further:
The synchronous task possessing same object mark is dispensed in same thread according to sequential or clooating sequence.
4. according to the method in claim 2 or 3, wherein, described the step that is dispensed in same thread of synchronous task possessing identical data table mark to be comprised further:
The synchronous task possessing identical data table mark is dispensed in same thread according to sequential or clooating sequence.
5. the method according to any one of claim 1-4, wherein, described in call at least two concurrent threads, distribute described multiple synchronous task according to preset rules and comprise further to the step on described at least two concurrent threads:
According to the quantity of described multiple synchronous task, call the concurrent thread of respective numbers; And
Be dispensed to man-to-man for described multiple synchronous task in the concurrent thread of described respective numbers.
6. the method according to any one of claim 1-5, wherein, described described in utilizing at least two concurrent threads, transmit described multiple synchronous task to described from the process of the different transmission interfaces database, if get new data to be synchronized, then new according to described data genaration to be synchronized newly multiple synchronous tasks.
7. method according to claim 6, wherein, described method also comprises:
Described multiple synchronous tasks are newly distributed in described at least two concurrent threads according to described preset rules; Or
Call new thread, and distribute in described multiple synchronous tasks newly to described new thread according to described preset rules, send described multiple synchronous tasks newly to described from database to utilize described new thread.
8. a master data base, the data syn-chronization on it to from database, to be describedly activated from the transmission interface of at least two database by described master data base, and to receive the data of described master data base transmission, described master data base comprises:
Acquisition module, is suitable for obtaining data to be synchronized;
Generation module, is suitable for according to the multiple synchronous task of described data genaration to be synchronized;
Calling module, be suitable for calling at least two concurrent threads, wherein, each thread carries out data transmission with described from the different transmission interfaces database respectively;
Distribution module, is suitable for distributing described multiple synchronous task on described at least two concurrent threads according to preset rules; And
Transport module, at least two concurrent threads described in being suitable for utilizing, transmit described multiple synchronous task to described from the different transmission interfaces database, to realize and data syn-chronization between described master data base from database root for described according to described multiple synchronous task.
9. from a database, to be describedly activated from the transmission interface of at least two database, to receive the data of master data base transmission, describedly to comprise from database:
Receiver module, be suitable for utilization described from the transmission interface of at least two database, the multiple synchronous tasks from described master data base are received from the thread that at least two to its transmission data are concurrent, wherein, described at least two concurrent threads and described at least two transmission interfaces are one to one; And
Synchronization module, is suitable for according to described multiple synchronous task, the data syn-chronization between realization and described master data base.
10. a system for synchrodata, comprises master data base according to claim 8 and according to claim 9 from database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510155678.1A CN104731956B (en) | 2015-04-02 | 2015-04-02 | Method, system and the Relational database of synchrodata |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510155678.1A CN104731956B (en) | 2015-04-02 | 2015-04-02 | Method, system and the Relational database of synchrodata |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104731956A true CN104731956A (en) | 2015-06-24 |
| CN104731956B CN104731956B (en) | 2019-07-23 |
Family
ID=53455843
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510155678.1A Active CN104731956B (en) | 2015-04-02 | 2015-04-02 | Method, system and the Relational database of synchrodata |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104731956B (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104994177A (en) * | 2015-08-06 | 2015-10-21 | 上海爱数软件有限公司 | Synchronized method of network disk system, terminal equipment and network disk system |
| CN105227683A (en) * | 2015-11-11 | 2016-01-06 | 中国建设银行股份有限公司 | A kind of LDAP company-data synchronous method and system |
| CN105491106A (en) * | 2015-11-18 | 2016-04-13 | 中国石油天然气集团公司 | Real-time synchronization system and method for oil well logging master-slave database systems |
| CN106682164A (en) * | 2016-12-26 | 2017-05-17 | 北京奇虎科技有限公司 | Method and device for expanding master-slave database system |
| CN106776790A (en) * | 2016-11-11 | 2017-05-31 | 北京奇虎科技有限公司 | Concurrent master-slave synchronisation method and device based on token |
| CN106776775A (en) * | 2016-11-11 | 2017-05-31 | 北京奇虎科技有限公司 | Concurrent master-slave synchronisation method and device |
| CN107741965A (en) * | 2017-09-30 | 2018-02-27 | 北京奇虎科技有限公司 | Database synchronization processing method, device, computing device and computer-readable storage medium |
| CN108108463A (en) * | 2017-12-29 | 2018-06-01 | 北京奇虎科技有限公司 | Synchronous task processing method and processing device based on time slice scheduling |
| CN108763358A (en) * | 2018-05-16 | 2018-11-06 | 阿里巴巴集团控股有限公司 | A kind of data verification method and device |
| CN109116818A (en) * | 2018-08-08 | 2019-01-01 | 新智能源系统控制有限责任公司 | Real time data dump method and device when a kind of SCADA system upgrades |
| CN109299116A (en) * | 2018-12-05 | 2019-02-01 | 浪潮电子信息产业股份有限公司 | A kind of method of data synchronization, device, equipment and readable storage medium storing program for executing |
| CN110019059A (en) * | 2017-12-04 | 2019-07-16 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus of Timing Synchronization |
| CN111858501A (en) * | 2020-06-02 | 2020-10-30 | 武汉达梦数据库有限公司 | Log reading method and data synchronization system based on log analysis synchronization |
| CN111984729A (en) * | 2020-08-14 | 2020-11-24 | 北京人大金仓信息技术股份有限公司 | Heterogeneous database data synchronization method, device, medium and electronic equipment |
| CN113010602A (en) * | 2021-03-12 | 2021-06-22 | 北京三快在线科技有限公司 | Data synchronization method, device and system |
| TWI731926B (en) * | 2017-01-24 | 2021-07-01 | 香港商阿里巴巴集團服務有限公司 | Data synchronization method and device |
| CN113535664A (en) * | 2021-09-14 | 2021-10-22 | 深圳兆瑞优品科技有限公司 | Database data synchronization method based on data page preloading |
| CN114594907A (en) * | 2022-02-24 | 2022-06-07 | 百果园技术(新加坡)有限公司 | Data read-write processing method, device, equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102542007A (en) * | 2011-12-13 | 2012-07-04 | 中国电子科技集团公司第十五研究所 | Method and system for synchronization of relational databases |
| CN103500229A (en) * | 2013-10-24 | 2014-01-08 | 北京奇虎科技有限公司 | Database synchronization method and database system |
| CN104346479A (en) * | 2014-11-26 | 2015-02-11 | 北京奇虎科技有限公司 | Database synchronization method and database synchronization device |
-
2015
- 2015-04-02 CN CN201510155678.1A patent/CN104731956B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102542007A (en) * | 2011-12-13 | 2012-07-04 | 中国电子科技集团公司第十五研究所 | Method and system for synchronization of relational databases |
| CN103500229A (en) * | 2013-10-24 | 2014-01-08 | 北京奇虎科技有限公司 | Database synchronization method and database system |
| CN104346479A (en) * | 2014-11-26 | 2015-02-11 | 北京奇虎科技有限公司 | Database synchronization method and database synchronization device |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104994177B (en) * | 2015-08-06 | 2019-01-25 | 上海爱数信息技术股份有限公司 | Synchronous method, terminal device and the Dropbox system of Dropbox system |
| CN104994177A (en) * | 2015-08-06 | 2015-10-21 | 上海爱数软件有限公司 | Synchronized method of network disk system, terminal equipment and network disk system |
| CN105227683A (en) * | 2015-11-11 | 2016-01-06 | 中国建设银行股份有限公司 | A kind of LDAP company-data synchronous method and system |
| CN105491106A (en) * | 2015-11-18 | 2016-04-13 | 中国石油天然气集团公司 | Real-time synchronization system and method for oil well logging master-slave database systems |
| CN106776790A (en) * | 2016-11-11 | 2017-05-31 | 北京奇虎科技有限公司 | Concurrent master-slave synchronisation method and device based on token |
| CN106776775A (en) * | 2016-11-11 | 2017-05-31 | 北京奇虎科技有限公司 | Concurrent master-slave synchronisation method and device |
| CN106776775B (en) * | 2016-11-11 | 2021-05-07 | 北京奇虎科技有限公司 | Concurrent master-slave synchronization method and device |
| CN106682164A (en) * | 2016-12-26 | 2017-05-17 | 北京奇虎科技有限公司 | Method and device for expanding master-slave database system |
| TWI731926B (en) * | 2017-01-24 | 2021-07-01 | 香港商阿里巴巴集團服務有限公司 | Data synchronization method and device |
| CN107741965A (en) * | 2017-09-30 | 2018-02-27 | 北京奇虎科技有限公司 | Database synchronization processing method, device, computing device and computer-readable storage medium |
| CN107741965B (en) * | 2017-09-30 | 2021-06-29 | 北京奇虎科技有限公司 | Database synchronous processing method and device, computing equipment and computer storage medium |
| CN110019059A (en) * | 2017-12-04 | 2019-07-16 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus of Timing Synchronization |
| CN108108463B (en) * | 2017-12-29 | 2021-08-24 | 北京奇虎科技有限公司 | Synchronous task processing method and device based on time slice scheduling |
| CN108108463A (en) * | 2017-12-29 | 2018-06-01 | 北京奇虎科技有限公司 | Synchronous task processing method and processing device based on time slice scheduling |
| CN108763358A (en) * | 2018-05-16 | 2018-11-06 | 阿里巴巴集团控股有限公司 | A kind of data verification method and device |
| CN109116818A (en) * | 2018-08-08 | 2019-01-01 | 新智能源系统控制有限责任公司 | Real time data dump method and device when a kind of SCADA system upgrades |
| CN109299116A (en) * | 2018-12-05 | 2019-02-01 | 浪潮电子信息产业股份有限公司 | A kind of method of data synchronization, device, equipment and readable storage medium storing program for executing |
| CN111858501A (en) * | 2020-06-02 | 2020-10-30 | 武汉达梦数据库有限公司 | Log reading method and data synchronization system based on log analysis synchronization |
| CN111858501B (en) * | 2020-06-02 | 2023-03-28 | 武汉达梦数据库股份有限公司 | Log reading method based on log analysis synchronization and data synchronization system |
| CN111984729A (en) * | 2020-08-14 | 2020-11-24 | 北京人大金仓信息技术股份有限公司 | Heterogeneous database data synchronization method, device, medium and electronic equipment |
| CN113010602A (en) * | 2021-03-12 | 2021-06-22 | 北京三快在线科技有限公司 | Data synchronization method, device and system |
| CN113535664A (en) * | 2021-09-14 | 2021-10-22 | 深圳兆瑞优品科技有限公司 | Database data synchronization method based on data page preloading |
| CN113535664B (en) * | 2021-09-14 | 2021-12-31 | 深圳兆瑞优品科技有限公司 | Database data synchronization method based on data page preloading |
| CN114594907A (en) * | 2022-02-24 | 2022-06-07 | 百果园技术(新加坡)有限公司 | Data read-write processing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104731956B (en) | 2019-07-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104731956A (en) | Method and system for synchronizing data and related database | |
| CN104699541B (en) | Method, apparatus, data transfer components and the system of synchrodata | |
| US11310313B2 (en) | Multi-threaded processing of search responses returned by search peers | |
| US10506084B2 (en) | Timestamp-based processing of messages using message queues | |
| CN107515878B (en) | Data index management method and device | |
| US20150193243A1 (en) | System and method for extracting data from legacy data systems to big data platforms | |
| CN104881466B (en) | The processing of data fragmentation and the delet method of garbage files and device | |
| US9836516B2 (en) | Parallel scanners for log based replication | |
| CN109643310B (en) | System and method for redistribution of data in a database | |
| CN111324610A (en) | Data synchronization method and device | |
| CN105468720A (en) | Method for integrating distributed data processing systems, corresponding systems and data processing method | |
| CN104699723A (en) | Data exchange adapter and system and method for synchronizing data among heterogeneous systems | |
| CN103927331A (en) | Data querying method, data querying device and data querying system | |
| CN110245134B (en) | Increment synchronization method applied to search service | |
| CN102946410A (en) | Method and device for network synchronization | |
| CN102946411A (en) | Network synchronization system | |
| CN107646105B (en) | Cloud computing infrastructure | |
| CN104462342B (en) | database snapshot synchronization processing method and device | |
| CN110177144B (en) | Method for copying application environment by one key based on private cloud | |
| CN108595121B (en) | Data storage method and device | |
| CN110008284A (en) | Method for synchronizing data of database and equipment based on data page preloading and rollback | |
| CN103634374A (en) | Method and device for processing concurrent access requests | |
| CN106815318B (en) | Clustering method and system for time sequence database | |
| US20200073727A1 (en) | Scheduling software jobs having dependencies | |
| CN103176843B (en) | The file migration method and apparatus of MapReduce distributed system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220725 Address after: Room 801, 8th floor, No. 104, floors 1-19, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee after: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Address before: 100088 room 112, block D, 28 new street, new street, Xicheng District, Beijing (Desheng Park) Patentee before: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Patentee before: Qizhi software (Beijing) Co.,Ltd. |