CN110083579A - Incremental data synchronous method, apparatus, computer equipment and computer storage medium - Google Patents
Incremental data synchronous method, apparatus, computer equipment and computer storage medium Download PDFInfo
- Publication number
- CN110083579A CN110083579A CN201910218794.1A CN201910218794A CN110083579A CN 110083579 A CN110083579 A CN 110083579A CN 201910218794 A CN201910218794 A CN 201910218794A CN 110083579 A CN110083579 A CN 110083579A
- Authority
- CN
- China
- Prior art keywords
- incremental data
- synchronization
- data
- synchronized
- incremental
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 242
- 230000001360 synchronised effect Effects 0.000 title claims abstract description 214
- 238000004590 computer program Methods 0.000 claims description 11
- 230000002123 temporal effect Effects 0.000 claims description 8
- 241001269238 Data Species 0.000 claims description 5
- 230000000694 effects Effects 0.000 description 8
- 238000010276 construction Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- KCXVZYZYPLLWCC-UHFFFAOYSA-N EDTA Chemical compound OC(=O)CN(CC(O)=O)CCN(CC(O)=O)CC(O)=O KCXVZYZYPLLWCC-UHFFFAOYSA-N 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000003542 behavioural effect Effects 0.000 description 1
- 229960001484 edetic acid Drugs 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/178—Techniques for file synchronisation in file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24564—Applying rules; Deductive queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Abstract
This application discloses a kind of incremental data synchronous method, apparatus, computer equipment and computer storage mediums, it is related to cloud storage technical field, the suitable incremental data method of synchronization can be pushed to and need synchronous tables of data, improve the synchronous efficiency of incremental data.The described method includes: obtaining the mode character for being suitable for the incremental data method of synchronization；The preset matching rule for being suitable for the incremental data method of synchronization is determined according to the mode character, constructs the regular expression of multiple incremental data methods of synchronization；When receiving incremental data synchronization request, the data in the incremental data table to be synchronized are matched with the regular expression of each increment synchronization mode respectively, searches whether there is the character string to match with the data in the tables of data to be synchronized；If it exists, then according to described synchronous to the incremental data table progress incremental data to be synchronized with the most incremental data method of synchronization of incremental data matched character string quantity in the tables of data to be synchronized.
Description
Technical field
The present invention relates to cloud storage technical fields, more particularly, to the synchronous method, apparatus of incremental data, computer equipment
And computer storage medium.
Background technique
The rapid development and information-based propulsion of computer network so that data become the precious resources of many enterprises so that
Data acquisition, storage and processing task are growing day by day, and network-based data sharing has become people and obtains data resource not
The mode that can or lack.
It needs to synchronize shared data in order to which data sharing is better achieved, data synchronize for enterprise to Guan Chong
It wants, for example the server end of enterprise is used to manage the business end for belonging to difference department, enterprise, and is stored in server end
Data are managed, then server end is managed each business end for convenience, while improving the data processing effect at business end
Rate needs to guarantee that the data between server end and each business end are synchronous.
Under normal conditions, whether can change after being written according to data will need synchronous data to be divided into two class data,
One kind is will not changed data, usually daily record data etc.；Another kind of is the data that can change, usually person chart
Deng.For the data that can change, with the correcting of time dimension, business end can constantly increase the data of record newly, the newly-increased record
Data be known as incremental data.User can select the different incremental data methods of synchronization according to actual needs, for example, full table is deleted
The incremental data method of synchronization, the timestamp dynamic incremental data method of synchronization updated and the incremental data compared one by one removed are same
Step mode.However, the different incremental data methods of synchronization needs the structure to tables of data, size to be judged manually, need to consume
Take a large amount of handling times to select the suitable incremental data method of synchronization, and be easy to produce mistake during manual operation
Accidentally, inappropriate incremental data method of synchronization is pushed to and needs synchronous tables of data, lead to the efficiency drop that incremental data is synchronous
It is low.
Summary of the invention
In view of this, the present invention provides a kind of incremental data synchronous method, apparatus, computer equipment and computers to deposit
Storage media, main purpose are to solve the problems, such as that incremental data synchronous efficiency is low in presently relevant technology.
According to the present invention on one side, a kind of method that incremental data is synchronous is provided, this method comprises:
Obtain the mode character for being suitable for the incremental data method of synchronization；
The preset matching rule for being suitable for the incremental data method of synchronization is determined according to the mode character, constructs multiple increments
The regular expression of the data method of synchronization；
When receiving incremental data synchronization request, by the data in the incremental data table to be synchronized respectively with each increasing
The regular expression of the amount method of synchronization is matched, and is searched whether to exist and is matched with the data in the tables of data to be synchronized
Character string；
If it exists, then according to the increment most with incremental data matched character string quantity in the tables of data to be synchronized
It is synchronous that the data method of synchronization carries out incremental data to the incremental data table to be synchronized.
Further, described obtain includes: suitable for the mode character of the incremental data method of synchronization
It is suitable for the field of the data table definitions of the incremental data method of synchronization by parsing, obtains same suitable for incremental data
The field of step mode；
From the preset field of being chosen suitable for the field of the incremental data method of synchronization as same suitable for incremental data
The mode character of step mode.
Further, the characteristic information suitable for the incremental data method of synchronization, the basis are included in the mode character
The mode character determines the preset matching rule for being suitable for the incremental data method of synchronization, constructs multiple incremental data methods of synchronization
Regular expression include:
According to the characteristic information for being suitable for the incremental data method of synchronization in the mode character, determine that the mode character exists
Matching rule in incremental data table；
According to matching rule of the mode character in incremental data table, multiple incremental data methods of synchronization are being constructed just
Then expression formula.
Further, described according to the characteristic information for being suitable for the incremental data method of synchronization in the mode character, it determines
Matching rule of the mode character in incremental data table include:
If the characteristic information for being suitable for the incremental data method of synchronization in the mode character is location information, with the mould
Field location of the formula character in incremental data table is as matching rule；
If the characteristic information for being suitable for the incremental data method of synchronization in the mode character is temporal information, with the mould
Timestamp of the formula character in incremental data table is as matching rule；
If the characteristic information for being suitable for the incremental data method of synchronization in the mode character is frequency information, with the mould
Frequency of occurrence of the formula character in incremental data table is as matching rule.
Further, the matching rule according to the mode character in incremental data table, constructs multiple incremental numbers
Include: according to the regular expression of the method for synchronization
According to matching rule of the mode character in incremental data table, is filtered out from character list and meet incremental data
The general character string and special string of the method for synchronization, the character list include the common word for combining various matching rules
Symbol string and special string；
The general character string for meeting the incremental data method of synchronization and special string are directed into expression templates
In, construct the regular expression of multiple incremental data methods of synchronization.
It further, will be in the incremental data table to be synchronized described when receiving incremental data synchronization request
Data are matched with the regular expression of each increment synchronization mode respectively, search whether exist and the tables of data to be synchronized
In the character string that matches of data after, the method also includes:
If it does not exist, then it is determined according to the corresponding data volume size of incremental data table to be synchronized and is suitable for incremental number to be synchronized
According to the incremental data method of synchronization of table；
According to the incremental data method of synchronization suitable for incremental data table to be synchronized to the incremental data to be synchronized
It is synchronous that table carries out incremental data.
Further, described that the incremental data method of synchronization is determined according to the corresponding data volume size of incremental data table to be synchronized
Include:
Count the number of data in the incremental data table to be synchronized；
If the number of data in the incremental data table to be synchronized is less than or equal to default value, deleted using full table
The incremental data method of synchronization；
If the number of data in the incremental data table to be synchronized is greater than default value, using the increment compared one by one
The data method of synchronization.
According to the present invention on the other hand, a kind of device that incremental data is synchronous is provided, described device includes:
Acquiring unit, for obtaining the mode character for being suitable for the incremental data method of synchronization；
Structural unit, for determining that the preset matching for being suitable for the incremental data method of synchronization is advised according to the mode character
Then, the regular expression of multiple incremental data methods of synchronization is constructed；
Searching unit, for when receiving incremental data synchronization request, by the number in the incremental data table to be synchronized
According to being matched respectively with the regular expression of each increment synchronization mode, search whether exist in the tables of data to be synchronized
The character string that matches of data；
First synchronization unit, for if it exists, then matching word with incremental data in the tables of data to be synchronized according to described
It is synchronous that the most incremental data method of synchronization of symbol string quantity carries out incremental data to the incremental data table to be synchronized.
Further, the acquiring unit includes:
Module is obtained, the field of the data table definitions for being suitable for the incremental data method of synchronization by parsing obtains suitable
Field for the incremental data method of synchronization；
Module is chosen, is applicable in for being used as from the selection preset field suitable for the field of the incremental data method of synchronization
In the mode character of the incremental data method of synchronization.
Further, the characteristic information suitable for the incremental data method of synchronization, the construction are included in the mode character
Unit includes:
First determining module, for according in the mode character be suitable for the incremental data method of synchronization characteristic information,
Determine matching rule of the mode character in incremental data table；
Constructing module constructs multiple incremental numbers for the matching rule according to the mode character in incremental data table
According to the regular expression of the method for synchronization.
Further, first determining module, if be specifically used for same suitable for incremental data in the mode character
The characteristic information of step mode is location information, is advised using field location of the mode character in incremental data table as matching
Then；
First determining module, if be specifically also used in the mode character suitable for the incremental data method of synchronization
Characteristic information is temporal information, using timestamp of the mode character in incremental data table as matching rule；
First determining module, if be specifically also used in the mode character suitable for the incremental data method of synchronization
Characteristic information is frequency information, using frequency of occurrence of the mode character in incremental data table as matching rule.
Further, the constructing module, specifically for being advised according to matching of the mode character in incremental data table
Then, the general character string and special string for meeting the incremental data method of synchronization, the character list are filtered out from character list
Including the general character string and special string for combining various matching rules；
The constructing module is specifically also used to the general character string for meeting the incremental data method of synchronization and special
Character string is directed into expression templates, constructs the regular expression of multiple incremental data methods of synchronization.
Further, described device further include:
Determination unit, for described when receiving incremental data synchronization request, by the incremental data table to be synchronized
In data matched respectively with the regular expression of each increment synchronization mode, search whether exist and the number to be synchronized
It is if it does not exist, then big according to the corresponding data volume of incremental data table to be synchronized after the character string to match according to the data in table
Small determination is suitable for the incremental data method of synchronization of incremental data table to be synchronized；
Second synchronization unit, for the incremental data method of synchronization according to suitable for incremental data table to be synchronized to institute
It is synchronous to state incremental data table progress incremental data to be synchronized.
Further, the determination unit includes:
Statistical module, for counting the number of data in the incremental data table to be synchronized；
Second determining module, if being less than or equal to present count for the number of data in the incremental data table to be synchronized
Value, it is determined that the incremental data method of synchronization deleted using full table；
Second determining module, if the number of data being also used in the incremental data table to be synchronized is greater than present count
Value, it is determined that using the incremental data method of synchronization compared one by one.
Another aspect according to the present invention provides a kind of computer equipment, including memory and processor, the storage
Device is stored with computer program, and the processor realizes the step of the synchronous method of incremental data when executing the computer program
Suddenly.
Another aspect according to the present invention provides a kind of computer storage medium, is stored thereon with computer program, institute
The step of stating the method that realization incremental data synchronizes when computer program is executed by processor.
By above-mentioned technical proposal, the present invention provides a kind of incremental data synchronous method and device, when receiving increment
When data synchronization request, incremental data to be synchronized is matched by the regular expression of multiple incremental data methods of synchronization, is searched
Whether containing in the presence of the character string to match with incremental data in tables of data to be synchronized, and if it exists, then illustrate in tables of data to be synchronized
Data be suitable for one of multiple incremental data methods of synchronization, further according to and incremental number in the tables of data to be synchronized
It carries out incremental data to incremental data table to be synchronized according to the most incremental data method of synchronization of matched character string quantity to synchronize, to mention
The synchronous efficiency of high incremental data.With suitable incremental data method of synchronization phase is selected by manual operation in the prior art
Than the embodiment of the present invention matches increment to be synchronized by constructing the regular expression suitable for the different incremental data methods of synchronization
Field in tables of data can select to be suitble to incremental data method of synchronization completion incremental data same for the characteristic of incremental data table
Step task, since can to optimize incremental data synchronous effect and incremental data synchronous for the suitable incremental data method of synchronization
Accuracy carries out incremental data by the suitable incremental data method of synchronization and synchronizes, save system resource, reduces manual operation,
And improve the synchronous resource utilization of incremental data.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows a kind of synchronous method flow schematic diagram of incremental data provided in an embodiment of the present invention；
Fig. 2 shows the synchronous method flow schematic diagrams of another incremental data provided in an embodiment of the present invention；
Fig. 3 shows a kind of structural schematic diagram of the synchronous device of incremental data provided in an embodiment of the present invention；
Fig. 4 shows the structural schematic diagram of the synchronous device of another incremental data provided in an embodiment of the present invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
The embodiment of the invention provides a kind of synchronous method of incremental data, may be implemented to improve incremental data synchronous efficiency
Purpose, as shown in Figure 1, this method comprises:
101, the mode character for being suitable for the incremental data method of synchronization is obtained.
Wherein, the incremental data method of synchronization, the data that the incremental data method of synchronization can update for timestamp dynamic are incremented by
The incremental data method of synchronization, during incremental data is synchronous, the different incremental data methods of synchronization, which have, intrinsic synchronizes spy
Point has preferable synchronous effect for the tables of data of a certain type, and for other kinds of tables of data, possible synchronous effect
It is not that very well, mode character here is equivalent to the matched character string for the configuration of the incremental data method of synchronization, the matching word
Symbol string can be table name or literary name section etc., here without limiting.
The incremental data method of synchronization that above-mentioned timestamp dynamic updates is by searching for specific in tables of data to be synchronized
Timestamp, and the incremental data after specific time stamp is synchronized, and be synchronized to data center's tables of data corresponding time
Position is stabbed, generally directed to the tables of data of logging timestamp, so being suitable for the incremental data method of synchronization that timestamp dynamic updates
Mode character can be tables of data time field.The incremental incremental data method of synchronization of above-mentioned data be by searching for
Incremental data difference in synchrodata, and incremental data difference is synchronized, and be synchronized to the end of data center's tables of data,
Generally directed to the daily record data table being written one by one, so the mode character for being suitable for the incremental data method of synchronization that data are incremented by can
Think the table name field of tables of data.
Since the structure of different incremental data tables is different, different structure makes incremental data table be suitable for different incremental datas
The method of synchronization, for example, recording having time stamp in literary name section when data are written for incremental data table to be synchronized, explanation can root
The incremental data in incremental data table to be synchronized is judged according to timestamp, it is dynamic which is more suitable for timestamp
The incremental data method of synchronization that state updates, and be to be written in table one by one when data are written for incremental data table to be synchronized,
Illustrate that incremental data can be written to table end, incremental data to be synchronized can be judged by data volume difference in comparison data table
Incremental data in table, the incremental data table to be synchronized are more suitable for the incremental incremental data method of synchronization of data.
102, the preset matching rule for being suitable for the incremental data method of synchronization is determined according to the mode character, is constructed multiple
The regular expression of the incremental data method of synchronization.
It include the table suitable for the tables of data of the incremental data method of synchronization for the embodiment of the present invention, in mode character
Feature, and the table features may be the temporal information of matching field in the table, may occur in the table for matching field
Frequency, may be the position etc. of matching field in the table, different table features need to assign different matching rules, into
One step determines the matching rule of each incremental data method of synchronization according to mode character, for example, if mode character includes
Table features are the temporal information of matching field in the table, it is determined that the matching rule of the incremental data method of synchronization is to be related to counting
According to the matching rule that the write time stabs, if the table features that mode character includes are the position letter of matching field in the table
Breath, it is determined that the matching rule of the incremental data method of synchronization is to be related to the matching rule of data writing position, here without limit
It is fixed.
For the embodiment of the present invention, regular expression describes a kind of mode of string matching, is suitable for for defining
The preset matching rule of the incremental data method of synchronization, can be checked in tables of data to be synchronized by regular expression with the presence or absence of symbol
The character string of the suitable preset matching rule for the incremental data method of synchronization, to determine suitable increase for tables of data to be synchronized
Measure the data method of synchronization.
103, when receiving incremental data synchronization request, respectively and often by the data in the incremental data table to be synchronized
The regular expression of a increment synchronization mode is matched, and searches whether exist and the data phase in the tables of data to be synchronized
The character string matched.
For the embodiment of the present invention, for the tables of data with time change, tables of data is being synchronized to data by business side
Behind center, meeting certain interval of time starts incremental data synchronous task, and sends incremental data synchronization request, requests tables of data
The data of middle variation are synchronized to data center, and the data changed in tables of data here are exactly incremental data, and correspondence is stored in same
It walks in incremental data table.
Wherein, the incremental data in incremental data table to be synchronized can be the incremental data that server automatically generates, client
The user information incremental data etc. of input is held, data can also be increased to record the log of user behavior in platform, for example, user is clear
Look at the data of webpage, user buys the data etc. of commodity, here without limiting.
For the embodiment of the present invention, when receiving incremental data synchronization request, due in incremental data table to be synchronized
Incremental data is not particularly suited for all incremental data methods of synchronization, if selecting inappropriate incremental data method of synchronization may
The synchronous efficiency for reducing incremental data, here by the way that the data in the incremental data table to be synchronized are same with each increment respectively
The regular expression of step mode is matched, and searches whether there is the character to match with incremental data in tables of data to be synchronized
String, thus for the suitable incremental data side of synchronization is selected the characteristics of incremental data in incremental data table to be synchronized for incremental data
Formula, to improve the synchronous efficiency of incremental data.
104, if it exists, then most with incremental data matched character string quantity in the tables of data to be synchronized according to described
It is synchronous that the incremental data method of synchronization carries out incremental data to the incremental data table to be synchronized.
For the embodiment of the present invention, the character string to match if it exists with incremental data in incremental data table to be synchronized, then
Illustrate to exist in multiple incremental data methods of synchronization and be suitble to the method for synchronization of incremental data in tables of data to be synchronized, and with to same
Data Matching character string quantity in step data table is more, illustrates that the data in tables of data to be synchronized are more suitable for the incremental data
The method of synchronization can save synchronization time using the incremental data method of synchronization, further select and increase in tables of data to be synchronized
It is synchronous to measure the most incremental data method of synchronization progress incremental data of Data Matching character string quantity.
Illustratively, if all existed in table name field and column field in incremental data table to be synchronized and data are incremented by
The character string that matches of the incremental data method of synchronization, then the incremental data for illustrating that tables of data to be synchronized is suitble to data incremental is same
Step mode further judges that tables of data to be synchronized is compared with the tables of data for being synchronized to data center, will compare difference
Data volume is directly synchronized to the end of the tables of data of data center, completes incremental data synchronous task.
The present invention provides a kind of method that incremental data is synchronous, when receiving incremental data synchronization request, by multiple
The regular expression of the incremental data method of synchronization matches incremental data to be synchronized, searches whether containing existing and tables of data to be synchronized
The character string that middle incremental data matches, and if it exists, then illustrate that the data in tables of data to be synchronized are suitable for multiple incremental datas
One of method of synchronization, further according to the increasing most with incremental data matched character string quantity in the tables of data to be synchronized
It is synchronous to incremental data table to be synchronized progress incremental data to measure the data method of synchronization, to improve the synchronous efficiency of incremental data.With
The suitable incremental data method of synchronization is selected to compare by manual operation in the prior art, the embodiment of the present invention is suitable by construction
The field in incremental data table to be synchronized is matched for the regular expression of the different incremental data methods of synchronization, it can be for increasing
The characteristic for measuring tables of data selects that the incremental data method of synchronization is suitble to complete incremental data synchronous task, due to suitable incremental data
The accuracy that the method for synchronization can optimize incremental data synchronous effect and incremental data synchronizes, passes through suitable incremental data
The method of synchronization carries out incremental data and synchronizes, and saves system resource, reduces manual operation, and improves the synchronous resource of incremental data
Utilization rate.
The embodiment of the invention provides the synchronous method of another incremental data, may be implemented to improve the synchronous effect of incremental data
The purpose of rate, as shown in Figure 2, which comprises
201, it is suitable for the field of the data table definitions of the incremental data method of synchronization by parsing, obtains and be suitable for incremental number
According to the field of the method for synchronization.
Due to different types of data table have different structures, may cause incremental data have the characteristics that it is different, here
It can be the table name or row field tables of data to be synchronized suitable for the field of the data table definitions of the incremental data method of synchronization
Deng for example, illustrating that the data in the tables of data are written one by one comprising log in the table name of some tables of data, so increasing
Measuring data is also to be written one by one, is to include at least log table name field suitable for the field of the incremental data method of synchronization, has
Tables of data be table column field in record having time stamp, illustrate in the tables of data that every write-in data record having time is stabbed,
So incremental data is also that there is timestamp to record, suitable for the field of the incremental data method of synchronization be table column field at least
Include timestamp.
For the embodiment of the present invention, can be specifically suitable for by the table structure of the scanning all tables of data in business side, parsing
The field of the data table definitions of the incremental data method of synchronization, such as table name, table numbering obtain suitable according to the field of data table definitions
For the field of the incremental data method of synchronization, for example, the field for being suitable for incremental data table is table name, it is same to be suitable for incremental data
The field of step mode is the particular content for including in table name, and the field suitable for incremental data table is table column field, is suitable for increasing
The field of the amount data method of synchronization is the particular content for including in table column field.
202, preset field is chosen suitable for the field of the incremental data method of synchronization and is used as from described be suitable for incremental number
According to the mode character of the method for synchronization.
For the embodiment of the present invention, the field due to being suitable for the incremental data method of synchronization may be comprising multiple, such as table
It, can be from suitable for incremental number in order to improve the accuracy of successive character String matching comprising log, report etc. in name name section
According to selecting the higher field of matching degree to match here in the field of the method for synchronization as the mode character of the incremental data method of synchronization
Spend higher field be usually in the higher field of the frequency of occurrences suitable for the corresponding tables of data of the incremental data method of synchronization, this
In without limit.
203, according to the characteristic information for being suitable for the incremental data method of synchronization in the mode character, the pattern-word is determined
Accord with the matching rule in incremental data table.
Wherein, in mode character comprising suitable for the incremental data method of synchronization characteristic information, here be suitable for increment
The characteristic information of the data method of synchronization can be location information, temporal information or frequency information etc., here without limiting.
Specifically, different characteristic informations is corresponding with different matching rules, if being suitable for increment in mode character
The characteristic information of the data method of synchronization is location information, and field location of the character in incremental data table is as matching rule in mode
Then；If the characteristic information for being suitable for the incremental data method of synchronization in mode character is temporal information, character is in increment in mode
Timestamp in tables of data is as matching rule；If the characteristic information in mode character suitable for the incremental data method of synchronization is
Frequency information, frequency of occurrence of the character in incremental data table is as matching rule in mode.
204, the matching rule according to the mode character in incremental data table constructs multiple incremental data methods of synchronization
Regular expression.
Wherein, the regular expression of the incremental data method of synchronization of construction is by general character string (such as a to z) and spy
Whether the type mode of different character string (referred to as " metacharacter ") composition, can be for checking containing certain substring in a string, will
Matched substring does replacement or takes out the substring etc. for meeting some condition from some string.
It, specifically can be according to matching rule of the mode character in incremental data table, from character for the embodiment of the present invention
The general character string for meeting the incremental data method of synchronization is filtered out in table, which includes for combining various matching rules
General character string and special string, such as number or letter and special string, such as underscore, slash, and
Here regular expression has specific expression templates, will meet general character string and the spy of the incremental data method of synchronization
Different character string is directed into expression templates, constructs the regular expression of multiple incremental data methods of synchronization, can be by some word
Symbol mode is matched with the character searched for.
205, when receiving incremental data synchronization request, respectively and often by the data in the incremental data table to be synchronized
The regular expression of a increment synchronization mode is matched, and searches whether exist and the data phase in the tables of data to be synchronized
The character string matched.
For the embodiment of the present invention, with the update of time, newly-increased data can be put into increment to be synchronized by service center
In tables of data, when certain data volume is arrived in accumulation in incremental data table to be synchronized or business side sends incremental data synchronization request
When, incremental data is synchronized to data center, here mainly for incremental data synchronize, which can be database
The behavioral data of middle user can be the daily record data etc. recorded in platform.
It can specifically be gone to match the word in incremental data table to be synchronized according to the regular expression of the incremental data method of synchronization
Section content, searching the field contents in incremental data table to be synchronized whether there is met suitable for the incremental data method of synchronization
Character string with rule.
206a, if it exists, then according to described most with incremental data matched character string quantity in the tables of data to be synchronized
The incremental data method of synchronization to carry out incremental data to the incremental data table to be synchronized synchronous.
For the embodiment of the present invention, if there is suitable for the incremental data method of synchronization in incremental data table to be synchronized
Character string with rule, illustrates that the corresponding structure of incremental data table to be synchronized meets the condition of this kind of incremental data method of synchronization,
To using the most incremental data method of synchronization of matched character string quantity as the incremental data for being applicable in incremental data table to be synchronized
The method of synchronization synchronizes to treat synchrodata table using the incremental data method of synchronization and carry out incremental data, to improve increment
The synchronizing speed of data.
It is corresponding with step 206a to have step 206b, if it does not exist, then according to the corresponding number of incremental data table to be synchronized
The incremental data method of synchronization for being suitable for incremental data table to be synchronized is determined according to amount size.
It should be noted that regular expression here is not particularly suited for all incremental data methods of synchronization, some to
Field contents in synchronous incremental data table can not be analyzed by way of regular expression matching is suitble to the increment to be synchronized
The incremental data method of synchronization of tables of data, then being that can not find in incremental data table to be synchronized to exist by regular expression
Matched character string, so needing using other incremental data methods of synchronization, for example, the incremental data side of synchronization that full table is deleted
Formula etc..
For the embodiment of the present invention, if there is no the character string for the matching rule for being suitable for the incremental data method of synchronization,
Then illustrate that the regular expression for constructing multiple incremental data methods of synchronization is not all suitable for tables of data to be synchronized, needs to select other
The incremental data method of synchronization, further determined according to the corresponding data volume size of incremental data table to be synchronized be suitable for it is to be synchronized
The incremental data method of synchronization of incremental data table.
207b, the incremental data method of synchronization according to suitable for incremental data table to be synchronized are to the increment to be synchronized
It is synchronous that tables of data carries out incremental data.
For the embodiment of the present invention, specifically can by counting the number of data in incremental data table to be synchronized, judge to
Data volume size in synchronous incremental data table, if the number of data in incremental data table to be synchronized is less than or equal to present count
Value, illustrates that the data volume of incremental data table to be synchronized is smaller, it is determined that the incremental data method of synchronization deleted using full table, if
Number of data in incremental data table to be synchronized is greater than default value, illustrates that the quantity of incremental data table to be synchronized is larger, then really
It is fixed to use the incremental data method of synchronization compared one by one.
Further, the specific implementation as Fig. 1 the method, it is synchronous that the embodiment of the invention provides a kind of incremental datas
Device, as shown in figure 3, described device includes: acquiring unit 31, structural unit 32, searching unit 33, the first synchronization unit
34。
Acquiring unit 31 can be used for obtaining the mode character for being suitable for the incremental data method of synchronization；
Structural unit 32 can be used for determining default for being suitable for the incremental data method of synchronization according to the mode character
With rule, the regular expression of multiple incremental data methods of synchronization is constructed；
Searching unit 33 can be used for when receiving incremental data synchronization request, by the incremental data table to be synchronized
In data matched respectively with the regular expression of each increment synchronization mode, search whether exist and the number to be synchronized
The character string to match according to the data in table；
First synchronization unit 34, can be used for if it exists, then according to incremental data in the described and tables of data to be synchronized
It is synchronous that the most incremental data method of synchronization of matched character string quantity carries out incremental data to the incremental data table to be synchronized.
The present invention provides a kind of device that incremental data is synchronous, when receiving incremental data synchronization request, by multiple
The regular expression of the incremental data method of synchronization matches incremental data to be synchronized, searches whether containing existing and tables of data to be synchronized
The character string that middle incremental data matches, and if it exists, then illustrate that the data in tables of data to be synchronized are suitable for multiple incremental datas
One of method of synchronization, further according to the increasing most with incremental data matched character string quantity in the tables of data to be synchronized
It is synchronous to incremental data table to be synchronized progress incremental data to measure the data method of synchronization, to improve the synchronous efficiency of incremental data.With
The suitable incremental data method of synchronization is selected to compare by manual operation in the prior art, the embodiment of the present invention is suitable by construction
The field in incremental data table to be synchronized is matched for the regular expression of the different incremental data methods of synchronization, it can be for increasing
The characteristic for measuring tables of data selects that the incremental data method of synchronization is suitble to complete incremental data synchronous task, due to suitable incremental data
The accuracy that the method for synchronization can optimize incremental data synchronous effect and incremental data synchronizes, passes through suitable incremental data
The method of synchronization carries out incremental data and synchronizes, and saves system resource, reduces manual operation, and improves the synchronous resource of incremental data
Utilization rate.
The further explanation of the device synchronous as incremental data shown in Fig. 3, Fig. 4 are another according to embodiments of the present invention
The structural schematic diagram of the synchronous device of kind incremental data, as shown in figure 4, described device further include:
Determination unit 35 can be used for described when receiving incremental data synchronization request, by the increment to be synchronized
Data in tables of data are matched with the regular expression of each increment synchronization mode respectively, search whether exist with it is described to
After the character string that data in synchrodata table match, if it does not exist, then according to the corresponding number of incremental data table to be synchronized
The incremental data method of synchronization for being suitable for incremental data table to be synchronized is determined according to amount size；
Second synchronization unit 36 can be used for according to the incremental data side of synchronization for being suitable for incremental data table to be synchronized
It is synchronous that formula carries out incremental data to the incremental data table to be synchronized.
Further, the determination unit 35 includes:
Statistical module 351 can be used for counting the number of data in the incremental data table to be synchronized；
Second determining module 352, if the number of data that can be used in the incremental data table to be synchronized is less than or waits
In default value, it is determined that the incremental data method of synchronization deleted using full table；
Second determining module 352, if the number of data that can be also used in the incremental data table to be synchronized is big
In default value, it is determined that using the incremental data method of synchronization compared one by one.
Further, the acquiring unit 31 includes:
Module 311 is obtained, can be used for the field by parsing the data table definitions for being suitable for the incremental data method of synchronization,
Obtain the field for being suitable for the incremental data method of synchronization；
Module 312 is chosen, can be used for choosing preset field suitable for the field of the incremental data method of synchronization from described
As the mode character for being suitable for the incremental data method of synchronization.
Further, the characteristic information suitable for the incremental data method of synchronization, the construction are included in the mode character
Unit 32 includes:
First determining module 321 can be used for according to the spy for being suitable for the incremental data method of synchronization in the mode character
Reference breath, determines matching rule of the mode character in incremental data table；
Constructing module 322 can be used for the matching rule according to the mode character in incremental data table, construct multiple
The regular expression of the incremental data method of synchronization.
Further, first determining module 321, if specifically can be used for being suitable for increment in the mode character
The characteristic information of the data method of synchronization be location information, using field location of the mode character in incremental data table as
With rule；
First determining module 321, if specifically can be also used for same suitable for incremental data in the mode character
The characteristic information of step mode is temporal information, using timestamp of the mode character in incremental data table as matching rule；
First determining module 321, if specifically can be also used for same suitable for incremental data in the mode character
The characteristic information of step mode is frequency information, is advised using frequency of occurrence of the mode character in incremental data table as matching
Then.
Further, the constructing module 322 specifically can be used for according to the mode character in incremental data table
Matching rule filters out the general character string and special string for meeting the incremental data method of synchronization from character list, described
Character list includes the general character string and special string for combining various matching rules；
The constructing module 322 specifically can be also used for the general character string for meeting the incremental data method of synchronization
And special string is directed into expression templates, constructs the regular expression of multiple incremental data methods of synchronization.
It should be noted that its of each functional unit involved by the device that a kind of incremental data provided in this embodiment synchronizes
He accordingly describes, can be with reference to the corresponding description in Fig. 1 and Fig. 2, and details are not described herein.
It is deposited thereon based on above-mentioned method as depicted in figs. 1 and 2 correspondingly, the present embodiment additionally provides a kind of storage medium
Computer program is contained, which realizes above-mentioned incremental data as depicted in figs. 1 and 2 synchronous side when being executed by processor
Method.
Based on this understanding, the technical solution of the application can be embodied in the form of software products, which produces
Product can store in a non-volatile memory medium (can be CD-ROM, USB flash disk, mobile hard disk etc.), including some instructions
With so that computer equipment (can be personal computer, server or the network equipment an etc.) execution the application is each
Method described in implement scene.
Based on above-mentioned method as shown in Figure 1 and Figure 2 and Fig. 3, virtual bench embodiment shown in Fig. 4, in order to realize
Above-mentioned purpose, the embodiment of the present application also provides a kind of computer equipments, are specifically as follows personal computer, server, network
Equipment etc., the entity device include storage medium and processor；Storage medium, for storing computer program；Processor is used for
Computer program is executed to realize the synchronous method of above-mentioned incremental data as depicted in figs. 1 and 2.
Optionally, which can also include user interface, network interface, camera, radio frequency (Radio
Frequency, RF) circuit, sensor, voicefrequency circuit, WI-FI module etc..User interface may include display screen
(Display), input unit such as keyboard (Keyboard) etc., optional user interface can also connect including USB interface, card reader
Mouthful etc..Network interface optionally may include standard wireline interface and wireless interface (such as blue tooth interface, WI-FI interface).
It will be understood by those skilled in the art that the entity device structure that incremental data provided in this embodiment synchronizes is not
The restriction to the entity device is constituted, may include more or fewer components, perhaps combines certain components or different portions
Part arrangement.
It can also include operating system, network communication module in storage medium.Operating system is that the above-mentioned computer of management is set
The program of standby hardware and software resource, supports the operation of message handling program and other softwares and/or program.Network communication mould
Block leads to for realizing the communication between each component in storage medium inside, and between other hardware and softwares in the entity device
Letter.
Through the above description of the embodiments, those skilled in the art can be understood that the application can borrow
It helps software that the mode of necessary general hardware platform is added to realize, hardware realization can also be passed through.Pass through the skill of application the application
Art scheme, compared with currently available technology, the embodiment of the present invention is being suitable for the different incremental data methods of synchronization just by construction
Then expression formula matches the field in incremental data table to be synchronized, can select to be suitble to incremental number for the characteristic of incremental data table
Incremental data synchronous task is completed according to the method for synchronization, is synchronized since the suitable incremental data method of synchronization can optimize incremental data
The accuracy that effect and incremental data synchronize carries out incremental data by the suitable incremental data method of synchronization and synchronizes, saves
System resource reduces manual operation, and improves the synchronous resource utilization of incremental data.
It will be appreciated by those skilled in the art that the accompanying drawings are only schematic diagrams of a preferred implementation scenario, module in attached drawing or
Process is not necessarily implemented necessary to the application.It will be appreciated by those skilled in the art that the mould in device in implement scene
Block can according to implement scene describe be distributed in the device of implement scene, can also carry out corresponding change be located at be different from
In one or more devices of this implement scene.The module of above-mentioned implement scene can be merged into a module, can also be into one
Step splits into multiple submodule.
Above-mentioned the application serial number is for illustration only, does not represent the superiority and inferiority of implement scene.Disclosed above is only the application
Several specific implementation scenes, still, the application is not limited to this, and the changes that any person skilled in the art can think of is all
The protection scope of the application should be fallen into.
Claims (10)
1. a kind of synchronous method of incremental data, which is characterized in that the described method includes:
Obtain the mode character for being suitable for the incremental data method of synchronization；
The preset matching rule for being suitable for the incremental data method of synchronization is determined according to the mode character, constructs multiple incremental datas
The regular expression of the method for synchronization；
It is when receiving incremental data synchronization request, the data in the incremental data table to be synchronized are same with each increment respectively
The regular expression of step mode is matched, and searches whether there is the character to match with the data in the tables of data to be synchronized
String；
If it exists, then according to the incremental data most with incremental data matched character string quantity in the tables of data to be synchronized
It is synchronous that the method for synchronization carries out incremental data to the incremental data table to be synchronized.
2. the method according to claim 1, wherein described obtain the mode for being suitable for the incremental data method of synchronization
Character includes:
It is suitable for the field of the data table definitions of the incremental data method of synchronization by parsing, obtains and be suitable for the incremental data side of synchronization
The field of formula；
It is used as from the preset field of being chosen suitable for the field of the incremental data method of synchronization suitable for the incremental data side of synchronization
The mode character of formula.
3. the method according to claim 1, wherein synchronous comprising being suitable for incremental data in the mode character
The characteristic information of mode, it is described that the preset matching rule for being suitable for the incremental data method of synchronization is determined according to the mode character,
The regular expression for constructing multiple incremental data methods of synchronization includes:
According to the characteristic information for being suitable for the incremental data method of synchronization in the mode character, determine the mode character in increment
Matching rule in tables of data；
According to matching rule of the mode character in incremental data table, the canonical table of multiple incremental data methods of synchronization is constructed
Up to formula.
4. according to the method described in claim 3, it is characterized in that, it is described according in the mode character be suitable for incremental data
The characteristic information of the method for synchronization determines that matching rule of the mode character in incremental data table includes:
If the characteristic information for being suitable for the incremental data method of synchronization in the mode character is location information, with the pattern-word
The field location in incremental data table is accorded with as matching rule；
If the characteristic information for being suitable for the incremental data method of synchronization in the mode character is temporal information, with the pattern-word
The timestamp in incremental data table is accorded with as matching rule；
If the characteristic information for being suitable for the incremental data method of synchronization in the mode character is frequency information, with the pattern-word
The frequency of occurrence in incremental data table is accorded with as matching rule.
5. according to the method described in claim 3, it is characterized in that, it is described according to the mode character in incremental data table
Matching rule, the regular expression for constructing multiple incremental data methods of synchronization include:
According to matching rule of the mode character in incremental data table, is filtered out from character list and meet incremental data synchronization
The general character string and special string of mode, the character list include the general character string for combining various matching rules
And special string；
The general character string for meeting the incremental data method of synchronization and special string are directed into expression templates, structure
Make the regular expression of multiple incremental data methods of synchronization.
6. method according to any one of claims 1-5, which is characterized in that described synchronous when receiving incremental data
When request, by the data in the incremental data table to be synchronized respectively with the regular expression of each increment synchronization mode carry out
Match, searches whether after there is the character string to match with the data in the tables of data to be synchronized, the method also includes:
If it does not exist, then it is determined according to the corresponding data volume size of incremental data table to be synchronized and is suitable for incremental data table to be synchronized
The incremental data method of synchronization；
According to the incremental data method of synchronization suitable for incremental data table to be synchronized to the incremental data table to be synchronized into
Row incremental data is synchronous.
7. according to the method described in claim 6, it is characterized in that, described according to the corresponding data volume of incremental data table to be synchronized
Size determines that the incremental data method of synchronization includes:
Count the number of data in the incremental data table to be synchronized；
If the number of data in the incremental data table to be synchronized is less than or equal to default value, it is determined that deleted using full table
The incremental data method of synchronization；
If the number of data in the incremental data table to be synchronized is greater than default value, it is determined that using the increment compared one by one
The data method of synchronization.
8. a kind of synchronous device of incremental data, which is characterized in that described device includes:
Acquiring unit, for obtaining the mode character for being suitable for the incremental data method of synchronization；
Structural unit, for determining the preset matching rule for being suitable for the incremental data method of synchronization, structure according to the mode character
Make the regular expression of multiple incremental data methods of synchronization；
Searching unit, for when receiving incremental data synchronization request, the data in the incremental data table to be synchronized to be divided
It is not matched with the regular expression of each increment synchronization mode, searches whether exist and the number in the tables of data to be synchronized
According to the character string to match；
First synchronization unit is used for if it exists, then according to incremental data matched character string in the described and tables of data to be synchronized
It is synchronous that the most incremental data method of synchronization of quantity carries out incremental data to the incremental data table to be synchronized.
9. a kind of computer equipment, including memory and processor, the memory are stored with computer program, feature exists
In the step of processor realizes any one of claims 1 to 7 the method when executing the computer program.
10. a kind of computer storage medium, is stored thereon with computer program, which is characterized in that the computer program is located
The step of reason device realizes method described in any one of claims 1 to 7 when executing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910218794.1A CN110083579A (en) | 2019-03-21 | 2019-03-21 | Incremental data synchronous method, apparatus, computer equipment and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910218794.1A CN110083579A (en) | 2019-03-21 | 2019-03-21 | Incremental data synchronous method, apparatus, computer equipment and computer storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110083579A true CN110083579A (en) | 2019-08-02 |
Family
ID=67413370
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910218794.1A Pending CN110083579A (en) | 2019-03-21 | 2019-03-21 | Incremental data synchronous method, apparatus, computer equipment and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110083579A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110633321A (en) * | 2019-08-30 | 2019-12-31 | 中国人民财产保险股份有限公司 | Data synchronization method, device and equipment |
| CN113206891A (en) * | 2021-05-31 | 2021-08-03 | 浙江大华技术股份有限公司 | Scheduling method, storage system, scheduling device and storage medium for metadata reporting |
| CN113961572A (en) * | 2021-12-23 | 2022-01-21 | 中电云数智科技有限公司 | Database synchronization method and synchronization device based on increment field |
| US20220083510A1 (en) * | 2020-09-15 | 2022-03-17 | Open Text Holdings, Inc. | Connector for content repositories |
| CN114911862A (en) * | 2022-07-18 | 2022-08-16 | 国网江苏省电力有限公司营销服务中心 | System and method for transmitting big data of network operation link of network |
| CN115510166A (en) * | 2022-11-23 | 2022-12-23 | 云账户技术(天津)有限公司 | Data synchronization service method and device, remote platform and electronic equipment |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102289460A (en) * | 2011-07-13 | 2011-12-21 | 中国工商银行股份有限公司 | Method and system for performing report metadata synchronization on testing environments |
| CN103164477A (en) * | 2011-12-19 | 2013-06-19 | 江南大学 | Interactive display device based on Action Script 3.0 platform network remote data capture |
| CN103440317A (en) * | 2013-08-28 | 2013-12-11 | 电子科技大学 | Incremental data inquiry method based on database time labels |
| CN105373448A (en) * | 2015-10-27 | 2016-03-02 | 北京百度网讯科技有限公司 | Method and system for recovering failure data in database |
| US20170132245A1 (en) * | 2015-11-05 | 2017-05-11 | International Business Machines Corporation | Storage controller and method for managing a solid-state memory |
| CN106713487A (en) * | 2017-01-16 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data synchronization method and device |
| CN107273471A (en) * | 2017-06-07 | 2017-10-20 | 国网上海市电力公司 | A kind of binary electric power time series data index structuring method based on Geohash |
| CN107330003A (en) * | 2017-06-12 | 2017-11-07 | 上海藤榕网络科技有限公司 | Method of data synchronization, system, memory and data syn-chronization equipment |
| CN108595522A (en) * | 2018-03-27 | 2018-09-28 | 北京明朝万达科技股份有限公司 | A kind of increment synchronization method, apparatus and system |
| CN108628881A (en) * | 2017-03-20 | 2018-10-09 | 北京京东尚科信息技术有限公司 | Method of data synchronization and device |
| CN108804487A (en) * | 2017-12-28 | 2018-11-13 | 中国移动通信集团公司 | A kind of method and device of extraction target character |
| CN109388676A (en) * | 2018-08-21 | 2019-02-26 | 中国平安人寿保险股份有限公司 | Data synchronize generation method, device, computer equipment and storage medium |
| CN115658382A (en) * | 2022-10-11 | 2023-01-31 | 四川大学 | Incremental object backup recovery method and system for object storage and storage medium |
-
2019
- 2019-03-21 CN CN201910218794.1A patent/CN110083579A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102289460A (en) * | 2011-07-13 | 2011-12-21 | 中国工商银行股份有限公司 | Method and system for performing report metadata synchronization on testing environments |
| CN103164477A (en) * | 2011-12-19 | 2013-06-19 | 江南大学 | Interactive display device based on Action Script 3.0 platform network remote data capture |
| CN103440317A (en) * | 2013-08-28 | 2013-12-11 | 电子科技大学 | Incremental data inquiry method based on database time labels |
| CN105373448A (en) * | 2015-10-27 | 2016-03-02 | 北京百度网讯科技有限公司 | Method and system for recovering failure data in database |
| US20170132245A1 (en) * | 2015-11-05 | 2017-05-11 | International Business Machines Corporation | Storage controller and method for managing a solid-state memory |
| CN106713487A (en) * | 2017-01-16 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data synchronization method and device |
| CN108628881A (en) * | 2017-03-20 | 2018-10-09 | 北京京东尚科信息技术有限公司 | Method of data synchronization and device |
| CN107273471A (en) * | 2017-06-07 | 2017-10-20 | 国网上海市电力公司 | A kind of binary electric power time series data index structuring method based on Geohash |
| CN107330003A (en) * | 2017-06-12 | 2017-11-07 | 上海藤榕网络科技有限公司 | Method of data synchronization, system, memory and data syn-chronization equipment |
| CN108804487A (en) * | 2017-12-28 | 2018-11-13 | 中国移动通信集团公司 | A kind of method and device of extraction target character |
| CN108595522A (en) * | 2018-03-27 | 2018-09-28 | 北京明朝万达科技股份有限公司 | A kind of increment synchronization method, apparatus and system |
| CN109388676A (en) * | 2018-08-21 | 2019-02-26 | 中国平安人寿保险股份有限公司 | Data synchronize generation method, device, computer equipment and storage medium |
| CN115658382A (en) * | 2022-10-11 | 2023-01-31 | 四川大学 | Incremental object backup recovery method and system for object storage and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 庞秋奔;李银;: "基于Web Service多源异构系统增量同步的实现", 计算机应用与软件, no. 05, 12 May 2018 (2018-05-12), pages 172 - 176 * |
| 赵文芳;刘旭林;: "Spark Streaming框架下的气象自动站数据实时处理系统", 计算机应用, no. 01, 10 January 2018 (2018-01-10), pages 38 - 43 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110633321A (en) * | 2019-08-30 | 2019-12-31 | 中国人民财产保险股份有限公司 | Data synchronization method, device and equipment |
| CN110633321B (en) * | 2019-08-30 | 2022-06-03 | 中国人民财产保险股份有限公司 | Data synchronization method, device and equipment |
| US20220083510A1 (en) * | 2020-09-15 | 2022-03-17 | Open Text Holdings, Inc. | Connector for content repositories |
| CN113206891A (en) * | 2021-05-31 | 2021-08-03 | 浙江大华技术股份有限公司 | Scheduling method, storage system, scheduling device and storage medium for metadata reporting |
| CN113961572A (en) * | 2021-12-23 | 2022-01-21 | 中电云数智科技有限公司 | Database synchronization method and synchronization device based on increment field |
| CN114911862A (en) * | 2022-07-18 | 2022-08-16 | 国网江苏省电力有限公司营销服务中心 | System and method for transmitting big data of network operation link of network |
| CN114911862B (en) * | 2022-07-18 | 2022-12-06 | 国网江苏省电力有限公司营销服务中心 | System and method for transmitting big data of network national network operation link |
| CN115510166A (en) * | 2022-11-23 | 2022-12-23 | 云账户技术(天津)有限公司 | Data synchronization service method and device, remote platform and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110083579A (en) | Incremental data synchronous method, apparatus, computer equipment and computer storage medium | |
| CN108228817B (en) | Data processing method, device and system | |
| US7509327B2 (en) | Business data migration using metadata | |
| US20170255709A1 (en) | Atomic updating of graph database index structures | |
| US8924373B2 (en) | Query plans with parameter markers in place of object identifiers | |
| WO2018095299A1 (en) | Time sequence data management method, device and apparatus | |
| EP2380090B1 (en) | Data integrity in a database environment through background synchronization | |
| CN102779138B (en) | The hard disk access method of real time data | |
| CN106933836B (en) | Data storage method and system based on sub-tables | |
| US20170255708A1 (en) | Index structures for graph databases | |
| WO2018097846A1 (en) | Edge store designs for graph databases | |
| US9235613B2 (en) | Flexible partitioning of data | |
| CN111448560A (en) | Database synchronization | |
| US20140244606A1 (en) | Method, apparatus and system for storing, reading the directory index | |
| CN105900093A (en) | Keyvalue database data table updating method and data table updating device | |
| US9031909B2 (en) | Provisioning and/or synchronizing using common metadata | |
| CN110062028A (en) | Data synchronous method, apparatus, computer equipment and computer storage medium | |
| CN110928900B (en) | Multi-table data query method, device, terminal and computer storage medium | |
| CN112559913B (en) | Data processing method, device, computing equipment and readable storage medium | |
| CN110489483B (en) | Data synchronization method, device, computer equipment and storage medium | |
| US20180349443A1 (en) | Edge store compression in graph databases | |
| CN106156038A (en) | Date storage method and device | |
| EP3061011B1 (en) | Method for optimizing index, master database node and subscriber database node | |
| CN102722543B (en) | Method for storing files | |
| CN114840497A (en) | Method, system and device for preprocessing row migration of database and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |