CN112419018A - General data reconciliation method, server and storage medium in distributed environment - Google Patents
General data reconciliation method, server and storage medium in distributed environment Download PDFInfo
- Publication number
- CN112419018A CN112419018A CN202010003626.3A CN202010003626A CN112419018A CN 112419018 A CN112419018 A CN 112419018A CN 202010003626 A CN202010003626 A CN 202010003626A CN 112419018 A CN112419018 A CN 112419018A
- Authority
- CN
- China
- Prior art keywords
- data
- reconciliation
- account checking
- script
- task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/12—Accounting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Development Economics (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Computing Systems (AREA)
- Economics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a general data reconciliation method, a server and a storage medium in a distributed environment, belonging to the technical field of internet. The method comprises the steps of firstly, recording data changes in real time and pushing the data changes to a data bus; consuming the data change record to start account checking, and filtering account checking data from the data change record; further establishing an account checking task and an account checking script; and executing the account checking script to generate an account checking result, and further realizing the repair callback according to the account checking result. Therefore, on one hand, the decoupling of the reconciliation method and the business is realized, and the method can be applied to any data reconciliation in a distributed environment, and on the other hand, the method has stronger real-time performance, higher data accuracy and better user experience.
Description
Technical Field
The invention relates to the technical field of internet, in particular to the technical field of data processing of a distributed system, and specifically relates to a general data reconciliation method, a server and a storage medium in a distributed environment.
Background
In a distributed environment, the whole system is split into a plurality of services according to the service, and each service has a plurality of service instances at the same time. The communication between instances and between services may also have a call failure scenario, so that more or less data inconsistency exists in the whole distributed system.
Taking the electric commerce as an example, the whole electric commerce platform is taken as a large system adopting distribution, and the large system is divided into multiple services such as shopping malls, orders, inventory, payment, logistics and the like according to applications. There may be inconsistent scenarios as follows:
1. orders are created but stock is not deducted, resulting in over-selling;
2. the order has been cancelled but the payment has not been returned;
3. the warehouse has shipped, but the order status has not changed;
4. the order has been cancelled but the coupon or the like has not returned the user; and so on.
These scenarios are caused by data inconsistency among services, which directly affects normal use of users, even causes complaints of users, and even confusion of the whole system data.
Therefore, how to guarantee the consistency of data among each service is a problem to be solved by all distributed systems.
The mainstream solution at present is to implement service compensation through each service, or to ensure final consistency of data by using offline reconciliation. However, these schemes are strongly coupled with the service, and the offline reconciliation instantaneity is poor, so that the problem cannot be found in time.
Disclosure of Invention
The invention aims to overcome the defects in the prior art and provide a universal data reconciliation method, a server and a storage medium which can be decoupled from a service, have strong real-time performance and better user experience in a distributed environment.
The distributed environment includes at least a first data system and a second data system. In order to achieve the above object, the general data reconciliation method in a distributed environment of the present invention comprises:
acquiring a data change record of the first data system and pushing the data change record to a data bus;
acquiring data to be checked according to the data change record;
acquiring a reconciliation task according to the data to be reconciled, wherein the reconciliation task comprises a reconciliation script;
and executing the reconciliation script, and comparing the data to be reconciled with the corresponding data in the second data system to generate a reconciliation result.
In the general data reconciliation method in the distributed environment, the acquiring of the data to be reconciled according to the data change record specifically comprises the following steps:
and using the data which accords with the rules in the trigger data as the data to be checked by using the preset rules.
In the general data reconciliation method in the distributed environment, the acquiring of the reconciliation task according to the data to be reconciled specifically comprises the following steps:
acquiring a set account checking task according to the account checking data to be checked;
acquiring an account checking script included in the account checking task;
and creating a reconciliation task cache according to the reconciliation script.
In the general data reconciliation method in the distributed environment, after the reconciliation task cache is created according to the reconciliation script, the method further comprises the following steps:
determining whether the account checking task needs to be delayed according to the delay time in the account checking script;
if the time delay is not needed, entering the step of executing the reconciliation script;
if the time delay is needed, the account checking task is put into a time delay queue, and after the time delay, the account checking task is obtained from the time delay queue and the step of executing the account checking script is carried out.
In the general data reconciliation method in the distributed environment, the executing of the reconciliation script, the comparing of the data to be reconciled with the second data system, and the generating of the reconciliation result specifically include:
checking whether the reconciliation script is the latest version, if so, entering the next step; if not, updating the reconciliation script and then entering the next step;
and executing the reconciliation script, and comparing the data to be reconciled with the corresponding data in the second data system to generate a reconciliation result.
In the general data reconciliation method under the distributed environment, after the reconciliation script is executed, the data to be reconciled is compared with the corresponding data in the second data system, and a reconciliation result is generated, the method further comprises the following steps:
determining whether a callback needs to be repaired according to the task configuration in the account checking task, and if so, entering the next step; if not, ending the method;
and repairing and calling back according to the account checking result and the task configuration.
In the general data reconciliation method under the distributed environment, after the reconciliation script is executed, the data to be reconciled is compared with the corresponding data in the second data system, and a reconciliation result is generated, the method further comprises the following steps:
determining whether notification is needed according to task configuration in the reconciliation task, and if so, entering the next step; if not, ending the method;
and notifying the account checking result according to the task configuration.
The present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the above-described method for general data reconciliation in a distributed environment.
The invention also provides a general data reconciliation server in the distributed environment, which is connected with the first data system and the second data system through a data bus, and comprises a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the general data reconciliation server realizes the general data reconciliation method in the distributed environment according to any one of claims 1 to 8 through data interaction with the first data system and the second data system.
By adopting the general data reconciliation method, the server and the storage medium under the distributed environment, the data change record is firstly recorded in real time and pushed to a data bus; consuming the data change record to start account checking, and filtering account checking data from the data change record; further establishing an account checking task and an account checking script; and executing the account checking script to generate an account checking result, and further realizing the repair callback according to the account checking result. Therefore, on one hand, the decoupling of the reconciliation method and the business is realized, and the method can be applied to any data reconciliation in a distributed environment, and on the other hand, the method has stronger real-time performance, higher data accuracy and better user experience.
Drawings
FIG. 1 is a flow chart illustrating the steps of a general data reconciliation method in a distributed environment in accordance with the present invention;
FIG. 2 is a functional module structure diagram of a general data reconciliation server in a distributed environment according to the present invention;
FIG. 3 is a flow chart illustrating the realization of the reconciliation between two systems by using the general data reconciliation method of the present invention;
FIG. 4 is a schematic diagram of a user interface for creating a reconciliation task using the general data reconciliation method of the present invention.
Detailed Description
In order to clearly understand the technical contents of the present invention, the following examples are given in detail.
Fig. 1 is a flowchart illustrating steps of a general data reconciliation method in a distributed environment according to the present invention.
In one embodiment, the distributed environment includes at least a first data system and a second data system, and the general data reconciliation method in the distributed environment includes:
(1) acquiring a data change record of the first data system and pushing the data change record to a data bus;
(2) acquiring data to be checked according to the data change record;
(3) acquiring a reconciliation task according to the data to be reconciled, wherein the reconciliation task comprises a reconciliation script;
(4) and executing the reconciliation script, and comparing the data to be reconciled with the corresponding data in the second data system to generate a reconciliation result.
Wherein, the step (1) of obtaining the data change record of the first data system and pushing the data change record to a data bus specifically comprises:
and using the canal monitoring binlog to acquire the data change record of the first data system in real time and push the data change record to a data bus as trigger data.
The step (2) obtains the data to be reconciled according to the data change record, and specifically comprises the following steps:
and using the data which accords with the rules in the trigger data as the data to be checked by using the preset rules. The preset rule is generally a time period, such as a data change record within an hour or a week, and the time period is determined according to a time tag corresponding to the data change record.
The step (3) of obtaining the reconciliation task according to the data to be reconciled specifically comprises the following steps:
acquiring a set account checking task according to the account checking data to be checked;
acquiring an account checking script included in the account checking task;
and creating a reconciliation task cache according to the reconciliation script.
Accordingly, the present invention also provides a computer readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the above-mentioned general data reconciliation method in a distributed environment.
The invention also provides a general data reconciliation server and a computer readable storage medium in the distributed environment. The general data reconciliation server is connected with the first data system and the second data system through a data bus. The general data reconciliation server comprises a processor and a memory, wherein the memory is the computer readable storage medium and is stored with a computer program. When the computer program is executed by the processor, the general data reconciliation server performs data interaction with the first data system and the second data system to implement the general data reconciliation method in the distributed environment in the above embodiment.
As shown in fig. 2, the functional modules of the general data reconciliation server in the distributed environment include:
the pre-filter is used for acquiring the data change record of the first data system from the data bus, filtering the data change record by using a preset rule and acquiring data to be checked;
the task constructor is used for acquiring a reconciliation task comprising a reconciliation script;
and the executor is used for executing the reconciliation script, comparing the data to be reconciled with the second data system of the second data system and generating a reconciliation result.
By utilizing the general data account checking method and system in the distributed environment, high-concurrency near-real-time account checking can be realized, and the problem of inconsistent data in the distributed environment is effectively solved; meanwhile, the service account checking logic is realized by using the script, and the service account checking logic is decoupled from the service, so that the scheme of the invention is more universal. For different services, the account checking logic is packaged into the account checking script without depending on how the specific service is realized, and different services only need to write different scripts without changing the whole account checking process.
In a preferred embodiment, after creating a reconciliation task cache according to the reconciliation script, the method further includes:
determining whether the account checking task needs to be delayed according to the delay time in the account checking script;
if the time delay is not needed, entering the step of executing the reconciliation script;
if the time delay is needed, the account checking task is put into a time delay queue, and after the time delay, the account checking task is obtained from the time delay queue and the step of executing the account checking script is carried out.
The method of the embodiment can realize the configurable reconciliation delay so as to meet different requirements on the reconciliation instantaneity.
In another preferred embodiment, the step (4) of executing the reconciliation script, comparing the data to be reconciled with the second data system of the second data system, and generating a reconciliation result specifically includes:
checking whether the reconciliation script is the latest version, if so, entering the next step; if not, updating the reconciliation script and then entering the next step;
and executing the reconciliation script, and comparing the data to be reconciled with the corresponding data in the second data system to generate a reconciliation result.
The method of the embodiment can realize real-time update of the reconciliation script.
In an optional embodiment, after the method executes the reconciliation script in the step (4), and compares the data to be reconciled with the corresponding data in the second data system to generate a reconciliation result, the method further includes the following steps:
determining whether a callback needs to be repaired according to the task configuration in the account checking task, and if so, entering the next step; if not, ending the method;
and repairing and calling back according to the account checking result and the task configuration.
And by repairing and calling back, data repairing is carried out by using the account checking result, and the consistency of data among the data systems is ensured.
Determining whether notification is needed according to task configuration in the reconciliation task, and if so, entering the next step; if not, ending the method;
and notifying the account checking result according to the task configuration.
Correspondingly, the general data reconciliation system in the distributed environment of the invention can further comprise: and the result processor is used for carrying out repair callback and notification of the account checking result according to the account checking task and the account checking result.
By using the method and the system of the more preferable embodiment, the early warning notification and the interface callback can be supported, and the problem of data inconsistency can be automatically repaired.
In practical application, the general data reconciliation system in the distributed environment mainly comprises: a pre-filter with a filter script as a trigger condition; a task constructor for acquiring the analysis script and creating the reconciliation task; a core executor for executing the script and outputting the account checking result; and a result processor that processes the reconciliation result.
And the reconciliation script is written by the user and stored in a reconciliation system database, and the user creates a user interface schematic diagram of the reconciliation task. The user can configure the conditions triggered by the script, configure the time delayed by the script, select whether to repair the callback and configure the related interface, and configure the receiver of the mail and the WeChat early warning notice.
The following describes an implementation process of the general data reconciliation method in a distributed environment according to a specific embodiment of the present invention.
Example 1
Taking account checking between the order system and the inventory system of the online shopping platform as an example. The order system is a first data system, and the inventory system is a second data system.
The main flow for implementing account checking between two systems by using the invention is shown in fig. 3, and comprises the following steps:
1. obtaining a data change record of an order system (a first data system) in real time by using canal, and pushing the data change to databus to be used as trigger data of a reconciliation system;
2. the account checking system consumes trigger data (data change records of an order system) in the databus, the account checking system is triggered to start an account checking process, firstly, a front filter of the account checking system checks the version number of a front filter cached in redis, if the version number of the front filter in the cache is inconsistent with the version number of the front filter in the account checking system, the version of the front filter is incorrect, and the step 3 is carried out; otherwise, the version of the pre-filter is correct, and the step 4 is entered;
3. the account checking system reads a database of the account checking system, updates the preposed filter version to be the latest version, and synchronizes the updated filter version number to the redis;
4. the pre-filter checks whether the trigger data meets the filtering condition, and the filter supports the filtering of the change table, the database operation type (such as insert \ update \ delete) and the specific value of the specified field (such as status is NEW). The user can set a condition that needs filtering, for example, status is NEW, when the trigger data of databus is consumed, the message is checked whether the condition is met according to the filtering condition set by the user, if the filter condition is met, the data change record of the order system in the trigger data is the data that needs reconciliation, and then step 5 is carried out; otherwise, ending the flow; the pre-filter can be used for filtering out data which do not meet the script triggering so as to reduce account checking tasks entering a subsequent flow, thereby reducing the times of subsequent delay queues and script execution and improving the overall performance of the system;
5. the task constructor checks the version number of the task constructor cached in the task redis, and if the version number of the task constructor cached in the task constructor is inconsistent with the version number of the task constructor in the system, turning to step 6; if the two are consistent, turning to step 7;
6. the reconciliation system reads the database of the reconciliation system, updates the reconciliation task to be the latest version, and synchronizes the version number of the updated reconciliation task to the redis;
7. judging whether a task cache exists or not, and if not, turning to step 8; if yes, go to step 9;
8. the account checking system analyzes the account checking script in the account checking task and creates an account checking task cache;
9. acquiring a script which can be executed by triggering data;
12. the core executor checks the account checking script version number in the redis cache, and if the account checking script version number in the account checking system is inconsistent with the account checking script version number in the cache, the step 13 is executed; if the two are consistent, go to step 14;
13. the account checking system reads the account checking script in the database of the account checking system, updates the account checking script to be the latest version, and synchronizes the version number of the updated account checking script to the redis;
14. and executing the account checking script, comparing the data needing account checking with a second data system (inventory system), and obtaining and outputting an account checking result.
By the embodiment, account checking between high-concurrency and near-real-time distributed systems can be realized; meanwhile, the whole account checking logic of the process is not related to the business logic of the order system and the inventory system, so that the decoupling of the account checking system and the business system is realized, and the scheme of the invention is more universal. For different services, the account checking logic is packaged into the account checking script without depending on how the specific service is realized, and different services only need to write different scripts without changing the whole account checking process.
Example 2
The difference from embodiment 1 is that the following is also included between step 9 and step 12:
9. acquiring a script which can be executed by trigger data, reading delay time, and turning to step 10 if the delay time is greater than zero; otherwise, go to step 12;
10. putting the account checking task into a delay queue of a rabbitmq;
11. after the delay time, the reconciliation system acquires the deferred reconciliation task from the rabbitmq delay queue.
The embodiment is utilized to realize the configurable of the account checking delay.
Example 3
The difference from the embodiments 1 and 2 is that the following can be included after the step 14:
14. executing the account checking script, outputting an account checking result, and turning to the step 15 if the account checking result needs to be processed; otherwise, ending;
15. the result processor processes the account checking result, and if the account checking result needs to be repaired and recalled, the step 16 is carried out; if not, go to step 17;
16. reading task configuration in the reconciliation task, calling back a repair interface, and recording a call-back address, a request and a response;
17. if the account checking result needs early warning, turning to step 18; otherwise, go to step 19;
18. reading task configuration, and asynchronously aggregating push mails and WeChat notifications;
19. inserting the account checking result into a database of the account checking system;
20. ending the account checking task, and if the trigger data which is not checked exists in the databus, turning to the step 2; otherwise, the step 1 is carried out.
The embodiment realizes early warning notification and interface callback based on account checking results, and automatically repairs the problem of inconsistent data.
By adopting the general data reconciliation method, the server and the storage medium under the distributed environment, the data change record is firstly recorded in real time and pushed to a data bus; consuming the data change record to start account checking, and filtering account checking data from the data change record; further establishing an account checking task and an account checking script; and executing the account checking script to generate an account checking result, and further realizing the repair callback according to the account checking result. Therefore, on one hand, the decoupling of the reconciliation method and the business is realized, and the method can be applied to any data reconciliation in a distributed environment, and on the other hand, the method has stronger real-time performance, higher data accuracy and better user experience.
In this specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims (9)
1. A general data reconciliation method in a distributed environment is characterized in that the distributed environment at least comprises a first data system and a second data system, and the general data reconciliation method comprises the following steps:
acquiring a data change record of the first data system and pushing the data change record to a data bus;
acquiring data to be checked according to the data change record;
acquiring a reconciliation task according to the data to be reconciled, wherein the reconciliation task comprises a reconciliation script;
and executing the reconciliation script, and comparing the data to be reconciled with the corresponding data in the second data system to generate a reconciliation result.
2. The general data reconciliation method in the distributed environment according to claim 1, wherein the obtaining of the data to be reconciled according to the data change record specifically comprises:
and using the data which accords with the rules in the trigger data as the data to be checked by using the preset rules.
3. The method for general data reconciliation in a distributed environment according to claim 2, wherein the acquiring a reconciliation task according to the data to be reconciled specifically comprises:
acquiring a set account checking task according to the account checking data to be checked;
acquiring an account checking script included in the account checking task;
and creating a reconciliation task cache according to the reconciliation script.
4. The method for general data reconciliation in a distributed environment of claim 3, wherein after the creating a reconciliation task cache according to the reconciliation script, the method further comprises:
determining whether the account checking task needs to be delayed according to the delay time in the account checking script;
if the time delay is not needed, entering the step of executing the reconciliation script;
if the time delay is needed, the account checking task is put into a time delay queue, and after the time delay, the account checking task is obtained from the time delay queue and the step of executing the account checking script is carried out.
5. The method for general data reconciliation under the distributed environment of claim 4, wherein the executing the reconciliation script compares the data to be reconciled with corresponding data in the second data system to generate a reconciliation result, specifically comprising:
checking whether the reconciliation script is the latest version, if so, entering the next step; if not, updating the reconciliation script and then entering the next step;
and executing the reconciliation script, and comparing the data to be reconciled with the corresponding data in the second data system to generate a reconciliation result.
6. The method for general data reconciliation in a distributed environment of claim 1, wherein after the reconciliation script is executed, the data to be reconciled is compared with the corresponding data in the second data system, and a reconciliation result is generated, the method further comprises the following steps:
determining whether a callback needs to be repaired according to the task configuration in the account checking task, and if so, entering the next step; if not, ending the method;
and repairing and calling back according to the account checking result and the task configuration.
7. The method for general data reconciliation in a distributed environment of claim 1, wherein after the reconciliation script is executed, the data to be reconciled is compared with the corresponding data in the second data system, and a reconciliation result is generated, the method further comprises the following steps:
determining whether notification is needed according to task configuration in the reconciliation task, and if so, entering the next step; if not, ending the method;
and notifying the account checking result according to the task configuration.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method for general data reconciliation in a distributed environment of any one of claims 1 to 8.
9. A general data reconciliation server in a distributed environment, characterized in that the general data reconciliation server is connected with a first data system and a second data system through a data bus, the general data reconciliation server comprises a processor and a memory, the memory stores a computer program, and when the computer program is executed by the processor, the general data reconciliation server realizes the general data reconciliation method in the distributed environment according to any one of claims 1 to 8 through data interaction with the first data system and the second data system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010003626.3A CN112419018B (en) | 2020-01-03 | 2020-01-03 | General data reconciliation method, server and storage medium in distributed environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010003626.3A CN112419018B (en) | 2020-01-03 | 2020-01-03 | General data reconciliation method, server and storage medium in distributed environment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112419018A true CN112419018A (en) | 2021-02-26 |
| CN112419018B CN112419018B (en) | 2022-11-18 |
Family
ID=74844028
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010003626.3A Active CN112419018B (en) | 2020-01-03 | 2020-01-03 | General data reconciliation method, server and storage medium in distributed environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112419018B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113421109A (en) * | 2021-05-14 | 2021-09-21 | 北京沃东天骏信息技术有限公司 | Service checking method, device, electronic equipment and storage medium |
| CN114612209A (en) * | 2022-05-12 | 2022-06-10 | 深圳依时货拉拉科技有限公司 | Account checking data processing method and device, computer equipment and storage medium |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017020740A1 (en) * | 2015-08-06 | 2017-02-09 | 阿里巴巴集团控股有限公司 | Inventory data reconciliation method and device |
| CN107783975A (en) * | 2016-08-24 | 2018-03-09 | 北京京东尚科信息技术有限公司 | The method and apparatus of distributed data base synchronization process |
| CN107995242A (en) * | 2016-10-27 | 2018-05-04 | 北京京东尚科信息技术有限公司 | A kind of method for processing business and system |
| CN108491332A (en) * | 2018-04-04 | 2018-09-04 | 浙江小泰科技有限公司 | A kind of real-time buffering updating method and system based on Redis |
| CN108764879A (en) * | 2018-05-31 | 2018-11-06 | 广州唯品会信息科技有限公司 | The real-time account checking method of distribution, system and computer storage media based on affairs |
| CN108804237A (en) * | 2017-05-05 | 2018-11-13 | 北京京东尚科信息技术有限公司 | Data real-time statistical method, device, storage medium and electronic equipment |
| CN108961029A (en) * | 2018-07-26 | 2018-12-07 | 阿里巴巴集团控股有限公司 | A kind of distribution reconciliation processing method, system and terminal device |
| CN109034993A (en) * | 2018-09-29 | 2018-12-18 | 深圳前海微众银行股份有限公司 | Account checking method, equipment, system and computer readable storage medium |
| CN109284334A (en) * | 2018-09-05 | 2019-01-29 | 拉扎斯网络科技（上海）有限公司 | Real-time data base synchronous method, device, electronic equipment and storage medium |
| CN109325077A (en) * | 2018-08-03 | 2019-02-12 | 北京马上慧科技术有限公司 | A kind of system that number storehouse in real time is realized based on canal and kafka |
| CN109582301A (en) * | 2018-12-03 | 2019-04-05 | 深圳前海微众银行股份有限公司 | Method for processing business, device, equipment and the medium of task based access control scheduling system |
| CN109597817A (en) * | 2018-11-14 | 2019-04-09 | 阿里巴巴集团控股有限公司 | A kind of caching data processing method, device, equipment and medium |
| CN109615495A (en) * | 2018-10-11 | 2019-04-12 | 阿里巴巴集团控股有限公司 | A kind of account checking method of data, device, equipment and system |
| CN109800272A (en) * | 2019-02-25 | 2019-05-24 | 广州虎牙信息科技有限公司 | Data cached synchronous method, server, application system and storage device |
| WO2019127916A1 (en) * | 2017-12-29 | 2019-07-04 | 北京奇虎科技有限公司 | Data read/write method and device implemented on the basis of distributed consensus protocol |
| CN110415095A (en) * | 2019-07-24 | 2019-11-05 | 深圳乐信软件技术有限公司 | A kind of account checking method, device, terminal and storage medium |
-
2020
- 2020-01-03 CN CN202010003626.3A patent/CN112419018B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017020740A1 (en) * | 2015-08-06 | 2017-02-09 | 阿里巴巴集团控股有限公司 | Inventory data reconciliation method and device |
| CN107783975A (en) * | 2016-08-24 | 2018-03-09 | 北京京东尚科信息技术有限公司 | The method and apparatus of distributed data base synchronization process |
| CN107995242A (en) * | 2016-10-27 | 2018-05-04 | 北京京东尚科信息技术有限公司 | A kind of method for processing business and system |
| CN108804237A (en) * | 2017-05-05 | 2018-11-13 | 北京京东尚科信息技术有限公司 | Data real-time statistical method, device, storage medium and electronic equipment |
| WO2019127916A1 (en) * | 2017-12-29 | 2019-07-04 | 北京奇虎科技有限公司 | Data read/write method and device implemented on the basis of distributed consensus protocol |
| CN108491332A (en) * | 2018-04-04 | 2018-09-04 | 浙江小泰科技有限公司 | A kind of real-time buffering updating method and system based on Redis |
| CN108764879A (en) * | 2018-05-31 | 2018-11-06 | 广州唯品会信息科技有限公司 | The real-time account checking method of distribution, system and computer storage media based on affairs |
| CN108961029A (en) * | 2018-07-26 | 2018-12-07 | 阿里巴巴集团控股有限公司 | A kind of distribution reconciliation processing method, system and terminal device |
| CN109325077A (en) * | 2018-08-03 | 2019-02-12 | 北京马上慧科技术有限公司 | A kind of system that number storehouse in real time is realized based on canal and kafka |
| CN109284334A (en) * | 2018-09-05 | 2019-01-29 | 拉扎斯网络科技（上海）有限公司 | Real-time data base synchronous method, device, electronic equipment and storage medium |
| CN109034993A (en) * | 2018-09-29 | 2018-12-18 | 深圳前海微众银行股份有限公司 | Account checking method, equipment, system and computer readable storage medium |
| CN109615495A (en) * | 2018-10-11 | 2019-04-12 | 阿里巴巴集团控股有限公司 | A kind of account checking method of data, device, equipment and system |
| CN109597817A (en) * | 2018-11-14 | 2019-04-09 | 阿里巴巴集团控股有限公司 | A kind of caching data processing method, device, equipment and medium |
| CN109582301A (en) * | 2018-12-03 | 2019-04-05 | 深圳前海微众银行股份有限公司 | Method for processing business, device, equipment and the medium of task based access control scheduling system |
| CN109800272A (en) * | 2019-02-25 | 2019-05-24 | 广州虎牙信息科技有限公司 | Data cached synchronous method, server, application system and storage device |
| CN110415095A (en) * | 2019-07-24 | 2019-11-05 | 深圳乐信软件技术有限公司 | A kind of account checking method, device, terminal and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113421109A (en) * | 2021-05-14 | 2021-09-21 | 北京沃东天骏信息技术有限公司 | Service checking method, device, electronic equipment and storage medium |
| CN114612209A (en) * | 2022-05-12 | 2022-06-10 | 深圳依时货拉拉科技有限公司 | Account checking data processing method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112419018B (en) | 2022-11-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11249981B2 (en) | Data quality analysis | |
| CN111339073A (en) | Real-time data processing method and device, electronic equipment and readable storage medium | |
| CN112419018B (en) | General data reconciliation method, server and storage medium in distributed environment | |
| US20120185399A1 (en) | Automotive repair warranty and recall tracking | |
| EP2416246B1 (en) | Extensibility of business process and application logic | |
| US8862613B2 (en) | Extensibility of business process and application logic | |
| WO2021185327A1 (en) | Data processing | |
| CN111400294B (en) | Data anomaly monitoring method, device and system | |
| CN110275892B (en) | Block chain-oriented data management method, device, equipment and storage medium | |
| CN111125106A (en) | Batch running task execution method, device, server and storage medium | |
| CN111738728A (en) | Transaction compensation method and device | |
| CN111309746A (en) | Asynchronous parallel data synchronization method and device | |
| CN112015766A (en) | Data processing method and device based on pipelining and data processing system | |
| CN114077518A (en) | Data snapshot method, device, equipment and storage medium | |
| US20200142985A1 (en) | Asynchronously publishing events to a message bus in an event-driven computing system | |
| CN111028074A (en) | Overdue bill updating and inquiring method, system, server and storage medium | |
| CN111861502B (en) | Information processing method, system, electronic device and storage medium | |
| CN114066295A (en) | Workflow business arrangement method and device, electronic equipment and readable storage medium | |
| CN114138397A (en) | Page display method and device, electronic equipment and storage medium | |
| CN110888917A (en) | Batch running task execution method, device, server and storage medium | |
| CN112181380A (en) | Credit product multi-product parallel development system and credit granting, paying and repayment method thereof | |
| CN110765144A (en) | Distributed heterogeneous database data processing method and device | |
| CN114513558B (en) | User request processing method and device | |
| CN112529453B (en) | Method, device, equipment and medium for determining inauguration enterprises | |
| CN115271501A (en) | Order processing method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |