CN113645309A - Processing method and system for multi-client data differentiation secondary caching and synchronization - Google Patents
Processing method and system for multi-client data differentiation secondary caching and synchronization Download PDFInfo
- Publication number
- CN113645309A CN113645309A CN202110950467.2A CN202110950467A CN113645309A CN 113645309 A CN113645309 A CN 113645309A CN 202110950467 A CN202110950467 A CN 202110950467A CN 113645309 A CN113645309 A CN 113645309A
- Authority
- CN
- China
- Prior art keywords
- data
- client
- data set
- server
- updating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 10
- 230000004069 differentiation Effects 0.000 title claims description 8
- 238000000034 method Methods 0.000 claims description 37
- 230000008569 process Effects 0.000 claims description 23
- 238000004590 computer program Methods 0.000 claims description 13
- 125000004122 cyclic group Chemical group 0.000 claims description 8
- 230000008520 organization Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 10
- 230000001360 synchronised effect Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a processing method for differentiated secondary caching and synchronization of data of multiple clients, which comprises the following steps: the server side responds to a data set calling request initiated by each client side according to self service requirements, and if the server side has a corresponding cache data set, the server side sends the data set to the matched client side; if not, sending a data set acquisition request to a data source; the data source responds to a data set acquisition request initiated by the server and sends a corresponding data set to the server; the server receives the data set and caches the memory, and sends the data set to the corresponding client; each client receives the data set matched with the exclusive client label and caches the memory. A large amount of data can be simultaneously cached and differentially cached at multiple points and at various client sides, and the problems of data synchronization and timely updating between a data source and a server side, between the server side and multiple client sides and between the client sides are solved; the requirements of personalized caching and data updating of different clients are met.
Description
Technical Field
The invention relates to the field of big data transmission, data synchronization and data caching, in particular to a processing method and a processing system for differentiated secondary caching and synchronization of data of multiple clients.
Background
With the development of internet technology, the data processing capacity of a software system is larger and larger, the scale of data processing corresponding to a client is larger and larger, and more data to be stored in a database is provided. For various reasons, there is a need for multi-level caching of data in a database, i.e., synchronizing data in the database to other business process computer caches or databases or other clients.
Due to the requirements of high concurrency and high performance of the system, many systems almost use data caching technologies such as memory cache, memory database, and redis cache database, but the caching technologies have the following problems when applied: if the data single-point cache is directly linked with the data source, the defects of large data transmission quantity or inflexible data updating and the like exist; if the data is cached in multiple points, the problem that the data is difficult to synchronize and update in time can occur; when the overall data caching is adopted, the requirements of individual caching of a single data set and differential caching of multiple clients cannot be met.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides a processing method and a system for differentiated secondary caching and synchronization of data of multiple clients.
In order to solve the technical problem, the invention is solved by the following technical scheme:
a processing method for multi-client data differentiation secondary caching and synchronization comprises the following steps:
the server side responds to a data set calling request initiated by each client side according to self service requirements, and if the server side has a corresponding cache data set, the server side sends the data set to the matched client side; if not, sending a data set acquisition request to a data source;
the data source responds to a data set acquisition request initiated by the server and sends a corresponding data set to the server;
the server receives the data set and caches the memory, and sends the data set to the corresponding client;
each client receives the data set matched with the exclusive client label and caches the memory.
As an implementation manner, each client is provided with an exclusive client tag, each data set is provided with an exclusive data set tag, the exclusive data set tag carried by the data set cached in each client is paired with the exclusive client tag of the client, and the exclusive client tag and the exclusive data set tag are stored in a tag list of the server.
As an implementation manner, each data set includes data, a data check value and a dedicated data set tag, the data check value is a value obtained by performing operation through a data check algorithm, the data check algorithm selects one or more of sum check, parity check and cyclic redundancy check, and the dedicated data set tag is a unique identification code of the data set.
As an implementation manner, the data check value and the dedicated data set tag form a data update identifier, and if the data check values of the previous and subsequent data sets are different, it is determined that the data set generates a data update.
As an implementable mode, the method further comprises a data updating process, and the method comprises the following steps:
if the data source detects that the data set generates data updating, the data updating identification and the organization updating data are asynchronously pushed to the server side;
the server receives and caches the updated data, and asynchronously pushes the data updating identification to the corresponding client based on the tag list;
the client receives the data updating identification, and sends a request for updating the corresponding data set to the server according to the data set pointed by the data updating identification;
the server side sends the corresponding updated data in the cache to the client side;
the client receives the data and updates the cache data.
As an implementation manner, the asynchronously pushing the data update identifier and the organization update data to the server includes the following steps:
if the data source detects that the data set generates data updating, the data updating identification is asynchronously pushed to the server side;
the server side sends a corresponding data updating request to the data source according to the data set pointed by the data updating identification;
and the data source organizes the update data and pushes the update data to the server.
A processing system for data differentiation secondary caching and synchronization of multiple clients comprises a server, clients and a data source;
the server side responds to a data set calling request initiated by each client side according to self service requirements, and if the server side has a corresponding cache data set, the server side sends the data set to the matched client side; if not, sending a data set acquisition request to a data source;
the data source responds to a data set acquisition request initiated by the server and sends a corresponding data set to the server;
the server is used for receiving the data set, caching the memory and sending the data set to the corresponding client;
the server is used for storing the exclusive label of the client and the exclusive label of the data set;
the client is used for receiving a data set matched with a self exclusive client label and caching a memory;
the data source is used for storing data sets, each data set comprises data, a data check value and an exclusive data set tag, the data check value is obtained by operation through a data check algorithm, the data check algorithm selects one or more of sum check, parity check and cyclic redundancy check, and the exclusive data set tag is a unique identification code of the data set.
As an implementable manner, the data source is further configured to detect a data update generated by the data set, and if the data source detects that the data set generates the data update, asynchronously push a data update identifier to the server, where the data check value and the dedicated data set tag form the data update identifier, and if the data check values of the previous and subsequent times are different, determine that the data set generates the data update;
the server is also used for sending a corresponding data updating request to the data source according to the data set pointed by the data updating identifier;
the data source is also used for organizing the updating data and sending the updating data to the server;
the server is also used for receiving and caching the updated data, and asynchronously pushing the data update identifier to the corresponding client based on the tag list;
the client is also used for receiving the data updating identification and sending a request for updating the corresponding data set to the server according to the data set pointed by the data updating identification;
the server is also used for sending the corresponding updating data in the cache to the client;
the client is also used for receiving data and updating the cache data.
A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of:
the server side responds to a data set calling request initiated by each client side according to self service requirements, and if the server side has a corresponding cache data set, the server side sends the data set to the matched client side; if not, sending a data set acquisition request to a data source;
the data source responds to a data set acquisition request initiated by the server and sends a corresponding data set to the server;
the server receives the data set and caches the memory, and sends the data set to the corresponding client;
each client receives the data set matched with the exclusive client label and caches the memory.
An apparatus for processing multi-client data differential secondary caching and synchronization, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the following method steps when executing the computer program:
the server side responds to a data set calling request initiated by each client side according to self service requirements, and if the server side has a corresponding cache data set, the server side sends the data set to the matched client side; if not, sending a data set acquisition request to a data source;
the data source responds to a data set acquisition request initiated by the server and sends a corresponding data set to the server;
the server receives the data set and caches the memory, and sends the data set to the corresponding client;
each client receives the data set matched with the exclusive client label and caches the memory.
Due to the adoption of the technical scheme, the invention has the remarkable technical effects that:
by the method, a large amount of data can be simultaneously cached and differentially cached at multiple points and at various client sides, and the problems of data synchronization and timely updating between a data source and a server side, between the server side and multiple client sides and between the client sides are solved; the requirements of personalized caching and data updating of different clients are met.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic flow diagram of the process of the present invention;
FIG. 2 is a schematic diagram illustrating a data synchronization process of a data set between a client and a server and a data source;
fig. 3 is a system framework schematic of the present invention.
Detailed Description
The present invention will be described in further detail with reference to examples, which are illustrative of the present invention and are not to be construed as being limited thereto.
Example 1:
a processing method for multi-client data differentiated secondary caching and synchronization, as shown in fig. 1, includes the following steps:
s100, the server responds to a data set calling request initiated by each client according to self service requirements, and if the server has a corresponding cache data set, the server sends the data set to the matched client; if not, sending a data set acquisition request to a data source;
s200, the data source responds to a data set acquisition request initiated by the server and sends a corresponding data set to the server;
s300, the server receives the data set and caches the memory, and sends the data set to a corresponding client;
s400, each client receives the data set matched with the own exclusive client label and caches the memory.
In one embodiment, each client is provided with an exclusive client tag, each data set is provided with an exclusive data set tag, the exclusive data set tag carried by the cache data set in each client is paired with the exclusive client tag of the client, and the exclusive client tag and the exclusive data set tag are stored in a tag list of the server. In addition, each data set comprises data, a data check value and a dedicated data set label, the data check value is a value obtained by operation through a data check algorithm, the data check algorithm selects one or more of sum check, parity check and cyclic redundancy check, and the dedicated data set label is a unique identification code of the data set.
The above processes of data request and secondary cache further include a data updating process, the data check value and the exclusive data set tag form a data updating identifier, if the data check values of the previous and subsequent times are different, it is determined that the data set generates data updating, and the data updating process specifically includes the following steps:
s1, when the data source detects that the data set generates data updating, the data updating identification is asynchronously pushed to the server side;
s2, the server side sends a corresponding data updating request to the data source according to the data set pointed by the data updating identification;
s3, organizing the update data by the data source and pushing the update data to the server;
s4, the server receives and caches the updated data, and asynchronously pushes the data update identifier to the corresponding client based on the tag list;
s5, the client receives the data updating identification, and sends a request for updating the corresponding data set to the server according to the data set pointed by the data updating identification;
s6, the server side sends the corresponding updated data in the cache to the client side;
and S7, the client receives the data and updates the cache data.
The above processes can be summarized into the following two major processes:
data request and secondary caching process: the client side initiates a data request, the server side organizes data, and if the server cache has data, the server side directly responds to the request; and if the data in the cache of the server does not exist, sending a data request to the data source, organizing the data by the data source and sending the data to the server, and caching the data by the server and responding to the request of the client.
And (3) data updating process: the data source detects data updating of the data set, asynchronously pushes a data updating identifier to the server, the server sends a corresponding data request to the data source according to the data set pointed by the updating identifier, the data source organizes data and responds to the server request, the server receives the data set (including data, a data check value and a dedicated data set tag) to update cache data, and stores tag list record information according to the client and the data set, asynchronously pushes the updating identifier to the corresponding client in the list, the client sends a corresponding data request to the server, the server organizes the corresponding data set and responds to the request, the client receives the data and updates the cache, and data synchronization of the client, the server and the data source is achieved.
Through the above processes of data request, secondary cache and data update, the whole invention can be understood as follows: the invention caches all data sets of a data source in a server memory of a server, caches a part of data sets required in a computer memory of each client according to different service requirements of each client, realizes secondary caching of the data sets of the server and the clients, simultaneously informs each client according to updating of the data sets in the data source by the server, and the client requests to update the corresponding data sets, wherein the whole detailed process can be shown in the flow or the attached figure 2.
By the method, the client and the server can cache data for the second time, the server caches all data, and the client caches the required data; performing differential caching on data, and realizing differential caching of different clients by taking a data set as a minimum unit; the data set is subjected to multi-point caching, and different clients and servers cache data; the caching data of the same data set are synchronized between a plurality of clients and a server in real time; the data is stored and synchronized by taking a data set as a unit, and the synchronized data of different clients are different.
In other words, the data difference cache is embodied, and the cached data sets of the clients in different service fields are different. In order to realize data synchronization better and more quickly, a server stores all data sets, each client stores the data sets required by the service, each client is provided with a unique client tag, each data set is provided with a unique data set tag, the data set tags cached by each client and the client tags are stored in a tag list of the server in a matching manner, if the data sets of a data source generate data updating, the server pushes a data set updating identifier to each client according to the information recorded in the tag list, and each client sends a corresponding updating request according to the data set pointed by the updating tag after receiving the updating identifier, so as to obtain data updating cache data. The data set consists of data, a data check value and an exclusive data set tag, wherein the data refers to original data in a data source, the data check value refers to a value obtained after a check operation is performed to ensure the integrity of the data, the data check operation algorithm can select one of sum check, parity check, cyclic redundancy check and the like, and the exclusive data set tag is a unique identification code of the data set. And in the process of data updating, whether the data is updated or not is judged by comparing the data check values of the two times before and after.
Example 2:
a processing system for multi-client data differentiation secondary caching and synchronization is disclosed, as shown in FIG. 3, and includes a server, a client and a data source;
the server side responds to a data set calling request initiated by each client side according to self service requirements, and if the server side has a corresponding cache data set, the server side sends the data set to the matched client side; if not, sending a data set acquisition request to a data source;
the data source responds to a data set acquisition request initiated by the server and sends a corresponding data set to the server;
the server is used for receiving the data set, caching the memory and sending the data set to the corresponding client;
and the client is used for receiving the data set matched with the exclusive client tag and caching the memory.
In one embodiment, the data source is further configured to detect a data update generated by the data set, and if the data source detects that the data set generates the data update, asynchronously push the data update identifier to the server;
the server is also used for sending a corresponding data updating request to the data source according to the data set pointed by the data updating identifier;
the data source is also used for organizing the updating data and sending the updating data to the server;
the server is also used for receiving and caching the updated data, and asynchronously pushing the data update identifier to the corresponding client based on the tag list;
the client is also used for receiving the data updating identification and sending a request for updating the corresponding data set to the server according to the data set pointed by the data updating identification;
the server is also used for sending the corresponding updating data in the cache to the client;
the client is also used for receiving data and updating the cache data.
The process implemented by the whole system can also be summarized into the following two processes:
data request and secondary caching process: the client side initiates a data request, the server side organizes data, and if the server cache has data, the server side directly responds to the request; and if the data in the cache of the server does not exist, sending a data request to a data source, organizing the data by the data source and sending the data to the server, and caching the data by the server and responding to the request of the client.
And (3) data updating process: the data source detects data updating of the data set, asynchronously pushes a data updating identifier to the server, the server sends a corresponding data request to the data source according to the data set pointed by the updating identifier, the data source organizes data and responds to the server request, the server receives the data set (including data, a data check value and a dedicated data set tag) to update cache data, and stores tag list record information according to the client and the data set, asynchronously pushes the updating identifier to the corresponding client in the list, the client sends a corresponding data request to the server, the server organizes the corresponding data set and responds to the request, the client receives the data and updates the cache, and data synchronization of the client, the server and the data source is achieved.
Through the above processes of data request, secondary cache and data update, the whole invention can be understood as follows: the invention caches all data sets of a data source in a server memory of a server, caches a part of data sets required in a computer memory of each client according to different service requirements of each client, realizes secondary caching of the data sets of the server and the clients, simultaneously informs each client according to updating of the data sets in the data source by the server, and the client requests to update the corresponding data sets, wherein the whole detailed process can be shown in the flow or the attached figure 2.
By the system, secondary data caching of the client and the server can be realized, the server caches all data, and the client caches the required data; data differential caching, namely realizing differential caching of different clients by taking a data set as a minimum unit; the method comprises the following steps that data sets are cached in a multi-point mode, and different clients and different servers cache data; the caching data of the same data set are synchronized between a plurality of clients and a server in real time; the data is stored and synchronized by taking a data set as a unit, and the synchronized data of different clients are different.
Certainly, in the system, each client is provided with an exclusive client tag, each data set is provided with an exclusive data set tag, the exclusive data set tag carried by the cache data set in each client is paired with the exclusive client tag of the client, and the exclusive client tag and the exclusive data set tag are stored in the tag list of the server. In addition, each data set comprises data, a data check value and a special data set label, the data check value is a value obtained by operation through a data check algorithm, the data check algorithm selects one or more of sum check, parity check and cyclic redundancy check, and the special data set label is a unique identification code of the data set.
In other words, the data difference cache is embodied, and the cached data sets of the clients in different service fields are different according to different service requirements of the clients, wherein the cached data sets of the clients are different from each other, and the cached data sets of the clients and the server are different from each other. In order to realize data synchronization better and more quickly, a server stores all data sets, each client stores the data sets required by the service, each client is provided with a unique client tag, each data set is provided with a unique data set tag, the data set tags cached by each client and the client tags are stored in a tag list of the server in a matching mode, if the data sets of a data source generate data updating, the server pushes a data set updating identifier to each client according to information recorded in the tag list, and after each client receives the updating identifier, each client sends a corresponding updating request according to the data set pointed by the updating tag to acquire the data updating and cache the data. The data set consists of data, a data check value and an exclusive data set tag, wherein the data refers to original data in a data source, the data check value refers to a value obtained after a check operation is performed to ensure the integrity of the data, the data check operation algorithm can select one of sum check, parity check, cyclic redundancy check and the like, and the exclusive data set tag is a unique identification code of the data set. And in the process of data updating, whether the data is updated or not is judged by comparing the data check values of the two times before and after.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts in the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that:
reference in the specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. Thus, the appearances of the phrase "one embodiment" or "an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment.
In addition, it should be noted that the specific embodiments described in the present specification may differ in the shape of the components, the names of the components, and the like. All equivalent or simple changes of the structure, the characteristics and the principle of the invention which are described in the patent conception of the invention are included in the protection scope of the patent of the invention. Various modifications, additions and substitutions for the specific embodiments described may be made by those skilled in the art without departing from the scope of the invention as defined in the accompanying claims.
Claims (10)
1. A processing method for multi-client data differentiation secondary caching and synchronization is characterized by comprising the following steps:
the server side responds to a data set calling request initiated by each client side according to self service requirements, and if the server side has a corresponding cache data set, the server side sends the data set to the matched client side; if not, sending a data set acquisition request to a data source;
the data source responds to a data set acquisition request initiated by the server and sends a corresponding data set to the server;
the server receives the data set and caches the memory, and sends the data set to the corresponding client;
each client receives the data set matched with the exclusive client label and caches the memory.
2. The method of claim 1, wherein each client has a dedicated client tag, each dataset comprises data, a data check value and a dedicated dataset tag, the dedicated dataset tag carried by the dataset cached in each client is paired with the dedicated client tag of the client, and the dedicated client tag and the dedicated dataset tag are stored in a tag list of the server.
3. The processing method of the differentiated secondary caching and synchronization of the multi-client data according to claim 2, wherein the data check value is obtained by performing operation through a data check algorithm, the data check algorithm selects one or more of a sum check, a parity check and a cyclic redundancy check, and the exclusive data set tag is a unique identification code of the data set.
4. The processing method of multi-client data differentiation secondary caching and synchronization according to claim 2 or 3, wherein the data check value and the dedicated data set tag form a data update flag, and if the two previous and subsequent data check values are different, it is determined that the data set generates data update.
5. The method for processing the differentiated secondary caching and synchronization of the multi-client data according to claim 4, further comprising a data updating process, comprising the following steps:
if the data source detects that the data set generates data updating, the data updating identification and the organization updating data are asynchronously pushed to the server side;
the server receives and caches the updated data, and asynchronously pushes the data updating identification to the corresponding client based on the tag list;
the client receives the data updating identification, and sends a request for updating the corresponding data set to the server according to the data set pointed by the data updating identification;
the server side sends the corresponding updated data in the cache to the client side;
the client receives the data and updates the cache data.
6. The method of claim 5, wherein the step of asynchronously pushing the data update identifier and the organization update data to the server comprises the steps of:
if the data source detects that the data set generates data updating, the data updating identification is asynchronously pushed to the server side;
the server side sends a corresponding data updating request to the data source according to the data set pointed by the data updating identification;
and the data source organizes the update data and pushes the update data to the server.
7. A processing system for data differentiation secondary caching and synchronization of multiple clients is characterized by comprising a server, clients and a data source;
the server side responds to a data set calling request initiated by each client side according to self service requirements, and if the server side has a corresponding cache data set, the server side sends the data set to the matched client side; if not, sending a data set acquisition request to a data source;
the data source responds to a data set acquisition request initiated by the server and sends a corresponding data set to the server;
the server is used for receiving the data set, caching the memory and sending the data set to the corresponding client;
the server is used for storing the exclusive label of the client and the exclusive label of the data set;
the client is used for receiving a data set matched with a self exclusive client label and caching a memory;
the data source is used for storing data sets, each data set comprises data, a data check value and an exclusive data set tag, the data check value is obtained by operation through a data check algorithm, the data check algorithm selects one or more of sum check, parity check and cyclic redundancy check, and the exclusive data set tag is a unique identification code of the data set.
8. The system for processing multi-client data differential secondary caching and synchronization of claim 7,
the data source is further used for detecting data update generated by the data set, and if the data source detects that the data set generates data update, the data update identifier is asynchronously pushed to the server side, wherein the data check value and the exclusive data set tag form the data update identifier, and if the data check values of the previous time and the next time are different, the data update generated by the data set is judged;
the server is also used for sending a corresponding data updating request to the data source according to the data set pointed by the data updating identifier;
the data source is also used for organizing the updating data and sending the updating data to the server;
the server is also used for receiving and caching the updated data, and asynchronously pushing the data update identifier to the corresponding client based on the tag list;
the client is also used for receiving the data updating identification and sending a request for updating the corresponding data set to the server according to the data set pointed by the data updating identification;
the server is also used for sending the corresponding updating data in the cache to the client;
the client is also used for receiving data and updating the cache data.
9. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of one of claims 1 to 6.
10. An apparatus for processing multi-client data differential secondary caching and synchronization, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the method steps according to any one of claims 1 to 6 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110950467.2A CN113645309A (en) | 2021-08-18 | 2021-08-18 | Processing method and system for multi-client data differentiation secondary caching and synchronization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110950467.2A CN113645309A (en) | 2021-08-18 | 2021-08-18 | Processing method and system for multi-client data differentiation secondary caching and synchronization |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113645309A true CN113645309A (en) | 2021-11-12 |
Family
ID=78422755
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110950467.2A Pending CN113645309A (en) | 2021-08-18 | 2021-08-18 | Processing method and system for multi-client data differentiation secondary caching and synchronization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113645309A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114900424A (en) * | 2022-05-27 | 2022-08-12 | 网易（杭州）网络有限公司 | Data hot-repair method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101090401A (en) * | 2007-05-25 | 2007-12-19 | 金蝶软件（中国）有限公司 | Data buffer store method and system at duster environment |
| CN108650318A (en) * | 2018-05-10 | 2018-10-12 | 北京奇艺世纪科技有限公司 | A kind of data capture method and device |
| US20190034550A1 (en) * | 2016-04-01 | 2019-01-31 | Alibaba Group Holding Limited | Data caching method and apparatus |
| US20190182226A1 (en) * | 2017-12-11 | 2019-06-13 | International Business Machines Corporation | Provide access to data storage services in a network environment |
| CN110727892A (en) * | 2019-09-24 | 2020-01-24 | 北京奇艺世纪科技有限公司 | Cache data updating method and device and electronic equipment |
-
2021
- 2021-08-18 CN CN202110950467.2A patent/CN113645309A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101090401A (en) * | 2007-05-25 | 2007-12-19 | 金蝶软件（中国）有限公司 | Data buffer store method and system at duster environment |
| US20190034550A1 (en) * | 2016-04-01 | 2019-01-31 | Alibaba Group Holding Limited | Data caching method and apparatus |
| US20190182226A1 (en) * | 2017-12-11 | 2019-06-13 | International Business Machines Corporation | Provide access to data storage services in a network environment |
| CN108650318A (en) * | 2018-05-10 | 2018-10-12 | 北京奇艺世纪科技有限公司 | A kind of data capture method and device |
| CN110727892A (en) * | 2019-09-24 | 2020-01-24 | 北京奇艺世纪科技有限公司 | Cache data updating method and device and electronic equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114900424A (en) * | 2022-05-27 | 2022-08-12 | 网易（杭州）网络有限公司 | Data hot-repair method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11824996B2 (en) | Parachain data synchronization method, device and storage medium | |
| US9747356B2 (en) | Eager replication of uncommitted transactions | |
| US20130218837A1 (en) | Cloud data synchronization with local data | |
| CN109492013B (en) | Data processing method, device and system applied to database cluster | |
| US20170154067A1 (en) | Real time big data master data management | |
| CN105100050A (en) | User permission management method and system | |
| WO2023040364A1 (en) | Consensus method and apparatus, and blockchain system | |
| CN111338834B (en) | Data storage method and device | |
| US20180276267A1 (en) | Methods and system for efficiently performing eventual and transactional edits on distributed metadata in an object storage system | |
| US10235251B2 (en) | Distributed disaster recovery file sync server system | |
| CN111694865A (en) | Four-layer structure data acquisition method and device based on distributed system | |
| CN115858488A (en) | Parallel migration method and device based on data governance and readable medium | |
| CN113645309A (en) | Processing method and system for multi-client data differentiation secondary caching and synchronization | |
| CN113761052A (en) | Database synchronization method and device | |
| CN110795495A (en) | Data processing method and device, electronic equipment and computer readable medium | |
| CN110912979B (en) | Method for solving multi-server resource synchronization conflict | |
| US10387887B2 (en) | Bloom filter driven data synchronization | |
| CN116775712A (en) | Method, device, electronic equipment, distributed system and storage medium for inquiring linked list | |
| CN113963763B (en) | Partition changing method and device for medical data storage | |
| CN113783916B (en) | Information synchronization method and device | |
| JP2002014860A (en) | Method for synchronizing plural data base | |
| CN114969206A (en) | Data processing method, device, equipment and storage medium | |
| CN109635040B (en) | Real-time data migration method and device and storage medium | |
| CN113849574A (en) | Data processing method, front end and computer readable storage medium | |
| CN112948494A (en) | Data synchronization method and device, electronic equipment and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |