CN111563102A - Cache updating method, server, system and storage medium - Google Patents
Cache updating method, server, system and storage medium Download PDFInfo
- Publication number
- CN111563102A CN111563102A CN202010279793.0A CN202010279793A CN111563102A CN 111563102 A CN111563102 A CN 111563102A CN 202010279793 A CN202010279793 A CN 202010279793A CN 111563102 A CN111563102 A CN 111563102A
- Authority
- CN
- China
- Prior art keywords
- data
- modification information
- cache
- data modification
- message queue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000003860 storage Methods 0.000 title claims abstract description 22
- 230000004048 modification Effects 0.000 claims abstract description 99
- 238000012986 modification Methods 0.000 claims abstract description 99
- 238000012544 monitoring process Methods 0.000 claims description 24
- 238000012545 processing Methods 0.000 claims description 11
- 238000012546 transfer Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004091 panning Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013501 data transformation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
- G06F16/24578—Query processing with adaptation to user needs using ranking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Abstract
According to the cache updating method, the server, the system and the storage medium, when the data modification information in the update log corresponding to the source database is monitored, the data modification information is added to the message queue; updating corresponding data in a cache database according to the data modification information added to the message queue; the embodiment of the invention monitors the update log of the source database, so that the corresponding data in the cache database is updated only when the source database is changed, and timely and efficient cache updating is realized.
Description
Technical Field
The present invention relates to computer technologies, and in particular, to a cache updating method, a server, a system, and a storage medium.
Background
The cache is a buffer area for data exchange, when data is to be read by certain hardware, the required data is firstly searched from the cache, if the required data is found, the data is directly executed, and if the required data is not found, the required data is found from a memory. Since caches run much faster than memory, the role of caches is to help the hardware run faster. However, when data changes, how to timely and accurately update the data in the cache also becomes a design key point.
In the prior art, a timing task is usually adopted to synchronize data of a source database into a cache database, however, if the frequency of the timing task is too fast, certain influence is caused on the performance of the database and a server, and if the frequency of the timing task is too slow, the data cannot be updated in time.
Therefore, a new cache updating method is needed to update the data in the cache database timely and efficiently.
Disclosure of Invention
In view of the above problems, the present invention provides a cache updating method, a server, a system and a storage medium.
In a first aspect, the present invention provides a cache updating method, including: when data modification information in an update log corresponding to a source database is monitored, adding the data modification information to a message queue; and updating the corresponding data in the cache database according to the data modification information added to the message queue.
In other optional embodiments, the updating, according to the data modification information added to the message queue, corresponding data in the cache database includes: the message queue sends the data modification information to an application server of a theme corresponding to the data modification information; and the application server receives the data modification information and updates the corresponding data in the cache database according to the data modification information.
In other optional embodiments, updating the corresponding data in the cache database according to the data modification information includes: and the application server performs heterogeneous processing on the data modification information and updates corresponding data in a cache database according to the data modification information after the heterogeneous processing.
In other optional embodiments, before the monitoring of the data modification information in the update log corresponding to the source database, the method further includes: and receiving a data modification instruction in the source database, and generating an update log according to the data modification instruction.
In other optional embodiments, before the monitoring of the data modification information in the update log corresponding to the source database, the method further includes: monitoring the update log through a Data Transfer Service (DTS).
In other optional embodiments, the method further comprises: and receiving a data query instruction, and querying the corresponding data in the cache database according to the data query instruction.
In a second aspect, the present invention provides a cache update server, which includes a monitoring module, a message queue module, and an update module; the monitoring module is used for adding the data modification information to the message queue module when monitoring the data modification information in the update log corresponding to the source database; and the updating module is used for updating the data in the cache database according to the data modification information added to the message queue module.
In other optional embodiments, the update module includes an application server, and the update module is specifically configured to: the message queue module sends the data modification information to an application server of a theme corresponding to the data modification information; and the application server receives the data modification information and updates the data in the cache database according to the data modification information.
In a third aspect, the present invention provides a cache updating system, including: the system comprises a source database, a cache database and a cache updating server; wherein the cache update server is configured to perform the method of any of the preceding claims.
In a fourth aspect, the present invention provides a readable storage medium having stored therein computer executable instructions which, when executed by a processor, implement a method as in any of the preceding claims.
According to the cache updating method, the server, the system and the storage medium, when the data modification information in the update log corresponding to the source database is monitored, the data modification information is added to the message queue; updating corresponding data in a cache database according to the data modification information added to the message queue; the embodiment of the invention monitors the update log of the source database, so that the corresponding data in the cache database is updated only when the source database is changed, and timely and efficient cache updating is realized.
Drawings
FIG. 1 is a schematic diagram of a cache update system according to the present invention;
fig. 2 is a schematic flow chart of a cache updating method according to the present invention;
FIG. 3 is a schematic flow chart of another cache updating method according to the present invention;
FIG. 4 is a data storage format of Redis according to the present invention;
fig. 5 is a schematic structural diagram of a cache update server according to the present invention;
FIG. 6 is a schematic structural diagram of a cache update system according to the present invention;
fig. 7 is a schematic diagram of a hardware structure of a control device according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions in the examples of the present invention will be clearly and completely described below with reference to the accompanying drawings in the examples of the present invention.
The terms to which the present invention relates will be explained first:
data transmission service: data Transformation Service (DTS) is a Data transmission method that supports Data transmission between Data sources such as relational databases, non-relational databases (NoSQL), and big Data (OLAP). The data transmission service integrates data migration, data subscription and data real-time synchronization.
Message queue: a (Message Queue, MQ for short) is a container that holds messages during their transmission. The message queue manager acts as a man-in-the-middle in relaying a message from its source to its destination. The main purpose of the queues is to provide routing and guarantee delivery of messages; if the recipient is not available when the message is sent, the message queue will hold the message until it can be successfully delivered.
The cache is a buffer area for data exchange, when data is to be read by certain hardware, the required data is firstly searched from the cache, if the required data is found, the data is directly executed, and if the required data is not found, the required data is found from a memory. Since caches run much faster than memory, the role of caches is to help the hardware run faster. A common cache database is a Remote Dictionary Server (Remote Dictionary Server, Redis), which is a key-value storage system, and supports relatively more stored value types, including string, list, set, and zset. The data types all support push/pop, add/remove, intersection union and difference taking and richer operations, and the Redis cache database can store data frequently called by a user based on the use of a source database, so that the response speed of the system is improved.
For example, in the big data era, a Redis cache database is widely used for panning, wechat, microblog and the like, for example, some fixed and unchangeable data such as fixed information of schools, regions and the like can be stored in a relational database, for frequently changing data such as panning displays related hot searches in a search box at each festival, keywords are automatically deleted when the festival passes, for convenience of management, the data can be synchronously stored in the Redis cache database, expiration time is set, and arrival time is automatically deleted. For another example, in the construction process of the guest collecting service system, the Redis cache database is also used to increase the response speed of the system, for example, the regional information of the system is cached in the Redis cache database to increase the response speed of the system page opening, and for example, the system parameter configuration table information is also stored in the Redis cache database, so that the time for assembling the message is greatly reduced. However, when these data are written into the Redis cache database, it needs to be considered how to timely and accurately update the corresponding data in the Redis cache database when the data change.
In the prior art, a timing task is usually adopted to synchronize data of a source database into a cache database, that is, a thread is started at a timing, and latest data information is written into a Redis cache database by querying a source database parameter table or other data tables which need to be synchronized into the Redis cache database. However, if the frequency of the timing task is too fast, the performance of the server and the performance of the database are affected to a certain extent; if the frequency of the timing task is too slow, the configuration parameters for some switches are not timely enough, for example, when a certain switch is closed, the certain switch cannot be closed timely, and the certain switch needs to be closed to take effect after the next timing task is started.
Aiming at the method, the design concept of the invention is that the data in the cache database is updated only after the update log of the source database is found through monitoring by monitoring the update log of the source database in real time.
Fig. 1 is a schematic diagram of a cache updating system based on the present invention, as shown in fig. 1, one of the cache updating systems based on the present invention may include a source database 1, a cache database 2, and a server 3, where the server 3 may be configured to execute the updating method described in the following embodiments to update data in the cache database 2 after the data in the source database 1 is modified.
In a first aspect, an example of the present invention provides a cache updating method, and fig. 2 is a schematic flow chart of the cache updating method provided in the present invention.
As shown in fig. 2, the cache updating method includes:
Optionally, before step 101, the method further includes: and receiving a data modification instruction in the source database, and generating an update log according to the data modification instruction.
Specifically, the source database is generally a Distributed Relational Database Service (DRDS). When the operation and maintenance personnel and other related personnel need to maintain the data in the source database, the operation such as adding, deleting, changing and the like can be performed on the parameter table or the code table in the source database through the front-end page, and a corresponding update log, such as a binary log file (binary log for short), can be generated, that is, the modification information of the data in the source database is recorded in the update log. The server 3 will monitor the update log in real time and will add the data modification information in the update log to the message queue.
In this step, the reason why the data modification information is added to the message queue is that a problem may occur in the process of executing the operation by the computer or other equipment, if the updated log data is directly stored in the cache database, the cache database may remove the log data when the capacity is low, and the data modification information may be removed, and the message queue may retain the message when the receiver is unavailable, that is, the log data is stored through the message queue, so that the probability of losing the log data is reduced. And the message queue is MQ, which has strong function, stable operation, mature technology and more applicable operating systems.
Optionally, before step 101, the method further includes: monitoring the update log through a Data Transfer Service (DTS).
Specifically, the DTS architecture has high performance, high reliability, and high expansion special effect, and can be seamlessly connected with the DRDS, and in the aspect of its heterogeneity, it supports real-time synchronization of DRDS data to a search engine (elastic search) and an MQ, so in this embodiment, the DTS is the first choice for synchronous update of data software.
And step 102, updating corresponding data in the cache database according to the data modification information added to the message queue.
Optionally, after step 102, the method further includes: and receiving a data query instruction, and querying the corresponding data in the cache database according to the data query instruction.
Specifically, the data in the cache database is updated according to the data modification information in the message queue, and after the update is completed, if a data query instruction of a user is received, the data can be directly obtained by querying the cache database, so that the response speed of the system is improved.
According to the cache updating method provided by the embodiment of the invention, when the data modification information in the update log corresponding to the source database is monitored, the data modification information is added to the message queue; updating corresponding data in a cache database according to the data modification information added to the message queue; the embodiment of the invention monitors the update log of the source database, so that the corresponding data in the cache database is updated only when the source database is changed, and timely and efficient cache updating is realized. In addition, compared with a method of adding a cache refreshing button on a page and needing manual intervention to refresh, the method is more intelligent, reduces development workload and reduces cost.
With reference to the foregoing implementation manners, fig. 3 is a schematic flow chart of another cache updating method provided by the present invention, and as shown in fig. 3, the cache updating method includes:
And 203, the application server receives the data modification information and updates corresponding data in a cache database according to the data modification information.
Step 201 in this embodiment is similar to the implementation of step 101 in the foregoing embodiment, and is not described herein again.
Unlike the previous embodiments, this embodiment further defines a specific implementation manner of cache update. In this embodiment, the message queue sends the data modification information to an application server of a topic corresponding to the data modification information; and the application server receives the data modification information and updates the corresponding data in the cache database according to the data modification information.
In particular, an application server may be a piece of application. In this example, the message production end, i.e. the DTS, sends the update log to the message queue corresponding to the topic in a specified format, and the message consumption end, i.e. the application server, also monitors the message queue, acquires the log message corresponding to the topic at any time, and then inserts the log message into the cache database. And by adopting the message queue mode, a message production end does not need to care whether the message is consumed or not, and the system can not be blocked when the system is busy. The loose coupling architecture design realized by the RocktMQ can improve the availability and the expandability of the system, and is an optimal design scheme suitable for modern application.
For example, when the DTS captures data modification information in real time through binlog and synchronizes the data modification information to the MQ message queue, the application subscribes to the ordered operation topic corresponding to the MQ, receives the message including the data modification information, and updates the heterogeneously processed message to the Redis cache database.
Optionally, one implementation manner of step 203 is: and the application server performs heterogeneous processing on the data modification information and updates corresponding data in a cache database according to the data modification information after the heterogeneous processing.
Usually, a source database holds a base table, table 1 is a source database table format provided by the present invention, as shown in table 1, the base table includes a plurality of data records, the data records include a primary key, the primary key includes a plurality of fields, and Redis is a format stored using key ≧ value, so that it is necessary to change the base table into a storage format using key ≧ value through heterogeneous processing, and the heterogeneous processing is to take the primary key in the source database table as a key value, extract data associated in the base table out of a multi-level entity, and store the data as value, as shown in fig. 4, an R source database table format provided by the present invention is provided by the present inventionedisThe data storage format of (1).
TABLE 1
| Table name | Main key | Field(s) | Field(s) | Field(s) | Field(s) |
| Customer meter | Customer ID | Information 1 | Information 2 | … | |
| CUST | C1 | ||||
| Order form | Order ID | Customer ID | Order information 1 | Order information 2 | … |
| ORDER | D1 | C1 | |||
| Other information | Other information ID | Order ID | Other information 1 | Other information 2 | … |
| OTHER | Q1 | D1 |
According to the cache updating method provided by the embodiment of the invention, when the data modification information in the update log corresponding to the source database is monitored, the data modification information is added to the message queue; the message queue sends the data modification information to an application server of a theme corresponding to the data modification information; the application server receives the data modification information and updates corresponding data in a cache database according to the data modification information; the embodiment of the invention monitors the update log of the source database, so that the corresponding data in the cache database is updated only when the source database is changed, and timely and efficient cache updating is realized.
In a second aspect, the present invention provides a cache update server, fig. 5 is a schematic structural diagram of the cache update server provided in the present invention, as shown in fig. 5, the cache update server includes a monitoring module 10, a message queue module 20, and an update module 30; the monitoring module 10 is configured to, when monitoring data modification information in an update log corresponding to a source database, add the data modification information to the message queue module 20; and the updating module 30 is configured to update the data in the cache database according to the data modification information added to the message queue module 20.
In other optional embodiments, the update module 30 includes an application server, and the update module 30 is specifically configured to: the message queue module 20 sends the data modification information to an application server of a topic corresponding to the data modification information; and the application server receives the data modification information and updates the corresponding data in the cache database according to the data modification information.
In other optional embodiments, the update module 30 is further specifically configured to: and the application server performs heterogeneous processing on the data modification information and updates corresponding data in a cache database according to the data modification information after the heterogeneous processing.
In other optional embodiments, the method further includes a generating module 40, where the generating module 40 is configured to: and receiving a data modification instruction in the source database, and generating an update log according to the data modification instruction.
In other optional embodiments, the monitoring module 10 is further configured to: monitoring the update log through a Data Transfer Service (DTS).
In other optional embodiments, the system further comprises a query module 50, wherein the query module 50 is configured to: and receiving a data query instruction, and querying the corresponding data in the cache database according to the data query instruction.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process and corresponding beneficial effects of the cache update server described above may refer to the corresponding process in the foregoing method example, and are not described herein again.
The cache updating server provided by the invention comprises a monitoring module, a message queue module and an updating module; the monitoring module is used for adding the data modification information to the message queue module when monitoring the data modification information in the update log corresponding to the source database; the updating module is used for updating the data in the cache database according to the data modification information added to the message queue module; the embodiment of the invention monitors the update log of the source database, so that the corresponding data in the cache database is updated only when the source database is changed, and timely and efficient cache updating is realized.
In a third aspect, the present invention provides a cache update system. Fig. 6 is a schematic structural diagram of a cache update system according to the present invention, as shown in fig. 6, the cache update system includes a source database 100, a cache database 200, and a cache update server 300; wherein the cache update server 300 is configured to perform the method according to any of the previous claims.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process and corresponding beneficial effects of the above described cache updating system may refer to the corresponding process in the foregoing method example, and are not described herein again.
The cache updating system provided by the invention comprises a source database, a cache database and a cache updating server, wherein the cache updating server is used for executing the method in any item; the embodiment of the invention monitors the update log of the source database, so that the corresponding data in the cache database is updated only when the source database is changed, and timely and efficient cache updating is realized.
In a fourth aspect, the present invention provides a control device, and fig. 7 is a schematic diagram of a hardware structure of the control device provided in the present invention, as shown in fig. 7, including:
at least one processor 701 and a memory 702.
In a specific implementation process, at least one processor 701 executes computer-executable instructions stored in the memory 702, so that the at least one processor 701 executes the cache update method, where the processor 701 and the memory 702 are connected through the bus 703.
For a specific implementation process of the processor 701, reference may be made to the above method embodiments, which implement principles and technical effects similar to each other, and details of this embodiment are not described herein again.
In the embodiment shown in fig. 7, it should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.
The memory may comprise high speed RAM memory and may also include non-volatile storage NVM, such as at least one disk memory.
The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.
The invention also provides a readable storage medium, wherein the readable storage medium stores computer execution instructions, and when a processor executes the computer execution instructions, the cache updating method is realized.
The readable storage medium described above may be implemented by any type of volatile or non-volatile memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk. Readable storage media can be any available media that can be accessed by a general purpose or special purpose computer.
An exemplary readable storage medium is coupled to the processor such the processor can read information from, and write information to, the readable storage medium. Of course, the readable storage medium may also be an integral part of the processor. The processor and the readable storage medium may reside in an Application Specific Integrated Circuits (ASIC). Of course, the processor and the readable storage medium may also reside as discrete components in the apparatus.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A cache update method, comprising:
when data modification information in an update log corresponding to a source database is monitored, adding the data modification information to a message queue;
and updating the corresponding data in the cache database according to the data modification information added to the message queue.
2. The method of claim 1, wherein updating the corresponding data in the cache database according to the data modification information added to the message queue comprises:
the message queue sends the data modification information to an application server of a theme corresponding to the data modification information;
and the application server receives the data modification information and updates the corresponding data in the cache database according to the data modification information.
3. The method of claim 2, wherein updating the corresponding data in the cache database according to the data modification information comprises:
and the application server performs heterogeneous processing on the data modification information and updates corresponding data in a cache database according to the data modification information after the heterogeneous processing.
4. The method according to any one of claims 1 to 3, wherein before the monitoring of the data modification information in the update log corresponding to the source database, the method further comprises:
and receiving a data modification instruction of the source database, and generating an update log according to the data modification instruction.
5. The method of claim 4, wherein before the monitoring of the data modification information in the update log corresponding to the source database, further comprising:
monitoring the update log through a Data Transfer Service (DTS).
6. The method according to any one of claims 1-3, further comprising:
and receiving a data query instruction, and querying the corresponding data in the cache database according to the data query instruction.
7. A cache updating server is characterized by comprising a monitoring module, a message queue module and an updating module;
the monitoring module is used for adding the data modification information to the message queue module when monitoring the data modification information in the update log corresponding to the source database;
and the updating module is used for updating the data in the cache database according to the data modification information added to the message queue module.
8. The server according to claim 7, wherein the update module comprises an application server, and the update module is specifically configured to:
the message queue module sends the data modification information to an application server of a theme corresponding to the data modification information;
and the application server receives the data modification information and updates the corresponding data in the cache database according to the data modification information.
9. A cache update system, comprising: the system comprises a source database, a cache database and a cache updating server; wherein the cache update server is configured to perform the method of any of claims 1 to 6.
10. A readable storage medium having stored thereon computer executable instructions which, when executed by a processor, implement the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010279793.0A CN111563102A (en) | 2020-04-10 | 2020-04-10 | Cache updating method, server, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010279793.0A CN111563102A (en) | 2020-04-10 | 2020-04-10 | Cache updating method, server, system and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111563102A true CN111563102A (en) | 2020-08-21 |
Family
ID=72074228
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010279793.0A Pending CN111563102A (en) | 2020-04-10 | 2020-04-10 | Cache updating method, server, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111563102A (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111966719A (en) * | 2020-10-21 | 2020-11-20 | 四川新网银行股份有限公司 | Method for refreshing local data cache of distributed consumer credit system in real time |
| CN112052247A (en) * | 2020-09-29 | 2020-12-08 | 微医云(杭州)控股有限公司 | Index updating system, method and device of search engine, electronic equipment and storage medium |
| CN112131237A (en) * | 2020-09-28 | 2020-12-25 | 京东数字科技控股股份有限公司 | Data synchronization method, device, equipment and computer readable medium |
| CN112187896A (en) * | 2020-09-18 | 2021-01-05 | 成都精灵云科技有限公司 | Cache system and method supporting real-time notification of changes and real-time synchronization of data |
| CN112256715A (en) * | 2020-11-12 | 2021-01-22 | 微医云(杭州)控股有限公司 | Index updating method and device, electronic equipment and storage medium |
| CN112579585A (en) * | 2020-12-22 | 2021-03-30 | 京东数字科技控股股份有限公司 | Data processing system, method and device |
| CN112597151A (en) * | 2020-12-03 | 2021-04-02 | 长沙市到家悠享家政服务有限公司 | Data processing method, device, equipment and storage medium |
| CN112615907A (en) * | 2020-12-04 | 2021-04-06 | 北京齐尔布莱特科技有限公司 | Data synchronization system and method |
| CN112860720A (en) * | 2021-03-09 | 2021-05-28 | 中国电子系统技术有限公司 | Storage capacity updating method and device |
| CN113254465A (en) * | 2021-05-25 | 2021-08-13 | 四川虹魔方网络科技有限公司 | Cache final consistency updating method |
| CN113377289A (en) * | 2021-06-01 | 2021-09-10 | 北京齐尔布莱特科技有限公司 | Cache management method, system, computing device and readable storage medium |
| CN113535777A (en) * | 2021-06-24 | 2021-10-22 | 上海浦东发展银行股份有限公司 | Database query method, device and system |
| CN115118590A (en) * | 2022-06-22 | 2022-09-27 | 平安科技（深圳）有限公司 | Method, device, system, equipment and storage medium for managing configuration data |
| CN116401317A (en) * | 2023-04-19 | 2023-07-07 | 中国环球租赁有限公司 | Cache data synchronization method and device, electronic equipment and medium |
| CN112256715B (en) * | 2020-11-12 | 2024-04-19 | 微医云(杭州)控股有限公司 | Index updating method and device, electronic equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102023973A (en) * | 2009-09-14 | 2011-04-20 | 中国移动通信集团公司 | Method, device and system for synchronizing database with application cache server |
| CN102741843A (en) * | 2011-03-22 | 2012-10-17 | 青岛海信传媒网络技术有限公司 | Method and apparatus for reading data from database |
| CN108491332A (en) * | 2018-04-04 | 2018-09-04 | 浙江小泰科技有限公司 | A kind of real-time buffering updating method and system based on Redis |
| CN108989429A (en) * | 2018-07-19 | 2018-12-11 | 平安科技（深圳）有限公司 | The method, apparatus of real-time update page data, electronic equipment |
| CN109241072A (en) * | 2018-08-31 | 2019-01-18 | 携程计算机技术（上海）有限公司 | Buffering updating method and system based on Canal |
| CN109857812A (en) * | 2019-02-27 | 2019-06-07 | 珠海天燕科技有限公司 | A kind of method and apparatus handling data in caching |
| US20190207880A1 (en) * | 2017-12-29 | 2019-07-04 | Facebook, Inc. | Techniques for data reads from secondary stores |
| US20190294722A1 (en) * | 2018-03-20 | 2019-09-26 | Locus Robotics Corp. | Change management system for data synchronization within an enterprise portal application |
-
2020
- 2020-04-10 CN CN202010279793.0A patent/CN111563102A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102023973A (en) * | 2009-09-14 | 2011-04-20 | 中国移动通信集团公司 | Method, device and system for synchronizing database with application cache server |
| CN102741843A (en) * | 2011-03-22 | 2012-10-17 | 青岛海信传媒网络技术有限公司 | Method and apparatus for reading data from database |
| US20190207880A1 (en) * | 2017-12-29 | 2019-07-04 | Facebook, Inc. | Techniques for data reads from secondary stores |
| US20190294722A1 (en) * | 2018-03-20 | 2019-09-26 | Locus Robotics Corp. | Change management system for data synchronization within an enterprise portal application |
| CN108491332A (en) * | 2018-04-04 | 2018-09-04 | 浙江小泰科技有限公司 | A kind of real-time buffering updating method and system based on Redis |
| CN108989429A (en) * | 2018-07-19 | 2018-12-11 | 平安科技（深圳）有限公司 | The method, apparatus of real-time update page data, electronic equipment |
| CN109241072A (en) * | 2018-08-31 | 2019-01-18 | 携程计算机技术（上海）有限公司 | Buffering updating method and system based on Canal |
| CN109857812A (en) * | 2019-02-27 | 2019-06-07 | 珠海天燕科技有限公司 | A kind of method and apparatus handling data in caching |
Non-Patent Citations (1)
| Title |
|---|
| 叶青: ""论缓存更新策略"", 《福建电脑》 * |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112187896A (en) * | 2020-09-18 | 2021-01-05 | 成都精灵云科技有限公司 | Cache system and method supporting real-time notification of changes and real-time synchronization of data |
| WO2022063284A1 (en) * | 2020-09-28 | 2022-03-31 | 京东科技控股股份有限公司 | Data synchronization method and apparatus, device, and computer-readable medium |
| CN112131237A (en) * | 2020-09-28 | 2020-12-25 | 京东数字科技控股股份有限公司 | Data synchronization method, device, equipment and computer readable medium |
| CN112052247A (en) * | 2020-09-29 | 2020-12-08 | 微医云(杭州)控股有限公司 | Index updating system, method and device of search engine, electronic equipment and storage medium |
| CN111966719A (en) * | 2020-10-21 | 2020-11-20 | 四川新网银行股份有限公司 | Method for refreshing local data cache of distributed consumer credit system in real time |
| CN111966719B (en) * | 2020-10-21 | 2021-07-13 | 四川新网银行股份有限公司 | Method for refreshing local data cache of distributed consumer credit system in real time |
| CN112256715A (en) * | 2020-11-12 | 2021-01-22 | 微医云(杭州)控股有限公司 | Index updating method and device, electronic equipment and storage medium |
| CN112256715B (en) * | 2020-11-12 | 2024-04-19 | 微医云(杭州)控股有限公司 | Index updating method and device, electronic equipment and storage medium |
| CN112597151A (en) * | 2020-12-03 | 2021-04-02 | 长沙市到家悠享家政服务有限公司 | Data processing method, device, equipment and storage medium |
| CN112615907A (en) * | 2020-12-04 | 2021-04-06 | 北京齐尔布莱特科技有限公司 | Data synchronization system and method |
| CN112615907B (en) * | 2020-12-04 | 2022-09-06 | 北京齐尔布莱特科技有限公司 | Data synchronization system and method |
| CN112579585A (en) * | 2020-12-22 | 2021-03-30 | 京东数字科技控股股份有限公司 | Data processing system, method and device |
| CN112860720A (en) * | 2021-03-09 | 2021-05-28 | 中国电子系统技术有限公司 | Storage capacity updating method and device |
| CN113254465A (en) * | 2021-05-25 | 2021-08-13 | 四川虹魔方网络科技有限公司 | Cache final consistency updating method |
| CN113377289A (en) * | 2021-06-01 | 2021-09-10 | 北京齐尔布莱特科技有限公司 | Cache management method, system, computing device and readable storage medium |
| CN113535777A (en) * | 2021-06-24 | 2021-10-22 | 上海浦东发展银行股份有限公司 | Database query method, device and system |
| CN115118590A (en) * | 2022-06-22 | 2022-09-27 | 平安科技（深圳）有限公司 | Method, device, system, equipment and storage medium for managing configuration data |
| CN116401317A (en) * | 2023-04-19 | 2023-07-07 | 中国环球租赁有限公司 | Cache data synchronization method and device, electronic equipment and medium |
| CN116401317B (en) * | 2023-04-19 | 2023-11-17 | 中国环球租赁有限公司 | Cache data synchronization method and device, electronic equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111563102A (en) | Cache updating method, server, system and storage medium | |
| US11921746B2 (en) | Data replication method and apparatus, computer device, and storage medium | |
| US9779128B2 (en) | System and method for massively parallel processing database | |
| US9558257B2 (en) | Method of synchronizing data between databases, and computer system and computer program for the same | |
| US8589361B2 (en) | Reduced disk space standby | |
| US8341134B2 (en) | Asynchronous deletion of a range of messages processed by a parallel database replication apply process | |
| CN101650741B (en) | Method and system for updating index of distributed full-text search in real time | |
| Aiyer et al. | Storage infrastructure behind Facebook messages: Using HBase at scale. | |
| CN108121782B (en) | Distribution method of query request, database middleware system and electronic equipment | |
| US7783607B2 (en) | Decentralized record expiry | |
| CN101364217B (en) | Data maintenance method, equipment and system thereof in data-base | |
| CN111797121B (en) | Strong consistency query method, device and system of read-write separation architecture service system | |
| US20050049945A1 (en) | Database log capture program that publishes transactions to multiple targets to handle unavailable targets by separating the publishing of subscriptions and subsequently recombining the publishing | |
| US20130117234A1 (en) | Database Log Parallelization | |
| CN106557578B (en) | Historical data query method and system | |
| US7734618B2 (en) | Creating adaptive, deferred, incremental indexes | |
| WO2012126177A2 (en) | Method and apparatus for reading data from database | |
| WO2021068612A1 (en) | Method and device for archiving outdated data | |
| CN116108057B (en) | Distributed database access method, device, equipment and storage medium | |
| CN111127252A (en) | Data management method of water resource management decision support system | |
| CN105956041A (en) | Data model processing method based on Spring Data for MongoDB cluster | |
| CN115469810A (en) | Data acquisition method, device, equipment and storage medium | |
| CN113626457A (en) | Method and system for realizing database and cache consistency by cache deletion retry mechanism | |
| CN111913973A (en) | Data synchronization method, device and storage medium | |
| CN113051274B (en) | Mass tag storage system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200821 |