CN113779326A - Data processing method, device, system and storage medium - Google Patents
Data processing method, device, system and storage medium Download PDFInfo
- Publication number
- CN113779326A CN113779326A CN202110363237.6A CN202110363237A CN113779326A CN 113779326 A CN113779326 A CN 113779326A CN 202110363237 A CN202110363237 A CN 202110363237A CN 113779326 A CN113779326 A CN 113779326A
- Authority
- CN
- China
- Prior art keywords
- server
- basic data
- data
- intermediate server
- memory space
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/90335—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9032—Query formulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a data processing method, equipment, a system and a storage medium, wherein the method comprises the steps of receiving an inquiry operation request sent by a user server, wherein the inquiry operation request is used for inquiring basic data; reading basic data from a memory space of the intermediate server according to the query operation request, and sending the basic data to the user server; the basic data are permanently stored in the database server, the basic data are cached in the memory space of the intermediate server, and the size of the memory space of the intermediate server is determined according to the data volume of the basic data. According to the scheme, basic data are cached in the physical memory space, the query performance is guaranteed, the size of the memory space is determined based on the data volume of the basic data, and the lightweight deployment of the intermediate server is achieved.
Description
Technical Field
The present application relates to computer system technologies, and in particular, to a data processing method, device, system, and storage medium.
Background
In the process of developing a software system, operations such as adding, deleting and modifying basic data are generally involved. The basic data refers to the underlying data in the software system and is the basis of other data.
Typically, the overall amount of underlying data is small compared to other data. Since other data needs to be based on the basic data, the basic data is frequently queried, but the basic data is not frequently updated, and data consistency is guaranteed once the basic data is updated.
However, no data processing scheme suitable for the add-delete-modify operation of the basic data exists in the prior art.
Disclosure of Invention
The application provides a data processing method, equipment, a system and a storage medium, and aims to provide a data processing scheme aiming at basic data.
In a first aspect, the present application provides a data processing method, where the method is applied to an intermediate server, and the method includes:
receiving an inquiry operation request sent by a user server, wherein the inquiry operation request is used for inquiring basic data;
reading basic data from a memory space of the intermediate server according to the query operation request, and sending the basic data to the user server;
the basic data are permanently stored in the database server, the basic data are cached in the memory space of the intermediate server, and the size of the memory space of the intermediate server is determined according to the data volume of the basic data.
Optionally, before reading the basic data from the memory space of the intermediate server according to the query operation request, the method further includes:
obtaining a cache operation instruction for operating basic data;
and operating the basic data in the memory space of the intermediate server according to the cache operation instruction.
In the technical scheme, when the basic data is updated or newly added, the cache operation instruction of the basic data is obtained, and the basic data is loaded into the memory space according to the cache operation instruction, so that the consistency of the basic data in the database server and the basic data in the intermediate server is ensured.
Optionally, the obtaining of the cache operation instruction for operating the basic data specifically includes:
and receiving a cache operation instruction sent by the user server.
Optionally, the method further comprises:
and when operation failure occurs in the operation basic data, sending an operation failure message to the user server so that the user server sends a cache operation message to the message server.
Optionally, the method further comprises:
and operating the basic data in the memory space of the intermediate server according to the cache operation message.
In the technical scheme, the user server sends the caching operation instruction to the intermediate server so that the intermediate server caches the basic data in the memory space according to the caching operation instruction, if the caching of the data fails, the user server issues the caching operation message to the intermediate server, the intermediate server caches the data in the memory space again by polling the message in the message server when receiving the caching operation message, and double data caching is ensured, so that the data consistency is improved.
Optionally, the obtaining of the cache operation instruction for operating the basic data specifically includes:
when the intermediate server is powered on, generating a cache operation instruction;
correspondingly, operating the basic data in the memory space of the intermediate server according to the cache operation instruction specifically includes:
reading all basic data from the database server according to the cache operation instruction;
the base data is cached in the memory space.
In a second aspect, the present application provides a data processing method, where the method is applied to a user server, and the method includes:
sending a query operation request to an intermediate server, wherein the query operation request is used for querying basic data so that the intermediate server reads the basic data from a memory space of the intermediate server according to the query operation request, the basic data is permanently stored in a database server and cached in the memory space of the intermediate server, and the size of the memory space of the intermediate server is determined according to a basic database;
and receiving the basic data sent by the intermediate server.
Optionally, the method further comprises:
and sending a cache operation instruction to the intermediate server so that the intermediate server operates the basic data in the memory space according to the cache operation instruction.
Optionally, the method further comprises:
and if receiving an operation failure message sent by the intermediate server, sending a cache operation message to the message server so as to enable the intermediate server to operate the basic data in the memory space.
Optionally, the method further comprises:
and sending a database operation instruction to the database server, wherein the database operation instruction comprises basic data to be operated so that the database server operates the basic data.
In a third aspect, the present application provides an intermediary server, comprising:
a memory; a memory for storing processor-executable instructions;
wherein the processor is configured as a data processing method according to the first aspect and alternative aspects.
In a fourth aspect, the present application provides a user server, comprising: a memory, a processor;
a memory; a memory for storing processor-executable instructions;
wherein the processor is configured as a data processing method according to the second aspect and the alternative.
In a fifth aspect, the present application provides a service system, comprising: an intermediate server according to the third aspect, a user server, a database server and a message server according to the fourth aspect.
In a sixth aspect, the present application provides a computer-readable storage medium, wherein computer-executable instructions are stored in the computer-readable storage medium, and when the computer-executable instructions are executed by a processor, the computer-readable storage medium is used for implementing the data processing method according to the first aspect and the optional steps, and the second aspect and the optional steps.
In a seventh aspect, the present application provides a computer program product comprising a computer program which, when executed by a processor, implements the data processing method according to the first aspect and the alternative aspects and the second aspect and the alternative aspects.
The application provides a data processing method, equipment, a system and a storage medium, which are used for receiving a query operation request sent by a user server, reading basic data from a memory space of an intermediate server according to the query operation request and sending the basic data to the user server. Basic data are cached by using a physical memory space, so that the query performance is ensured, and the disk IO blockage of a query database is reduced. The size of the memory space of the intermediate server is determined according to the data volume of the basic data, and the intermediate server can be deployed in a light weight mode.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
Fig. 1 is a schematic structural diagram of a service system according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a data processing method according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a data processing method according to another embodiment of the present application;
fig. 4 is a schematic flowchart of a data processing method according to another embodiment of the present application;
fig. 5 is a schematic structural diagram of a data processing apparatus according to another embodiment of the present application;
fig. 6 is a schematic structural diagram of a data processing apparatus according to another embodiment of the present application;
fig. 7 is a schematic structural diagram of an intermediate server according to another embodiment of the present application.
With the above figures, there are shown specific embodiments of the present application, which will be described in more detail below. These drawings and written description are not intended to limit the scope of the inventive concepts in any manner, but rather to illustrate the inventive concepts to those skilled in the art by reference to specific embodiments.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
In the process of developing a software system, operations such as adding, deleting and modifying basic data are generally involved. The basic data refers to the underlying data in the software system and is the basis of other data. For example: in a warehouse management system, the name of each item, the name of the supplier of the item, etc. belong to the underlying data on which other data in the warehouse management system are based, such as: the frequency of shipment, the quantity of inventory of the goods, etc. need to be based on the name of the goods. Another example is: in an enterprise office system, names, sexes, ages and the like of employees belong to basic data, and attendance records, office supply application records and the like of the employees need to be according to the names of the employees but do not belong to the basic data.
The basic data listed here is for the purpose of explaining the basic data, and may be changed according to different usage scenarios.
In general, the basic data has the following characteristics: first, the overall amount of base data is less than other data. Second, since other data needs to be based on the base data, the base data is frequently queried but not frequently updated, and data consistency is guaranteed once updated.
Based on the above-mentioned feature analysis of technical data, the following aspects must be considered when developing a software system: first, the response performance of the query operation must be considered. Second, data consistency must be considered, i.e., data is updated on all devices on which the software system is deployed when it is modified or added.
The application provides a data processing method, equipment, a system and a storage medium, and aims to provide a data processing scheme suitable for basic data. The technical idea of the application is as follows: the intermediate server is deployed in a light weight mode, namely the size of the memory space of the intermediate server is determined according to the data volume of the basic data, the real-time effective basic data are directly cached in the physical memory space of the intermediate server, the data query request can be responded in real time, the query performance of data query is improved, and the high availability of the data is ensured. In addition, when updating the basic data in the database server, the deployment user server initiates a data caching instruction to control the intermediate server to cache the basic data in the memory space, after the intermediate server fails to cache the data, the user server issues a caching operation message to the message server, the intermediate server polls the message in the message server, and caches the data again after receiving the caching operation message.
As shown in fig. 1, an embodiment of the present application provides a data processing system 100, where the data processing system 100 includes a database server 101, an intermediate server 102, a user server 103, a user client 104, and a message server 105.
The communication connection between the intermediate server 102 and the database server 101, the communication connection between the intermediate server 102 and the user server 103, and the communication connection between the user server 103 and the database server 101 are described.
A user server 103 and a user client 104. A communication connection is made between the message server 105 and the intermediate server 102, and also between the message server 105 and the user server 103.
The database server 101 is configured to permanently store data, and when the intermediate server 102 is powered on, read data from the database server 101 and store the read data in a memory space. The user server 103 is configured to receive a data operation request of the user client 104.
The message server 105 functions for listening and notification. When the intermediate server fails to cache the updated basic data, the message server 105 is configured to receive a message issued by the user server 103, and the intermediate server 102 polls the message in the message server 105 and reads the newly added basic data from the database server according to the cached data information.
The data interaction process between each server and the user client in the data processing system 100 is described in detail in the following method embodiments, and is not described herein again.
It should be noted here that, in order to ensure horizontal capacity expansion and smooth capacity reduction of the device, each server described above adopts a server cluster, that is, the database server 101, the intermediate server 102, the user server 103, and the message server 105 adopt a server cluster, and if a certain server node goes down, other servers in the cluster may also continue to provide services, so as to ensure the overall availability of the services.
As shown in fig. 2, the present application provides a data processing method, which is applied to the data processing system, and the data processing method specifically includes the following steps:
s201, the intermediate server receives an inquiry operation request sent by the user server.
The query operation request is used for querying basic data, the basic data refers to bottom data in the software system, and other data needs to be based on the basic data.
And the user initiates a query operation request of basic data through the user client. After receiving the query operation request, the user server may directly forward the query operation request to the intermediate server, or may encode the query operation request according to a communication manner between the intermediate server and the user server, and then transmit the encoded query operation request to the intermediate server.
S202, the intermediate server reads the basic data from the memory space of the intermediate server according to the query operation request.
The basic data is permanently stored in the database server, after the intermediate server is powered on, the intermediate server reads the basic data from the database server and stores the basic data in a memory space of the intermediate server, wherein the memory space is a storage space of a volatile memory.
Because the data volume of the basic data is smaller, the occupied memory space of the intermediate server is also smaller, namely the intermediate server with common resource configuration can meet the storage requirement of the basic data. The size of the memory space of the intermediate server can be determined according to the data volume of the basic data. And the basic data is used as the basis of other data and is frequently called, so that the quick response is required to be realized. The basic data is stored in the memory space, and when a query operation request is received, the request can be quickly responded.
After receiving the query operation request, the intermediate server parses basic data to be queried from the query operation request, and reads corresponding basic data from a memory space.
S203, the intermediate server sends basic data to the user server.
And the intermediate server sends the basic data to the user server after acquiring the basic data from the memory space.
The scheme is compared with a Redis server cluster deployment mode. The Redis server cluster is deployed, namely, the Redis server cluster caches basic data, and provides the basic data for a user, so that the data query performance is improved.
The problem of deploying the Redis server cluster is that firstly, the Redis server cluster has higher requirements on the performance of the server. Secondly, the Redis of the lower version only supports single-thread query, and in a general situation, due to the fact that the quantity of basic data is small, other data can be cached by the Redis server cluster, and the situation that resources of the Redis server cluster are seriously wasted due to the fact that only the basic data is cached is avoided. That is, there is a thread condition where there is competition between the basic data and other data in Redis. Thirdly, when the Redis performs data query, consistent hash calculation is performed according to the keywords, a certain hash slot position is located according to the hash calculation result, and the data hash cached by the Redis is unbalanced, so that the basic data can be located only by performing multiple times of hash calculation, and the query request cannot be quickly responded. Fourth, Redis is a storage method that uses a structure of keys and keys to store data, and is not suitable for a relational structure.
In the application, the intermediate server is deployed, the memory space of the intermediate server is configured according to the data volume of the basic data, and the performance requirement of the intermediate server is obviously reduced. The memory space of the intermediate server only caches the basic data, and the problem that the basic data and other data compete for threads does not exist.
The present application is compared below with deploying a cluster of ES servers. The method comprises the steps that basic data are stored in an index library by using an ES server cluster, a calling party directly inquires the index library of the ES server cluster, and if data are not found in the ES server cluster, a database server is directly accessed. However, when a caller queries basic data, the problem of querying deep paging of the index library is also considered, and if the problem of deep paging is not solved, the performance will drop off cliff after defaulting more than ten thousand pieces of data.
In the technical scheme, the memory space of the intermediate server is determined according to the data volume of the basic data, the basic data is cached in the memory space, and when the query operation request initiated by the user server is received, the basic data is directly read from the memory space of the intermediate server and returned to the user server. Because the memory space is used for caching the basic data, the query operation request can be quickly responded, so that the characteristic that the basic data is queried at high concurrency is adapted. And the data size of the basic data is small, the requirement on the size of the memory space of the intermediate server is not high, and the system cost is not additionally increased.
As shown in fig. 3, another embodiment of the present application provides a data processing method, where the data processing method is applied to the data processing system, and the method specifically includes the following steps:
s301, the user server sends a database operation instruction to the database server.
When a user operates basic data in a database through a user client, the user client sends an operation modification request, an operation deletion request or an operation addition request to a user server. The modification operation request includes base data before modification and base data after modification. The new operation request includes the new basic data. The delete operation request includes the underlying data to be deleted.
The user server generates an operation instruction after receiving the operation modification request, the operation deletion request or the operation addition request, wherein the operation instruction comprises basic data to be operated, so that the data server operates the data in the storage space by the operation instruction.
And S302, operating the basic data by the database server according to the database operation instruction.
And if the database instruction is used for modifying the basic data, the basic data to be operated comprises the identification information of the basic data before modification and the modified basic data. The database server stores the modified basic data in the storage space permanently in a mode of covering the basic data before modification.
And if the database instruction is used for newly adding the basic data, the basic data to be operated comprises the newly added basic data. The database server stores the newly added basic data in the storage space permanently.
And if the database instruction is used for deleting the basic data, the basic data to be operated comprises the basic data to be deleted, and the database server deletes the basic data to be deleted from the storage space.
S303, the intermediate server obtains a cache operation instruction for operating the basic data.
The cache operation instruction may be triggered in two cases. One is a cache operation instruction generated by self-triggering when the intermediate server is powered on. The other is generated by a user server, and the user server generates a cache operation instruction when receiving a modification operation request, a deletion operation request or an addition operation request.
And S304, operating the basic data in the memory space of the intermediate server according to the cache operation instruction.
If the cache operation instruction is generated when the intermediate server is powered on, the intermediate server reads all basic data from the data server after receiving the cache operation instruction, and caches the basic data in the memory space.
And if the cache operation instruction of the basic data is generated by the user server, the intermediate server operates the data of the memory space according to the specific cache operation type.
If the cache operation instruction is used for adding the basic data in the memory space, extracting the identification information of the added basic data from the cache operation instruction, reading the basic data from the database server according to the identification information, and caching the added basic data in the memory space.
And if the cache operation instruction is used for deleting invalid basic data in the memory space, extracting identification information of the basic data to be deleted from the cache operation instruction, and deleting the basic data from the memory space according to the identification information.
If the cache operation instruction is used for modifying the basic data in the memory space, extracting the modified basic data and the identification information of the basic data to be deleted from the cache operation instruction, deleting the basic data from the memory space according to the identification information, and caching the modified basic data in the memory space.
S305, the intermediate server receives the query operation request sent by the user server.
S306, the intermediate server reads the basic data from the memory space of the intermediate server according to the query operation request.
S307, the intermediate server sends basic data to the user server.
S305 to S307 have already been described in detail in the above embodiments, and are not described herein again.
The scheme is compared with a Redis server cluster deployment mode. The Redis server cluster passively solves the problem of consistency of data cached in a database server and the Redis server cluster through a policy of eliminating caching keywords. Due to the adoption of a passive mode, the problems of cache breakdown or cache avalanche and the like are easily caused, and the basic data query is paralyzed. In the application, after the user server sends the database operation instruction to the database server, the cache operation instruction is also generated, so that the data in the database server is highly consistent with the data in the intermediate server.
In the above embodiment, when the user updates the basic data in the database server through the user client, the user server sends the cache operation instruction to the intermediate server, so that the intermediate server caches the basic data to the memory in time, and the consistency of the data in the intermediate server and the database server is ensured.
As shown in fig. 4, another embodiment of the present application provides a data processing method, where the data processing method is applied to the data processing system, and the method specifically includes the following steps:
s401, the user server sends a database operation instruction to the database server.
S402, the database server operates the basic data in the storage space according to the database operation instruction.
S401 and S402 have already been described in detail in the above embodiments, and are not described again here.
S403, the intermediate server obtains a cache operation instruction for operating the basic data.
The user server receives a modification operation request, a deletion operation request or a new operation request sent by the client, and generates a cache operation instruction according to the modification operation request, the deletion operation request or the new operation request. The user server sends a cache operation instruction to the intermediate server through a Remote Procedure Call (RPC).
And S404, operating the basic data in the memory space of the intermediate server according to the cache operation instruction.
S405, if the operation of the operation basic data fails, the intermediate server sends an operation failure message to the user server.
And after the intermediate server operates the basic data according to the cache operation instruction, returning a data storage result to the user server. And if the operation is successful, returning an operation success message. And if the operation fails, returning an operation failure message.
S406, if receiving the operation failure message sent by the intermediate server, the user server sends a cache operation message to the message server.
When the user server receives the operation failure message, it indicates that the intermediate server has not successfully operated the basic data, for example: and adding basic data, deleting the basic data or modifying the basic data, generating a cache operation message by the user server, and issuing the cache operation message to the message server.
S407, the intermediate server receives the caching operation message from the message server.
Wherein the intermediate server polls the read message from the message server to determine whether a cache operation message is received.
And S408, the intermediate server processes the basic data in the memory space according to the cache operation message.
In the technical scheme, when basic data in the database server needs to be operated, a cache operation instruction is initiated to the intermediate server by the user server, the intermediate server caches the basic data in the memory space according to the cache operation instruction, if the intermediate server cannot successfully respond to the cache operation instruction, the user server issues a cache operation message to the message server, the intermediate server polls the cache operation message from the message server, and continues to operate the basic data in the memory space, so as to ensure the consistency of the basic data.
As shown in fig. 5, another embodiment of the present application provides a data processing apparatus 500, where the apparatus includes:
a first receiving module 501, configured to receive an inquiry operation request sent by a user server, where the inquiry operation request is used to inquire basic data;
a processing module 502, configured to read basic data from a memory space of the intermediate server according to the query operation request, and send the basic data to the user server;
the basic data are permanently stored in the database server, the basic data are cached in the memory space of the intermediate server, and the size of the memory space of the intermediate server is determined according to the data volume of the basic data.
Optionally, the processing module 502 is further configured to:
obtaining a cache operation instruction for operating basic data;
and operating the basic data in the memory space of the intermediate server according to the cache operation instruction.
Optionally, the processing module 502 is specifically configured to:
and receiving a cache operation instruction sent by the user server.
Optionally, the processing module 502 is further configured to:
and when operation failure occurs in the operation basic data, sending an operation failure message to the user server so that the user server sends a cache operation message to the message server.
Optionally, the processing module 502 is further configured to:
and operating the basic data in the memory space of the intermediate server according to the cache operation message.
Optionally, the processing module 502 is specifically configured to:
when the intermediate server is powered on, generating a cache operation instruction;
reading all basic data from the database server according to the cache operation instruction;
the base data is cached in the memory space.
As shown in fig. 6, another embodiment of the present application provides a data processing apparatus 600, where the apparatus 600 includes:
a second sending module 601, configured to send a query operation request to the intermediate server, where the query operation request is used to query basic data, so that the intermediate server reads the basic data from a memory space of the intermediate server according to the query operation request, the basic data is permanently stored in the database server, and the basic data is cached in the memory space of the intermediate server, and the size of the memory space of the intermediate server is determined according to the basic database;
a second receiving module 602, configured to receive the basic data sent by the intermediate server.
Optionally, the second sending module 601 is further configured to:
and sending a cache operation instruction to the intermediate server so that the intermediate server operates the basic data in the memory space according to the cache operation instruction.
Optionally, the second sending module 601 is further configured to:
and if receiving an operation failure message sent by the intermediate server, sending a cache operation message to the message server so as to enable the intermediate server to operate the basic data in the memory space.
Optionally, the second sending module 601 is further configured to:
and sending a database operation instruction to the database server, wherein the database operation instruction comprises basic data to be operated so that the database server operates the basic data.
As shown in fig. 7, another embodiment of the present application provides a server 700, where the server is an intermediate server or a user server, and the server 700 includes: a transmitter 701, a receiver 702, a memory 703, and a processor 704.
The transmitter 701 is configured to transmit instructions and data, the receiver 702 is configured to receive instructions and data, the memory 703 is configured to store computer-executable instructions, and the processor 704 is configured to execute the computer-executable instructions stored in the memory, so as to implement the steps performed by the data processing method in the foregoing embodiments. Reference may be made specifically to the relevant description in the foregoing data processing method embodiments.
Alternatively, the memory 703 may be separate or integrated with the processor 704. When the memory 703 is provided separately, the processing device further includes a bus for connecting the memory 703 and the processor 704.
The embodiment of the present application further provides a computer-readable storage medium, in which computer-executable instructions are stored, and when the processor executes the computer-executable instructions, the data processing method executed by the processing device is implemented.
Embodiments of the present application further provide a computer program product, which includes instructions that, when executed by a processor, implement the data processing method executed by the processing device.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Claims (15)
1. A data processing method applied to an intermediate server, the method comprising:
receiving an inquiry operation request sent by a user server, wherein the inquiry operation request is used for inquiring basic data;
reading the basic data from the memory space of the intermediate server according to the query operation request, and sending the basic data to the user server;
the basic data are stored in the database server permanently, the basic data are cached in the memory space of the intermediate server, and the size of the memory space of the intermediate server is determined according to the data volume of the basic data.
2. The method of claim 1, wherein before reading the base data from the memory space of the intermediate server according to the query operation request, the method further comprises:
obtaining a cache operation instruction for operating the basic data;
and operating the basic data in the memory space of the intermediate server according to the cache operation instruction.
3. The method of claim 2, wherein obtaining the cache operation instruction for operating the basic data specifically comprises:
and receiving the cache operation instruction sent by the user server.
4. The method of claim 3, further comprising:
and when the basic data is operated and operation fails, sending an operation failure message to the user server so that the user server sends a cache operation message to a message server.
5. The method of claim 4, further comprising:
and operating the basic data in the memory space of the intermediate server according to the cache operation message.
6. The method of claim 2, wherein obtaining the cache operation instruction for operating the basic data specifically comprises:
when the intermediate server is powered on, generating the cache operation instruction;
correspondingly, the operating the basic data in the memory space of the intermediate server according to the cache operation instruction specifically includes:
reading all basic data from a database server according to the cache operation instruction;
and caching the basic data in the memory space.
7. A data processing method is applied to a user server, and the method comprises the following steps:
sending a query operation request to an intermediate server, wherein the query operation request is used for querying basic data so that the intermediate server reads the basic data from a memory space of the intermediate server according to the query operation request, the basic data is permanently stored in a database server, the basic data is cached in the memory space of the intermediate server, and the size of the memory space of the intermediate server is determined according to the basic database;
and receiving the basic data sent by the intermediate server.
8. The method of claim 7, further comprising:
and sending a cache operation instruction to the intermediate server so that the intermediate server operates the basic data in the memory space according to the cache operation instruction.
9. The method of claim 8, further comprising:
and if receiving an operation failure message sent by the intermediate server, sending a cache operation message to a message server so that the intermediate server operates the basic data in the memory space.
10. The method of claim 7, further comprising:
sending a database operation instruction to a database server, wherein the database operation instruction comprises basic data to be operated so that the database server operates the basic data.
11. An intermediary server, comprising: a memory, a processor;
a memory; a memory for storing the processor-executable instructions;
wherein the processor is configured as a data processing method as claimed in any one of claims 1 to 6.
12. A user server, comprising: a memory, a processor;
a memory; a memory for storing the processor-executable instructions;
wherein the processor is configured as a data processing method as claimed in any one of claims 7 to 10.
13. A data processing system, comprising: an intermediate server as claimed in claim 12, a user server as claimed in claim 12, a database server and a message server.
14. A computer-readable storage medium, having stored thereon computer-executable instructions for implementing a data processing method as claimed in any one of claims 1 to 6 and as claimed in any one of claims 7 to 10 when executed by a processor.
15. A computer program product, characterized in that it comprises a computer program which, when executed by a processor, implements the data processing method of any one of claims 1 to 6 and of any one of claims 7 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110363237.6A CN113779326A (en) | 2021-04-02 | 2021-04-02 | Data processing method, device, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110363237.6A CN113779326A (en) | 2021-04-02 | 2021-04-02 | Data processing method, device, system and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113779326A true CN113779326A (en) | 2021-12-10 |
Family
ID=78835631
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110363237.6A Pending CN113779326A (en) | 2021-04-02 | 2021-04-02 | Data processing method, device, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113779326A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116248762A (en) * | 2022-12-02 | 2023-06-09 | 中山市可讯科技有限公司 | Cache system and method based on unstable request |
-
2021
- 2021-04-02 CN CN202110363237.6A patent/CN113779326A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116248762A (en) * | 2022-12-02 | 2023-06-09 | 中山市可讯科技有限公司 | Cache system and method based on unstable request |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107943594B (en) | Data acquisition method and device | |
| CN110324177B (en) | Service request processing method, system and medium under micro-service architecture | |
| CN101090401B (en) | Data buffer store method and system at duster environment | |
| CN111464615B (en) | Request processing method, device, server and storage medium | |
| US8788458B2 (en) | Data caching for mobile applications | |
| CN111309785B (en) | Database access method and device based on Spring framework, computer equipment and medium | |
| CN102682037A (en) | Data acquisition method, system and device | |
| CN111291079A (en) | Data query method and device | |
| CN104731516A (en) | Method and device for accessing files and distributed storage system | |
| CN111221469B (en) | Method, device and system for synchronizing cache data | |
| CN110719187B (en) | Configuration management method, system and computer readable storage medium | |
| CN109167840B (en) | Task pushing method, node autonomous server and edge cache server | |
| CN102411598A (en) | Method and system for realizing data consistency | |
| CN105335170A (en) | Distributed system and incremental data updating method | |
| CN105159845A (en) | Memory reading method | |
| US10649964B2 (en) | Incorporating external data into a database schema | |
| CN105095313A (en) | Data access method and equipment | |
| CN103607424A (en) | Server connection method and server system | |
| CN109254981B (en) | Data management method and device of distributed cache system | |
| CN111582824B (en) | Cloud resource synchronization method, device, equipment and storage medium | |
| CN113779326A (en) | Data processing method, device, system and storage medium | |
| CN111125170A (en) | Cross-service data acquisition method and device of micro-service and micro-service equipment | |
| JP4019817B2 (en) | Distributed object control method and its implementation system | |
| CN109165078B (en) | Virtual distributed server and access method thereof | |
| CN113051271A (en) | Cold and hot data separation method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |