CN111221826A - Method, system, device and medium for processing shared cache synchronization message - Google Patents
Method, system, device and medium for processing shared cache synchronization message Download PDFInfo
- Publication number
- CN111221826A CN111221826A CN202010007564.3A CN202010007564A CN111221826A CN 111221826 A CN111221826 A CN 111221826A CN 202010007564 A CN202010007564 A CN 202010007564A CN 111221826 A CN111221826 A CN 111221826A
- Authority
- CN
- China
- Prior art keywords
- cache
- synchronization message
- write
- shared
- shared cache
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 238000012545 processing Methods 0.000 title claims abstract description 34
- 230000004044 response Effects 0.000 claims abstract description 16
- 230000008569 process Effects 0.000 claims description 24
- 238000004590 computer program Methods 0.000 claims description 9
- 230000000977 initiatory effect Effects 0.000 claims description 9
- 230000001360 synchronised effect Effects 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
The invention discloses a method, a system, equipment and a storage medium for processing shared cache synchronization messages, wherein the method comprises the following steps: creating a basic local cache and a basic external cache index; in response to receiving the shared cache synchronization message, judging whether the read-write identification of the shared cache synchronization message is write; responding to the read-write identification of the shared cache synchronization message as write, and judging whether the basic local cache has the cache of the object corresponding to the shared cache synchronization message; and in response to the cache of the object corresponding to the shared cache synchronization message existing in the basic local cache, deleting the corresponding cache in the basic local cache, and adding the external cache index of the object into the basic external cache index. The method, the system, the equipment and the medium for processing the shared cache synchronous message realize the shared data cache by utilizing the memory of the client, fully utilize the memory resources of a storage service network and a high-performance client, and reduce the delay when the cluster shares and accesses the data.
Description
Technical Field
The present invention relates to the field of parallel storage, and more particularly, to a method, system, computer device, and readable medium for processing a shared cache synchronization message.
Background
A parallel storage system refers to a storage system that can provide a capability for a plurality of clients to concurrently access a storage object. The concurrent access requirement is widely applied in scenarios such as HPC (High Performance Computing) and MPI (Message passing interface). High performance computing requires that multiple compute nodes can process a batch of data simultaneously, requiring read and write operations on the same object. Message delivery delivers data over a shared medium, and message producers and consumers also need concurrent access to the same object entity. Object synchronization in a parallel storage system is needed, and in the prior art, processing of shared cache synchronization messages not only needs to solve the problem of data consistency, but also needs to improve concurrency to the maximum extent, and has extremely high design requirements on a lock mechanism and a cache mechanism, so that the processing is often complex.
Disclosure of Invention
In view of this, an object of the embodiments of the present invention is to provide a method, a system, a computer device, and a computer-readable storage medium for processing a shared cache synchronization message, which implement a shared data cache by using a client memory, fully utilize memory resources of a storage service network and a high-performance client, and reduce a delay when a cluster shares access data.
Based on the above object, an aspect of the embodiments of the present invention provides a method for processing a shared cache synchronization message, including the following steps: creating a basic local cache and a basic external cache index; in response to receiving a shared cache synchronization message, judging whether a read-write identifier of the shared cache synchronization message is written; responding to the read-write identification of the shared cache synchronization message as write, and judging whether the basic local cache has the cache of the object corresponding to the shared cache synchronization message; and responding to the cache of the object corresponding to the shared cache synchronization message in the basic local cache, deleting the corresponding cache in the basic local cache, and adding the external cache index of the object into the basic external cache index.
In some embodiments, further comprising: and in response to that the read-write identification of the shared cache synchronization message is not write, adding the external cache index of the object corresponding to the shared cache synchronization message into the basic external cache index.
In some embodiments, further comprising: the shared cache synchronization message is sent based on a read operation or a write operation.
In some embodiments, the sending the shared cache synchronization message based on the read operation includes: responding to an application process to access an object, and judging whether the object exists in the local cache and/or the external cache index; and responding to the condition that the object does not exist in the local cache and/or the external cache index, initiating a read request to a parallel storage cluster, writing return data into the local cache, and sending a shared cache synchronization message to other client nodes.
In some embodiments, the sending the shared cache synchronization message based on the write operation includes: responding to an application process access object, acquiring a write lock of the object from a storage cluster, and judging whether the object exists in the local cache or not; responding to the condition that the object does not exist in the local cache, creating the local cache of the object, and sending a shared cache synchronization message to other client nodes; and releasing the write lock, and returning operation success to the application process.
In another aspect of the embodiments of the present invention, a system for processing a shared cache synchronization message is further provided, including: a creation module configured to create a base local cache and a base external cache index; the first judgment module is configured to respond to the received shared cache synchronization message and judge whether the read-write identifier of the shared cache synchronization message is write; a second judgment module, configured to, in response to that the read-write identifier of the shared cache synchronization message is write, judge whether a cache of an object corresponding to the shared cache synchronization message exists in the basic local cache; and the processing module is configured to respond to the cache of the object corresponding to the shared cache synchronization message in the basic local cache, delete the corresponding cache in the basic local cache, and add the external cache index of the object to the basic external cache index.
In some embodiments, the processing module is further configured to: and in response to that the read-write identification of the shared cache synchronization message is not write, adding the external cache index of the object corresponding to the shared cache synchronization message into the basic external cache index.
In some embodiments, further comprising: a synchronization module configured to send a shared cache synchronization message based on a read operation or a write operation.
In another aspect of the embodiments of the present invention, there is also provided a computer device, including: at least one processor; and a memory storing computer instructions executable on the processor, the instructions when executed by the processor implementing the steps of the method as above.
In a further aspect of the embodiments of the present invention, a computer-readable storage medium is also provided, in which a computer program for implementing the above method steps is stored when the computer program is executed by a processor.
The invention has the following beneficial technical effects: by utilizing the memory of the client to realize the cache of the shared data, the memory resources of the storage service network and the high-performance client are fully utilized, and the delay of the cluster in sharing the access data is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.
Fig. 1 is a schematic diagram of an embodiment of a method for processing a shared cache synchronization message according to the present invention;
fig. 2 is a schematic diagram of a hardware structure of an embodiment of a method for processing a shared cache synchronization message according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
In view of the foregoing, a first aspect of the embodiments of the present invention provides an embodiment of a method for processing a shared cache synchronization message. Fig. 1 is a schematic diagram illustrating an embodiment of a method for processing a shared cache synchronization message according to the present invention. As shown in fig. 1, the embodiment of the present invention includes the following steps:
s1, creating a basic local cache and a basic external cache index;
s2, responding to the received shared cache synchronization message, and judging whether the read-write identification of the shared cache synchronization message is write;
s3, responding to the read-write identification of the shared cache synchronization message as write, and judging whether the basic local cache has the cache of the object corresponding to the shared cache synchronization message; and
s4, responding to the cache of the object corresponding to the shared cache synchronization message in the basic local cache, deleting the corresponding cache in the basic local cache, and adding the external cache index of the object into the basic external cache index.
In a network environment, when a node accesses data of other nodes, the two nodes are generally required to transmit the data through a network protocol, such as a TCP/IP protocol. The nodes need to install a network protocol software module, and data needs to pass through network protocol stacks of the nodes of both sides when being transmitted. Remote Direct Memory Access (RDMA) enables data to be transferred between two nodes directly by a network interface device (e.g., a network card) without passing through a network protocol. The pressure of a processor and the pressure of memory resources of the node are greatly reduced, and the system overhead of network communication on the node is reduced.
The parallel storage system in the embodiment of the invention consists of a storage cluster (consisting of a plurality of storage nodes) and client software. The client software consists of the following modules: an IO request service interface, a local cache, an external cache index, and a cache synchronization interface. And a global and virtual shared cache is formed by the caches distributed on the application servers through client software. The storage node is a storage server having a function of storing the object data. Meanwhile, the storage node is provided with a network interface card with RDMA function, so that high-speed access to memory data of an external node is realized. And a parallel storage operating system is operated on the storage nodes, and the whole storage cluster provides an object storage service to the outside. The parallel storage system in the embodiment of the invention fully utilizes a network architecture with RDMA function on the network networking. The application server and the storage node have RDMA functions and can provide low-delay network service for the shared cache mechanism.
A base local cache and a base external cache index are created. When a local application accesses an object, a cache of the object data is created locally. The cache component is provided with parameters, and the length of a cache region, the number of objects capable of being cached and the percentage of occupied system memory can be configured. The object cache format in the cache region is a tuple: < object ID, cache status identification, cache start address >. The identification bit defined by the cache state identification is Dirty, and the others are temporarily reserved. When the external node sends the object cache synchronization information, the local node creates an external cache index according to the synchronization information. Each element in the cache index table is a tuple: < object ID, cache status identification, cache affiliated client host ID >. The identification bit defined by the cache state identification is Dirty, and the others are temporarily reserved. For ease of distinction, the most primitive local cache and external cache index are referred to as the base local cache and base external cache index.
And responding to the received shared cache synchronization message, and judging whether the read-write identification of the shared cache synchronization message is write. The shared cache synchronization message is a tuple: < object ID, read-write identification, client host ID of sending message >. And (4) a read-write identifier exists in the shared cache synchronization message, and whether the read-write identifier is a write is judged.
And responding to the read-write identifier of the shared cache synchronization message as write, and judging whether the cache of the object corresponding to the shared cache synchronization message exists in the basic local cache. And in response to the cache of the object corresponding to the shared cache synchronization message existing in the basic local cache, deleting the corresponding cache in the basic local cache, and adding the external cache index of the object into the basic external cache index. If the read-write identification of the shared cache synchronization message is write, the local cache needs to be checked, and if the local cache stores the cache of the object, the cache can be set to be invalid, and meanwhile, the external cache index of the object is added. If the local cache does not have a cache for the object, only the external cache index for the object needs to be added.
In some embodiments, further comprising: and in response to that the read-write identification of the shared cache synchronization message is not write, adding the external cache index of the object corresponding to the shared cache synchronization message into the basic external cache index. If the read-write identifier of the shared cache synchronization message is not write, the read-write identifier of the shared cache synchronization message should be read, and the external cache index of the object may be added to update the local external cache index.
In some embodiments, further comprising: the shared cache synchronization message is sent based on a read operation or a write operation.
In some embodiments, the sending the shared cache synchronization message based on the read operation includes: responding to an application process to access an object, and judging whether the object exists in the local cache and/or the external cache index; and responding to the condition that the object does not exist in the local cache and/or the external cache index, initiating a read request to a parallel storage cluster, writing return data into the local cache, and sending a shared cache synchronization message to other client nodes.
When an application process of a client accesses an object in a reading mode, a client module firstly searches the object in a local cache, if the object is found, the object is called local cache hit, and a result in the cache is returned to the application process. And if the local cache is not hit, inquiring the external cache index, if the external cache index is found, referring to as external cache hit, and then initiating a read request to the corresponding application server client. Collectively referred to as a shared cache hit. And if the shared cache hit does not occur, the client module initiates a read request to the storage cluster. And after the storage cluster returns, writing the data into a local cache, simultaneously initiating a shared cache synchronization message, and synchronizing an external cache index to other application server clients.
In some embodiments, the sending the shared cache synchronization message based on the write operation includes: responding to an application process access object, acquiring a write lock of the object from a storage cluster, and judging whether the object exists in the local cache or not; responding to the condition that the object does not exist in the local cache, creating the local cache of the object, and sending a shared cache synchronization message to other client nodes; and releasing the write lock, and returning operation success to the application process.
When an application process of a client side has write access to an object, a write lock of the object is acquired from a storage cluster. The client module firstly searches the object in the local cache, if the object is found, the object is called local cache hit, the data submitted by the application process is written into the local cache, and the data is submitted to the storage cluster, so that data storage is completed. And simultaneously, initiating a shared cache synchronization message, and synchronizing the external cache index to other application server clients. And if the local cache is not hit, a local object cache is created, the data submitted by the application process is written into the local cache and submitted to the storage cluster, and data storage is completed. And simultaneously, initiating a shared cache synchronization message, and synchronizing the external cache index to other application server clients. And releasing the write lock, and returning the operation success to the application process.
It should be particularly noted that, the steps in the embodiments of the method for processing a shared cache synchronization message described above may be mutually intersected, replaced, added, or deleted, and therefore, these reasonable permutation and combination transformations should also belong to the scope of the present invention, and should not limit the scope of the present invention to the embodiments.
In view of the above object, a second aspect of the embodiments of the present invention provides a system for processing a shared cache synchronization message, including: a creation module configured to create a base local cache and a base external cache index; the first judgment module is configured to respond to the received shared cache synchronization message and judge whether the read-write identifier of the shared cache synchronization message is write; a second judgment module, configured to, in response to that the read-write identifier of the shared cache synchronization message is write, judge whether a cache of an object corresponding to the shared cache synchronization message exists in the basic local cache; and the processing module is configured to respond to the cache of the object corresponding to the shared cache synchronization message in the basic local cache, delete the corresponding cache in the basic local cache, and add the external cache index of the object to the basic external cache index.
In some embodiments, the processing module is further configured to: and in response to that the read-write identification of the shared cache synchronization message is not write, adding the external cache index of the object corresponding to the shared cache synchronization message into the basic external cache index.
In some embodiments, the system for processing shared cache synchronization messages further comprises: a synchronization module configured to send a shared cache synchronization message based on a read operation or a write operation.
In some embodiments, the synchronization module is further configured to: responding to an application process to access an object, and judging whether the object exists in the local cache and/or the external cache index; and responding to the condition that the object does not exist in the local cache and/or the external cache index, initiating a read request to a parallel storage cluster, writing return data into the local cache, and sending a shared cache synchronization message to other client nodes.
In some embodiments, the synchronization module is further configured to: responding to an application process access object, acquiring a write lock of the object from a storage cluster, and judging whether the object exists in the local cache or not; responding to the condition that the object does not exist in the local cache, creating the local cache of the object, and sending a shared cache synchronization message to other client nodes; and releasing the write lock, and returning operation success to the application process.
In view of the above object, a third aspect of the embodiments of the present invention provides a computer device, including: at least one processor; and a memory storing computer instructions executable on the processor, the instructions being executable by the processor to perform the steps of: s1, creating a basic local cache and a basic external cache index; s2, responding to the received shared cache synchronization message, and judging whether the read-write identification of the shared cache synchronization message is write; s3, responding to the read-write identification of the shared cache synchronization message as write, and judging whether the basic local cache has the cache of the object corresponding to the shared cache synchronization message; and S4, responding to the cache of the object corresponding to the shared cache synchronization message in the basic local cache, deleting the corresponding cache in the basic local cache, and adding the external cache index of the object into the basic external cache index.
In some embodiments, further comprising: and in response to that the read-write identification of the shared cache synchronization message is not write, adding the external cache index of the object corresponding to the shared cache synchronization message into the basic external cache index.
In some embodiments, further comprising: the shared cache synchronization message is sent based on a read operation or a write operation.
In some embodiments, the sending the shared cache synchronization message based on the read operation includes: responding to an application process to access an object, and judging whether the object exists in the local cache and/or the external cache index; and responding to the condition that the object does not exist in the local cache and/or the external cache index, initiating a read request to a parallel storage cluster, writing return data into the local cache, and sending a shared cache synchronization message to other client nodes.
In some embodiments, the sending the shared cache synchronization message based on the write operation includes: responding to an application process access object, acquiring a write lock of the object from a storage cluster, and judging whether the object exists in the local cache or not; responding to the condition that the object does not exist in the local cache, creating the local cache of the object, and sending a shared cache synchronization message to other client nodes; and releasing the write lock, and returning operation success to the application process.
Fig. 2 is a schematic hardware structure diagram of an embodiment of the method for processing a shared cache synchronization message according to the present invention.
Taking the apparatus shown in fig. 2 as an example, the apparatus includes a processor 301 and a memory 302, and may further include: an input device 303 and an output device 304.
The processor 301, the memory 302, the input device 303 and the output device 304 may be connected by a bus or other means, and fig. 2 illustrates the connection by a bus as an example.
The memory 302, which is a non-volatile computer-readable storage medium, may be used for storing non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules corresponding to the method for processing shared cache synchronization messages in the embodiments of the present application. The processor 301 executes various functional applications of the server and data processing by running nonvolatile software programs, instructions and modules stored in the memory 302, that is, implements the method of processing shared cache synchronization messages of the above-described method embodiments.
The memory 302 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of a method of processing the shared cache synchronization message, and the like. Further, the memory 302 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 302 optionally includes memory located remotely from processor 301, which may be connected to a local module via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 303 may receive information such as a user name and a password that are input. The output means 304 may comprise a display device such as a display screen.
Program instructions/modules corresponding to one or more methods of processing shared cache synchronization messages are stored in the memory 302 and, when executed by the processor 301, perform the methods of processing shared cache synchronization messages in any of the method embodiments described above.
Any embodiment of a computer device implementing the method for processing a shared cache synchronization message may achieve the same or similar effects as any corresponding embodiment of the method described above.
The invention also provides a computer readable storage medium storing a computer program which, when executed by a processor, performs the method as above.
Finally, it should be noted that, as one of ordinary skill in the art can appreciate that all or part of the processes of the methods of the above embodiments can be implemented by a computer program to instruct related hardware, and the program of the method for processing a shared cache synchronization message can be stored in a computer readable storage medium, and when executed, the program can include the processes of the embodiments of the methods described above. The storage medium of the program may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like. The embodiments of the computer program may achieve the same or similar effects as any of the above-described method embodiments.
Furthermore, the methods disclosed according to embodiments of the present invention may also be implemented as a computer program executed by a processor, which may be stored in a computer-readable storage medium. Which when executed by a processor performs the above-described functions defined in the methods disclosed in embodiments of the invention.
Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage medium for storing a computer program for causing the controller to implement the functions of the above steps or elements.
Further, it should be appreciated that the computer-readable storage media (e.g., memory) herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in a variety of forms such as synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.
The various illustrative logical blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed with the following components designed to perform the functions herein: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP, and/or any other such configuration.
The steps of a method or algorithm described in connection with the disclosure herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.
In one or more exemplary designs, the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (10)
1. A method of processing a shared cache synchronization message, comprising the steps of:
creating a basic local cache and a basic external cache index;
in response to receiving a shared cache synchronization message, judging whether a read-write identifier of the shared cache synchronization message is written;
responding to the read-write identification of the shared cache synchronization message as write, and judging whether the basic local cache has the cache of the object corresponding to the shared cache synchronization message; and
and in response to the cache of the object corresponding to the shared cache synchronization message existing in the basic local cache, deleting the corresponding cache in the basic local cache, and adding the external cache index of the object into the basic external cache index.
2. The method of claim 1, further comprising:
and in response to that the read-write identification of the shared cache synchronization message is not write, adding the external cache index of the object corresponding to the shared cache synchronization message into the basic external cache index.
3. The method of claim 1, further comprising:
the shared cache synchronization message is sent based on a read operation or a write operation.
4. The method of claim 3, wherein sending the shared cache synchronization message based on the read operation comprises:
responding to an application process to access an object, and judging whether the object exists in the local cache and/or the external cache index; and
and responding to the condition that the object does not exist in the local cache and/or the external cache index, initiating a read request to a parallel storage cluster, writing return data into the local cache, and sending a shared cache synchronization message to other client nodes.
5. The method of claim 3, wherein sending the shared cache synchronization message based on the write operation comprises:
responding to an application process access object, acquiring a write lock of the object from a storage cluster, and judging whether the object exists in the local cache or not;
responding to the condition that the object does not exist in the local cache, creating the local cache of the object, and sending a shared cache synchronization message to other client nodes; and
and releasing the write lock, and returning operation success to the application process.
6. A system for processing shared cache synchronization messages, comprising:
a creation module configured to create a base local cache and a base external cache index;
the first judgment module is configured to respond to the received shared cache synchronization message and judge whether the read-write identifier of the shared cache synchronization message is write;
a second judgment module, configured to, in response to that the read-write identifier of the shared cache synchronization message is write, judge whether a cache of an object corresponding to the shared cache synchronization message exists in the basic local cache; and
and the processing module is configured to respond to the cache of the object corresponding to the shared cache synchronization message in the basic local cache, delete the corresponding cache in the basic local cache, and add the external cache index of the object into the basic external cache index.
7. The system of claim 6, wherein the processing module is further configured to:
and in response to that the read-write identification of the shared cache synchronization message is not write, adding the external cache index of the object corresponding to the shared cache synchronization message into the basic external cache index.
8. The system of claim 6, further comprising:
a synchronization module configured to send a shared cache synchronization message based on a read operation or a write operation.
9. A computer device, comprising:
at least one processor; and
a memory storing computer instructions executable on the processor, the instructions when executed by the processor implementing the steps of the method of any one of claims 1 to 5.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010007564.3A CN111221826A (en) | 2020-01-04 | 2020-01-04 | Method, system, device and medium for processing shared cache synchronization message |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010007564.3A CN111221826A (en) | 2020-01-04 | 2020-01-04 | Method, system, device and medium for processing shared cache synchronization message |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111221826A true CN111221826A (en) | 2020-06-02 |
Family
ID=70832251
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010007564.3A Withdrawn CN111221826A (en) | 2020-01-04 | 2020-01-04 | Method, system, device and medium for processing shared cache synchronization message |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111221826A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111722927A (en) * | 2020-06-12 | 2020-09-29 | 苏州浪潮智能科技有限公司 | Data cache management method, system, device and medium |
| CN112181295A (en) * | 2020-09-22 | 2021-01-05 | 杭州宏杉科技股份有限公司 | Data access method and device, storage equipment and machine-readable storage medium |
| CN116107771A (en) * | 2022-12-13 | 2023-05-12 | 成都海光集成电路设计有限公司 | Cache state recording method, data access method, related device and equipment |
-
2020
- 2020-01-04 CN CN202010007564.3A patent/CN111221826A/en not_active Withdrawn
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111722927A (en) * | 2020-06-12 | 2020-09-29 | 苏州浪潮智能科技有限公司 | Data cache management method, system, device and medium |
| CN111722927B (en) * | 2020-06-12 | 2022-12-06 | 苏州浪潮智能科技有限公司 | Data cache management method, system, device and medium |
| CN112181295A (en) * | 2020-09-22 | 2021-01-05 | 杭州宏杉科技股份有限公司 | Data access method and device, storage equipment and machine-readable storage medium |
| CN112181295B (en) * | 2020-09-22 | 2022-02-18 | 杭州宏杉科技股份有限公司 | Data access method and device, storage equipment and machine-readable storage medium |
| CN116107771A (en) * | 2022-12-13 | 2023-05-12 | 成都海光集成电路设计有限公司 | Cache state recording method, data access method, related device and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111221826A (en) | Method, system, device and medium for processing shared cache synchronization message | |
| US20160277497A1 (en) | Facilitating access to remote cloud services | |
| WO2021128903A1 (en) | Method and system for accelerating reading of information of field replace unit, device and medium | |
| CN110519329B (en) | Method, device and readable medium for concurrently processing samba protocol request | |
| US7801883B2 (en) | Method and apparatus for improving data processing speed through storage of record information of identity module | |
| CN111352586B (en) | Directory aggregation method, device, equipment and medium for accelerating file reading and writing | |
| WO2021073156A1 (en) | Short link generation method, server, storage medium and computer device | |
| CN105426321A (en) | RDMA friendly caching method using remote position information | |
| WO2022007470A1 (en) | Data transmission method, chip, and device | |
| CN111708744B (en) | Method, system, device and medium for maintaining file lock based on stateless protocol | |
| WO2018041074A1 (en) | Method, apparatus, and system for accessing memory device | |
| CN106331153A (en) | Service request filtering method, service request filtering device and service request filtering system | |
| CN111104232A (en) | Method, device and medium for accelerating message writing of message queue | |
| CN111708834A (en) | Method, system, equipment and medium for synchronizing service configuration data | |
| US20230102617A1 (en) | Repeat transaction verification method, apparatus, and device, and medium | |
| WO2023056797A1 (en) | Blockchain-based data processing method, apparatus, and device, and storage medium | |
| CN111737201B (en) | Method for closing opened file, computer equipment and storage medium | |
| WO2007135627A2 (en) | Mobile phone used within a client-server system | |
| US10545667B1 (en) | Dynamic data partitioning for stateless request routing | |
| CN111045604B (en) | Small file read-write acceleration method and device based on NVRAM | |
| US11750716B2 (en) | Methods for publishing resource, and gateway | |
| CN109240621B (en) | Nonvolatile internal memory management method and device | |
| CN110417579B (en) | Method, equipment and readable medium for managing gigabit network by using gigabit network card | |
| CN111723140A (en) | Method, device and equipment for user to access storage and readable medium | |
| CN113742050B (en) | Method, device, computing equipment and storage medium for operating data object |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200602 |
|
| WW01 | Invention patent application withdrawn after publication |