CN110515774A - Generation method, device, electronic equipment and the storage medium of memory image - Google Patents
Generation method, device, electronic equipment and the storage medium of memory image Download PDFInfo
- Publication number
- CN110515774A CN110515774A CN201910807113.5A CN201910807113A CN110515774A CN 110515774 A CN110515774 A CN 110515774A CN 201910807113 A CN201910807113 A CN 201910807113A CN 110515774 A CN110515774 A CN 110515774A
- Authority
- CN
- China
- Prior art keywords
- memory image
- key
- snapshot document
- file
- delta file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/174—Redundancy elimination performed by the file system
- G06F16/1748—De-duplication implemented within the file system, e.g. based on file segments
- G06F16/1756—De-duplication implemented within the file system, e.g. based on file segments based on delta files
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application discloses the generation method of memory image, device, electronic equipment and storage mediums, are related to memory storage technical field.Specific implementation are as follows: when system starts, create the first subprocess；In the case where memory image generating process is triggered, the first subprocess of Xiang Suoshu, which is sent, merges compression duty, and the compression duty that merges includes the filename of the first snapshot document and the filename of delta file；Wherein, first snapshot document is used to record the memory image that the first snapshot document generates the moment, and the delta file is used to record the operational order for generating moment to current time from first snapshot document；Receive the implementing result for merging compression duty.The embodiment of the present application can be improved system availability, and reduce memory usage amount.
Description
Technical field
This application involves a kind of field of computer technology more particularly to a kind of memory storage technical fields.
Background technique
Redis is a high performance key-value pair (Key-Value) memory storage system, supports plurality of data structures, interior
Master-slave synchronisation function between deposit data persistence and node, is widely used.Redis completes internal storage data persistence and master-slave synchronisation
Steps necessary be generate memory image.The mode for generating Redis memory image at present is: calling bifurcated function by system
(fork function) generates subprocess by fork function, which completely contains all memories of this moment host process
This partial memory data is saved in hard disk by data, subprocess again, realizes the persistence of internal storage data.This mode simply has
Effect, host process can produce memory image without operation bidirectional, but there are problems that 2: system availability declines, memory usage amount
It is significantly greatly increased.Concrete reason is: first, fork function call are originally that the system function an of lightweight calls, but works as in process
It deposits bigger, calls time-consuming longer, system availability is caused to decline.The subprocess itself that second, fork function generate will not disappear
A large amount of memories are consumed, but host process handles always user and requests that internal storage data is caused to change, and triggers copy-on-write, so that consumption is big
Measure memory；Generally for guaranteeing successfully to generate memory image, need a part of memory of Redundant binary number, extreme case can redundancy with
The memory of Redis proceeding internal memory same size, so that the memory cost doubled, causes memory usage amount to be significantly greatly increased.
Summary of the invention
In a first aspect, the embodiment of the present application proposes a kind of generation method of memory image, comprising:
When system starts, the first subprocess is created；
In the case where memory image generating process is triggered, the first subprocess of Xiang Suoshu, which is sent, merges compression duty, institute
State the filename for merging filename of the compression duty comprising the first snapshot document and delta file；Wherein, the first snapshot text
Part is used to record the memory image that the first snapshot document generates the moment, and the delta file is for recording from the first snapshot text
The operational order at part generation moment to current time；
Receive the implementing result for merging compression duty.
In one embodiment, first snapshot document is Redis database file, and the delta file is to carry out
The file of additional operation.
In one embodiment, in the case where the memory image generating process is triggered, further includes:
The filename of the delta file and the first mapping relations of memory image information are recorded, and records the increment text
The filename of part；The memory image information includes the relevant information that the memory image generating process is triggered.
In one embodiment, after the implementing result for receiving merging compression duty, further includes:
The first mapping relations according to the filename lookup of the corresponding delta file of the implementing result, obtain the increasing
Measure the corresponding memory image information of filename of file；
Respective operations are executed according to the memory image information.
In one embodiment, the condition that the memory image generating process is triggered includes at least one of the following:
It receives from external triggering command；
From node triggering when carrying out master-slave synchronisation；
The data volume of the delta file reaches predefined size.
In one embodiment, the merging compression duty also includes leader follower replication information.
In one embodiment, further includes:
In the case where the implementing result is correct compression, the delta file is deleted, new delta file, institute are generated
New delta file is stated for recording the operational order after the current time.
Second aspect, the embodiment of the present application propose a kind of generation method of memory image, comprising:
First subprocess receive merge compression duty, it is described merge compression duty include the first snapshot document filename and
The filename of delta file；Wherein, first subprocess is created when system starts；First snapshot document is for remembering
The memory image that the first snapshot document generates the moment is recorded, when the delta file is generated for recording from first snapshot document
It carves to the operational order at current time；
The merging compression duty is executed, compression is merged to first snapshot document and delta file, is used
In the second snapshot document of the memory image at record current time；
Send the implementing result for merging compression duty.
In one embodiment, first snapshot document or the second snapshot document are Redis database file, described
Delta file is the file for carrying out additional operation.
It is in one embodiment, described to execute the merging compression duty, comprising:
The operational order recorded in the delta file is loaded, and by the operational order using the key in key-value pair as dimension
Sequentially store；
Read the key-value pair in the snapshot document；
For each key-value pair, the corresponding operational order of key in the key-value pair is executed, the newest number of the key is obtained
According to state, the key-value pair is updated according to the latest data state, and delete the key-value pair in memory；
Updated key-value pair is saved into second snapshot document.
It is in one embodiment, described to execute the merging compression duty, further includes:
Remaining operational order in the delta file is executed, the implementing result is saved into the second snapshot text
Part.
It is in one embodiment, described to execute the merging compression duty, further includes:
In the case that key in the key-value pair does not have corresponding operational order, the key-value pair is saved into described
Two snapshot documents.
In one embodiment, merging compression duty also includes leader follower replication information；
The method also includes: the leader follower replication information preservation is entered into second snapshot document.
The third aspect, the embodiment of the present application propose a kind of generating means of memory image, comprising:
Creation module, for creating the first subprocess when system starts；
Task sending module, in the case where memory image generating process is triggered, the first subprocess of Xiang Suoshu to be sent out
Merging compression duty is sent, the compression duty that merges includes the filename of the first snapshot document and the filename of delta file；Its
In, first snapshot document is used to record the memory image that the first snapshot document generates the moment, and the delta file is for remembering
Record the operational order that moment to current time is generated from first snapshot document；
As a result receiving module, for receiving the implementing result for merging compression duty.
In one embodiment, further includes:
Logging modle, for recording the delta file in the case where the memory image generating process is triggered
First mapping relations of filename and memory image information, and record the filename of the delta file；The memory image letter
Breath includes the relevant information that the memory image generating process is triggered.
In one embodiment, described device further include:
Searching module is closed for the first mapping according to the filename lookup of the corresponding delta file of the implementing result
System, obtains the corresponding memory image information of filename of the delta file；
Operation executing module, for executing respective operations according to the memory image information.
In one embodiment, the condition that the memory image generating process is triggered includes at least one of the following:
It receives from external triggering command；
From node triggering when carrying out master-slave synchronisation；
The data volume of the delta file reaches predefined size.
Fourth aspect, the embodiment of the present application propose a kind of generating means of memory image, comprising:
Task receiving module merges compression duty for receiving using the first subprocess, and the merging compression duty includes
The filename of first snapshot document and the filename of delta file；Wherein, first subprocess is created when system starts；
First snapshot document be used for record the first snapshot document generate the moment memory image, the delta file for record from
First snapshot document generates the operational order at moment to current time；
Task execution module, for executing the merging compression duty using the first subprocess, to the first snapshot text
Part and delta file merge compression, obtain the second snapshot document of the memory image for recording current time；
As a result sending module, for sending the implementing result for merging compression duty using the first subprocess.
In one embodiment, the task execution module is used for, and is loaded the operation recorded in the delta file and is referred to
It enables, and the operational order is sequentially stored using the key in key-value pair as dimension；Read the key-value pair in the snapshot document；Needle
To each key-value pair, the corresponding operational order of key in the key-value pair is executed, the latest data state of the key is obtained, according to
The latest data state updates the key-value pair, and deletes the corresponding operational order of the key；Updated key-value pair is protected
It is stored in second snapshot document.
In one embodiment, the task execution module is also used to, and executes remaining operation in the delta file
Instruction, is saved into second snapshot document for the implementing result.
In one embodiment, the task execution module is also used to, and the key in the key-value pair is not corresponding
In the case where operational order, the key-value pair is saved into second snapshot document.
One embodiment in above-mentioned application has the following advantages that or the utility model has the advantages that is used for due to creating when system starts
The first subprocess for merging the first snapshot document and delta file makes the first subprocess not include the data of host process, this is different
In in the prior art when triggering host process and generating memory image by calling fork function to generate subprocess and by the subprocess
Memory image is generated, so that fundamentally eliminating fork calls the influence caused by system, can be improved system availability, simultaneously
Reduce memory usage amount.The embodiment of the present application use RDB file in the prior art and AOF file, by merge RDB file and
AOF file realizes memory image.In the case where memory image is triggered, host process can also be by recording AOF filename
With the mapping relations of memory image information and record AOF filename, to realize the record to memory SNAPSHOT INFO, to protect
Necessary operation can be executed according to the record after memory image is completed by demonstrate,proving.The embodiment of the present application memory image generating process quilt
The condition of triggering may include receiving external command, reaching predetermined from the data volume that node carries out master-slave synchronisation and AOF file
Size.Wherein, the first two trigger condition is implemented for data preservation and master-slave synchronisation, the last one trigger condition can be right
AOF file is cut, to promote the execution efficiency of merging squeeze operation and can save memory.AOF file is cut
Later, new AOF file can be generated, record the Redis operational order after current time (including current time).This
Outside, host process is into the merging compression duty that the first subprocess is sent, and can also include leader follower replication information, for the first son into
The leader follower replication information is written in new RDB file by journey, to meet the needs of master-slave synchronisation.
Other effects possessed by above-mentioned optional way are illustrated hereinafter in conjunction with specific embodiment.
Detailed description of the invention
Attached drawing does not constitute the restriction to the application for more fully understanding this programme.Wherein:
Fig. 1 is the generation method implementation flow chart one according to a kind of memory image of the embodiment of the present application；
Fig. 2 is the generation method implementation flow chart two according to a kind of memory image of the embodiment of the present application；
Fig. 3 is the generation method implementation flow chart three according to a kind of memory image of the embodiment of the present application；
Fig. 4 is the implementation flow chart of step S302 in the generation method according to a kind of memory image of the embodiment of the present application；
Fig. 5 is in the generation method according to a kind of memory image of the embodiment of the present application, and load and storage Redis operation refer to
The realization schematic diagram of order；
Fig. 6 is storage RDB file and increment AOF in the generation method according to a kind of memory image of the embodiment of the present application
The merging compression process implementation flow chart of file
Fig. 7 is Redis host process and Compact in the generation method according to a kind of memory image of the embodiment of the present application
The interactive process schematic diagram of subprocess；
Fig. 8 A is the method proposed using the embodiment of the present application and is illustrated using the response time comparison of existing method
Figure；
Fig. 8 B is the method proposed using the embodiment of the present application and is illustrated using the reserved memory size comparison of existing method
Figure；
Fig. 9 is the generating means structural schematic diagram one according to a kind of memory image of the embodiment of the present application；
Figure 10 is the generating means structural schematic diagram two according to a kind of memory image of the embodiment of the present application；
Figure 11 is the generating means structural schematic diagram three according to a kind of memory image of the embodiment of the present application；
Figure 12 is the block diagram for the electronic equipment for realizing the memory image generation method of the embodiment of the present application.
Specific embodiment
It explains below in conjunction with exemplary embodiment of the attached drawing to the application, including the various of the embodiment of the present application
Details should think them only exemplary to help understanding.Therefore, those of ordinary skill in the art should recognize
It arrives, it can be with various changes and modifications are made to the embodiments described herein, without departing from the scope and spirit of the present application.Together
Sample, for clarity and conciseness, descriptions of well-known functions and structures are omitted from the following description.
The embodiment of the present application proposes a kind of generation method of memory image, and Fig. 1 is according in one kind of the embodiment of the present application
Deposit the generation method implementation flow chart one of snapshot, comprising:
Step S101: when system starts, the first subprocess is created；
Step S102: it in the case where memory image generating process is triggered, is sent to the first subprocess and merges compression times
Business, the merging compression duty include the filename of the first snapshot document and the filename of delta file；Wherein, the first snapshot document
The memory image at moment is generated for recording the first snapshot document, delta file generates the moment for recording from the first snapshot document
To the operational order at current time；
Step S103: the implementing result for merging compression duty is received.
The memory image generation method that the application proposes can be used for generating Redis memory image；Correspondingly, above system
It can refer to Redis storage system, aforesaid operations instruction can refer to Redis operational order.
The above process can be applied to the host process of Redis system.First subprocess merges compression duty for executing, can
The first subprocess is named as compression (Compact) subprocess.In step S103, it is anti-that host process receives Compact subprocess
The implementing result of feedback.
In a kind of possible embodiment, the first snapshot document is Redis database (RDB, RedisDatebase) text
Part, the delta file are the file (AOF, Append Only File) for carrying out additional operation.
The embodiment of the present application also proposes the generation method of another memory image, and Fig. 2 is according to the one of the embodiment of the present application
The generation method implementation flow chart two of kind memory image.As shown in Fig. 2, relative to above-described embodiment, the present embodiment further include:
Step S201: in the case where memory image generating process is triggered, the filename and memory of recording increment file
First mapping relations of SNAPSHOT INFO, and the filename of recording increment file；Wherein, memory image information includes that memory image is raw
The relevant information being triggered at process.
After above-mentioned steps S103, can also include:
Step S202: it according to the first mapping relations of filename lookup of the corresponding delta file of implementing result, obtains described
The corresponding memory image information of the filename of delta file；
Step S203: respective operations are executed according to the memory image information.
Step S204: in the case where implementing result is correct compression, deleting delta file, generate new delta file,
The new delta file is used to record the operational order after current time.
Above-mentioned steps S201 to step S204 can be executed by Redis host process.
In a kind of possible embodiment, the condition that the memory image generating process is triggered includes following at least one
:
It receives from external triggering command；
From node triggering when carrying out master-slave synchronisation；
The data volume of the delta file reaches predefined size.
In above-described embodiment, merging compression duty can also include leader follower replication information, and leader follower replication information can be used for
It is saved when generating new snapshot document for above-mentioned first subprocess.
The embodiment of the present application also proposes a kind of generation method of memory image, this method can be applied to above-mentioned first son into
Journey.If Fig. 3 is the generation method implementation flow chart three according to a kind of memory image of the embodiment of the present application, comprising:
The S301: the first subprocess of step, which receives, merges compression duty, which includes the first snapshot document
The filename of filename and delta file；Wherein, the first subprocess is created when system starts；First snapshot document is for remembering
The memory image that the first snapshot document generates the moment is recorded, delta file generates the moment to current for recording from the first snapshot document
The operational order at moment；
Step S302: it executes and merges compression duty, compression is merged to the first snapshot document and delta file, is used
In the second snapshot document of the memory image at record current time；
Step S303: the implementing result for merging compression duty is sent.
In above-mentioned steps S301, the first subprocess can be received from Redis host process merges compression duty；Above-mentioned steps
In S303, the first subprocess can send the implementing result of compression duty to Redis host process.Aforesaid operations instruction can refer to
Redis operational order.
In a kind of possible embodiment, above-mentioned first snapshot document or the second snapshot document are RDB file, above-mentioned increasing
Amount file is AOF file.
Fig. 4 is the implementation flow chart of step S302 in the generation method according to a kind of memory image of the embodiment of the present application,
Include:
Step S401: the operational order recorded in load delta file, and by operational order with key-value pair (Key-Value)
In key (Key) be dimension sequentially store；
Step S402: the key-value pair in snapshot document is read；
Step S403: being directed to each key-value pair, executes the corresponding operational order of Key of key assignments centering, obtains the Key most
New data state updates the key-value pair according to the latest data state, and deletes the key-value pair in memory；
Step S404: updated key-value pair is saved into the second snapshot document.
As shown in figure 4, can also include: after above-mentioned steps S402
Step S405: in the case that the key in key-value pair does not have corresponding operational order, key-value pair is saved into second
Snapshot document.
After being completed for the operation of all key-value pairs, can also include:
Step S406: remaining operational order in delta file is executed, implementing result is saved into the second snapshot document.
In a kind of possible embodiment, above-mentioned merging compression duty also includes leader follower replication information；
Correspondingly, the above method can also include: that leader follower replication information preservation is entered the second snapshot document.
The above content is introduce the embodiment of the present application respectively from the angle of Redis host process and the first subprocess.Below
In conjunction with attached drawing, the embodiment of the present application is introduced from the angle of Redis host process and the interaction of the first subprocess.
For ease of description, below in an example, the first subprocess is known as Compact subprocess, compressed merging
Task is known as Compact task；First snapshot document is known as storage RDB file, the second snapshot document is known as new RDB text
Delta file is known as increment AOF file by part.
RDB file is the persistence disk file of Redis internal storage data, has recorded the memory image at a certain moment.Increment
AOF file record Redis operational order, that is, operation note to Redis database.The application is using storage RDB text
Part and increment AOF file construct the memory image at a certain moment, that is, a new RDB file are generated, when new RDB file record is current
The memory image at quarter.Later, new increment AOF file is generated, new increment AOF file record is since current time
Redis operational order.When generating memory image next time, (the RDB file is being generated the RDB file generated before recycling
When be new RDB file, but identity has been converted into storage RDB file at this time) construct memory image with increment AOF file, generate new
RDB file.It executes repeatedly.The application creates a Compact subprocess when Redis starts, Compact subprocess
Effect is to generate Redis memory image.
Since the Compact subprocess in the application is to be created in Redis starting, rather than triggering host process life
It is created when at memory image, therefore Compact subprocess does not include the data of host process；This be different from the prior art in
It triggers by calling fork function to generate subprocess when host process generates memory image, which includes the number of all host processes
According to.Therefore, the application fundamentally eliminates fork and calls the influence caused by system, can be improved system availability and subtracts
Few memory usage amount.
The effect of Compact subprocess is to receive host process to send Compact task, by specified storage RDB file
A new RDB file is compressed into increment AOF file mergences.The groundwork of Compact subprocess is divided into two parts, a part
It is the processing of increment AOF file, another part is the merging compression for executing storage RDB file and increment AOF file.
Specifically, when handling increment AOF file, Compact subprocess is loaded in increment AOF file
Redis operational order, and Redis operational order is sequentially stored using Key as dimension.Fig. 5 is according to the embodiment of the present application
A kind of memory image generation method in, load and storage Redis operational order realization schematic diagram.Redis is that support is more
DB's, DB corresponding to the current Redis operational order of record has been instructed by the selection (SELECT) etc. in increment AOF file.
As shown in figure 5, first distinguishing Redis operation after Compact subprocess loads the Redis operational order in increment AOF file and referring to
It enables and which DB is directed to, for each DB, Redis operational order of the difference recording needle to each Key, the Redis behaviour of each Key
Making instruction record is according to time ordered arrangement, to guarantee result and host process after the subsequent operation for executing operation to Key
State consistency.Wherein, Redis operational order is all determining, and the instruction of this part can use the form of shared object to save
Memory.In addition, such as writing script (SCRIPT) instruction for special instruction, writing LUA script (LUA) instruction, empty data
(FLUSHALL) instruct, empty database (FLUSHDB) instruction, exchange data (SWAPDB) instruction etc. special instructions, need into
The parsing of row semantic class, and respective handling is carried out according to Redis operational order of the parsing result to storage.In Fig. 5, it is shown that right
For the delete operation of the Redis operational order of Key1 and Key2 in database D B3, and shows and be directed to in database DB1
The operate_3 of Key1 and the swap operation to the operate_3 for being directed to Key3 in database DB2, these operations are merely illustrative,
The embodiment of the present application to for Redis operational order processing mode with no restrictions.
Compact subprocess compared with the subprocess of fork function call in the prior art, can effectively save memory disappear
Consumption.In the prior art, the subprocess of generally fork function call reserves the memory redundancy of 50-100%, and in the application
The memory that Compact subprocess uses is essentially the size of AOF file.For example, for the Redis example of 10G memory size, it is existing
Have and needs to reserve 5G-10G memory for the subprocess of fork function call in technology；And in this application, AOF file is maximum general
For 1G, the data structure inside Compact subprocess, Compact subprocess consume 1.5G or so memory altogether in addition, with existing skill
Art is compared and has saved 70-85% memory；For the Redis example of bigger memory, the income that the application saves memory is become apparent.
The core process of Compact subprocess is to compress storage RDB file and increment AOF file mergences.In order to save
Use of the Compact subprocess to memory, the application can read in a letter by the way of streaming from storage RDB file
Breath.For the information of non-data type, such as database information, LUA script and subsidiary field, Compact subprocess is directly carried out
Record.For the information of data type, i.e., the content recorded with Key-Value structure, Compact subprocess is executed the Key and existed
All Redis operation notes in increment AOF file, so that the latest data state of the Key is obtained, it later will be updated
Key-Value carries out persistence (being namely written in new RDB file), and deletes the Key-Value in memory, in saving
Deposit use；If the Key does not have change record (namely without corresponding Redis operation note) in increment AOF file, can
It will be directly saved into new RDB file from the Key-Value that storage RDB file is read, to promote the generation effect of new RDB file
Rate.
Fig. 6 is storage RDB file and increment AOF in the generation method according to a kind of memory image of the embodiment of the present application
The merging compression process implementation flow chart of file, comprising:
Step S601: judging whether storage RDB file reads completion, if so, thening follow the steps S602；If it is not, then
Execute step S603.
Step S602: the remaining command in increment AOF file is executed, and carries out persistence.Step S602 is finished it
Afterwards, terminate current process.
Step S603: an information is read from storage RDB file.
Step S604: judging the type of the information, if it is non-data type, thens follow the steps S605；If it is data
Type thens follow the steps S606.
Step S605: the information is recorded.For example, the information is database information or LUA information.Step S605 is finished
Later, S601 is returned to step.
Step S606: judge with the presence or absence of the corresponding Redis operational order of Key in the information in increment AOF file, such as
Fruit exists, and thens follow the steps S607；Otherwise, step S608 is executed.
Step S607: the corresponding Redis operational order of the Key in increment AOF file is obtained, these are successively sequentially executed
Redis operational order obtains updated Key-Value, by updated Key-Value persistence (after namely updating
Key-Value be saved into new RDB file).Continue to execute step S609.
Step S608: by the Key in the data supplementing in storage RDB file into new RDB file.Continue to execute step
S609。
Step S609: the Key-Value is deleted in memory.Return to step S601.
By the above process shown in fig. 6, the compression of the merging to storage RDB file and increment AOF file is realized.
In a kind of possible embodiment, when Redis is received from extraneous triggering command (such as BGSAVE instruction)
Or when synchronous with from node progress full dose, Redis needs to generate memory image to realize data preservation or master-slave synchronisation.
Compact subprocess is completed after merging compression, is notified host process and is completed subsequent operation.In addition, in order to promoted Compact into
The case where execution efficiency and saving memory of journey, triggering generates memory image can also include: that the data volume of increment AOF file reaches
To predefined size.When the data volume of increment AOF file reaches predefined size, triggering generates memory image, by storage RDB file
With increment AOF file mergences, new increment AOF file is generated later, and newly generated Redis operational order is saved into new increasing
It measures in AOF file.The cutting to increment AOF file is realized in this way, it should be noted that increment AOF text
When part is cut, the Redis operational order generated before needing to guarantee clipping time point has all been saved into increment AOF text
In part.
Redis host process and Compact subprocess can be communicated using pipeline (pipe) mode, the main contents packet of communication
Include the filename of the filename and increment AOF file that need to compress combined storage RDB file.In addition, existing to be compatible with Redis
The content of the leader follower replication information recorded in storage RDB file, communication can also include leader follower replication information, for example including principal and subordinate
The information such as the offset (Offset) of replicated database ID, leader follower replication mark ID, leader follower replication.Compact subprocess can
The part leader follower replication information to be written in new RDB file.
Fig. 7 is Redis host process and Compact in the generation method according to a kind of memory image of the embodiment of the present application
The interactive process schematic diagram of subprocess, comprising:
Step S701: host process, which is triggered, generates memory image.
Since host process needs to carry out subsequent operation (as carried out master-slave synchronisation) according to the condition triggered at that time, so needing
Record memory image information；Again due to increment AOF file filename can one memory image information of unique identification, can
Memory image information is recorded in a manner of using following step S702.Wherein, memory image information is different from aforementioned memory image,
Memory image information can be the information such as trigger condition, triggered time, the triggering main body that triggering memory image generates.
Step S702: the filename of host process recording increment AOF file and the mapping relations of memory image information, and record
The filename of current increment AOF file.Later, host process returns to memory image and generates confirmation.
In addition, since Redis is to support more Key to operate, and Compact subprocess needs to be ranked up Key, then exists
The Redis operational order of write-in increment AOF file must be single Key operation, so needing to complete in Redis host process more
Key operates the conversion operated to single Key.
Step S703: host process sends Compact task to Compact subprocess.
Step S704:Compact subprocess, which is executed, merges compression to storage RDB file and increment AOF file.
Step S705:Compact subprocess returns to the implementing result of Compact task to host process.
Step S706: host process is corresponded to according to the above-mentioned mapping relations of filename lookup of current increment AOF file
Memory image information, and necessary operation is carried out according to the memory image information.
In addition, the case where generating for leader follower replication triggering memory image is answered after completing the duplication of full dose data from node
The Compact task of current Compact subprocess is terminated, to RDB text when to avoid due to subprocess completion merging compression duty
Part is modified, and two process logic conflicts are caused.
As seen from the above-described embodiment, the application eliminates existing using fork subprocess generation memory image bring shadow
It rings, therefore can be improved system availability, reduce memory usage amount.Fig. 8 A and Fig. 8 B are shown using the application and existing way
Generate performance comparison figure when memory image.Fig. 8 A is the method proposed using the embodiment of the present application and the sound using existing method
Answer delay time contrast schematic diagram.As shown in Figure 8 A, when Redis example memory size is 10GB, using existing open source scheme
Caused by request operating lag be 127 milliseconds, use the embodiment of the present application propose method caused by request operating lag be 1 in the least
Second；When Redis example memory size is 20GB, request operating lag caused by existing open source scheme is used to adopt for 287 milliseconds
The request operating lag caused by the method that the embodiment of the present application proposes is 1 millisecond；It is 30GB in Redis example memory size
When, use request operating lag caused by existing open source scheme to cause for 422 milliseconds using the method that the embodiment of the present application proposes
Request operating lag be 1 millisecond.(the problem of due to display scale, is proposed using the embodiment of the present application in the case of aforementioned three kinds
Method caused by request operating lag histogram fail clearly to show in fig. 8 a).Fig. 8 B is to use the embodiment of the present application
The method of proposition and the reserved memory size contrast schematic diagram for using existing method.As shown in Figure 8 B, big in Redis example memory
It is small be 10GB when, using needed for existing open source scheme reserve in save as 5GB, using the embodiment of the present application propose method needed for
It is reserved in save as 1.5GB；When Redis example memory size is 20GB, using reserved memory needed for existing open source scheme
For 10GB, using saving as 2.58GB in reserving needed for the method that the embodiment of the present application proposes；It is in Redis example memory size
When 30GB, using needed for existing open source scheme reserve in save as 15GB, using the embodiment of the present application propose method needed for
2.6GB is saved as in reserved.
The embodiment of the present application also proposes a kind of generating means of memory image, which can be applied to Redis host process.
Fig. 9 is the generating means structural schematic diagram one according to a kind of memory image of the embodiment of the present application, comprising:
Creation module 901, for creating the first subprocess when system starts；
Task sending module 902, for being sent to the first subprocess in the case where memory image generating process is triggered
Merge compression duty, which includes the filename of the first snapshot document and the filename of delta file；Wherein,
One snapshot document is used to record the memory image that the first snapshot document generates the moment, and delta file is for recording from the first snapshot text
The operational order at part generation moment to current time；
As a result receiving module 903, for receiving the implementing result for merging compression duty.
Figure 10 is the generating means structural schematic diagram two according to a kind of memory image of the embodiment of the present application, comprising: creation
Module 901, task sending module 902, result receiving module 903, logging modle 1004, searching module 1005 and operation execute mould
Block 1006；Wherein, creation module 901, task sending module 902 and result receiving module 903 are corresponding in above-described embodiment
Functions of modules is identical, repeats no more.
Above-mentioned logging modle 1004, in the case where memory image generating process is triggered, recording increment file
First mapping relations of filename and memory image information, and the filename of recording increment file；The memory image information includes
The relevant information that memory image generating process is triggered.
Searching module 1005, for the first mapping relations of filename lookup according to the corresponding delta file of implementing result,
Obtain the corresponding memory image information of filename of delta file；
Operation executing module 1006 executes respective operations for the memory image information.
In a kind of possible embodiment, the condition that memory image generating process is triggered is included at least one of the following:
It receives from external triggering command；
From node triggering when carrying out master-slave synchronisation；
The data volume of the delta file reaches predefined size.
The embodiment of the present application also proposes the generating means of another memory image, which can be applied to the first subprocess
(such as above-mentioned Compact subprocess).Figure 11 is to be shown according to a kind of generating means structure of memory image of the embodiment of the present application
It is intended to three, comprising:
Task receiving module 1101 merges compression duty for receiving using the first subprocess, merges compression duty and includes
The filename of first snapshot document and the filename of delta file；Wherein, the first subprocess is created when system starts；First
Snapshot document is used to record the memory image that the first snapshot document generates the moment, and delta file is for recording from the first snapshot document
Generate the operational order at moment to current time；
Task execution module 1102 merges compression duty for executing using the first subprocess, to the first snapshot document and
Delta file merges compression, obtains the second snapshot document of the memory image for recording current time；
As a result sending module 1103, for sending the implementing result for merging compression duty using the first subprocess.
In a kind of possible embodiment, task execution module 1102 is used for, and loads the operation recorded in delta file
Instruction, and operational order is sequentially stored using the key in key-value pair as dimension；Read the key-value pair in snapshot document；For each
Key-value pair executes the corresponding operational order of key of key assignments centering, the latest data state of the key is obtained, according to latest data shape
State updates the key-value pair, and deletes the corresponding operational order of the key；Updated key-value pair is saved into the second snapshot text
Part.
In a kind of possible embodiment, task execution module 1102 is also used to, and executes remaining behaviour in delta file
It instructs, implementing result is saved into the second snapshot document.
In a kind of possible embodiment, task execution module 1102 is also used to, and the key in key-value pair does not correspond to
Operational order in the case where, key-value pair is saved into second snapshot document.
The function of each module in each device of the embodiment of the present application may refer to the corresponding description in the above method, herein not
It repeats again.
According to an embodiment of the present application, present invention also provides a kind of electronic equipment and a kind of readable storage medium storing program for executing.
As shown in figure 12, it is block diagram according to the electronic equipment of the generation method of the memory image of the embodiment of the present application.Electricity
Sub- equipment is intended to indicate that various forms of digital computers, such as, laptop computer, desktop computer, workbench, a number
Word assistant, server, blade server, mainframe computer and other suitable computer.Electronic equipment also may indicate that respectively
The mobile device of kind form, such as, personal digital assistant, cellular phone, smart phone, wearable device and other similar meters
Calculate device.Component, their connection and relationship shown in this article and their function are merely exemplary, and are not intended to
Limit the realization of the application that is described herein and/or requiring.
As shown in figure 12, which includes: one or more processors 1201, memory 1202, and for connecting
Connect the interface of each component, including high-speed interface and low-speed interface.All parts are interconnected using different bus, and can be with
It is installed on public mainboard or installs in other ways as needed.Processor can be to the finger executed in electronic equipment
Order is handled, including storage in memory or on memory (such as, to be coupled to and connect in external input/output device
Mouthful display equipment) on show graphic user interface (Graphical User Interface, GUI) graphical information finger
It enables.In other embodiments, if desired, by multiple processors and/or multiple bus and multiple memories and multiple can deposit
Reservoir is used together.It is also possible to connect multiple electronic equipments, each equipment provides the necessary operation in part (for example, as clothes
Business device array, one group of blade server or multicomputer system).In Figure 12 by taking a processor 1201 as an example.
Memory 1202 is non-transitory computer-readable storage medium provided herein.Wherein, the memory
Be stored with the instruction that can be executed by least one processor so that at least one described processor execute it is provided herein interior
Deposit the generation method of snapshot.The non-transitory computer-readable storage medium of the application stores computer instruction, the computer instruction
For making computer execute the generation method of memory image provided herein.
Memory 1202 be used as a kind of non-transitory computer-readable storage medium, can be used for storing non-instantaneous software program,
Non-instantaneous computer executable program and module, such as the corresponding program instruction/module of the method for the XXX in the embodiment of the present application
(for example, attached creation module shown in Fig. 9 901, task sending module 902 and result receiving module 903).Processor 1201 passes through
Non-instantaneous software program, instruction and the module being stored in memory 1202 are run, thereby executing the various functions of server
Using and data processing, i.e., realization above method embodiment in memory image generation method.
Memory 1202 may include storing program area and storage data area, wherein storing program area can store operation system
Application program required for system, at least one function；Storage data area can store the electronic equipment of the generation according to memory image
Use created data etc..In addition, memory 1202 may include high-speed random access memory, it can also include non-wink
When memory, a for example, at least disk memory, flush memory device or other non-instantaneous solid-state memories.In some realities
It applies in example, it includes the memory remotely located relative to processor 1201 that memory 1202 is optional, these remote memories can be with
By being connected to the network to the electronic equipment of the generation of memory image.The example of above-mentioned network includes but is not limited to internet, enterprise
Intranet, local area network, mobile radio communication and combinations thereof.
The electronic equipment of the generation method of memory image can also include: input unit 1203 and output device 1204.Place
Reason device 1201, memory 1202, input unit 1203 can be connected with output device 1204 by bus or other modes, be schemed
In 12 for being connected by bus.
Input unit 1203 can receive the number or character information of input, and generate and the generation method of memory image
The related key signals input of the user setting and function control of electronic equipment, for example, touch screen, keypad, mouse, track pad,
The input units such as touch tablet, indicating arm, one or more mouse button, trace ball, control stick.Output device 1204 can wrap
Include display equipment, auxiliary lighting apparatus (for example, LED) and haptic feedback devices (for example, vibrating motor) etc..The display equipment can
To include but is not limited to, liquid crystal display (Liquid Crystal Display, LCD), light emitting diode (Light
Emitting Diode, LED) display and plasma scope.In some embodiments, display equipment can be touch
Screen.
The various embodiments of system and technology described herein can be in digital electronic circuitry, integrated circuit system
System, is consolidated specific integrated circuit (Application Specific Integrated Circuits, ASIC), computer hardware
It is realized in part, software, and/or their combination.These various embodiments may include: to implement in one or more calculating
In machine program, which can hold in programmable system containing at least one programmable processor
Row and/or explain, which can be dedicated or general purpose programmable processors, can from storage system, at least
One input unit and at least one output device receive data and instruction, and data and instruction is transmitted to the storage system
System, at least one input unit and at least one output device.
These calculation procedures (also referred to as program, software, software application or code) include the machine of programmable processor
Instruction, and can use programming language, and/or the compilation/machine language of level process and/or object-oriented to implement these
Calculation procedure.As used herein, term " machine readable media " and " computer-readable medium " are referred to for referring to machine
It enables and/or data is supplied to any computer program product, equipment, and/or the device of programmable processor (for example, disk, light
Disk, memory, programmable logic device (programmable logic device, PLD)), including, receiving can as machine
The machine readable media of the machine instruction of read signal.Term " machine-readable signal " is referred to for by machine instruction and/or number
According to any signal for being supplied to programmable processor.
In order to provide the interaction with user, system and technology described herein, the computer can be implemented on computers
Include for user show information display device (for example, CRT (Cathode Ray Tube, cathode-ray tube) or
LCD (liquid crystal display) monitor)；And keyboard and indicator device (for example, mouse or trace ball), user can be by this
Keyboard and the indicator device provide input to computer.The device of other types can be also used for providing the friendship with user
Mutually；For example, the feedback for being supplied to user may be any type of sensory feedback (for example, visual feedback, audio feedback or
Touch feedback)；And it can be received with any form (including vocal input, voice input or tactile input) from user
Input.
System described herein and technology can be implemented including the computing system of background component (for example, as data
Server) or the computing system (for example, application server) including middleware component or the calculating including front end component
System is (for example, the subscriber computer with graphic user interface or web browser, user can pass through graphical user circle
Face or the web browser to interact with the embodiment of system described herein and technology) or including this backstage portion
In any combination of computing system of part, middleware component or front end component.Any form or the number of medium can be passed through
Digital data communicates (for example, communication network) and is connected with each other the component of system.The example of communication network includes: local area network
(Local Area Network, LAN), wide area network (Wide Area Network, WAN) and internet.
Computer system may include client and server.Client and server is generally off-site from each other and usually logical
Communication network is crossed to interact.By being run on corresponding computer and each other with the meter of client-server relation
Calculation machine program generates the relationship of client and server.
According to the technical solution of the embodiment of the present application, in Redis starting, creation is for executing storage RDB file and increment
The Compact subprocess of the merging compression of AOF file.Since Compact subprocess is created in Redis starting, without
It is to be created when triggering host process and generating memory image, therefore Compact subprocess does not include the data of host process；This area
Not in the prior art when triggering host process and generating memory image by calling fork function to generate subprocess, the subprocess packet
Data containing all host processes.Therefore, the application fundamentally eliminates fork and calls the influence caused by system, can be improved
System availability simultaneously reduces memory usage amount.
It should be understood that various forms of processes illustrated above can be used, rearrangement increases or deletes step.Example
Such as, each step recorded in the application of this hair can be performed in parallel or be sequentially performed the order that can also be different and execute,
As long as it is desired as a result, being not limited herein to can be realized technical solution disclosed in the present application.
Above-mentioned specific embodiment does not constitute the limitation to the application protection scope.Those skilled in the art should be bright
White, according to design requirement and other factors, various modifications can be carried out, combination, sub-portfolio and substitution.It is any in the application
Spirit and principle within made modifications, equivalent substitutions and improvements etc., should be included within the application protection scope.
Claims (23)
1. a kind of generation method of memory image characterized by comprising
When system starts, the first subprocess is created；
In the case where memory image generating process is triggered, the first subprocess of Xiang Suoshu, which is sent, merges compression duty, the conjunction
And compression duty includes the filename of the first snapshot document and the filename of delta file；Wherein, first snapshot document is used
In the memory image for recording the first snapshot document generation moment, the delta file is raw from first snapshot document for recording
At the operational order at moment to current time；
Receive the implementing result for merging compression duty.
2. the method according to claim 1, wherein first snapshot document is Redis database file, institute
Stating delta file is the file for carrying out additional operation.
3. method according to claim 1 or 2, which is characterized in that in the feelings that the memory image generating process is triggered
Under condition, further includes:
The filename of the delta file and the first mapping relations of memory image information are recorded, and records the delta file
Filename；The memory image information includes the relevant information that the memory image generating process is triggered.
4. according to the method described in claim 3, it is characterized in that, it is described receive merge compression duty implementing result after,
Further include:
The first mapping relations according to the filename lookup of the corresponding delta file of the implementing result obtain the increment text
The corresponding memory image information of the filename of part；
Respective operations are executed according to the memory image information.
5. method according to claim 1 or 2, which is characterized in that the condition that the memory image generating process is triggered
It includes at least one of the following:
It receives from external triggering command；
From node triggering when carrying out master-slave synchronisation；
The data volume of the delta file reaches predefined size.
6. method according to claim 1 or 2, which is characterized in that the merging compression duty also includes leader follower replication letter
Breath.
7. method according to claim 1 or 2, which is characterized in that further include:
In the case where the implementing result is correct compression, the delta file is deleted, generates new delta file, it is described new
Delta file be used to record operational order after the current time.
8. a kind of generation method of memory image characterized by comprising
First subprocess, which receives, merges compression duty, described to merge the filename and increment that compression duty includes the first snapshot document
The filename of file；Wherein, first subprocess is created when system starts；First snapshot document is for recording the
One snapshot document generate the moment memory image, the delta file for record from first snapshot document generate the moment to
The operational order at current time；
The merging compression duty is executed, compression is merged to first snapshot document and delta file, is obtained for remembering
Record the second snapshot document of the memory image at current time；
Send the implementing result for merging compression duty.
9. according to the method described in claim 8, it is characterized in that, first snapshot document or the second snapshot document are
Redis database file, the delta file are the file for carrying out additional operation.
10. method according to claim 8 or claim 9, which is characterized in that described to execute the merging compression duty, comprising:
Load the operational order recorded in the delta file, and by the operational order using the key in key-value pair as dimension sequentially
Storage；
Read the key-value pair in the snapshot document；
For each key-value pair, the corresponding operational order of key in the key-value pair is executed, the latest data shape of the key is obtained
State updates the key-value pair according to the latest data state, and deletes the key-value pair in memory；
Updated key-value pair is saved into second snapshot document.
11. according to the method described in claim 10, it is characterized in that, described execute the merging compression duty, further includes:
Remaining operational order in the delta file is executed, implementing result is saved into second snapshot document.
12. according to the method described in claim 10, it is characterized in that, described execute the merging compression duty, further includes:
In the case that key in the key-value pair does not have corresponding operational order, it is fast that the key-value pair is saved into described second
According to file.
13. method according to claim 8 or claim 9, which is characterized in that merging compression duty also includes leader follower replication information；
The method also includes: the leader follower replication information preservation is entered into second snapshot document.
14. a kind of generating means of memory image characterized by comprising
Creation module, for creating the first subprocess when system starts；
Task sending module, in the case where memory image generating process is triggered, the first subprocess of Xiang Suoshu to send conjunction
And compression duty, the compression duty that merges includes the filename of the first snapshot document and the filename of delta file；Wherein, institute
The memory image that the first snapshot document generates the moment for recording the first snapshot document is stated, the delta file is for recording from institute
State the operational order that the first snapshot document generates moment to current time；
As a result receiving module, for receiving the implementing result for merging compression duty.
15. device according to claim 14, which is characterized in that further include:
Logging modle, for recording the file of the delta file in the case where the memory image generating process is triggered
First mapping relations of name and memory image information, and record the filename of the delta file；The memory image packet
Include the relevant information that the memory image generating process is triggered.
16. device according to claim 15, which is characterized in that described device further include:
Searching module, for the first mapping relations according to the filename lookup of the corresponding delta file of the implementing result,
Obtain the corresponding memory image information of filename of the delta file；
Operation executing module, for executing respective operations according to the memory image information.
17. device according to claim 14, which is characterized in that the condition packet that the memory image generating process is triggered
It includes at least one of following:
It receives from external triggering command；
From node triggering when carrying out master-slave synchronisation；
The data volume of the delta file reaches predefined size.
18. a kind of generating means of memory image characterized by comprising
Task receiving module merges compression duty for receiving using the first subprocess, and the merging compression duty includes first
The filename of snapshot document and the filename of delta file；Wherein, first subprocess is created when system starts；It is described
First snapshot document is used to record the memory image that the first snapshot document generates the moment, and the delta file is for recording from described
The operational order at the first snapshot document generation moment to current time；
Task execution module, for executing the merging compression duty using first subprocess, to the first snapshot text
Part and delta file merge compression, obtain the second snapshot document of the memory image for recording current time；
As a result sending module, for sending the implementing result for merging compression duty using first subprocess.
19. device according to claim 18, which is characterized in that
The task execution module is used for, and loads the operational order recorded in the delta file, and by the operational order with
Key in key-value pair is that dimension sequentially stores；Read the key-value pair in the snapshot document；For each key-value pair, described in execution
The corresponding operational order of key in key-value pair, obtains the latest data state of the key, is updated according to the latest data state
The key-value pair, and delete the corresponding operational order of the key；Updated key-value pair is saved into second snapshot document.
20. device according to claim 19, which is characterized in that
The task execution module is also used to, and executes remaining operational order in the delta file, the implementing result is protected
It is stored in second snapshot document.
21. device according to claim 19, which is characterized in that
The task execution module is also used to, in the case that the key in the key-value pair does not have corresponding operational order, by institute
It states key-value pair and is saved into second snapshot document.
22. a kind of electronic equipment characterized by comprising
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one
It manages device to execute, so that at least one described processor is able to carry out method of any of claims 1-13.
23. a kind of non-transitory computer-readable storage medium for being stored with computer instruction, which is characterized in that the computer refers to
It enables for making the computer perform claim require method described in any one of 1-13.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910807113.5A CN110515774A (en) | 2019-08-28 | 2019-08-28 | Generation method, device, electronic equipment and the storage medium of memory image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910807113.5A CN110515774A (en) | 2019-08-28 | 2019-08-28 | Generation method, device, electronic equipment and the storage medium of memory image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110515774A true CN110515774A (en) | 2019-11-29 |
Family
ID=68628009
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910807113.5A Pending CN110515774A (en) | 2019-08-28 | 2019-08-28 | Generation method, device, electronic equipment and the storage medium of memory image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110515774A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111240801A (en) * | 2020-01-06 | 2020-06-05 | 北京字节跳动网络技术有限公司 | Method, device, medium and electronic equipment for generating heap memory snapshot file |
| CN111309673A (en) * | 2020-02-12 | 2020-06-19 | 普信恒业科技发展（北京）有限公司 | Snapshot data generation method and device of incremental data |
| CN111506420A (en) * | 2020-03-27 | 2020-08-07 | 北京百度网讯科技有限公司 | Memory synchronization method and device, electronic equipment and storage medium |
| CN111638952A (en) * | 2020-05-09 | 2020-09-08 | 北京达佳互联信息技术有限公司 | Memory dump method and device and electronic equipment |
| CN112685360A (en) * | 2020-12-29 | 2021-04-20 | 平安普惠企业管理有限公司 | Memory data persistence method and device, storage medium and computer equipment |
| CN112835813A (en) * | 2021-03-04 | 2021-05-25 | 腾讯音乐娱乐科技（深圳）有限公司 | Method for processing repeated pictures in memory, electronic equipment and storage medium |
| CN112966046A (en) * | 2021-03-03 | 2021-06-15 | 北京金山云网络技术有限公司 | Data synchronization method and device, electronic equipment and storage medium |
-
2019
- 2019-08-28 CN CN201910807113.5A patent/CN110515774A/en active Pending
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111240801A (en) * | 2020-01-06 | 2020-06-05 | 北京字节跳动网络技术有限公司 | Method, device, medium and electronic equipment for generating heap memory snapshot file |
| CN111309673A (en) * | 2020-02-12 | 2020-06-19 | 普信恒业科技发展（北京）有限公司 | Snapshot data generation method and device of incremental data |
| CN111506420A (en) * | 2020-03-27 | 2020-08-07 | 北京百度网讯科技有限公司 | Memory synchronization method and device, electronic equipment and storage medium |
| CN111506420B (en) * | 2020-03-27 | 2023-09-22 | 北京百度网讯科技有限公司 | Memory synchronization method and device, electronic equipment and storage medium |
| CN111638952A (en) * | 2020-05-09 | 2020-09-08 | 北京达佳互联信息技术有限公司 | Memory dump method and device and electronic equipment |
| CN112685360A (en) * | 2020-12-29 | 2021-04-20 | 平安普惠企业管理有限公司 | Memory data persistence method and device, storage medium and computer equipment |
| CN112685360B (en) * | 2020-12-29 | 2023-09-22 | 湖北华中电力科技开发有限责任公司 | Method and device for persistence of memory data, storage medium and computer equipment |
| CN112966046A (en) * | 2021-03-03 | 2021-06-15 | 北京金山云网络技术有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN112966046B (en) * | 2021-03-03 | 2024-04-12 | 北京金山云网络技术有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN112835813A (en) * | 2021-03-04 | 2021-05-25 | 腾讯音乐娱乐科技（深圳）有限公司 | Method for processing repeated pictures in memory, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110515774A (en) | Generation method, device, electronic equipment and the storage medium of memory image | |
| US10445130B2 (en) | Framework for authoring data loaders and data savers | |
| CN105260376B (en) | Method, apparatus and system for clustered node reducing and expansion | |
| US11321291B2 (en) | Persistent version control for data transfer between heterogeneous data stores | |
| CN109840166A (en) | Across the cluster object storage async backup methods, devices and systems of one kind | |
| CN111782365B (en) | Timed task processing method, device, equipment and storage medium | |
| WO2012045245A1 (en) | Method and system for maintaining data consistency | |
| CN112131237A (en) | Data synchronization method, device, equipment and computer readable medium | |
| US20200104404A1 (en) | Seamless migration of distributed systems | |
| US11860892B2 (en) | Offline index builds for database tables | |
| WO2023231665A1 (en) | Distributed transaction processing method, system and device, and readable storage medium | |
| WO2022017347A1 (en) | Distributed database system and data processing method | |
| CN110955665A (en) | Cache query method and device and electronic equipment | |
| Tang et al. | Achieving convergent causal consistency and high availability for cloud storage | |
| US11157456B2 (en) | Replication of data in a distributed file system using an arbiter | |
| CN111240807A (en) | Volume-started virtual machine reconstruction method, terminal and readable storage medium | |
| US11693828B2 (en) | Real-time data replication in a multiple availability zone cloud platform | |
| CN112905613A (en) | Data bidirectional synchronization method and device for heterogeneous database | |
| US20170180473A1 (en) | High throughput, high reliability data processing system | |
| JP7135256B2 (en) | METHOD AND APPARATUS FOR GENERATING ERROR NOTIFICATION CONTENT OF DEEP LEARNING FRAMEWORK | |
| US20210208976A1 (en) | Backup management | |
| US11687565B2 (en) | Asynchronous data replication in a multiple availability zone cloud platform | |
| WO2024022329A1 (en) | Data management method based on key value storage system and related device thereof | |
| CN117390041B (en) | Data sharing method and device, electronic equipment and storage medium | |
| CN112527911B (en) | Data storage method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |