CN103365741B - For the snapshot of cluster virtual machine and the method and apparatus of recovery - Google Patents
For the snapshot of cluster virtual machine and the method and apparatus of recovery Download PDFInfo
- Publication number
- CN103365741B CN103365741B CN201210103120.5A CN201210103120A CN103365741B CN 103365741 B CN103365741 B CN 103365741B CN 201210103120 A CN201210103120 A CN 201210103120A CN 103365741 B CN103365741 B CN 103365741B
- Authority
- CN
- China
- Prior art keywords
- virtual machine
- message
- snapshot
- cluster
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Cosmetics (AREA)
Abstract
Embodiments of the invention relate to for the snapshot of cluster virtual machine and the method and apparatus of recovery. According to exemplary embodiment of the present invention, a kind of snapshot being associated with a virtual machine in cluster virtual machine that generates is proposed to generate the method for cluster snapshot, method, recovery cluster virtual machine and the corresponding equipment of generating virtual machines cluster snapshot. In an embodiment of the present invention, provide a kind of message dyeing mechanism of novelty, guarantee in the time creating the snapshot of cluster virtual machine not only can recording individual virtual machine local express photograph, and can effectively record the state of the communication port for supporting virtual machine communication. Corresponding equipment is also disclosed. According to exemplary embodiment of the present invention, the more effectively snapshot of generating virtual machines cluster, and can correspondingly cluster virtual machine be returned to the given snapshot moment.
Description
Technical field
Embodiments of the invention relate generally to virtual machine, more specifically, relate to for virtual machineThe snapshot of cluster and the method and apparatus of recovery.
Background technology
Virtual machine (VirtualMachine, VM) refers to by a class and is specifically applied in physical machineThe application execution environment creating on the hardware platform of device, user can move by this environment shouldMutual with also occurring with it, just as used physical machine. Create the software application of VMBe commonly referred to virtual machine manager (hypervisor). Thing can be disposed and operate in to managerOn reason machine, and VM manager can create and move one or more virtual machines. Along with getting overCarry out more Distributed Application and be deployed in cloud (cloud) environment, cluster virtual machine (cluster)Obtain increasingly extensive use. Term " cluster virtual machine " refers to and utilizes that as used hereinCommunication port between this intercoms and the logic packaging body of multiple virtual machines of swap data mutually.A cluster virtual machine is served an application or system conventionally. Virtual machine in cluster canBe deployed on same VM manager, also can distribute across different VM managers.
Know, for single virtual machine, snapshot (snapshot) be one importantOperation. The object of snapshot operation is to preserve all states, the data of virtual machine at given timeAnd context (context). Snapshot operation is most important for the fault recovery of virtual machine.For example, in the time there is gross error in operation in a virtual machine, can be according to snapshot by virtualMachine returns to the residing state of moment and the context that create this snapshot. Equally, at virtual machine collectionIn group, be also absolutely necessary for the snapshot operation of whole cluster.
For the cluster virtual machine being made up of multiple virtual machines, snapshot operation should energyEnough preserve in cluster all virtual machines at given time state and context separately. Not only asThis, owing to may communicating by communication port between the different virtual machine in cluster, thereforeCluster snapshot also should be preserved communication port between the virtual machine state in the snapshot moment.
Known cluster virtual machine snapshot operation often cannot degree of preservation be preserved multiple virtual machines and is existedThe context of strict synchronization. The more important thing is, known cluster virtual machine snapshot cannotEffectively catch and preserve communication port in cluster at the state in snapshot moment, and these passagesMay transmit data in the snapshot moment. Like this, cluster snapshot is because lost communication portInformation and become imperfect, and may destroy the data consistency in cluster. In addition, veryMany cluster virtual machine snapshots of the prior art depend on VME operating system (OS) or application,Make these schemes cannot be applicable to the environment of system virtualization and cloud computing.
Therefore, this area needs a kind of cluster virtual machine for comprising multiple virtual machines moreEffectively snapshot mechanism.
Summary of the invention
In view of the above-mentioned problems in the prior art, the present invention propose a kind of novelty for lifeBecome the method and apparatus of cluster virtual machine.
In a first aspect of the present invention, provide a kind of generate with cluster virtual machine in one virtualThe snapshot that machine is associated is for generating the method for cluster snapshot, and described virtual machine leads to by communicationCommunicate by letter with other virtual machines in described cluster in road. Described method comprises: in response to snapshot instruction,The local express that creates described virtual machine shines; In response to the startup of described establishment, making will be from describedVirtual machine send to other virtual machines in described cluster each spread out of message and be added and dyeColor marker, the described local express that described dye marker instruction is creating described virtual machine shines; WithAnd receive and do not there is described dye marker in response to other virtual machines from described clusterImport message into, the relevant information of importing message described in storage into is as the snapshot of described communication portPart.
In a second aspect of the present invention, provide a kind of side of the snapshot for generating virtual machines clusterMethod, described cluster comprises the multiple virtual machines that utilize communication port to communicate with one another. Described method bagDraw together: sent out to other virtual machines by the first virtual machine that is chosen as coordinator in described multiple virtual machinesSend snapshot instruction; In response to the instruction of described snapshot, according to the method described in paragraph above generate withThe snapshot that each virtual machine in described multiple virtual machine is associated; And collection and described manyThe snapshot that each virtual machine in individual virtual machine is associated, for generating the fast of described clusterAccording to.
In a third aspect of the present invention, provide a kind of cluster virtual machine is returned to given snapshotThe method in moment, described cluster comprises multiple virtual machines, and described cluster is in the time of described snapshotThe snapshot of carving uses the method that paragraph is described above and generates. Described method comprises: by described manyThe first virtual machine that is chosen as coordinator in individual virtual machine sends and recovers instruction to other virtual machines;In response to described recovery instruction, make each virtual machine of described multiple virtual machines virtual according to thisThe local express of machine is according to the state that returns to the described snapshot moment; And according to described communication portSnapshot loads the message of having stored, and makes described in each message be sent to destination virtualMachine.
In a fourth aspect of the present invention, provide a kind of generate with cluster virtual machine in one virtualThe snapshot that machine is associated is for generating the equipment of cluster snapshot, and described virtual machine leads to by communicationCommunicate by letter with other virtual machines in described cluster in road. Described equipment comprises: local fast photographing device,Be configured for the local express photograph that creates described virtual machine in response to snapshot instruction; Message dyeing dressPut, be configured for and make in response to the startup of described establishment to send to institute from described virtual machineEach that state other virtual machines in cluster spreads out of message and is added dye marker, described dyeingThe described local express that mark instruction is creating described virtual machine shines; And passage fast photographing device,Be configured in response to other virtual machines from described cluster and receive and do not there is described dyeingThe importing message into of mark and the relevant information of importing message described in storing into are as described communication portThe part of snapshot.
As above summarized and below describing in detail, according to the embodiment of the present invention, propose one and disappearedBreath dyeing mechanism is in generating each virtual machine local express photograph, generates that these are virtualThe snapshot of the communication port between machine. For any individual virtual machine in cluster, virtual when thisMachine start to create local express according to time, it utilizes dyeing mechanism to sending on communication portAll message that spreads out of dyes, in order to indicate this virtual machine creating this to other virtual machinesGround snapshot. In the time that the predetermined conditions such as such as local snapshot creation completes are satisfied, virtual machine finishesTo spreading out of the dyeing of message.
On the other hand, import message into for each receiving, destination virtual machine detects shouldWhether the source virtual machine that imports message into dyes to this message. If this message is not dyedLook, illustrates that this message just sent by source virtual machine before the snapshot moment, therefore shouldBe saved using the part as communication port snapshot. On the other hand, if import into message byDyeing, illustrates that this message is that source virtual machine is just issued after the snapshot moment, therefore clusterIn snapshot without the information that comprises this message.
In this way, embodiments of the present invention can be more effective with one, reliable and flexibleMethod generate the snapshot for cluster virtual machine.
Brief description of the drawings
Read detailed description below by reference to accompanying drawing, the embodiment of the present invention above-mentioned with andHis object, feature and advantage will become and should be readily appreciated that. In the accompanying drawings, with exemplary and unrestrictedThe mode of property shows some embodiment of the present invention, wherein:
Fig. 1 show according to an illustrative embodiment of the invention comprise multiple mutually intercommunicationThe schematic block diagram of the cluster 100 of virtual machine;
Fig. 2 show according to an illustrative embodiment of the invention for generate with virtual machine collectionThe snapshot that is associated of a virtual machine in group is for generating the showing of method 200 of cluster snapshotMeaning property flow chart;
Fig. 3 show according to the present invention another exemplary embodiment for generating and virtual machine collectionThe snapshot that is associated of a virtual machine in group is for generating the showing of method 300 of cluster snapshotMeaning property flow chart;
Fig. 4 show according to an illustrative embodiment of the invention for generating virtual machines clusterThe indicative flowchart of method 400 of snapshot;
Fig. 5 show according to an illustrative embodiment of the invention for cluster virtual machine is extensiveArrive again the indicative flowchart of the method 500 of given time;
Fig. 6 show according to an illustrative embodiment of the invention for generate with virtual machine collectionThe snapshot that is associated of a virtual machine in group is for generating the showing of equipment 600 of cluster snapshotMeaning property block diagram; And
Fig. 7 shows the signal that is applicable to the computer system for putting into practice the embodiment of the present invention 700Property block diagram.
In each accompanying drawing, identical or corresponding label represents identical or corresponding part.
Detailed description of the invention
Some exemplary embodiments are below with reference to the accompanying drawings described of the present invention formerReason and spirit. Should be appreciated that providing these embodiment is only used to make those skilled in the artCan understand better and then realize the present invention, and not limiting by any way model of the present inventionEnclose.
In general, according to embodiments of the invention, a cluster virtual machine is in the given momentThe snapshot of (being called " snapshot moment ") comprises two parts: the each individual virtual machine in clusterSnapshot, and support the snapshot of the communication port of communicating by letter between virtual machine. More particularly, logicalThe snapshot of letter passage mainly refers to that those that transmitted on communication port in the snapshot moment disappearBreath, or claim message in transit.
For this reason, embodiments of the invention based on thinking be: when each in cluster virtualMachine is during the snapshot moment creates local express photograph separately, to the message of sending by communication portLabel. For explanation and the object of description, to spreading out of message, to add tagged this process passableExemplarily be called " dyeing ". It is in order to indicate to destination virtual machine that message is dyeedThis message is just issued after the snapshot moment. Thus, destination virtual machine can only be depositedStorage passage those no dyeings import the part of message as communication port snapshot into because notDyed message was just transmitted in the snapshot moment on communication port.
First with reference to figure 1, it shows virtual machine according to an illustrative embodiment of the inventionThe schematic block diagram of cluster 100. In cluster 100, there is n manager (hypervisor),It is manager 1 to manager n. These managers are for establishment, operation and management virtual machineApplication, and operate on corresponding physical machine (not shown). Each managerCan be configured for establishment, the one or more virtual machines of operation and management. For example,, as Fig. 1 instituteShow, manager 1 is in charge of virtual machine VM1-1，VM1-2To VM1-i, manager n is responsible forManaging virtual machines VMn-1，VMn-2To VMn-j。
Especially, in the cluster virtual machine shown in Fig. 1, can be in order between different virtual machinesCommunicate with one another with communication port (not shown). Communication port between virtual machine can be for exampleNetwork, for example internet or Intranet. Alternatively or additionally, communication port can be also intoCommunication mechanism etc. between journey. Scope of the present invention is unrestricted in this regard. Note, with reference to figure 1It is only exemplary describing cluster 100, and the number shown in figure and configuration are only exemplaryAnd nonrestrictive. N, the i, the j that above describe with reference to figure 1 are natural number.
Below with reference to Fig. 2, its show according to an illustrative embodiment of the invention for lifeOne-tenth for example, is associated with a virtual machine in cluster virtual machine (, the cluster 100 in Fig. 1)Snapshot for generating the indicative flowchart of method 200 of cluster snapshot. According to the present inventionEmbodiment, method 200 can be performed for each virtual machine in cluster. For example,The main body of manner of execution 200 can be called " snapshot agent " being associated with virtual machine(agent) the application of being responsible for snapshot operation specially or process. This also will be explained below.
After method 200 starts, at step S202, create described void in response to snapshot instructionThe local express of plan machine shines. As mentioned below, according to embodiments of the invention, a void in clusterPlan machine manager can be selected as snapshot promoter or coordinator. This virtual machine manager canSend said " snapshot instruction " here with all virtual machines in cluster. For example, snapshotIn instruction, can specify the snapshot moment, make all virtual machines in cluster generate this snapshot momentThe snapshot at place.
In response to receiving such instruction, each the virtual machine creating local express in clusterAccording to. The local express of virtual machine, according to being the record of the local state to virtual machine, comprises this virtual machineData, mode of operation, context, memory service condition, processor service condition, magneticDish service condition, network connection state, etc. These are known to those skilled in the art,Do not repeat them here.
Continue with reference to figure 2, next at step S204, in response to opening of the establishment of local express photographMoving, each that makes to send to other virtual machines cluster from this virtual machine spreads out of message quiltAdd dye marker, the local express that dye marker instruction is creating this virtual machine shines.
The performed operation of step S204 can be regarded as " dyeing " operation, that is, and and to will be fromThis virtual machine sends to the message interpolation mark of other virtual machines in cluster (to be called " dyeing markNote). This dye marker indicates to other virtual machines: the source virtual machine of message is sending this messageTime creating local express shine. In other words, by means of dye marker, the destination of receipt messageVirtual machine can be known: the message being colored is just to be sent by source virtual machine after the snapshot moment, do not belong to the part of communication port state, thereby without being saved and record.
According to some embodiment, at step S204 place, can utilize the package that spreads out of messageWith position, described dye marker is not set. As described above, the communication port between virtual machineCan be network, for example network based on ICP/IP protocol or udp protocol. SuchIn embodiment, in message package, conventionally there is the position or the spare bits that are not used. These positions existIn procotol, there is no clear and definite fixing, can be by customization to be used for carry information. Therefore,Can be with position dye marker not being set in message package. In other words, if packageIn specific do not use position be set to the first predetermined value, indicate this outgoing message to there is dyeingTherefore mark is through hyperchromatic message. Otherwise, if this does not specifically use position to be set upFor second predetermined value different from the first predetermined value, indicate this message not there is dye marker,Therefore be the message of no dyeing.
Alternatively, also can add extra order to whole message package, such for arrangingDye marker. More specifically, in such embodiments, dye marker can be invested to messageOn package entirety, thereby form new package by encapsulating again. Above-describedly be only allRealize the exemplary embodiment of dye marker, other embodiment are also possible, model of the present inventionBe trapped among unrestricted in this respect.
Next, method proceeds to step S206, connects in response to other virtual machines from clusterReceive the message of importing into without dye marker, storage with this import into message for information about with workFor the part of the snapshot of communication port.
More particularly, in creating virtual machine local express photograph, may exist from collectionIn group, the message of other virtual machines is passed into by communication port. As described above, virtual machine collectionGroup in each virtual machine in the snapshot moment by manner of execution 200. Therefore, in the time of snapshotThe message of just being sent by other virtual machines in cluster after carving will be colored, and, have dyeing that isMark. Thus, in destination virtual machine one side, can detect the biography receiving from communication portEnter message and whether there is dye marker. If detect that the message of importing into of reception does not have dyeing markNote, can think that this message was just passed before snapshot zero hour on communication portDefeated, belong to message in transit. Thus, will store this message at step S206 leads to as communicationThe part of the snapshot in road.
Method 200 finishes after step S206.
By method 200, each virtual machine in cluster can be to after the snapshot momentThe message of sending from this virtual machine dyes. Thus, as recipient's destination virtual machineCan judge and should preserve which message to form the snapshot of communication port. Like this, by carrying outMethod 200, each virtual machine has not only created the local express photograph of oneself, has also created and itThe snapshot of associated communication port. Shine and he by the local express that combines all individual virtual machinesThe communication port snapshot that creates, just can generate the snapshot (cluster of whole cluster virtual machineThis also will below describe in detail the generation method of snapshot in conjunction with Fig. 4).
Below with reference to Fig. 3, its show according to the present invention another exemplary embodiment for lifeThe snapshot that becomes to be associated with a virtual machine in cluster virtual machine is for generating cluster snapshotThe indicative flowchart of method 300. Identical with method 200, according to embodiments of the invention,Method 300 can be performed for each virtual machine in cluster, and can be by with virtualThe snapshot agent that machine is associated is carried out. Will be understood that, method 300 can be considered to aboveA kind of specific specific implementation of the method 200 of describing in conjunction with Fig. 2.
After method 300 starts, at step S302, start virtual machine in response to snapshot instructionThe establishment of local express photograph. Snapshot instruction is for example sent out by the virtual machine that serves as coordinator in clusterGo out, this also will be explained below. In addition, according to embodiments of the invention, virtual machine local expressAccording to establishment can start in response to snapshot instruction and at once. Alternatively, virtual machine local express shinesEstablishment also can start a period of time after receiving snapshot instruction, need only for example not lateIn receiving from cluster, first of other virtual machines is colored (having dye marker)Import message into. This is only exemplary, and other startup opportunitys or trigger condition are also possible.
In the embodiment shown in method 300, create the local express of virtual machine according to comprising twoIndividual step, that is, be activated in response to the establishment of virtual machine local express photograph at step S304, temporarilyStop the operation of virtual machine; And at step S306, on backstage, storage is relevant to this virtual machineData and state are using the part as local express photograph.
Be appreciated that step S302-S306 is corresponding to the step S202 describing with reference to figure 2 above,, create the local express photograph of virtual machine. Especially, according to embodiments of the invention, carry out stepRapid S304 is not necessary with the operation that suspends virtual machine, that is, step S304 is optional.According to some alternative, can continue to preserve the snapshot moment in the situation that of execution at virtual machineThereby virtual machine state create local express shine. Scope of the present invention is unrestricted in this regard.
In addition, in the embodiment being suspended at virtual machine, the operation of virtual machine can be in stepThe term of execution of S306 or afterwards, recover. For example, in certain embodiments, can be at markAfter needing the local state of virtual machine of storage or recover virtual after actual storage completesThe normal operation of machine. Alternatively or additionally, virtual machine also can be extensive in response to other conditionsMultiple operation, for example time-out reaches the scheduled time, receives the explicit recovery instruction from cluster,Etc.. Scope of the present invention is unrestricted in this regard.
Next method 300 performs step S308, this make all will be from virtual machine by logicalThe outgoing message that letter passage sends to other virtual machines in cluster is added dye marker, that is,Be colored. The entrained dye marker of outgoing message will indicate to destination virtual machine: this messageThat source virtual machine sends after the snapshot moment. As described above, according to enforcement of the present inventionExample, this type of dye marker can, by means of not realizing with position in message package, also canAdd special extra order to message package. Any message known or exploitation in the future is dyed at presentLook mechanism all can be combined with embodiments of the invention.
Then at step S310, receive the biography from other virtual machines in cluster by communication portEnter message. Now, because virtual machine is in halted state, therefore receive at step S310The message of importing into be not to be directly forwarded to virtual machine, but for example by manner of execution 300Snapshot agent is processed in advance.
Note, although step S308 and S310 are presented to step S304 and S306 in Fig. 3Afterwards, but this is only used to illustrate clear object. In fact, step S308 and S310The startup that is in response to equally local snapshot creation in step S302 is carried out. In other words,The operation of step S308 and S310 and step S304 and/or S306 can carry out simultaneously orExist at least in part overlapping.
Whether next, method 300 proceeds to step S312, import message into have in this judgementDye marker. As mentioned above, one imports message into and does not have dye marker and illustrate that this message is soonBe the message in transit being transmitted on communication port according to the moment, thereby should be stored in collectionIn group's snapshot (more particularly, being kept in the snapshot of communication port). On the other hand,There is dye marker if import message into, illustrate this message be source virtual machine the snapshot moment itJust send afterwards, therefore without a part of preserving as cluster snapshot.
Particularly, as shown in Figure 3, if determine and import not tool of message at step S312 placeHave dye marker (branch's "No"), method 300 proceeds to step S314, will be not at thisThere is the message stores of dye marker in the buffering area being associated with current virtual machine. Method300 proceed to step S318 then, and this will be explained below.
On the other hand, if at step S312 place determine import into message have dye marker (pointProp up "Yes"), method 300 is carried out a series of corresponding by the message of importing into that this type of is coloredProcess. Usually, according to the embodiment of the present invention, this class has the message of dye markerProcessing not to make the snapshot of communication port that any renewal or change occur. Particularly, method300 proceed to step S316 along branch's "Yes" of step S312, remove institute in message at thisThe dye marker carrying. Method 300 proceeds to step S318 then.
Next at step S318, judge whether virtual machine resumes operation. As mentioned above,The operation that suspends virtual machine at step S304 is optional. Correspondingly, step S318 is also canChoosing. In other words,, in the situation that virtual machine operations is not suspended, method 300 can be in stepSkips steps S318 after rapid S314 and S316 and directly perform step S320.
Particularly, if determine the virtual machine (branch of not yet resuming operation at step S318 place"No"), method 300 is returned to step S310 and is imported message into continue receiving other. AnotherAspect, if determine recovery operation of virtual machine (branch's "Yes") at step S318 place,Method 300 proceeds to step S320, at this, virtual machine interval is received, processThe message of importing into of processing is transmitted to virtual machine. Be appreciated that at step S320 place and be forwarded toThe message of virtual machine comprise and be buffered in all not tools in buffering area at step S314Have the message of importing into of dye marker, also comprise originally there is dye marker, but in stepS316 be removed dye marker those import message into.
Note, step S320 by buffering area not the message with dye marker be transmitted to virtualMachine does not represent these message to delete from buffering area. On the contrary, these message still can be byThis is kept in buffering area so that in subsequent step S324 processing, will be explained below.
After step S320, at step S322 place, judgement is associated with virtual machine method 300Predetermined state whether be met. According to embodiments of the invention, predetermined condition is conventionally with emptyThe state of plan machine is relevant. For example, in certain embodiments, predetermined condition can be included in stepThe establishment of the virtual machine local express photograph that S302 place starts completes. Alternatively, predetermined conditionCan also comprise from the moment of step S302 startup local express photograph and start at and passed through oneThe predetermined period. For example, according to some embodiment of the present invention, can all obtain at these twoWhile meeting, think that predetermined condition is met. In other words, can after in these two conditions, meetThat be as the criterion. Note, these predetermined conditions are only exemplary, and other predetermined conditions are sameWithin the scope of the present invention.
If determine that at step S322 place predetermined condition is not satisfied (branch's "No"),Method 300 is returned to step S310 and is continued to receive the message of importing into from other virtual machines. AnotherAspect, if determine that at step S322 place predetermined condition is met (branch's "Yes"),Method 300 proceeds to step S324, has been buffered in not being with in buffering area in this storageThe relevant information of all message of dye marker, using one of the communication port snapshot as clusterPoint. Here the relevant information of said message comprises message itself, also can comprise message source,Destination and other any relevant parameters or information.
After execution step S324, can think that the snapshot being associated with virtual machine createsBuild. The snapshot generating comprises two parts generally: the local express of virtual machine shines and communicates by letterPassage snapshot.
Alternatively, method 300 performs step S326 then, adds to spreading out of message to stopDye marker. In other words, meet in response to predetermined condition, this virtual machine will communicated by letterOn passage, send to the message that spreads out of of other virtual machines in cluster to be no longer added dye marker(, being no longer colored). This is because now the snapshot of virtual machine is generated.
Note, step S326 is optional, and it can be according to different suitable from step S324Order is carried out or is carried out simultaneously. Method 300 finishes after step S326.
Can see, in the embodiment shown in fig. 3, not receive undyed biography at every turnEnter message and just preserved to create at once communication port snapshot, but in predetermined condition (for example,Local snapshot creation completes, or overtime) unifiedly afterwards preserve not having of receiving during this periodDye marker import message into. Certainly, this is only exemplary, is in fact receiving oftenThe individual message of importing into or not dye marker with regard to being stored as communication port snapshot is at once also afterwardsFeasible.
Above referring to figs. 2 and 3 described each virtual machine in cluster virtual machine asWhat generating snapshot. Below with reference to Fig. 4, it shows according to an illustrative embodiment of the inventionThe indicative flowchart of the method that is used to whole cluster virtual machine generating snapshot 400.
After method 400 starts, at step S402, by selected in the multiple virtual machines in clusterFor example, for coordinator's a virtual machine (, being designated as " the first virtual machine ") is to other virtual machinesThe instruction of transmission snapshot. According to embodiments of the invention, the first virtual machine can be selected at random.Mode of operation that alternatively, the selection of the first virtual machine can be based on each virtual machine in cluster,Load, etc. And for example, the first virtual machine can be also agreement or artificial appointment in advance.In a word, can select or refer to according to any suitable mode as the first virtual machine of coordinatorFixed, scope of the present invention is unrestricted in this regard.
Next,, at step S404, all virtual machines in cluster (comprise as coordinator'sThe first virtual machine itself) generate snapshot associated therewith in response to snapshot instruction. Especially,According to embodiments of the invention, each virtual machine for example, according to above-described method (, sideMethod 200 or 300) generate the snapshot being associated. In this way, the snapshot bag generatingDraw together the local express photograph of virtual machine, and the snapshot of the communication port being associated with this virtual machine.
Finally, at step S406, all virtual machines from cluster are collected this virtual machine generatingLocal express according to and the snapshot of communication port. These snapshots are combined, and have generated collectionGroup is at the snapshot in given snapshot moment. As example, according to some embodiment of the present invention, everyA virtual machine can be submitted to result as coordinator's after snapshot creation completesOne virtual machine, so that the snapshot each virtual machine being generated by the first virtual machine (comprises local expressAccording to communication port snapshot) gather and integrate. Alternatively, each virtual machine also canBy the snapshot of each self-generating be stored in can public visit memory location so that the first virtual machine fromHere access and obtain snapshot. Various Committing Mechanisms are all possible, and scope of the present invention is at thisAspect is unrestricted.
Below with reference to Fig. 5, its show according to an illustrative embodiment of the invention for willThe cluster virtual machine that comprises multiple virtual machines returns to the showing of method 500 in given snapshot momentMeaning property flow chart. Note, cluster is that basis is above with reference to figure 4 at the snapshot in described snapshot momentDescribe method 400 and generate.
After method 500 starts, at step S502, in the multiple virtual machines by cluster, be chosen asThe first virtual machine of coordinator sends and recovers instruction to other virtual machines. According to enforcement of the present inventionExample, the first virtual machine can be selected at random. Alternatively, the selection of the first virtual machine canMode of operation based on each virtual machine in cluster, load, etc. And for example, the first virtual machineAlso can be agreement or artificial appointment in advance. In a word, as the first virtual machine of coordinatorCan select or specify according to any suitable mode, scope of the present invention be subject in this regardRestriction.
Especially, in certain embodiments, serve as the first void of coordinator at step S502 placePlan machine is identical with the first virtual machine that serves as coordinator in method 400 at step S402 place. WhenSo, the two also can be different.
Next, method 500 proceeds to step S504, in response to recovering instruction, makes in clusterEach virtual machine (comprising the first virtual machine itself as coordinator) according to this virtual machineThe local express of oneself is according to the state that returns to the snapshot moment. According to local snapshot restore virtual machineRunning status is well known by persons skilled in the art, does not repeat them here.
Finally, at step S506, load the message of having stored according to communication port snapshot, make everyA described message is sent to destination virtual machine. For example, these message can be loaded intoIn virtual machine, be responsible for the local virtual interchanger of information receiving and transmitting, and be sent to immediately correctDestination virtual machine.
According to some embodiment of the present invention, each virtual machine can complete it in recovery operationAfter submit to the first virtual machine as coordinator using completing report. The first virtual machine is receivingAfter the recovery of all virtual machines completes report in cluster, confirm that the recovery operation of cluster completes.Alternatively, each virtual machine also recovery separately can be completed report be stored in and can publicly visitThe memory location of asking, so that the first virtual machine has recovered report from accessing and obtaining here. RespectivelyIt is all possible planting Committing Mechanism, and scope of the present invention is unrestricted in this regard.
With reference now to Fig. 6,, its show according to an illustrative embodiment of the invention for lifeThe snapshot that becomes to be associated with a virtual machine in cluster virtual machine is for generating cluster snapshotThe schematic block diagram of equipment 600. This virtual machine is by other void in communication port and clusterThe communication of plan machine.
As shown in the figure, equipment 600 comprises: local fast photographing device 602, be configured in response toSnapshot instruction and the local express that creates described virtual machine shines; Message dyeing apparatus 604, configuration is usedWill send to described cluster from described virtual machine in making in response to the startup of described establishmentEach message that spreads out of of other virtual machines be added dye marker, described dye marker is just being indicatedShine at the described local express that creates described virtual machine; And passage fast photographing device, be configured for soundOther virtual machines described in Ying Yucong in cluster receive does not have importing into of described dye markerMessage and import the relevant information of message described in storing into as the portion of the snapshot of described communication portPoint.
According to some optional embodiment of the present invention, described local fast photographing device 602 can comprise:Pause device, is configured for the operation that suspends described virtual machine; And back-up device, configuration is usedIn store data and the state relevant to described virtual machine on backstage. According to of the present invention some canSelect embodiment, equipment 600 may further include: recovery device, is configured at backup dressThe term of execution of putting or the operation that recovers afterwards described virtual machine.
According to some optional embodiment of the present invention, message dyeing apparatus 604 can comprise: theOne dyeing apparatus, be configured for spread out of described in utilization message package with position, institute is not setState dye marker; Or the second dyeing apparatus, be configured for to described package add extra order withBe used for arranging described dye marker.
According to some optional embodiment of the present invention, passage fast photographing device 606 can comprise: disappearBreath buffer storage, is configured for the described message buffering that imports in buffering area; The first message turnsTransmitting apparatus, is configured for the described message of importing into is transmitted to described virtual machine; And message storesDevice, is configured in response to definite predetermined condition relevant to described virtual machine and is met,Described in storage, import the relevant information of message into as the part of the snapshot of described communication port.
According to some optional embodiment of the present invention, equipment 600 may further include: through dyingLook message processing apparatus, is configured in response to other virtual machines from described cluster and receivesThere is the message of importing into of described dye marker, process have described dye marker described in import into and disappearBreath and do not upgrade the snapshot of described communication port.
According to some optional embodiment of the present invention, dyed message processing apparatus can comprise:Message solution dyeing apparatus, be configured for from have described dye marker described in import message into and removeDescribed dye marker; And second message transmission device, be configured for and will described in process, removeThe described message of importing into is transmitted to described virtual machine.
According to some optional embodiment of the present invention, equipment 600 may further include: dyeingForbidden device, is configured in response to the predetermined condition being associated with described virtual machine and obtains completelyEnough, make to send to from described virtual machine each biography of other virtual machines described clusterOutbound message is not added dye marker.
According to some optional embodiment of the present invention, it is one of following that described predetermined condition comprises: instituteThe described local snapshot creation of stating virtual machine completes; And from starting to create the institute of described virtual machineState local express according to starting at through scheduled time slot.
For clarity, in Fig. 6, do not illustrate what optional device and each device comprisedSub-device. But, should be appreciated that each device comprising in equipment 600 corresponds respectively toLiterary composition is referring to figs. 2 and 3 each step of the method 200 and 300 of describing. Thus, above joinExamining Fig. 2 and Fig. 3 the operation described and feature is equally applicable to equipment 600 and wherein comprisesDevice, does not repeat them here.
In addition, should be appreciated that equipment 600 can utilize variety of way to realize. For example,, at certainIn a little embodiment, equipment 600 can utilize software and/or firmware to realize. For example, equipment600 may be implemented as the application that each virtual machine in cluster is associated, for example, be called voidPlan machine snapshot agent. Alternatively or additionally, partially or fully base of equipment 600Realize in hardware. Other modes known or exploitation in the future are also feasible now, thisBright scope is unrestricted in this regard.
Below with reference to Fig. 7, it shows the department of computer science being suitable for for putting into practice the embodiment of the present inventionThe schematic block diagram of system 700. For example, computer system 700 can be served as virtual machine and resided atPhysical machine on it.
As shown in Figure 7, computer system can comprise: CPU (CPU) 701,RAM (random access memory) 702, ROM (read-only storage) 703, system bus704, hard disk controller 705, KBC 706, serial interface controller 707, parallelEstablish interface controller 708, display controller 709, hard disk 710, keyboard 711, serial outsideStandby 712, parallel external equipment 713 and display 714. In these equipment, total with systemWhat line 704 was coupled have CPU701, RAM702, ROM703, hard disk controller 705,KBC 706, serialization controller 707, parallel controller 708 and display controller 709.Hard disk 710 is coupled with hard disk controller 705, and keyboard 711 is coupled with KBC 706,Serial external equipment 712 is coupled with serial interface controller 707, parallel external equipment 713 withParallel interface controller 708 is coupled, and display 714 is coupled with display controller 709.Should be appreciated that the structured flowchart described in Fig. 7 illustrates just to the object of example, and notLimit the scope of the present invention. In some cases, can be as the case may be and increase orPerson reduces some equipment.
As mentioned above, equipment 600 can be realized by hardware, for example chip, ASIC, SOCDeng. These hardware can be integrated in computer system 700. In addition embodiments of the invention,Also can realize by the form of computer program. For example, describe with reference to figure 2-Fig. 5Method 200-500 can realize by computer program. This computer program canTo be stored in example RAM704, ROM704, hard disk 710 and/or any as shown in Figure 7In suitable storage medium, or download to computer system by network from suitable positionOn 700. Computer program can comprise computer code part, and it comprises can be by suitablyTreatment facility (for example, the CPU701 shown in Fig. 7) carry out programmed instruction. DescribedProgrammed instruction at least can comprise any one or more the step for implementation method 200-500Rapid instruction.
Spirit of the present invention and principle are explained in conjunction with some specific embodiments above. According toEmbodiments of the invention, provide a kind of and have dyeed and become cluster virtual machine machine-processed next life by means of messageThe technical scheme of snapshot. When the snapshot of generating virtual machines cluster, not only can obtain in this wayThe local express photograph of each virtual machine, and can effectively record snapshot moment communication portState. Like this, compared with prior art, embodiments of the present invention can more have with oneEffect, reliably and flexibly method generates the snapshot for cluster virtual machine.
According to embodiments of the invention, cluster snapshot operation can be by the snapshot of each virtual machineAgency carries out. Like this, cluster snapshot has the good transparency, for answering on virtual machineWith with OS be all transparent. And this scheme has good autgmentability and versatility,Back compatible has cluster virtual machine framework, for example collection based on TCP or UDP network serviceGroup.
It should be noted that embodiments of the invention can pass through hardware, software or software and hardwareCombination realize. Hardware components can utilize special logic to realize; Software section can be depositedStore up in memory, by suitable instruction execution system, for example microprocessor or special designsHardware is carried out. Those having ordinary skill in the art will appreciate that above-mentioned equipment and method are passableWith computer executable instructions and/or be included in processor control routine and realize, for example, existSuch as the mounting medium of disk, CD or DVD-ROM, such as read-only storage (firmware)Programmable memory or data medium such as optics or electronic signal carrier on provideSuch code. Equipment of the present invention and module thereof can be by such as super large-scale integrationOr gate array, such as the semiconductor of logic chip, transistor etc. or such as field-programmableThe hardware circuit of the programmable hardware device of gate array, programmable logic device etc. is realized, and also canTo use the software of being carried out by various types of processors to realize, also can be by above-mentioned hardware circuit andFor example firmware of the combination of software is realized.
The communication network of mentioning in description can comprise disparate networks, includes but not limited to localNet (" LAN "), wide area network (" WAN "), according to the network of IP agreement (for example, because ofSpecial net) and ad-hoc network (for example, adhoc peer-to-peer network).
Although it should be noted that some devices or the son dress of having mentioned equipment in above-detailedPut, but this division is only not enforceable. In fact, according to embodiments of the invention,The feature of above-described two or more devices and function can be specialized in a device.Otherwise the feature of an above-described device and function can Further Division be by multiple dressesPut and specialize.
In addition, although described in the accompanying drawings the operation of the inventive method with particular order,,This not requires or hint must be carried out these operations according to this particular order, or necessaryOperation shown in carrying out all could realize the result of expecting. On the contrary, the step of describing in flow chartSuddenly can change execution sequence. Additionally or alternatively, can omit some step, by multipleStep is merged into a step and is carried out, and/or a step is decomposed into multiple steps execution.
Although described the present invention with reference to some specific embodiments, should be appreciated that, thisInvention is not limited to disclosed specific embodiment. The present invention is intended to contain claimsIncluded various amendments and equivalent arrangements in spirit and scope. The scope symbol of claimsClose the most wide in range explanation, thereby comprise all such amendments and equivalent structure and function.
Claims (18)
1. the snapshot that a generation is associated with a virtual machine in cluster virtual machine forGenerate the method for the snapshot of described cluster, described virtual machine is by communication port and described clusterThe communication of other virtual machines, described method comprises:
In response to snapshot instruction, the local express that creates described virtual machine shines;
In response to the startup of described establishment, make to send to described cluster from described virtual machineEach of other virtual machines spread out of message and be added dye marker, described dye marker instructionThe described local express that is creating described virtual machine shines; And
Receive and do not there is described dye marker in response to other virtual machines from described clusterImport message into, import the relevant information of message into as the snapshot of described communication port described in storagePart.
2. method according to claim 1, the local express that wherein creates described virtual machine shinesComprise:
Suspend the operation of described virtual machine;
At backstage storage data and the state relevant to described virtual machine; And
In described backstage memory period or the operation that recovers afterwards described virtual machine.
3. method according to claim 1, wherein to sending to from described virtual machineEach of other virtual machines in described cluster spreads out of message interpolation dye marker and comprises:
Described in utilization, spread out of message package with position described dye marker is not set; Or
Add extra order for described dye marker is set to described package.
4. method according to claim 1, wherein in response to other from described clusterVirtual machine receives not to be had the importing into of described dye marker and imports message described in message stores intoRelevant information comprises as the part of the snapshot of described communication port:
Described in inciting somebody to action, import message buffering in buffering area;
Described in inciting somebody to action, import message into and be transmitted to described virtual machine; And
Be met in response to definite predetermined condition relevant to described virtual machine, store described biographyEnter the relevant information of message as the part of the snapshot of described communication port.
5. method according to claim 1, further comprises:
Receive and there is described dye marker in response to other virtual machines from described clusterImport message into, process have described dye marker described in import message into and do not upgrade described communicationThe snapshot of passage.
6. method according to claim 5, wherein processes the institute with described dye markerState and import message into and comprise:
From have described dye marker described in import message into and remove described dye marker; And
Be transmitted to described virtual machine by importing message into described in removing described in process.
7. method according to claim 1, further comprises:
Be met in response to the predetermined condition being associated with described virtual machine, making will be from describedVirtual machine send to other virtual machines in described cluster each spread out of message and be not addedDye marker.
8. according to the method described in claim 4 or 7, wherein said predetermined condition comprises followingAt least one:
The described local snapshot creation of described virtual machine completes; And
From the described local express that starts to create described virtual machine according to starting at through scheduled time slot.
9. for the method for the snapshot of generating virtual machines cluster, described cluster comprise utilize logicalMultiple virtual machines that letter passage communicates with one another, described method comprises:
By the first virtual machine that is chosen as coordinator in described multiple virtual machines to other virtual machinesThe instruction of transmission snapshot;
In response to described snapshot instruction, generate according to the method described in claim 1-8 any oneThe snapshot being associated with each virtual machine in described multiple virtual machines; And
Collect the described snapshot being associated with each virtual machine in described multiple virtual machines, withFor generating the snapshot of described cluster.
10. cluster virtual machine is returned to the method in given snapshot moment, described clusterComprise multiple virtual machines, and described cluster is in the snapshot right to use requirement in described snapshot momentMethod described in 9 and generating, described method comprises:
By the first virtual machine that is chosen as coordinator in described multiple virtual machines to other virtual machinesSend and recover instruction;
In response to described recovery instruction, make each virtual machine of described multiple virtual machines according to being somebody's turn to doThe local express of virtual machine is according to the state that returns to the described snapshot moment; And
Load the message of having stored according to the snapshot of described communication port, make to disappear described in eachBreath is sent to destination virtual machine.
11. 1 kinds is the equipment of a virtual machine generating snapshot in cluster virtual machine, described voidPlan machine is communicated by letter with other virtual machines in described cluster by communication port, and described equipment comprises:
Local fast photographing device, is configured for the basis that creates described virtual machine in response to snapshot instructionGround snapshot;
Message dyeing apparatus, is configured for that make in response to the startup of described establishment will be from describedVirtual machine send to other virtual machines in described cluster each spread out of message and be added and dyeColor marker, the described local express that described dye marker instruction is creating described virtual machine shines; WithAnd
Passage fast photographing device, is configured in response to other virtual machines from described cluster and receivesDescribed in storing, import the relevant information of message into not thering is the importing message into of described dye markerAs the part of the snapshot of described communication port.
12. equipment according to claim 11, wherein said local fast photographing device comprises:
Pause device, is configured for the operation that suspends described virtual machine;
Back-up device, is configured at backstage storage data and the shape relevant to described virtual machineState; And
Recovery device, is configured in the operating period of described back-up device or described in recovering afterwardsThe operation of virtual machine.
13. equipment according to claim 11, wherein said message dyeing apparatus comprises:
The first dyeing apparatus, is configured for not the coming with position of package that spreads out of message described in utilizationDescribed dye marker is set; Or
The second dyeing apparatus, is configured for to described package and adds extra order for described in arrangingDye marker.
14. equipment according to claim 11, wherein said passage fast photographing device comprises:
Message buffering device, is configured for the described message buffering that imports in buffering area;
The first message transmission device, is configured for the described message of importing into is transmitted to described virtualMachine; And
Message storage devices, is configured in response to definite predetermined bar relevant to described virtual machinePart is met, and imports the relevant information of message into as the snapshot of described communication port described in storagePart.
15. equipment according to claim 11, further comprise:
Dyed message processing apparatus, is configured in response to other from described cluster virtualMachine receives the message of importing into described dye marker, processes the institute with described dye markerState the snapshot that imports message into and do not upgrade described communication port.
16. equipment according to claim 15, wherein said dyed message processing apparatusComprise:
Message solution dyeing apparatus, be configured for from have described dye marker described in import message intoRemove described dye marker; And
The second message transmission device, is configured for and turns importing message into described in removing described in processIssue described virtual machine.
17. equipment according to claim 11, further comprise:
Dyeing forbidden device, is configured in response to the predetermined condition being associated with described virtual machineBe met, make to send to the every of other virtual machines described cluster from described virtual machineOne spreads out of message and is not added dye marker.
18. according to the equipment described in claim 14 or 17, and wherein said predetermined condition comprisesBelow at least one:
The described local snapshot creation of described virtual machine completes; And
From the described local express that starts to create described virtual machine according to starting at through scheduled time slot.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210103120.5A CN103365741B (en) | 2012-03-30 | 2012-03-30 | For the snapshot of cluster virtual machine and the method and apparatus of recovery |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210103120.5A CN103365741B (en) | 2012-03-30 | 2012-03-30 | For the snapshot of cluster virtual machine and the method and apparatus of recovery |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103365741A CN103365741A (en) | 2013-10-23 |
| CN103365741B true CN103365741B (en) | 2016-05-04 |
Family
ID=49367159
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210103120.5A Active CN103365741B (en) | 2012-03-30 | 2012-03-30 | For the snapshot of cluster virtual machine and the method and apparatus of recovery |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103365741B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103729264B (en) * | 2013-12-23 | 2016-07-13 | 国云科技股份有限公司 | A kind of Windows virtual machine system disk backup and reduction method |
| CN105117346A (en) * | 2015-09-24 | 2015-12-02 | 上海爱数软件有限公司 | Automatic testing method and system for distributed system of virtualization platform |
| JP6810163B2 (en) * | 2016-05-02 | 2021-01-06 | ノキア ソリューションズ アンド ネットワークス オサケユキチュア | Snapshot generation in a virtual network environment |
| CN107844420B (en) * | 2017-10-27 | 2020-08-28 | 南京国电南自电网自动化有限公司 | Binary online simulation and error checking method based on virtual machine snapshot |
| CN109753340B (en) * | 2017-11-08 | 2021-07-13 | 阿里巴巴集团控股有限公司 | Virtual machine snapshot processing method, device and system |
| CN109783272B (en) * | 2017-11-10 | 2023-01-24 | 阿里巴巴集团控股有限公司 | Disk snapshot processing method, device and equipment |
| CN108959547B (en) * | 2018-07-02 | 2022-02-18 | 上海浪潮云计算服务有限公司 | PV snapshot distributed database cluster recovery method |
| CN110972497A (en) * | 2018-11-02 | 2020-04-07 | 深信服科技股份有限公司 | Disaster recovery method and device for virtualization platform |
| CN111008095A (en) * | 2019-12-17 | 2020-04-14 | 山东超越数控电子股份有限公司 | State snapshot generation and recovery method facing edge cloud |
| CN113791870B (en) * | 2021-09-24 | 2024-03-26 | 上海交通大学 | WebAssemble virtual machine distributed system fine granularity migration method and system |
| CN116150797B (en) * | 2023-04-21 | 2023-08-01 | 深圳市科力锐科技有限公司 | Data protection method, system, equipment and storage medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101097526A (en) * | 2006-06-29 | 2008-01-02 | 联想(北京)有限公司 | Virtual machine system and accessing control method of hardware equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ATE497210T1 (en) * | 2005-06-24 | 2011-02-15 | Syncsort Inc | SYSTEM AND METHOD FOR VIRTUALIZING BACKUP IMAGES |
| KR101272612B1 (en) * | 2009-12-01 | 2013-06-10 | 한국전자통신연구원 | Method and apparatus for switchng communication channel in shared memory communication environment |
| US8510590B2 (en) * | 2010-03-17 | 2013-08-13 | Vmware, Inc. | Method and system for cluster resource management in a virtualized computing environment |
-
2012
- 2012-03-30 CN CN201210103120.5A patent/CN103365741B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101097526A (en) * | 2006-06-29 | 2008-01-02 | 联想(北京)有限公司 | Virtual machine system and accessing control method of hardware equipment |
Non-Patent Citations (1)
| Title |
|---|
| 《虚拟集群环境下多虚拟机协同检查点容错系统》;张旻佳;《万方学位论文》;20110920;第2.2节、2.3.2节、第2.6.1节 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103365741A (en) | 2013-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103365741B (en) | For the snapshot of cluster virtual machine and the method and apparatus of recovery | |
| CN103688505B (en) | Network filtering in virtualized environment | |
| CN104685830B (en) | Method, entity and the system of fault management | |
| CN107608757B (en) | Container-based isolation processing method and related equipment | |
| CN110932910B (en) | Method and device for recording logs of software faults | |
| CN107291750A (en) | A kind of data migration method and device | |
| CN106293704A (en) | Dynamic micro services edit methods, device and the server of multilingual cloud compiling | |
| CN108259200B (en) | A kind of physical network function PNF moving method and relevant device | |
| CN107005586B (en) | Method and device for managing virtual network function | |
| US20070094675A1 (en) | Object mobility | |
| US9043638B1 (en) | Method for enhancing memory fault tolerance | |
| WO2013061213A1 (en) | Passive monitoring of virtual systems using extensible indexing | |
| CN104216771B (en) | The method for restarting and device of software program | |
| CN112882792B (en) | Information loading method, computer device and storage medium | |
| CN104793981B (en) | A kind of online snapshot management method and device of cluster virtual machine | |
| EP4200700A1 (en) | System and method for a hybrid development platform | |
| CN106790658A (en) | A kind of Docker network plug-ins implementation method | |
| CN110737504B (en) | Fault-tolerant method, system, terminal and storage medium for deep learning model training | |
| CN106406980A (en) | Deployment method and device for virtual machines | |
| CN106385330A (en) | Network function virtualization composer realization method and device | |
| CN113886055A (en) | Intelligent model training resource scheduling method based on container cloud technology | |
| CN112860400A (en) | Method, system, device and medium for processing distributed training task | |
| CN104317673B (en) | Recovery method, device and its restoration methods of application program, device | |
| CN110908644A (en) | Configuration method and device of state node, computer equipment and storage medium | |
| CN116382944A (en) | Transaction-level memory data sharing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200408 Address after: Massachusetts, USA Patentee after: EMC IP Holding Company LLC Address before: Massachusetts, USA Patentee before: EMC Corp. |