CN114546766A - Data disk-dropping method, system and device based on Monitor and storage medium - Google Patents

Data disk-dropping method, system and device based on Monitor and storage medium Download PDF

Info

Publication number
CN114546766A
CN114546766A CN202210130373.5A CN202210130373A CN114546766A CN 114546766 A CN114546766 A CN 114546766A CN 202210130373 A CN202210130373 A CN 202210130373A CN 114546766 A CN114546766 A CN 114546766A
Authority
CN
China
Prior art keywords
data
monitor
abnormal
election
setting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210130373.5A
Other languages
Chinese (zh)
Inventor
黄志金
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Inspur Intelligent Technology Co Ltd
Original Assignee
Suzhou Inspur Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Inspur Intelligent Technology Co Ltd filed Critical Suzhou Inspur Intelligent Technology Co Ltd
Priority to CN202210130373.5A priority Critical patent/CN114546766A/en
Publication of CN114546766A publication Critical patent/CN114546766A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0709—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0793—Remedial or corrective actions
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Computer Hardware Design (AREA)
  • Mathematical Physics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a data disk-dropping method, a system, a device and a storage medium based on Monitor, wherein the method comprises the following steps: reading data, and determining whether the data is successfully landed or not by judging whether the data exists or not; if the data is not successfully landed, setting an abnormal Monitor not to participate in the election and then initiating the election; setting the abnormal Monitor to be in a data modification state, and pulling required data from other monitors; if the data is successfully pulled, performing data dropping on the abnormal Monitor; and if the data pulling fails, discarding the corresponding data application message. The invention can ensure that the Monitor can pull the required information from other monitors under the condition of data loss, thereby ensuring the stable operation of the service and greatly increasing the fault tolerance rate and the stability of the system.

Description

Data disk-dropping method, system and device based on Monitor and storage medium
Technical Field
The invention relates to the technical field of computers, in particular to a data-based method, a data-based system, a data-based device and a data-based storage medium.
Background
The Monitor is a manager of the cluster state, and the main task of the Monitor is to maintain the consistency of the cluster view, and a Paxos algorithm (protocol) is used when maintaining the consistency, and is instantiated in the database, so that subsequent access is facilitated. The Monitor consists of three parts, namely K/V storage, paxos and Paxosservice. K/V stores the persistent layer storage layer used for Monitor data, paxos provides consistent data access logic for the PaxosService layer, each PaxosService represents a kind of state information of the cluster, and the paxosServer is an abstraction actually, and includes: PGMonitor, OSDMonitor, MDSMonitor, AuthMonitor, LogMonitor, etc.
To avoid single point of failure or performance hot spot problems, multiple Monitor services are typically deployed in a production environment. To ensure the consistency of the cluster information, the Monitor cluster needs a Leader Monitor to determine the change of the information, which is the election of the Monitor. In the running process of the Monitor, all writing operations are finished by sending out an agenda by the Leader Monitor. If the non-Leader Monitor receives the update request, the request is forwarded to the Leader Monitor, so that the consistency of the data in the Monitor cluster is ensured. The Monitor data is deployed on top of the Nvme. If power failure or data silence error occurs during the disk dropping process, the disk dropping may fail. At this time, the Map has a corresponding version number, but the data of the version has not been successfully landed. Therefore, when the Monitor acquires the data of the version, the Monitor cannot acquire the desired data, and at the moment, the Monitor throws an exception and generates a core file.
Therefore, how to effectively avoid the possible failure of disk-dropping caused by power failure or data silence error when Monitor data in the Ceph distributed storage system is dropped on the disk is a problem to be solved urgently.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide a data-based method, a system, a device and a storage medium for dropping data on a disk based on a Monitor, which can enable the Monitor to pull required information from other monitors when data is missing, thereby ensuring stable operation of services and greatly increasing the fault tolerance and stability of the system.
In order to achieve the purpose, the invention is realized by the following technical scheme: a data landing method based on Monitor comprises the following steps:
reading data, and determining whether the data is successfully landed or not by judging whether the data exists or not;
if the data is not successfully landed, setting an abnormal Monitor not to participate in the election and then initiating the election;
setting the abnormal Monitor to be in a data modification state, and pulling required data from other monitors;
if the data is successfully pulled, performing data dropping on the abnormal Monitor;
and if the data pulling fails, discarding the corresponding data application message.
Further, the setting of the abnormal Monitor and initiating the election after not participating in the election includes:
setting the selecting _ me option of the abnormal Monitor to false so that the abnormal Monitor does not participate in election;
and traversing the montap and sending election messages to each Monitor member in the montap.
Further, the setting the abnormal Monitor to the data modification state and pulling the required data from other monitors includes:
setting the abnormal Monitor to be in a data modification state;
the abnormal Monitor sends a message for requesting corresponding data to each Monitor member in the montap by traversing the montap;
judging whether the returned information contains the corresponding data of the request or not;
if so, the data pulling is successful, otherwise, the data pulling is failed.
Further, the data dropping to the abnormal Monitor further includes:
setting the selecting _ me option of the abnormal Monitor to true;
and reinitiating election and sending a prompt message to each Monitor member by traversing the montap again.
Further, the discarding the corresponding data application message includes:
and saving the corresponding data application message to a callback queue.
Correspondingly, the invention also discloses a data falling system based on Monitor, comprising:
the reading module is used for reading data and determining whether the data is successfully landed or not by judging whether the data exists or not;
the abnormal Monitor control module is used for setting the abnormal Monitor not to participate in the election and then initiating the election;
the data pulling module is used for setting the abnormal Monitor to be in a data modification state and pulling the required data from other monitors;
the storage module is used for performing data destaging on the abnormal Monitor after the data is successfully pulled;
and the exception handling module is used for abandoning the corresponding data application message after the data pulling fails.
Further, the exception Monitor control module includes:
the setting unit is used for setting the selecting _ me option of the abnormal Monitor to false so that the abnormal Monitor does not participate in election;
and the election message sending unit is used for traversing the montap and sending the election message to each Monitor member in the montap.
Further, the data pulling module includes:
the state modification unit is used for setting the abnormal Monitor to be in a data modification state;
the data synchronization unit is used for sending a message requesting corresponding data to each Monitor member in the montap by the abnormal Monitor through traversing the montap;
and the judging unit is used for judging whether the returned information contains the corresponding data of the request.
Correspondingly, the invention discloses a data falling device based on Monitor, comprising:
the memory is used for storing a data landing program based on the Monitor;
a processor, configured to implement the steps of the Monitor-based data destaging method according to any one of the above items when executing the Monitor-based data destaging program.
Correspondingly, the invention discloses a readable storage medium, wherein a data landing program based on Monitor is stored on the readable storage medium, and when being executed by a processor, the data landing program based on Monitor realizes the steps of the data landing method based on Monitor as described in any one of the above.
Compared with the prior art, the invention has the beneficial effects that: the invention discloses a data-landing method, a system, a device and a storage medium based on a Monitor, which mainly aim at the situation that when the Monitor lands on the data, power failure or data silence error occurs to cause the data corresponding to the Monitor to be lost, and when service accesses the data, an exception is thrown out at the moment, and a core file occurs. When the Monitor does not access the due data, the Monitor sends election information to other monitors and excludes abnormal monitors. Namely, the normal operation of the service is firstly ensured. At this time, the state of the abnormal Monitor is modified to a repair state. And then the abnormal Monitor pulls the data required by the abnormal Monitor from other normal monitors, and then the abnormal Monitor modifies the state of the abnormal Monitor into a normal state and requires to initiate election again. The invention ensures that the Monitor can pull the required information from other monitors under the condition of data loss, thereby ensuring the stable operation of the service and greatly increasing the fault tolerance rate and the stability of the system.
Therefore, compared with the prior art, the invention has prominent substantive features and remarkable progress, and the beneficial effects of the implementation are also obvious.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a process flow diagram of an embodiment of the present invention.
FIG. 2 is a system block diagram of an embodiment of the present invention.
In the figure, 1 is a reading module; 2 is an abnormal Monitor control module; 3 is a data pulling module; 4 is a storage module; 5 is an exception handling module; 6 is a setting unit; 7 is an election message sending unit; 8 is a state modification unit; 9 is a data synchronization unit; reference numeral 10 denotes a determination unit.
Detailed Description
The core of the invention is to provide a data-based data-dropping method based on a Monitor, and in the prior art, all writing operations are completed by sending out a proposal by a Leader Monitor in the running process of the Monitor. If the non-Leader Monitor receives the update request, the request is forwarded to the Leader Monitor, so that the consistency of the data in the Monitor cluster is ensured. The Monitor data is deployed on top of the Nvme. If power failure or data silence error occurs during the disk dropping process, the disk dropping may fail. At this time, the Map has a corresponding version number therein, but the data of the version has not been successfully landed. Therefore, when the Monitor acquires the data of the version, the Monitor cannot acquire the desired data, and at the moment, the Monitor throws an exception and generates a core file.
The data landing method based on the Monitor provided by the invention firstly determines whether the data is successfully landed or not by judging whether the data exists or not when the data is read, and sets the abnormal Monitor not to participate in the election and then initiates the election if the data is not successfully landed. Then, the exception Monitor is set to the data modification state, and the required data is pulled from the other monitors. At the moment, if the data is successfully pulled, performing data dropping on the abnormal Monitor; and if the data pulling fails, discarding the corresponding data application message. Therefore, the invention can enable the Monitor to pull the required information from other monitors under the condition of data loss, thereby ensuring the stable operation of the service and greatly increasing the fault tolerance rate and stability of the system.
In order to make the technical field of the invention better understand, the name of the invention is explained as follows:
ceph: a unified, distributed storage system designed for excellent performance, reliability and scalability.
Monitor: manager of cluster state.
K/V storage: and storing the key value pair.
Paxos: the Paxos algorithm is a message-based consistency algorithm proposed by lesli lambert in 1990. The problem solved by the Paxos algorithm is how a distributed system agrees on a certain value (resolution). A typical scenario is that in a distributed database system, if the initial states of the nodes are consistent and each node performs the same sequence of operations, they can eventually get a consistent state. To ensure that each node executes the same sequence of commands, a "consensus algorithm" needs to be executed on each instruction to ensure that the instructions seen by each node are consistent. A general consensus algorithm can be applied in many scenarios and is an important issue in distributed computing. The search for a consensus algorithm has not stopped since the 80's of the 20 th century. There are two models of node communication: shared memory (Shared memory) and messaging (Messages passing). The Paxos algorithm is a consistency algorithm based on a message passing model.
Paxossoervice: to indicate the status information of the cluster.
The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The first embodiment is as follows:
as shown in fig. 1, the embodiment provides a data-dropping method based on Monitor, which includes the following steps:
s1: and reading the data.
S2: and judging whether the data exists. If there is data, the tray drop is successful and goes to step S3. If no data exists, the landing fails, and it goes to step S4.
When a power failure or data silence error occurs to cause a failed disk-down, a kind of information difference is caused at this time. Taking osdmap as an example, i.e. in the osdmap retained version, there is a corresponding version, but the data of this version is not successful to drop.
S3: and (5) normally processing until the data is completely landed.
S4: and setting the abnormal Monitor not to participate in the election and then initiating the election.
Firstly, setting the selecting _ me option of the abnormal Monitor to false so as to enable the abnormal Monitor not to participate in election; at this time, the montap is traversed, and an election message is sent to each Monitor member in the montap. The purpose of this step is to ensure the normal operation of the service.
S5: the exception Monitor is set to a data modification state and the required data is pulled from the other monitors.
Specifically, first, the exception Monitor is set to the data modification state. At this time, the abnormal Monitor sends a message requesting corresponding data to each Monitor member in the montap by traversing the montap.
S6: and judging whether the returned information contains the corresponding data of the request. If yes, go to step S7. Otherwise, go to step S8.
S7: and (5) successfully pulling the data, and performing data dropping on the abnormal Monitor.
Specifically, the selecting _ me option of the abnormal Monitor is set to true; then, the election is initiated again, and a prompt message is sent to each Monitor member by traversing the montap again.
S8: and if the data pulling fails, discarding the corresponding data application message.
If the returned information does not contain the corresponding data of the request, the information applying for the data is abandoned. If the version number corresponding to the data is not in the first _ commit and last _ commit ranges of other mons, the version of the Monitor can be judged to be too old, and the other monitors can already cut out the data of the older version.
When the Monitor finds that no corresponding data exists, the message applying for the data is firstly saved in the callback queue, and the message is processed after the callback queue is recovered to be normal.
The embodiment provides a data landing method based on a Monitor, which mainly aims at the situation that when the Monitor lands on the data, power failure or data silence error occurs to cause the data corresponding to the Monitor to be lost, and when a service accesses the data, an exception is thrown out at the moment, and a core file appears. When the Monitor does not access the due data, the Monitor sends election information to other monitors and excludes abnormal monitors. Namely, the normal operation of the service is firstly ensured. At this time, the state of the abnormal Monitor is modified to a repair state. And then the abnormal Monitor pulls the data required by the abnormal Monitor from other normal monitors, and then the abnormal Monitor modifies the state of the abnormal Monitor into a normal state and requires to initiate election again.
Example two:
based on the first embodiment, as shown in fig. 2, the invention further discloses a data dropping system based on Monitor, which includes: the device comprises a reading module 1, an exception Monitor control module 2, a data pulling module 3, a storage module 4 and an exception handling module 5.
The reading module 1 is used for reading data and determining whether the data is successfully landed or not by judging whether the data exists or not.
And the abnormal Monitor control module 2 is used for setting the abnormal Monitor not to participate in the election and then initiating the election. The abnormality Monitor control module 2 includes: a setting unit 6 and an election message sending unit 7. The setting unit 6 is used for setting the selecting _ me option of the abnormal Monitor to false so that the abnormal Monitor does not participate in election; and the election message sending unit 7 is used for traversing the montap and sending an election message to each Monitor member in the montap.
And the data pulling module 3 is used for setting the abnormal Monitor to be in a data modification state and pulling the required data from other monitors. The data pulling module 3 includes: a state modification unit 8, a data synchronization unit 9 and a decision unit 10. A state modification unit 8 for setting the exception Monitor to a data modification state; the data synchronization unit 9 is used for the abnormal Monitor to send a message requesting corresponding data to each Monitor member in the montap by traversing the montap; and a judging unit 10, configured to judge whether the returned information includes the requested corresponding data.
And the storage module 4 is used for performing data destaging on the abnormal Monitor after the data is successfully pulled. The method is specifically used for: firstly, setting an selecting _ me option of an abnormal Monitor to true; then, the election is initiated again, and a prompt message is sent to each Monitor member by traversing the montap again.
And the exception handling module 5 is used for abandoning the corresponding data application message after the data pulling fails. Specifically, the message for applying for the data may be saved in the callback queue, and the message may be processed after the callback queue is restored to normal.
The embodiment provides a data destaging system based on a Monitor, which can enable the Monitor to pull required information from other monitors under the condition of data loss, thereby ensuring the stable operation of services and greatly increasing the fault tolerance rate and stability of the system.
Example three:
the embodiment discloses a data falling device based on Monitor, which comprises a processor and a memory; when the processor executes the data falling program based on the Monitor stored in the memory, the following steps are realized:
1. and reading the data, and determining whether the data is successfully landed by judging whether the data exists. If the determination data exists, the disk is successfully landed and the process goes to step 2. If no determination data exists, the disk-drop fails, and the process goes to step 3.
2. And (5) normally processing until the data is completely landed.
3. And setting the abnormal Monitor not to participate in the election and then initiating the election.
4. The exception Monitor is set to a data modification state and the required data is pulled from the other monitors.
5. And judging whether the returned information contains the corresponding data of the request. If yes, go to step 6. Otherwise, go to step 7.
6. And (5) successfully pulling the data, and performing data dropping on the abnormal Monitor.
7. And if the data pulling fails, discarding the corresponding data application message.
Further, the data dropping device based on Monitor in this embodiment may further include:
and the input interface is used for acquiring an externally imported data landing program based on the Monitor, storing the acquired data landing program based on the Monitor into the memory, and also used for acquiring various instructions and parameters transmitted by external terminal equipment and transmitting the instructions and parameters to the processor, so that the processor can utilize the instructions and the parameters to perform corresponding processing. In this embodiment, the input interface may specifically include, but is not limited to, a USB interface, a serial interface, a voice input interface, a fingerprint input interface, a hard disk reading interface, and the like.
And the output interface is used for outputting various data generated by the processor to the terminal equipment connected with the output interface so that other terminal equipment connected with the output interface can acquire various data generated by the processor. In this embodiment, the output interface may specifically include, but is not limited to, a USB interface, a serial interface, and the like.
And the communication unit is used for establishing remote communication connection between the data falling device based on the Monitor and the external server so that the data falling device based on the Monitor can mount the mirror image file into the external server. In this embodiment, the communication unit may specifically include, but is not limited to, a remote communication unit based on a wireless communication technology or a wired communication technology.
And the keyboard is used for acquiring various parameter data or instructions input by a user through real-time key cap knocking.
And the display is used for displaying relevant information in the short circuit positioning process of the power supply line of the running server in real time.
The mouse can be used for assisting a user in inputting data and simplifying the operation of the user.
The embodiment provides a data tray falling device based on a Monitor, which can effectively deal with the situation that the data reading fails due to the tray falling failure of a certain Monitor caused by power failure or data silence error. The consistency of data and the stability of the system are effectively guaranteed.
Example four:
the present embodiments also disclose a readable storage medium, where the readable storage medium includes Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium known in the art. The readable storage medium is stored with a Monitor-based data destaging program, and the Monitor-based data destaging program realizes the following steps when being executed by a processor:
1. and reading the data, and determining whether the data is successfully landed by judging whether the data exists or not. If the determination data exists, the disk is successfully landed and the process goes to step 2. If no determination data exists, the disk-drop fails, and the process goes to step 3.
2. And (5) normally processing until the data is completely landed.
3. And setting the abnormal Monitor not to participate in the election and then initiating the election.
4. The exception Monitor is set to a data modification state and the required data is pulled from the other monitors.
5. And judging whether the returned information contains the corresponding data of the request. If yes, go to step 6. Otherwise, go to step 7.
6. And (5) successfully pulling the data, and performing data dropping on the abnormal Monitor.
7. And if the data pulling fails, discarding the corresponding data application message.
The embodiment provides a readable storage medium, which mainly aims at the situation that when a Monitor is in a data-landing state, power failure or data silence error occurs to cause data loss corresponding to the Monitor, and when service accesses the data, an exception is thrown, and a core file occurs. When the Monitor does not access the due data, the Monitor sends election information to other monitors and excludes abnormal monitors. Namely, the normal operation of the service is firstly ensured. At this time, the state of the abnormal Monitor is modified to a repair state. And then the abnormal Monitor pulls the data required by the abnormal Monitor from other normal monitors, and then the abnormal Monitor modifies the state of the abnormal Monitor into a normal state and requires to initiate election again.
In summary, the invention can enable the Monitor to pull the required information from other monitors when the Monitor has data loss, thereby ensuring the stable operation of the service and greatly increasing the fault tolerance rate and stability of the system.
The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts among the embodiments are referred to each other. The method disclosed by the embodiment corresponds to the system disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the description of the method part.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided by the present invention, it should be understood that the disclosed system, system and method can be implemented in other ways. For example, the above-described system embodiments are merely illustrative, and for example, the division of the units is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, systems or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each module may exist alone physically, or two or more modules are integrated into one unit.
Similarly, each processing unit in the embodiments of the present invention may be integrated into one functional module, or each processing unit may exist physically, or two or more processing units are integrated into one functional module.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The data-based data-landing method, system, device and readable storage medium provided by the invention are described in detail above. The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the method and its core concepts. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.

Claims (10)

1. A data falling method based on Monitor is characterized by comprising the following steps:
reading data, and determining whether the data is successfully landed or not by judging whether the data exists or not;
if the data is not successfully landed, setting an abnormal Monitor not to participate in the election and then initiating the election;
setting the abnormal Monitor to be in a data modification state, and pulling required data from other monitors;
if the data is successfully pulled, performing data dropping on the abnormal Monitor;
and if the data pulling fails, discarding the corresponding data application message.
2. The Monitor-based data destaging method according to claim 1, wherein the setting of the abnormal Monitor not to participate in the election and then initiating the election comprises:
setting the selecting _ me option of the abnormal Monitor to false so that the abnormal Monitor does not participate in election;
and traversing the montap and sending election messages to each Monitor member in the montap.
3. The Monitor-based data destaging method according to claim 1, wherein the setting of the abnormal Monitor to the data modification state and pulling the required data from other monitors comprises:
setting the abnormal Monitor to be in a data modification state;
the abnormal Monitor sends a message for requesting corresponding data to each Monitor member in the montap by traversing the montap;
judging whether the returned information contains the corresponding data of the request or not;
if so, the data pulling is successful, otherwise, the data pulling is failed.
4. The Monitor-based data destaging method according to claim 1, wherein the data destaging for abnormal monitors further comprises:
setting the selecting _ me option of the abnormal Monitor to true;
and reinitiating election and sending a prompt message to each Monitor member by traversing the mamap again.
5. The Monitor-based data landing method of claim 1, wherein discarding the corresponding data application message comprises:
and saving the corresponding data application message to a callback queue.
6. A Monitor-based data-dropping system, comprising:
the reading module is used for reading data and determining whether the data is successfully landed or not by judging whether the data exists or not; the abnormal Monitor control module is used for setting the abnormal Monitor not to participate in the election and then initiating the election;
the data pulling module is used for setting the abnormal Monitor to be in a data modification state and pulling the required data from other monitors;
the storage module is used for performing data destaging on the abnormal Monitor after the data is successfully pulled;
and the exception handling module is used for abandoning the corresponding data application message after the data pulling fails.
7. The Monitor-based data destaging system of claim 6, wherein the exception Monitor control module comprises:
the setting unit is used for setting the selecting _ me option of the abnormal Monitor to false so that the abnormal Monitor does not participate in election;
and the election message sending unit is used for traversing the montap and sending the election message to each Monitor member in the montap.
8. The Monitor-based data dropoff system of claim 6, wherein the data pull module comprises:
the state modification unit is used for setting the abnormal Monitor to be in a data modification state;
the data synchronization unit is used for sending a message requesting corresponding data to each Monitor member in the montap by the abnormal Monitor through traversing the montap;
and the judging unit is used for judging whether the returned information contains the corresponding data of the request.
9. A data falling device based on Monitor is characterized by comprising:
the memory is used for storing a data landing program based on the Monitor;
a processor for implementing the steps of the Monitor-based data landing method as claimed in any one of claims 1 to 5 when executing the Monitor-based data landing program.
10. A readable storage medium, characterized by: the readable storage medium stores a Monitor-based data destaging program, and the Monitor-based data destaging program when executed by the processor implements the steps of the Monitor-based data destaging method as claimed in any one of claims 1 to 5.
CN202210130373.5A 2022-02-11 2022-02-11 Data disk-dropping method, system and device based on Monitor and storage medium Pending CN114546766A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210130373.5A CN114546766A (en) 2022-02-11 2022-02-11 Data disk-dropping method, system and device based on Monitor and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210130373.5A CN114546766A (en) 2022-02-11 2022-02-11 Data disk-dropping method, system and device based on Monitor and storage medium

Publications (1)

Publication Number Publication Date
CN114546766A true CN114546766A (en) 2022-05-27

Family

ID=81673780

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210130373.5A Pending CN114546766A (en) 2022-02-11 2022-02-11 Data disk-dropping method, system and device based on Monitor and storage medium

Country Status (1)

Country Link
CN (1) CN114546766A (en)

Similar Documents

Publication Publication Date Title
US11222043B2 (en) System and method for determining consensus within a distributed database
US10614098B2 (en) System and method for determining consensus within a distributed database
US8055735B2 (en) Method and system for forming a cluster of networked nodes
US7146532B2 (en) Persistent session and data in transparently distributed objects
US20050262233A1 (en) Methods and systems for history analysis for access paths in networks
CN109218349A (en) A kind of method and device of management server cluster
CN108255592A (en) A kind of Quartz clusters timing task processing system and method
US9367298B1 (en) Batch configuration mode for configuring network devices
CN112671613B (en) Federal learning cluster monitoring method, device, equipment and medium
CN109379238A (en) A kind of CTDB host node electoral machinery of distributed type assemblies, apparatus and system
CN106331081B (en) Information synchronization method and device
EP3953818A2 (en) Iot partition management and load balancing
CN114328132A (en) Method, device, equipment and medium for monitoring state of external data source
CN113946362B (en) Consumption data processing method and storage medium
CN114844809B (en) Multi-factor arbitration method and device based on network heartbeat and kernel disk heartbeat
CN114531373A (en) Node state detection method, node state detection device, equipment and medium
CN113765690A (en) Cluster switching method, system, device, terminal, server and storage medium
CN114546766A (en) Data disk-dropping method, system and device based on Monitor and storage medium
CN116455830A (en) Method for realizing high-availability distributed QOS of storage gateway
CN110545197B (en) Node state monitoring method and device
CN116346834A (en) Session synchronization method, device, computing equipment and computer storage medium
CN115470303A (en) Database access method, device, system, equipment and readable storage medium
CN110502460B (en) Data processing method and node
CN112099879A (en) Configuration information management method and device, computer equipment and storage medium
CN109218206B (en) Method and device for limiting link state advertisement quantity

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination