CN114443438A - Node state detection method, node abnormity processing method and device - Google Patents

Abstract

The present application discloses a method for detecting node status, a method and device for processing node abnormality. The method includes: receiving a target detection indicator sent by an agent terminal deployed on a target node in a target cluster, and operation data corresponding to the target detection indicator, wherein the target node is a node whose target detection indicator is in an abnormal state; according to The operation data determines the target exception type corresponding to the target detection indicator; queries the target exception handling script corresponding to the target exception type; if the target exception handling script exists, executes the target exception handling script to make The target detection index of the target node is restored to a normal state. The method provided by the present application can automatically obtain and execute an exception handling script according to the abnormality type of the node when an abnormality occurs in a node in the target cluster, so as to realize the timely self-healing of the node after the abnormality occurs, and ensure that the target cluster continues to be in a high-availability state. state.

Description

Node state detection method, node abnormality processing method and device

technical field

The present application relates to the field of computer technology, and in particular, to a method for detecting node status, a method and device for processing node abnormality.

Background technique

At present, k8s has officially provided the fault detection function of node nodes, but as mentioned above, its detection function will still cause many problems in actual production, and it does not have the ability of node self-healing. Tencent has added node self-healing capability on the basis of the node node fault detection function officially provided by k8s, but its node self-healing capability is only a restart operation for superficial phenomena. In actual production, it is found that this simple restart cannot solve the problem. , because a component fails to start, often restarting it will not start successfully.

SUMMARY OF THE INVENTION

In order to solve the above-mentioned technical problems or at least partially solve the above-mentioned technical problems, the present application provides a method for detecting a node state, a method and an apparatus for processing a node abnormality.

According to an aspect of the embodiments of the present application, a method for processing a node abnormality is also provided. The method is applied to a controller deployed on a master node in a target cluster, and the method includes:

receiving the target detection indicator sent by the proxy terminal deployed on the target node in the target cluster, and the operation data corresponding to the target detection indicator, wherein the target node is a node whose target detection indicator is in an abnormal state;

Determine the target abnormality type corresponding to the target detection indicator according to the operating data;

query the target exception handling script corresponding to the target exception type;

If the target exception handling script exists, the target exception handling script is executed to restore the target detection index of the target node to a normal state.

Further, the querying the exception handling script corresponding to the target exception type includes:

Read the mapping relationship between the exception type and the exception handling script from the cache of the controller;

Based on the mapping relationship, a target exception handling script corresponding to the target exception type is acquired.

Further, in the absence of the exception handling script, the method further includes:

sending the target detection indicator and the operation data corresponding to the target detection indicator to the target client;

receiving a target exception handling script fed back by the target client based on the target detection indicator and the operating data;

A mapping relationship between the target exception handling script and the target exception type is established, and the mapping relationship is stored in the cache of the controller.

According to another aspect of the embodiments of the present application, a method for detecting a node state is provided. The method is applied to a proxy terminal, where the proxy terminal is deployed on each node in a target cluster, and the method includes:

Periodically detect the node according to the detection strategy corresponding to the detection index, and obtain the operation data corresponding to each detection index in the node;

Determine the state information corresponding to the detection index based on the operating data;

Determining the detection index whose state information is an abnormal state as the target detection index;

The operation data corresponding to the target detection indicator is sent to the controller, so that the controller performs an abnormal processing operation on the target node according to the operation data.

Further, when the detection indicator is a network indicator, the node is periodically detected according to the detection strategy corresponding to the detection indicator, and the operation data corresponding to each detection indicator in the node is obtained, including:

determining a network detection strategy corresponding to the network indicator;

Use the network detection strategy to detect network parameters corresponding to the management network, service network and storage network where the node is located;

The network parameters corresponding to the management network, the service network and the storage network respectively are determined as the operation data corresponding to the network indicators.

Further, in the case where the detection index is a component index, the node is periodically detected according to the detection strategy corresponding to the detection index, and the operation data corresponding to each detection index in the node is obtained, including:

determining the component detection strategy corresponding to the component indicator;

The log file of the node is queried by using the component detection strategy, and the running data of the components in the node is counted from the log file.

According to another aspect of the embodiments of the present application, a device for processing node exceptions is also provided, including:

a receiving module, configured to receive the target detection indicator sent by the proxy terminal deployed on the target node in the target cluster, and the operation data corresponding to the target detection indicator, wherein the target node is a node whose target detection indicator is in an abnormal state;

a determining module, configured to determine the target abnormality type corresponding to the target detection index according to the operating data;

a query module for querying the target exception handling script corresponding to the target exception type;

The execution module is configured to execute the target exception handling script in the presence of the target exception handling script to restore the target detection index of the target node to a normal state.

According to another aspect of the embodiments of the present application, a device for detecting a node state is also provided, including:

a detection module, configured to periodically detect the node according to the detection strategy corresponding to the detection index, and obtain operation data corresponding to each detection index in the node;

a determination module, configured to determine the state information corresponding to the detection index based on the operation data;

a processing module, configured to determine a detection index whose state information is an abnormal state as a target detection index;

The sending module is configured to send the operation data corresponding to the target detection indicator to the controller, so that the controller performs an abnormal processing operation on the target node according to the operation data.

According to another aspect of the embodiments of the present application, a storage medium is also provided, where the storage medium includes a stored program, and the above steps are executed when the program is run.

According to another aspect of the embodiments of the present application, an electronic device is also provided, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; wherein: The memory is used to store the computer program; the processor is used to execute the steps in the above method by running the program stored in the memory.

Embodiments of the present application also provide a computer program product containing instructions, which, when run on a computer, cause the computer to execute the steps in the above method.

Compared with the prior art, the above technical solutions provided by the embodiments of the present application have the following advantages: the method provided by the present application can automatically acquire and execute an exception handling script according to the abnormality type of the node when an abnormality occurs in a node in the target cluster, It realizes the timely self-healing of the node after an abnormality occurs, and ensures that the target cluster is continuously in a high-availability state.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. In other words, on the premise of no creative labor, other drawings can also be obtained from these drawings.

FIG. 1 is a flowchart of a method for detecting a node state provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of a target cluster provided by an embodiment of the present application;

3 is a flowchart of a method for processing node exceptions provided by an embodiment of the present application;

4 is a block diagram of an apparatus for detecting a node state provided by an embodiment of the present application;

FIG. 5 is a block diagram of an apparatus for processing node exceptions provided by an embodiment of the present application;

FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of the present application, but not all of the embodiments. The exemplary embodiments of the present application and their descriptions are used to explain the present application and do not constitute improper limitations on the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present application.

It should be noted that, herein, relational terms such as "first" and "second" etc. are only used to distinguish one entity or operation from another similar entity or operation, and do not necessarily require or Any such actual relationship or order between these entities or operations is implied. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

Embodiments of the present application provide a method for detecting node status, a method and device for processing node abnormality. The methods provided in the embodiments of the present invention can be applied to any required electronic devices, for example, electronic devices such as servers and terminals, which are not specifically limited here, and are simply referred to as electronic devices hereinafter for the convenience of description.

According to an aspect of the embodiments of the present application, a method embodiment of a method for detecting a node state is provided. FIG. 1 is a flowchart of a method for detecting a node state provided by an embodiment of the present application. As shown in FIG. 1 , the method includes:

Step S11: Periodically detect the node according to the detection strategy corresponding to the detection index, and obtain operation data corresponding to each detection index in the node.

The method provided by the embodiment of the present application is applied to an agent terminal, and the agent terminal is deployed on each node in the target cluster. As shown in FIG. 2 , an agent terminal agent is deployed on each node node, and the agent terminal is used to monitor the node where it is located. The running data, for example, the running data can be: network parameters, component parameters, memory parameters and so on.

In the embodiment of the present application, when the detection index is a network index, periodic detection is performed on the node according to the detection strategy corresponding to the detection index, and operation data corresponding to each detection index in the node is obtained, including the following steps A1-A3:

Step A1: Determine a network detection strategy corresponding to the network indicator.

In the embodiment of the present application, the network detection strategy corresponding to the network indicator is: use the Gossip protocol to detect the management network, service network, and storage network corresponding to the node. It should be noted that nodes using the Gossip protocol can mutually ensure the reachability of each other's network.

In step A2, network parameters corresponding to the management network, service network and storage network where the node is located are detected by using the network detection strategy.

Step A3: Determine the network parameters corresponding to the management network, the service network and the storage network respectively as the operation data corresponding to the network indicators.

In the embodiment of the present application, the proxy terminal first queries the first node corresponding to the management network, and then sends a message to the first node based on the Gossip protocol to determine the first network parameters of the management network where the node corresponding to the proxy terminal is located. The proxy terminal first queries the second node corresponding to the service network, and then sends a message to the second node based on the Gossip protocol to determine the second network parameters of the management network where the node corresponding to the proxy terminal is located. The proxy terminal first queries the third node corresponding to the storage network, and then sends a message to the third node based on the Gossip protocol to determine third network parameters of the storage network where the node corresponding to the proxy terminal is located. Then, the network parameters corresponding to the above-mentioned management network, service network, and storage network can be used as the operation data corresponding to the network indicators. Network parameters may include transmission rate, transmission delay, packet loss rate, and the like.

As an example, each proxy terminal communicates using the Gossip protocol. At intervals, the proxy terminal in each node will randomly select several nodes to send Gossip messages, and other nodes will randomly select other nodes to send Gossip messages again. After such a period of time, the nodes of the entire cluster can receive this Gossip message. Each node may know all other nodes, or only a few neighbor nodes. As long as these nodes can be connected through the network, the consul cluster state learned by all nodes will be consistent in the end.

In the embodiment of the present application, when the detection index is a component index, periodic detection is performed on the node according to the detection strategy corresponding to the detection index, and operation data corresponding to each detection index in the node is obtained, including the following steps B1-B2:

Step B1: Determine the component detection strategy corresponding to the component index.

Step B2, query the log file of the node by using the component detection strategy, and count the running data of the components in the node from the log file.

In this embodiment of the present application, the proxy terminal can monitor the running data of key components in real time by detecting system logs. In addition, you can also receive the heartbeat data of the kubelet component at preset time intervals, and when the heartbeat data sent by the kubelet component is not received within the preset time, perform health detection on the kubelet component to obtain the running data of the kubelet component. The running data of key components includes: the number of restarts of the kubelet component, the health information of the kubelet component, and so on.

In the embodiment of the present application, when the detection index is a disk index, the usage of the system disk is monitored by executing a df-h and iostat command at regular intervals, and the disk capacity of the system disk is determined based on the usage. Wait. In addition, when the detection indicator is the memory indicator, the usage of the memory can be monitored to determine the usage rate of the memory.

In step S12, the state information corresponding to the detection index is determined based on the operation data.

In the embodiment of the present application, the operation data can be compared with the preset operation data, and the preset operation data is the numerical range of each detection index of the node in a normal state, or the upper limit or lower limit preset by the staff limits, etc. If the operation data matches the preset operation data, it is determined that the state information is a normal state. If the operation data does not match the preset operation data, it is determined that the state information is an abnormal state.

As an example, if the disk capacity of the system disk is greater than the preset capacity, it is determined that the state information of the system disk is an abnormal state. If the transmission rate corresponding to the management network is less than the preset transmission rate, it is determined that the management network where the node is located is unreachable, and the status information corresponding to the management network is an abnormal state at this time. If the number of restarts corresponding to the component is greater than the preset number of times, or the health information does not match the preset health information, it is determined that the state information of the component is an abnormal state.

In step S13, the detection index whose state information is an abnormal state is determined as the target detection index.

In the embodiment of the present application, after determining the state information corresponding to each detection index according to the operation data, the proxy terminal will count the state information corresponding to each detection index, and determine the detection index whose state information is an abnormal state as the target detection index.

Step S14, sending the operation data corresponding to the target detection index to the controller, so that the controller performs an abnormal processing operation on the target node according to the operation data.

In the embodiment of the present application, after determining the target detection index, the agent terminal sends the target detection index and operation data of the node where it is located to the controller, so that the controller can determine the abnormal cause of the target detection index according to the operation data, and according to the operation data The abnormal cause is abnormally processed for the node, so that the target detection index of the node returns to the normal state.

According to another aspect of the embodiments of the present application, a method for processing node exceptions is also provided. FIG. 3 is a flowchart of a method for processing node exceptions provided by the embodiments of the present application. As shown in FIG. 3 , the method may Include the following steps:

Step S21: Receive the target detection indicator sent by the proxy terminal deployed on the target node in the target cluster, and the operation data corresponding to the target detection indicator, wherein the target node is a node whose target detection indicator is in an abnormal state.

The method provided by this embodiment of the present application is applied to a controller deployed on a master node in a target cluster, and the controller receives target detection indicators sent by each agent terminal deployed in the target cluster, and operation data corresponding to the target detection indicators, wherein, Each agent terminal corresponds to a target node.

It should be noted that there are multiple nodes in the target cluster, and an agent terminal is deployed in each node. The agent terminal will monitor the node where it is located. If one of the detection indicators of the node is abnormal, the agent terminal will appear abnormal. The detection index is determined as the target detection index. Therefore, after receiving the target detection indicator sent by the proxy terminal, the controller will determine the node where the proxy terminal is located as the target node.

Step S22, determining the target abnormality type corresponding to the target detection index according to the operation data.

In the embodiment of the present application, the abnormality classification conditions corresponding to each detection index are stored in the controller. For example, when the operating data is the number of restarts of the component, the target abnormality type is frequent restarting of the component. Or when the running data is the health information of the component, the target exception type is Kubelet exception or Docker exception. Alternatively, when the operating data is the network parameters of the management network, and/or the service network, and/or the storage network, the target abnormality type of the management network, and/or the service network, and/or the storage network can be determined according to the network parameters at this time. for network failure.

Step S23, query the target exception processing script corresponding to the target exception type.

In the embodiment of the present application, step S23, querying the exception handling script corresponding to the target exception type, includes the following steps C1-C2:

In step C1, the mapping relationship between the exception type and the exception handling script is read from the cache of the controller.

In this embodiment of the present application, the cache of the controller stores a mapping relationship between exception types and exception handling scripts, where one exception type may correspond to at least one exception handling script. Specifically, the controller may send the exception type to the target client, the target client will feed back the exception handling script to the controller according to the exception type, and then the controller establishes a mapping relationship between the exception handling script and the exception type.

It should be noted that the exception handling script can be used by the user to resolve the exception after catching the exception through the target client. After the exception is resolved, the user writes the resolution process into a script through the target client, and imports the script in the format. In the port file, the final exception handling script is generated.

Step C2, based on the mapping relationship, obtain the target exception handling script corresponding to the target exception type.

In this embodiment of the present application, during the query process, the controller may obtain the target exception handling script corresponding to the target exception type based on the established mapping relationship. Therefore, by pre-establishing the mapping relationship between the exception type and the exception handling script, the present application can automatically obtain the corresponding exception handling script according to the abnormality type of the node when an exception occurs in a certain node in the target cluster, which is no longer required. Manually resolving exceptions helps ensure that the target cluster is continuously in a high-availability state.

Step S24 , if the target exception handling script exists, execute the target exception handling script to restore the target detection index of the target node to a normal state.

In the embodiment of the present application, when there is a target exception handling script, the controller will execute the target exception handling script, so that the target detection index of the target node returns to normal, thereby realizing self-healing of the node.

In this embodiment of the present application, in step S24, in the absence of an exception handling script, the method further includes the following steps D1-D3:

In step D1, the target detection indicator and the operation data corresponding to the target detection indicator are sent to the target client.

Step D2: Receive a target exception handling script fed back by the target client based on the target detection index and the running data.

Step D3, establishing a mapping relationship between the target exception handling script and the target exception type, and storing the mapping relationship in the cache of the controller.

In the embodiment of the present application, when there is a target exception handling script, the controller will send the target detection indicator and the operation data corresponding to the target detection indicator to the target client, and the target client will display the target detection indicator and the operation data, So that users can write corresponding target exception handling scripts according to the displayed target detection indicators and running data. After writing, the user can send the target exception handling script to the controller in the target cluster through the target client.

In the embodiment of the present application, after receiving the target exception handling script, the controller executes the target exception handling script, thereby restoring the target detection index of the node to a normal state. At the same time, the target exception handling script is also stored, and the mapping relationship between the target exception handling script and the target exception type is established, and the mapping relationship is stored in the cache of the controller.

The embodiments of the present application provide a method. In the case where there is no exception handling script in the controller, the controller will automatically send target detection indicators and operation data to the target client. So that the user can write the target exception handling script according to the target detection indicators and operating data, and then feed the target exception handling script to the controller. Perform exception handling operations.

FIG. 4 is a block diagram of an apparatus for detecting a node state provided by an embodiment of the present application, and the apparatus may be implemented as part or all of an electronic device through software, hardware, or a combination of the two. As shown in Figure 4, the device includes:

The detection module 31 is configured to periodically detect the node according to the detection strategy corresponding to the detection index, and obtain the operation data corresponding to each detection index in the node;

A determination module 32, configured to determine the state information corresponding to the detection index based on the operation data;

The processing module 33 is used to determine the detection index whose state information is an abnormal state as the target detection index;

The sending module 34 is configured to send the operation data corresponding to the target detection indicator to the controller, so that the controller performs an abnormal processing operation on the target node according to the operation data.

In the embodiment of the present application, when the detection index is a network index, the detection module 31 is used to determine a network detection strategy corresponding to the network index; use the network detection strategy to detect the corresponding management network, service network and storage network where the node is located, respectively Network parameters; network parameters corresponding to the management network, service network, and storage network are determined as the operation data corresponding to the network indicators.

In the embodiment of the present application, when the detection index is a component index, the detection module 31 is used to determine the component detection strategy corresponding to the component index; query the log file of the node by using the component detection strategy, and collect statistics on the nodes from the log file. The operational data of the component.

FIG. 5 is a block diagram of an apparatus for processing node exceptions provided by an embodiment of the present application, and the apparatus may be implemented as part or all of an electronic device through software, hardware, or a combination of the two. As shown in Figure 5, the device includes:

The receiving module 41 is configured to receive the target detection indicator sent by the proxy terminal deployed on the target node in the target cluster, and the operation data corresponding to the target detection indicator, wherein the target node is a node whose target detection indicator is in an abnormal state.

The determining module 42 is configured to determine the target abnormality type corresponding to the target detection index according to the operation data.

The query module 43 is configured to query the target exception processing script corresponding to the target exception type.

The execution module 44 is configured to execute the target exception handling script when the target exception handling script exists, so as to restore the target detection index of the target node to a normal state.

In the embodiment of the present application, the query module 43 is configured to read the mapping relationship between the exception type and the exception handling script from the cache of the controller; based on the mapping relationship, obtain the target exception handling script corresponding to the target exception type.

In the embodiment of the present application, in the absence of an exception processing script, the device for processing node exceptions further includes: a building module for sending target detection indicators and operation data corresponding to the target detection indicators to the target client; receiving the target Based on the target detection index and the target exception handling script fed back by the running data, the client establishes a mapping relationship between the target exception handling script and the target exception type, and stores the mapping relationship in the controller's cache.

This embodiment of the present application also provides an electronic device. As shown in FIG. 5 , the electronic device may include: a processor 1501, a communication interface 1502, a memory 1503, and a communication bus 1504, wherein the processor 1501, the communication interface 1502, and the memory 1503 pass through The communication bus 1504 performs communication with each other.

The memory 1503 is used to store computer programs;

The processor 1501 is configured to implement the steps of the foregoing embodiments when executing the computer program stored in the memory 1503 .

The communication bus mentioned by the above terminal may be a Peripheral Component Interconnect (PCI for short) bus or an Extended Industry Standard Architecture (Extended Industry Standard Architecture, EISA for short) bus or the like. The communication bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the above-mentioned terminal and other devices.

The memory may include random access memory (Random Access Memory, RAM for short), and may also include non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

The above-mentioned processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, referred to as CPU), a network processor (Network Processor, referred to as NP), etc.; may also be a digital signal processor (Digital Signal Processing, referred to as DSP) , Application Specific Integrated Circuit (ASIC for short), Field-Programmable Gate Array (FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

In yet another embodiment provided by the present application, a computer-readable storage medium is also provided, where instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer is made to execute any one of the foregoing embodiments. The detection method of the node state.

In yet another embodiment provided by the present application, a computer program product including instructions is also provided, which, when running on a computer, enables the computer to execute the method for detecting a node state described in any of the foregoing embodiments.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server, or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk), among others.

The above descriptions are only preferred embodiments of the present application, and are not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application are included in the protection scope of this application.

The above descriptions are only specific embodiments of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, this application is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims (10)

1. A method for processing abnormal nodes, wherein the method is applied to a controller deployed on a master node in a target cluster, the method comprising: Receive the target detection indicator sent by the agent terminal deployed on the target node in the target cluster, and the operation data corresponding to the target detection indicator, wherein the target node is a node whose target detection indicator is in an abnormal state; Determine the target abnormality type corresponding to the target detection indicator according to the operating data; query the target exception handling script corresponding to the target exception type; If the target exception handling script exists, the target exception handling script is executed to restore the target detection index of the target node to a normal state. 2. The method according to claim 1, wherein the querying the exception handling script corresponding to the target exception type comprises: Read the mapping relationship between the exception type and the exception handling script from the cache of the controller; Based on the mapping relationship, a target exception handling script corresponding to the target exception type is acquired. 3. The method according to claim 2, wherein in the absence of the exception handling script, the method further comprises: sending the target detection indicator and the operation data corresponding to the target detection indicator to the target client; receiving a target exception handling script fed back by the target client based on the target detection indicator and the operating data; A mapping relationship between the target exception handling script and the target exception type is established, and the mapping relationship is stored in the cache of the controller. 4. A method for detecting a node state, wherein the method is applied to a proxy terminal, and the proxy terminal is deployed on each node in a target cluster, the method comprising: Periodically detect the node according to the detection strategy corresponding to the detection index, and obtain the operation data corresponding to each detection index in the node; Determine the state information corresponding to the detection index based on the operating data; Determining the detection index whose state information is an abnormal state as the target detection index; The operation data corresponding to the target detection indicator is sent to the controller, so that the controller performs an abnormal processing operation on the target node according to the operation data. 5 . The method according to claim 4 , wherein, in the case that the detection index is a network index, the node is periodically detected according to a detection strategy corresponding to the detection index, and the information in the node is obtained. 6 . Operation data corresponding to each detection indicator, including: determining a network detection strategy corresponding to the network indicator; Use the network detection strategy to detect network parameters corresponding to the management network, service network and storage network where the node is located; The network parameters corresponding to the management network, the service network and the storage network respectively are determined as the operation data corresponding to the network indicators. 6 . The method according to claim 4 , wherein, in the case that the detection index is a component index, the node is periodically detected according to a detection strategy corresponding to the detection index, and the node is obtained. Operation data corresponding to each detection indicator, including: determining the component detection strategy corresponding to the component indicator; The log file of the node is queried by using the component detection strategy, and the running data of the components in the node is counted from the log file. 7. A device for processing node abnormality, comprising: a receiving module, configured to receive the target detection indicator sent by the agent terminal deployed on the target node in the target cluster, and the operation data corresponding to the target detection indicator, wherein the target node is a node whose target detection indicator is in an abnormal state; a determining module, configured to determine the target abnormality type corresponding to the target detection index according to the operating data; a query module for querying the target exception handling script corresponding to the target exception type; The execution module is configured to execute the target exception handling script in the presence of the target exception handling script to restore the target detection index of the target node to a normal state. 8. A device for detecting a node state, comprising: a detection module, configured to periodically detect the node according to the detection strategy corresponding to the detection index, and obtain operation data corresponding to each detection index in the node; a determination module, configured to determine the state information corresponding to the detection index based on the operation data; a processing module, configured to determine a detection index whose state information is an abnormal state as a target detection index; The sending module is configured to send the operation data corresponding to the target detection index to the controller, so that the controller performs an abnormal processing operation on the target node according to the operation data. 9 . A storage medium, characterized in that the storage medium comprises a stored program, wherein when the program runs, the method steps of any one of the preceding claims 1 to 6 are executed. 10. An electronic device, characterized in that it comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface, and the memory complete mutual communication through the communication bus; wherein: memory for storing computer programs; The processor is configured to execute the method steps of any one of claims 1 to 6 by running a program stored in the memory.

Images