CN116723117A

CN116723117A - Monitoring method and device

Info

Publication number: CN116723117A
Application number: CN202310766520.2A
Authority: CN
Inventors: 刘禹
Original assignee: China Construction Bank Corp; CCB Finetech Co Ltd
Current assignee: China Construction Bank Corp; CCB Finetech Co Ltd
Priority date: 2023-06-27
Filing date: 2023-06-27
Publication date: 2023-09-08

Abstract

The invention discloses a monitoring method and a monitoring device, and relates to the technical field of computers. One embodiment of the method includes acquiring a full path; step-by-step disassembly is carried out on the full path to obtain a plurality of target paths so as to create a plurality of corresponding target nodes; a monitoring node is established, and the full path is used as corresponding data content; analyzing the data content of the monitoring node through a preset monitoring component, and compensating and monitoring each path obtained through analysis to determine the existence of the corresponding node. Therefore, the embodiment of the invention can solve the technical problem that partial paths and monitoring events thereof can be lost without perception when the Zookeeper creates the multi-level paths.

Description

Monitoring method and device

Technical Field

The present invention relates to the field of computer technologies, and in particular, to a monitoring method and apparatus.

Background

At present, the application of a distributed data system Zookeeper is very common, and a convenient and strong-consistency distributed data operation service is provided for users.

In the process of implementing the present invention, the inventor finds that at least the following problems exist in the prior art:

when a user creates a multi-level path in the Zookeeper at one time, due to the self defect of the Zookeeper, the event that part of paths and monitoring mechanisms thereof are lost simultaneously can occur, so that the Zookeeper does not feel the lost paths and corresponding configuration change events, and great potential data hazards are caused.

Disclosure of Invention

In view of this, the embodiments of the present invention provide a monitoring method and apparatus, which can solve the technical problem that a part of paths and monitoring events thereof may be lost without perception when a Zookeeper creates a multi-level path.

To achieve the above object, according to an aspect of the embodiments of the present invention, there is provided a listening method, including acquiring a full path; step-by-step disassembly is carried out on the full path to obtain a plurality of target paths so as to create a plurality of corresponding target nodes; a monitoring node is established, and the full path is used as corresponding data content; analyzing the data content of the monitoring node through a preset monitoring component, and compensating and monitoring each path obtained through analysis to determine the existence of the corresponding node.

Optionally, creating a listening node includes:

and creating a monitoring node under a specified path, wherein the specified path and the full path are not overlapped.

Optionally, analyzing, by a preset monitoring component, the data content of the monitoring node includes:

and in response to determining that the specified path is not empty, invoking a preset monitoring component to read the data content of the monitoring node under the specified path.

Optionally, after reading the data content of the listening node under the designated path, the method includes:

and (3) carrying out step-by-step disassembly on the read result to obtain a plurality of target paths.

Optionally, after determining the existence of the corresponding node, the method includes:

in response to determining that a certain target node does not exist, the target node is marked as lost.

Optionally, after marking the target node as lost, including:

and determining a target path corresponding to each lost target node respectively so as to recreate the corresponding target node under each target path.

Optionally, after marking the target node as lost, including:

and recording each lost target node into a designated file, and uploading the designated file to a designated port.

In addition, the invention also provides a monitoring device, which comprises an acquisition module for acquiring the full path; the creating module is used for carrying out step-by-step disassembly on the full path to obtain a plurality of target paths so as to create a plurality of corresponding target nodes; the monitoring module is used for creating a monitoring node and taking the full path as corresponding data content; and the processing module is used for analyzing the data content of the monitoring node through a preset monitoring component, and compensating and monitoring each path obtained through analysis so as to determine the existence of the corresponding node.

One embodiment of the above invention has the following advantages or benefits: the invention achieves the technical purposes of acquiring the monitoring requirement and determining the monitoring object by acquiring the full path; meanwhile, the invention disassembles the whole path step by step to obtain a plurality of target paths so as to create a plurality of corresponding target nodes, and a plurality of multi-level nodes corresponding to the service demands are generated, thereby achieving the purpose of meeting the corresponding service technology; in addition, the invention establishes the monitoring node, takes the whole path as the corresponding data content, accurately records the whole path of the service requirement, and lays a foundation for the subsequent monitoring assembly to comprehensively monitor and compensate by analyzing the monitoring node; in addition, the invention analyzes the data content of the monitoring node through the preset monitoring component, and performs compensation monitoring on each path obtained by analysis to determine the existence of the corresponding node, so that the paths and nodes which possibly have abnormality can be checked step by step, and the technical purposes of defining the abnormality as early as possible and performing corresponding compensation processing are achieved.

Further effects of the above-described non-conventional alternatives are described below in connection with the embodiments.

Drawings

The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:

fig. 1 is a schematic diagram of the main flow of a listening method according to a first embodiment of the present invention;

FIG. 2 is a schematic diagram of a method of processing a listening component in accordance with an embodiment of the present invention;

fig. 3 is a schematic diagram of the main flow of a listening method according to a second embodiment of the present invention;

fig. 4 is a schematic diagram of the main flow of a listening method according to a third embodiment of the present invention;

fig. 5 is a schematic diagram of the main modules of a listening device according to a first embodiment of the present invention;

FIG. 6 is an exemplary system architecture diagram in which embodiments of the present invention may be applied;

fig. 7 is a schematic diagram of a computer system suitable for use in implementing an embodiment of the invention.

Detailed Description

Exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, in which various details of the embodiments of the present invention are included to facilitate understanding, and are to be considered merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

Fig. 1 is a schematic diagram of the main flow of a listening method according to a first embodiment of the present invention, as shown in fig. 1, the listening method includes:

step S101, a full path is acquired.

Step S102, performing step-by-step disassembly on the full path to obtain a plurality of target paths, so as to create a plurality of corresponding target nodes.

In an embodiment, through the processing of the two steps, different levels of routes of a plurality of nodes to be configured corresponding to service requirements are obtained, so that a plurality of data storage nodes of different levels which can be dynamically configured can be correspondingly created in a Zookeeper. For example, the acquired full path may be a/rootPath/envPath/flowlimit path/comp/compPath/module/modulePath, and it is known that the lowest level of the multi-level path is a module level, and the corresponding storage path of the component level above the module level is a/rootPath/envPath/flowlimit path/comp/compPath, so that by creating nodes of different levels, configuration data of different levels are respectively stored; in addition, for each node created in the zookeeper, a monitoring mechanism corresponding to each node is normally generated, so that the subsequent data updating operation of each node is monitored in real time. However, due to the defect of the Zookeeper, when multiple paths (and the corresponding multiple nodes thereof) are simultaneously created, partial path loss events may occur, and a listening mechanism corresponding to the paths is simultaneously lost, so that the Zookeeper is not aware of the path loss events, and is also not aware of subsequent configuration data change events, and great potential data hazards are caused.

Step S103, a monitoring node is created, and the full path is used as corresponding data content.

In the embodiment, through the processing of this step, by writing the value of the multi-stage path as the node, the technical purpose of accurately storing the full path corresponding to the service requirement can be achieved, that is, the node and the path lost in the process of creating the multi-stage node by the zookeeper do not influence the monitoring node, so that the foundation is laid for taking the value (namely the data content) of the initial multi-stage path as the standard value in the subsequent processing to perform the corresponding compensation processing.

In some embodiments, in order to avoid that the listening node itself negatively affects the full path of the traffic demand, specific processing when creating the listening node may be: and creating a monitoring node under a specified path, wherein the specified path and the full path are not overlapped. Through the processing of the step, the path of the monitoring node can be ensured not to cause any change to the multi-stage target path included by the full path, so that the condition of path disorder caused by the monitoring node can be effectively avoided. By way of example, as can be seen in FIG. 2, there is no hierarchical relationship between the path/WatcherPath of the listening node and any target path (e.g., in the figure/rootPath/envPath/flowLimittRNA/comp/compPath/module Path) included by the full path.

Step S104, analyzing the data content of the monitoring node through a preset monitoring component, and compensating and monitoring each path obtained through analysis to determine the existence of the corresponding node.

In an embodiment, through the processing of this step, the monitoring component can perform compensation monitoring on all target nodes in a full path through monitoring the data content of the nodes, and timely find the target node lost in the creation process, and perform corresponding compensation processing, so that the technical effect of timely sensing the loss event of any node in the multiple nodes created synchronously by the technical scheme can be achieved, and accordingly, corresponding potential data hazards can be found as soon as possible, and the potential data hazards can be processed as soon as possible. By way of example, as shown in fig. 2, by parsing the data content of the/WatcherPath, the multi-level path listening device (i.e., listening component) in the figure compensates for each target path including the/modulePath and/campPath for a corresponding listening event.

In some embodiments, in order to ensure that a preset monitoring component accurately identifies and parses a monitoring node, so as to improve the efficiency and accuracy of monitoring compensation in the technical scheme, when the preset monitoring component parses the data content of the monitoring node, the preset monitoring component is called in response to determining that the designated path is not air-conditioner, so as to read the data content of the monitoring node under the designated path. The specified path may be a path specially storing the monitoring node, so that the specified path is not empty and corresponds to the corresponding monitoring node which is created, and a preset monitoring component is required to be called to process the corresponding compensating monitoring event. The processing of this step enables the listening component to perceive the need for listening compensation in real time.

In some embodiments, in order to perform comprehensive monitoring and checking on paths and nodes with abnormal loss events, after the data content of the monitoring nodes under the designated paths is read, the reading result is disassembled step by step to obtain a plurality of target paths.

In some embodiments, in order to quickly screen out target nodes suspected of being lost according to the listening process, after determining the existence of a corresponding node, a certain target node may be marked as lost in response to determining that the target node is not present. The processing of the step can achieve the technical purpose of compensating and monitoring each newly created target path and target node, so that a monitoring component can rapidly locate the defect of the full path through monitoring and compensation under the condition that a corresponding monitoring mechanism is lost, and a foundation is laid for subsequent node reconstruction and defect reporting processing.

In some embodiments, to minimize the traffic impact of the lost target paths on the full path, after the target nodes are marked as lost, a respective target path for each lost target node may be determined to recreate a corresponding target node under each target path.

In some embodiments, in order to timely report the result of the compensation monitoring so as to facilitate statistics and management of abnormal conditions of the system, after the target nodes are marked as lost, each lost target node may be recorded into a designated file, and the designated file is uploaded to a designated port, so that the abnormal conditions of the business occurring through the designated port can be timely recorded and analyzed.

Fig. 3 is a schematic diagram of the main flow of a listening method according to a second embodiment of the present invention, the listening method comprising:

step S301, a multi-stage path is acquired.

Step S302, generating a target node outside the multi-level path.

Step S303, taking the multi-level path as the data content corresponding to the target node, and monitoring the target node.

Step S304, generating a plurality of corresponding nodes according to the multi-level paths.

Step S305, in response to monitoring the target node change event.

Step S306, the data content changed by the target node is split step by step, and a plurality of changed paths are obtained.

Step S307, compensation monitoring is performed on the nodes corresponding to each changed path respectively so as to judge the existence of each node.

Step S308, in response to determining that a certain node does not exist, the node is taken as a change node.

Step S309, determining a rerouting path corresponding to the rerouting node, so as to regenerate the corresponding node under the rerouting path.

Fig. 4 is a schematic diagram of the main flow of a listening method according to a third embodiment of the present invention, the listening method comprising:

step S401, a full path is acquired.

Step S402, performing step-by-step disassembly on the full path to obtain a plurality of target paths, so as to create a plurality of corresponding target nodes.

Step S403, a listening node is created under the specified path.

Preferably, there is no overlap between the designated path and the full path.

And step S404, taking the full path as corresponding data content.

Step S405, in response to determining that the specified path is not empty, invoking a preset listening component to read the data content of the listening node under the specified path.

Step S406, the reading result is disassembled step by step to obtain a plurality of target paths.

Step S407, monitoring the target node corresponding to each target path obtained through analysis.

In step S408, in response to determining that a certain target node does not exist, the target node is marked as lost.

Step S409, determining a target path corresponding to each lost target node, so as to recreate a corresponding target node under each target path.

Preferably, each lost target node is recorded in a designated file, and the designated file is uploaded to a designated port.

Fig. 5 is a schematic diagram of main modules of a listening device according to an embodiment of the present invention, and as shown in fig. 5, the listening device 500 includes an acquisition module 501, a creation module 502, a listening module 503, and a processing module 504. The acquiring module 501 is configured to acquire a full path; the creating module 502 is configured to progressively disassemble the full path to obtain a plurality of target paths, so as to create a plurality of corresponding target nodes; and the monitoring module 503 is configured to create a monitoring node, and take the full path as a corresponding data content; and the processing module 504 is configured to parse the data content of the listening node through a preset listening component, and perform compensation listening on each path obtained by parsing, so as to determine the existence of the corresponding node.

In some embodiments, the listening module 503 is further configured to: and creating a monitoring node under a specified path when the monitoring node is created, wherein the specified path and the full path are not overlapped.

In some embodiments, the processing module 504 is further configured to: when analyzing the data content of the monitoring node through a preset monitoring component, responding to the fact that the appointed path is not empty, calling the preset monitoring component to read the data content of the monitoring node under the appointed path.

In some embodiments, the processing module 504 is further configured to: after the data content of the monitoring nodes under the designated paths is read, the reading result is disassembled step by step, and a plurality of target paths are obtained.

In some embodiments, the processing module 504 is further configured to: after determining the presence of the corresponding node, a certain target node is marked as lost in response to determining that the target node is not present.

In some embodiments, the processing module 504 is further configured to: after marking the target nodes as lost, determining target paths corresponding to each lost target node respectively so as to recreate the corresponding target nodes under each target path.

In some embodiments, the processing module 504 is further configured to: after the target nodes are marked as lost, each lost target node is recorded into a designated file, and the designated file is uploaded to a designated port.

It should be noted that, in the method for monitoring and the monitoring device of the present invention, there is a corresponding relationship between the implementation content, so the repetitive content will not be described.

Fig. 6 illustrates an exemplary system architecture 600 in which a listening method or listening device of an embodiment of the present invention may be applied.

As shown in fig. 6, the system architecture 600 may include terminal devices 601, 602, 603, a network 604, and a server 605. The network 604 is used as a medium to provide communication links between the terminal devices 601, 602, 603 and the server 605. The network 604 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.

A user may interact with the server 605 via the network 604 using the terminal devices 601, 602, 603 to receive or send messages, etc. Various communication client applications can be installed on the terminal devices 601, 602, 603.

The terminal devices 601, 602, 603 may be various electronic devices having a page display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.

The server 605 may be a server providing various services, such as a background management server (by way of example only) providing support for users with the terminal devices 601, 602, 603. The background management server may analyze and process the received data such as the product information query request, and feedback the processing result (e.g., the target push information, the product information—only an example) to the terminal device.

It should be noted that, the listening method provided by the embodiment of the present invention is generally executed by the server 605, and accordingly, the computing device is generally disposed in the server 605.

It should be understood that the number of terminal devices, networks and servers in fig. 6 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

Referring now to FIG. 7, there is illustrated a schematic diagram of a computer system 700 suitable for use in implementing an embodiment of the present invention. The terminal device shown in fig. 7 is only an example, and should not impose any limitation on the functions and the scope of use of the embodiment of the present invention.

As shown in fig. 7, the computer system 700 includes a Central Processing Unit (CPU) 701, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 702 or a program loaded from a storage section 708 into a Random Access Memory (RAM) 703. In the RAM703, various programs and data required for the operation of the computer system 700 are also stored. The CPU701, ROM702, and RAM703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.

The following components are connected to the I/O interface 505: an input section 706 including a keyboard, a mouse, and the like; an output section 707 including a Cathode Ray Tube (CRT), a liquid crystal page display processor (LCD), and the like, and a speaker, and the like; a storage section 708 including a hard disk or the like; and a communication section 709 including a network interface card such as a LAN card, a modem, or the like. The communication section 709 performs communication processing via a network such as the internet. The drive 710 is also connected to the I/O interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 710 as necessary, so that a computer program read therefrom is mounted into the storage section 708 as necessary.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 709, and/or installed from the removable medium 711. The above-described functions defined in the system of the present invention are performed when the computer program is executed by a Central Processing Unit (CPU) 701.

The computer readable medium shown in the present invention may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules involved in the embodiments of the present invention may be implemented in software or in hardware. The described modules may also be provided in a processor, for example, as: a processor includes an acquisition module, a creation module, a listening module, and a processing module. The names of these modules do not constitute a limitation on the module itself in some cases.

As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be present alone without being fitted into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to include acquiring a full path; step-by-step disassembly is carried out on the full path to obtain a plurality of target paths so as to create a plurality of corresponding target nodes; a monitoring node is established, and the full path is used as corresponding data content; analyzing the data content of the monitoring node through a preset monitoring component, and compensating and monitoring each path obtained through analysis to determine the existence of the corresponding node.

According to the technical scheme provided by the embodiment of the invention, the technical problem that part of paths and monitoring events thereof can be lost without perception when the Zookeeper creates the multi-level paths can be solved.

The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives can occur depending upon design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims

1. A method of listening, comprising:

acquiring a full path;

step-by-step disassembly is carried out on the full path to obtain a plurality of target paths so as to create a plurality of corresponding target nodes;

a monitoring node is established, and the full path is used as corresponding data content;

analyzing the data content of the monitoring node through a preset monitoring component, and compensating and monitoring each path obtained through analysis to determine the existence of the corresponding node.

2. The method of claim 1, wherein creating a listening node comprises:

3. The method of claim 2, wherein parsing the data content of the listening node by a preset listening component comprises:

4. A method according to claim 3, characterized in that after reading the data content of the listening node under the specified path, it comprises:

5. The method of claim 1, wherein after determining the presence of the corresponding node, comprising:

6. The method of claim 5, wherein marking the target node as lost comprises:

7. The method of claim 5, wherein marking the target node as lost comprises:

8. A listening device, comprising:

the acquisition module is used for acquiring the full path;

the creating module is used for carrying out step-by-step disassembly on the full path to obtain a plurality of target paths so as to create a plurality of corresponding target nodes;

the monitoring module is used for creating a monitoring node and taking the full path as corresponding data content;

and the processing module is used for analyzing the data content of the monitoring node through a preset monitoring component, and compensating and monitoring each path obtained through analysis so as to determine the existence of the corresponding node.

9. The apparatus of claim 8, wherein creating a listening node comprises:

10. The apparatus of claim 9, wherein parsing the data content of the listening node by a preset listening component comprises:

11. The apparatus of claim 10, wherein after reading the data content of the listening node under the designated path, comprising:

12. The apparatus of claim 8, wherein after determining the presence of the corresponding node, comprising:

13. The apparatus of claim 12, wherein after marking the target node as lost, comprising:

14. The apparatus of claim 12, wherein after marking the target node as lost, comprising:

15. An electronic device, comprising:

one or more processors;

storage means for storing one or more programs,

when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-7.

16. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any of claims 1-7.

17. A computer readable medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any of claims 1-7.