CN108845910B - Monitoring method, device and storage medium of large-scale micro-service system - Google Patents
Monitoring method, device and storage medium of large-scale micro-service system Download PDFInfo
- Publication number
- CN108845910B CN108845910B CN201810547288.2A CN201810547288A CN108845910B CN 108845910 B CN108845910 B CN 108845910B CN 201810547288 A CN201810547288 A CN 201810547288A CN 108845910 B CN108845910 B CN 108845910B
- Authority
- CN
- China
- Prior art keywords
- micro
- performance data
- service
- alarm
- access
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000012544 monitoring process Methods 0.000 title claims abstract description 31
- 230000004044 response Effects 0.000 claims description 16
- 238000004364 calculation method Methods 0.000 claims description 9
- 230000015556 catabolic process Effects 0.000 claims description 8
- 238000006731 degradation reaction Methods 0.000 claims description 8
- 230000001960 triggered effect Effects 0.000 claims description 6
- 230000002159 abnormal effect Effects 0.000 abstract description 14
- 230000009286 beneficial effect Effects 0.000 abstract 1
- 230000008569 process Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000005856 abnormality Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Abstract
The invention provides a monitoring method and device of a large-scale micro-service system and a computer readable storage medium. The method comprises the following steps: collecting various performance data of various micro services in real time; storing the performance data acquired in real time into a message queue in a message mode; processing the message in the message queue, and judging whether the performance data in the message exceeds a preset threshold value; when certain performance data of a certain micro-service exceeds a preset threshold, triggering an alarm, and dynamically adjusting the access quantity to the micro-service until the performance data of the micro-service is restored to a normal range. The invention reduces the error rate of the system by carrying out real-time monitoring on the performance data of a large number of micro services in the large-scale micro service system and dynamically adjusting the access flow of the abnormal micro services, and is also beneficial to improving the debugging efficiency of the system by triggering an alarm.
Description
Technical Field
The present invention relates to the field of micro-service technologies, and in particular, to a method and apparatus for monitoring a large-scale micro-service system, and a computer readable storage medium.
Background
Micro-services (Microservice Architecture) are an emerging style of software architecture that develops a stand-alone complete application system by way of developing some micro-services. Each micro-service is built around a service function, can be deployed independently through an automatic deployment mechanism, runs in a process of the micro-service, and adopts a lightweight communication mechanism, typically an HTTP-based RESTful API. These micro-services may be written using different programming languages, may use different data storage techniques, and remain minimally centrally managed.
Large-scale micro-service systems involve thousands of micro-services. Any component error may result in a user not having normal access because of the possible dependencies between the microservices. At present, when a large-scale micro-service system fails, the fault is usually removed by calling and analyzing system service logs, and because the number of related micro-services is huge, if a large number of logs are called and analyzed again when the fault is found, the fault is removed, and the debugging efficiency cannot be ensured.
Disclosure of Invention
In view of the foregoing, it is necessary to provide a monitoring method, apparatus and computer readable storage medium for a large-scale micro service system, which monitors all micro services on the micro service platform architecture level to ensure the stability of all running services and improve the debug efficiency of the system.
In order to achieve the above object, the present invention provides a monitoring method for a large-scale micro service system, the method comprising:
the acquisition step: collecting various performance data of various micro services in real time;
the storage step: storing the performance data acquired in real time into a message queue in a message mode;
judging: processing the message in the message queue, and judging whether the performance data in the message exceeds a preset threshold value; and
An adjustment step: when certain performance data of a certain micro-service exceeds a preset threshold, triggering an alarm, and dynamically adjusting the access amount to the micro-service until the performance data of the micro-service is restored to a normal range.
Preferably, the method further comprises the step of calculating: when all performance data of each micro service do not exceed a preset threshold value, respectively calculating the same ratio difference value of all performance data of the current period and all performance data of the history simultaneous period and the ring ratio difference value of all performance data of the previous period, and triggering an alarm when the same ratio difference value or the ring ratio difference value exceeds a preset value.
Preferably, the data generated in the judging step, the adjusting step, and the calculating step are stored in a storage system.
Preferably, the performance data includes a request access amount per second, an access Response Time (RT), a TOTAL access amount (TOTAL) within a preset Time, an access error amount (FAIL) within a preset Time, and a concurrent access amount (concurrent) within a preset Time.
Preferably, the adjusting the access amount to the micro service dynamically in the adjusting step includes the following steps:
gradually increasing the concurrent access quantity to the triggered alarm micro-service;
when the concurrent access quantity reaches a preset threshold value, triggering an alarm, carrying out flow degradation on the micro service, and rejecting subsequently received access requests.
The invention also provides an electronic device, which comprises a memory and a processor, wherein the memory comprises a monitoring program of a large-scale micro-service system, and the monitoring program of the large-scale micro-service system realizes the following steps when being executed by the processor:
the acquisition step: collecting various performance data of various micro services in real time;
the storage step: storing the performance data acquired in real time into a message queue in a message mode;
judging: processing the message in the message queue, and judging whether the performance data in the message exceeds a preset threshold value; and
An adjustment step: when certain performance data of a certain micro-service exceeds a preset threshold, triggering an alarm, and dynamically adjusting the access amount to the micro-service until the performance data of the micro-service is restored to a normal range.
Preferably, when all performance data of each micro service do not exceed a preset threshold value, the same ratio difference value of all performance data of the current period and all performance data of the history simultaneous period and the ring ratio difference value of all performance data of the previous period are respectively calculated, and when the same ratio difference value or the ring ratio difference value exceeds a preset value, an alarm is triggered.
Preferably, the performance data includes a request access amount per second, an access response time, a total access amount within a preset time, an access error amount within the preset time, and a concurrent access amount within the preset time.
Preferably, the adjusting the access amount to the micro service dynamically in the adjusting step includes the following steps:
gradually increasing the concurrent access quantity to the triggered alarm micro-service;
when the concurrent access quantity reaches a preset threshold value, triggering an alarm, carrying out flow degradation on the micro service, and rejecting subsequently received access requests.
The present invention also provides a computer-readable storage medium including therein a monitoring program of a large-scale micro-service system, which when executed by a processor, implements any of the steps in the monitoring method of a large-scale micro-service system as described above.
The monitoring method, the device and the computer readable storage medium of the large-scale micro-service system provided by the invention collect various performance data of each micro-service in real time, store the performance data in a message queue in a message mode, then process the message in the message queue, judge whether the collected performance data is abnormal or not, trigger an alarm if the collected performance data is abnormal, dynamically adjust the access quantity to the micro-service triggering the alarm until the performance data of the micro-service is recovered to a normal range, so as to reduce the error rate of the system; if the collected performance data is not abnormal, calculating and analyzing the change condition of the performance data, and if the abnormal change of the performance data is found, triggering an alarm to timely check the micro-service which is possibly abnormal, so as to avoid the spread of the micro-service abnormal in a large-scale micro-service system.
Drawings
FIG. 1 is a schematic diagram of an electronic device according to a preferred embodiment of the invention;
FIG. 2 is a block diagram of a preferred embodiment of a monitor of the large-scale micro-service system of FIG. 1;
FIG. 3 is a flow chart of a monitoring method of a large-scale micro-service system according to a first preferred embodiment of the present invention;
FIG. 4 is a flow chart of a monitoring method of a large-scale micro-service system according to a second preferred embodiment of the present invention;
FIG. 5 is a flow chart of a monitoring method of a large-scale micro-service system according to a third preferred embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The invention provides an electronic device. Referring to fig. 1, a schematic diagram of a preferred embodiment of an electronic device 1 according to the present invention is shown. In this embodiment, the electronic device 1 collects various performance data of each micro service in real time, analyzes and calculates the performance data, triggers an alarm when abnormal data is found, and achieves graceful degradation of the micro service by dynamically adjusting the access amount to the micro service triggering the alarm until the performance data of the micro service is restored to a normal range, thereby helping to ensure the stability of the micro service in operation.
The electronic device 1 may be a terminal device with storage and operation functions, such as a server, a smart phone, a tablet computer, a portable computer, a desktop computer, etc. In one embodiment, when the electronic apparatus 1 is a server, the server may be one or more of a rack server, a blade server, a tower server, a rack server, or the like.
The electronic device 1 comprises a memory 11, a processor 12, a network interface 13 and a communication bus 14.
Wherein the memory 11 comprises at least one type of readable storage medium. The at least one type of readable storage medium may be a non-volatile storage medium such as flash memory, a hard disk, a multimedia card, a card memory, etc. In some embodiments, the readable storage medium may be an internal storage unit of the electronic device 1, such as a hard disk of the electronic device 1. In other embodiments, the readable storage medium may also be an external memory 11 of the electronic device 1, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card) or the like, which are provided on the electronic device 1.
In this embodiment, the readable storage medium of the memory 11 is generally used for storing an operating system, a monitoring program 10 of a large-scale micro-service system, performance data collected in real time, configuration information, and the like. The memory 11 may also be used for temporarily storing data that has been output or is to be output.
The processor 12 may in some embodiments be a central processing unit (Central Processing Unit, CPU), microprocessor or other data processing chip for running program code or processing data stored in the memory 11, such as executing the monitoring program 10 of a large-scale micro-service system, etc.
The network interface 13 may comprise a standard wired interface, a wireless interface (e.g., WI-FI interface). Typically for establishing a communication connection between the electronic apparatus 1 and other electronic devices or systems.
The communication bus 14 is used to enable connection communication between the above-described components.
Fig. 1 shows only an electronic device 1 with components 11-14 and a monitoring program 10 of a large scale micro-service system, but it is understood that not all shown components are required to be implemented, and that more or fewer components may alternatively be implemented.
Alternatively, the electronic apparatus 1 may further include a background manager interface of the micro service system, which may include an input unit such as a Keyboard (Keyboard), a voice input device such as a Microphone (Microphone), and the like, a device having a voice recognition function, a voice output device such as a sound box, a headphone, and the like. Optionally, the background administrator interface of the microservice system may also include a standard wired interface, a wireless interface.
Optionally, the electronic device 1 may also comprise a display, which may also be referred to as a display screen or display unit. In some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an Organic Light-Emitting Diode (OLED) display, or the like. The display is used for displaying information processed in the electronic device 1 and for displaying a background administrator interface of the visualized micro-service system.
Optionally, the electronic device 1 further comprises a touch sensor. The area provided by the touch sensor for a background administrator of the micro-service system to perform touch operation is called a touch area. Further, the touch sensors described herein may be resistive touch sensors, capacitive touch sensors, and the like. The touch sensor may include not only a contact type touch sensor but also a proximity type touch sensor. Furthermore, the touch sensor may be a single sensor or may be a plurality of sensors arranged in an array, for example. A background administrator of the micro-service system may initiate the monitoring program 10 of the large-scale micro-service system by touching the touch area.
The area of the display of the electronic device 1 may be the same as or different from the area of the touch sensor. Optionally, a display is stacked with the touch sensor to form a touch display screen. The device detects touch operation triggered by a background manager of the micro-service system based on the touch display screen.
The electronic device 1 may further include Radio Frequency (RF) circuits, sensors and audio circuits, etc., which will not be described in detail herein.
In the above embodiment, the processor 12 implements the following steps when executing the monitor program 10 of the large-scale micro service system stored in the memory 11:
the acquisition step: collecting various performance data of various micro services in real time;
the storage step: storing the performance data acquired in real time into a message queue in a message mode;
judging: processing the message in the message queue, and judging whether the performance data in the message exceeds a preset threshold value; and
An adjustment step: when certain performance data of a certain micro-service exceeds a preset threshold, triggering an alarm, and dynamically adjusting the access amount to the micro-service until the performance data of the micro-service is restored to a normal range.
For a detailed description of the above steps, refer to the following program block diagram of the preferred embodiment of the monitoring program 10 of the large-scale micro-service system in fig. 2 and the flowchart of the preferred embodiment of the monitoring method of the large-scale micro-service system in fig. 3, 4 and 5.
In other embodiments, the monitoring program 10 of the large-scale micro-service system may be divided into a plurality of modules, which are stored in the memory 12 and executed by the processor 13 to complete the present invention. The invention may refer to a series of computer program instruction segments capable of performing a specified function.
Referring to FIG. 2, a block diagram of a preferred embodiment of the monitor 10 of the large-scale micro-service system of FIG. 1 is shown. In this embodiment, the monitoring program 10 of the large-scale micro service system may be divided into: the system comprises an acquisition module 110, a storage module 120, a judgment module 130, a calculation module 140, an alarm module 150, an adjustment module 160 and a configuration module 170.
And the acquisition module 110 is used for acquiring various performance data of each micro service in real time. The performance data includes, but is not limited to, system performance indexes such as request access amount per second, access response time, total access amount in preset time, access error amount in preset time, concurrence amount in preset time and the like. In one embodiment, the acquisition module 110 acquires the performance data in real time using a buried point technique, providing data support for monitoring of the micro-service system of the present invention. For example, during the operation of the large-scale micro-service system, the acquisition module 110 acquires various data of each micro-service in real time by means of a visual embedded point or a full embedded point.
The storage module 120 is configured to store the performance data acquired in real time to the message queue in a message manner. For example, the storage module 120 stores n pieces of performance data collected in real time in a message queue according to a time sequence.
And the judging module 130 is configured to process the message in the message queue, and judge whether the performance data in the message exceeds a preset threshold. For example, the determining module 130 invokes a certain number of threads, processes the access response time of the front micro service a in the message queue and the access error amount of the micro service a in a preset time (for example, 5 seconds), and compares the access response time with a preset threshold value read from the memory 11, and determines whether the value of the performance data exceeds the preset threshold value.
It will be appreciated that, to achieve greater real-time performance, the determination module 130 typically invokes a sufficient number of threads to process the messages in the message queue in time.
The calculating module 140 is configured to calculate a comparison difference between each item of performance data in the current period and each item of performance data in the historical simultaneous period and a loop ratio difference between each item of performance data in the previous period, and compare the calculation result with a preset value. When the judging module 130 judges that all performance data of each micro service do not exceed the preset threshold, the calculating module 140 calculates the same ratio difference value between each performance data of the current period and each performance data of the history simultaneous period and the ring ratio difference value between each performance data of the previous period, and if the same ratio difference value or the ring ratio difference value exceeds the preset value, the calculating module 140 sends the calculation result to the alarm module 150.
For example, the calculation module 140 calculates a difference between the access error amount of the current period (e.g., 10:00-11:00) of the micro service a and the access error amount of the same period yesterday, and a difference between the access error amount of the previous period (9:00-10:00), and if the access error amount exceeds a preset value (e.g., 50), the calculation module 140 notifies the alarm module 150, and the alarm module 150 triggers an alarm.
And the alarm module 150 is used for triggering an alarm when a preset condition is met. For example, an alarm is triggered when certain performance data of a certain micro-service exceeds a preset threshold. In the above example, assuming that the preset threshold of the access response time of the micro service a is 0.15 seconds, and the access response time of the micro service a stored in the message queue acquired in real time is 4.2 seconds, the judging module 130 sends the judging result that the access response time of the micro service a exceeds the preset threshold to the alarm module 150, and the alarm module 150 triggers an alarm. For another example, if the calculation module 140 determines that the same ratio difference or the ring ratio difference exceeds a preset value, the alarm module 150 triggers an alarm.
It should be noted that, the types of abnormal triggering alarms of the performance data of different micro services may be different, for example, when the micro service a triggers an alarm, an alarm short message may be sent to a background administrator of the first micro service system or a background administrator group of the first micro service system, and when the micro service B triggers an alarm, an alarm mail may be sent to a background administrator of the second micro service system or a background administrator group of the second micro service system. The above triggering of different alarm types for different abnormal situations is merely provided as a partial example and is not exhaustive.
And the adjusting module 160 is configured to dynamically adjust the access amount of the micro service corresponding to the abnormal performance data until the performance data of the micro service is restored to the normal range. For example, according to the above example, after the access response time of the micro service a exceeds the preset threshold, the alarm module 150 triggers an alarm, the adjustment module 160 increases the concurrent access amount of the micro service a gradually (for example, increases the preset amount every 5 seconds), when the concurrent access amount reaches the preset threshold, the alarm module 150 triggers an alarm, the adjustment module 160 performs traffic degradation on the micro service, and denies the subsequently received access request (for example, returns an access error prompt to the access requester) until the performance data of the micro service returns to the normal range.
The adjustment module 160 dynamically adjusts the access amount of the micro service with abnormal performance data after the alarm module 150 triggers an alarm, thereby realizing graceful degradation of the micro service, further realizing the technical effect of reducing the error rate of the system, and the whole process does not need manual intervention. It can be appreciated that, after receiving the alarm from the alarm module 150, the background administrator of the micro service system may also analyze the cause of the abnormality and solve the abnormality problem through manual intervention.
A configuration module 160, configured to configure alarm rules, including preset thresholds for each performance data of each micro service. The preset threshold value of each performance data of each micro service can be dynamically configured by a background manager of the micro service system according to the service scene, namely, the threshold value for triggering alarm is configured according to the actual application requirement of each micro service. For example, regarding the alarm rule of the access error amount of the micro service a in the preset time, the following configuration may be performed:
rule name: provider_check
Rule description: service provider error times are relatively high
Rule calculation: 100/$ { invokeCount } >10& $ { invokeCount } >1
In other embodiments, the storage module 120 is further configured to store data generated during operation of the judging module 130, the calculating module 140, the alarm module 150, the adjusting module 160, and the configuring module 170 in the memory 11.
In addition, the invention also provides a monitoring method of the large-scale micro-service system. Referring to fig. 3, a flowchart of a monitoring method of a large-scale micro service system according to a first preferred embodiment of the present invention is shown. The processor 12 of the electronic device 1 executes the monitoring program 10 of the large-scale micro-service system stored in the memory 11 to realize the following steps of the monitoring method of the large-scale micro-service system:
in step S300, the acquisition module 110 acquires each performance data of each micro service in real time. For example, during the operation of the micro service system, the acquisition module 110 acquires system performance indexes such as the per-second request access quantity, the access response time, the total access quantity in a preset time, the access error quantity in the preset time and the concurrency quantity in the preset time of each micro service in real time by using the embedded point technology, and provides data support for monitoring of the micro service system. .
In step S301, the storage module 120 stores the performance data acquired in real time in a message manner to a message queue.
In step S302, the determining module 130 processes the message in the message queue, and determines whether the performance data in the message exceeds a preset threshold. For example, the determining module 130 invokes a sufficient number of threads to process the messages in the message queue, including the access response time of the micro service a and the access error amount of the micro service a in a preset time (for example, 5 seconds), and compares the processed messages with a preset threshold value read from the memory 11, to determine whether the value of the performance data exceeds the preset threshold value.
In step S303, when the performance data of a certain micro-service exceeds the preset threshold, the alarm module 150 triggers an alarm, and the adjustment module 160 dynamically adjusts the access amount to the micro-service until the performance data of the micro-service is restored to the normal range. For example, assuming that the preset threshold of the access response time of the micro service a is 0.15 seconds, and the access response time of the micro service a stored in the message queue acquired in real time is 4.2 seconds, the judging module 130 sends a judging result that the access response time of the micro service a exceeds the preset threshold to the alarm module 150, the alarm module 150 triggers an alarm, the adjusting module 160 increases the concurrent access amount of the micro service a gradually (for example, increases the preset amount every 5 seconds), when the concurrent access amount reaches the preset threshold, the alarm module 150 triggers an alarm, the adjusting module 160 performs traffic degradation on the micro service, and refuses the subsequently received access request (for example, returns an access error prompt to the access requester) until the performance data of the micro service is restored to the normal range.
It should be noted that, the types of abnormal triggering alarms of the performance data of different micro services may be different, for example, when the micro service a triggers an alarm, an alarm short message may be sent to a background administrator of the first micro service system or a background administrator group of the first micro service system, and when the micro service B triggers an alarm, an alarm mail may be sent to a background administrator of the second micro service system or a background administrator group of the second micro service system. The above triggering of different alarm types for different abnormal situations is merely provided as a partial example and is not exhaustive.
Referring to fig. 4, a flow chart of a second preferred embodiment of the monitoring method of the large-scale micro-service system of the present invention is shown. In this embodiment, steps S400-S403 of the monitoring method of the large-scale micro-service system are similar to steps S300-S303 of the first preferred embodiment, except that this embodiment further includes step S404. The processor 12 of the electronic device 1, when executing the monitoring program 10 of the large-scale micro service system stored in the memory 11, further implements the following steps of the monitoring method of the large-scale micro service system:
step S404: when all the performance data of each micro service do not exceed the preset threshold, the calculation module 140 calculates the same ratio difference value of all the performance data of the current period and all the performance data of the history simultaneous period and the ring ratio difference value of all the performance data of the previous period respectively, and when the same ratio difference value or the ring ratio difference value exceeds the preset value, the alarm module 150 triggers an alarm.
Referring to fig. 5, a flow chart of a third preferred embodiment of the monitoring method of the large-scale micro-service system according to the present invention is shown. In this embodiment, steps S500-S504 of the monitoring method of the large-scale micro-service system are similar to steps S400-S404 of the second preferred embodiment, except that this embodiment further includes step S505. The processor 12 of the electronic device 1, when executing the monitoring program 10 of the large-scale micro service system stored in the memory 11, further implements the following steps of the monitoring method of the large-scale micro service system:
in step S505, the storage module 120 stores the data generated during the operation of the judging module 130, the calculating module 140, the alarm module 150, the adjusting module 160, and the configuration module 170 into the memory 11. The stored data includes a judgment result of the judging module 130 on whether the performance data exceeds a preset threshold, an actual condition of whether the alarm module 150 triggers an alarm, a type of the alarm module 150 triggering an alarm, a comparison difference value of each performance data of each time period calculated by the calculating module 140, a specific operation of dynamically adjusting the access amount of the micro service by the adjusting module 160, a preset threshold of each performance data of each micro service set by the configuring module 170, and the like.
Furthermore, the present invention also provides a computer readable storage medium, which may be any one or any combination of several of a hard disk, a multimedia card, an SD card, a flash memory card, an SMC, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable compact disc read-only memory (CD-ROM), a USB memory, and the like. The computer readable storage medium includes therein a monitoring program 10 of a large-scale micro service system, which monitoring program 10, when executed by the processor 12, performs the following operations:
the acquisition step: collecting various performance data of various micro services in real time;
the storage step: storing the performance data acquired in real time into a message queue in a message mode;
judging: processing the message in the message queue, and judging whether the performance data in the message exceeds a preset threshold value; and
An adjustment step: when certain performance data of a certain micro-service exceeds a preset threshold, triggering an alarm, and dynamically adjusting the access amount to the micro-service until the performance data of the micro-service is restored to a normal range.
The specific implementation of the computer readable storage medium of the present invention is substantially the same as the above-mentioned monitoring method of the large-scale micro-service system and the specific implementation of the electronic device 1, please refer to the program block diagram of the preferred embodiment of the monitoring program 10 of the large-scale micro-service system in fig. 2 and the detailed description of the flowcharts of the preferred embodiment of the monitoring method of the large-scale micro-service system in fig. 3, 4 and 5, which are not repeated herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, apparatus, article, or method. In addition, the technical solutions of the embodiments may be combined with each other, but it is necessary to base that the technical solutions can be realized by those skilled in the art, and when the technical solutions are contradictory or cannot be realized, the combination of the technical solutions should be considered to be absent and not within the scope of protection claimed in the present invention.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium as described above, comprising several instructions for causing an electronic device to perform the method according to the various embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (8)
1. A monitoring method of a large-scale micro-service system, applied to an electronic device, characterized in that the method comprises the following steps:
the acquisition step: collecting various performance data of various micro services in real time;
the storage step: storing the performance data acquired in real time into a message queue in a message mode;
judging: processing the message in the message queue, and judging whether the performance data in the message exceeds a preset threshold value; and
An adjustment step: when certain performance data of a certain micro-service exceeds a preset threshold, triggering an alarm and sending the alarm to a background management end corresponding to the micro-service, gradually increasing concurrent access quantity of the micro-service triggering the alarm, and when the concurrent access quantity reaches the preset threshold, triggering the alarm, carrying out flow degradation on the micro-service, and refusing a subsequently received access request until the performance data of the micro-service is restored to a normal range.
2. The method of monitoring a large-scale microservice system of claim 1, further comprising:
the calculation steps are as follows: when all performance data of each micro service do not exceed a preset threshold value, respectively calculating the same ratio difference value of all performance data of the current period and all performance data of the history simultaneous period and the ring ratio difference value of all performance data of the previous period, and triggering an alarm when the same ratio difference value or the ring ratio difference value exceeds a preset value.
3. The method of monitoring a large-scale microservice system of claim 2, further comprising:
and storing the data generated in the judging step, the adjusting step and the calculating step into a storage system.
4. The method of monitoring a large-scale micro-service system according to claim 1 or 2, wherein the performance data includes a request access amount per second, an access response time, a total access amount within a preset time, an access error amount within a preset time, and a concurrent access amount within a preset time.
5. An electronic device comprising a memory and a processor, wherein the memory stores a monitoring program for a large-scale micro-service system, which when executed by the processor, performs the steps of:
the acquisition step: collecting various performance data of various micro services in real time;
the storage step: storing the performance data acquired in real time into a message queue in a message mode;
judging: processing the message in the message queue, and judging whether the performance data in the message exceeds a preset threshold value; and
An adjustment step: when certain performance data of a certain micro-service exceeds a preset threshold, triggering an alarm and sending the alarm to a background management end corresponding to the micro-service, gradually increasing concurrent access quantity of the micro-service triggering the alarm, and when the concurrent access quantity reaches the preset threshold, triggering the alarm, carrying out flow degradation on the micro-service, and refusing a subsequently received access request until the performance data of the micro-service is restored to a normal range.
6. The electronic device of claim 5, wherein when each performance data of each micro-service does not exceed a preset threshold, a same ratio difference value between each performance data of a current period and each performance data of a history simultaneous period and a ring ratio difference value between each performance data of a previous period are calculated, and when the same ratio difference value or the ring ratio difference value exceeds a preset value, an alarm is triggered.
7. The electronic device of claim 5 or 6, wherein the performance data includes a request per second access volume, an access response time, a total access volume within a preset time, an access error volume within a preset time, and a concurrent access volume within a preset time.
8. A computer-readable storage medium, wherein a monitoring program of a large-scale micro-service system is stored in the computer-readable storage medium, which when executed by a processor, implements the steps of the monitoring method of a large-scale micro-service system according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810547288.2A CN108845910B (en) | 2018-05-31 | 2018-05-31 | Monitoring method, device and storage medium of large-scale micro-service system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810547288.2A CN108845910B (en) | 2018-05-31 | 2018-05-31 | Monitoring method, device and storage medium of large-scale micro-service system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108845910A CN108845910A (en) | 2018-11-20 |
| CN108845910B true CN108845910B (en) | 2024-02-06 |
Family
ID=64210119
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810547288.2A Active CN108845910B (en) | 2018-05-31 | 2018-05-31 | Monitoring method, device and storage medium of large-scale micro-service system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108845910B (en) |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109739727B (en) * | 2019-01-03 | 2022-07-01 | 优信拍（北京）信息科技有限公司 | Service monitoring method and device in micro-service architecture |
| CN109873736A (en) * | 2019-01-18 | 2019-06-11 | 苏宁易购集团股份有限公司 | A kind of micro services monitoring method and system |
| CN109831356A (en) * | 2019-01-29 | 2019-05-31 | 网联清算有限公司 | Data processing method, device, system, computer readable storage medium |
| CN110149364A (en) * | 2019-04-15 | 2019-08-20 | 厦门市美亚柏科信息股份有限公司 | Method, apparatus, the storage medium of micro services are provided based on data service platform |
| CN110365762B (en) * | 2019-07-10 | 2022-03-11 | 腾讯科技（深圳）有限公司 | Service processing method, device, equipment and storage medium |
| CN110535902A (en) * | 2019-07-16 | 2019-12-03 | 平安普惠企业管理有限公司 | The processing method and electronic device of monitoring intelligent are realized based on micro services |
| CN110535779B (en) * | 2019-08-30 | 2020-09-11 | 百度在线网络技术（北京）有限公司 | Traffic degradation method and device |
| CN110727518B (en) * | 2019-10-14 | 2022-05-27 | 北京奇艺世纪科技有限公司 | Data processing method and related equipment |
| CN110852598B (en) * | 2019-11-07 | 2023-07-11 | 腾讯科技（深圳）有限公司 | Data processing method, device, equipment and storage medium |
| CN110990245A (en) * | 2019-12-04 | 2020-04-10 | 北京明略软件系统有限公司 | Micro-service operation state judgment method and device based on call chain data |
| CN111092778A (en) * | 2019-12-31 | 2020-05-01 | 谷云科技(广州)有限责任公司 | System and method for realizing API real-time early warning based on limited time sequence data queue |
| CN111290924B (en) * | 2020-01-22 | 2022-05-10 | 北京字节跳动网络技术有限公司 | Monitoring method and device and electronic equipment |
| CN111309442B (en) * | 2020-02-19 | 2023-07-28 | 望海康信(北京)科技股份公司 | Method, device, system, medium and equipment for adjusting number of micro-service containers |
| CN112350950A (en) * | 2020-10-28 | 2021-02-09 | 北京中电普华信息技术有限公司 | Request message control method and device |
| CN112596979A (en) * | 2020-12-23 | 2021-04-02 | 树根互联技术有限公司 | Micro-service access data acquisition and monitoring platform, method and electronic equipment |
| CN115474165A (en) * | 2021-05-24 | 2022-12-13 | 中移动金融科技有限公司 | Self-monitoring dynamic adjustment method and system for short message service |
| CN113419852B (en) * | 2021-06-22 | 2023-10-20 | 康键信息技术（深圳）有限公司 | Method, device, equipment and storage medium for responding request of micro service |
| CN114201231B (en) * | 2021-11-29 | 2023-01-03 | 江苏金农股份有限公司 | Distributed micro-service arranging system and method |
| CN114285642B (en) * | 2021-12-24 | 2023-07-18 | 苏州浪潮智能科技有限公司 | Control management method and device for host sensitive service and port in cloud platform |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107623610A (en) * | 2017-09-22 | 2018-01-23 | 郑州云海信息技术有限公司 | A kind of monitoring method of application apparatus, device and computer-readable storage medium |
| CN107871190A (en) * | 2016-09-23 | 2018-04-03 | 阿里巴巴集团控股有限公司 | A kind of operational indicator monitoring method and device |
| CN107992398A (en) * | 2017-12-22 | 2018-05-04 | 宜人恒业科技发展（北京）有限公司 | The monitoring method and monitoring system of a kind of operation system |
| CN108073465A (en) * | 2017-12-29 | 2018-05-25 | 中国平安人寿保险股份有限公司 | Dynamic current limiting method, Nginx servers, storage medium and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9389936B2 (en) * | 2011-09-23 | 2016-07-12 | Microsoft Technology Licensing, Llc. | Monitoring the responsiveness of a user interface |
-
2018
- 2018-05-31 CN CN201810547288.2A patent/CN108845910B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107871190A (en) * | 2016-09-23 | 2018-04-03 | 阿里巴巴集团控股有限公司 | A kind of operational indicator monitoring method and device |
| CN107623610A (en) * | 2017-09-22 | 2018-01-23 | 郑州云海信息技术有限公司 | A kind of monitoring method of application apparatus, device and computer-readable storage medium |
| CN107992398A (en) * | 2017-12-22 | 2018-05-04 | 宜人恒业科技发展（北京）有限公司 | The monitoring method and monitoring system of a kind of operation system |
| CN108073465A (en) * | 2017-12-29 | 2018-05-25 | 中国平安人寿保险股份有限公司 | Dynamic current limiting method, Nginx servers, storage medium and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108845910A (en) | 2018-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108845910B (en) | Monitoring method, device and storage medium of large-scale micro-service system | |
| WO2021129367A1 (en) | Method and apparatus for monitoring distributed storage system | |
| CN110730136B (en) | Method, device, server and storage medium for realizing flow control | |
| US10509689B2 (en) | Method for processing application and terminal | |
| CN105760240A (en) | Distributed task processing method and device | |
| CN109669835B (en) | MySQL database monitoring method, device, equipment and readable storage medium | |
| CN113704065A (en) | Monitoring method, device, equipment and computer storage medium | |
| CN109450691B (en) | Service gateway monitoring method, device and computer readable storage medium | |
| CN110674149B (en) | Service data processing method and device, computer equipment and storage medium | |
| CN110933172A (en) | Remote monitoring system and method based on cloud computing | |
| CN115357450A (en) | Node maintenance method and device based on artificial intelligence, computer equipment and medium | |
| CN109800085B (en) | Resource configuration detection method and device, storage medium and electronic equipment | |
| CN111339466A (en) | Interface management method and device, electronic equipment and readable storage medium | |
| US20130198380A1 (en) | Violation sign condition setting supporting system, violation sign condition setting supporting method, and violation sign condition setting supporting program | |
| CN111130944B (en) | System monitoring method and system | |
| CN112527543A (en) | Client starting exception handling method and device, electronic equipment and storage medium | |
| CN107025148B (en) | Mass data processing method and device | |
| CN111416857A (en) | Client crash processing method, device, system, equipment and storage medium | |
| CN110838940A (en) | Underground cable inspection task configuration method and device | |
| CN106855824B (en) | Task stopping method and device and electronic equipment | |
| CN115729727A (en) | Fault repairing method, device, equipment and medium | |
| CN113242302A (en) | Data access request processing method and device, computer equipment and medium | |
| CN110597682B (en) | Application deployment method and device, computer equipment and storage medium | |
| CN110633165B (en) | Fault processing method, device, system server and computer readable storage medium | |
| CN112965799A (en) | Task state prompting method and device, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |