CN117827575A - Method, device, electronic equipment and storage medium for monitoring leakage of off-heap memory - Google Patents

Abstract

The invention discloses a method, a device, electronic equipment and a storage medium for monitoring leakage of an external memory, and relates to the technical field of monitoring of the external memory, wherein the method comprises the following steps: acquiring an out-of-heap memory index; wherein the out-of-heap memory metrics include a physical memory occupancy metric, a physical memory allocation metric, and an out-of-heap memory occupancy metric; determining an out-of-heap memory leakage result according to the physical memory occupation index, the physical memory allocation index and the out-of-heap memory occupation index; and monitoring the leakage of the external memory according to the leakage result of the external memory. According to the technical scheme, the out-of-pile memory leakage result is determined according to the physical memory occupation index, the physical memory allocation index and the out-of-pile memory occupation index by monitoring and analyzing the physical memory occupation index, the physical memory allocation index and the out-of-pile memory occupation index of the out-of-pile memory, the problem that the existing out-of-pile memory leakage is difficult to locate is solved, and the out-of-pile memory leakage is monitored through the out-of-pile memory leakage result, so that accurate locating analysis is realized.

Description

Method, device, electronic equipment and storage medium for monitoring leakage of off-heap memory

Technical Field

The present invention relates to the field of monitoring technologies of off-heap memories, and in particular, to a method, an apparatus, an electronic device, and a storage medium for monitoring leakage of an off-heap memory.

Background

One of the core targets of the performance test is to help an application system monitor and locate and solve the problem of possible memory leakage, thereby ensuring that the system is smoothly on line and stably operates and creating value for business operation and development.

At present, in the running process of a Java (object-oriented programming language) virtual machine, a certain amount of non-heap memory is occupied besides Java heap memory, which can be called as off-heap memory, and the risk of leakage exists. In the prior art, the method for leakage of the memory outside the heap is mainly as follows: firstly, checking whether internal memory leakage exists or not, checking whether internal memory leakage does not exist or not, and then checking whether external memory leakage exists or not, comprehensively analyzing resource consumption macro indexes such as a central processing unit (Central Processing Unit, CPU) and the like to code level micro indexes, wherein the comprehensive analysis is very complex, and the problem of external memory leakage is difficult to position and accurately solve due to the fact that programmer experience is very depended.

Disclosure of Invention

The invention provides a method, a device, electronic equipment and a storage medium for monitoring leakage of an off-heap memory, which realize accurate positioning analysis of the problem of leakage of the off-heap memory of a Java application system JVM (Java virtual machine) by monitoring and analyzing Java process physical memory occupation indexes, java process physical memory allocation indexes and Java virtual machine off-heap memory occupation indexes.

According to an aspect of the present invention, the present invention provides a method for monitoring leakage of an off-heap memory, applied to a target device, the method comprising:

acquiring an out-of-heap memory index; wherein the out-of-heap memory metrics include a physical memory occupancy metric, a physical memory allocation metric, and an out-of-heap memory occupancy metric;

determining an out-of-heap memory leakage result according to the physical memory occupation index, the physical memory allocation index and the out-of-heap memory occupation index;

and monitoring the leakage of the external memory according to the leakage result of the external memory.

Optionally, determining the out-of-heap memory leakage result according to the physical memory occupation index, the physical memory allocation index, and the out-of-heap memory occupation index includes: determining an initial leakage result according to the physical memory occupation index and the physical memory allocation index; determining whether the initial leakage result meets a first preset condition; if the initial leakage result does not meet the first preset condition, determining that the memory outside the heap does not have leakage; if the initial leakage result meets the first preset condition, determining the leakage result of the external memory according to the external memory occupation index.

Optionally, determining the initial leakage result according to the physical memory occupation index and the physical memory allocation index includes: determining whether the physical memory occupation index is in a continuous growth state; if the physical memory occupation index is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked; if the physical memory occupation index is determined to be in a continuous growth state, determining whether the physical memory allocation index is in a continuous growth state; if the physical memory allocation index is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked; if the physical memory allocation index is determined to be in a continuously-increasing state, an initial leakage result is determined.

Optionally, determining whether the initial leakage result meets the first preset condition includes: determining whether the initial leakage result is greater than or equal to a preset leakage result; if the initial leakage result is greater than or equal to the preset leakage result, determining that the initial leakage result meets a first preset condition; if the initial leakage result is smaller than the preset leakage result, determining that the initial leakage result does not meet the first preset condition.

Alternatively, the out-of-heap memory footprint metrics include class footprint memory, thread footprint memory, and physical memory.

Optionally, determining the out-of-heap memory leakage result according to the out-of-heap memory occupation index includes: determining whether the class occupied memory, the thread occupied memory and the physical memory meet a second preset condition; if the class occupied memory, the thread occupied memory and the physical memory are determined to not meet the second preset condition, determining that the out-of-heap memory is not leaked; if the class occupied memory, the thread occupied memory and the physical memory are determined to not meet the second preset condition, determining an out-of-heap memory leakage result.

Optionally, determining whether the class occupied memory, the thread occupied memory and the physical memory meet the second preset condition includes: determining whether the class occupied memory, the thread occupied memory and the physical memory are in a continuous growth state; if the class occupied memory, the thread occupied memory and the physical memory are not in the continuous growth state, determining that the class occupied memory, the thread occupied memory and the physical memory do not meet a second preset condition; if at least one of the class occupied memory, the thread occupied memory and the physical memory is determined to be in a continuously growing state, the class occupied memory, the thread occupied memory and the physical memory are determined to meet a second preset condition.

According to another aspect of the present invention, there is also provided an apparatus for monitoring leakage of an off-heap memory, for implementing the method for monitoring leakage of an off-heap memory according to any of the embodiments, the apparatus including:

the index acquisition module is used for acquiring the out-of-pile memory index; wherein the out-of-heap memory metrics include a physical memory occupancy metric, a physical memory allocation metric, and an out-of-heap memory occupancy metric;

the result determining module is used for determining an out-of-heap memory leakage result according to the physical memory occupation index, the physical memory allocation index and the out-of-heap memory occupation index;

and the leakage monitoring module is used for monitoring leakage of the external memory according to the leakage result of the external memory.

According to another aspect of the present invention, there is also provided an electronic apparatus including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the method of monitoring for out-of-heap memory leaks of any of the embodiments of the present invention.

According to another aspect of the present invention, there is also provided a computer readable storage medium storing computer instructions for causing a processor to implement a method of monitoring for out-of-heap memory leaks according to any of the embodiments of the present invention when executed.

According to the technical scheme, the out-of-pile memory index is obtained; wherein the out-of-heap memory metrics include a physical memory occupancy metric, a physical memory allocation metric, and an out-of-heap memory occupancy metric; determining an out-of-heap memory leakage result according to the physical memory occupation index, the physical memory allocation index and the out-of-heap memory occupation index; and monitoring the leakage of the external memory according to the leakage result of the external memory. According to the invention, the physical memory occupation index, the physical memory allocation index and the external memory occupation index of the external memory are monitored and analyzed, the external memory leakage result is determined according to the physical memory occupation index, the physical memory allocation index and the external memory occupation index, the problem that the existing external memory leakage is difficult to locate is solved, and the external memory leakage is monitored through the external memory leakage result, so that the accurate positioning analysis is realized.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.

Drawings

In order to more clearly illustrate the technical solutions of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flow chart of a method for monitoring for leakage of memory outside a heap according to the first embodiment;

FIG. 2 is a flowchart of a method for monitoring leakage of memory outside a heap provided in the second embodiment;

FIG. 3 is a schematic structural diagram of an apparatus for monitoring leakage of an external memory provided in the third embodiment;

fig. 4 is a schematic structural diagram of an electronic device provided in the fourth embodiment.

Detailed Description

In order that those skilled in the art will better understand the present invention, a more complete description of the same will be rendered by reference to the appended drawings, wherein it is to be understood that the illustrated embodiments are merely exemplary of some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example 1

Fig. 1 is a flowchart of a method for monitoring leakage of an off-heap memory provided in a first embodiment, where the method may be performed by an apparatus for monitoring leakage of an off-heap memory, and the apparatus for monitoring leakage of an off-heap memory may be implemented in hardware and/or software, and in a specific embodiment, the apparatus for monitoring leakage of an off-heap memory may be configured in an electronic device. As shown in fig. 1, the method of this embodiment specifically includes the following steps:

s101, acquiring an out-of-heap memory index.

The out-of-heap memory indexes comprise physical memory occupation indexes, physical memory allocation indexes and out-of-heap memory occupation indexes. The out-of-heap memory occupation index comprises class occupation memory, thread occupation memory and physical memory. The physical memory occupation index represents the Java process physical memory occupation condition of the Java application system; the physical memory allocation index represents the physical memory allocation condition of Java processes of the Java application system; the out-of-heap memory occupation index indicates the out-of-heap memory occupation of a Java virtual machine of a Java application system. The class occupied memory is the memory occupied by class loading of the Java virtual machine, the thread occupied memory is the memory occupied by a thread stack of the Java virtual machine, and the physical memory is the direct memory of the Java virtual machine or the memory occupied by other physical memories.

Specifically, acquiring a physical memory occupation trend of a Java process, and determining a physical memory occupation index according to the physical memory occupation trend; the method comprises the steps of obtaining a physical memory allocation trend of a Java process, determining a physical memory allocation index according to the physical memory allocation trend, obtaining memory occupied by class loading of a Java virtual machine, memory occupied by a thread stack of the Java virtual machine and memory occupied by direct memory or other physical memories of the Java virtual machine, and determining an out-of-heap memory occupation index of the Java virtual machine according to the memory occupied by class loading of the Java virtual machine, the memory occupied by the thread stack of the Java virtual machine and the memory occupied by the direct memory or other physical memories of the Java virtual machine.

S102, determining an out-of-heap memory leakage result according to the physical memory occupation index, the physical memory allocation index and the out-of-heap memory occupation index.

The out-of-heap memory occupation index comprises class occupation memory, thread occupation memory and physical memory; the class occupied memory is the memory occupied by class loading of the Java virtual machine; the thread occupied memory is the memory occupied by the thread stack of the Java virtual machine; the physical memory is the direct memory of the Java virtual machine or the memory occupied by other physical memories.

Specifically, firstly, monitoring and judging leakage of the external memory from a macroscopic angle, and determining whether the physical memory occupation index is in a continuous growth state or not; if the physical memory occupation index is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked; if the physical memory occupation index is determined to be in a continuous growth state, determining whether the physical memory allocation index is in a continuous growth state; if the physical memory allocation index is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked; if the physical memory allocation index is determined to be in a continuous growth state, determining to further perform out-of-heap memory leakage monitoring judgment from a microscopic angle, and if the memory occupied by class loading of the Java virtual machine, the memory occupied by a thread stack of the Java virtual machine and the direct memory of the Java virtual machine or the memory occupied by other physical memories are determined to be in a continuous growth state; if the memory occupied by class loading of the Java virtual machine, the memory occupied by a thread stack of the Java virtual machine and the memory occupied by direct memory or other physical memories of the Java virtual machine are not in a continuous growth state, determining that no out-of-heap memory leakage exists; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine and the memory occupied by direct memory or other physical memories of the Java virtual machine are determined not to be in a continuous growth state, and then an out-of-heap memory leakage result is determined according to the memory occupied by the class; if the memory occupied by class loading of the Java virtual machine is determined not to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is determined not to be in a continuous growth state, determining an out-of-heap memory leakage result according to the memory occupied by the thread; if the memory occupied by class loading of the Java virtual machine is determined not to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is determined not to be in a continuous growth state, and the direct memory of the Java virtual machine or the memory occupied by other physical memories is determined to be in a continuous growth state, determining an out-of-heap memory leakage result according to the physical memory; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is not in a continuous growth state, determining an out-of-heap memory leakage result according to the class occupied memory and the thread occupied memory; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is not in a continuous growth state, and the memory occupied by direct memory or other physical memory of the Java virtual machine is in a continuous growth state, determining an out-of-heap memory leakage result according to the class occupied memory and the physical memory fullness; if the memory occupied by class loading of the Java virtual machine is determined not to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is in a continuous growth state, and the memory occupied by direct memory or other physical memory of the Java virtual machine is in a continuous growth state, determining an out-of-heap memory leakage result according to the memory occupied by the thread and the physical memory; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is determined to be in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is determined to be in a continuous growth state, the out-of-heap memory leakage result is determined according to the class occupied memory, the thread occupied memory and the physical memory.

S103, monitoring out-of-heap memory leakage according to out-of-heap memory leakage results.

Specifically, after determining the leakage result of the external memory according to the class occupied memory, the thread occupied memory and the physical memory, if the leakage result of the external memory is determined to be that the memory occupied by class loading of the Java virtual machine is in a continuously growing state, further performing deep investigation, and monitoring the leakage of the external memory to mainly monitor the memory leakage condition of the class loader; if the out-of-heap memory leakage result is determined to be that the memory occupied by the thread stack of the Java virtual machine is in a continuously growing state, further deeply checking, and monitoring out-of-heap memory leakage to mainly monitor the memory leakage condition of the thread stack; if it is determined that the result of the out-of-heap memory leak is that the direct memory of the Java virtual machine or the memory occupied by other physical memories is in a continuously growing state, further investigation is performed, and whether the direct memory is allocated in the main monitoring program for monitoring the out-of-heap memory leak is generally performed by using a synchronous non-blocking correlation technique, or using a correlation method in the unafe class (which is used for substantially expanding the Java language expression capability and is convenient for implementing the core library function that is originally to be implemented in the C language layer in the Java layer code), the physical memory is allocated, and attention is paid to whether these memories are correctly recovered after allocation.

According to the technical scheme, the out-of-heap memory index is obtained; wherein the out-of-heap memory metrics include a physical memory occupancy metric, a physical memory allocation metric, and an out-of-heap memory occupancy metric; determining an out-of-heap memory leakage result according to the physical memory occupation index, the physical memory allocation index and the out-of-heap memory occupation index; and monitoring the leakage of the external memory according to the leakage result of the external memory. On the basis of the embodiment, the invention determines the out-of-pile memory leakage result according to the physical memory occupation index, the physical memory allocation index and the out-of-pile memory occupation index by monitoring and analyzing the physical memory occupation index, the physical memory allocation index and the out-of-pile memory occupation index of the out-of-pile memory, solves the problem that the existing out-of-pile memory leakage is difficult to locate, and realizes accurate locating analysis by monitoring the out-of-pile memory leakage through the out-of-pile memory leakage result.

Example two

Fig. 2 is a flowchart of a method for monitoring out-of-heap memory leakage provided in the second embodiment, and based on the foregoing embodiment, the method optimizes the out-of-heap memory leakage result determined according to a physical memory occupation index, a physical memory allocation index, and an out-of-heap memory occupation index, as shown in fig. 2, and specifically includes the following steps:

S201, acquiring an out-of-heap memory index.

Wherein the out-of-heap memory metrics include a physical memory occupancy metric, a physical memory allocation metric, and an out-of-heap memory occupancy metric; the out-of-heap memory occupation index comprises class occupation memory, thread occupation memory and physical memory.

The physical memory occupation index represents the Java process physical memory occupation condition of the Java application system; the physical memory allocation index represents the physical memory allocation condition of Java processes of the Java application system; the out-of-heap memory occupation index indicates the out-of-heap memory occupation of a Java virtual machine of a Java application system. Class occupied memory is memory occupied by class loading of a Java virtual machine, and the meta space is mainly aimed at a meta space, wherein the meta space is a memory area shared by all threads and is mainly used for storing class information of a system, such as fields, methods, constant pools and the like of the class. Therefore, the system can be called as a metaspace, the size of the region determines the number of classes which can be saved by the system, and if the system defines too many classes, the metaspace can overflow, so that the Java virtual machine throws out memory overflow errors; the thread occupying memory is the memory occupied by the thread stack of the Java virtual machine, mainly aiming at the aspect of the thread stack, the thread stack of Java is a private memory space of a thread, and the space is closely related to the execution of the Java thread and does not belong to Java heap memory. The basic behavior executed by the Java thread is the call of a function, and the data of each function call is transferred through a Java stack; the physical memory is direct memory of the Java virtual machine or memory occupied by other physical memories, and is mainly used for the physical memory distributed when a non-blocking interface technology is used in a program. Direct memory refers to that a Java heap is skipped, so that a Java program can directly access a native physical memory, and the access speed of a memory space is accelerated to a certain extent.

Specifically, acquiring a physical memory occupation trend of a Java process, and determining a physical memory occupation index according to the physical memory occupation trend; the method comprises the steps of obtaining a physical memory allocation trend of a Java process, determining a physical memory allocation index according to the physical memory allocation trend, obtaining memory occupied by class loading of a Java virtual machine, memory occupied by a thread stack of the Java virtual machine and memory occupied by direct memory or other physical memories of the Java virtual machine, and determining an out-of-heap memory occupation index of the Java virtual machine according to the memory occupied by class loading of the Java virtual machine, the memory occupied by the thread stack of the Java virtual machine and the memory occupied by the direct memory or other physical memories of the Java virtual machine.

S202, determining an initial leakage result according to the physical memory occupation index and the physical memory allocation index.

And determining a memory leakage result of the initial leakage result according to the physical memory occupation index and the physical memory allocation index.

In one embodiment, determining the initial leakage result according to the physical memory occupation index and the physical memory allocation index includes: determining whether the physical memory occupation index is in a continuous growth state; if the physical memory occupation index is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked; if the physical memory occupation index is determined to be in a continuous growth state, determining whether the physical memory allocation index is in a continuous growth state; if the physical memory allocation index is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked; if the physical memory allocation index is determined to be in a continuously-increasing state, an initial leakage result is determined.

Specifically, determining whether the Java process physical memory occupation condition of the Java application system is in a continuous growth state; if the Java process physical memory occupation of the Java application system is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked; if the physical memory occupation of the Java process of the Java application system is determined to be in a continuously-growing state, determining whether the physical memory allocation condition of the Java process of the Java application system is in the continuously-growing state; if the physical memory allocation of the Java process of the Java application system is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked; if the physical memory allocation of the Java process of the Java application system is determined to be in a continuously-increasing state, an initial leakage result is determined, wherein the initial leakage result is expressed as that the physical memory occupation of the Java process is in a continuously-increasing state and the physical memory allocation of the Java process is in a continuously-increasing state.

The method has the advantages that the problem of leakage of the external memory is primarily judged from a macroscopic angle by collecting the physical memory occupation index and the physical memory allocation index, and the accuracy of leakage investigation of the external memory is improved.

S203, determining whether the initial leakage result meets a first preset condition.

The first preset condition is a preset determination condition of the initial leakage result, which is not limited in this embodiment.

In one embodiment, determining whether the initial leakage result meets a first preset condition includes: determining whether the initial leakage result is greater than or equal to a preset leakage result; if the initial leakage result is greater than or equal to the preset leakage result, determining that the initial leakage result meets a first preset condition; if the initial leakage result is smaller than the preset leakage result, determining that the initial leakage result does not meet the first preset condition.

The preset leakage result is a preset leakage result of the out-of-stack memory.

Specifically, after the initial leakage result is determined, whether the initial leakage result is larger than or equal to a preset leakage result is determined; if the initial leakage result is smaller than the preset leakage result, determining that the initial leakage result does not meet the first preset condition, and executing S204; if the initial leakage result is greater than or equal to the preset leakage result, it is determined that the initial leakage result satisfies the first preset condition, and S205 is performed.

The method has the advantages that whether the leakage condition of the external memory is further checked is determined by determining whether the initial leakage result meets the first preset condition, and reliability in the checking process is improved.

S204, determining that the memory outside the heap is not leaked.

Specifically, if the initial leakage result does not meet the first preset condition, determining that the external memory is not leaked.

S205, determining the leakage result of the external memory according to the external memory occupation index.

Specifically, if the initial leakage result meets a first preset condition, determining an out-of-heap memory leakage result according to an out-of-heap memory occupation index.

In one embodiment, determining the out-of-heap memory leak result according to the out-of-heap memory occupation index includes: determining whether the class occupied memory, the thread occupied memory and the physical memory meet a second preset condition; if the class occupied memory, the thread occupied memory and the physical memory are determined to not meet the second preset condition, determining that the out-of-heap memory is not leaked; if the class occupied memory, the thread occupied memory and the physical memory are determined to not meet the second preset condition, determining an out-of-heap memory leakage result.

The class occupied memory is the memory occupied by class loading of the Java virtual machine, the thread occupied memory is the memory occupied by a thread stack of the Java virtual machine, and the physical memory is the direct memory of the Java virtual machine or the memory occupied by other physical memories. The second preset condition is a preset condition for judging the conditions of memory occupation, thread memory occupation and physical memory occupation, which is not limited in this embodiment.

Specifically, determining whether the class occupied memory, the thread occupied memory and the physical memory meet a second preset condition; if the class occupied memory, the thread occupied memory and the physical memory are determined to not meet the second preset condition, determining that the out-of-heap memory is not leaked; if the class occupied memory, the thread occupied memory and the physical memory are determined to not meet the second preset condition, determining an out-of-heap memory leakage result.

In a specific embodiment, determining whether the class occupied memory, the thread occupied memory and the physical memory meet the second preset condition includes: determining whether the class occupied memory, the thread occupied memory and the physical memory are in a continuous growth state; if the class occupied memory, the thread occupied memory and the physical memory are not in the continuous growth state, determining that the class occupied memory, the thread occupied memory and the physical memory do not meet a second preset condition; if at least one of the class occupied memory, the thread occupied memory and the physical memory is determined to be in a continuously growing state, the class occupied memory, the thread occupied memory and the physical memory are determined to meet a second preset condition.

Specifically, determining whether a memory occupied by class loading of the Java virtual machine, a memory occupied by a thread stack of the Java virtual machine and a direct memory or a memory occupied by other physical memories of the Java virtual machine are in a continuous growth state; if the memory occupied by class loading of the Java virtual machine, the memory occupied by a thread stack of the Java virtual machine and the memory occupied by direct memory or other physical memories of the Java virtual machine are not in a continuous growth state, determining that the memory occupied by the class, the memory occupied by the thread and the physical memory do not meet a second preset condition; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine and the memory occupied by direct memory or other physical memories of the Java virtual machine are determined not to be in a continuous growth state, and the memory occupied by the class, the thread and the physical memory are determined to meet a second preset condition; if the memory occupied by class loading of the Java virtual machine is determined not to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is determined not to be in a continuous growth state, determining that the class occupied memory, the thread occupied memory and the physical memories meet a second preset condition; if the memory occupied by class loading of the Java virtual machine is determined not to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is determined not to be in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is determined to be in a continuous growth state, then the memory occupied by the class, the memory occupied by the thread and the physical memory are determined to meet a second preset condition; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is determined to be in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is determined not to be in a continuous growth state, then the memory occupied by the class, the memory occupied by the thread and the physical memory are determined to meet a second preset condition; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is not in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is determined to be in a continuous growth state, then the memory occupied by the class, the memory occupied by the thread and the physical memory are determined to meet a second preset condition; if the memory occupied by class loading of the Java virtual machine is determined not to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is in a continuous growth state, and the memory occupied by direct memory or other physical memory of the Java virtual machine is in a continuous growth state, determining that the class occupied memory, the thread occupied memory and the physical memory meet a second preset condition; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is determined to be in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is determined to be in a continuous growth state, then the memory occupied by the class, the memory occupied by the thread and the physical memory are determined to meet a second preset condition.

If the memory occupied by class loading of the Java virtual machine, the memory occupied by a thread stack of the Java virtual machine and the direct memory of the Java virtual machine or the memory occupied by other physical memories are determined to be in a continuous growth state; if the memory occupied by class loading of the Java virtual machine, the memory occupied by a thread stack of the Java virtual machine and the memory occupied by direct memory or other physical memories of the Java virtual machine are not in a continuous growth state, determining that no out-of-heap memory leakage exists; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine and the memory occupied by direct memory or other physical memories of the Java virtual machine are determined not to be in a continuous growth state, and then an out-of-heap memory leakage result is determined according to the memory occupied by the class; if the memory occupied by class loading of the Java virtual machine is determined not to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is determined not to be in a continuous growth state, determining an out-of-heap memory leakage result according to the memory occupied by the thread; if the memory occupied by class loading of the Java virtual machine is determined not to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is determined not to be in a continuous growth state, and the direct memory of the Java virtual machine or the memory occupied by other physical memories is determined to be in a continuous growth state, determining an out-of-heap memory leakage result according to the physical memory; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is not in a continuous growth state, determining an out-of-heap memory leakage result according to the class occupied memory and the thread occupied memory; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is not in a continuous growth state, and the memory occupied by direct memory or other physical memory of the Java virtual machine is in a continuous growth state, determining an out-of-heap memory leakage result according to the class occupied memory and the physical memory fullness; if the memory occupied by class loading of the Java virtual machine is determined not to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is in a continuous growth state, and the memory occupied by direct memory or other physical memory of the Java virtual machine is in a continuous growth state, determining an out-of-heap memory leakage result according to the memory occupied by the thread and the physical memory; if the memory occupied by class loading of the Java virtual machine is determined to be in a continuous growth state, the memory occupied by a thread stack of the Java virtual machine is determined to be in a continuous growth state, and the memory occupied by direct memory or other physical memories of the Java virtual machine is determined to be in a continuous growth state, the out-of-heap memory leakage result is determined according to the class occupied memory, the thread occupied memory and the physical memory.

The method has the advantages that the continuous growth states of the memory occupied by class loading of the Java virtual machine, the memory occupied by a thread stack of the Java virtual machine and the memory occupied by direct memory or other physical memory of the Java virtual machine are respectively determined, and the high efficiency and the stability of monitoring the leakage of the memory outside the heap are improved.

S206, monitoring the leakage of the external memory according to the leakage result of the external memory.

Specifically, after determining the out-of-heap memory leakage result according to the class occupied memory, the thread occupied memory and the physical memory, if the out-of-heap memory leakage result is determined to be that the memory occupied by class loading of the Java virtual machine is in a continuously growing state, further conducting deep investigation, and monitoring the memory leakage condition of the class loader; if the out-of-heap memory leakage result is determined to be that the memory occupied by the thread stack of the Java virtual machine is in a continuously-growing state, further deeply checking and monitoring the memory leakage condition of the thread stack; if it is determined that the result of the out-of-heap memory leakage is that the direct memory of the Java virtual machine or the memory occupied by other physical memories is in a continuously growing state, further examining is performed in depth, and whether the direct memory is allocated in the monitor program, usually using a synchronous non-blocking correlation technique, or using a correlation method in the unafe class (the unafe class is used for substantially expanding the Java language expression capability and facilitating the implementation of the core library function that is originally to be implemented in the C language layer in the Java layer code), allocating the physical memory, focusing on whether these memories are correctly recovered after allocation.

The benefit of the arrangement is that the comprehensive monitoring of the allocation of the memory outside the heap of the ava virtual machine is realized by judging the conditions of the occupied memory of the class, the occupied memory of the thread and the physical memory from a macroscopic angle, and the performance testing capability of the application system is improved.

According to the technical scheme of the embodiment, an initial leakage result is determined according to the physical memory occupation index and the physical memory allocation index by acquiring the physical memory occupation index, the physical memory allocation index and the off-heap memory occupation index; determining whether the initial leakage result meets a first preset condition; if the initial leakage result does not meet the first preset condition, determining that the memory outside the heap does not have leakage; if the initial leakage result meets a first preset condition, determining an out-of-heap memory leakage result according to an out-of-heap memory occupation index; and monitoring the leakage of the external memory according to the leakage result of the external memory. On the basis of the embodiment, the out-of-heap memory leakage result is determined according to the physical memory occupation index, the physical memory allocation index and the out-of-heap memory occupation index by monitoring and analyzing the physical memory occupation index, the physical memory allocation index and the out-of-heap memory occupation index of the out-of-heap memory, the problem that the existing out-of-heap memory leakage is difficult to locate is solved, the out-of-heap memory leakage is monitored through the out-of-heap memory leakage result, accurate positioning analysis is realized, and the efficiency, the reliability and the stability of the out-of-heap memory leakage monitoring are improved.

Example III

Fig. 3 is a schematic structural diagram of an apparatus for monitoring leakage of an off-heap memory, which is provided in the third embodiment, and the apparatus is configured to implement any method for monitoring leakage of an off-heap memory, where the apparatus includes: an index acquisition module 301, a result determination module 302, and a leak monitoring module 303. Wherein,

the index obtaining module 301 is configured to obtain an out-of-heap memory index; the out-of-heap memory indexes comprise physical memory occupation indexes, physical memory allocation indexes and out-of-heap memory occupation indexes.

The result determining module 302 is configured to determine an out-of-heap memory leak result according to the physical memory occupation index, the physical memory allocation index, and the out-of-heap memory occupation index.

And the leakage monitoring module 303 is configured to monitor leakage of the external memory according to the leakage result of the external memory.

Optionally, the result determining module 302 is specifically configured to: determining an initial leakage result according to the physical memory occupation index and the physical memory allocation index; determining whether the initial leakage result meets a first preset condition; if the initial leakage result does not meet the first preset condition, determining that the memory outside the heap does not have leakage; if the initial leakage result meets the first preset condition, determining the leakage result of the external memory according to the external memory occupation index.

Optionally, the result determining module 302 determines an initial leakage result according to the physical memory occupation index and the physical memory allocation index, which is specifically configured to: determining whether the physical memory occupation index is in a continuous growth state; if the physical memory occupation index is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked; if the physical memory occupation index is determined to be in a continuous growth state, determining whether the physical memory allocation index is in a continuous growth state; if the physical memory allocation index is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked; if the physical memory allocation index is determined to be in a continuously-increasing state, an initial leakage result is determined.

Optionally, the result determining module 302 is configured to determine whether the initial leakage result meets a first preset condition, specifically: determining whether the initial leakage result is greater than or equal to a preset leakage result; if the initial leakage result is greater than or equal to the preset leakage result, determining that the initial leakage result meets a first preset condition; if the initial leakage result is smaller than the preset leakage result, determining that the initial leakage result does not meet the first preset condition.

Alternatively, the out-of-heap memory footprint metrics include class footprint memory, thread footprint memory, and physical memory.

Optionally, the result determining module 302 determines an out-of-heap memory leakage result according to an out-of-heap memory occupation index, which is specifically configured to: determining whether the class occupied memory, the thread occupied memory and the physical memory meet a second preset condition; if the class occupied memory, the thread occupied memory and the physical memory are determined to not meet the second preset condition, determining that the out-of-heap memory is not leaked; if the class occupied memory, the thread occupied memory and the physical memory are determined to not meet the second preset condition, determining an out-of-heap memory leakage result.

Optionally, the result determining module 302 determines whether the class occupied memory, the thread occupied memory, and the physical memory meet a second preset condition, which is specifically configured to: determining whether the class occupied memory, the thread occupied memory and the physical memory are in a continuous growth state; if the class occupied memory, the thread occupied memory and the physical memory are not in the continuous growth state, determining that the class occupied memory, the thread occupied memory and the physical memory do not meet a second preset condition; if at least one of the class occupied memory, the thread occupied memory and the physical memory is determined to be in a continuously growing state, the class occupied memory, the thread occupied memory and the physical memory are determined to meet a second preset condition.

The device for monitoring the leakage of the external memory provided by the embodiment can execute the method for monitoring the leakage of the external memory provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Example IV

Fig. 4 is a schematic diagram of the structure of an electronic device provided in the fourth embodiment, which is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.

As shown in fig. 4, the electronic device 10 includes at least one processor 11, and a Memory communicatively connected to the at least one processor 11, such as a Read Only Memory (ROM) 12, a random access Memory (also referred to as "random access Memory", random Access Memory, RAM) 13, etc., in which the Memory stores a computer program executable by the at least one processor, and the processor 11 may perform various suitable actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 may also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.

Various components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, etc.; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.

The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as monitoring for off-heap memory leaks.

In some embodiments, the method of monitoring for out-of-heap memory leaks may be implemented as a computer program tangibly embodied on a computer readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the method of monitoring for off-heap memory leaks described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the method of monitoring for out-of-heap memory leaks in any other suitable manner (e.g., by means of firmware).

Various implementations of the systems and techniques described here above can be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.

The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.

The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims (10)

1. A method of monitoring for out-of-heap memory leaks, the method comprising:

acquiring an out-of-heap memory index; wherein the out-of-heap memory index comprises a physical memory occupation index, a physical memory allocation index and an out-of-heap memory occupation index;

determining an out-of-heap memory leakage result according to the physical memory occupation index, the physical memory allocation index and the out-of-heap memory occupation index;

and monitoring leakage of the external memory according to the leakage result of the external memory.

2. The method for monitoring out-of-heap memory leakage according to claim 1, wherein determining an out-of-heap memory leakage result according to the physical memory occupation index, the physical memory allocation index, and the out-of-heap memory occupation index comprises:

determining an initial leakage result according to the physical memory occupation index and the physical memory allocation index;

determining whether the initial leakage result meets a first preset condition;

if the initial leakage result does not meet the first preset condition, determining that the memory outside the heap does not have leakage;

and if the initial leakage result meets the first preset condition, determining the leakage result of the off-heap memory according to the off-heap memory occupation index.

3. The method for monitoring out-of-heap memory leakage according to claim 2, wherein the determining an initial leakage result according to the physical memory occupation index and the physical memory allocation index comprises:

determining whether the physical memory occupation index is in a continuously-growing state;

if the physical memory occupation index is determined not to be in a continuously-growing state, determining that the memory outside the heap is not leaked;

if the physical memory occupation index is determined to be in a continuously-increasing state, determining whether the physical memory allocation index is in a continuously-increasing state;

If the physical memory allocation index is determined not to be in a continuously-growing state, determining that the off-heap memory is not leaked;

and if the physical memory allocation index is determined to be in a continuously-growing state, determining an initial leakage result.

4. The method for monitoring out-of-heap memory leaks of claim 3, wherein the determining whether the initial leak result meets a first preset condition comprises:

determining whether the initial leakage result is greater than or equal to a preset leakage result;

if the initial leakage result is greater than or equal to the preset leakage result, determining that the initial leakage result meets the first preset condition;

if the initial leakage result is smaller than the preset leakage result, determining that the initial leakage result does not meet the first preset condition.

5. The method of claim 1, wherein the out-of-heap memory footprint metrics include class footprint memory, thread footprint memory, and physical memory.

6. The method for monitoring out-of-heap memory leakage according to claim 5, wherein determining the out-of-heap memory leakage result according to the out-of-heap memory occupation index comprises:

Determining whether the class occupied memory, the thread occupied memory and the physical memory meet a second preset condition;

if the class occupied memory, the thread occupied memory and the physical memory are determined to not meet the second preset condition, determining that no leakage exists in the off-heap memory;

and if the class occupied memory, the thread occupied memory and the physical memory are determined not to meet the second preset condition, determining the out-of-heap memory leakage result.

7. The method for monitoring out-of-heap memory leaks of claim 6, the determining whether the class occupied memory, the thread occupied memory, and the physical memory satisfy a second preset condition, comprising:

determining whether the class occupies memory, the thread occupies memory and the physical memory are in a continuously growing state;

if the class occupied memory, the thread occupied memory and the physical memory are not in a continuous growth state, determining that the class occupied memory, the thread occupied memory and the physical memory do not meet the second preset condition;

if it is determined that at least one of the class occupied memory, the thread occupied memory and the physical memory is in a continuously growing state, determining that the class occupied memory, the thread occupied memory and the physical memory meet the second preset condition.

8. An apparatus for monitoring for leakage of an off-heap memory, the apparatus comprising:

the index acquisition module is used for acquiring the out-of-pile memory index; wherein the out-of-heap memory index comprises a physical memory occupation index, a physical memory allocation index and an out-of-heap memory occupation index;

the result determining module is used for determining an out-of-heap memory leakage result according to the physical memory occupation index, the physical memory allocation index and the out-of-heap memory occupation index;

and the leakage monitoring module is used for monitoring leakage of the external memory according to the leakage result of the external memory.

9. An electronic device, the electronic device comprising:

at least one processor; and a memory communicatively coupled to the at least one processor; wherein,

the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the method of monitoring for off-heap memory leaks of any one of claims 1-7.

10. A computer readable storage medium storing computer instructions for causing a processor to perform the method of monitoring for out-of-heap memory leaks of any one of claims 1-7.