CN116010210A - Method, system, storage medium and equipment for monitoring overflow of JVM (Java virtual machine) aging memory - Google Patents

Abstract

The invention provides a method, a system, a storage medium and equipment for monitoring the overflow of a JVM senior citizen memory, wherein the method comprises the following steps: in the operation process of the JVM, the memory usage amount of the aging memory in the memory recovery log is recorded in real time; obtaining the average memory usage amount at each moment according to the first memory usage amount recorded in the initial period to generate a memory average trend graph, and recording the memory average trend graph into a base line table; comparing the second memory usage recorded after the initial period with the average memory usage at the same time in the baseline table, and judging whether the current memory trend deviation is greater than the preset deviation; and pushing the pre-alarm message in response to the current memory trend deviation being greater than the preset deviation amount, and checking whether the memory overflow problem occurs in the operation system of the JVM based on the pre-alarm message to obtain a checking result. The invention realizes advanced monitoring and avoids early warning after memory overflows in the prior art, so that the problem of system blocking is exposed to clients and trust loss is caused.

Description

Method, system, storage medium and equipment for monitoring overflow of JVM (Java virtual machine) aging memory

Technical Field

The present invention relates to the field of computer technologies, and in particular, to a method, a system, a storage medium, and an apparatus for monitoring memory overflow of a JVM senior citizen.

Background

Two methods are commonly employed by the industry to monitor JVM (Java Virtual Machine ) memory overflow:

1) Monitoring the memory use condition of a JAVA (computer programming language) application program, giving an alarm when the memory use condition is continuously higher than a set threshold value, wherein the memory use condition is not represented by overflow, so that a certain false alarm probability exists;

2) If the application process is not present, the alarm informs the operation staff to analyze the JVM operation log, if the keyword java. Lang. OutOfMemoryError appears in the log, the JVM memory overflow occurs.

The first mode has too high false alarm probability, can not complete learning and memory behaviors, and can not update the benchmark by itself. In the second mode, after the customer senses that the system is blocked, the problem machine is used for checking the problem offline, so that the problem can not be found in advance, and the problem is solved. Therefore, a way of early warning of memory fluctuation and self-updating reference is needed to ensure the stability of the system.

Disclosure of Invention

Therefore, the invention aims to provide a method, a system, a storage medium and equipment for monitoring the overflow of a JVM aging memory, which are used for solving the problems that the memory early warning mode in the prior art cannot predict the risk of system downtime in advance, basically, early warning is carried out after the overflow of the memory occurs, monitoring is delayed, and the system clamping problem is exposed at the client level, so that trust loss is caused.

Based on the above object, the present invention provides a method for monitoring the overflow of the memory of the old generation of the JVM, comprising the following steps:

in the operation process of the JVM, the memory usage amount of the aging memory in the memory recovery log is recorded in real time;

obtaining the average memory usage amount at each moment according to the first memory usage amount recorded in the initial period to generate a memory average trend graph, and recording the memory average trend graph into a base line table;

comparing the second memory usage recorded after the initial period with the average memory usage at the same time in the baseline table, and judging whether the current memory trend deviation is greater than the preset deviation;

and pushing the pre-alarm message in response to the current memory trend deviation being greater than the preset deviation amount, and checking whether the memory overflow problem occurs in the operation system of the JVM based on the pre-alarm message to obtain a checking result.

In some embodiments, obtaining the average memory usage at each time according to the first memory usage recorded in the initial period to generate the memory average trend graph includes:

averaging the first memory usage amount recorded in one week at the same time to obtain the average memory usage amount at each time;

and generating a memory average trend graph based on each time value and the corresponding memory average use amount.

In some embodiments, comparing the second memory usage recorded after the initial period with the average memory usage at the same time in the baseline table, and determining whether the current memory trend deviation is greater than the preset deviation comprises:

comparing the second memory usage recorded after one week with the average memory usage at the same time in the baseline table, and judging whether the ratio of the current memory trend area to the memory trend area at the same time in the baseline table is greater than a preset default threshold;

determining that the current memory trend deviation is greater than a preset deviation amount in response to the ratio being greater than a default threshold;

and determining that the current memory trend deviation is less than or equal to a preset deviation amount in response to the proportion being less than or equal to a default threshold.

In some embodiments, the method further comprises:

and in response to the checking result that the memory overflow problem does not occur, marking false alarm marks on the moments corresponding to the current memory trend deviation.

In some embodiments, the method further comprises:

and in response to the accumulated number of false positive marks reaching a preset value, updating the current memory trend into a baseline table to replace the average memory trend in the same period.

In some embodiments, the method further comprises:

and responding to the situation that the pre-alarm message is not pushed and the memory overflow problem occurs, and taking the memory trend deviation amount of the corresponding period as the preset deviation amount.

In some embodiments, the method further comprises:

and recording the time stamp corresponding to the memory usage amount of the memory of the old generation in real time.

In another aspect of the present invention, there is also provided a system for monitoring overflow of a JVM senior citizen memory, comprising:

the real-time recording module is configured to record the memory usage amount of the senior generation memory in the memory recovery log in real time in the JVM operation process;

the generation module is configured to obtain the average memory usage amount at each moment according to the first memory usage amount recorded in the initial period so as to generate a memory average trend graph, and record the memory average trend graph into the baseline table;

the judging module is configured to compare the second memory usage recorded after the initial period with the average memory usage at the same time in the baseline table and judge whether the current memory trend deviation is greater than a preset deviation; and

and the checking module is configured to push the pre-alarm message in response to the current memory trend deviation being greater than a preset deviation amount, and check whether the memory overflow problem occurs in the operation system of the JVM based on the pre-alarm message, so as to obtain a checking result.

In yet another aspect of the present invention, there is also provided a computer readable storage medium storing computer program instructions which, when executed by a processor, implement the above-described method.

In yet another aspect of the present invention, there is also provided a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, performs the above method.

The invention has at least the following beneficial technical effects:

according to the method for monitoring the memory overflow of the JVM senior citizen, the trend of the memory trend of the senior citizen is learned and memorized in the actual operation process of the JVM to form a base line, and once the deviation between the trend of a graph and the base line exceeds the preset deviation, the early warning is carried out to predict the risk of downtime of the system in advance, so that an operation and maintenance person can rapidly check whether the memory overflow problem occurs, the early warning is carried out after the memory overflow in the prior art, the early warning is carried out after the memory overflow is delayed, the system is exposed to a client level, and the trust loss is caused.

Drawings

In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are necessary for the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention and that other embodiments may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic diagram of a method for monitoring memory overflow in a JVM older generation according to an embodiment of the invention;

FIG. 2 is a flowchart of a method for monitoring overflow of a JVM senior citizen memory according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a system for monitoring JVM senior citizen memory overflow according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a computer readable storage medium implementing a method for monitoring JVM senior citizen memory overflow according to an embodiment of the present invention;

fig. 5 is a schematic hardware structure of a computer device for performing a method for monitoring a JVM senior citizen memory overflow according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention will be described in further detail with reference to the accompanying drawings.

It should be noted that, in the embodiments of the present invention, all the expressions "first" and "second" are used to distinguish two non-identical entities with the same name or non-identical parameters, and it is noted that the "first" and "second" are only used for convenience of expression, and should not be construed as limiting the embodiments of the present invention. Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover a non-exclusive inclusion, such as a process, method, system, article, or other step or unit that comprises a list of steps or units.

In view of the foregoing, a first aspect of the embodiments of the present invention proposes an embodiment of a method for monitoring memory overflow of a JVM senior citizen. FIG. 1 is a schematic diagram of an embodiment of a method for monitoring JVM senior citizen memory overflow according to the present invention. As shown in fig. 1, the embodiment of the present invention includes the following steps:

step S10, in the operation process of the JVM, recording the memory usage amount of the senior citizen memory in the memory recovery log in real time;

step S20, obtaining the average memory usage amount at each moment according to the first memory usage amount recorded in the initial period to generate a memory average trend graph, and recording the memory average trend graph into a base line table;

step S30, comparing the second memory usage recorded after the initial period with the average memory usage at the same time in the baseline table, and judging whether the current memory trend deviation is greater than a preset deviation;

and step S40, pushing the pre-alarm message in response to the current memory trend deviation being greater than the preset deviation amount, and checking whether the memory overflow problem occurs in the operation system of the JVM based on the pre-alarm message to obtain a checking result.

According to the method for monitoring the memory overflow of the JVM senior citizen through learning and memorizing trend of the memory trend of the senior citizen in the actual operation process of the JVM, a base line is formed, and once the deviation of the graph trend and the base line exceeds the preset deviation, early warning is carried out, and the risk of downtime of the system is predicted in advance, so that an operation and maintenance person can rapidly check whether the memory overflow problem occurs, early monitoring is realized, early warning is carried out after the memory overflow in the prior art, the monitoring is delayed, the system jam problem is exposed on a client level, and trust loss is caused.

In some embodiments, obtaining the average memory usage at each time according to the first memory usage recorded in the initial period to generate the memory average trend graph includes: averaging the first memory usage amount recorded in one week at the same time to obtain the average memory usage amount at each time; and generating a memory average trend graph based on each time value and the corresponding memory average use amount.

In some embodiments, comparing the second memory usage recorded after the initial period with the average memory usage at the same time in the baseline table, and determining whether the current memory trend deviation is greater than the preset deviation comprises: comparing the second memory usage recorded after one week with the average memory usage at the same time in the baseline table, and judging whether the ratio of the current memory trend area to the memory trend area at the same time in the baseline table is greater than a preset default threshold; determining that the current memory trend deviation is greater than a preset deviation amount in response to the ratio being greater than a default threshold; and determining that the current memory trend deviation is less than or equal to a preset deviation amount in response to the proportion being less than or equal to a default threshold.

In some embodiments, the method further comprises: and in response to the checking result that the memory overflow problem does not occur, marking false alarm marks on the moments corresponding to the current memory trend deviation.

In some embodiments, the method further comprises: and in response to the accumulated number of false positive marks reaching a preset value, updating the current memory trend into a baseline table to replace the average memory trend in the same period.

In this embodiment, if the number of false alarms reaches a preset value, it is indicated that the current memory trend is not original, and is changed, so that the current memory trend is updated to the baseline table to replace the average memory trend in the same period.

In some embodiments, the method further comprises: and responding to the situation that the pre-alarm message is not pushed and the memory overflow problem occurs, and taking the memory trend deviation amount of the corresponding period as the preset deviation amount.

In some embodiments, the method further comprises: and recording the time stamp corresponding to the memory usage amount of the memory of the old generation in real time.

FIG. 2 is a flow chart of a method for monitoring JVM senior citizen memory overflow. As shown in fig. 2, the specific flow of the method for monitoring the JVM aging memory overflow of the present invention is as follows:

1) The JVM (Java Virtual Machine ) is configured to start script parameters, so that the real-time recording of the memory trend of the senior citizen is ensured.

2) The tenued Heap value (memory usage) and corresponding timestamp for each time in gclog are recorded.

3) Taking a week as a node, taking data of each minute in seven days, calculating the average value of the data at the same moment, forming a 24-hour memory average trend graph of the week, and recording the average trend graph into a fixed baseline table. For example, taking the data of 0 point 01 point of the first day to the seventh day for average calculation to obtain a data value of 0 point 01 point of the week; taking the data of 0 point 02 points from the first day to the seventh day to perform average value calculation to obtain a data value of 0 point 02 points of one week; and so on.

4) Next, the JVM cured Heap trend was recorded in real time, and the real time and baseline table trends were compared. If the difference between the trend area from the early morning (for example, 0 point) to the current moment and the trend area on the same period base line is larger than a default threshold value (the preset default threshold value area is 80 percent), pre-alarm text pushing is carried out.

5) An operation and maintenance person intervenes to check whether a memory overflow problem occurs, if no memory overflow problem occurs, false report identification is carried out on the data at the current moment on the surface of the base line; if the memory overflow problem exists, the problem machine is disconnected, and the problem of OOM (memory overflow) is solved.

6) And when the false alarm mark exceeds 3 times, updating the minute-scale trend real-time record from the early morning to the current moment to the baseline table, and updating the memory curve.

7) And when the OOM appears but no early warning exists, updating the current threshold value according to the actual difference value between the trend area and the baseline trend area.

8) After several times of learning and memorizing, a baseline memory trend graph suitable for the current service system is drawn, and the upcoming JVM aging OOM problem can be accurately pre-warned in advance.

The process of the embodiment carries out memory learning through the memory trend of the JVM old generation object in the operation process of the service system to form a base line diagram, and the memory trend base line diagrams memorized by different service systems are different and automatically recorded according to the actual condition of the project. The early warning threshold is automatically adjusted according to the problem conditions in the actual operation process of the project, and the early warning threshold closest to the problem lightning point at present is found. The deviation is calculated by using a curve difference algorithm, so that the deviation is accurate.

In a second aspect of the embodiment of the present invention, a system for monitoring overflow of a JVM senior citizen memory is also provided. FIG. 3 is a schematic diagram of an embodiment of a system for monitoring JVM senior citizen memory overflow in accordance with the present invention. As shown in fig. 3, a system for monitoring JVM senior citizen memory overflow comprises: the real-time recording module 10 is configured to record the memory usage of the senior generation memory in the memory recovery log in real time during the operation of the JVM; the generating module 20 is configured to obtain an average memory usage amount at each moment according to the first memory usage amount recorded in the initial period, so as to generate a memory average trend graph, and record the memory average trend graph into the baseline table; the judging module 30 is configured to compare the second memory usage recorded after the initial period with the average memory usage at the same time in the baseline table, and judge whether the current memory trend deviation is greater than a preset deviation; and an investigation module 40 configured to push a pre-alarm message in response to the current memory trend deviation being greater than a preset deviation amount, and to investigate whether a memory overflow problem occurs in the operation system of the JVM based on the pre-alarm message, so as to obtain an investigation result.

According to the system for monitoring the memory overflow of the JVM senior citizen through learning and memorizing trend of the memory trend of the senior citizen in the actual operation process of the JVM, a base line is formed, and once the deviation of the graph trend and the base line exceeds the preset deviation, early warning is carried out, and the risk of downtime of the system is predicted in advance, so that an operation and maintenance person can rapidly check whether the memory overflow problem occurs, early monitoring is realized, early warning is carried out after the memory overflow in the prior art, the monitoring is delayed, the system jam problem is exposed on a client level, and trust loss is caused.

In a third aspect of the embodiment of the present invention, there is further provided a computer readable storage medium, and fig. 4 is a schematic diagram of a computer readable storage medium implementing a method for monitoring a JVM senior generation memory overflow according to an embodiment of the present invention. As shown in fig. 4, the computer-readable storage medium 3 stores computer program instructions 31. The computer program instructions 31 when executed by a processor implement the method of any of the embodiments described above.

It should be appreciated that all of the embodiments, features and advantages set forth above with respect to the method of monitoring JVM senior citizen memory overflow in accordance with the present invention are equally applicable to the system and storage medium of monitoring JVM senior memory overflow in accordance with the present invention, without conflict.

In a fourth aspect of the embodiment of the present invention, there is also provided a computer device, including a memory 402 and a processor 401 as shown in fig. 5, where the memory 402 stores a computer program, and the computer program is executed by the processor 401 to implement the method of any one of the embodiments above.

FIG. 5 is a schematic diagram showing the hardware architecture of one embodiment of a computer device for performing the method for monitoring memory overflow in the older generation of the JVM. Taking the example of a computer device as shown in fig. 5, a processor 401 and a memory 402 are included in the computer device, and may further include: an input device 403 and an output device 404. The processor 401, memory 402, input device 403, and output device 404 may be connected by a bus or otherwise, for example in fig. 5. The input device 403 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the system that monitors the JVM senior citizen memory overflow. The output 404 may include a display device such as a display screen.

The memory 402 is used as a non-volatile computer readable storage medium, and may be used to store non-volatile software programs, non-volatile computer executable programs, and modules, such as program instructions/modules corresponding to a method for monitoring memory overflow in the older JVM generation in the embodiments of the present application. Memory 402 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the store data area may store data created by the use of a method of monitoring JVM senior memory overflow, etc. In addition, memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 402 may optionally include memory located remotely from processor 401, which may be connected to the local module via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The processor 401 executes various functional applications and data processing of the server by running non-volatile software programs, instructions and modules stored in the memory 402, i.e. implements the method of monitoring the JVM senior citizen memory overflow of the method embodiment described above.

Finally, it is noted that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

The various illustrative logical blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed with the following components designed to perform the functions herein: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP and/or any other such configuration.

The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.

It should be understood that as used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items. The foregoing embodiment of the present invention has been disclosed with reference to the number of embodiments for the purpose of description only, and does not represent the advantages or disadvantages of the embodiments.

Those of ordinary skill in the art will appreciate that: the above discussion of any embodiment is merely exemplary and is not intended to imply that the scope of the disclosure of embodiments of the invention, including the claims, is limited to such examples; combinations of features of the above embodiments or in different embodiments are also possible within the idea of an embodiment of the invention, and many other variations of the different aspects of the embodiments of the invention as described above exist, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. of the embodiments should be included in the protection scope of the embodiments of the present invention.

Claims (10)

1. A method for monitoring memory overflow in a JVM senior citizen, comprising the steps of:

in the operation process of the JVM, the memory usage amount of the aging memory in the memory recovery log is recorded in real time;

obtaining the average memory usage amount at each moment according to the first memory usage amount recorded in the initial period to generate a memory average trend graph, and recording the memory average trend graph into a base line table;

comparing the second memory usage recorded after the initial period with the average memory usage at the same time in the baseline table, and judging whether the current memory trend deviation is greater than a preset deviation;

and pushing a pre-alarm message in response to the current memory trend deviation is larger than the preset deviation, and checking whether the memory overflow problem occurs in the operation system of the JVM based on the pre-alarm message to obtain a checking result.

2. The method of claim 1 wherein deriving the average memory usage at each time based on the first memory usage recorded during the initial period to generate the memory average trend graph comprises:

averaging the first memory usage amount recorded in one week at the same time to obtain the average memory usage amount at each time;

and generating a memory average trend graph based on each time value and the corresponding memory average use amount.

3. The method of claim 2, wherein comparing the second memory usage recorded after the initial period with the average memory usage at the same time in the baseline table, and determining whether the current memory trend deviation is greater than a predetermined deviation comprises:

comparing the second memory usage recorded after one week with the average memory usage at the same time in the baseline table, and judging whether the ratio of the current memory trend area to the memory trend area at the same time in the baseline table is greater than a preset default threshold;

determining that the current memory trend deviation amount is greater than the preset deviation amount in response to the proportion being greater than the default threshold;

and determining that the current memory trend deviation amount is smaller than or equal to the preset deviation amount in response to the proportion being smaller than or equal to the default threshold.

4. The method as recited in claim 1, further comprising:

and responding to the checking result that the memory overflow problem does not occur, and marking a false alarm mark for the time corresponding to the current memory trend deviation.

5. The method as recited in claim 4, further comprising:

and in response to the accumulated number of false positive marks reaching a preset value, updating the current memory trend into the baseline table to replace the memory average trend in the same period.

6. The method as recited in claim 1, further comprising:

and responding to the situation that the early warning message is not pushed and the memory overflow problem occurs, and taking the memory trend deviation value of the corresponding period as the preset deviation value.

7. The method as recited in claim 1, further comprising:

and recording the time stamp corresponding to the memory usage amount of the memory of the old generation in real time.

8. A system for monitoring memory overflow in a JVM senior citizen comprising:

the real-time recording module is configured to record the memory usage amount of the senior generation memory in the memory recovery log in real time in the JVM operation process;

the generation module is configured to obtain the average memory usage amount at each moment according to the first memory usage amount recorded in the initial period so as to generate a memory average trend graph, and record the memory average trend graph into a baseline table;

the judging module is configured to compare the second memory usage recorded after the initial period with the average memory usage at the same time in the baseline table and judge whether the current memory trend deviation is greater than a preset deviation; and

and the checking module is configured to push a pre-alarm message in response to the current memory trend deviation is larger than the preset deviation, check whether the memory overflow problem occurs in the operation system of the JVM based on the pre-alarm message, and obtain a checking result.

9. A computer readable storage medium, characterized in that computer program instructions are stored, which, when executed by a processor, implement the method of any one of claims 1-7.

10. A computer device comprising a memory and a processor, wherein the memory has stored therein a computer program which, when executed by the processor, performs the method of any of claims 1-7.

Images