CN110908964B - Monitoring method, device, terminal and storage medium of distributed file system - Google Patents
Monitoring method, device, terminal and storage medium of distributed file system Download PDFInfo
- Publication number
- CN110908964B CN110908964B CN201910995097.7A CN201910995097A CN110908964B CN 110908964 B CN110908964 B CN 110908964B CN 201910995097 A CN201910995097 A CN 201910995097A CN 110908964 B CN110908964 B CN 110908964B
- Authority
- CN
- China
- Prior art keywords
- data
- grade
- operation type
- file system
- distributed file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/1734—Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
- G06F11/328—Computer systems status display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Mathematical Physics (AREA)
- Computer Hardware Design (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a monitoring method of a distributed file system, which comprises the following steps: acquiring a log output by a distributed file system to be monitored, identifying the operation type of each line of data in the log, classifying the data in the log according to the operation type, and dividing the data of the same operation type into different grades; calculating response parameters of each grade in the same operation type; calculating the deviation value of the response parameter and the corresponding preset baseline data; and outputting a result of normal operation of the distributed file system when each deviation value is determined to be within a preset deviation threshold range. The invention also provides a monitoring device, a terminal and a storage medium of the distributed file system. According to the invention, the operation type and the specific grade corresponding to the abnormal data in the log are rapidly positioned by calculating the deviation values of the response parameters of different grades in different types and the preset baseline data, so that the operation and maintenance efficiency is improved.
Description
Technical Field
The invention relates to the technical field of cloud storage, in particular to a monitoring method, a monitoring device, a monitoring terminal and a storage medium of a distributed file system.
Background
Along with the wide use of cloud storage, how to ensure the stable operation of the cloud storage is earlier than the problem that users find the operation of the cloud storage and solve the problem as early as possible, and becomes an important problem concerned by cloud storage construction parties.
The monitoring of the existing cloud storage is mainly aimed at monitoring cloud storage services and storage hardware, such as the situation that the services are stopped or the storage disk has bad disk alarms, monitoring alarms are sent when the abnormal problems occur, the cloud storage is ensured to stably run in a timely manner, the problem that the performance of the services at the bottom layer of a distributed file system is reduced in the cloud storage running process is not considered, for example, the response time of the operation is increased when a user uploads and downloads files of the same type, the user experience is directly reduced, and the user loss is caused under severe conditions. Therefore, constructing a solution for performance monitoring based on response parameters of a user operating a file of the same type is a major problem to be solved.
Disclosure of Invention
In view of the foregoing, it is necessary to provide a method, an apparatus, a terminal, and a storage medium for monitoring a distributed file system, which are capable of quickly determining an abnormality occurring in a log in a specific level corresponding to a specific operation type by calculating deviation values of response parameters of different levels in different types and preset baseline data, thereby improving operation and maintenance efficiency.
A first aspect of the present invention provides a method for monitoring a distributed file system, the method comprising:
acquiring a log output by a distributed file system to be monitored;
identifying the operation type of each row of data in the log;
classifying the data in the log according to the operation type;
dividing data of the same operation type into different grades;
calculating response parameters of each grade in the same operation type;
calculating the deviation value of the response parameter and the corresponding preset baseline data;
judging whether each deviation value is within a preset deviation threshold range;
and outputting a result of normal operation of the distributed file system when each deviation value is determined to be within the preset deviation threshold value range.
Preferably, the calculating the response parameter of each grade in the same operation type includes:
acquiring response parameters of each data of each grade in the same operation type;
calculating the average response parameter of each grade in each operation type according to the response parameters;
and determining the average response parameter as the response parameter of the corresponding grade.
Preferably, the creating process of the preset baseline data includes:
Acquiring a history log in a preset time period;
dividing the history log into a plurality of sub-history logs according to the time sequence of the history log record;
identifying the operation type of each line of data in each part of sub-history log;
classifying the data in each part of sub-history log according to the operation type;
dividing data of the same operation type in each part of sub-history logs into different grades;
calculating response parameters of each data of each grade in the same operation type in each part of sub-history log;
calculating a first average response parameter of each grade in the same operation type in the same part of sub-history log according to the response parameters;
calculating a second average response parameter of the multi-part sub-history log of each grade in the same operation type according to the first average response parameter;
and taking the second average response parameter as preset baseline data of the corresponding type-grade.
Preferably, the calculating the deviation value of the response parameter from the corresponding preset baseline data includes:
acquiring preset baseline data of the corresponding type-grade;
calculating the difference value between the response parameter of the corresponding type-grade and the preset baseline data of the corresponding type-grade;
And dividing the absolute value of the difference value by the preset baseline data of the corresponding type-grade to obtain a value serving as a deviation value.
Preferably, the method further comprises:
and outputting a result of abnormal operation of the distributed file system when at least one deviation value is determined to be not within the preset deviation threshold value range.
Preferably, after said outputting the result of the abnormal operation of the distributed file system, the method further comprises:
and sending alarm information to an administrator.
Preferably, after the sending the alarm information to the administrator, the method further includes:
and identifying abnormal data in the log output by the distributed file system to be monitored.
A second aspect of the present invention provides a monitoring apparatus for a distributed file system, the apparatus comprising:
the acquisition module is used for acquiring logs output by the distributed file system to be monitored;
the identification module is used for identifying the operation type of each row of data in the log;
the classifying module is used for classifying the data in the log according to the operation type;
the division module is used for dividing the data of the same operation type into different grades;
the first calculation module is used for calculating the response parameters of each grade in the same operation type;
The second calculation module is used for calculating the deviation value of the response parameter and the corresponding preset baseline data;
the judging module is used for judging whether each deviation value is in a preset deviation threshold range or not;
and the output module is used for outputting the result of normal operation of the distributed file system when the judging module determines that each deviation value is within the preset deviation threshold range.
A third aspect of the invention provides a terminal comprising a processor for implementing a method of monitoring the distributed file system when executing a computer program stored in a memory.
A fourth aspect of the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method of monitoring the distributed file system.
In summary, according to the method, the device, the terminal and the storage medium for monitoring the distributed file system, the log output by the distributed file system to be monitored is obtained; identifying the operation type of each row of data in the log; classifying the data in the log according to the operation type; dividing data of the same operation type into different grades; calculating response parameters of each grade in the same operation type; calculating the deviation value of the response parameter and the corresponding preset baseline data; judging whether each deviation value is within a preset deviation threshold range; outputting a result of normal operation of the distributed file system when each deviation value is determined to be within a preset deviation threshold range; and outputting a result of abnormal operation of the distributed file system when one deviation value is determined to be not within a preset deviation threshold value range. According to the invention, by calculating the deviation values of the response parameters of different grades in different types and the preset baseline data and judging whether each deviation value accords with the preset threshold range, the abnormal occurrence of the log in the specific grade corresponding to the specific operation type can be rapidly determined, the abnormal data checking time is shortened, the operation and maintenance efficiency is improved, and meanwhile, the user experience is improved and the running stability of the distributed file system is ensured.
Drawings
Fig. 1 is a flowchart of a monitoring method of a distributed file system according to an embodiment of the present invention.
Fig. 2 is a block diagram of a monitoring device for a distributed file system according to a second embodiment of the present invention.
Fig. 3 is a schematic structural diagram of a terminal according to a third embodiment of the present invention.
The invention will be further described in the following detailed description in conjunction with the above-described figures.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, and the described embodiments are merely some, rather than all, embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.
Example 1
Fig. 1 is a flowchart of a monitoring method of a distributed file system according to an embodiment of the present invention.
In this embodiment, the method for monitoring a distributed file system may be applied to a terminal, and for a monitoring terminal that needs to perform a distributed file system, the function of monitoring a distributed file system provided by the method of the present invention may be directly integrated on the terminal, or may be run in the terminal in the form of a software development kit (Software Development Kit, SKD).
As shown in fig. 1, the method for monitoring a distributed file system specifically includes the following steps, and the order of the steps in the flowchart may be changed according to different requirements, and some may be omitted.
S11: and acquiring a log output by the distributed file system to be monitored.
In this embodiment, a period for acquiring the log output by the distributed file system to be monitored may be preset, and the preset period may be set to 1 hour or 2 hours. And when the period of the log output by the distributed file system to be monitored reaches a preset period, acquiring the log output by the distributed file system to be monitored.
S12: and identifying the operation type of each row of data in the log.
In this embodiment, the log output by the distributed file system to be monitored is recorded in a log record table, an operation identifier is recorded in the log record table, and the operation type of the single-row data can be determined by identifying the operation identifier of each row of data in the log.
The operation types may include upload, download, delete, query, or the like.
S13: and classifying the data in the log according to the operation type.
In this embodiment, the operation types of the log are multiple, and response parameters of the output log corresponding to each operation type are very different, so that data in the log are classified according to different operation types, for example: classifying the data in the log with the operation type of uploading into an uploading operation file; classifying the data in the log with the operation type of downloading into a downloading operation file. By categorizing the logs of the same operation type, large differences in response parameters of the logs output by the distributed file system to be monitored, which are caused by data mixing in the logs of different operation types, can be avoided to a certain extent.
S14: data of the same operation type is divided into different grades.
In this embodiment, the level may be set according to a size range of data or a type of data, where the type of data may include: text files, video files, audio files, picture files, etc. In other embodiments, the division of the levels may be further defined according to practical situations, and the present invention is not limited herein.
The following illustrates how data of the same operation type is divided into different levels according to the size range of the data. Assuming that the operation type is uploading operation, dividing the size range of all data corresponding to the uploading operation into three grades, and dividing the data with the size range of 10K-500K in the uploading operation into a first grade; dividing the data with the size range of 500K-2000K in the uploading operation into a second gear; and dividing the data with the size range of 2000K-3M in the uploading operation into a third grade.
The following illustrates how data of the same operation type is divided into different levels according to the type of data. Assuming that the operation type is a downloading operation, dividing all data corresponding to the downloading operation into four grades according to the type of the data, and dividing the data with the data type of a text file in the downloading operation into a first grade; dividing the data with the data type of the video file in the downloading operation into a second gear; dividing data with the data type of the audio file in the downloading operation into a third grade; and dividing the data with the data type of the picture file in the downloading operation into a fourth grade.
S15: and calculating the response parameters of each grade in the same operation type.
In this embodiment, the same operation type includes a plurality of levels, each level includes a plurality of data, and the response parameters of the plurality of data having the same level in the same operation type are calculated.
Preferably, the calculating the response parameter of each grade in the same operation type includes:
acquiring response parameters of each data of each grade in the same operation type;
calculating the average response parameter of each grade in each operation type according to the response parameters;
and determining the average response parameter as the response parameter of the corresponding grade.
In this embodiment, the response parameters of the plurality of data with the same level in the same operation type are averaged to obtain the response parameters of the plurality of data with the same level in the same operation type.
For example, the first level in the uploading operation type includes 3 data, where the response parameter of the first data is X1, the response parameter of the second data is X2, the response parameter of the third data is X3, and an average response parameter corresponding to the first level in the uploading operation is calculated and obtained as Y, where y= (x1+x2+x3)/(3).
In this embodiment, by calculating response parameters of a plurality of data with the same level in the same operation type, the calculation time of the response parameters can be shortened, and the monitoring efficiency can be improved.
S16: and calculating the deviation value of the response parameter and the corresponding preset baseline data.
In this embodiment, baseline data may be preset, and deviation values of response parameters of different grades in different types and response parameters of corresponding types-grades may be calculated according to the baseline data.
Preferably, before calculating the deviation value between the response parameters of different grades in different types and the preset baseline data, the method further includes:
baseline data is created in advance.
In this embodiment, the baseline data is created in advance according to response parameters of history logs of different grades in different types.
Preferably, the creating process of the preset baseline data includes:
acquiring a history log in a preset time period;
dividing the history log into a plurality of sub-history logs according to the time sequence of the history log record;
identifying the operation type of each line of data in each part of sub-history log;
classifying the data in each part of sub-history log according to the operation type;
dividing data of the same operation type in each part of sub-history logs into different grades;
calculating response parameters of each data of each grade in the same operation type in each part of sub-history log;
Calculating a first average response parameter of each grade in the same operation type in the same part of sub-history log according to the response parameters;
calculating a second average response parameter of the multi-part sub-history log of each grade in the same operation type according to the first average response parameter;
and taking the second average response parameter as preset baseline data of the corresponding type-grade.
In this embodiment, a time period may be preset, a history log in the preset time period may be obtained, the history log is equally divided into n parts according to time information carried by the history log, for example, the preset time period is 30 days, and the daily history log is taken as one part according to the time carried by the history log, and is divided into 30 parts of sub-history logs in total. The method comprises the steps of identifying the operation type of each line of data in each part of sub-history log, dividing the same operation type according to different grades, calculating a first average response parameter of each part of sub-history log with the same grade in the same operation type, and calculating a second average response parameter of each part of sub-history log in a preset time period according to the first average response parameter to obtain preset baseline data of the history log response parameters.
Exemplary: the method comprises the steps that a history log in a preset time period is divided into n parts, i pieces of data are included in each grade in the same operation type of a first part of history log, first average response parameters of i pieces of data in each grade in the same operation type of each part of history log are calculated, as shown in a table I, the first average response parameters of the first grade of the first part of uploading operation are A1= (A11+A12+ … … +A1i)/(i), the first average response parameters of the first grade of the second part of uploading operation are A2= (A21+A22+ … … +A2i)/(i), average values of a plurality of first response parameters of the same grade in the same operation type are calculated to obtain second average response parameters, as shown in a table II, the second average response parameters of the first grade in the uploading operation are A= (A1+A2+ … … +an), and the second average response parameters of the first grade in the uploading operation are preset data of the history log.
TABLE one calculation of first average response parameters
Table II calculates a second average response parameter
Preferably, the calculating the deviation value of the response parameter from the corresponding preset baseline data includes:
acquiring preset baseline data of the corresponding type-grade;
calculating the difference value between the response parameter of the corresponding type-grade and the preset baseline data of the corresponding type-grade;
And dividing the absolute value of the difference value by the preset baseline data of the corresponding type-grade to obtain a value serving as a deviation value.
In this embodiment, response parameters of a corresponding type and a corresponding grade are obtained from the preset baseline data, and a difference value between the response parameters of the corresponding type and the corresponding grade in the log output by the distributed file system to be monitored and the preset baseline data of the corresponding type and the corresponding grade is calculated, where the difference value is equal to an absolute value of the difference value divided by the second average response parameter of the preset baseline data, which corresponds to the log and the corresponding grade.
For example, the response parameters Y and Y represent average response parameters of the first level of the uploading operation, and the second average response parameters a of the first level of the corresponding uploading operation in the preset baseline data are obtained, where the deviation value z= |y-a|a of the monitoring data and the preset baseline data is equal to or greater than the first average response parameters a of the first level of the uploading operation.
S17: and judging whether each deviation value is within a preset deviation threshold value range.
In this embodiment, a deviation threshold may be preset, for example, the preset deviation threshold is set to 10%, each calculated deviation value is compared with the preset deviation threshold, and whether each deviation value is within a preset deviation value threshold range is determined.
In this embodiment, by calculating the deviation values of the response parameters of different grades and the preset baseline data in different grades, the deviation values of the response parameters of the logs output by the distributed file system to be monitored of the same grade in the same operation type and the response parameters of the same grade corresponding to the history log can be determined at the first time, whether the deviation values are within the preset deviation threshold range is judged, whether the data in the specific grade corresponding to the specific operation type is abnormal can be rapidly judged, the operation and maintenance efficiency is improved, and the running stability of the distributed file system is ensured.
When each deviation value is determined to be within the preset deviation threshold value range, executing step S18; when it is determined that at least one deviation value is not within the preset deviation threshold value range, step S19 is performed.
S18: and outputting a result of normal operation of the distributed file system.
In this embodiment, when each deviation value of the log output by the distributed file system to be monitored is within the preset deviation threshold range, it is determined that each deviation value in the data of the log output by the distributed file system to be monitored meets the requirement, no abnormal data occurs, and a result that the distributed file system operates normally is output.
S19: and outputting the abnormal running result of the distributed file system.
In this embodiment, when one of the deviation values of the logs output by the distributed file system to be monitored is not within the preset deviation threshold range, it is determined that an abnormality occurs in data in the log corresponding to the deviation value not within the preset deviation threshold range, so that an abnormality occurs in operation of the distributed file system, and the result of the abnormality is output.
Further, after the outputting the result of the abnormal operation of the distributed file system, the method further includes:
and sending alarm information to an administrator.
In this embodiment, after the distributed file system outputs the result of the operation abnormality, the alarm information carrying the abnormality result is sent to the administrator, where the alarm information includes a specific operation type of the abnormality data and a specific grade corresponding to the specific operation type of the abnormality data.
Further, after the sending the alarm information to the administrator, the method further includes:
and identifying abnormal data in the log output by the distributed file system to be monitored.
In this embodiment, by sending alarm information to the administrator, the administrator is informed that the data in the specific level of the specific operation type is abnormal and identifies the abnormal data in the log output by the distributed file system to be monitored, so that the administrator can directly locate the abnormal data and perform later maintenance, the time for checking the abnormal data is shortened, the operation and maintenance efficiency is improved, and meanwhile, the user experience is improved and the running stability of the distributed file system is ensured.
In summary, according to the method for monitoring the distributed file system, the log output by the distributed file system to be monitored is obtained; identifying the operation type of each row of data in the log; classifying the data in the log according to the operation type; dividing data of the same operation type into different grades; calculating response parameters of each grade in the same operation type; calculating the deviation value of the response parameter and the corresponding preset baseline data; judging whether each deviation value is within a preset deviation threshold range; outputting a result of normal operation of the distributed file system when each deviation value is determined to be within a preset deviation threshold range; and outputting a result of abnormal operation of the distributed file system when one deviation value is determined to be not within a preset deviation threshold value range. According to the invention, by calculating the deviation values of the response parameters of different grades in different types and the preset baseline data and judging whether each deviation value accords with the preset threshold range, the abnormal occurrence of the log in the specific grade corresponding to the specific operation type can be rapidly determined, the abnormal data checking time is shortened, the operation and maintenance efficiency is improved, and meanwhile, the user experience is improved and the running stability of the distributed file system is ensured.
Example two
Fig. 2 is a block diagram of a monitoring device for a distributed file system according to a second embodiment of the present invention.
In some embodiments, the monitoring device 20 of the distributed file system may comprise a plurality of functional modules comprising program code segments. Program code of the individual program segments in the monitoring means 20 of the distributed file system may be stored in a memory of the terminal and executed by the at least one processor for performing (see in detail fig. 1 for description) monitoring of the presence of the distributed file system.
In this embodiment, the monitoring device 20 of the distributed file system may be divided into a plurality of functional modules according to the functions performed by the monitoring device. The functional module may include: the system comprises an acquisition module 201, an identification module 202, a classification module 203, a division module 204, a first calculation module 205, a second calculation module 206, a creation module 207, a judgment module 208, an output module 209, a transmission module 210 and an identification module 211. The module referred to in the present invention refers to a series of computer program segments capable of being executed by at least one processor and of performing a fixed function, stored in a memory. In the present embodiment, the functions of the respective modules will be described in detail in the following embodiments.
The acquisition module 201: and the system is used for acquiring the log output by the distributed file system to be monitored.
In this embodiment, a period for acquiring the log output by the distributed file system to be monitored may be preset, and the preset period may be set to 1 hour or 2 hours. And when the period of the log output by the distributed file system to be monitored reaches a preset period, acquiring the log output by the distributed file system to be monitored.
The identification module 202: for identifying the type of operation for each line of data in the log.
In this embodiment, the log output by the distributed file system to be monitored is recorded in a log record table, an operation identifier is recorded in the log record table, and the operation type of the single-row data can be determined by identifying the operation identifier of each row of data in the log.
The operation types may include upload, download, delete, query, or the like.
The classification module 203: and the data in the log are classified according to the operation type.
In this embodiment, the operation types of the log are multiple, and response parameters of the output log corresponding to each operation type are very different, so that data in the log are classified according to different operation types, for example: classifying the data in the log with the operation type of uploading into an uploading operation file; classifying the data in the log with the operation type of downloading into a downloading operation file. By categorizing the logs of the same operation type, large differences in response parameters of the logs output by the distributed file system to be monitored, which are caused by data mixing in the logs of different operation types, can be avoided to a certain extent.
The dividing module 204: for dividing data of the same operation type into different levels.
In this embodiment, the level may be set according to a size range of data or a type of data, where the type of data may include: text files, video files, audio files, picture files, etc. In other embodiments, the division of the levels may be further defined according to practical situations, and the present invention is not limited herein.
The following illustrates how data of the same operation type is divided into different levels according to the size range of the data. Assuming that the operation type is uploading operation, dividing the size range of all data corresponding to the uploading operation into three grades, and dividing the data with the size range of 10K-500K in the uploading operation into a first grade; dividing the data with the size range of 500K-2000K in the uploading operation into a second gear; and dividing the data with the size range of 2000K-3M in the uploading operation into a third grade.
The following illustrates how data of the same operation type is divided into different levels according to the type of data. Assuming that the operation type is a downloading operation, dividing all data corresponding to the downloading operation into four grades according to the type of the data, and dividing the data with the data type of a text file in the downloading operation into a first grade; dividing the data with the data type of the video file in the downloading operation into a second gear; dividing data with the data type of the audio file in the downloading operation into a third grade; and dividing the data with the data type of the picture file in the downloading operation into a fourth grade.
The first calculation module 205: for calculating a response parameter for each level in the same operation type.
In this embodiment, the same operation type includes a plurality of levels, each level includes a plurality of data, and the response parameters of the plurality of data having the same level in the same operation type are calculated.
Preferably, the first calculating module 205 calculates the response parameters of each level in the same operation type, including:
acquiring response parameters of each data of each grade in the same operation type;
calculating the average response parameter of each grade in each operation type according to the response parameters;
and determining the average response parameter as the response parameter of the corresponding grade.
In this embodiment, the response parameters of the plurality of data with the same level in the same operation type are averaged to obtain the response parameters of the plurality of data with the same level in the same operation type.
For example, the first level in the uploading operation type includes 3 data, where the response parameter of the first data is X1, the response parameter of the second data is X2, the response parameter of the third data is X3, and an average response parameter corresponding to the first level in the uploading operation is calculated and obtained as Y, where y= (x1+x2+x3)/(3).
In this embodiment, by calculating response parameters of a plurality of data with the same level in the same operation type, the calculation time of the response parameters can be shortened, and the monitoring efficiency can be improved.
The second calculation module 206: and the deviation value of the response parameter and corresponding preset baseline data is calculated.
In this embodiment, baseline data may be preset, and deviation values of response parameters of different grades in different types and response parameters of corresponding types-grades may be calculated according to the baseline data.
Preferably, before the second calculating module 206 calculates the deviation values between the response parameters of different grades in different types and the preset baseline data, the monitoring device of the distributed file system further includes:
creation module 207: for creating baseline data in advance.
In this embodiment, the baseline data is created in advance according to response parameters of history logs of different grades in different types.
Preferably, the process of creating the preset baseline data by the creating module 207 includes:
acquiring a history log in a preset time period;
dividing the history log into a plurality of sub-history logs according to the time sequence of the history log record;
Identifying the operation type of each line of data in each part of sub-history log;
classifying the data in each part of sub-history log according to the operation type;
dividing data of the same operation type in each part of sub-history logs into different grades;
calculating response parameters of each data of each grade in the same operation type in each part of sub-history log;
calculating a first average response parameter of each grade in the same operation type in the same part of sub-history log according to the response parameters;
calculating a second average response parameter of the multi-part sub-history log of each grade in the same operation type according to the first average response parameter;
and taking the second average response parameter as preset baseline data of the corresponding type-grade.
In this embodiment, a time period may be preset, a history log in the preset time period may be obtained, the history log is equally divided into n parts according to time information carried by the history log, for example, the preset time period is 30 days, and the daily history log is taken as one part according to the time carried by the history log, which is divided into 30 parts in total. And identifying the operation type in each part of sub-history log, dividing the same operation type according to different grades, and calculating a first average response parameter of each part of sub-history log with the same grade in the same operation type. And calculating a second average response parameter of each part of sub-history log in a preset time period according to the first average response parameter to obtain preset baseline data of the history log response parameter.
Exemplary: the method comprises the steps that a history log in a preset time period is divided into n parts, i pieces of data are included in each grade in the same operation type of a first part of history log, first average response parameters of i pieces of data in each grade in the same operation type of each part of history log are calculated, as shown in a table I, the first average response parameters of the first grade of the first part of uploading operation are A1= (A11+A12+ … … +A1i)/(i), the first average response parameters of the first grade of the second part of uploading operation are A2= (A21+A22+ … … +A2i)/(i), average values of a plurality of first response parameters of the same grade in the same operation type are calculated to obtain second average response parameters, as shown in a table II, the second average response parameters of the first grade in the uploading operation are A= (A1+A2+ … … +an), and the second average response parameters of the first grade in the uploading operation are preset data of the history log.
TABLE one calculation of first average response parameters
Table II calculates a second average response parameter
Preferably, the calculating, by the second calculating module 206, a deviation value between the response parameter and the corresponding preset baseline data includes:
acquiring preset baseline data of the corresponding type-grade;
calculating the difference value between the response parameter of the corresponding type-grade and the preset baseline data of the corresponding type-grade;
And dividing the absolute value of the difference value by the preset baseline data of the corresponding type-grade to obtain a value serving as a deviation value.
In this embodiment, response parameters of a corresponding type and a corresponding grade are obtained from the preset baseline data, and a difference value between the response parameters of the corresponding type and the corresponding grade in the log output by the distributed file system to be monitored and the preset baseline data of the corresponding type and the corresponding grade is calculated, where the difference value is equal to an absolute value of the difference value divided by the second average response parameter of the preset baseline data, which corresponds to the log and the corresponding grade.
In this embodiment, the target preset baseline data refers to response parameters of the same type and the same grade corresponding to the type and the grade in the log, and a difference value between the response parameters of the same grade in the same operation type in the log output by the distributed file system to be monitored and the target preset baseline data corresponding to the type and the grade is calculated, where the difference value is equal to an absolute value of the difference value divided by the second average response parameter of the type-grade corresponding to the log in the preset baseline data.
For example, the response parameters Y and Y represent average response parameters of the first level of the uploading operation, and the second average response parameters a of the first level of the corresponding uploading operation in the preset baseline data are obtained, where the deviation value z= |y-a|a of the monitoring data and the preset baseline data is equal to or greater than the first average response parameters a of the first level of the uploading operation.
The judgment module 208: for determining whether each deviation value is within a preset deviation threshold.
In this embodiment, a deviation threshold may be preset, for example, the preset deviation threshold is set to 10%, each calculated deviation value is compared with the preset deviation threshold, and whether each deviation value is within a preset deviation value threshold range is determined.
In this embodiment, by calculating the deviation values of the response parameters of different grades and the preset baseline data in different grades, the deviation values of the response parameters of the logs output by the distributed file system to be monitored of the same grade in the same operation type and the response parameters of the same grade corresponding to the history log can be determined at the first time, whether the deviation values are within the preset deviation threshold range is judged, whether the data in the specific grade corresponding to the specific operation type is abnormal can be rapidly judged, the operation and maintenance efficiency is improved, and the running stability of the distributed file system is ensured.
The output module 209: and when the judging module 208 determines that each deviation value meets the preset deviation threshold value range, outputting a result that the distributed file system is normal in operation.
In this embodiment, when each deviation value of the log output by the distributed file system to be monitored is within the preset deviation threshold range, it is determined that each deviation value in the data of the log output by the distributed file system to be monitored meets the requirement, no abnormal data occurs, and a result that the distributed file system operates normally is output.
The output module 209: and is further configured to output a result of the abnormal operation of the distributed file system when the determining module 208 determines that at least one deviation value does not satisfy the preset deviation threshold range.
In this embodiment, when one of the deviation values of the logs output by the distributed file system to be monitored is not within the preset deviation threshold range, it is determined that an abnormality occurs in data in the log corresponding to the deviation value not within the preset deviation threshold range, so that an abnormality occurs in operation of the distributed file system, and the result of the abnormality is output.
Further, after the output module 209 outputs the result of the abnormal operation of the distributed file system, the monitoring apparatus of the distributed file system further includes:
The sending module 210: for sending alert information to an administrator.
In this embodiment, after the distributed file system outputs the result of the operation abnormality, the alarm information carrying the abnormality result is sent to the administrator, where the alarm information includes a specific operation type of the abnormality data and a specific grade corresponding to the specific operation type of the abnormality data.
Further, after the sending module 210 sends the alarm information to the administrator, the monitoring apparatus of the distributed file system further includes:
the identification module 211: and the system is used for identifying abnormal data in the log output by the distributed file system to be monitored.
In this embodiment, by sending alarm information to the administrator, the administrator is informed that the data in the specific level of the specific operation type is abnormal and identifies the abnormal data in the log output by the distributed file system to be monitored, so that the administrator can directly locate the abnormal data and perform later maintenance, the time for checking the abnormal data is shortened, the operation and maintenance efficiency is improved, and meanwhile, the user experience is improved and the running stability of the distributed file system is ensured.
In summary, according to the monitoring device of the distributed file system, the log output by the distributed file system to be monitored is obtained; identifying the operation type of each row of data in the log; classifying the data in the log according to the operation type; dividing data of the same operation type into different grades; calculating response parameters of each grade in the same operation type; calculating the deviation value of the response parameter and the corresponding preset baseline data; judging whether each deviation value is within a preset deviation threshold range; outputting a result of normal operation of the distributed file system when each deviation value is determined to be within a preset deviation threshold range; and outputting a result of abnormal operation of the distributed file system when one deviation value is determined to be not within a preset deviation threshold value range. According to the invention, by calculating the deviation values of the response parameters of different grades in different types and the preset baseline data and judging whether each deviation value accords with the preset threshold range, the abnormal occurrence of the log in the specific grade corresponding to the specific operation type can be rapidly determined, the abnormal data checking time is shortened, the operation and maintenance efficiency is improved, and meanwhile, the user experience is improved and the running stability of the distributed file system is ensured.
Example III
Fig. 3 is a schematic structural diagram of a terminal according to a third embodiment of the present invention. In the preferred embodiment of the invention, the terminal 3 comprises a memory 31, at least one processor 32, at least one communication bus 33 and a transceiver 34.
It will be appreciated by those skilled in the art that the configuration of the terminal shown in fig. 3 is not limiting of the embodiments of the present invention, and that it may be a bus type configuration, a star type configuration, or a combination of hardware and software, or a different arrangement of components, as the terminal 3 may include more or less hardware or software than is shown.
In some embodiments, the terminal 3 is a terminal capable of automatically performing numerical calculation and/or information processing according to a preset or stored instruction, and its hardware includes, but is not limited to, a microprocessor, an application specific integrated circuit, a programmable gate array, a digital processor, an embedded device, and the like. The terminal 3 may further comprise a client device, which includes, but is not limited to, any electronic product capable of performing man-machine interaction with a client through a keyboard, a mouse, a remote controller, a touch pad, a voice control device, etc., for example, a personal computer, a tablet computer, a smart phone, a digital camera, etc.
It should be noted that the terminal 3 is only used as an example, and other electronic products that may be present in the present invention or may be present in the future are also included in the scope of the present invention by way of reference.
In some embodiments, the memory 31 is used to store program codes and various data, such as the monitoring device 20 of the distributed file system installed in the terminal 3, and to implement high-speed, automatic access to programs or data during operation of the terminal 3. The Memory 31 includes a Read-Only Memory (ROM), a programmable Read-Only Memory (PROM), an erasable programmable Read-Only Memory (EPROM), a One-time programmable Read-Only Memory (One-time Programmable Read-Only Memory, OTPROM), an Electrically erasable rewritable Read-Only Memory (EEPROM), and a Read-Only optical disk (Compact Disc Read-Only Memory, CD-ROM). The memory 31 may further include a nonvolatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card), at least one magnetic disk storage device, or other nonvolatile solid state storage device.
In some embodiments, the at least one processor 32 may be comprised of an integrated circuit, for example, a single packaged integrated circuit, or may be comprised of multiple integrated circuits packaged with the same or different functions, including one or more central processing units (Central Processing unit, CPU), microprocessors, digital processing chips, graphics processors, combinations of various control chips, and the like. The at least one processor 32 is a Control Unit (Control Unit) of the terminal 3, connects the various components of the whole terminal 3 using various interfaces and lines, and performs various functions of the terminal 3 and processes data, such as monitoring of a distributed file system, by running or executing programs or modules stored in the memory 31, and calling data stored in the memory 31.
In some embodiments, the at least one communication bus 33 is arranged to enable connected communication between the memory 31 and the at least one processor 32 or the like.
Although not shown, the terminal 3 may further include a power source (such as a battery) for supplying power to the respective components, and preferably, the power source may be logically connected to the at least one processor 32 through a power management device, so as to perform functions of managing charging, discharging, power consumption management, etc. through the power management device. The power supply may also include one or more of any of a direct current or alternating current power supply, recharging device, power failure detection circuit, power converter or inverter, power status indicator, etc. The terminal 3 may further include various sensors, bluetooth modules, wi-Fi modules, etc., which will not be described herein.
It should be understood that the embodiments described are for illustrative purposes only and are not limited to this configuration in the scope of the patent application.
The integrated units implemented in the form of software functional modules described above may be stored in a computer readable storage medium. The software functional modules described above are stored in a storage medium and include instructions for causing a computer device (which may be a personal computer, a terminal, or a network device, etc.) or a processor (processor) to perform portions of the methods described in the various embodiments of the invention.
In a further embodiment, in connection with fig. 2, the at least one processor 32 may execute the operating device of the terminal 3 as well as various installed applications (e.g., the monitoring device 20 of the distributed file system), program code, etc., such as the various modules described above.
The memory 31 has program code stored therein, and the at least one processor 32 can invoke the program code stored in the memory 31 to perform related functions. For example, each of the modules depicted in fig. 2 is program code stored in the memory 31 and executed by the at least one processor 32 to perform the functions of the respective modules for the purpose of monitoring a distributed file system.
In one embodiment of the invention, the memory 31 stores a plurality of instructions that are executed by the at least one processor 32 to enable monitoring of a distributed file system.
Specifically, the specific implementation method of the above instruction by the at least one processor 32 may refer to the description of the relevant steps in the corresponding embodiment of fig. 1, which is not repeated herein.
Example IV
The embodiment of the invention also provides a computer readable storage medium, the computer readable storage medium stores computer executable instructions, the instructions when executed by a processor of a computer device implement a method for monitoring a distributed file system, the method for monitoring the distributed file system includes:
acquiring a log output by a distributed file system to be monitored;
identifying the operation type of each row of data in the log;
classifying the data in the log according to the operation type;
dividing data of the same operation type into different grades;
calculating response parameters of each grade in the same operation type;
calculating the deviation value of the response parameter and the corresponding preset baseline data;
judging whether each deviation value is within a preset deviation threshold range;
And outputting a result of normal operation of the distributed file system when each deviation value is determined to be within the preset deviation threshold value range.
Specifically, the plurality of instructions executed by the processor to implement the above-mentioned monitoring of the distributed file system may refer to the description of the relevant steps in the corresponding embodiment of fig. 1, which is not repeated herein.
In the several embodiments provided by the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical function division, and there may be other manners of division when actually implemented.
The modules described as separate components may or may not be physically separate, and components shown as modules may or may not be physical units, may be located in one place, or may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional module in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units can be realized in a form of hardware or a form of hardware and a form of software functional modules.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it will be obvious that the term "comprising" does not exclude other elements or that the singular does not exclude a plurality. A plurality of units or means recited in the apparatus claims can also be implemented by means of one unit or means in software or hardware. The terms first, second, etc. are used to denote a name, but not any particular order.
Finally, it should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications and equivalents may be made to the technical solution of the present invention without departing from the spirit and scope of the technical solution of the present invention.
Claims (9)
1. A method for monitoring a distributed file system, the method comprising:
acquiring a log output by a distributed file system to be monitored;
identifying the operation type of each row of data in the log;
classifying the data in the log according to the operation type;
dividing data of the same operation type into different grades, wherein the grades are set according to the size range or the data type of the data;
calculating the response parameters of each grade in the same operation type, including: acquiring response parameters of each data of each grade in the same operation type; calculating the average response parameter of each grade in each operation type according to the response parameters; determining the average response parameter as a response parameter of a corresponding grade;
calculating the deviation value of the response parameter and the corresponding preset baseline data;
judging whether each deviation value is within a preset deviation threshold range;
and outputting a result of normal operation of the distributed file system when each deviation value is determined to be within the preset deviation threshold value range.
2. The method of claim 1, wherein the creating of the preset baseline data comprises:
Acquiring a history log in a preset time period;
dividing the history log into a plurality of sub-history logs according to the time sequence of the history log record;
identifying the operation type of each line of data in each part of sub-history log;
classifying the data in each part of sub-history log according to the operation type;
dividing data of the same operation type in each part of sub-history logs into different grades;
calculating response parameters of each data of each grade in the same operation type in each part of sub-history log;
calculating a first average response parameter of each grade in the same operation type in the same part of sub-history log according to the response parameters;
calculating a second average response parameter of the multi-part sub-history log of each grade in the same operation type according to the first average response parameter;
and taking the second average response parameter as preset baseline data of the corresponding type-grade.
3. The method of claim 1, wherein calculating the deviation value of the response parameter from the corresponding preset baseline data comprises:
acquiring preset baseline data of the corresponding type-grade;
calculating the difference value between the response parameter of the corresponding type-grade and the preset baseline data of the corresponding type-grade;
And dividing the absolute value of the difference value by the preset baseline data of the corresponding type-grade to obtain a value serving as a deviation value.
4. A method according to any one of claims 1 to 3, wherein the method further comprises:
and outputting a result of abnormal operation of the distributed file system when at least one deviation value is determined to be not within the preset deviation threshold value range.
5. The method of claim 4, wherein after said outputting the result of the distributed file system operation exception, the method further comprises:
and sending alarm information to an administrator.
6. The method of claim 5, wherein after the sending alert information to an administrator, the method further comprises:
and identifying abnormal data in the log output by the distributed file system to be monitored.
7. A monitoring device for a distributed file system, the device comprising:
the acquisition module is used for acquiring logs output by the distributed file system to be monitored;
the identification module is used for identifying the operation type of each row of data in the log;
the classifying module is used for classifying the data in the log according to the operation type;
The dividing module is used for dividing the data of the same operation type into different grades, wherein the grades are set according to the size range or the data type of the data;
the first calculating module is configured to calculate a response parameter of each grade in the same operation type, and includes: acquiring response parameters of each data of each grade in the same operation type; calculating the average response parameter of each grade in each operation type according to the response parameters; determining the average response parameter as a response parameter of a corresponding grade;
the second calculation module is used for calculating the deviation value of the response parameter and the corresponding preset baseline data;
the judging module is used for judging whether each deviation value is in a preset deviation threshold range or not;
and the output module is used for outputting the result of normal operation of the distributed file system when the judging module determines that each deviation value is within the preset deviation threshold range.
8. A terminal comprising a processor for implementing a method of monitoring a distributed file system according to any one of claims 1 to 6 when executing a computer program stored in a memory.
9. A computer readable storage medium having stored thereon a computer program, characterized in that the computer program, when executed by a processor, implements a method of monitoring a distributed file system according to any of claims 1 to 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910995097.7A CN110908964B (en) | 2019-10-18 | 2019-10-18 | Monitoring method, device, terminal and storage medium of distributed file system |
| PCT/CN2020/098234 WO2021073144A1 (en) | 2019-10-18 | 2020-06-24 | Distributed file system monitoring method and device, terminal, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910995097.7A CN110908964B (en) | 2019-10-18 | 2019-10-18 | Monitoring method, device, terminal and storage medium of distributed file system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110908964A CN110908964A (en) | 2020-03-24 |
| CN110908964B true CN110908964B (en) | 2023-08-18 |
Family
ID=69815535
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910995097.7A Active CN110908964B (en) | 2019-10-18 | 2019-10-18 | Monitoring method, device, terminal and storage medium of distributed file system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110908964B (en) |
| WO (1) | WO2021073144A1 (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110908964B (en) * | 2019-10-18 | 2023-08-18 | 平安科技（深圳）有限公司 | Monitoring method, device, terminal and storage medium of distributed file system |
| CN113472555B (en) * | 2020-03-30 | 2022-09-23 | 华为技术有限公司 | Fault detection method, system, device, server and storage medium |
| CN111563022B (en) * | 2020-05-12 | 2023-09-05 | 中国民航信息网络股份有限公司 | Centralized memory monitoring method and device |
| CN112000806B (en) * | 2020-08-25 | 2023-06-16 | 携程旅游信息技术（上海）有限公司 | Anomaly log monitoring and analyzing method, system, equipment and storage medium |
| CN113535454B (en) * | 2021-07-15 | 2023-05-30 | 上海上讯信息技术股份有限公司 | Log data anomaly detection method and device |
| CN113872814A (en) * | 2021-09-29 | 2021-12-31 | 北京金山云网络技术有限公司 | Information processing method, device and system for content distribution network |
| CN114328646A (en) * | 2021-11-15 | 2022-04-12 | 腾讯科技（深圳）有限公司 | Data detection method and device, computer equipment and storage medium |
| CN114209345B (en) * | 2021-11-22 | 2024-05-24 | 中山大学肿瘤防治中心（中山大学附属肿瘤医院、中山大学肿瘤研究所） | Nuclear medicine equipment and correction source quality control method, system, equipment and storage medium thereof |
| CN114386025B (en) * | 2021-12-14 | 2024-06-04 | 深圳前海微众银行股份有限公司 | Abnormality detection method, abnormality detection device, electronic device, and storage medium |
| CN114510708A (en) * | 2021-12-28 | 2022-05-17 | 奇安信科技集团股份有限公司 | Real-time data warehouse construction and anomaly detection method, device, equipment and product |
| CN118012652A (en) * | 2023-03-03 | 2024-05-10 | 博泰车联网(南京)有限公司 | Positioning analysis method, device, equipment and storage medium |
| CN116366308B (en) * | 2023-03-10 | 2023-11-03 | 广东堡塔安全技术有限公司 | Cloud computing-based server security monitoring system |
| CN116185672B (en) * | 2023-04-28 | 2023-08-22 | 北京亿赛通科技发展有限责任公司 | Data monitoring method, device and storage medium |
| CN116561076A (en) * | 2023-05-10 | 2023-08-08 | 合芯科技(苏州)有限公司 | Monitoring method and device for distributed file system, computer equipment and medium |
| CN116821837A (en) * | 2023-08-31 | 2023-09-29 | 北京中科心研科技有限公司 | Active report method and device for exception log, electronic equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2037448A1 (en) * | 2007-09-14 | 2009-03-18 | Siemens Aktiengesellschaft | Method and device for classifying data |
| JP2012181744A (en) * | 2011-03-02 | 2012-09-20 | Kddi Corp | Operation monitoring system and operation monitoring method for distributed file system |
| WO2017125014A1 (en) * | 2016-01-18 | 2017-07-27 | 中兴通讯股份有限公司 | Method and device for monitoring hard disk |
| CN108563550A (en) * | 2018-04-23 | 2018-09-21 | 上海达梦数据库有限公司 | A kind of monitoring method of distributed system, device, server and storage medium |
| CN108572905A (en) * | 2018-04-23 | 2018-09-25 | 中国农业银行股份有限公司 | A kind of monitoring method and system based on Distributed Calculation |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105488610B (en) * | 2015-11-23 | 2017-05-10 | 国网山东省电力公司信息通信公司 | Fault real-time analysis and diagnosis method for power application system |
| CN106502875A (en) * | 2016-10-21 | 2017-03-15 | 过冬 | A kind of daily record generation method and system based on cloud computing |
| CN106649068A (en) * | 2016-12-28 | 2017-05-10 | 福建三元达网络技术有限公司 | System fault log recording method and system |
| RU2697955C2 (en) * | 2018-02-06 | 2019-08-21 | Акционерное общество "Лаборатория Касперского" | System and method for training harmful container detection model |
| CN110113224B (en) * | 2019-03-19 | 2022-08-09 | 深圳壹账通智能科技有限公司 | Capacity monitoring method and device, computer equipment and storage medium |
| CN110908964B (en) * | 2019-10-18 | 2023-08-18 | 平安科技（深圳）有限公司 | Monitoring method, device, terminal and storage medium of distributed file system |
-
2019
- 2019-10-18 CN CN201910995097.7A patent/CN110908964B/en active Active
-
2020
- 2020-06-24 WO PCT/CN2020/098234 patent/WO2021073144A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2037448A1 (en) * | 2007-09-14 | 2009-03-18 | Siemens Aktiengesellschaft | Method and device for classifying data |
| JP2012181744A (en) * | 2011-03-02 | 2012-09-20 | Kddi Corp | Operation monitoring system and operation monitoring method for distributed file system |
| WO2017125014A1 (en) * | 2016-01-18 | 2017-07-27 | 中兴通讯股份有限公司 | Method and device for monitoring hard disk |
| CN108563550A (en) * | 2018-04-23 | 2018-09-21 | 上海达梦数据库有限公司 | A kind of monitoring method of distributed system, device, server and storage medium |
| CN108572905A (en) * | 2018-04-23 | 2018-09-25 | 中国农业银行股份有限公司 | A kind of monitoring method and system based on Distributed Calculation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110908964A (en) | 2020-03-24 |
| WO2021073144A1 (en) | 2021-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110908964B (en) | Monitoring method, device, terminal and storage medium of distributed file system | |
| CN107870845B (en) | Management method and system for micro-service architecture application | |
| CN109543891B (en) | Method and apparatus for establishing capacity prediction model, and computer-readable storage medium | |
| US11544052B2 (en) | Tenant declarative deployments with release staggering | |
| CN113656168A (en) | Method, system, medium and equipment for automatic disaster recovery and scheduling of traffic | |
| CN111694677A (en) | Message queue management method, device, terminal and computer-readable storage medium | |
| CN112395156A (en) | Fault warning method and device, storage medium and electronic equipment | |
| CN110932892B (en) | Block chain based information early warning method and device, related nodes and storage medium | |
| CN109656786B (en) | Log acquisition method and device | |
| CN111754123A (en) | Data monitoring method and device, computer equipment and storage medium | |
| CN113630443A (en) | Service management method, device, server and medium | |
| CN113094224B (en) | Server asset management method and device, computer equipment and storage medium | |
| CN115328974A (en) | Data real-time detection method, device, equipment and readable storage medium | |
| CN110708177B (en) | Exception handling method, system and device in distributed system | |
| CN111124591B (en) | Mirror image transmission method and device, electronic equipment and storage medium | |
| CN113609088A (en) | File processing method, device and equipment | |
| CN110399151A (en) | A kind of firmware update, device, equipment and medium | |
| CN111159009B (en) | Pressure testing method and device for log service system | |
| CN110879701B (en) | Workflow visual configuration method, server, system and medium | |
| WO2023239461A1 (en) | Capacity aware cloud environment node recovery system | |
| CN111552746A (en) | Data synchronization method and device, electronic equipment and storage medium | |
| CN113835961B (en) | Alarm information monitoring method, device, server and storage medium | |
| CN114257392A (en) | Equipment management method, equipment management system and gateway | |
| CN115934453A (en) | Troubleshooting method, troubleshooting device and storage medium | |
| CN110543470A (en) | Message early warning method and device, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40020262 Country of ref document: HK |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |