CN117632656A - Processing equipment and system for operation data - Google Patents
Processing equipment and system for operation data Download PDFInfo
- Publication number
- CN117632656A CN117632656A CN202311658794.6A CN202311658794A CN117632656A CN 117632656 A CN117632656 A CN 117632656A CN 202311658794 A CN202311658794 A CN 202311658794A CN 117632656 A CN117632656 A CN 117632656A
- Authority
- CN
- China
- Prior art keywords
- operation data
- data
- server
- information
- queried
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 95
- 230000010365 information processing Effects 0.000 claims abstract description 42
- 230000003993 interaction Effects 0.000 claims abstract description 20
- 238000001514 detection method Methods 0.000 claims description 55
- 238000004891 communication Methods 0.000 claims description 31
- 238000012544 monitoring process Methods 0.000 description 40
- 230000002159 abnormal effect Effects 0.000 description 28
- 238000000034 method Methods 0.000 description 23
- 238000012360 testing method Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 6
- 238000011156 evaluation Methods 0.000 description 5
- 238000012216 screening Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000008719 thickening Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000630 rising effect Effects 0.000 description 2
- 238000005096 rolling process Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009472 formulation Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000007670 refining Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000001744 unit root test Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
- G06F11/3093—Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
- G06F11/328—Computer systems status display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24564—Applying rules; Deductive queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Computer Hardware Design (AREA)
- Mathematical Physics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a processing device and a system for running data, which relate to the technical field of data processing, wherein the processing device comprises: the information processing module is respectively connected with the information interaction module and the information display module; the information interaction module is used for determining the data query requirement of the user; the information processing module is used for determining candidate operation data based on the data query requirement and determining target operation data according to preset data processing rules and the candidate operation data; the information display module is used for displaying the target operation data. The processing equipment can call the operation data of the server to be queried according to the data query requirement of the user, analyze and summarize the called operation data based on the preset data processing rule, generate the target operation data and display the target operation data, so that the user can intuitively check and know the related information of the server to be queried, the workload of the user is saved, and the processing efficiency and quality of the operation data are improved.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a device and a system for processing operation data.
Background
With the development and application of technologies such as distributed computing and parallel computing, the number of nodes at a server side is increased, and the resource use condition at the server side and the running performance of the server are one of the key problems focused by testers.
At present, a method for detecting the use condition and the operation performance of the resource at the server side is determined by a tester based on the operation data of the server, for example, the tester formulates an evaluation index according to test experience, retrieves the operation data of the server to be monitored, and determines the use condition and the operation performance of the resource at the server side based on the evaluation result of the operation data on the relevant evaluation index. However, the running data of the server is a graph of each index or an average value in a fixed time period, a tester needs to judge whether the resource use condition of the server in the monitoring time period is stable or not and whether the server has abnormality such as protruding burrs or not according to the graph or the average value in the fixed time period, the operation is complicated, the monitoring mode is time-consuming, a large amount of manpower resources are wasted, once the number of the monitored servers is large, the performance indexes to be monitored are large, the testing level of the tester is limited or the tester is doped with subjective consciousness in the testing process, and the monitoring result of the resource use condition and the running performance of the server end is seriously affected.
Disclosure of Invention
The invention provides a processing device and a system for operation data, which aim to rapidly, efficiently, automatically and intelligently analyze the operation data of a server to be detected so as to determine abnormal information in the operation data of the server to be detected, save the workload of users such as testers and the like and improve the processing efficiency and quality of the operation data.
According to an aspect of the present invention, there is provided a processing apparatus for operating data, the processing apparatus comprising: the information processing module is respectively connected with the information interaction module and the information display module;
the information interaction module is used for determining the data query requirement of the user;
the information processing module is used for determining candidate operation data based on the data query requirement and determining target operation data according to preset data processing rules and the candidate operation data;
the information display module is used for displaying the target operation data.
Optionally, the information interaction module comprises an information display unit and an information determination unit, wherein the information display unit and the information determination unit are both connected with the information processing module; the information display unit is used for displaying a parameter matching interface of the operation data when receiving an operation data acquisition instruction sent by a user, wherein the parameter matching interface comprises a first matching parameter and at least one second matching parameter, and the first matching parameter and each second matching parameter are used for indicating the user to determine the data query requirement; and the information determining unit is used for determining the data query requirement based on the attribute information of the first matching parameters and the second matching parameters.
Optionally, the information processing module is further configured to: and determining a parameter matching interface, and sending the parameter matching interface to the information display unit so that the information display unit displays the parameter matching interface when receiving the operation data acquisition instruction.
Optionally, the first matching parameter includes a server address, a start time and an end time; the second matching parameters include central processor usage, memory usage, network bandwidth, amount of input data and amount of output data of the disk.
Optionally, the processing device further includes a storage module, where the storage module is connected to the information processing module; the storage module is used for storing the operation data of at least one server to be queried.
Optionally, the information processing module is specifically configured to: determining a data query instruction based on the data query requirement; candidate operation data is determined from the operation data of at least one server to be queried stored in the storage module based on the data query instruction.
Optionally, the processing device further includes a communication module, where the communication module is electrically connected to the information processing module, and the communication module is communicatively connected to at least one server to be queried; the communication module is used for transmitting interaction information between the information processing module and at least one server to be queried.
Optionally, the information processing module is specifically configured to: determining a data query instruction based on the data query requirement, wherein the data query instruction comprises a target server address of a target server to be queried and an operation data calling instruction; sending a target server address and an operation data calling instruction to a communication module, so that the communication module sends the operation data calling instruction to a target server to be queried based on the target server address, and calling intermediate operation data of the target server to be queried; the intermediate operation data is data which accords with an operation data calling instruction in the operation data of the target server to be queried; and receiving the intermediate operation data fed back by the communication module, and determining candidate operation data based on the intermediate operation data.
Optionally, the preset data processing rule includes a range detection rule, a constant gradient detection rule, a standard deviation detection rule, a differential detection rule, a unit root test rule, and a target operation data determination rule.
Optionally, the information processing module is specifically configured to: processing the candidate operation data based on a range detection rule, a constant gradient detection rule, a standard deviation detection rule, a differential detection rule and a unit root detection rule respectively to obtain an intermediate candidate data set, wherein the intermediate candidate data set comprises at least five intermediate candidate data; and determining target operation data based on the intermediate candidate data and the target operation data determining rule, wherein the target operation data is the intermediate candidate data integrated according to the target operation data determining rule.
According to another aspect of the present invention, there is provided a processing system for operating data, the processing system comprising: the processing equipment of the running data and the server cluster to be queried in any one of the invention; the server cluster to be queried comprises at least one server to be queried.
The processing device of the operation data of the present invention comprises: the information processing module is respectively connected with the information interaction module and the information display module; the information interaction module is used for determining the data query requirement of the user; the information processing module is used for determining candidate operation data based on the data query requirement and determining target operation data according to preset data processing rules and the candidate operation data; the information display module is used for displaying the target operation data. The processing equipment can be used for calling the operation data of the server to be queried according to the data query requirement of the user, analyzing and summarizing the called operation data based on the preset data processing rule, generating the target operation data and displaying the target operation data, analyzing the operation data of the server to be detected quickly, efficiently, automatically and intelligently, determining the abnormal information in the operation data of the server to be detected, saving the workload of the user such as a tester, improving the processing efficiency and quality of the operation data, and displaying the target operation data can enable the user to intuitively check and know the related information of the server to be queried, improve the monitoring experience of the user, reduce the action of human participation in the automatic processing process, reduce the probability of false detection and false judgment and improve the accuracy of the evaluation result of the processor. The method solves the problems that whether the resource use condition of the server in the monitoring time period is stable, whether the abnormal condition such as protruding burrs exist or not is judged by a tester according to the graph or the average value in the fixed time period, the operation is complicated, the monitoring mode is time-consuming, a large amount of manpower resources are wasted, once the number of the monitored servers is large, the performance indexes to be monitored are large, the testing level of the tester is limited, or the tester is doped with subjective consciousness in the testing process, the resource use condition and the monitoring result of the running performance of the server are seriously affected, and the like.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of an apparatus for processing operation data according to the first embodiment;
FIG. 2 is a schematic diagram of another configuration of an apparatus for processing operation data according to the first embodiment;
fig. 3 is a schematic structural diagram of a processing system for operation data according to the second embodiment.
Reference numerals:
10-processing equipment for running data, 101-information interaction module, 102-information processing module, 103-information display module, 104-storage module, 105-communication module and 20-server cluster to be queried.
Detailed Description
In order that the manner in which the invention may be better understood, a more particular description of the invention will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
Fig. 1 is a schematic structural diagram of an operation data processing apparatus according to an embodiment, where the embodiment is applicable to detecting operation data of a server, and determining abnormal operation data of at least one server to be detected/monitored/queried simply, quickly, intelligently and automatically, as shown in fig. 1, the operation data processing apparatus 10 specifically includes: the information processing module 102 is respectively connected with the information interaction module 101 and the information display module 103.
The information interaction module is used for determining the data query requirement of the user; the information processing module is used for determining candidate operation data based on the data query requirement and determining target operation data according to preset data processing rules and the candidate operation data; the information display module is used for displaying the target operation data.
The data query requirement of the user can be understood as a requirement expression of the running condition of the server which the user needs to view, so that the processing device can call relevant running data of the server, the data query requirement comprises server basic information such as a server address, a server running time period and query items, and the query items can be understood as functions which need to be detected/monitored in the server, for example, the use condition of a central processing unit (Central Processing Unit, a CPU), the use condition of a memory, the use condition of a network bandwidth and the like, so that the user can determine whether the server has abnormal running time points and relevant data of abnormal running in the monitoring time period. The candidate operation data may be understood as operation data of a server to be queried (which is a server to be checked by a user, like the server to be detected and the server to be monitored) which is called based on the data query requirement, and may be understood as original operation data of the server to be queried within a monitoring period (a server operation period in the data query requirement). The candidate operation data can be generally understood as log data of the server, the log data are arranged in time sequence, the data amount is more, the candidate operation data are directly displayed, a user is required to check each operation data one by one to determine whether abnormal data exist in the candidate operation data, the determination process of the abnormal operation data is complicated and is greatly influenced by human factors, the preset data processing rule can be understood as screening, refining and integrating rules of the candidate operation data, the abnormal operation data of the server to be queried can be automatically screened out from the candidate operation data, special labeling (thickening, color changing, highlighting and the like) is carried out on the abnormal operation data, the user can quickly position the abnormal operation data of the server to be queried, screening work of the user is saved, the problems of neglect of the abnormal operation data, low recognition rate of the abnormal operation data and the like caused by the human factors are avoided, and the screening rate and the screening accuracy of the abnormal operation data are improved. The target operation data can be understood as candidate operation data after analysis, screening and integration, and can be a data information integration table for highlighting, thickening or color marking special information, so that a user can intuitively check each operation data and abnormal operation data of the server to be queried, and the detection efficiency of the server to be queried and the monitoring experience of monitoring staff are improved.
Specifically, the preset data processing rules include a range detection rule, a constant gradient detection rule, a standard deviation detection rule, a differential detection rule, a unit root inspection rule and a target operation data determination rule. The method comprises the steps of determining whether abnormal points of resource occupation exist in a server to be queried, determining whether the resource occupation of the server to be queried is stable or not in a monitoring period by a constant gradient detection rule, determining whether burrs (representing abnormal) exist in the resource occupation of the server to be queried in the monitoring period by a standard deviation detection rule, determining whether protrusions or recesses (abnormal types) exist in the resource occupation of the server to be queried in the monitoring period by a differential detection rule, determining whether the occupation of a central processor and a memory resource of the server to be queried is stable or not in the monitoring period by a unit root detection rule, and integrating candidate operation data according to the format and requirements of a summary report of monitoring data so as to generate a visual report to assist a user to quickly check and know the abnormal operation data of the server to be queried.
The processing procedure of the candidate operation data according to the invention may comprise: determining whether the maximum value, the minimum value, the average value and the resource occupation of each query index (query term) in the running data of the server to be queried exceed 80 percent (can be determined according to specific monitoring indexes, and is not limited to 80 percent) of the total resources or not in the monitoring time period; and determining the matching results of the operation data of the server to be queried and the range detection rule, the constant gradient detection rule, the standard deviation detection rule, the difference detection rule and the unit root detection rule, and integrating the matching results based on the target operation data determination rule to obtain an operation data summary table (namely target operation data) of the server to be queried.
The number of servers to be queried is not limited, and the operation information of one server can be monitored at one time, and the operation information of a plurality of servers can also be monitored at one time.
Optionally, the information processing module is specifically configured to: processing the candidate operation data based on a range detection rule, a constant gradient detection rule, a standard deviation detection rule, a differential detection rule and a unit root detection rule respectively to obtain an intermediate candidate data set, wherein the intermediate candidate data set comprises at least five intermediate candidate data; and determining target operation data based on the intermediate candidate data and the target operation data determining rule, wherein the target operation data is the intermediate candidate data integrated according to the target operation data determining rule.
The intermediate candidate data set may be understood as a set formed by processing each processing result (intermediate candidate data) of the candidate operation data by using each rule such as a range detection rule, a constant gradient detection rule, a standard deviation detection rule, a differential detection rule, and a unit root detection rule, where the number of intermediate candidate data is related to the number of processing rules, and one processing rule may obtain at least one intermediate candidate data.
Specifically, the range detection is to determine whether data with a standard deviation of plus or minus 3 times from the mean exists in the candidate operation data, the constant gradient detection is to determine whether data with a time period and/or a gradient value with a gradient approximately constant exists in the candidate operation data, the rolling standard deviation detection is to determine whether data with a standard deviation of plus or minus 3 times from the mean of a time window exists in the candidate operation data, the differential detection is to determine whether data with a larger differential value exists in the candidate operation data, and the unit root (ADF) test is to determine whether the candidate operation data has stability.
For example, if a point with a standard deviation of plus or minus 3 times of the mean exists in the range detection, determining that the resource occupation condition of the server to be queried in the monitoring process has an abnormally high or abnormally low time point; if the constant gradient detection has a time period with the gradient being approximately non-0 constant, determining that the resources of the server to be queried are not occupied uniformly in the monitoring process, for example, if the constant gradient detection has a time period with the gradient being approximately 0, determining that the resources of the server to be queried are occupied more stably in the monitoring process; if the standard deviation detection (namely rolling standard deviation monitoring) has a point which deviates from the time window mean by plus or minus 3 times of the standard deviation, determining that the resource occupation of the server to be queried has burrs in the monitoring process; if a point with a larger difference value exists in the difference detection, determining that the resource occupation of the server to be queried has a protrusion or a depression in the monitoring process; if the ADF test has a time trend or is unstable, the operation data of the server to be queried needs to be focused, for example, the CPU occupation has an obvious rising trend along with the time increase in the monitoring process, the memory occupation has an obvious rising trend along with the time increase in the monitoring process, and the like.
Further, after obtaining each intermediate candidate data, the processing device of the present invention integrates each intermediate candidate data based on a target operation data determining rule (information summarizing format) to obtain target operation data, where the target operation data may be a processor monitoring report, a name of the report may include a timestamp of a report generating time, and the report may display specific information of each monitoring index, and make a special marking on the heavy point information.
The target operation data are shown in table 1, specific data are not filled in table 1, and the specific data are denoted by XX, so that a user can intuitively see the operation information of the processor and timely find abnormal information.
TABLE 1
The original data address in table 1 can be understood as a storage location of the original data, so that a user can quickly find the original data, the accessory can be understood as information such as an icon or a graph, other information can be understood as information which is not classified in the table, and summary information can be understood as simple summary information of operation data of all servers to be queried, so that the user can quickly know a detection result of the servers to be queried.
The information interaction module comprises an information display unit and an information determination unit, wherein the information display unit and the information determination unit are both connected with the information processing module.
Specifically, the information display unit is used for displaying a parameter matching interface of the operation data when receiving an operation data acquisition instruction sent by a user, wherein the parameter matching interface comprises a first matching parameter and at least one second matching parameter, and the first matching parameter and each second matching parameter are used for indicating the user to determine the data query requirement; the information determining unit is used for determining the data query requirement based on the first matching parameters and the attribute information of each second matching parameter.
The operation data obtaining instruction can be understood as a detection requirement sent by a user, and the user is informed of the data query requirement at the current moment of the processing equipment, so that the operation condition of some servers needs to be detected. The parameter matching interface comprises names of a plurality of matching parameters and data acquisition positions, and attribute information can be understood as contents filled in the data acquisition positions, so that data query requirements are determined according to information of the data acquisition positions of the matching parameters input by a user. The first matching parameters may be understood as necessary parameters including server address, start time and end time; the second matching parameter may be understood as an optional parameter, including a central processing unit usage rate, a memory usage rate, a network bandwidth, an input data amount of a disk, and an output data amount, where the formulation of the optional parameter is related to a query requirement of a user, for example, when the user needs to query the central processing unit usage rate, the second matching parameter is determined to be the central processing unit usage rate, and when the user needs to query the memory usage rate, the second matching parameter is determined to be the memory usage rate.
The parameter matching interface is shown in table 2, the server address is the address of the server to be queried, the starting time and the ending time form a monitoring time period, the starting time is the starting time of the operation data to be monitored, the ending time is the ending time of the operation data to be monitored, the central processing unit represents the central processing unit utilization rate, the memory represents the memory utilization rate, and other matching parameters are not shown in the table.
TABLE 2
After the relevant matching parameters are set, the information determining unit can determine the data query requirement according to the attribute information of the first matching parameters and the second matching parameters.
It is noted that the data acquisition location of the second matching parameter is considered to not monitor the content if the information is not filled, for example, if the central processor in the table is not filled with 8, the processor usage is considered to not be monitored.
The information display unit has only display function and no data processing function, and the parameter matching interface is determined by the processor substantially and displayed by the information display unit so as to indicate the user to determine the data query requirement. It can be seen that the information processing module is further configured to: and determining a parameter matching interface, and sending the parameter matching interface to the information display unit so that the information display unit displays the parameter matching interface when receiving the operation data acquisition instruction. The method has the advantage that the requirement input mode of the user can be regulated, so that the processing equipment can quickly know the data query requirement of the user.
Fig. 2 is a schematic structural diagram of another processing device for operation data provided in the first embodiment, and as can be seen from fig. 2, the processing device 10 for operation data further includes a storage module 104 and a communication module 105 in addition to the information interaction module 101, the information processing module 102 and the information display module 103; the storage module 104 is connected to the information processing module 102, the communication module 105 is electrically connected to the information processing module 102, and the communication module 105 is communicatively connected to at least one server to be queried (not shown in the figure).
The storage module can be understood as a component with a data storage function such as a hard disk, a storage bar, a magnetic disk and the like, and is used for storing the operation data of at least one server to be queried; the communication module may be understood as a component such as bluetooth, near field communication, or internet of things, and is configured to transmit interaction information between the information processing module and at least one server to be queried, for example, send data call information of the information processing module to the server, and send operation data of the server to the information processing module.
The operation data of each server in the present invention may be stored on the processing device, that is, each server transmits the operation data to the processing device in real time or at a fixed time, so that the processing device stores the operation data of each server, or may be stored in a memory component of each server, that is, the processing device does not have the operation data of each server. The determination process of the candidate operation data is different for different storage modes.
When the operation data of each server is stored in the processing device, the information processing module is specifically configured to: determining a data query instruction based on the data query requirement; candidate operation data is determined from the operation data of at least one server to be queried stored in the storage module based on the data query instruction.
The data query instruction may be understood as a request message configured according to a server address, a monitoring time period (a start time and an end time), and a query term (a term to be monitored), and is used for acquiring original operation data corresponding to a data query requirement from the data storage component.
When the operation data of each server is stored in the processing device, the information processing module generates a data query instruction including the server address, the monitoring time period and the query item, and directly retrieves the operation data conforming to the instruction in the storage module, where the retrieved data is candidate operation data.
When the operation data of each server are stored in the memory component of the respective server, the information processing module is specifically configured to: determining a data query instruction based on the data query requirement, wherein the data query instruction comprises a target server address of a target server to be queried and an operation data calling instruction; sending a target server address and an operation data calling instruction to a communication module, so that the communication module sends the operation data calling instruction to a target server to be queried based on the target server address, and calling intermediate operation data of the target server to be queried; the intermediate operation data is data which accords with an operation data calling instruction in the operation data of the target server to be queried; and receiving the intermediate operation data fed back by the communication module, and determining candidate operation data based on the intermediate operation data.
The running data call instruction includes a monitoring time period and a query term, the target server to be queried may be understood as a server having a data call requirement (having a monitoring requirement), and the target server address may be understood as a server address of the target server to be queried.
Specifically, when the operation data of each server is stored in the respective server memory unit, the communication module is used as an intermediary to call the candidate operation data. Therefore, the information processing module determines the target server address and the operation data calling instruction of the target server to be queried, and sends the target server address and the operation data calling instruction to the communication module, so that the communication module sends the operation data calling instruction to the target server to be queried corresponding to the target server address, the operation data which accords with the operation data calling instruction in the target server to be queried is called, and the operation data which is fed back to the information processing module by the communication module is the candidate operation data.
The processing apparatus of operation data of the present embodiment includes: the information processing module is respectively connected with the information interaction module and the information display module; the information interaction module is used for determining the data query requirement of the user; the information processing module is used for determining candidate operation data based on the data query requirement and determining target operation data according to preset data processing rules and the candidate operation data; the information display module is used for displaying the target operation data. The processing equipment can be used for calling the operation data of the server to be queried according to the data query requirement of the user, analyzing and summarizing the called operation data based on the preset data processing rule, generating the target operation data and displaying the target operation data, analyzing the operation data of the server to be detected quickly, efficiently, automatically and intelligently, determining the abnormal information in the operation data of the server to be detected, saving the workload of the user such as a tester, improving the processing efficiency and quality of the operation data, and displaying the target operation data can enable the user to intuitively check and know the related information of the server to be queried, improve the monitoring experience of the user, reduce the action of human participation in the automatic processing process, reduce the probability of false detection and false judgment and improve the accuracy of the evaluation result of the processor. The method solves the problems that whether the resource use condition of the server in the monitoring time period is stable, whether the abnormal condition such as protruding burrs exist or not is judged by a tester according to the graph or the average value in the fixed time period, the operation is complicated, the monitoring mode is time-consuming, a large amount of manpower resources are wasted, once the number of the monitored servers is large, the performance indexes to be monitored are large, the testing level of the tester is limited, or the tester is doped with subjective consciousness in the testing process, the resource use condition and the monitoring result of the running performance of the server are seriously affected, and the like.
Example two
Fig. 3 is a schematic structural diagram of a processing system for operation data provided in the second embodiment, where the present embodiment is applicable to detecting operation data of a server, and determining abnormal operation data of at least one server to be detected/monitored/queried simply, quickly, intelligently and automatically, as shown in fig. 3, the processing system specifically includes: the device 10 for processing operation data and the server cluster 20 to be queried according to any of the embodiments of the present invention.
The server cluster to be queried includes at least one server to be queried, which can be understood as electronic products such as a computer, a mobile phone, a tablet, etc., which is not limited in this embodiment.
It should be noted that the running data of the server may be stored in the memory module of the processing device that is sent to the running data based on the communication module at regular time, or may be stored in the memory unit of the server itself (processing system call waiting for the running data).
The communication method may be a bluetooth communication method, an internet of things communication method, a near field communication method, etc., which is not limited in the present invention.
The processing system of the operation data in this embodiment includes the server cluster to be queried and the processing device of the operation data described in the above embodiment. When receiving a request that a user checks operation information of any one server or determines whether any one server has abnormal operation or not within a certain period of time, a request instruction is generated based on the request information of the user, the server operation data of the response is called, the called operation data is processed, analyzed and integrated to generate an information table, and the information table is displayed so that the user can know whether the operation information of the server has abnormal points (the abnormal points can be marked in the information table in a thickening, highlighting and other forms), and the embodiment does not limit the abnormal points). The method solves the problems that whether the resource use condition of the server in the monitoring time period is stable, whether the abnormal condition such as protruding burrs exist or not is judged by a tester according to the graph or the average value in the fixed time period, the operation is complicated, the monitoring mode is time-consuming, a large amount of manpower resources are wasted, once the number of the monitored servers is large, the performance indexes to be monitored are large, the testing level of the tester is limited, or the tester is doped with subjective consciousness in the testing process, the resource use condition and the monitoring result of the running performance of the server are seriously affected, and the like. Further, the processing system for the operation data provided in the embodiment includes the operation data processing device in the above embodiment, and has the corresponding beneficial effects of the operation data processing device.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.
Claims (10)
1. An apparatus for processing operation data, comprising: the information processing module is respectively connected with the information interaction module and the information display module;
the information interaction module is used for determining the data query requirement of a user;
the information processing module is used for determining candidate operation data based on the data query requirement and determining target operation data according to a preset data processing rule and the candidate operation data;
the information display module is used for displaying the target operation data.
2. The processing device according to claim 1, wherein the information interaction module includes an information display unit and an information determination unit, wherein the information display unit and the information determination unit are both connected to the information processing module;
the information display unit is used for displaying a parameter matching interface of the operation data when receiving an operation data acquisition instruction sent by the user, wherein the parameter matching interface comprises a first matching parameter and at least one second matching parameter, and the first matching parameter and each second matching parameter are used for indicating the user to determine the data query requirement;
the information determining unit is used for determining the data query requirement based on the first matching parameters and the attribute information of each second matching parameter.
3. The processing device of claim 2, wherein the information processing module is further configured to:
and determining the parameter matching interface, and sending the parameter matching interface to the information display unit so that the information display unit displays the parameter matching interface when receiving the operation data acquisition instruction.
4. The processing device of claim 2, wherein the first matching parameters include a server address, a start time, and an end time; the second matching parameters comprise CPU utilization, memory utilization, network bandwidth, disk input data volume and disk output data volume.
5. The processing apparatus of claim 1, further comprising: the storage module is connected with the information processing module;
the storage module is used for storing the operation data of at least one server to be queried.
6. The processing device according to claim 5, characterized in that said information processing module is in particular configured to:
determining a data query instruction based on the data query requirement;
and determining the candidate operation data from the operation data of the at least one server to be queried, which are stored by the storage module, based on the data query instruction.
7. The processing apparatus of claim 1, further comprising: the communication module is electrically connected with the information processing module and is in communication connection with at least one server to be queried;
and the communication module is used for transmitting the interaction information between the information processing module and the at least one server to be queried.
8. The processing device according to claim 7, characterized in that said information processing module is in particular configured to:
determining the data query instruction based on the data query requirement, wherein the data query instruction comprises a target server address of a target server to be queried and an operation data calling instruction;
the target server address and the operation data calling instruction are sent to the communication module, so that the communication module sends the operation data calling instruction to the target server to be queried based on the target server address, and intermediate operation data of the target server to be queried are called; the intermediate operation data is data which accords with the operation data calling instruction in the operation data of the target server to be queried;
and receiving the intermediate operation data fed back by the communication module, and determining the candidate operation data based on the intermediate operation data.
9. The processing apparatus according to claim 1, wherein the preset data processing rule includes a range detection rule, a constant gradient detection rule, a standard deviation detection rule, a differential detection rule, a unit root check rule, and a target operation data determination rule;
the information processing module is specifically configured to:
processing the candidate operation data based on the range detection rule, the constant gradient detection rule, the standard deviation detection rule, the differential detection rule and the unit root detection rule respectively to obtain an intermediate candidate data set, wherein the intermediate candidate data set comprises at least five intermediate candidate data;
and determining the target operation data based on the intermediate candidate data and the target operation data determining rule, wherein the target operation data is the intermediate candidate data integrated according to the target operation data determining rule.
10. A system for processing operational data, comprising: a processing device of operational data and a cluster of servers to be queried according to any of claims 1-9;
the server cluster to be queried comprises at least one server to be queried.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311658794.6A CN117632656A (en) | 2023-12-05 | 2023-12-05 | Processing equipment and system for operation data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311658794.6A CN117632656A (en) | 2023-12-05 | 2023-12-05 | Processing equipment and system for operation data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117632656A true CN117632656A (en) | 2024-03-01 |
Family
ID=90021323
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311658794.6A Pending CN117632656A (en) | 2023-12-05 | 2023-12-05 | Processing equipment and system for operation data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117632656A (en) |
-
2023
- 2023-12-05 CN CN202311658794.6A patent/CN117632656A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109726103B (en) | Test report generation method, device, equipment and storage medium | |
| CN109684160A (en) | Database method for inspecting, device, equipment and computer readable storage medium | |
| CN111400186B (en) | Performance test method and system | |
| CN109815094B (en) | Data table monitoring method, device, equipment and computer readable storage medium | |
| CN109633351B (en) | Intelligent IT operation and maintenance fault positioning method, device, equipment and readable storage medium | |
| CN110362473B (en) | Test environment optimization method and device, storage medium and terminal | |
| EP2492767B1 (en) | Inspection system, management server, inspection apparatus and method for managing inspection data | |
| KR20070080313A (en) | Method and system for analyzing performance of providing services to client terminal | |
| JP2010231368A (en) | Monitoring method and monitoring program | |
| CN111045879B (en) | Method, device and storage medium for generating pressure test report | |
| CN115396289B (en) | Fault alarm determining method and device, electronic equipment and storage medium | |
| CN105471938B (en) | Server load management method and device | |
| CN106648722B (en) | Method and device for processing Flume receiving terminal data based on big data | |
| CN115509797A (en) | Method, device, equipment and medium for determining fault category | |
| CN110262955B (en) | Application performance monitoring tool based on pinpoint | |
| CN111143325A (en) | Data acquisition monitoring method, monitoring device and readable storage medium | |
| EP3764232A1 (en) | Business transactions impact analysis | |
| CN112948262A (en) | System test method, device, computer equipment and storage medium | |
| CN109614382B (en) | Log segmentation method and device for application | |
| CN117632656A (en) | Processing equipment and system for operation data | |
| CN110688273B (en) | Classification model monitoring method and device, terminal and computer storage medium | |
| CN107357703B (en) | Terminal application power consumption detection method and server | |
| CN115952098A (en) | Performance test tuning scheme recommendation method and system | |
| CN113411236B (en) | Quality difference router detection method, quality difference router detection device, quality difference router detection equipment and storage medium | |
| CN113778831A (en) | Data application performance analysis method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |