CN112799903A - Method and device for evaluating health state of business system - Google Patents
Method and device for evaluating health state of business system Download PDFInfo
- Publication number
- CN112799903A CN112799903A CN201911114418.4A CN201911114418A CN112799903A CN 112799903 A CN112799903 A CN 112799903A CN 201911114418 A CN201911114418 A CN 201911114418A CN 112799903 A CN112799903 A CN 112799903A
- Authority
- CN
- China
- Prior art keywords
- data
- service
- structured
- time period
- threshold time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000036541 health Effects 0.000 title claims abstract description 52
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000002159 abnormal effect Effects 0.000 claims abstract description 75
- 230000005856 abnormality Effects 0.000 claims abstract description 52
- 230000003862 health status Effects 0.000 claims description 32
- 238000011156 evaluation Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 9
- 238000007405 data analysis Methods 0.000 claims description 5
- 239000000126 substance Substances 0.000 claims description 3
- 238000012545 processing Methods 0.000 abstract description 13
- 230000008569 process Effects 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000012544 monitoring process Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 239000000835 fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
- G06F11/3072—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
Abstract
The invention discloses a method and a device for evaluating the health state of a business system, and relates to the technical field of computers. One embodiment of the method comprises: receiving service data to be written into a log file of a service system; analyzing structured abnormal data from the service data before writing the service data into a log file or while writing the service data into the log file, wherein the structured abnormal data indicates the type of the abnormality and the time when the abnormality occurs; and evaluating the health state of the business system according to the structured abnormal data. The embodiment can directly extract the structured abnormal data from the service data, thereby avoiding the time of waiting for writing the service data into the log file on the disk; meanwhile, the data extracted from the business data is structured abnormal data, so that the processing process of converting the data in the log file into the structured data is avoided, and the integrity of the abnormal data is ensured.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and an apparatus for evaluating a health status of a business system.
Background
In the operation process of the business system, multiple kinds of multiple exceptions, such as absence of reference data, error of a calculation formula, error of code writing and the like, are likely to occur, and at this time, the occurring exceptions need to be analyzed and processed, including: printing a log and analyzing and processing the abnormality according to the log file, sending an abnormality alarm, and the like. The log file-based anomaly analysis needs to go through the following steps: writing the service data of the system into a log file on a disk through log service; regularly (such as every day) pulling the log file from the disk; carrying out structuralization processing on the log file, and further extracting original information to be analyzed; performing data cleaning on the formatted data, removing invalid interference data, and analyzing the cleaned data by using a big data analysis tool; and directly displaying the abnormal analysis result as the system health state.
In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art: when the log is printed, the speed of writing the log into a disk file is very low, and particularly when a system has problems and needs to write a large number of abnormal logs, the system runs slowly; only the log file is pulled regularly for exception analysis, and the exception cannot be monitored in real time, so that exception alarm delay is caused; the structured log file needs to be converted into structured data, errors or omissions are easy to occur in the structured data, and the data accuracy is low; system health cannot be reflected from the perspective of the system user.
Disclosure of Invention
In view of this, the present invention provides a method and an apparatus for evaluating health status of a service system, which can directly extract structured abnormal data from service data, and avoid the time of waiting for writing the service data into a log file on a disk; meanwhile, the data extracted from the business data is structured abnormal data, so that the processing process of converting the data in the log file into the structured data is avoided, and the integrity of the abnormal data is ensured.
To achieve the above object, according to a first aspect of the present invention, there is provided a method for evaluating health status of a business system, including:
receiving service data to be written into a log file of a service system;
analyzing structured abnormal data from the service data before writing the service data into a log file or while writing the service data into the log file, wherein the structured abnormal data indicates the type of the abnormality and the time when the abnormality occurs;
and evaluating the health state of the business system according to the structured abnormal data.
Optionally, the structured exception data is stored using a message queue.
Optionally, evaluating the health status of the business system according to the structured abnormal data includes:
counting the occurrence frequency of each abnormality in a first threshold time period according to the type of the abnormality and the time of the abnormality occurrence;
and calculating the health state of the service system within a first threshold time period according to the occurrence frequency of each abnormality and the preset weight corresponding to each abnormality.
Optionally, in a case that the second threshold time period is divisible into at least two of the first threshold time periods:
determining the weight corresponding to each first threshold time period according to the number of active users using the service system in each first threshold time period;
and calculating the health condition of the service system in the second time period according to the health condition of the service system in each first threshold time period and the weight corresponding to each first threshold time period.
To achieve the above object, according to a second aspect of the present invention, there is provided a business system health status assessment apparatus, including: the system comprises a service data receiving module, an abnormal data analyzing module and a service system evaluating module; wherein the content of the first and second substances,
the service data receiving module is used for receiving service data of a service system to be written into the log file;
the abnormal data analysis module is used for analyzing structured abnormal data from the service data before the service data are written into the log file or while the service data are written into the log file, wherein the structured abnormal data indicate the type of the abnormality and the time when the abnormality occurs;
and the business system evaluation module is used for evaluating the health state of the business system according to the structured abnormal data.
Optionally, the method further comprises: a message queue;
and the abnormal data analysis module is used for storing the structured abnormal data by using the message queue.
Optionally, the evaluating the health status of the business system according to the structured abnormal data includes:
counting the occurrence frequency of each abnormality in a first threshold time period according to the type of the abnormality and the time of the abnormality occurrence;
and calculating the health state of the service system within a first threshold time period according to the occurrence frequency of each abnormality and the preset weight corresponding to each abnormality.
Optionally, in a case that the second threshold time period is divisible into at least two of the first threshold time periods:
determining the weight corresponding to each first threshold time period according to the number of active users using the service system in each first threshold time period;
and calculating the health condition of the service system in the second time period according to the health condition of the service system in each first threshold time period and the weight corresponding to each first threshold time period.
To achieve the above object, according to a third aspect of the present invention, there is provided a server for evaluation of health status of a business system, comprising: one or more processors; a storage device, configured to store one or more programs, which when executed by the one or more processors, cause the one or more processors to implement any one of the above methods for assessing a health status of a business system.
To achieve the above object, according to a fourth aspect of the present invention, there is provided a computer readable medium having stored thereon a computer program which, when executed by a processor, implements any one of the methods of assessing a health status of a business system as described above.
The invention has the following advantages or beneficial effects: structured service data are directly extracted from the service data of the service system, which are to be written into the log file, so that the time for waiting to write the service data into the log file on the disk is avoided; meanwhile, the data extracted from the business data is structured abnormal data, so that the processing process of converting the data in the log file into the structured data is avoided, and the integrity of the abnormal data is ensured; the method can monitor abnormal data of the service system in real time by storing the structured data in the message queue, thereby realizing the real-time monitoring of the abnormity of the service system; and the health state of the business system is evaluated by combining the active state of the user, so that the more reliable and practical health state of the business system is provided for the user.
Further effects of the above-mentioned non-conventional alternatives will be described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
fig. 1 is a schematic diagram of a main flow of a business system health status evaluation method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a main flow of another business system health status evaluation method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of the main modules of an apparatus for assessing the health of a business system in accordance with an embodiment of the present invention;
FIG. 4 is an exemplary system architecture diagram in which embodiments of the present invention may be employed;
fig. 5 is a schematic block diagram of a computer system suitable for use in implementing a terminal device or server of an embodiment of the invention.
Detailed Description
Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which various details of embodiments of the invention are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a schematic diagram of a main flow of a business system health status evaluation method according to an embodiment of the present invention; as shown in fig. 1, the method for evaluating the health status of the service system may specifically include the following steps:
step S101, receiving service data of a service system to be written into a log file. The service data of the service system refers to the service data of the log file to be written in the disk, which is generated by the log service of the service system according to the running state or running record of the service system. Unlike the unstructured data of the plain text content in the log file, the service data acquired at this time is structured service data. The data in the computer informatization system comprises structured data and unstructured data, wherein the unstructured data refers to data which are irregular or incomplete in data structure and inconvenient to express by a database two-dimensional logic table, and the data comprise office documents, texts, pictures, XML, HTML, various reports, images, audio frequency, video information and the like in all formats; structured data refers to data that can be represented using a two-dimensional logical table of a database.
Step S102, before the business data are written into the log file, or while the business data are written into the log file, structural abnormal data are analyzed from the business data, and the structural abnormal data indicate the type of the abnormality and the time of the abnormality. Structured anomaly data includes, but is not limited to: the name of the exception, the type of the exception, the time when the exception occurs, the prompt information of the exception, the description information of the exception, the IP address of the machine where the exception is located, the process number of the occurrence of the exception, the thread number corresponding to the exception and the like. It can be understood that the structured abnormal data is directly analyzed from the service data, so that the time for waiting for the service data to be written into the log file is avoided, meanwhile, the data structuring process required for extracting the abnormal data from the log file is avoided, and the error or omission of the abnormal data caused by format conversion is avoided.
It can be understood that, when the service data is written into the log file and the structured abnormal data is analyzed from the service data, the service data is written into the log file in an asynchronous log mode, that is, after a print log command is sent or a log file is written into a magnetic disk, other processing operations can be continuously executed without waiting for the completion of the writing of the log file, for example, the structured abnormal data is analyzed from the service data. Before the business data are written into the log file, the structured abnormal data are analyzed from the business person data, so that the logs can be written in a synchronous log mode or an asynchronous log mode.
In an alternative embodiment, the structured exception data is stored using a message queue. On the basis, the abnormity occurring in the service system can be monitored in real time by monitoring the abnormal data in the message queue in real time, so that an abnormity alarm can be sent in time, and the abnormity of the service system can be analyzed and processed in time.
And step S103, evaluating the health state of the business system according to the structured abnormal data. In the case of using a message queue to store structured exception data, the structured exception data refers to structured exception data that is heard from the message queue.
In an optional implementation mode, counting the occurrence frequency of each abnormality in a first threshold time period according to the type of the abnormality and the time of the abnormality occurrence; and calculating the health state of the service system within a first threshold time period according to the occurrence frequency of each abnormality and the preset weight corresponding to each abnormality.
The first threshold time period may be any time period set according to actual demand, including but not limited to: 1 hour, 0.5 hour, 3 hoursThe time, 6 hours and the like can be set according to actual needs. Specifically, the abnormality type occurring in the first threshold time period is ΦnCorresponding number of occurrences is NΦnThe abnormal type is phinTo illustrate the corresponding weight, the health status H of the service system in the first threshold time periodΦCan be calculated according to the following formula:
HΦ＝100–(NΦ1*S1+NΦ2*S2+…+NΦn*Sn)······(1)
it can be understood that the influence on the service system or the influence on the user experience is different when the different types of exceptions occur, that is, the health states of the service system are different, and therefore, the weight corresponding to the abnormal type can be determined according to actual needs.
In an alternative embodiment, in the case that the second threshold time period is divisible into at least two of said first threshold time periods: determining the weight corresponding to each first threshold time period according to the number of active users using the service system in each first threshold time period; and calculating the health condition of the service system in the second time period according to the health condition of the service system in each first threshold time period and the weight corresponding to each first threshold time period. It can be understood that the number of users using the service system in different time periods, that is, the number of active users is different, so that the same abnormality occurs in different time periods in the service system, which has different influences on user experience, and thus the health status of the service system can be evaluated in combination with the number of active users of the user, so as to provide a more reliable health evaluation status of the service system for the user or related personnel.
The second threshold time period is any time period set according to actual needs, including but not limited to: 1 hour, 0.5 hour, 3 hours, 6 hours, 1 day, 3 days, 15 days, one month, one year, etc. Specifically, the second threshold time period may be divided into n second threshold time periods, the number of active users using the service system in the nth threshold time period is Pn, and the health state of the service system in the nth threshold time period is Hn, then the health state Dn of the service system in the second threshold time period may be calculated by the following formula:
it is noted that the health status of the traffic system within the second threshold time period can also be calculated using equation (1). In addition, under the condition that the health states of the service systems in a plurality of second threshold time periods need to be calculated, if the first threshold time is 1 hour, and the second threshold time periods are 1 day and 30 days respectively, the health states of the corresponding service systems can be calculated by adopting the formula (1); the second threshold time periods are respectively the health states of the corresponding service systems within 1 day and 30 days and can be obtained by adopting the formula (2); in addition, since the second threshold time period of 30 days may be divided into 30 second threshold time periods of 1 day, the health status of the service system within 30 days may be calculated by the weight determined by the health status of the service system within each divided day and the number of active users within the day.
Based on the method for evaluating the health state of the service system provided by the embodiment, the time for waiting to write the service data into the log file on the disk is avoided by directly extracting the structured service data from the service data to be written into the log file of the service system; meanwhile, the data extracted from the business data is structured abnormal data, so that the processing process of converting the extracted abnormal data in the log file into the structured abnormal data is avoided, and the integrity of the abnormal data is ensured; the method can monitor abnormal data of the service system in real time by storing the structured data in the message queue, thereby realizing the real-time monitoring of the abnormity of the service system; and the health state of the business system is evaluated by combining the active state of the user, so that the more reliable and practical health state of the business system is provided for the user.
Referring to fig. 2, on the basis of the foregoing embodiment, another method for evaluating the health status of a business system is provided, which specifically includes the following steps:
step S201, receiving service data to be written into the log file of the service system.
Step S202, analyzing out structured abnormal data from the service data, wherein the structured abnormal data indicates the type of the abnormality and the time of the abnormality.
Step S203, when the structured abnormal data is analyzed from the service data, the service data is written into a log file. Therefore, the time for waiting for writing the business data into the log file when the structured abnormal data is analyzed from the business data is avoided, and the content in the unstructured log file is converted into the structured abnormal data is avoided.
And step S204, evaluating the health state of the business system according to the structured abnormal data.
Referring to fig. 3, on the basis of the above embodiment, there is provided an apparatus 300 for evaluating health status of a business system, including: a service data receiving module 301, an abnormal data analyzing module 302 and a service system evaluating module 304; wherein the content of the first and second substances,
the service data receiving module 301 is configured to receive service data of a service system, where a log file is to be written;
the abnormal data analyzing module 302 is configured to analyze structured abnormal data from the service data before writing the service data into a log file, or while writing the service data into the log file, where the structured abnormal data indicates a type of an abnormality and a time when the abnormality occurs;
the business system evaluation module 304 is configured to evaluate the health status of the business system according to the structured abnormal data.
Optionally, the method further comprises: a message queue 303;
the abnormal data parsing module 302 is configured to store the structured abnormal data using the message queue.
Optionally, the evaluating the health status of the business system according to the structured abnormal data includes:
counting the occurrence frequency of each abnormality in a first threshold time period according to the type of the abnormality and the time of the abnormality occurrence;
and calculating the health state of the service system within a first threshold time period according to the occurrence frequency of each abnormality and the preset weight corresponding to each abnormality.
Optionally, in a case that the second threshold time period is divisible into at least two of the first threshold time periods:
determining the weight corresponding to each first threshold time period according to the number of active users using the service system in each first threshold time period;
and calculating the health condition of the service system in the second time period according to the health condition of the service system in each first threshold time period and the weight corresponding to each first threshold time period.
Fig. 4 shows an exemplary system architecture 400 of a business system health status evaluation method or a business system health status evaluation device to which an embodiment of the present invention can be applied.
As shown in fig. 4, the system architecture 400 may include terminal devices 401, 402, 403, a network 404, and a server 405. The network 404 serves as a medium for providing communication links between the terminal devices 401, 402, 403 and the server 405. Network 404 may include various types of connections, such as wire, wireless communication links, or fiber optic cables, to name a few.
A user may use terminal devices 401, 402, 403 to interact with a server 405 over a network 404 to receive or send messages or the like. The terminal devices 401, 402, 403 may have various communication client applications installed thereon, such as shopping applications, web browser applications, search applications, instant messaging tools, mailbox clients, social platform software, and the like.
The terminal devices 401, 402, 403 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
The server 405 may be a server that provides various services, such as a background management server that supports shopping websites browsed by users using the terminal devices 401, 402, and 403. The background management server may analyze and perform other processing on the received data such as the product information query request, and feed back a processing result (for example, a health state of the service system) to the terminal device.
It should be noted that the method for evaluating the health status of the business system provided by the embodiment of the present invention is generally executed by the server 405, and accordingly, the apparatus for evaluating the health status of the business system is generally disposed in the server 405.
It should be understood that the number of terminal devices, networks, and servers in fig. 4 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring now to FIG. 5, shown is a block diagram of a computer system 500 suitable for use with a terminal device implementing an embodiment of the present invention. The terminal device shown in fig. 5 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 5, the computer system 500 includes a Central Processing Unit (CPU)501 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)502 or a program loaded from a storage section 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data necessary for the operation of the system 500 are also stored. The CPU 501, ROM 502, and RAM 503 are connected to each other via a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
The following components are connected to the I/O interface 505: an input portion 506 including a keyboard, a mouse, and the like; an output portion 507 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 508 including a hard disk and the like; and a communication section 509 including a network interface card such as a LAN card, a modem, or the like. The communication section 509 performs communication processing via a network such as the internet. The driver 510 is also connected to the I/O interface 505 as necessary. A removable medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 510 as necessary, so that a computer program read out therefrom is mounted into the storage section 508 as necessary.
In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 509, and/or installed from the removable medium 511. The computer program performs the above-described functions defined in the system of the present invention when executed by the Central Processing Unit (CPU) 501.
It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present invention may be implemented by software or hardware. The described modules may also be provided in a processor, which may be described as: a processor comprises a service data receiving module, an abnormal data analyzing module and a service system evaluating module. The names of the modules do not constitute a limitation to the modules themselves in some cases, for example, the service data receiving module may also be described as a "module for receiving service data of a service system".
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be separate and not incorporated into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to comprise: receiving service data to be written into a log file of a service system; analyzing structured abnormal data from the service data before writing the service data into a log file or while writing the service data into the log file, wherein the structured abnormal data indicates the type of the abnormality and the time when the abnormality occurs; and evaluating the health state of the business system according to the structured abnormal data.
According to the technical scheme of the embodiment of the invention, the structured service data is directly extracted from the service data of the service system, so that the time for waiting to write the service data into the log file on the disk is avoided; meanwhile, the data extracted from the business data is structured abnormal data, so that the processing process of converting the data in the log file into the structured data is avoided, and the integrity of the abnormal data is ensured; the method can monitor abnormal data of the service system in real time by storing the structured data in the message queue, thereby realizing the real-time monitoring of the abnormity of the service system; and the health state of the business system is evaluated by combining the active state of the user, so that the more reliable and practical health state of the business system is provided for the user.
The above-described embodiments should not be construed as limiting the scope of the invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A method for evaluating health status of a business system, comprising:
receiving service data to be written into a log file of a service system;
analyzing structured abnormal data from the service data before writing the service data into a log file or while writing the service data into the log file, wherein the structured abnormal data indicates the type of the abnormality and the time when the abnormality occurs;
and evaluating the health state of the business system according to the structured abnormal data.
2. The business system health assessment method of claim 1,
storing the structured exception data using a message queue.
3. The method for assessing the health status of a business system according to claim 1, wherein assessing the health status of the business system based on the structured anomaly data comprises:
counting the occurrence frequency of each abnormality in a first threshold time period according to the type of the abnormality and the time of the abnormality occurrence;
and calculating the health state of the service system within a first threshold time period according to the occurrence frequency of each abnormality and the preset weight corresponding to each abnormality.
4. The business system health assessment method of claim 3,
in case the second threshold time period is divisible into at least two of said first threshold time periods:
determining the weight corresponding to each first threshold time period according to the number of active users using the service system in each first threshold time period;
and calculating the health condition of the service system in the second time period according to the health condition of the service system in each first threshold time period and the weight corresponding to each first threshold time period.
5. An apparatus for assessing health of a business system, comprising: the system comprises a service data receiving module, an abnormal data analyzing module and a service system evaluating module; wherein the content of the first and second substances,
the service data receiving module is used for receiving service data of a service system to be written into the log file;
the abnormal data analysis module is used for analyzing structured abnormal data from the service data before the service data are written into the log file or while the service data are written into the log file, wherein the structured abnormal data indicate the type of the abnormality and the time when the abnormality occurs;
and the business system evaluation module is used for evaluating the health state of the business system according to the structured abnormal data.
6. The business system health assessment apparatus according to claim 5, further comprising: a message queue;
and the abnormal data analysis module is used for storing the structured abnormal data by using the message queue.
7. The apparatus for evaluating health status of business system according to claim 5, wherein said evaluating health status of business system according to said structured abnormal data comprises:
counting the occurrence frequency of each abnormality in a first threshold time period according to the type of the abnormality and the time of the abnormality occurrence;
and calculating the health state of the service system within a first threshold time period according to the occurrence frequency of each abnormality and the preset weight corresponding to each abnormality.
8. The business system health assessment apparatus of claim 7,
in case the second threshold time period is divisible into at least two of said first threshold time periods:
determining the weight corresponding to each first threshold time period according to the number of active users using the service system in each first threshold time period;
and calculating the health condition of the service system in the second time period according to the health condition of the service system in each first threshold time period and the weight corresponding to each first threshold time period.
9. A server for evaluation of a health status of a business system, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-4.
10. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911114418.4A CN112799903A (en) | 2019-11-14 | 2019-11-14 | Method and device for evaluating health state of business system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911114418.4A CN112799903A (en) | 2019-11-14 | 2019-11-14 | Method and device for evaluating health state of business system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112799903A true CN112799903A (en) | 2021-05-14 |
Family
ID=75803778
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911114418.4A Pending CN112799903A (en) | 2019-11-14 | 2019-11-14 | Method and device for evaluating health state of business system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112799903A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113434473A (en) * | 2021-06-28 | 2021-09-24 | 上海浦东发展银行股份有限公司 | Distributed log processing method, device, medium and electronic equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102208991A (en) * | 2010-03-29 | 2011-10-05 | 腾讯科技（深圳）有限公司 | Blog processing method, device and system |
| US20110264424A1 (en) * | 2008-11-19 | 2011-10-27 | Toshiharu Miwa | Apparatus abnormality diagnosis method and system |
| US20160261482A1 (en) * | 2015-03-04 | 2016-09-08 | Fisher-Rosemount Systems, Inc. | Anomaly detection in industrial communications networks |
| CN107832196A (en) * | 2017-11-28 | 2018-03-23 | 广东金赋科技股份有限公司 | A kind of monitoring device and monitoring method for real-time logs anomalous content |
| CN107992398A (en) * | 2017-12-22 | 2018-05-04 | 宜人恒业科技发展（北京）有限公司 | The monitoring method and monitoring system of a kind of operation system |
| WO2019060327A1 (en) * | 2017-09-20 | 2019-03-28 | University Of Utah Research Foundation | Online detection of anomalies within a log using machine learning |
| CN110019214A (en) * | 2017-12-04 | 2019-07-16 | 北京京东尚科信息技术有限公司 | The method and apparatus that data split result is verified |
| CN110275878A (en) * | 2019-06-25 | 2019-09-24 | 北京达佳互联信息技术有限公司 | Business datum detection method, device, computer equipment and storage medium |
-
2019
- 2019-11-14 CN CN201911114418.4A patent/CN112799903A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110264424A1 (en) * | 2008-11-19 | 2011-10-27 | Toshiharu Miwa | Apparatus abnormality diagnosis method and system |
| CN102208991A (en) * | 2010-03-29 | 2011-10-05 | 腾讯科技（深圳）有限公司 | Blog processing method, device and system |
| US20160261482A1 (en) * | 2015-03-04 | 2016-09-08 | Fisher-Rosemount Systems, Inc. | Anomaly detection in industrial communications networks |
| WO2019060327A1 (en) * | 2017-09-20 | 2019-03-28 | University Of Utah Research Foundation | Online detection of anomalies within a log using machine learning |
| CN107832196A (en) * | 2017-11-28 | 2018-03-23 | 广东金赋科技股份有限公司 | A kind of monitoring device and monitoring method for real-time logs anomalous content |
| CN110019214A (en) * | 2017-12-04 | 2019-07-16 | 北京京东尚科信息技术有限公司 | The method and apparatus that data split result is verified |
| CN107992398A (en) * | 2017-12-22 | 2018-05-04 | 宜人恒业科技发展（北京）有限公司 | The monitoring method and monitoring system of a kind of operation system |
| CN110275878A (en) * | 2019-06-25 | 2019-09-24 | 北京达佳互联信息技术有限公司 | Business datum detection method, device, computer equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 张亮;赵娜;: "基于日志数据分析算法的异常检测研究", 微型电脑应用, no. 03 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113434473A (en) * | 2021-06-28 | 2021-09-24 | 上海浦东发展银行股份有限公司 | Distributed log processing method, device, medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8423638B2 (en) | Performance monitoring of a computer resource | |
| CN111190888A (en) | Method and device for managing graph database cluster | |
| CN109471783B (en) | Method and device for predicting task operation parameters | |
| US10375008B2 (en) | Interactive splitting of entries in social collaboration environments | |
| US10031901B2 (en) | Narrative generation using pattern recognition | |
| CN110955640B (en) | Cross-system data file processing method, device, server and storage medium | |
| CN110928934A (en) | Data processing method and device for business analysis | |
| CN113190558A (en) | Data processing method and system | |
| CN112799903A (en) | Method and device for evaluating health state of business system | |
| CN110705271B (en) | System and method for providing natural language processing service | |
| CN110647706A (en) | Method, device and equipment for processing webpage access request and storage medium | |
| CN111858621A (en) | Method, device, equipment and computer readable medium for monitoring business process | |
| US9887945B2 (en) | System and method for unfiltering filtered status messages | |
| CN113076254A (en) | Test case set generation method and device | |
| CN114153703A (en) | Micro-service exception positioning method and device, electronic equipment and program product | |
| CN112579673A (en) | Multi-source data processing method and device | |
| CN113419887A (en) | Method and device for processing abnormal online transaction of host | |
| CN113342619A (en) | Log monitoring method and system, electronic device and readable medium | |
| CN113760568A (en) | Data processing method and device | |
| CN111178014A (en) | Method and device for processing business process | |
| CN113378346A (en) | Method and device for model simulation | |
| CN112749204A (en) | Method and device for reading data | |
| CN112152915A (en) | Message forwarding network system and message forwarding method | |
| CN114201493B (en) | Data access method, device, equipment and storage medium | |
| CN112132722B (en) | Government hot line quantity trend abnormity determining method and device, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |