CN114741226A - Fault processing method, system, computer device and readable storage medium - Google Patents

Fault processing method, system, computer device and readable storage medium Download PDF

Info

Publication number
CN114741226A
CN114741226A CN202210445990.4A CN202210445990A CN114741226A CN 114741226 A CN114741226 A CN 114741226A CN 202210445990 A CN202210445990 A CN 202210445990A CN 114741226 A CN114741226 A CN 114741226A
Authority
CN
China
Prior art keywords
processing
alarm
preset
fault
instruction set
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210445990.4A
Other languages
Chinese (zh)
Inventor
王梦翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Asset Management Co Ltd
Original Assignee
Ping An Asset Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Asset Management Co Ltd filed Critical Ping An Asset Management Co Ltd
Priority to CN202210445990.4A priority Critical patent/CN114741226A/en
Publication of CN114741226A publication Critical patent/CN114741226A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0793—Remedial or corrective actions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0709—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0721—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment within a central processing unit [CPU]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0766—Error or fault reporting or storing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3024—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a central processing unit [CPU]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/324—Display of status information
    • G06F11/327—Alarm or error message display
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Computer Hardware Design (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The embodiment of the invention provides a fault processing method, which comprises the following steps: when alarm information of a preset monitoring item ID is received, judging whether the preset monitoring item ID is provided with an automatic intervention switch or not; if the automatic intervention switch is set, counting the alarm times of the ID of the preset monitoring item; judging whether the alarm frequency reaches a preset threshold value or not; and if the alarm times reach the preset threshold value, automatically processing according to a preset instruction set, wherein the preset instruction set comprises a preset fault processing instruction set and/or a recommended fault processing instruction set, and the recommended fault processing instruction set is obtained by learning and processing according to the fault historical processing condition of the monitoring item ID. According to the embodiment of the invention, all alarms do not need to be manually intervened in the alarm processing, an integrated monitoring processing flow is formed, and the mechanical and repetitive work content of operation and maintenance personnel is reduced to a great extent.

Description

Fault processing method, system, computer device and readable storage medium
Technical Field
The embodiment of the invention relates to the technical field of artificial intelligence, in particular to a fault processing method, a fault processing system, computer equipment and a computer readable storage medium.
Background
With the development of information technology, more and more businesses and processes start electronic reform, and a digital centralized scheme is adopted. However, after the business system is centralized, the increase of the complexity of the system leads to further improvement of the working strength of operation and maintenance. The effective system and the application monitoring system not only can know the service condition of the service resources, but also can find system faults at the first time, thereby realizing stable operation.
The traditional monitoring and diagnosing tool can help operation and maintenance personnel to quickly analyze the reason of the application fault, but after the reason is analyzed and positioned, the operation and maintenance personnel still need manual intervention to perform alarm processing, manual intervention not only wastes human resources to perform mechanical and repeated fault processing, but also prolongs the problem processing timeliness, and further possibly causes the risk of reduction of the satisfaction degree of an IT system.
Disclosure of Invention
In view of this, embodiments of the present invention provide a fault handling method, a system, a computer device, and a computer readable storage medium, so as to solve the problems that, in the prior art, for an application deployed in a cluster mode, a complex current limiting rule cannot be implemented, and when a service is down, only a single machine current limiting mode can be used.
In order to achieve the above object, an embodiment of the present invention provides a fault handling method, including the following steps:
when alarm information of a preset monitoring item ID is received, judging whether the preset monitoring item ID is provided with an automatic intervention switch or not;
if the automatic intervention switch is set, counting the alarm times of the ID of the preset monitoring item;
judging whether the alarm frequency reaches a preset threshold value or not;
and if the alarm times reach the preset threshold value, automatically processing according to a preset instruction set, wherein the preset instruction set comprises a preset fault processing instruction set and/or a recommended fault processing instruction set, and the recommended fault processing instruction set is obtained by learning and processing according to the fault historical processing condition of the monitoring item ID.
Optionally, the method for generating the recommended fault handling instruction set includes:
acquiring a historical fault processing record aiming at the preset monitoring item ID, wherein the historical fault processing record comprises a historical processing instruction aiming at the monitoring item ID;
analyzing the historical fault processing record to acquire all historical processing instructions of the preset monitoring item ID from the historical fault processing record, wherein all the historical processing instructions of the preset monitoring item ID form a historical processing instruction set of the monitoring item ID;
and calculating a relative complement set of a pre-stored high-risk instruction list in the historical processing instruction set to obtain the recommended fault processing instruction set.
Optionally, the method further comprises:
when receiving the alarm information of the preset monitoring item ID, establishing connection with an alarm host sending the alarm information, and carrying out alarm processing on the alarm information according to an alarm processing instruction sent by a user;
and storing the alarm record of the preset monitoring item ID, wherein the alarm record comprises the alarm information and a corresponding alarm processing mode, and the stored alarm record is the historical fault processing record.
Optionally, the setting up the connection with the alarm host sending the alarm information and performing alarm processing on the alarm information according to an alarm processing instruction sent by a user includes:
establishing connection with the agent interface of the alarm host;
and sending an alarm processing instruction to the alarm host through the agent interface so as to perform alarm processing on the alarm information.
Optionally, the high-risk instruction list includes a preset high-risk instruction set, and the calculating a relative complement set of the pre-stored high-risk instruction list in the historical processing instruction set to obtain the recommended fault processing instruction set includes:
and calculating a relative complement set of the high-risk instruction set in the historical instruction set to obtain the recommended fault processing instruction set.
Optionally, the method further comprises:
and when the preset fault processing instruction set and the recommended fault processing instruction set exist simultaneously, if the preset alarm frequency reaches the preset threshold value, the preset fault processing instruction set is preferentially adopted for alarm processing.
In order to achieve the above object, an embodiment of the present invention further provides a fault handling system, where the fault handling system includes:
the device comprises a first judgment module, a second judgment module and a monitoring module, wherein the first judgment module is used for judging whether an automatic intervention switch is arranged on a preset monitoring item ID or not when alarm information of the preset monitoring item ID is received;
the counting module is used for counting the alarming times of the preset monitoring item ID when the preset monitoring item ID is provided with the automatic intervention switch;
the second judgment module is used for judging whether the alarm frequency reaches a preset threshold value or not;
and the processing module is used for automatically processing according to a preset instruction set when the alarm frequency reaches the preset threshold, wherein the preset instruction set comprises a preset fault processing instruction set and/or a recommended fault processing instruction set, and the recommended fault processing instruction set is obtained by learning and processing according to the fault historical processing condition of the monitoring item ID.
Optionally, the recommended fault handling generation module is configured to:
acquiring a historical fault processing record aiming at the preset monitoring item ID, wherein the historical fault processing record comprises a historical processing instruction aiming at the monitoring item ID;
analyzing the historical fault processing record to acquire all historical processing instructions of the preset monitoring item ID from the historical fault processing record, wherein all the historical processing instructions of the preset monitoring item ID form a historical processing instruction set of the monitoring item ID;
and calculating a relative complement set of a pre-stored high-risk instruction list in the historical processing instruction set to obtain the recommended fault processing instruction set.
To achieve the above object, an embodiment of the present invention further provides a computer device, a memory of the computer device, a processor, and a computer program stored on the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the fault handling method as described above.
To achieve the above object, an embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, where the computer program is executable by at least one processor to cause the at least one processor to execute the steps of the fault handling method described above.
According to the fault processing method, the fault processing system, the computer device and the readable storage medium provided by the embodiment of the invention, whether the alarm processing is automatically intervened or not is determined by the automatic intervention switch and the set value of the alarm times, and when the automatic intervention alarm processing is determined, the agent realizes the execution of the instruction set on the host, so that the purpose that all alarms do not need to depend on manual intervention alarm processing is realized. The embodiment of the invention forms an integrated monitoring processing flow through a series of alarm judgment. Under the condition that the safety is ensured by multiple switches, the mechanical and repetitive work content of operation and maintenance personnel is reduced to a great extent.
Drawings
Fig. 1 is an exemplary flowchart of a first embodiment of a fault handling method according to an embodiment of the present invention.
Fig. 2 is a schematic flowchart of a method for generating a recommended fault handling instruction set according to a first embodiment of a fault handling method according to an embodiment of the present invention.
Fig. 3 is another exemplary detailed flowchart of a first embodiment of a fault handling method according to an embodiment of the present invention.
Fig. 4 is a schematic diagram of an exemplary alarm processing flow of the fault processing method according to the embodiment of the present invention.
Fig. 5 is a schematic diagram of program modules of a second embodiment of the fault handling system of the present invention.
Fig. 6 is a schematic diagram of a hardware structure of a third embodiment of the computer apparatus according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the descriptions relating to "first", "second", etc. in this application are for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present application.
The following embodiment will exemplarily be described with the computer apparatus 2 as an execution subject.
Example one
Referring to fig. 1, a flowchart illustrating steps of a fault handling method according to a first embodiment of the invention is shown. It is to be understood that the flow charts in the embodiments of the present method are not intended to limit the order in which the steps are performed. The method comprises the following specific steps:
step S100: and when the alarm information of the ID of the preset monitoring item is received, judging whether the ID of the preset monitoring item is provided with an automatic intervention switch or not.
Specifically, the ID is called Identity Document, and Chinese is the ID number. The automatic intervention switch is used for starting whether the alarm information needs to be automatically processed or not, and when the automatic intervention switch is not arranged, manual judgment is executed and subsequent manual intervention processing is carried out; and when an automatic intervention switch is arranged, automatically processing the alarm information. In practical application, each monitoring item ID corresponds to a performance index of the application. The performance monitoring of the application is realized by monitoring each performance index of the application. By setting the automatic intervention switch, the automatic processing of the ID of the monitoring item with alarm can be realized.
The automatic processing method may be to automatically process the alarm information of the preset monitoring item ID according to a preset fault processing instruction set which is entered in advance, or to automatically process the alarm information of the preset monitoring item ID according to a recommended fault processing instruction set generated by fault processing learning.
Step S200: and if an automatic intervention switch is arranged, counting the alarm times of the preset monitoring item ID.
In practical application, when an automatic intervention switch is arranged, the alarm information of the preset monitoring item ID is automatically processed. However, whether to automatically process the alarm information of the preset monitoring item ID needs to judge whether the alarm frequency of the preset monitoring item ID reaches a preset threshold, and for the alarm frequency which does not reach the preset threshold, the alarm information is still processed by adopting a manual judgment and subsequent intervention processing mode.
Step S300: and judging whether the alarm frequency reaches a preset threshold value.
Specifically, the alarm frequency threshold value is set, so that processing interference caused by random events such as network jitter and performance glitch can be eliminated.
Step S400: and if the alarm times reach the preset threshold value, automatically processing according to a preset instruction set, wherein the preset instruction set comprises a preset fault processing instruction set and/or a recommended fault processing instruction set, and the recommended fault processing instruction set is obtained by learning and processing according to the fault historical processing condition of the monitoring item ID.
In practical application, the preset fault handling instruction set is a fault handling instruction set which is pre-recorded in a preset management module of the monitoring platform aiming at the preset monitoring item ID by an operation maintenance worker according to expert experience, organization process assets and the like.
The fault handling learning mechanism enables the monitoring platform to be more intelligent, and can greatly improve the fault handling timeliness and the fault handling efficiency.
In an exemplary embodiment, as shown in fig. 2, the method for generating the recommended fault handling instruction set includes steps S401 to S403:
step S401: and acquiring a historical fault processing record aiming at the preset monitoring item ID, wherein the historical fault processing record comprises a historical processing instruction aiming at the monitoring item ID.
Specifically, by acquiring the historical fault processing record of the preset monitoring item ID, the historical fault processing record is convenient to learn, so that a more accurate fault processing instruction is obtained.
In an exemplary embodiment, as shown in fig. 3, the method further includes step S4011 and step S4012:
step S4011: when receiving the alarm information of the preset monitoring item ID, establishing connection with an alarm host sending the alarm information, and carrying out alarm processing on the alarm information according to an alarm processing instruction sent by a user;
step S4012: and storing the alarm record of the preset monitoring item ID, wherein the alarm record comprises the alarm information and a corresponding alarm processing mode, and the stored alarm record is the historical fault processing record.
Specifically, when the alarm information of the preset monitoring item ID is received, when the operation maintenance personnel need to manually intervene in alarm processing, the host where this alarm occurs is selected to be connected through the visual interface of the monitoring platform, and then the alarm processing is performed through the monitoring platform. And all the alarm information of the preset monitoring item ID and the corresponding alarm processing mode are stored in a database.
In an exemplary embodiment, the step S4010 of establishing a connection with the alarm host that sends the alarm information and performing alarm processing on the alarm information includes:
establishing connection with the agent interface of the alarm host;
and sending an alarm processing instruction to the alarm host through the agent interface so as to perform alarm processing on the alarm information.
agent, which is used most generally to describe a software and hardware system, has four properties: (1) and (4) autonomy. Can operate autonomously without direct intervention of a person or other systems, and can control the behavior and internal state thereof. (2) And (4) sociality. It is possible to interact with other agents (and possibly also people) through some communication language. (3) And (4) reactivity. The environment is sensed, the real-time reaction is made to the change of the environment, and the environment can be changed through behaviors. (4) And (4) motility. Not only simply reacting to the environment, but also actively representing target-driven behavior. And realizing the transmission of an alarm processing instruction by the way of connecting with a host agent interface, thereby realizing the alarm processing of the alarm information.
Step S402: analyzing the historical fault processing record to obtain all historical processing instructions of the preset monitoring item ID from the historical fault processing record, wherein all the historical processing instructions of the preset monitoring item ID form a historical processing instruction set of the monitoring item ID.
Specifically, the historical fault processing record of the preset monitoring item ID includes all historical processing instructions of the preset monitoring item ID. In an exemplary embodiment, a mode of batch processing on a final day may be adopted, and a mode of batch processing on a final week or a final month may also be adopted to perform fault processing acquisition and analysis on the historical fault processing record of the preset monitoring item ID. In the embodiment of the invention, the fault processing is acquired and analyzed in a day-to-day batch processing mode.
For example: in one day, the monitoring item A0001 reports that the application of the X1 is abnormal, and the operation maintenance personnel process the abnormal application in the fault processing module for 3 times in total.
Wherein, the first processing instruction set is: cd/root, sh stop.sh and sh start.sh
The second processing instruction set comprises cd/root sh stop.sh, cd/tmp rm lock.lck, cd/app sh restart.sh
The third processing instruction set comprises (cd/tmp), (rm lock.lck), (cd/app), (sh restart.sh)
In this example, all the history processing instruction sets of the preset monitoring item A00001 should be cd/root sh stop.sh start.sh cd/tmp rm lock.lck (cd/app) sh restart.sh
Step S403: and calculating a relative complement set of a pre-stored high-risk instruction list in the historical processing instruction set to obtain the recommended fault processing instruction set.
The relative complement of the list of high-risk instructions in the historical processing instruction set refers to instructions that are present in the historical processing instruction set but not present in the list of high-risk instructions.
In an exemplary embodiment, the high-risk instruction list includes a preset high-risk instruction set, and the calculating a relative complement of the pre-stored high-risk instruction list in the historical processing instruction set in step S403 to obtain the recommended fault processing instruction set includes:
and calculating a relative complement set of the high-risk instruction set in the historical instruction set to obtain the recommended fault processing instruction set.
And the relative complement of the high-risk instruction set in the historical instruction set is the recommended fault handling instruction set.
For example, the operation and maintenance personnel previously input: the list of high-risk instructions (TRUNCATE TABLE), CREATE INDEX _ name ON TABLE (column), DROP INDEX region _ name _ INDEX ON user.
Monitoring item A00002, reporting Y1 batch interruption, and processing in the fault processing module by operation maintenance personnel for 10 times in total.
The first processing is analyzed to be that the upstream data amount is too large, an INDEX needs to be temporarily added, and the final processing instruction SET comprises (i) CREATE INDEX _ tmp ON user (id), (i) UPDATE flow SET status ═ retry flow _ id ═ Y1, (i) DROP INDEX _ tmp ON user
The second to tenth processing instruction SETs include (i) UPDATE flow SET status (retry WHERE flow _ id (Y1))
As described above, the history processing instruction SET of the monitoring item a00002 includes the CREATE INDEX _ name _ ON table (column) and the DROP INDEX location _ name _ INDEX ON user instruction in the high-risk instruction list, and the result of relatively complementing the high-risk instruction SET in the history processing instruction SET in 10 processing records is UPDATE flow SET — return flow _ id — Y1.
In an exemplary embodiment, the high-risk instruction list further includes an goodness-of-fit threshold and a goodness-of-fit, and when the goodness-of-fit of the subsequent and manual processing records exceeds a preset threshold, fault processing is triggered preferentially after a subsequent fault occurs. The goodness of fit threshold refers to the minimum ratio of the total times of fault processing instructions which are executed and in the same recommended fault processing instruction set when the operation maintenance personnel carry out manual intervention fault processing (namely, alarm information) to the total times of manual intervention fault processing. The goodness of fit times refer to the minimum times of manual intervention fault handling of operation and maintenance personnel. By setting the goodness of fit threshold and the goodness of fit times, the times of processing the alarm information by manual intervention can be ensured, the number of samples for historical alarm processing learning is ensured, and the processing accuracy of the preset monitoring item ID alarm information is improved.
For example, in combination with the above, the list of high-risk instructions preferably includes: an goodness of fit threshold: 90%, goodness of fit times: 5 times. In 10 processing records, 9 times of execution of the recommended fault processing instruction SET UPDATE flow SET status is equal to retry WHERE flow _ ID is equal to Y1, and through calculation, the coincidence degree between the fault processing instruction adopted in the actual processing instruction and the recommended fault processing instruction SET is 90%, and the 9 times, since the coincidence degree threshold SET in the high risk instruction list is 90%, and the coincidence degree times is 5 times, the calculated coincidence degree reaches the SET coincidence degree threshold and meets the requirement of the coincidence degree times, therefore, when the next fault of the preset monitoring item ID recurs, the recommended fault processing instruction SET is preferentially adopted to automatically perform alarm processing, so that mechanical repeated fault processing of human resources is avoided, fault processing timeliness is shortened, and user experience is improved.
In an exemplary embodiment, when the preset fault processing instruction set and the recommended fault processing instruction set exist at the same time, if the preset alarm frequency reaches the preset threshold, the preset fault processing instruction set is preferentially adopted for alarm processing.
In an exemplary embodiment, the preset instruction set may be sent to the alarm host through the agent interface, so as to perform automatic alarm processing on the alarm information. The effect of automatic alarm is achieved through autonomy, sociality, reactivity and activity of the agent.
In practical application, the preset instruction set is sent to the agent on the fault host to realize the execution of the instruction set, and the execution result is sent to the monitoring platform and displayed. If the alarm event processing is completed, the alarm event is automatically closed.
Fig. 4 is a schematic diagram of an exemplary alarm processing flow according to an embodiment of the present invention. When an alarm occurs, automatic intervention switch judgment is firstly carried out to judge whether the switch is automatically intervened, and when the switch is automatically intervened, whether the alarm frequency reaches a preset value is continuously judged. When the alarm times reach the preset value, the automatic processing is carried out according to the preset instruction set, and after the processing is finished, the alarm is turned off. And when the switch is not automatically intervened or the alarm frequency does not reach the preset value, carrying out manual judgment and subsequent manual intervention processing, and after the manual intervention processing is finished, alarming and closing.
The embodiment of the invention determines whether to intervene the alarm processing automatically according to the set values of the automatic intervention switch and the alarm times, and when the automatic intervention alarm processing is determined, the agent realizes the execution of the instruction set on the host, thereby realizing the aim of not needing all alarms to depend on the manual intervention alarm processing. The embodiment of the invention forms an integrated monitoring processing flow through a series of alarm judgment. Under the condition that the safety is ensured by multiple switches, the mechanical and repetitive work content of operation and maintenance personnel is reduced to a great extent.
Example two
Referring to fig. 5, based on the above embodiments, fig. 5 is a schematic diagram illustrating program modules of a second embodiment of the fault handling system according to the present invention. In the present embodiment, the fault handling system 20 may include or be divided into one or more program modules, and the one or more program modules are stored in a storage medium and executed by one or more processors to implement the present invention and implement the above-described fault handling method. The program modules referred to in the embodiments of the present invention refer to a series of computer program instruction segments that can perform specific functions, and are more suitable than the program itself for describing the execution process of the fault handling system 20 in the storage medium. The following description will specifically describe the functions of the program modules of the present embodiment:
the first judgment module 201 is configured to judge whether an automatic intervention switch is set in a preset monitoring item ID when receiving alarm information of the preset monitoring item ID.
Specifically, the ID is called Identity Document, and Chinese is the ID number. The automatic intervention switch is used for starting whether the alarm information needs to be automatically processed or not, and when the automatic intervention switch is not arranged, manual judgment is executed and subsequent manual intervention processing is carried out; and when an automatic intervention switch is arranged, automatically processing the alarm information. In practical applications, each monitoring item ID corresponds to a performance index of the application. The performance monitoring of the application is realized by monitoring each performance index of the application. By setting the automatic intervention switch, the automatic processing of the ID of the monitoring item with alarm can be realized.
The automatic processing method may be to automatically process the alarm information of the preset monitoring item ID according to a preset fault processing instruction set that is entered in advance or to automatically process the alarm information of the preset monitoring item ID according to a recommended fault processing instruction set generated by fault processing learning.
And the counting module 202 is configured to count the alarm times of the preset monitoring item ID if an automatic intervention switch is set.
In practical application, when an automatic intervention switch is arranged, the alarm information of the preset monitoring item ID is automatically processed. However, whether to automatically process the alarm information of the preset monitoring item ID needs to judge whether the alarm frequency of the preset monitoring item ID reaches a preset threshold, and for the alarm frequency which does not reach the preset threshold, the alarm information is still processed by adopting a manual judgment and subsequent intervention processing mode.
And the second judging module 203 is configured to judge whether the alarm frequency reaches a preset threshold.
Specifically, the alarm frequency threshold value is set, so that processing interference caused by random events such as network jitter and performance glitch can be eliminated.
And the processing module 204 is configured to, if the alarm frequency reaches the preset threshold, perform automatic processing according to a preset instruction set, where the preset instruction set includes a preset fault processing instruction set and/or a recommended fault processing instruction set, and the recommended fault processing instruction set is obtained by learning and processing according to a historical fault processing condition of the monitoring item ID.
In practical application, the preset fault handling instruction set is a fault handling instruction set which is pre-recorded in a preset management module of the monitoring platform aiming at the preset monitoring item ID by an operation maintenance worker according to expert experience, organization process assets and the like.
The fault handling learning mechanism enables the monitoring platform to be more intelligent, and can greatly improve the fault handling timeliness and the fault handling efficiency.
In an exemplary embodiment, the system further includes a recommended fault handling generation module, configured to generate a recommended fault handling instruction set, and specifically includes an obtaining unit, an analyzing unit, and a calculating unit:
the acquisition unit is used for acquiring a historical fault processing record aiming at the preset monitoring item ID, and the historical fault processing record comprises a historical processing instruction aiming at the monitoring item ID.
Specifically, by acquiring the historical fault processing record of the preset monitoring item ID, the historical fault processing record is convenient to learn, so that a more accurate fault processing instruction is obtained. In an exemplary embodiment, the system may include a fault handling learning module to learn the historical fault handling record to obtain more accurate fault handling instructions.
In an exemplary embodiment, the system further comprises a fault handling module for:
when receiving the alarm information of the preset monitoring item ID, establishing connection with an alarm host sending the alarm information, and carrying out alarm processing on the alarm information according to an alarm processing instruction sent by a user;
and storing the alarm record of the preset monitoring item ID, wherein the alarm record comprises the alarm information and a corresponding alarm processing mode, and the stored alarm record is the historical fault processing record.
Specifically, when the alarm information of the preset monitoring item ID is received, when the operation maintenance personnel need to manually intervene in alarm processing, the host where this alarm occurs is selected to be connected through the visual interface of the monitoring platform, and then the alarm processing is performed through the monitoring platform. And each alarm information of the preset monitoring item ID and the corresponding alarm processing mode are stored in a database.
In an exemplary embodiment, the alarm host is installed with a corresponding agent, and the fault handling module is further specifically configured to:
establishing connection with the agent interface of the alarm host;
and sending an alarm processing instruction to the alarm host through the agent interface so as to perform alarm processing on the alarm information.
agent describes, most generally, a software and hardware system with four properties: (1) and (4) autonomy. Can operate autonomously without direct intervention of a person or other systems and can control its behavior and internal states. (2) Sociality. It is possible to interact with other agents (and possibly also people) through some communication language. (3) And (4) reactivity. The environment is sensed, the real-time reaction is made to the change of the environment, and the environment can be changed through behaviors. (4) And (4) motility. Not only simply react to the environment, but can actively exhibit target-driven behavior. And realizing the transmission of an alarm processing instruction by the way of connecting with a host agent interface, thereby realizing the alarm processing of the alarm information.
And the analysis unit is used for analyzing the historical fault processing record so as to acquire all historical processing instructions of the preset monitoring item ID from the historical fault processing record, and all the historical processing instructions of the preset monitoring item ID form a historical processing instruction set of the monitoring item ID.
Specifically, the historical fault processing record of the preset monitoring item ID includes all historical processing instructions of the preset monitoring item ID. In an exemplary embodiment, a mode of batch processing on a final day may be adopted, and a mode of batch processing on a final week or a final month may also be adopted to perform fault processing acquisition and analysis on the historical fault processing record of the preset monitoring item ID. In the embodiment of the invention, the fault processing is acquired and analyzed in a day-to-day batch processing mode.
For example: in one day, the monitoring item A0001 reports the application exception of the X1, and the operation maintenance personnel process the application exception in the fault processing module for 3 times in total.
Wherein, the first processing instruction set is as follows: cd/root, sh stop.sh and sh start.sh
The instruction set for the second processing is cd/root sh stop.sh start.sh cd/tmp rm lock.lck sixth cd/app sh restart.sh
The third processing instruction set comprises cd/tmp rm lock.lck cd/app sh restart
In this example, all the history processing instruction sets of the preset monitoring item A00001 should be cd/root sh stop.sh start.sh cd/tmp rm lock.lck (cd/app) sh restart.sh
And the calculation unit is used for calculating a relative complement set of a pre-stored high-risk instruction list in the historical processing instruction set to obtain the recommended fault processing instruction set.
The relative complement of the list of high-risk instructions in the historical processing instruction set refers to instructions that are present in the historical processing instruction set but not present in the list of high-risk instructions.
In an exemplary embodiment, the high-risk instruction list includes a preset high-risk instruction set, and the computing unit is specifically configured to:
and calculating a relative complement set of the high-risk instruction set in the historical instruction set to obtain the recommended fault processing instruction set.
And the relative complement of the high-risk instruction set in the historical instruction set is the recommended fault handling instruction set.
For example, the operation and maintenance personnel previously input: the high risk instruction list includes (1) TRUNCATE TABLE, (CREATE INDEX _ name ON TABLE (column)) and (3) DROP INDEX logic _ name _ INDEX ON user.
Monitoring item A00002, reporting Y1 batch interruption, and processing in the fault processing module by operation maintenance personnel for 10 times in total.
The first processing is analyzed to be that the upstream data amount is too large, an INDEX needs to be temporarily added, and the final processing instruction SET comprises (i) CREATE INDEX _ tmp ON user (id), (i) UPDATE flow SET status ═ retry flow _ id ═ Y1, (i) DROP INDEX _ tmp ON user
The second to tenth processing instruction SETs include (i) UPDATE flow SET status (retry WHERE flow _ id (Y1))
As described above, the history processing instruction SET of the monitoring item a00002 includes the CREATE INDEX _ name _ ON table (column) and the DROP INDEX location _ name _ INDEX ON user instruction in the high-risk instruction list, and the result of relatively complementing the high-risk instruction SET in the history processing instruction SET in 10 processing records is UPDATE flow SET — return flow _ id — Y1.
In an exemplary embodiment, the high-risk instruction list further includes an goodness-of-fit threshold and a goodness-of-fit, and when the goodness-of-fit of the subsequent and manual processing records exceeds a preset threshold, fault processing is triggered preferentially after a subsequent fault occurs. The goodness of fit threshold refers to the minimum ratio of the total times of fault processing instructions which are executed and in the same recommended fault processing instruction set when the operation maintenance personnel carry out manual intervention fault processing (namely, alarm information) to the total times of manual intervention fault processing. The goodness of fit times refer to the minimum times of manual intervention fault handling of operation and maintenance personnel. By setting the goodness of fit threshold and the goodness of fit times, the times of processing the alarm information by manual intervention can be ensured, the number of samples for historical alarm processing learning is ensured, and the processing accuracy of the preset monitoring item ID alarm information is improved.
For example, in combination with the above, the list of high-risk instructions preferably includes: goodness of fit threshold: 90%, goodness of fit times: 5 times. In 10 processing records, 9 times of execution of the recommended fault processing instruction SET UPDATE flow SET status is equal to retry WHERE flow _ ID is equal to Y1, and through calculation, the coincidence degree between the fault processing instruction adopted in the actual processing instruction and the recommended fault processing instruction SET is 90%, and the 9 times, since the coincidence degree threshold SET in the high risk instruction list is 90%, and the coincidence degree times is 5 times, the calculated coincidence degree reaches the SET coincidence degree threshold and meets the requirement of the coincidence degree times, therefore, when the next fault of the preset monitoring item ID recurs, the recommended fault processing instruction SET is preferentially adopted to automatically perform alarm processing, so that mechanical repeated fault processing of human resources is avoided, fault processing timeliness is shortened, and user experience is improved.
In an exemplary embodiment, when the preset fault processing instruction set and the recommended fault processing instruction set exist at the same time, if the preset alarm frequency reaches the preset threshold, the preset fault processing instruction set is preferentially adopted for alarm processing.
In an exemplary embodiment, the preset instruction set may be sent to the alarm host through the agent interface, so as to perform automatic alarm processing on the alarm information. The effect of automatic alarm is achieved through autonomy, sociality, reactivity and activity of the agent.
In practical application, the preset instruction set is sent to the agent on the fault host to realize the execution of the instruction set, and the execution result is sent to the monitoring platform and displayed. If the alarm event processing is completed, the alarm event is automatically closed.
The embodiment of the invention determines whether to intervene the alarm processing automatically according to the set values of the automatic intervention switch and the alarm times, and when the automatic intervention alarm processing is determined, the agent realizes the execution of the instruction set on the host, thereby realizing the aim of not needing all alarms to depend on the manual intervention alarm processing. The embodiment of the invention forms an integrated monitoring processing flow through a series of alarm judgment. Under the condition that the safety is ensured by multiple switches, the mechanical and repetitive work content of operation and maintenance personnel is reduced to a great extent.
EXAMPLE III
Fig. 6 is a schematic diagram of a hardware architecture of a computer device according to a third embodiment of the present invention. In the present embodiment, the computer device 2 is a device capable of automatically performing numerical calculation and/or information processing in accordance with a preset or stored instruction. The computer device 2 may be a rack server, a blade server, a tower server or a cabinet server (including an independent server or a server cluster composed of a plurality of servers), and the like. As shown, the computer device 2 includes, but is not limited to, at least a memory 21, a processor 22, a network interface 23, and a fault handling system 20, which may be communicatively coupled to each other via a system bus. Wherein:
in this embodiment, the memory 21 includes at least one type of computer-readable storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the storage 21 may be an internal storage unit of the computer device 2, such as a hard disk or a memory of the computer device 2. In other embodiments, the memory 21 may also be an external storage device of the computer device 2, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), etc. provided on the computer device 20. Of course, the memory 21 may also comprise both internal and external memory units of the computer device 2. In this embodiment, the memory 21 is generally used for storing an operating system installed in the computer device 2 and various types of application software, such as the program codes of the fault handling system 20 in the second embodiment. Further, the memory 21 may also be used to temporarily store various types of data that have been output or are to be output.
Processor 22 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data Processing chip in some embodiments. The processor 22 is typically used to control the overall operation of the computer device 2. In this embodiment, the processor 22 is configured to execute the program code stored in the memory 21 or process data, for example, execute the fault handling system 20, so as to implement the fault handling method according to the first embodiment.
The network interface 23 may comprise a wireless network interface or a wired network interface, and the network interface 23 is generally used for establishing communication connection between the computer device 2 and other electronic apparatuses. For example, the network interface 23 is used to connect the computer device 2 to an external terminal through a network, establish a data transmission channel and a communication connection between the computer device 2 and the external terminal, and the like. The network may be a wireless or wired network such as an Intranet (Intranet), the Internet (Internet), a Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth (Bluetooth), Wi-Fi, and the like.
It is noted that fig. 6 only shows the computer device 2 with components 20-23, but it is to be understood that not all shown components are required to be implemented, and that more or less components may be implemented instead.
In this embodiment, the fault handling system 20 stored in the memory 21 may be further divided into one or more program modules, and the one or more program modules are stored in the memory 21 and executed by one or more processors (in this embodiment, the processor 22) to complete the present invention.
For example, fig. 5 is a schematic diagram of program modules for implementing the second embodiment of the fault handling system 20, in which the fault handling system 20 may be divided into a first determining module 201, a counting module 202, a second determining module 203, and a processing module 204. The program modules referred to herein are a series of computer program instruction segments that can perform specific functions, and are more suitable than programs for describing the execution process of the fault handling system 20 in the computer device 2. The specific functions of the program modules 201 and 204 have been described in detail in the second embodiment, and are not described herein again.
Example four
The present embodiment also provides a computer-readable storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, a server, an App application mall, etc., on which a computer program is stored, which when executed by a processor implements corresponding functions. The computer readable storage medium of the embodiment is used for storing the fault handling system 20, and when being executed by a processor, the fault handling method of the first embodiment is implemented.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and all equivalent structures or equivalent processes performed by the present invention or directly or indirectly applied to other related technical fields are also included in the scope of the present invention.

Claims (10)

1. A method of fault handling, the method comprising:
when alarm information of a preset monitoring item ID is received, judging whether an automatic intervention switch is arranged on the preset monitoring item ID or not;
if the automatic intervention switch is set, counting the alarm times of the ID of the preset monitoring item;
judging whether the alarm frequency reaches a preset threshold value or not;
and if the alarm times reach the preset threshold value, automatically processing according to a preset instruction set, wherein the preset instruction set comprises a preset fault processing instruction set and/or a recommended fault processing instruction set, and the recommended fault processing instruction set is obtained by learning and processing according to the fault historical processing condition of the monitoring item ID.
2. The fault handling method according to claim 1, wherein the generation method of the recommended fault handling instruction set includes:
acquiring a historical fault processing record aiming at the preset monitoring item ID, wherein the historical fault processing record comprises a historical processing instruction aiming at the monitoring item ID;
analyzing the historical fault processing record to acquire all historical processing instructions of the preset monitoring item ID from the historical fault processing record, wherein all the historical processing instructions of the preset monitoring item ID form a historical processing instruction set of the monitoring item ID;
and calculating a relative complement set of a pre-stored high-risk instruction list in the historical processing instruction set to obtain the recommended fault processing instruction set.
3. The fault handling method of claim 2, wherein the method further comprises:
when receiving the alarm information of the preset monitoring item ID, establishing connection with an alarm host sending the alarm information, and carrying out alarm processing on the alarm information according to an alarm processing instruction sent by a user;
and storing the alarm record of the preset monitoring item ID, wherein the alarm record comprises the alarm information and a corresponding alarm processing mode, and the stored alarm record is the historical fault processing record.
4. The method for processing the fault according to claim 3, wherein the alarm host is installed with a corresponding agent, and the establishing of the connection with the alarm host that sends the alarm information and the alarm processing of the alarm information according to the alarm processing instruction sent by the user comprises:
establishing connection with the agent interface of the alarm host;
and sending an alarm processing instruction to the alarm host through the agent interface so as to perform alarm processing on the alarm information.
5. The fault handling method according to claim 2, wherein the list of high-risk instructions includes a preset set of high-risk instructions, and the calculating a relative complement of the pre-stored list of high-risk instructions in the historical processing instruction set to obtain the recommended set of fault handling instructions includes:
and calculating a relative complement set of the high-risk instruction set in the historical instruction set to obtain the recommended fault processing instruction set.
6. The fault handling method of claim 1, wherein the method further comprises:
and when the preset fault processing instruction set and the recommended fault processing instruction set exist simultaneously, if the preset alarm frequency reaches the preset threshold value, the preset fault processing instruction set is preferentially adopted for alarm processing.
7. A fault handling system, the system comprising:
the first judgment module is used for judging whether an automatic intervention switch is arranged on a preset monitoring item ID or not when the alarm information of the preset monitoring item ID is received;
the counting module is used for counting the alarming times of the preset monitoring item ID when the preset monitoring item ID is provided with the automatic intervention switch;
the second judgment module is used for judging whether the alarm frequency reaches a preset threshold value or not;
and the processing module is used for automatically processing according to a preset instruction set when the alarm times reach the preset threshold, wherein the preset instruction set comprises a preset fault processing instruction set and/or a recommended fault processing instruction set, and the recommended fault processing instruction set is obtained by learning and processing according to the historical fault processing condition of the monitoring item ID.
8. The fault handling system of claim 7, wherein the system further comprises a recommended fault handling generation module to:
acquiring a historical fault processing record aiming at the preset monitoring item ID, wherein the historical fault processing record comprises a historical processing instruction aiming at the monitoring item ID;
analyzing the historical fault processing record to acquire all historical processing instructions of the preset monitoring item ID from the historical fault processing record, wherein all the historical processing instructions of the preset monitoring item ID form a historical processing instruction set of the monitoring item ID;
and calculating a relative complement set of a pre-stored high-risk instruction list in the historical processing instruction set to obtain the recommended fault processing instruction set.
9. A computer device having a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the computer program, when executed by the processor, carries out the steps of the fault handling method according to any one of claims 1 to 6.
10. A computer-readable storage medium, in which a computer program is stored which is executable by at least one processor for causing the at least one processor to carry out the steps of the fault handling method according to any one of claims 1 to 6.
CN202210445990.4A 2022-04-26 2022-04-26 Fault processing method, system, computer device and readable storage medium Pending CN114741226A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210445990.4A CN114741226A (en) 2022-04-26 2022-04-26 Fault processing method, system, computer device and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210445990.4A CN114741226A (en) 2022-04-26 2022-04-26 Fault processing method, system, computer device and readable storage medium

Publications (1)

Publication Number Publication Date
CN114741226A true CN114741226A (en) 2022-07-12

Family

ID=82283752

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210445990.4A Pending CN114741226A (en) 2022-04-26 2022-04-26 Fault processing method, system, computer device and readable storage medium

Country Status (1)

Country Link
CN (1) CN114741226A (en)

Similar Documents

Publication Publication Date Title
CN109639450B (en) Fault alarm method, system, computer equipment and medium based on neural network
CN112052111B (en) Processing method, device and equipment for server abnormity early warning and storage medium
EP1895376A2 (en) Dynamic maintenance management system
CN109918279B (en) Electronic device, method for identifying abnormal operation of user based on log data and storage medium
CN110069925B (en) Software monitoring method, system and computer readable storage medium
CN113516244A (en) Intelligent operation and maintenance method and device, electronic equipment and storage medium
CN112488484A (en) Personnel reliability evaluation method, system, computer equipment and storage medium
CN110069382B (en) Software monitoring method, server, terminal device, computer device and medium
CN114741226A (en) Fault processing method, system, computer device and readable storage medium
CN111124805A (en) Data acquisition method, device, equipment and storage medium
CN115794545A (en) Automatic processing method of operation and maintenance data and related equipment thereof
CN112131090B (en) Service system performance monitoring method, device, equipment and medium
CN114371980A (en) Call link performance monitoring method and device, computer equipment and storage medium
CN114415559A (en) Equipment linkage method and device
CN112561385A (en) Risk monitoring method and system
CN112434079A (en) Secondary equipment abnormity discrimination decision method and device based on big data
CN114579347B (en) Page abnormity detection method and device, computer equipment and readable storage medium
CN116841792B (en) Application program development fault repairing method
CN114003248B (en) Model management method and device, electronic equipment and storage medium
CN113986698A (en) Communication log quantity diagnosis method, device and storage medium
CN111224861B (en) Method, system, equipment and storage medium for opening instant message service
US20140200688A1 (en) System and method for distributing and exchanging elements for planning and/or for operating automation operating equipment
CN117806946A (en) Consistency detection method and system for power grid monitoring system
CN117149639A (en) Test method and device of vehicle-mounted system, electronic equipment and storage medium
CN117744978A (en) Patrol task scheduling method and device, electronic equipment and nonvolatile storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination