CN112686644A - Project operation state monitoring method, system, equipment and storage medium - Google Patents

Project operation state monitoring method, system, equipment and storage medium Download PDF

Info

Publication number
CN112686644A
CN112686644A CN202110043307.XA CN202110043307A CN112686644A CN 112686644 A CN112686644 A CN 112686644A CN 202110043307 A CN202110043307 A CN 202110043307A CN 112686644 A CN112686644 A CN 112686644A
Authority
CN
China
Prior art keywords
project
current
alarm
item
monitoring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110043307.XA
Other languages
Chinese (zh)
Inventor
陈跃强
汪小涛
许兴
高晶
蔡利伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yonghui Yunjin Technology Co ltd
Original Assignee
Yonghui Yunjin Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yonghui Yunjin Technology Co ltd filed Critical Yonghui Yunjin Technology Co ltd
Priority to CN202110043307.XA priority Critical patent/CN112686644A/en
Publication of CN112686644A publication Critical patent/CN112686644A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention provides a project operation state monitoring method, a system, equipment and a storage medium, wherein the method comprises the following steps: collecting dependency information and configuration files in a current project, and storing the dependency information and the configuration files in a database, wherein the dependency information comprises the dependency project of the current project, and the configuration files comprise time waiting step lengths; starting the current project according to the dependency information and the configuration file, and monitoring the running state of the current project; and when the abnormal operation state of the current project is detected, sending alarm information according to a preset alarm rule. According to the invention, because the dependent relation exists between the projects, the operation can be performed in sequence according to the dependent relation, and each project can be monitored and alarmed independently, and the abnormal project can be accurately confirmed, so that management personnel can process the abnormal project accurately and timely, and the working efficiency is improved.

Description

Project operation state monitoring method, system, equipment and storage medium
Technical Field
The invention relates to the technical field of data management, in particular to a project operation state monitoring method, a system, equipment and a storage medium.
Background
With the development of society, the informatization process is faster and faster, so that the information data volume is larger and larger. The information industry therefore has to undertake the task of data calculation, which is accumulated in multiples, most of which are run in batches late at night. In this process, each computing task is generally divided into different categories, and encapsulated into each task, but there is no association between tasks, for example: the task A is a data acquisition function, the task B is a data calculation function, the tasks A, B are packaged together, and the task B needs to be executed after the task A is completed.
Since A, B tasks are packaged together, once an exception occurs, an alarm message is generated, and A, B tasks need to be detected separately to be able to identify the exception. If the number of the tasks packaged together is large, all the tasks need to be detected in sequence, and the abnormal tasks can be identified, so that the workload is large, and the working efficiency is low.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a method, a system, a device and a storage medium for monitoring a project operating state.
A project operation state monitoring method comprises the following steps: collecting dependency information and configuration files in a current project, and storing the dependency information and the configuration files in a database, wherein the dependency information comprises the dependency project of the current project, and the configuration files comprise time waiting step lengths; starting the current project according to the dependency information and the configuration file, and monitoring the running state of the current project; and when the abnormal operation state of the current project is detected, sending alarm information according to a preset alarm rule.
In one embodiment, the configuration file further includes an account number, a password, a session ID, a dependent project name, a time waiting step, a longest waiting duration, a maximum number of waiting rounds, a maximum number of reboots, and a project failure tolerance level.
In one embodiment, the starting the current project according to the dependency information and the configuration file, and monitoring the running state of the current project specifically include: inquiring the running state of the current item according to the time waiting step length, and acquiring the monitoring time of the current item; presetting a monitoring duration threshold, and entering a state response when the monitoring time exceeds the monitoring duration threshold or the running state of the current project is successful.
In one embodiment, the status response specifically includes: if the running state of the current project is successful, executing the next project through the current project; if the running state of the current project is failure, rejecting the current project, and calling an alarm rule to send alarm information; if the running state of the current item is overtime and the current item is a necessary dependent item of the next item, the overtime response is determined.
In one embodiment, after determining that the current item is a dependent item of a next item and the running status of the current item is timeout, the method further includes: according to the content of the configuration file, executing continuous waiting operation or restarting operation on the current project; if the current project is subjected to continuous waiting operation, the number of waiting rounds cannot exceed the maximum waiting round number, if the number of waiting rounds exceeds the maximum waiting round number, the current project is ended, and an alarm is given according to the alarm rule; if the current project is restarted, the restarting frequency does not exceed the maximum restarting frequency, if the restarting frequency exceeds the maximum restarting frequency, the current project is ended, and an alarm is given according to the alarm rule.
In one embodiment, the alarm rule specifically includes: pre-adding addressees after the item fails and alarm numbers of the addressees after the item is overtime in a short message alarm interface of a configuration file or a network page; and when the abnormal triggering alarm exists in the project operation state, acquiring alarm information, packaging the alarm information, and sending the alarm information to a terminal corresponding to the alarm number.
A project operating condition monitoring system, comprising: the information acquisition module is used for acquiring the dependency information and the configuration file in the current project and storing the dependency information and the configuration file in a database, wherein the dependency information comprises the dependency project of the current project, and the configuration file comprises a time waiting step; the state monitoring module is used for starting the current project according to the dependency information and the configuration file and monitoring the running state of the current project; and the alarm module is used for sending alarm information according to a preset alarm rule when the abnormal operation state of the current project is monitored.
An apparatus comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of a method for monitoring a status of an operation of a project as described in the various embodiments above when executing the program.
A storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of a method for monitoring a status of operation of a project as described in the various embodiments above.
Compared with the prior art, the invention has the advantages and beneficial effects that: the project and the project have dependency relationships, can be operated in sequence according to the dependency relationships, can realize independent monitoring and alarming of each project, accurately confirms the project generating abnormal operation state, is convenient for management personnel to perform accurate and timely processing, and improves working efficiency.
Drawings
FIG. 1 is a schematic flow chart of a method for monitoring a project operating condition according to an embodiment;
FIG. 2 is a schematic diagram of a system for monitoring a status of a project operation in accordance with an embodiment;
fig. 3 is a schematic diagram of the internal structure of the apparatus in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings by way of specific embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In one embodiment, as shown in fig. 1, there is provided a project operation state monitoring method, including the steps of:
step S101, collecting dependency information and configuration files in the current project, storing the dependency information and the configuration files in a database, wherein the dependency information comprises the dependency project of the current project, and the configuration files comprise time waiting step lengths.
Specifically, the project is performed in the scheduling system, and before the current project is started, the dependency information and the configuration file in the current project are acquired and stored in the database for later use.
The dependency information comprises a dependent item and a depended item which have a dependency relationship with the current item, and the current item can be started after the execution of the dependent item is finished; after the execution of the current project is completed, the dependent project can be started. Of course, when the depended item includes another dependent item, the depended item needs to be started after all the dependent items of the depended item are completed.
The configuration file comprises a time waiting step, and also comprises parameters such as an account number, a password, a session ID, a dependent project name, the time waiting step, the longest waiting time, the maximum waiting round number, the maximum restarting number and the like.
Specifically, whether the execution of the dependent item is completed or not can be confirmed according to the name of the dependent item, and the current item is started after the completion of the execution is confirmed; and if the dependent item is not executed, waiting for the execution of the dependent item to be completed.
Specifically, the longest waiting duration may be an upper limit of the number of time waiting steps, and after the number of times of querying the running state of the current item according to the time waiting steps exceeds the longest waiting duration, the current item is determined as an overtime response, and the step S103 is performed.
Specifically, the scheduling system can be logged in according to the session ID, and after the account number and the password are verified to be correct, the session ID is registered in the scheduling system and connected with the scheduling system, so that the running state of the project can be monitored in real time.
And S102, starting the current project according to the dependency information and the configuration file, and monitoring the running state of the current project.
Specifically, after the connection with the scheduling system is established according to the configuration file, the current project is started according to the dependency information, the current project can be a project in which the execution of the initial project or the dependency project is completed, and the running state of the current project is monitored.
In the actual operation process of the project, threads with the same number as the dependent projects can be started according to the dependent information, the operation state of each dependent project is continuously monitored, the state of a dependent task can be inquired every other time of waiting for step length according to the content configured by the configuration file, and a state response stage is entered when the monitoring time is overtime or the project is successfully operated; if the operation failure of the project is monitored, the dependent project is required to be started to enter a state response stage after being successfully executed.
And step S103, when the abnormal operation state of the current project is monitored, sending alarm information according to a preset alarm rule.
Specifically, when it is detected that the running state of the current item is abnormal, for example, running overtime or running failure, the warning information may be sent according to a preset warning rule, so that a manager can perform timely processing conveniently.
In the embodiment, the dependency information and the configuration file in the current project are collected, the dependency information and the configuration file are stored in the database, the current project is started according to the dependency information and the configuration file, the running state of the current project is detected, when the running state of the current project is detected to be abnormal, the warning information is sent according to the preset warning rule, each project can be monitored independently and continuously, the project with the abnormal running state is accurately confirmed, management personnel can perform accurate and timely processing, and the working efficiency is improved.
Wherein, step S102 specifically includes: inquiring the running state of the current item according to the time waiting step length, and acquiring the monitoring time of the current item; and entering a state response when the monitoring time is overtime or the running state of the current project is successful.
Specifically, the running state of the current item is continuously queried according to the time waiting step length, the running state needs to be queried once every other time waiting step length, and the monitoring time of the current item is obtained; and presetting a monitoring time length threshold, and entering a state response stage when the monitoring time exceeds the monitoring time length threshold or the running state of the current project is monitored to be successful.
Wherein the status response specifically includes: if the running state of the current project is successful, executing the next project through the current project; if the running state of the current project is failure, rejecting the current project, and calling an alarm rule to send alarm information; if the running state of the current item is overtime and the current item is a necessary dependent item of the next item, the overtime response is determined.
Specifically, after the timeout response is determined, the method further comprises the following steps: according to the content of the configuration file, continuously waiting or restarting the current project; if the current project is subjected to continuous waiting operation, the number of waiting rounds cannot exceed the maximum waiting round number, if the number of waiting rounds exceeds the maximum waiting round number, the current project is ended, and an alarm is given according to an alarm rule; if the current project is restarted, the restarting frequency does not exceed the maximum restarting frequency, if the restarting frequency exceeds the maximum restarting frequency, the current project is ended, and an alarm is given according to an alarm rule.
Wherein, the alarm rule specifically is: pre-adding addressees after the item fails and alarm numbers of the addressees after the item is overtime in a short message alarm interface of a configuration file or a network page; and when the abnormal triggering alarm exists in the project operation state, acquiring alarm information, packaging the alarm information, and sending the alarm information to a terminal corresponding to the alarm number.
Specifically, when the alarm is given by the network page, a short message alarm interface needs to be added on the basis of the original network page, and the short message interface comprises an alarm number of the addressee after the item fails and an alarm number of the addressee after the item is overtime. And after the interface is successfully added, when an abnormal triggering alarm exists in the operation state of the project, acquiring alarm information, packaging the alarm information into a short message, and sending the short message to a terminal corresponding to the alarm number.
Wherein, when a plurality of alarm numbers need to be transmitted, the alarm numbers need to be separated by commas.
Specifically, the alarm number may also be a mailbox number or a micro signal, and the alarm information is sent by means of a mail or a micro message.
Specifically, when an alarm is given by transmitting parameters through a configuration file, alarm numbers of an addressee after an item fails to be added and an addressee after an item is overtime need to be added in the configuration file of each item, when the configuration file is uploaded to a corresponding item, the current content of the configuration file is firstly analyzed according to a keyword-value mode to obtain the alarm numbers, when an alarm is triggered abnormally in the operating state of the item, alarm information is obtained, the alarm information is packaged into a short message, and the short message is sent to a terminal corresponding to the alarm numbers.
As shown in fig. 2, there is provided a project operating condition monitoring system 20, including: information acquisition module 21, state monitoring module 22 and alarm module 23, wherein:
the information acquisition module 21 is configured to acquire dependency information and configuration files in a current project, store the dependency information and the configuration files in a database, where the dependency information includes a dependency project of the current project, and the configuration files include a time waiting step;
the state monitoring module 22 is used for starting the current project according to the dependency information and the configuration file and monitoring the running state of the current project;
and the alarm module 23 is configured to send alarm information according to a preset alarm rule when it is monitored that the operating state of the current item is abnormal.
In one embodiment, condition monitoring module 22 is further configured to: inquiring the running state of the current item according to the time waiting step length, and acquiring the monitoring time of the current item; and presetting a monitoring duration threshold, and entering a state response when the monitoring time exceeds the monitoring duration threshold or the running state of the current project is successful.
If the running state of the current project is successful, executing the next project through the current project; if the running state of the current project is failure, rejecting the current project, and calling an alarm rule to send alarm information; if the running state of the current item is overtime and the current item is a necessary dependent item of the next item, the overtime response is determined.
In one embodiment, condition monitoring module 22 is further configured to: according to the content of the configuration file, executing continuous waiting operation or restarting operation on the current project; if the current project is subjected to continuous waiting operation, the number of waiting rounds cannot exceed the maximum waiting round number, if the number of waiting rounds exceeds the maximum waiting round number, the current project is ended, and an alarm is given according to an alarm rule; if the current project is restarted, the restarting frequency does not exceed the maximum restarting frequency, if the restarting frequency exceeds the maximum restarting frequency, the current project is ended, and an alarm is given according to an alarm rule.
In one embodiment, the alert module 23 is further configured to: pre-adding addressees after the item fails and alarm numbers of the addressees after the item is overtime in a short message alarm interface of a configuration file or a network page; and when the abnormal triggering alarm exists in the project operation state, acquiring alarm information, packaging the alarm information, and sending the alarm information to a terminal corresponding to the alarm number.
In one embodiment, a device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 3. The device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the device is configured to provide computing and control capabilities. The memory of the device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the device is used for storing configuration templates and also can be used for storing target webpage data. The network interface of the device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method of monitoring a state of operation of a project.
Those skilled in the art will appreciate that the configuration shown in fig. 3 is a block diagram of only a portion of the configuration associated with the present application and does not constitute a limitation on the devices to which the present application may be applied, and that a particular device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a storage medium may also be provided, the storage medium storing a computer program comprising program instructions which, when executed by a computer, may be part of a project operating condition monitoring system of the kind mentioned above, cause the computer to perform the method of the preceding embodiment.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
It will be apparent to those skilled in the art that the modules or steps of the invention described above may be implemented in a general purpose computing device, they may be centralized on a single computing device or distributed across a network of computing devices, and optionally they may be implemented in program code executable by a computing device, such that they may be stored on a computer storage medium (ROM/RAM, magnetic disks, optical disks) and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The foregoing is a more detailed description of the present invention that is presented in conjunction with specific embodiments, and the practice of the invention is not to be considered limited to those descriptions. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.

Claims (9)

1. A project operation state monitoring method is characterized by comprising the following steps:
collecting dependency information and configuration files in a current project, and storing the dependency information and the configuration files in a database, wherein the dependency information comprises the dependency project of the current project, and the configuration files comprise time waiting step lengths;
starting the current project according to the dependency information and the configuration file, and monitoring the running state of the current project;
and when the abnormal operation state of the current project is detected, sending alarm information according to a preset alarm rule.
2. The method for monitoring the operating state of the project according to claim 1, wherein the configuration file further comprises an account number, a password, a session ID, a dependent project name, a time waiting step, a longest waiting duration, a maximum number of waiting rounds, and a maximum number of reboots.
3. The method for monitoring the operating state of a project according to claim 2, wherein the starting the current project according to the dependency information and the configuration file and monitoring the operating state of the current project specifically comprise:
inquiring the running state of the current item according to the time waiting step length, and acquiring the monitoring time of the current item;
presetting a monitoring duration threshold, and entering a state response when the monitoring time exceeds the monitoring duration threshold or the running state of the current project is successful.
4. The method for monitoring the operating state of the project according to claim 3, wherein the state response specifically comprises: if the running state of the current project is successful, executing the next project through the current project; if the running state of the current project is failure, rejecting the current project, and calling an alarm rule to send alarm information; if the running state of the current item is overtime and the current item is a necessary dependent item of the next item, the overtime response is determined.
5. The method of claim 4, wherein after determining that the current item is a timeout response if the current item is a dependent item of the next item and the current item is a dependent item of the next item, the method further comprises:
according to the content of the configuration file, executing continuous waiting operation or restarting operation on the current project;
if the current project is subjected to continuous waiting operation, the number of waiting rounds cannot exceed the maximum waiting round number, if the number of waiting rounds exceeds the maximum waiting round number, the current project is ended, and an alarm is given according to the alarm rule;
if the current project is restarted, the restarting frequency does not exceed the maximum restarting frequency, if the restarting frequency exceeds the maximum restarting frequency, the current project is ended, and an alarm is given according to the alarm rule.
6. The method for monitoring the operation state of the project according to claim 1, wherein the alarm rule is specifically as follows:
pre-adding addressees after the item fails and alarm numbers of the addressees after the item is overtime in a short message alarm interface of a configuration file or a network page; and when the abnormal triggering alarm exists in the project operation state, acquiring alarm information, packaging the alarm information, and sending the alarm information to a terminal corresponding to the alarm number.
7. A project operating condition monitoring system, comprising:
the information acquisition module is used for acquiring the dependency information and the configuration file in the current project and storing the dependency information and the configuration file in a database, wherein the dependency information comprises the dependency project of the current project, and the configuration file comprises a time waiting step;
the state monitoring module is used for starting the current project according to the dependency information and the configuration file and monitoring the running state of the current project;
and the alarm module is used for sending alarm information according to a preset alarm rule when the abnormal operation state of the current project is monitored.
8. An apparatus comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 6 are implemented when the computer program is executed by the processor.
9. A storage medium having a computer program stored thereon, the computer program, when being executed by a processor, realizing the steps of the method of any one of claims 1 to 6.
CN202110043307.XA 2021-01-13 2021-01-13 Project operation state monitoring method, system, equipment and storage medium Pending CN112686644A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110043307.XA CN112686644A (en) 2021-01-13 2021-01-13 Project operation state monitoring method, system, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110043307.XA CN112686644A (en) 2021-01-13 2021-01-13 Project operation state monitoring method, system, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN112686644A true CN112686644A (en) 2021-04-20

Family

ID=75457755

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110043307.XA Pending CN112686644A (en) 2021-01-13 2021-01-13 Project operation state monitoring method, system, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112686644A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114090109A (en) * 2021-09-30 2022-02-25 安胜(天津)飞行模拟系统有限公司 Starting method of flight simulator

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114090109A (en) * 2021-09-30 2022-02-25 安胜(天津)飞行模拟系统有限公司 Starting method of flight simulator

Similar Documents

Publication Publication Date Title
CN110661659B (en) Alarm method, device and system and electronic equipment
CN108572907B (en) Alarm method, alarm device, electronic equipment and computer readable storage medium
CN110888783B (en) Method and device for monitoring micro-service system and electronic equipment
CN106657387A (en) Intelligent centralized air-traffic-control automation monitoring system
CN111897671A (en) Failure recovery method, computer device, and storage medium
CN109995612B (en) Service inspection method and device and electronic equipment
CN112446511A (en) Fault handling method, device, medium and equipment
CN110674149B (en) Service data processing method and device, computer equipment and storage medium
CN112686644A (en) Project operation state monitoring method, system, equipment and storage medium
CN107885634B (en) Method and device for processing abnormal information in monitoring
CN111611057A (en) Distributed retry method, device, electronic equipment and storage medium
CN111082986A (en) Alarm notification method and device
CN114595075A (en) Network scheduling asynchronous task execution method based on distributed scheduling
CN116302989A (en) Pressure testing method and system, storage medium and computer equipment
CN113472881B (en) Statistical method and device for online terminal equipment
CN114650218B (en) Data acquisition method, device, system and storage medium
CN115168137A (en) Monitoring method and system for timing task, computer equipment and storage medium
CN114036032A (en) Real-time program monitoring method and device
CN115705259A (en) Fault processing method, related device and storage medium
CN113592108A (en) Charging fault management method of charging pile and related equipment
CN112416701A (en) Service data monitoring method and device, computer equipment and readable storage medium
CN107577546B (en) Information processing method and device and electronic equipment
CN111427698A (en) Azakban-based data synchronization method and device and computer equipment
CN110995500A (en) Node log management and control method, system and related components
CN111506446B (en) Interface fault detection method and server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination