CN114897372A - Task monitoring method, device, equipment and storage medium - Google Patents

Task monitoring method, device, equipment and storage medium Download PDF

Info

Publication number
CN114897372A
CN114897372A CN202210537940.9A CN202210537940A CN114897372A CN 114897372 A CN114897372 A CN 114897372A CN 202210537940 A CN202210537940 A CN 202210537940A CN 114897372 A CN114897372 A CN 114897372A
Authority
CN
China
Prior art keywords
task
execution plan
layer
tasks
key
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210537940.9A
Other languages
Chinese (zh)
Inventor
陈旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Property and Casualty Insurance Company of China Ltd
Original Assignee
Ping An Property and Casualty Insurance Company of China Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Property and Casualty Insurance Company of China Ltd filed Critical Ping An Property and Casualty Insurance Company of China Ltd
Priority to CN202210537940.9A priority Critical patent/CN114897372A/en
Publication of CN114897372A publication Critical patent/CN114897372A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0637Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/103Workflow collaboration or project management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services

Landscapes

  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Engineering & Computer Science (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Educational Administration (AREA)
  • Tourism & Hospitality (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Marketing (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Development Economics (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Game Theory and Decision Science (AREA)
  • Data Mining & Analysis (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention relates to the technical field of cloud computing, is applied to the field of smart cities, and discloses a task monitoring method, which comprises the following steps: acquiring a task dependency relationship table of a terminal task; generating a standard execution plan for the ending task according to the task dependency relationship table and the task operation time acquired in the historical time period; generating a dynamic execution plan for the ending task according to the task dependency relationship table and the currently acquired task operation time; comparing the dynamic execution plan with a standard execution plan to judge whether a mutation task exists; and if so, outputting information related to the mutation task as early warning information. Because all tasks do not need to be monitored independently, the full-link monitoring can be realized only by focusing on the peripheral tasks, and the monitoring configuration efficiency is improved. And by generating the dynamic execution plan in real time and monitoring the sudden change of the dynamic execution plan, the abnormal sudden change task can be quickly positioned, the event processing flow is promoted, and the monitoring in the task is realized so as to discover hidden dangers in advance.

Description

一种任务监控方法、装置、设备及存储介质A task monitoring method, device, equipment and storage medium

技术领域technical field

本发明涉及云计算技术领域,具体涉及一种任务监控方法、装置、设备及存储介质。The present invention relates to the technical field of cloud computing, in particular to a task monitoring method, device, equipment and storage medium.

背景技术Background technique

现有的任务监控方式一种是基于单个任务的时效监控,即当任务完成时间超过约定时间或中间任务完成时间超过紧后任务最迟开始时间时,触发告警;另一种是针对关键任务模块或者数据层整体任务进度进行监控,当有任务未在预设时间内完成时,触发告警。One of the existing task monitoring methods is based on the timeliness monitoring of a single task, that is, when the task completion time exceeds the agreed time or the intermediate task completion time exceeds the latest start time of the subsequent task, an alarm is triggered; the other is for key task modules. Or the overall task progress of the data layer is monitored, and an alarm is triggered when a task is not completed within the preset time.

然而,上述两种任务监控方式均属于偏事后的监控预警,一般为异常发生后触发,对于技术人员来说,更多的是应急方案的实施及资源的临时调度,因此现有任务监控方式不利于提前预警。However, the above two task monitoring methods belong to the monitoring and early warning after the event, which is generally triggered after an abnormality occurs. For technicians, it is more about the implementation of emergency plans and the temporary scheduling of resources. Therefore, the existing task monitoring methods are not sufficient. Useful for early warning.

发明内容SUMMARY OF THE INVENTION

本发明的目的是针对上述现有技术的不足提出的一种任务监控方法、装置、设备及存储介质,该目的是通过以下技术方案实现的。The purpose of the present invention is to propose a task monitoring method, device, device and storage medium for the deficiencies of the above-mentioned prior art, and the purpose is achieved through the following technical solutions.

本发明的第一方面提出了一种任务监控方法,所述方法包括:A first aspect of the present invention proposes a task monitoring method, the method comprising:

获取位于最低任务层中末梢任务的任务依赖关系表;Get the task dependency table of the stub tasks located in the lowest task layer;

根据所述任务依赖关系表和历史时间段内采集的任务运行时间,为所述末梢任务生成标准执行计划;generating a standard execution plan for the peripheral task according to the task dependency table and the task running time collected in the historical time period;

根据所述任务依赖关系表和当前采集的任务运行时间,为所述末梢任务生成动态执行计划;generating a dynamic execution plan for the peripheral task according to the task dependency table and the currently collected task running time;

将所述动态执行计划与所述标准执行计划进行比对,以判定所述动态执行计划中是否存在突变任务;Comparing the dynamic execution plan with the standard execution plan to determine whether there is a mutation task in the dynamic execution plan;

如果存在,则将与所述突变任务相关的信息作为预警信息输出。If it exists, the information related to the mutation task is output as early warning information.

在本申请的一些实施例中,所述根据所述任务依赖关系表和历史时间段内采集的任务运行时间,为所述末梢任务生成标准执行计划,包括:In some embodiments of the present application, generating a standard execution plan for the peripheral task according to the task dependency relationship table and the task running time collected in a historical time period includes:

针对每一任务层,从所述任务依赖关系表中获取位于该任务层的至少一个任务;根据历史时间段内采集的任务运行时间,从该至少一个任务中选择一个任务作为该任务层的关键任务;利用每一任务层的关键任务为所述末梢任务生成标准执行计划。For each task layer, obtain at least one task located in the task layer from the task dependency table; select a task from the at least one task as the key of the task layer according to the task running time collected in the historical time period Tasks; use the critical tasks of each task layer to generate standard execution plans for the peripheral tasks.

在本申请的一些实施例中,所述根据历史时间段内采集的任务运行时间,从该至少一个任务中选择一个任务作为该任务层的关键任务,包括:In some embodiments of the present application, selecting a task from the at least one task as a key task of the task layer according to the task running time collected in a historical time period includes:

根据历史时间段内采集的任务运行时间,确定每一任务的平均运行时间;选择最长平均运行时间对应的任务作为该任务层的关键任务。According to the task running time collected in the historical time period, the average running time of each task is determined; the task corresponding to the longest average running time is selected as the key task of the task layer.

在本申请的一些实施例中,所述根据所述任务依赖关系表和当前采集的任务运行时间,为所述末梢任务生成动态执行计划,包括:In some embodiments of the present application, generating a dynamic execution plan for the peripheral task according to the task dependency relationship table and the currently collected task running time includes:

针对每一任务层,从所述任务依赖关系表中获取位于该任务层的至少一个任务;根据当前采集的任务运行时间,从该至少一个任务中选择一个任务作为该任务层的关键任务;利用每一任务层的关键任务为所述末梢任务生成动态执行计划。For each task layer, obtain at least one task located in the task layer from the task dependency table; select a task from the at least one task as the key task of the task layer according to the currently collected task running time; use The critical tasks of each task layer generate dynamic execution plans for the peripheral tasks.

在本申请的一些实施例中,所述根据当前采集的任务运行时间,从该至少一个任务中选择一个任务作为该任务层的关键任务,包括:In some embodiments of the present application, selecting a task from the at least one task as the key task of the task layer according to the currently collected task running time includes:

选择当前采集的最长任务运行时间对应的任务作为该任务层的关键任务。Select the task corresponding to the longest task running time currently collected as the key task of the task layer.

在本申请的一些实施例中,所述将所述动态执行计划与所述标准执行计划进行比对,以判定所述动态执行计划中是否存在突变任务,包括:In some embodiments of the present application, comparing the dynamic execution plan with the standard execution plan to determine whether there is a mutation task in the dynamic execution plan includes:

将所述动态执行计划与所述标准执行计划中属于相同任务层的关键任务进行比对;如果比对不一致,则确定所述动态执行计划包含的属于该任务层的关键任务为突变任务。The dynamic execution plan is compared with the key tasks belonging to the same task layer in the standard execution plan; if the comparison is inconsistent, it is determined that the key tasks belonging to the task layer included in the dynamic execution plan are mutation tasks.

在本申请的一些实施例中,所述方法还包括:In some embodiments of the present application, the method further includes:

针对各任务层中的每一任务,获取该任务当前采集的任务运行时间与前一次采集的任务运行时间之间的时间差;如果所述时间差超过预设阈值,则将与该任务相关的信息作为预警信息输出。For each task in each task layer, obtain the time difference between the task running time currently collected for the task and the task running time collected last time; if the time difference exceeds a preset threshold, the information related to the task is used as Warning information output.

本发明的第二方面提出了一种任务监控装置,所述装置包括:A second aspect of the present invention provides a task monitoring device, the device comprising:

获取模块,用于获取位于最低任务层中末梢任务的任务依赖关系表;The acquisition module is used to acquire the task dependency table of the stub tasks located in the lowest task layer;

第一生成模块,用于根据所述任务依赖关系表和历史时间段内采集的任务运行时间,为所述末梢任务生成标准执行计划;a first generating module, configured to generate a standard execution plan for the peripheral task according to the task dependency table and the task running time collected in the historical time period;

第二生成模块,用于根据所述任务依赖关系表和当前采集的任务运行时间,为所述末梢任务生成动态执行计划;A second generation module, configured to generate a dynamic execution plan for the peripheral task according to the task dependency table and the currently collected task running time;

比对模块,用于将所述动态执行计划与所述标准执行计划进行比对,以判定所述动态执行计划中是否存在突变任务;a comparison module, configured to compare the dynamic execution plan with the standard execution plan to determine whether there is a mutation task in the dynamic execution plan;

预警模块,用于在判定存在突变任务时,将与所述突变任务相关的信息作为预警信息输出。The early warning module is used for outputting the information related to the mutation task as early warning information when it is determined that there is a mutation task.

本发明的第三方面提出了一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现如上述第一方面所述方法的步骤。A third aspect of the present invention provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor implementing the program as described in the first aspect above when the processor executes the program steps of the method described.

本发明的第四方面提出了一种计算机可读存储介质,其上存储有计算机程序,所述程序被处理器执行时实现如上述第一方面所述方法的步骤。A fourth aspect of the present invention provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the steps of the method described in the above-mentioned first aspect.

基于上述第一方面和第二方面所述的任务监控方法及装置,本发明至少具有如下有益效果或优点:Based on the task monitoring method and device described in the first aspect and the second aspect, the present invention has at least the following beneficial effects or advantages:

本发明集中在末梢任务上,结合历史执行数据和任务依赖关系表为末梢任务输出标准执行计划,并实时结合当前执行数据和任务依赖关系表为末梢任务输出动态执行计划,通过将标准执行计划与动态执行计划进行比对来发现突变任务,从而完成对相关任务的全链路监控。由于不再需要对所有任务进行单独评估监控,只需要集中于关注末梢任务,便可实现全链路监控,这样有利于快速达成一致的目标,提升监控配置效率。并且通过实时生成动态执行计划,监控动态执行计划突变,可快速定位异常突变任务,推动事件处理流程,实现任务事中监控,以提前发现隐患、规避风险。The invention focuses on the peripheral tasks, outputs a standard execution plan for the peripheral tasks in combination with the historical execution data and the task dependency table, and outputs a dynamic execution plan for the peripheral tasks in combination with the current execution data and the task dependency table in real time. The dynamic execution plan is compared to discover mutation tasks, so as to complete the full-link monitoring of related tasks. Since it is no longer necessary to individually evaluate and monitor all tasks, it is only necessary to focus on peripheral tasks to achieve full-link monitoring, which is conducive to quickly reaching a consensus goal and improving the efficiency of monitoring configuration. And by generating a dynamic execution plan in real time and monitoring the mutation of the dynamic execution plan, it can quickly locate abnormal mutation tasks, promote the event processing process, and realize in-process monitoring of tasks, so as to discover hidden dangers and avoid risks in advance.

本发明可以应用于智慧城市技术领域,从而推动智慧城市的建设。The invention can be applied to the technical field of smart cities, thereby promoting the construction of smart cities.

附图说明Description of drawings

此处所说明的附图用来提供对本发明的进一步理解,构成本发明的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The accompanying drawings described herein are used to provide further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached image:

图1为本发明根据一示例性实施例示出的一种任务监控方法的实施例流程图;1 is a flowchart of an embodiment of a task monitoring method according to an exemplary embodiment of the present invention;

图2为本发明根据一示例性实施例示出的一种任务监控装置的结构示意图;FIG. 2 is a schematic structural diagram of a task monitoring device according to an exemplary embodiment of the present invention;

图3为本发明根据一示例性实施例示出的一种电子设备的硬件结构示意图图;3 is a schematic diagram of a hardware structure of an electronic device according to an exemplary embodiment of the present invention;

图4为本发明根据一示例性实施例示出的一种存储介质的结构示意图。FIG. 4 is a schematic structural diagram of a storage medium according to an exemplary embodiment of the present invention.

具体实施方式Detailed ways

这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本发明相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本发明的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of the invention as recited in the appended claims.

在本发明使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本发明。在本发明和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。The terminology used in the present invention is for the purpose of describing particular embodiments only and is not intended to limit the present invention. As used in this specification and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

应当理解,尽管在本发明可能采用术语第一、第二、第三等来描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如,在不脱离本发明范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。取决于语境,如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”。It should be understood that although the terms first, second, third, etc. may be used in the present invention to describe various information, such information should not be limited by these terms. These terms are only used to distinguish the same type of information from each other. For example, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information, without departing from the scope of the present invention. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determining."

大数据经营分析平台为管理者提供指标看板及归因分析等数据,指标数据依赖的数据加工任务,按照既定的依赖关系进行任务编排及调度执行,每个任务涉及的上游依赖任务多达数百个,因此对于任务运行时效的监控尤其关键。The big data business analysis platform provides managers with data such as indicator dashboards and attribution analysis. The data processing tasks that the indicator data depends on are arranged and scheduled for execution according to the established dependencies. Each task involves hundreds of upstream dependent tasks. Therefore, the monitoring of task runtime is especially critical.

在大数据经营分析平台中,所有任务主要分属于三个数据层:操作性数据仓库层(ODS)、数据仓库层(DW)、以及数据集市层(DM)。每一数据层级由若干个同类型任务构成。In the big data business analysis platform, all tasks mainly belong to three data layers: operational data warehouse layer (ODS), data warehouse layer (DW), and data mart layer (DM). Each data level consists of several tasks of the same type.

现有技术中任务监控模式都是基于各数据层自定义的任务关键级别展开,各数据层主要维护自己的监控体系,缺乏各数据层任务间的串联,也无法准确评估依赖数据层的关联影响,造成数据层间的任务关键等级及保障力度无法达成统一,并且也不利于提前预警。The task monitoring modes in the prior art are based on the key levels of tasks defined by each data layer. Each data layer mainly maintains its own monitoring system, lacks the connection between tasks of each data layer, and cannot accurately evaluate the impact of dependencies on the data layer. , resulting in the inability to unify the mission-critical level and security between the data layers, and it is also not conducive to early warning.

为解决上述技术问题,本发明提出一种任务监控方法,本发明不再集中在某个关键任务、关键模块或者数据层级,而是集中在末梢任务上,即结合历史执行数据和任务依赖关系表为末梢任务输出标准执行计划,并实时结合当前执行数据和任务依赖关系表为末梢任务输出动态执行计划,通过将标准执行计划与动态执行计划进行比对来发现突变任务,从而完成对相关任务的全链路监控。由于不再需要对所有任务进行单独评估监控,只需要集中于关注末梢任务,便可实现全链路监控,这样有利于快速达成一致的目标,提升监控配置效率。并且通过实时生成动态执行计划,监控动态执行计划突变,可快速定位异常突变任务,推动事件处理流程,实现任务事中监控,以提前发现隐患、规避风险。In order to solve the above technical problems, the present invention proposes a task monitoring method. The present invention no longer focuses on a certain key task, key module or data level, but on peripheral tasks, that is, combining historical execution data and task dependency table. Output standard execution plans for peripheral tasks, and output dynamic execution plans for peripheral tasks combined with current execution data and task dependency table in real time. By comparing the standard execution plan with the dynamic execution plan, mutation tasks are found, and the related tasks are completed. Full link monitoring. Since it is no longer necessary to individually evaluate and monitor all tasks, it is only necessary to focus on peripheral tasks to achieve full-link monitoring, which is conducive to quickly reaching a consensus goal and improving the efficiency of monitoring configuration. And by generating a dynamic execution plan in real time and monitoring the mutation of the dynamic execution plan, it can quickly locate abnormal mutation tasks, promote the event processing process, and realize in-process monitoring of tasks, so as to discover hidden dangers and avoid risks in advance.

为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。In order to make those skilled in the art better understand the solutions of the present application, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application.

实施例一:Example 1:

图1为本发明根据一示例性实施例示出的一种任务监控方法的实施例流程图,所述任务监控方法可以应用在计算机设备上,所述计算机设备可以是终端设备、移动终端、PC机、服务器等设备,如图1所示,所述任务监控方法包括如下步骤:FIG. 1 is a flowchart of an embodiment of a task monitoring method according to an exemplary embodiment of the present invention. The task monitoring method can be applied to a computer device, and the computer device can be a terminal device, a mobile terminal, or a PC. , server and other equipment, as shown in Figure 1, the task monitoring method includes the following steps:

步骤101:获取位于最低任务层中末梢任务的任务依赖关系表。Step 101: Obtain the task dependency table of the stub tasks located in the lowest task layer.

其中,任务依赖关系表为预先根据任务执行网络图为位于最低任务层中的末梢任务建立的,其中记录有末梢任务的上游依赖任务的相关信息,这些上游依赖任务被划分到其他任务层。Among them, the task dependency table is established in advance for the peripheral tasks located in the lowest task layer according to the task execution network graph, and records the relevant information of the upstream dependent tasks of the peripheral tasks, and these upstream dependent tasks are divided into other task layers.

例如,以末梢任务所属的最低任务层为第一层L0为例,末梢任务的直接上游依赖任务属于第二层L1,且第二层L1可能包含1-N个任务,第二层L1中的所有任务也有其自身上游依赖任务(属于末梢任务的间接上游依赖任务),且分离为多条新的任务分支。For example, taking the first layer L0 as the lowest task layer to which the peripheral task belongs, the direct upstream dependent tasks of the peripheral task belong to the second layer L1, and the second layer L1 may contain 1-N tasks. All tasks also have their own upstream dependent tasks (indirect upstream dependent tasks belonging to stub tasks), and are separated into multiple new task branches.

步骤102:根据任务依赖关系表和历史时间段内采集的任务运行时间,为所述末梢任务生成标准执行计划。Step 102: Generate a standard execution plan for the peripheral task according to the task dependency relationship table and the task running time collected in the historical time period.

可选的,历史时间段内采集的任务运行时间可以是过去一周内采集到的任务运行时间。Optionally, the task running time collected in the historical time period may be the task running time collected in the past week.

在一种可能的实现方式中,可以针对每一任务层,从任务依赖关系表中获取位于该任务层的至少一个任务,根据历史时间段内采集的任务运行时间,从该至少一个任务中选择一个任务作为该任务层的关键任务,然后利用每一任务层的关键任务为末梢任务生成一个标准执行计划。In a possible implementation manner, for each task layer, at least one task located in the task layer may be obtained from the task dependency table, and selected from the at least one task according to the task running time collected in the historical time period. A task is regarded as the key task of the task layer, and then a standard execution plan is generated for the peripheral task using the key task of each task layer.

其中,标准执行计划表示的是末梢任务的平均执行情况,反映了末梢任务的各个上游依赖任务过去一段时间的平均执行情况。Among them, the standard execution plan represents the average execution of the peripheral tasks, and reflects the average execution of each upstream dependent task of the peripheral tasks in the past period of time.

具体地,对于利用每一任务层的关键任务为末梢任务生成标准执行计划的过程,将每一任务层的关键任务的标签和任务层编号拼接在一起后按照任务层依赖顺序依次拼接生成标准执行计划。Specifically, for the process of using the key tasks of each task layer to generate a standard execution plan for peripheral tasks, the labels of the key tasks of each task layer and the task layer number are spliced together and then spliced together according to the task layer dependency order to generate the standard execution plan. plan.

举例说明,假设每一任务层中的任务以字母进行标签表示,每一任务层以数字进行编号表示,生成的标准执行计划示例为:1A2A3D4A5C6A7A8B9C10D11A,表示该末梢任务的上游依赖任务所属的任务层有11层,第1层的关键任务为A,第2层的关键任务为A,第3层的关键任务为D,第4层的关键任务为A,第5层的关键任务为C,第6层的关键任务为A,第7层的关键任务为A,第8层的关键任务为B,第9层的关键任务为C,第10层的关键任务为D,第11层的关键任务为A。For example, assuming that the tasks in each task layer are labeled with letters, and each task layer is numbered with numbers, the generated standard execution plan example is: 1A2A3D4A5C6A7A8B9C10D11A, indicating that the task layer to which the upstream dependent task of the peripheral task belongs has 11 layers, the key task of layer 1 is A, the key task of layer 2 is A, the key task of layer 3 is D, the key task of layer 4 is A, the key task of layer 5 is C, the key task of layer 6 is C The key task of layer is A, the key task of layer 7 is A, the key task of layer 8 is B, the key task of layer 9 is C, the key task of layer 10 is D, the key task of layer 11 is A.

需要补充说明的是,任务执行网络中位于最低任务层的末梢任务可能不止一个任务,在本发明中需要为每个末梢任务单独生成一个标准执行计划,并同时记录下该标准执行计划的生成日期。It should be added that there may be more than one stub task located at the lowest task layer in the task execution network. In the present invention, a standard execution plan needs to be separately generated for each stub task, and the generation date of the standard execution plan is recorded at the same time. .

在一种可能的实现方式中,针对根据历史时间段内采集的任务运行时间,从该至少一个任务中选择一个任务作为该任务层的关键任务的过程,可以根据历史时间段内采集的任务运行时间,确定每一任务的平均运行时间,并选择最长平均运行时间对应的任务作为该任务层的关键任务。In a possible implementation manner, for the process of selecting a task from the at least one task as the key task of the task layer according to the task running time collected in the historical time period, the process of selecting a task as the key task of the task layer may be based on the task running time collected in the historical time period. time, determine the average running time of each task, and select the task corresponding to the longest average running time as the key task of the task layer.

其中,通过计算平均运行时间可以表示任务运行的平均耗时情况,平均运行时间越短说明该任务运行的耗时情况比较短,平均运行时间越长说明该任务运行的耗时情况比较长,在正常情况下,属于同一任务层中的任务执行耗时比较平均,通过选择最长平均耗时可以确保本任务层所有任务均执行完成。Among them, the average running time of the task can be represented by calculating the average running time. The shorter the average running time is, the shorter the running time of the task is, and the longer the average running time is, the longer the running time of the task is. Under normal circumstances, the execution time of tasks belonging to the same task layer is relatively average. By selecting the longest average time consumption, it can be ensured that all tasks in this task layer are executed.

步骤103:根据任务依赖关系表和当前采集的任务运行时间,为所述末梢任务生成动态执行计划。Step 103: Generate a dynamic execution plan for the peripheral task according to the task dependency relationship table and the currently collected task running time.

其中,当前采集的任务运行时间为最近一次采集到的任务运行时间。The currently collected task running time is the most recently collected task running time.

在一种可能的实现方式中,针对每一任务层,从任务依赖关系表中获取位于该任务层的至少一个任务,并根据当前采集的任务运行时间,从该至少一个任务中选择一个任务作为该任务层的关键任务,然后利用每一任务层的关键任务为末梢任务生成动态执行计划。In a possible implementation manner, for each task layer, at least one task located in the task layer is obtained from the task dependency table, and according to the currently collected task running time, one task is selected from the at least one task as the The key tasks of the task layer are then used to generate dynamic execution plans for peripheral tasks using the key tasks of each task layer.

其中,动态执行计划表示的是末梢任务的实时执行情况,反映了末梢任务的各个上游依赖任务实时执行情况。Among them, the dynamic execution plan represents the real-time execution of the peripheral task, and reflects the real-time execution of each upstream dependent task of the peripheral task.

具体地,对于利用每一任务层的关键任务为末梢任务生成动态执行计划的过程,将每一任务层的关键任务的标签和任务层编号拼接在一起后,按照任务层依赖顺序依次拼接生成动态执行计划。Specifically, for the process of using the key tasks of each task layer to generate dynamic execution plans for peripheral tasks, after splicing together the labels of the key tasks of each task layer and the task layer number, the dynamic execution plan is generated by splicing in the order of task layer dependencies. Implementation plan.

举例说明,假设生成的动态执行计划示例为:1A2C3D4A5C6A7A8B9C10D11A,表示该末梢任务的上游依赖任务所属的任务层有11层,第1层的关键任务为A,第2层的关键任务为C,第3层的关键任务为D,第4层的关键任务为A,第5层的关键任务为C,第6层的关键任务为A,第7层的关键任务为A,第8层的关键任务为B,第9层的关键任务为C,第10层的关键任务为D,第11层的关键任务为A。For example, suppose the generated dynamic execution plan example is: 1A2C3D4A5C6A7A8B9C10D11A, indicating that the upstream dependent tasks of the peripheral task belong to 11 task layers, the key task of the first layer is A, the key task of the second layer is C, and the third layer is the key task of the third layer. The key task of layer is D, the key task of layer 4 is A, the key task of layer 5 is C, the key task of layer 6 is A, the key task of layer 7 is A, the key task of layer 8 is B, the key task of layer 9 is C, the key task of layer 10 is D, and the key task of layer 11 is A.

需要补充说明的是,任务执行网络中位于最低任务层的末梢任务可能不止一个任务,在本发明中也需要为每个末梢任务单独生成一个动态执行计划,并同时记录下该动态执行计划的生成时间。It should be added that there may be more than one task at the end task located at the lowest task layer in the task execution network. In the present invention, it is also necessary to generate a dynamic execution plan for each end task separately, and record the generation of the dynamic execution plan at the same time. time.

在一种可能的实现方式中,针对根据当前采集的任务运行时间,从该至少一个任务中选择一个任务作为该任务层的关键任务的过程,可以选择当前采集的最长任务运行时间对应的任务作为该任务层的关键任务。In a possible implementation manner, for the process of selecting a task from the at least one task as the key task of the task layer according to the currently collected task running time, the task corresponding to the currently collected longest task running time may be selected as the key task of this task layer.

其中,选择最长任务运行时间的任务作为关键任务,说明当前任务运行过程中该关键任务属于最影响任务运行时效的任务。Among them, the task with the longest task running time is selected as the key task, indicating that the key task in the current task running process belongs to the task that most affects the task running time.

需要补充说明的是,通过每隔一定时间间隔执行一次动态执行计划的生成过程,以实时对任务运行情况进行监控,提前发现异常突变任务,及时解决问题。It should be added that by executing the generation process of the dynamic execution plan at regular intervals, the task operation can be monitored in real time, abnormal mutation tasks can be detected in advance, and problems can be solved in time.

步骤104:将动态执行计划与标准执行计划进行比对,以判定动态执行计划中是否存在突变任务。Step 104: Compare the dynamic execution plan with the standard execution plan to determine whether there is a mutation task in the dynamic execution plan.

其中,突变任务表示该任务可能出现耗时突增,任务僵死等异常情况。Among them, the mutation task indicates that the task may have abnormal conditions such as sudden increase in time consumption and task death.

在一可选的实施例中,通过将动态执行计划与标准执行计划中属于相同任务层的关键任务进行比对,如果比对不一致,则确定动态执行计划包含的属于该任务层的关键任务为突变任务,如果比对一致,则确定动态执行计划包含的属于该任务层的关键任务正常。In an optional embodiment, by comparing the key tasks belonging to the same task layer in the dynamic execution plan and the standard execution plan, if the comparison is inconsistent, it is determined that the key tasks belonging to the task layer included in the dynamic execution plan are: For mutation tasks, if the alignment is consistent, it is determined that the key tasks belonging to the task layer included in the dynamic execution plan are normal.

由此可见,根据动态执行计划与标准执行计划的比对结果,可能确定存在多个突变任务,也可能确定存在一个突变任务,当然也可能不存在突变任务。It can be seen that, according to the comparison result between the dynamic execution plan and the standard execution plan, it may be determined that there are multiple mutation tasks, one mutation task, and of course, there may be no mutation tasks.

举例说明,假设生成的标准执行计划示例为:1A2A3D4A5C6A7A8B9C10D11A,生成的动态执行计划示例为:1A2C3D4A5C6A7A8B9C10D11A,通过将属于各个任务层的关键任务进行比对可以发现,第2层发生任务突变,关键任务由A变为C,说明任务C可能出现耗时突增、任务僵死等异常情况。For example, suppose the generated standard execution plan example is: 1A2A3D4A5C6A7A8B9C10D11A, and the generated dynamic execution plan example is: 1A2C3D4A5C6A7A8B9C10D11A. By comparing the key tasks belonging to each task layer, it can be found that the task mutation occurs in the second layer, and the key task is determined by A Changes to C, indicating that task C may experience abnormal situations such as sudden increase in time consumption and task death.

步骤105:如果存在,则将与突变任务相关的信息作为预警信息输出。Step 105: If there is, output the information related to the mutation task as early warning information.

可选的,与突变任务相关的信息可以包括业务属主、关联指标、以及功能影响点等信息,便于技术人员分析突变原因、实施应急方案。Optionally, the information related to the mutation task may include information such as business owners, associated indicators, and functional impact points, which is convenient for technicians to analyze the cause of mutation and implement emergency plans.

需要补充说明的是,可以预先建立一任务表,用于记录每一任务的相关信息,例如业务属主及、关联指标、开发人员、任务名称、是否为末梢任务的标记等,从而在有突变任务出现时,可以直接从任务表中读取突变任务对应的业务属主及关联指标作为预警信息输出。It should be added that a task table can be established in advance to record the relevant information of each task, such as business owner, related indicators, developers, task name, whether it is a flag of a peripheral task, etc. When a task appears, the business owner and associated indicators corresponding to the mutation task can be directly read from the task table as early warning information output.

在一种可能的实现方式中,可以通过电话或者邮件将预警信息发送给相应的人员,以实现及时预警。In a possible implementation manner, the early warning information may be sent to the corresponding personnel by telephone or email, so as to realize timely early warning.

步骤106:如果不存在,则继续执行步骤103的过程。Step 106: If it does not exist, continue to perform the process of Step 103.

其中,如果动态执行计划与标准执行计划中属于相同任务层的关键任务比对均一致,说明目前未出现突变任务,可以继续进行下一次的监控。Among them, if the dynamic execution plan is consistent with the key tasks belonging to the same task layer in the standard execution plan, it means that there is no mutation task at present, and the next monitoring can be continued.

需要补充说明的是,可以实时对各任务层中的每一任务的运行时间进行监控,即针对各任务层中的每一任务,获取该任务当前采集的任务运行时间与前一次采集的任务运行时间之间的时间差,如果该时间差超过预设阈值,则说明该任务出现耗时突增,将该任务的业务属主及关联指标作为预警信息输出。It should be added that the running time of each task in each task layer can be monitored in real time, that is, for each task in each task layer, the task running time currently collected for the task and the task running time collected in the previous collection are obtained. The time difference between times, if the time difference exceeds the preset threshold, it means that the task has a sudden increase in time consumption, and the business owner and associated indicators of the task are output as early warning information.

至此,完成上述图1所示的任务监控流程,本发明不再集中在某个关键任务、关键模块或者数据层级,而是集中在末梢任务上,即结合历史执行数据和任务依赖关系表为末梢任务输出标准执行计划,并实时结合当前执行数据和任务依赖关系表为末梢任务输出动态执行计划,通过将标准执行计划与动态执行计划进行比对来发现突变任务,从而完成对相关任务的全链路监控。由于不再需要对所有任务进行单独评估监控,只需要集中于关注末梢任务,便可实现全链路监控,这样有利于快速达成一致的目标,提升监控配置效率。并且通过实时生成动态执行计划,监控动态执行计划突变,可快速定位异常突变任务,推动事件处理流程,实现任务事中监控,以提前发现隐患、规避风险。So far, the task monitoring process shown in FIG. 1 is completed. The present invention no longer focuses on a certain key task, key module or data level, but on the peripheral task, that is, combined with the historical execution data and the task dependency table as the terminal. The task outputs the standard execution plan, and combines the current execution data and the task dependency table to output the dynamic execution plan for the peripheral task in real time. By comparing the standard execution plan with the dynamic execution plan, the mutation task is found, so as to complete the whole chain of related tasks. road monitoring. Since it is no longer necessary to individually evaluate and monitor all tasks, it is only necessary to focus on peripheral tasks to achieve full-link monitoring, which is conducive to quickly reaching a consensus goal and improving the efficiency of monitoring configuration. And by generating a dynamic execution plan in real time and monitoring the mutation of the dynamic execution plan, it can quickly locate abnormal mutation tasks, promote the event processing process, and realize in-process monitoring of tasks, so as to discover hidden dangers and avoid risks in advance.

本发明可以应用于智慧城市技术领域,从而推动智慧城市的建设。The invention can be applied to the technical field of smart cities, thereby promoting the construction of smart cities.

与前述任务监控方法的实施例相对应,本发明还提供了任务监控装置的实施例。Corresponding to the foregoing embodiments of the task monitoring method, the present invention also provides an embodiment of a task monitoring apparatus.

图2为本发明根据一示例性实施例示出的一种任务监控装置的结构示意图,该装置用于执行上述任一实施例提供的任务监控方法,如图2所示,该任务监控装置包括:FIG. 2 is a schematic structural diagram of a task monitoring device according to an exemplary embodiment of the present invention. The device is configured to execute the task monitoring method provided by any of the above embodiments. As shown in FIG. 2 , the task monitoring device includes:

获取模块210,用于获取位于最低任务层中末梢任务的任务依赖关系表;an acquisition module 210, for acquiring the task dependency table of the peripheral task located in the lowest task layer;

第一生成模块220,用于根据所述任务依赖关系表和历史时间段内采集的任务运行时间,为所述末梢任务生成标准执行计划;a first generating module 220, configured to generate a standard execution plan for the peripheral task according to the task dependency table and the task running time collected in the historical time period;

第二生成模块230,用于根据所述任务依赖关系表和当前采集的任务运行时间,为所述末梢任务生成动态执行计划;A second generating module 230, configured to generate a dynamic execution plan for the peripheral task according to the task dependency table and the currently collected task running time;

比对模块240,用于将所述动态执行计划与所述标准执行计划进行比对,以判定所述动态执行计划中是否存在突变任务;A comparison module 240, configured to compare the dynamic execution plan with the standard execution plan to determine whether there is a mutation task in the dynamic execution plan;

预警模块250,用于在判定存在突变任务时,将与所述突变任务相关的信息作为预警信息输出。The early warning module 250 is configured to output information related to the sudden change task as early warning information when it is determined that there is a sudden change task.

上述装置中各个单元的功能和作用的实现过程具体详见上述方法中对应步骤的实现过程,在此不再赘述。For details of the implementation process of the functions and functions of each unit in the above device, please refer to the implementation process of the corresponding steps in the above method, which will not be repeated here.

对于装置实施例而言,由于其基本对应于方法实施例,所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本发明方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。For the apparatus embodiments, since they basically correspond to the method embodiments, reference may be made to the partial descriptions of the method embodiments for related parts. The device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the present invention. Those of ordinary skill in the art can understand and implement it without creative effort.

本发明实施方式还提供一种与前述实施方式所提供的任务监控方法对应的电子设备,以执行上述任务监控方法。Embodiments of the present invention further provide an electronic device corresponding to the task monitoring method provided by the foregoing embodiments, so as to execute the above task monitoring method.

图3为本发明根据一示例性实施例示出的一种电子设备的硬件结构图,该电子设备包括:通信接口601、处理器602、存储器603和总线604;其中,通信接口601、处理器602和存储器603通过总线604完成相互间的通信。处理器602通过读取并执行存储器603中与任务监控方法的控制逻辑对应的机器可执行指令,可执行上文描述的任务监控方法,该方法的具体内容参见上述实施例,此处不再累述。3 is a hardware structure diagram of an electronic device according to an exemplary embodiment of the present invention. The electronic device includes: a communication interface 601, a processor 602, a memory 603, and a bus 604; wherein the communication interface 601, the processor 602 and the memory 603 communicate with each other through the bus 604 . The processor 602 can execute the task monitoring method described above by reading and executing the machine-executable instructions corresponding to the control logic of the task monitoring method in the memory 603. For the specific content of the method, refer to the above-mentioned embodiment, which is not repeated here. described.

本发明中提到的存储器603可以是任何电子、磁性、光学或其它物理存储装置,可以包含存储信息,如可执行指令、数据等等。具体地,存储器603可以是RAM(Random AccessMemory,随机存取存储器)、闪存、存储驱动器(如硬盘驱动器)、任何类型的存储盘(如光盘、DVD等),或者类似的存储介质,或者它们的组合。通过至少一个通信接口601(可以是有线或者无线)实现该系统网元与至少一个其他网元之间的通信连接,可以使用互联网、广域网、本地网、城域网等。The memory 603 referred to in the present invention may be any electronic, magnetic, optical or other physical storage device that may contain stored information, such as executable instructions, data, and the like. Specifically, the memory 603 may be a RAM (Random Access Memory), a flash memory, a storage drive (such as a hard disk drive), any type of storage disk (such as an optical disc, DVD, etc.), or a similar storage medium, or their combination. The communication connection between the network element of the system and at least one other network element is realized through at least one communication interface 601 (which may be wired or wireless), which may use the Internet, a wide area network, a local network, a metropolitan area network, and the like.

总线604可以是ISA总线、PCI总线或EISA总线等。所述总线可以分为地址总线、数据总线、控制总线等。其中,存储器603用于存储程序,所述处理器602在接收到执行指令后,执行所述程序。The bus 604 may be an ISA bus, a PCI bus, an EISA bus, or the like. The bus can be divided into an address bus, a data bus, a control bus, and the like. The memory 603 is used for storing a program, and the processor 602 executes the program after receiving the execution instruction.

处理器602可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器602中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器602可以是通用处理器,包括中央处理器(Central Processing Unit,简称CPU)、网络处理器(Network Processor,简称NP)等;还可以是数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。The processor 602 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above-mentioned method may be completed by an integrated logic circuit of hardware in the processor 602 or an instruction in the form of software. The above-mentioned processor 602 may be a general-purpose processor, including a central processing unit (CPU for short), a network processor (NP for short), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component. The methods, steps, and logic block diagrams disclosed in the embodiments of this application can be implemented or executed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in conjunction with the embodiments of the present application may be directly embodied as executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor.

本申请实施例提供的电子设备与本申请实施例提供的任务监控方法出于相同的发明构思,具有与其采用、运行或实现的方法相同的有益效果。The electronic device provided by the embodiment of the present application and the task monitoring method provided by the embodiment of the present application are based on the same inventive concept, and have the same beneficial effects as the method adopted, operated or realized.

本申请实施方式还提供一种与前述实施方式所提供的任务监控方法对应的计算机可读存储介质,请参考图4所示,其示出的计算机可读存储介质为光盘30,其上存储有计算机程序(即程序产品),所述计算机程序在被处理器运行时,会执行前述任意实施方式所提供的任务监控方法。Embodiments of the present application further provide a computer-readable storage medium corresponding to the task monitoring method provided by the foregoing embodiments, please refer to FIG. 4 , the computer-readable storage medium shown is an optical disc 30 on which is stored A computer program (ie, a program product), when the computer program is run by a processor, it will execute the task monitoring method provided by any of the foregoing embodiments.

需要说明的是,所述计算机可读存储介质的例子还可以包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他光学、磁性存储介质,在此不再一一赘述。It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random Access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical and magnetic storage media will not be repeated here.

本申请的上述实施例提供的计算机可读存储介质与本申请实施例提供的任务监控方法出于相同的发明构思,具有与其存储的应用程序所采用、运行或实现的方法相同的有益效果。The computer-readable storage medium provided by the above embodiments of the present application and the task monitoring method provided by the embodiments of the present application are based on the same inventive concept, and have the same beneficial effects as the methods used, run or implemented by the application programs stored thereon.

本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本发明的其它实施方案。本发明旨在涵盖本发明的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本发明的一般性原理并包括本发明未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本发明的真正范围和精神由下面的权利要求指出。Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention which follow the general principles of the present invention and include common knowledge or conventional techniques in the technical field not disclosed by the present invention . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.

还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Other elements not expressly listed, or which are inherent to such a process, method, article of manufacture, or apparatus are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article of manufacture, or device that includes the element.

以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明保护的范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the present invention. within the scope of protection.

Claims (10)

1. A method for task monitoring, the method comprising:
acquiring a task dependency relationship table of a peripheral task in a lowest task layer;
generating a standard execution plan for the ending task according to the task dependency relationship table and the task operation time acquired in the historical time period;
generating a dynamic execution plan for the ending task according to the task dependency relationship table and the currently acquired task operation time;
comparing the dynamic execution plan with the standard execution plan to judge whether a mutation task exists in the dynamic execution plan;
and if so, outputting information related to the mutation task as early warning information.
2. The method of claim 1, wherein generating a standard execution plan for the tip task based on the task dependency table and task run times collected over historical time periods comprises:
aiming at each task layer, at least one task positioned at the task layer is obtained from the task dependency relationship table;
selecting one task from the at least one task as a key task of the task layer according to the task running time collected in the historical time period;
and generating a standard execution plan for the tip task by utilizing the key tasks of each task layer.
3. The method of claim 2, wherein selecting a task from the at least one task as a key task of the task layer according to the task running time collected in the historical time period comprises:
determining the average running time of each task according to the task running time collected in the historical time period;
and selecting the task corresponding to the longest average running time as the key task of the task layer.
4. The method of claim 1, wherein generating a dynamic execution plan for the tip task based on the task dependency table and a currently collected task runtime comprises:
aiming at each task layer, at least one task positioned at the task layer is obtained from the task dependency relationship table;
selecting one task from the at least one task as a key task of the task layer according to the currently acquired task running time;
and generating a dynamic execution plan for the tip task by utilizing the key tasks of each task layer.
5. The method of claim 4, wherein selecting a task from the at least one task as a critical task of the task layer according to the currently collected task running time comprises:
and selecting the task corresponding to the currently acquired longest task running time as the key task of the task layer.
6. The method of claim 1, wherein comparing the dynamic execution plan to the standard execution plan to determine whether a mutated task exists in the dynamic execution plan comprises:
comparing the dynamic execution plan with key tasks belonging to the same task layer in the standard execution plan;
and if the comparison is inconsistent, determining that the key tasks contained in the dynamic execution plan and belonging to the task layer are mutation tasks.
7. The method of claim 1, further comprising:
aiming at each task in each task layer, acquiring the time difference between the task running time currently acquired by the task and the task running time acquired last time;
and if the time difference exceeds a preset threshold value, outputting information related to the task as early warning information.
8. A task monitoring apparatus, characterized in that the apparatus comprises:
the acquisition module is used for acquiring a task dependency relationship table of a peripheral task in the lowest task layer;
the first generation module is used for generating a standard execution plan for the ending task according to the task dependency relationship table and the task operation time acquired in the historical time period;
the second generation module is used for generating a dynamic execution plan for the ending task according to the task dependency relationship table and the currently acquired task operation time;
the comparison module is used for comparing the dynamic execution plan with the standard execution plan so as to judge whether a mutation task exists in the dynamic execution plan;
and the early warning module is used for outputting information related to the mutation task as early warning information when the mutation task is judged to exist.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method according to any of claims 1-7 are implemented when the processor executes the program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
CN202210537940.9A 2022-05-18 2022-05-18 Task monitoring method, device, equipment and storage medium Pending CN114897372A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210537940.9A CN114897372A (en) 2022-05-18 2022-05-18 Task monitoring method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210537940.9A CN114897372A (en) 2022-05-18 2022-05-18 Task monitoring method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114897372A true CN114897372A (en) 2022-08-12

Family

ID=82724396

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210537940.9A Pending CN114897372A (en) 2022-05-18 2022-05-18 Task monitoring method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114897372A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111858065A (en) * 2020-07-28 2020-10-30 中国平安财产保险股份有限公司 Data processing method, device, storage medium and device
CN113220542A (en) * 2021-04-01 2021-08-06 深圳市云网万店科技有限公司 Early warning method and device for computing task, computer equipment and storage medium
CN114020596A (en) * 2021-11-29 2022-02-08 城云科技(中国)有限公司 Abnormal task identification method, system and application
CN114238055A (en) * 2021-12-20 2022-03-25 中国平安财产保险股份有限公司 Task data processing method, device, electronic device and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111858065A (en) * 2020-07-28 2020-10-30 中国平安财产保险股份有限公司 Data processing method, device, storage medium and device
CN113220542A (en) * 2021-04-01 2021-08-06 深圳市云网万店科技有限公司 Early warning method and device for computing task, computer equipment and storage medium
CN114020596A (en) * 2021-11-29 2022-02-08 城云科技(中国)有限公司 Abnormal task identification method, system and application
CN114238055A (en) * 2021-12-20 2022-03-25 中国平安财产保险股份有限公司 Task data processing method, device, electronic device and storage medium

Similar Documents

Publication Publication Date Title
CN109960635B (en) Monitoring and alarming method, system, equipment and storage medium of real-time computing platform
CN105591821B (en) Monitoring system and service system
CN109947079A (en) Region method for detecting abnormality and edge calculations equipment based on edge calculations
US20110218843A1 (en) Non intrusive system and method for monitoring business processes
CN103562863A (en) Creating a correlation rule defining a relationship between event types
CN109582418B (en) User behavior data collection method, device, computer device, and storage medium
CN112580812A (en) Model training method, inventory safety early warning method, device, equipment and medium
CN108154252A (en) Method and apparatus for estimating the flow deadline
CN111400294B (en) Data anomaly monitoring method, device and system
US9170909B2 (en) Automatic parallel performance profiling systems and methods
KR20210101111A (en) Systems and methods for centralization and diagnostics for live virtual server performance data
CN117333124A (en) A variable project management method, system, equipment and media
KR20210055934A (en) Self-learning system for developing machine learning models
CN113886373A (en) Data processing method and device and electronic equipment
CN109711849B (en) Ether house address portrait generation method and device, electronic equipment and storage medium
CN111144987A (en) Abnormal shopping behavior limiting method, limiting assembly and shopping system
CN116149926A (en) Abnormality monitoring method, device, equipment and storage medium for business index
CN117913830B (en) Resource scheduling method and system for pumped storage power station
CN107515807A (en) A kind of method and device for storing monitoring data
CN118053125B (en) A method, device, equipment and medium for visualizing image supervision of project progress
CN109493958A (en) A kind of follow-up ways to draw up the plan, device, server and medium
CN119090480A (en) Smart building operation and maintenance method, platform, storage medium and electronic equipment
CN119089349A (en) An operation monitoring method and device for energy internet marketing service system
CN114897372A (en) Task monitoring method, device, equipment and storage medium
CN118734216A (en) Data anomaly detection method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination