CN118502918A - Workflow intelligent management system based on artificial intelligence - Google Patents

Workflow intelligent management system based on artificial intelligence Download PDF

Info

Publication number
CN118502918A
CN118502918A CN202410846473.7A CN202410846473A CN118502918A CN 118502918 A CN118502918 A CN 118502918A CN 202410846473 A CN202410846473 A CN 202410846473A CN 118502918 A CN118502918 A CN 118502918A
Authority
CN
China
Prior art keywords
task
target
tasks
resource
decision support
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202410846473.7A
Other languages
Chinese (zh)
Inventor
陈家坤
陈志敏
王成成
刘钰欣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Dianji University
Original Assignee
Shanghai Dianji University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Dianji University filed Critical Shanghai Dianji University
Priority to CN202410846473.7A priority Critical patent/CN118502918A/en
Publication of CN118502918A publication Critical patent/CN118502918A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • G06F9/5016Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5038Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/505Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/48Indexing scheme relating to G06F9/48
    • G06F2209/484Precedence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/5021Priority

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

本申请提供一种基于人工智能的工作流智能化管理系统,任务管理模块用于监控当前在线工作流的实时工作负载,根据实时工作负载自适应调整目标任务的资源弹性分配策略;决策支持模块用于通过决策支持模型对目标任务进行聚类分析获得聚类结果;基于聚类结果以及相关性通过决策支持模型确定各组目标任务的优先级执行顺序;资源管理模块用于根据优先级执行顺序以及资源弹性分配策略对各组目标任务进行任务分配以及资源调度;自适应优化学习模块用于以质量评估值和/或性能指标为奖励项,对决策支持模型中的超参数组合进行动态优化获得最佳超参数组合。该系统能够高效管理调度工作流任务,提供更为全面、智能地工作流智能化管理服务。

The present application provides an intelligent workflow management system based on artificial intelligence. The task management module is used to monitor the real-time workload of the current online workflow, and adaptively adjust the resource elastic allocation strategy of the target task according to the real-time workload; the decision support module is used to cluster the target task through the decision support model to obtain the clustering result; the priority execution order of each group of target tasks is determined through the decision support model based on the clustering result and the correlation; the resource management module is used to perform task allocation and resource scheduling for each group of target tasks according to the priority execution order and the resource elastic allocation strategy; the adaptive optimization learning module is used to dynamically optimize the hyperparameter combination in the decision support model with the quality evaluation value and/or performance index as the reward item to obtain the best hyperparameter combination. The system can efficiently manage and schedule workflow tasks, and provide more comprehensive and intelligent workflow intelligent management services.

Description

基于人工智能的工作流智能化管理系统Intelligent workflow management system based on artificial intelligence

技术领域Technical Field

本申请属于数据处理技术领域,尤其涉及一种基于人工智能的工作流智能化管理系统。The present application belongs to the field of data processing technology, and in particular, relates to an intelligent workflow management system based on artificial intelligence.

背景技术Background Art

在传统的工作流管理系统中,管理员通常需要手动调整资源分配策略,例如分配计算资源给不同的任务或节点,以满足工作流中各个任务的需求。In traditional workflow management systems, administrators usually need to manually adjust resource allocation strategies, such as allocating computing resources to different tasks or nodes, to meet the needs of each task in the workflow.

然而,这种手动调整方式存在以下问题:可能无法及时察觉到工作流的实时工作负载变化。在大规模的工作流中,任务的数量和类型可能会动态变化,导致工作负载不平衡。如果管理员无法及时调整资源分配策略,某些任务可能得不到足够的资源进行处理,而其他任务可能得到过多的资源,导致资源的浪费和效率的降低。However, this manual adjustment method has the following problems: The real-time workload changes of the workflow may not be detected in time. In large-scale workflows, the number and type of tasks may change dynamically, resulting in an unbalanced workload. If the administrator cannot adjust the resource allocation strategy in time, some tasks may not get enough resources to be processed, while other tasks may get too many resources, resulting in a waste of resources and reduced efficiency.

因此,亟待设计一种全新方案,用于解决上述至少一个技术问题。Therefore, it is urgent to design a new solution to solve at least one of the above technical problems.

发明内容Summary of the invention

本申请提供了一种基于人工智能的工作流智能化管理系统,用以高效管理调度工作流任务,提供更为全面、智能地工作流智能化管理服务。The present application provides an artificial intelligence-based workflow intelligent management system for efficiently managing and scheduling workflow tasks and providing more comprehensive and intelligent workflow intelligent management services.

第一方面,本申请提供了一种基于人工智能的工作流智能化管理系统,所述系统包括:In a first aspect, the present application provides an artificial intelligence-based workflow intelligent management system, the system comprising:

任务管理模块,用于监控当前在线工作流的实时工作负载;根据实时工作负载,自适应调整目标任务的资源弹性分配策略,以实现算力弹性调配;The task management module is used to monitor the real-time workload of the current online workflow; according to the real-time workload, the resource elastic allocation strategy of the target task is adaptively adjusted to achieve elastic allocation of computing power;

决策支持模块,用于通过决策支持模型对目标任务进行聚类分析,以获得聚类结果,聚类结果包括各组目标任务、以及各组目标任务之间的相关性;基于聚类结果以及相关性,通过决策支持模型确定各组目标任务的优先级执行顺序;根据聚类结果,通过决策支持模型将存在异常的目标任务标记为异常任务;其中,异常任务不符合预设期望模式,或者异常任务与其他目标任务之间的相关性低于预设异常值;A decision support module is used to perform cluster analysis on target tasks through a decision support model to obtain clustering results, wherein the clustering results include each group of target tasks and the correlation between each group of target tasks; based on the clustering results and the correlation, the priority execution order of each group of target tasks is determined through the decision support model; according to the clustering results, the target tasks with abnormalities are marked as abnormal tasks through the decision support model; wherein the abnormal tasks do not conform to the preset expected mode, or the correlation between the abnormal tasks and other target tasks is lower than the preset abnormal value;

资源管理模块,用于根据各组目标任务的优先级执行顺序以及资源弹性分配策略,对各组目标任务进行任务分配以及资源调度;对异常任务执行资源重分配操作或隔离操作;The resource management module is used to perform task allocation and resource scheduling for each group of target tasks according to the priority execution order of each group of target tasks and the resource elasticity allocation strategy; and to perform resource reallocation or isolation operations on abnormal tasks;

自适应优化学习模块,用于通过优化奖励模型以聚类结果对应的质量评估值和/或性能指标为奖励项,对决策支持模型中的超参数组合进行动态优化,以获得最佳超参数组合;根据聚类结果对应的质量评估值和/或性能指标,对决策支持模型执行簇合并操作,以提升聚类结果的鲁棒性;An adaptive optimization learning module is used to dynamically optimize the hyperparameter combination in the decision support model by optimizing the reward model with the quality evaluation value and/or performance index corresponding to the clustering result as the reward item to obtain the best hyperparameter combination; according to the quality evaluation value and/or performance index corresponding to the clustering result, a cluster merging operation is performed on the decision support model to improve the robustness of the clustering result;

报告展示模块,用于响应于用户操作,提供对目标任务的交互式分析,并向用户展示分析得到的目标任务的工作流信息,工作流信息包括任务执行状态、任务成功率、任务异常信息、资源分配情况。The report display module is used to respond to user operations, provide interactive analysis of the target task, and display the workflow information of the target task obtained through analysis to the user. The workflow information includes task execution status, task success rate, task exception information, and resource allocation status.

第二方面,本申请实施例提供了一种基于人工智能的工作流智能化管理方法,该方法包括:In a second aspect, an embodiment of the present application provides an artificial intelligence-based workflow intelligent management method, the method comprising:

监控当前在线工作流的实时工作负载;Monitor the real-time workload of current online workflows;

根据实时工作负载,自适应调整目标任务的资源弹性分配策略,以实现算力弹性调配;Adaptively adjust the resource elastic allocation strategy of the target task according to the real-time workload to achieve elastic allocation of computing power;

通过决策支持模型对目标任务进行聚类分析,以获得聚类结果,聚类结果包括各组目标任务、以及各组目标任务之间的相关性;Performing cluster analysis on target tasks through a decision support model to obtain cluster results, which include each group of target tasks and the correlation between each group of target tasks;

基于聚类结果以及相关性,通过决策支持模型确定各组目标任务的优先级执行顺序;Based on the clustering results and correlation, the priority execution order of each group of target tasks is determined through the decision support model;

根据聚类结果,通过决策支持模型将存在异常的目标任务标记为异常任务;其中,异常任务不符合预设期望模式,或者异常任务与其他目标任务之间的相关性低于预设异常值;According to the clustering results, the target tasks with abnormalities are marked as abnormal tasks through the decision support model; wherein the abnormal tasks do not conform to the preset expected pattern, or the correlation between the abnormal tasks and other target tasks is lower than the preset abnormal value;

根据各组目标任务的优先级执行顺序以及资源弹性分配策略,对各组目标任务进行任务分配以及资源调度;According to the priority execution order of each group of target tasks and the resource elasticity allocation strategy, each group of target tasks is assigned tasks and resources are scheduled;

对异常任务执行资源重分配操作或隔离操作;Perform resource reallocation or isolation operations on abnormal tasks;

通过优化奖励模型以聚类结果对应的质量评估值和/或性能指标为奖励项,对决策支持模型中的超参数组合进行动态优化,以获得最佳超参数组合;By optimizing the reward model, the quality evaluation value and/or performance index corresponding to the clustering result is used as the reward item, and the hyperparameter combination in the decision support model is dynamically optimized to obtain the best hyperparameter combination;

根据聚类结果对应的质量评估值和/或性能指标,对决策支持模型执行簇合并操作,以提升聚类结果的鲁棒性;According to the quality evaluation value and/or performance index corresponding to the clustering result, a cluster merging operation is performed on the decision support model to improve the robustness of the clustering result;

响应于用户操作,提供对目标任务的交互式分析,并向用户展示分析得到的目标任务的工作流信息;工作流信息包括任务执行状态、任务成功率、任务异常信息、资源分配情况。In response to user operations, an interactive analysis of the target task is provided, and the workflow information of the target task obtained through the analysis is displayed to the user; the workflow information includes task execution status, task success rate, task exception information, and resource allocation status.

第三方面,本申请提供了一种电子设备,包括存储器、处理器,所述存储器中存储有可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述第一方面任一项所述的基于人工智能的工作流智能化管理系统。In a third aspect, the present application provides an electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the computer program, it implements the artificial intelligence-based intelligent workflow management system described in any one of the first aspects above.

第四方面,一种具有处理器可执行的非易失的程序代码的计算机可读介质,所述程序代码使所述处理器执行第一方面任一所述的基于人工智能的工作流智能化管理系统。In a fourth aspect, a computer-readable medium having a non-volatile program code executable by a processor, wherein the program code enables the processor to execute any of the artificial intelligence-based intelligent workflow management systems described in the first aspect.

本申请实施例提供的技术方案中,任务管理模块,用于监控当前在线工作流的实时工作负载;根据实时工作负载,自适应调整目标任务的资源弹性分配策略,以实现算力弹性调配;决策支持模块,用于通过决策支持模型对目标任务进行聚类分析,以获得聚类结果,聚类结果包括各组目标任务、以及各组目标任务之间的相关性;基于聚类结果以及相关性,通过决策支持模型确定各组目标任务的优先级执行顺序;根据聚类结果,通过决策支持模型将存在异常的目标任务标记为异常任务;其中,异常任务不符合预设期望模式,或者异常任务与其他目标任务之间的相关性低于预设异常值;资源管理模块,用于根据各组目标任务的优先级执行顺序以及资源弹性分配策略,对各组目标任务进行任务分配以及资源调度;对异常任务执行资源重分配操作或隔离操作;自适应优化学习模块,用于通过优化奖励模型以聚类结果对应的质量评估值和/或性能指标为奖励项,对决策支持模型中的超参数组合进行动态优化,以获得最佳超参数组合;根据聚类结果对应的质量评估值和/或性能指标,对决策支持模型执行簇合并操作,以提升聚类结果的鲁棒性;报告展示模块,用于响应于用户操作,提供对目标任务的交互式分析,并向用户展示分析得到的目标任务的工作流信息,工作流信息包括任务执行状态、任务成功率、任务异常信息、资源分配情况。本申请实施例中,能够提高工作流的处理效率和准确性,实现智能化任务管理和调度,优化决策支持模型的性能,同时提供全面的展示和分析功能,增强对工作流执行状态和结果的了解,有助于提升自动化管理水平。In the technical solution provided by the embodiment of the present application, the task management module is used to monitor the real-time workload of the current online workflow; according to the real-time workload, the resource elastic allocation strategy of the target task is adaptively adjusted to achieve elastic allocation of computing power; the decision support module is used to perform cluster analysis on the target task through a decision support model to obtain clustering results, and the clustering results include each group of target tasks and the correlation between each group of target tasks; based on the clustering results and the correlation, the priority execution order of each group of target tasks is determined through the decision support model; according to the clustering results, the target task with abnormalities is marked as an abnormal task through the decision support model; wherein the abnormal task does not conform to the preset expected mode, or the correlation between the abnormal task and other target tasks is lower than the preset abnormal value; the resource management module is used to perform cluster analysis on the target task according to the group of target tasks. The priority execution order of tasks and the resource elasticity allocation strategy are used to allocate tasks and schedule resources for each group of target tasks; resource reallocation operations or isolation operations are performed on abnormal tasks; an adaptive optimization learning module is used to dynamically optimize the hyperparameter combination in the decision support model by optimizing the reward model with the quality evaluation value and/or performance index corresponding to the clustering result as the reward item to obtain the best hyperparameter combination; according to the quality evaluation value and/or performance index corresponding to the clustering result, a cluster merging operation is performed on the decision support model to improve the robustness of the clustering result; a report display module is used to respond to user operations, provide interactive analysis of the target task, and display the workflow information of the target task obtained by the analysis to the user, and the workflow information includes task execution status, task success rate, task abnormality information, and resource allocation. In the embodiment of the present application, the processing efficiency and accuracy of the workflow can be improved, intelligent task management and scheduling can be realized, the performance of the decision support model can be optimized, and comprehensive display and analysis functions can be provided at the same time, and the understanding of the workflow execution status and results can be enhanced, which is helpful to improve the level of automated management.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

为了更清楚地说明本申请实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

图1是本申请实施例的一种基于人工智能的工作流智能化管理系统的示意图;FIG1 is a schematic diagram of an artificial intelligence-based intelligent workflow management system according to an embodiment of the present application;

图2是本申请实施例的一种电子设备的结构示意图。FIG. 2 is a schematic diagram of the structure of an electronic device according to an embodiment of the present application.

具体实施方式DETAILED DESCRIPTION

为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

除非另有定义,本文所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。本文中在本申请的说明书中所使用的术语只是为了描述具体的实施例的目的,不是旨在于限制本申请。Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.

目前,在传统的工作流管理系统中,管理员通常需要手动调整资源分配策略,例如分配计算资源给不同的任务或节点,以满足工作流中各个任务的需求。Currently, in traditional workflow management systems, administrators usually need to manually adjust resource allocation strategies, such as allocating computing resources to different tasks or nodes, to meet the needs of each task in the workflow.

然而,相关技术中,这种手动调整方式存在以下问题:However, in the related art, this manual adjustment method has the following problems:

可能无法及时察觉到工作流的实时工作负载变化。在大规模的工作流中,任务的数量和类型可能会动态变化,导致工作负载不平衡。如果管理员无法及时调整资源分配策略,某些任务可能得不到足够的资源进行处理,而其他任务可能得到过多的资源,导致资源的浪费和效率的降低。The real-time workload changes of the workflow may not be detected in time. In large-scale workflows, the number and type of tasks may change dynamically, resulting in an unbalanced workload. If the administrator cannot adjust the resource allocation strategy in time, some tasks may not get enough resources to be processed, while other tasks may get too many resources, resulting in a waste of resources and reduced efficiency.

在调整资源分配策略时,可能受到个人主观偏好或经验的影响。这可能导致资源分配的不公平或不合理,无法满足工作流中各个任务的实际需求。When adjusting resource allocation strategies, it may be affected by personal subjective preferences or experience, which may lead to unfair or unreasonable resource allocation and fail to meet the actual needs of each task in the workflow.

由于手动调整资源分配策略需要花费时间和精力,这种方式在大规模或高频率的工作流中很难实现高效的资源弹性调配。这可能导致工作流处理的延迟和效率的下降。Since manually adjusting resource allocation strategies takes time and effort, it is difficult to achieve efficient resource elasticity in large-scale or high-frequency workflows, which may lead to delays in workflow processing and reduced efficiency.

因此,传统的工作流管理系统往往无法根据实时工作负载自动调整资源分配策略,导致工作负载不平衡和任务处理的缓慢。而基于人工智能的工作流智能化管理系统能够通过任务管理模块和决策支持模块,实时监控工作负载并自适应调整资源弹性分配策略,解决这一问题,并提高工作流的处理效率和性能。Therefore, traditional workflow management systems often cannot automatically adjust resource allocation strategies according to real-time workloads, resulting in workload imbalance and slow task processing. However, AI-based workflow intelligent management systems can monitor workloads in real time and adaptively adjust resource elastic allocation strategies through task management modules and decision support modules to solve this problem and improve workflow processing efficiency and performance.

因此,亟待设计一种全新方案,用于解决上述至少一个技术问题。Therefore, it is urgent to design a new solution to solve at least one of the above technical problems.

本申请实施例提供的基于人工智能的工作流智能化管理方案,可以由一电子设备来执行,该电子设备可以是服务器、服务器集群、云服务器。该电子设备也可以是诸如手机、计算机、平板电脑、可穿戴设备(如智能手表等)等终端设备。在一可选实施例中,该电子设备上可以安装有用于执行基于人工智能的工作流智能化管理方案的服务程序。The intelligent workflow management solution based on artificial intelligence provided in the embodiment of the present application can be executed by an electronic device, which can be a server, a server cluster, or a cloud server. The electronic device can also be a terminal device such as a mobile phone, a computer, a tablet computer, a wearable device (such as a smart watch, etc.). In an optional embodiment, a service program for executing the intelligent workflow management solution based on artificial intelligence can be installed on the electronic device.

图1为本申请实施例提供的一种基于人工智能的工作流智能化管理系统的示意图。如图1所示,该工作流智能化管理系统包括:FIG1 is a schematic diagram of an artificial intelligence-based workflow intelligent management system provided in an embodiment of the present application. As shown in FIG1 , the workflow intelligent management system includes:

任务管理模块11,用于监控当前在线工作流的实时工作负载;根据所述实时工作负载,自适应调整目标任务的资源弹性分配策略,以实现算力弹性调配;The task management module 11 is used to monitor the real-time workload of the current online workflow; according to the real-time workload, adaptively adjust the resource elastic allocation strategy of the target task to achieve elastic allocation of computing power;

决策支持模块12,用于通过决策支持模型对所述目标任务进行聚类分析,以获得聚类结果,所述聚类结果包括各组目标任务、以及各组目标任务之间的相关性;基于所述聚类结果以及所述相关性,通过决策支持模型确定各组目标任务的优先级执行顺序;根据所述聚类结果,通过决策支持模型将存在异常的目标任务标记为异常任务;其中,所述异常任务不符合预设期望模式,或者所述异常任务与其他目标任务之间的相关性低于预设异常值;The decision support module 12 is used to perform cluster analysis on the target tasks through a decision support model to obtain a clustering result, wherein the clustering result includes each group of target tasks and the correlation between each group of target tasks; based on the clustering result and the correlation, the priority execution order of each group of target tasks is determined through the decision support model; according to the clustering result, the target tasks with abnormalities are marked as abnormal tasks through the decision support model; wherein the abnormal tasks do not conform to a preset expected mode, or the correlation between the abnormal tasks and other target tasks is lower than a preset abnormal value;

资源管理模块13,用于根据各组目标任务的优先级执行顺序以及所述资源弹性分配策略,对各组目标任务进行任务分配以及资源调度;对所述异常任务执行资源重分配操作或隔离操作;The resource management module 13 is used to perform task allocation and resource scheduling for each group of target tasks according to the priority execution order of each group of target tasks and the resource elastic allocation strategy; and perform resource reallocation operation or isolation operation on the abnormal task;

自适应优化学习模块14,用于通过优化奖励模型以所述聚类结果对应的质量评估值和/或性能指标为奖励项,对决策支持模型中的超参数组合进行动态优化,以获得最佳超参数组合;根据所述聚类结果对应的质量评估值和/或性能指标,对决策支持模型执行簇合并操作,以提升所述聚类结果的鲁棒性;The adaptive optimization learning module 14 is used to dynamically optimize the hyperparameter combination in the decision support model by optimizing the reward model with the quality evaluation value and/or performance index corresponding to the clustering result as the reward item to obtain the best hyperparameter combination; according to the quality evaluation value and/or performance index corresponding to the clustering result, perform a cluster merging operation on the decision support model to improve the robustness of the clustering result;

报告展示模块15,用于响应于用户操作,提供对所述目标任务的交互式分析,并向用户展示分析得到的所述目标任务的工作流信息,所述工作流信息包括任务执行状态、任务成功率、任务异常信息、资源分配情况。The report display module 15 is used to provide interactive analysis of the target task in response to user operations, and display the workflow information of the target task obtained by analysis to the user, wherein the workflow information includes task execution status, task success rate, task exception information, and resource allocation status.

下面结合具体示例分别介绍各个模块的功能原理。The functional principles of each module are introduced below with reference to specific examples.

任务管理模块11,用于监控当前在线工作流的实时工作负载;根据所述实时工作负载,自适应调整目标任务的资源弹性分配策略,以实现算力弹性调配。The task management module 11 is used to monitor the real-time workload of the current online workflow; according to the real-time workload, the resource elastic allocation strategy of the target task is adaptively adjusted to achieve elastic allocation of computing power.

这里,任务管理模块11负责目标任务的创建、分配、调度和监控。该模块可以根据实时的工作负载情况,自适应调整任务分配和资源分配策略,以支持算力弹性调配。Here, the task management module 11 is responsible for the creation, allocation, scheduling and monitoring of target tasks. This module can adaptively adjust the task allocation and resource allocation strategy according to the real-time workload to support the elastic allocation of computing power.

作为一个可选实施例,任务管理模块11,根据所述实时工作负载,自适应调整目标任务的资源弹性分配策略时,具体用于:As an optional embodiment, the task management module 11, when adaptively adjusting the resource elastic allocation strategy of the target task according to the real-time workload, is specifically used to:

获取当前在线工作流的CPU利用率、内存使用量、网络流量;结合所述目标任务的季节性因素以及业务特征,通过负载预测模型对当前在线工作流的CPU利用率、内存使用量、网络流量进行动态预测,以获得所述目标任务对应的负载预测时序;根据所述负载预测时序,利用云计算平台对所述目标任务执行资源弹性调整,得到所述目标任务的资源弹性分配策略。The CPU utilization, memory usage, and network traffic of the current online workflow are obtained; in combination with the seasonal factors and business characteristics of the target task, the CPU utilization, memory usage, and network traffic of the current online workflow are dynamically predicted through a load prediction model to obtain the load prediction timing corresponding to the target task; according to the load prediction timing, the cloud computing platform is used to perform resource elasticity adjustment on the target task to obtain the resource elasticity allocation strategy of the target task.

其中,所述资源弹性分配策略包括但不限于:增加或减少虚拟机实例、调整存储容量、调整网络带宽。The resource elastic allocation strategy includes, but is not limited to: increasing or decreasing virtual machine instances, adjusting storage capacity, and adjusting network bandwidth.

本申请实施例中,任务管理模块11可以连接到相应的监控工具或云计算平台的应用程序接口(Application Program Interface,API),获取当前在线工作流的CPU利用率、内存使用量、网络流量等关键指标信息。其中,应用程序接口是一组定义、程序及协议的集合,通过应用程序接口实现计算机软件之间的相互通信。In the embodiment of the present application, the task management module 11 can be connected to the application program interface (API) of the corresponding monitoring tool or cloud computing platform to obtain key indicator information such as CPU utilization, memory usage, network traffic, etc. of the current online workflow. Among them, the application program interface is a set of definitions, programs and protocols, and mutual communication between computer software is realized through the application program interface.

作为一个可选实施例,任务管理模块11,在根据负载预测时序,利用云计算平台对目标任务执行资源弹性调整,得到目标任务的资源弹性分配策略时,具体用于:As an optional embodiment, the task management module 11, when performing resource elasticity adjustment on the target task using the cloud computing platform according to the load prediction time sequence to obtain the resource elasticity allocation strategy of the target task, is specifically used to:

根据负载预测时序,评估目标任务的预测资源需求与当前可用资源的匹配情况;若评估到预测资源需求超过当前资源承载能力,利用云计算平台的弹性资源功能发起针对目标任务的资源扩展请求;通过调用云计算平台中的虚拟机资源,获得与预测资源需求匹配的虚拟机实例;基于预测资源需求,对目标任务的存储容量和网络带宽进行动态调整,以实现针对目标任务的弹性扩容操作;根据资源扩展请求、所需匹配的虚拟机实例、存储容量以及网络带宽,形成资源弹性分配策略。According to the load prediction timing, the match between the predicted resource demand of the target task and the currently available resources is evaluated; if it is evaluated that the predicted resource demand exceeds the current resource carrying capacity, the elastic resource function of the cloud computing platform is used to initiate a resource expansion request for the target task; by calling the virtual machine resources in the cloud computing platform, a virtual machine instance that matches the predicted resource demand is obtained; based on the predicted resource demand, the storage capacity and network bandwidth of the target task are dynamically adjusted to achieve elastic expansion operations for the target task; a resource elastic allocation strategy is formed based on the resource expansion request, the required matching virtual machine instance, storage capacity and network bandwidth.

这里,任务管理模块11,一方面,可以动态匹配资源需求:该任务管理模块11,可以评估目标任务的预测资源需求与当前可用资源的匹配情况,实现资源的动态匹配,可以避免过多或过少地分配资源进而提高资源利用效率。另一方面,可以实时响应和弹性扩展:该任务管理模块11可以利用云计算平台的虚拟机资源和弹性资源功能,快速响应任务执行的资源需求,及时进行资源的弹性扩展,以满足任务执行的要求,提高工作流的处理效率和灵活性。再一方面,可以动态调整存储容量和网络带宽:该任务管理模块11还可以根据任务的资源需求,在保证任务的执行效率的前提下,动态调整任务的存储容量和网络带宽,进一步提升任务的处理能力和质量。还有一方面,可以实现资源弹性分配策略:该任务管理模块11可以实时根据任务的资源需求,生成具有弹性的资源分配策略,使目标任务的执行更加高效和稳定,从而提高整个工作流的处理能力和效率。综上所述,任务管理模块11在利用云计算平台对目标任务执行资源弹性调整过程中,能够实现资源需求的匹配、实时响应和弹性扩展、动态调整存储容量和网络带宽,最终实现资源弹性分配策略,从而提高工作流的处理能力和效率。Here, the task management module 11, on the one hand, can dynamically match resource requirements: the task management module 11 can evaluate the matching of the predicted resource requirements of the target task with the currently available resources, realize dynamic matching of resources, avoid excessive or insufficient allocation of resources, and thus improve resource utilization efficiency. On the other hand, it can respond in real time and expand elastically: the task management module 11 can use the virtual machine resources and elastic resource functions of the cloud computing platform to quickly respond to the resource requirements of task execution, and timely elastically expand resources to meet the requirements of task execution and improve the processing efficiency and flexibility of the workflow. On the other hand, it can dynamically adjust the storage capacity and network bandwidth: the task management module 11 can also dynamically adjust the storage capacity and network bandwidth of the task according to the resource requirements of the task, while ensuring the execution efficiency of the task, so as to further improve the processing capacity and quality of the task. On the other hand, it can realize the resource elastic allocation strategy: the task management module 11 can generate a flexible resource allocation strategy in real time according to the resource requirements of the task, so that the execution of the target task is more efficient and stable, thereby improving the processing capacity and efficiency of the entire workflow. To sum up, in the process of using the cloud computing platform to perform resource elastic adjustment on the target task, the task management module 11 can achieve resource demand matching, real-time response and elastic expansion, dynamic adjustment of storage capacity and network bandwidth, and ultimately implement resource elastic allocation strategy, thereby improving the processing capacity and efficiency of the workflow.

假设有一个基于人工智能的图像处理工作流,涉及到大量的图像处理任务。下面是一个示例,说明如何根据负载预测和资源扩展请求生成资源弹性分配策略:首先,任务管理模块11根据历史数据和负载预测模型,预测未来一段时间内图像处理任务的资源需求。例如,根据每小时平均任务数和每个任务的平均处理时间,预测下一个小时内需要15个并行进行的图像处理任务。其次,任务管理模块11将预测的资源需求与当前可用资源进行比较。假设当前可用资源是10个虚拟机实例,每个实例拥有足够的存储容量和网络带宽进行图像处理。由于预测的资源需求超过当前资源承载能力,任务管理模块发起资源扩展请求给云计算平台。云计算平台接收到资源扩展请求后,根据请求中提供的资源需求(例如虚拟机的数量、配置要求等),为该图像处理工作流提供额外的虚拟机实例。假设云计算平台提供5个新的虚拟机实例。任务管理模块11根据预测的资源需求,动态调整目标任务的存储容量和网络带宽,以实现针对图像处理任务的弹性扩容。例如,根据每个图像处理任务需要的存储容量和网络带宽,增加相应的资源分配给任务。最终,基于资源扩展请求、获取的虚拟机实例、存储容量和网络带宽的调整,任务管理模块形成资源弹性分配策略,确保图像处理任务能够以高效和稳定的方式进行。Assume that there is an AI-based image processing workflow involving a large number of image processing tasks. The following is an example of how to generate a resource elastic allocation strategy based on load prediction and resource expansion request: First, the task management module 11 predicts the resource requirements of image processing tasks in the future period based on historical data and load prediction models. For example, based on the average number of tasks per hour and the average processing time of each task, it is predicted that 15 parallel image processing tasks will be required in the next hour. Secondly, the task management module 11 compares the predicted resource requirements with the current available resources. Assume that the current available resources are 10 virtual machine instances, each of which has sufficient storage capacity and network bandwidth for image processing. Since the predicted resource requirements exceed the current resource carrying capacity, the task management module initiates a resource expansion request to the cloud computing platform. After receiving the resource expansion request, the cloud computing platform provides additional virtual machine instances for the image processing workflow based on the resource requirements provided in the request (such as the number of virtual machines, configuration requirements, etc.). Assume that the cloud computing platform provides 5 new virtual machine instances. The task management module 11 dynamically adjusts the storage capacity and network bandwidth of the target task based on the predicted resource requirements to achieve elastic expansion for image processing tasks. For example, according to the storage capacity and network bandwidth required by each image processing task, the corresponding resources are allocated to the task. Finally, based on the resource expansion request, the obtained virtual machine instance, the storage capacity and the network bandwidth adjustment, the task management module forms a resource elastic allocation strategy to ensure that the image processing task can be carried out in an efficient and stable manner.

在这个示例中,任务管理模块根据负载预测和资源评估情况,发起资源扩展请求给云计算平台,并获得与预测资源需求匹配的虚拟机实例。同时,动态调整存储容量和网络带宽,以实现针对图像处理任务的弹性扩容操作。最终,基于这些操作,形成了针对该工作流的资源弹性分配策略,确保任务的处理能力和效率。In this example, the task management module initiates a resource expansion request to the cloud computing platform based on load forecasting and resource evaluation, and obtains a virtual machine instance that matches the predicted resource demand. At the same time, the storage capacity and network bandwidth are dynamically adjusted to achieve elastic expansion operations for image processing tasks. Finally, based on these operations, a resource elastic allocation strategy for the workflow is formed to ensure the processing capacity and efficiency of the task.

决策支持模块12,用于通过决策支持模型对所述目标任务进行聚类分析,以获得聚类结果,所述聚类结果包括各组目标任务、以及各组目标任务之间的相关性;基于所述聚类结果以及所述相关性,通过决策支持模型确定各组目标任务的优先级执行顺序;根据所述聚类结果,通过决策支持模型将存在异常的目标任务标记为异常任务;其中,所述异常任务不符合预设期望模式,或者所述异常任务与其他目标任务之间的相关性低于预设异常值。The decision support module 12 is used to perform cluster analysis on the target tasks through a decision support model to obtain clustering results, wherein the clustering results include each group of target tasks and the correlation between each group of target tasks; based on the clustering results and the correlation, the priority execution order of each group of target tasks is determined through a decision support model; according to the clustering results, the target tasks with abnormalities are marked as abnormal tasks through a decision support model; wherein the abnormal tasks do not conform to a preset expected pattern, or the correlation between the abnormal tasks and other target tasks is lower than a preset abnormal value.

其中,示例性地,采用具有噪声的基于密度的空间聚类(Density-Based SpatialClustering of Applications with Noise,DBSCAN)来构建决策支持模型。DBSCAN是一种密度聚类算法,它可以自动地将具有相似密度的样本聚集在一起,并将数据点分为不同的类别。DBSCAN将样本点分为核心点、边界点和噪声点。核心点是某个半径内所包含的样本点数目达到最小值,即密度达到某种程度的样本点。而边界点是某个半径内包含的样本点数目小于最小值但距离核心点又在半径之内的样本点。噪声点则不属于任何类别。DBSCAN算法通过计算样本点之间的距离和密度,实现对数据的聚类和噪声点的过滤处理。Among them, by way of example, a density-based spatial clustering of applications with noise (DBSCAN) is used to construct a decision support model. DBSCAN is a density clustering algorithm that can automatically cluster samples with similar density and classify data points into different categories. DBSCAN divides sample points into core points, boundary points, and noise points. A core point is a sample point whose number of sample points within a certain radius reaches a minimum value, that is, a sample point whose density reaches a certain level. A boundary point is a sample point whose number of sample points within a certain radius is less than the minimum value but whose distance from the core point is within the radius. Noise points do not belong to any category. The DBSCAN algorithm achieves data clustering and noise point filtering by calculating the distance and density between sample points.

这里,决策支持模块12能够通过聚类分析、优先级执行顺序确定和异常任务标记等功能,提高任务分类和管理效率,优化任务优先级执行顺序,标记异常任务和快速反应,实现智能决策制定。这些功能能够显著提高工作流的执行质量和效率,具有重要的应用价值。Here, the decision support module 12 can improve the efficiency of task classification and management, optimize the priority execution order of tasks, mark abnormal tasks and respond quickly, and realize intelligent decision making through functions such as cluster analysis, priority execution order determination and abnormal task marking. These functions can significantly improve the execution quality and efficiency of workflows and have important application value.

作为一个可选实施例,决策支持模块12通过决策支持模型对所述目标任务进行聚类分析,以获得聚类结果时,具体用于:As an optional embodiment, when the decision support module 12 performs cluster analysis on the target task through the decision support model to obtain the clustering result, it is specifically used to:

根据所述目标任务的目标聚类特征以及距离度量,计算各个目标任务的数据点密度;若目标任务在特定半径内的数据点密度超过最小邻居密度,则以所述目标任务为核心数据特征;将与核心数据特征密度相似的目标任务划分到同一簇,得到所述聚类结果。According to the target clustering features and distance metrics of the target tasks, the data point density of each target task is calculated; if the data point density of the target task within a specific radius exceeds the minimum neighbor density, the target task is taken as the core data feature; the target tasks with similar densities to the core data feature are divided into the same cluster to obtain the clustering results.

其中,所述目标聚类特征至少包括如下之一:CPU利用率、内存使用量、I/O数据。所述距离度量为曼哈顿距离。The target clustering feature includes at least one of the following: CPU utilization, memory usage, and I/O data. The distance metric is Manhattan distance.

示例性地,决策支持模块12中的聚类分析过程可以根据目标任务的目标聚类特征和距离度量来计算数据点密度,并将密度相似的目标任务划分到同一簇。以下是一个示例来说明决策支持模块12的聚类分析功能,首先,选择以下目标聚类特征之一:CPU利用率。并将收集每个任务的CPU利用率数据。使用曼哈顿距离(Manhattan Distance)作为距离度量,曼哈顿距离是一个基于各个特征之间差异的距离度量方法。针对每个目标任务,计算其与其他目标任务之间的曼哈顿距离,并统计在特定半径内的数据点数量。如果数据点密度超过最小邻居密度(设定的阈值),则将该目标任务作为核心数据特征。进而,将所有与核心数据特征密度相似的目标任务划分到同一簇。例如,最终的聚类结果可能是将图像处理任务聚在一起,将文本处理任务聚在一起,将音频处理任务聚在一起。进而,基于聚类结果和相关性,决策支持模型可以确定各个簇的优先级执行顺序。通过分析不同簇的任务特性和依赖关系,可以决定哪个簇的任务应该在其他簇之前执行,以最大程度地提高执行效率。在这个示例中,决策支持模块12使用目标聚类特征(例如CPU利用率)、距离度量(曼哈顿距离)和数据点密度计算来实现目标任务的聚类分析。这种聚类分析能够帮助理解不同任务之间的相似性,并为制定优先级执行顺序提供依据,从而提高任务执行的效率和质量。Exemplarily, the clustering analysis process in the decision support module 12 can calculate the data point density according to the target clustering feature and distance metric of the target task, and divide the target tasks with similar density into the same cluster. The following is an example to illustrate the clustering analysis function of the decision support module 12. First, select one of the following target clustering features: CPU utilization. And collect the CPU utilization data of each task. Manhattan distance is used as the distance metric, which is a distance metric method based on the difference between each feature. For each target task, the Manhattan distance between it and other target tasks is calculated, and the number of data points within a specific radius is counted. If the data point density exceeds the minimum neighbor density (the set threshold), the target task is used as the core data feature. Then, all target tasks with similar density to the core data feature are divided into the same cluster. For example, the final clustering result may be to cluster image processing tasks together, text processing tasks together, and audio processing tasks together. Then, based on the clustering results and correlation, the decision support model can determine the priority execution order of each cluster. By analyzing the task characteristics and dependencies of different clusters, it can be determined which cluster's tasks should be executed before other clusters to maximize execution efficiency. In this example, the decision support module 12 uses target clustering features (such as CPU utilization), distance metrics (Manhattan distance), and data point density calculation to implement cluster analysis of target tasks. This cluster analysis can help understand the similarities between different tasks and provide a basis for formulating a priority execution order, thereby improving the efficiency and quality of task execution.

在这个示例中,假设有N个目标任务,其中第i个任务的CPU利用率为x_i。使用曼哈顿距离作为距离度量,这意味着要计算每对目标任务之间的距离,这些距离可以表示为:In this example, assume that there are N target tasks, where the CPU utilization of the i-th task is x_i. Using Manhattan distance as the distance metric means calculating the distance between each pair of target tasks, which can be expressed as:

d(i,j) = |x_i - x_j|;d(i,j) = |x_i - x_j|;

在计算数据点密度时,需要确定每个核心数据特征的半径和最小邻居密度。假设使用R作为半径,k作为最小邻居密度,则对于每个目标任务i,需要计算出距离该任务在半径R内的其他任务的数量n_i,然后检查n_i是否至少等于k。如果是,那么将任务i标记为一个核心数据特征。数学表达式为:When calculating the density of data points, it is necessary to determine the radius and minimum neighbor density of each core data feature. Assuming R is used as the radius and k is used as the minimum neighbor density, for each target task i, it is necessary to calculate the number of other tasks n_i within the radius R from the task, and then check whether n_i is at least equal to k. If so, then mark task i as a core data feature. The mathematical expression is:

n_i = ∑_{j=1, j ≠ i}^N [d(i,j) ≤ R];n_i = ∑_{j=1, j ≠ i}^N [d(i,j) ≤ R];

如果n_i ≥ k,则任务i是核心数据特征。If n_i ≥ k, then task i is a core data feature.

通过这些计算,可以将目标任务划分为不同的簇,并确定它们的优先级执行顺序,以实现更高效的任务管理和执行。Through these calculations, the target tasks can be divided into different clusters and their priority execution order can be determined to achieve more efficient task management and execution.

作为一个可选实施例,决策支持模块12基于所述聚类结果以及所述相关性,通过决策支持模型确定各组目标任务的优先级执行顺序时,具体用于:As an optional embodiment, when the decision support module 12 determines the priority execution order of each group of target tasks through a decision support model based on the clustering result and the correlation, it is specifically used to:

从所述聚类结果中获取各个目标任务所属的簇类别,并获取各个目标任务与其他任务之间的相关性;对所述各个目标任务与其他任务之间的相关性进行量化处理,以得到相关性度量;以所述聚类结果和所述相关性度量作为所述决策支持模型的输入,通过所述决策支持模型输出各组目标任务的优先级得分;对各组目标任务的优先级得分进行排序,以得到各组目标任务的优先级执行顺序。The cluster category to which each target task belongs is obtained from the clustering result, and the correlation between each target task and other tasks is obtained; the correlation between each target task and other tasks is quantified to obtain a correlation measure; the clustering result and the correlation measure are used as inputs of the decision support model, and the priority score of each group of target tasks is output through the decision support model; the priority score of each group of target tasks is sorted to obtain the priority execution order of each group of target tasks.

示例性地,假设有一组目标任务,其中包括图像处理任务、文本处理任务和音频处理任务。基于假设,从聚类结果中获取各个目标任务所属的簇类别。例如,将音频处理任务聚类到簇A中,文本处理和图像处理任务聚类到簇B中。然后,将获取各个任务之间的相关性度量,例如处理文本任务需要依赖图像处理任务,这说明两个任务具有较高的相关性。将这些相关性量化处理为数值,例如,可以使用相关系数或互信息等度量方法将相似性转换为得分。接下来,将聚类结果和相关性度量作为输入到决策支持模型中。决策支持模型可以采用多种算法,例如模糊逻辑、神经网络、模拟退火算法等,根据输入数据计算得到各个簇的任务优先级得分。通过这个过程,可以得到每个簇的目标任务的优先级得分,例如,簇A的音频处理任务可以得到80分,而簇B的文本处理任务可以得到70分。这些得分可以帮助确定每个簇的任务执行优先级。最后,可以将每个簇的任务按照得分进行排序,以确定每个簇的任务执行顺序。在本示例中,可能会按照簇A、簇B的顺序执行任务,也可能确定某些任务的执行顺序,例如对于簇A,可能先执行音频处理任务以确保其在时间上的完成性。通过这个示例,可以看到,决策支持模块可以通过聚类分析和相关性度量,帮助理解不同任务之间的相关性,从而制定出更优的任务执行顺序。这种过程可以提高任务执行的效率和质量,并提高决策制定的准确性。Exemplarily, it is assumed that there is a set of target tasks, including image processing tasks, text processing tasks and audio processing tasks. Based on the assumption, the cluster category to which each target task belongs is obtained from the clustering results. For example, the audio processing task is clustered into cluster A, and the text processing and image processing tasks are clustered into cluster B. Then, the correlation measure between each task is obtained, for example, the processing of the text task needs to rely on the image processing task, which shows that the two tasks have a high correlation. These correlations are quantified and processed into numerical values. For example, similarity can be converted into scores using measurement methods such as correlation coefficients or mutual information. Next, the clustering results and the correlation measure are used as inputs to the decision support model. The decision support model can use a variety of algorithms, such as fuzzy logic, neural networks, simulated annealing algorithms, etc., to calculate the task priority scores of each cluster based on the input data. Through this process, the priority scores of the target tasks of each cluster can be obtained. For example, the audio processing task of cluster A can get 80 points, while the text processing task of cluster B can get 70 points. These scores can help determine the task execution priority of each cluster. Finally, the tasks of each cluster can be sorted according to the scores to determine the task execution order of each cluster. In this example, tasks may be executed in the order of cluster A and cluster B, or the execution order of certain tasks may be determined. For example, for cluster A, the audio processing task may be executed first to ensure its completion in time. Through this example, we can see that the decision support module can help understand the correlation between different tasks through cluster analysis and correlation measurement, so as to formulate a better task execution order. This process can improve the efficiency and quality of task execution and improve the accuracy of decision making.

作为一个可选实施例,各个目标任务与其他任务之间的相关性至少包括目标任务之间的相似度。基于此,决策支持模块12,对所述各个目标任务与其他任务之间的相关性进行量化处理,以得到相关性度量时,具体用于:As an optional embodiment, the correlation between each target task and other tasks at least includes the similarity between the target tasks. Based on this, the decision support module 12 quantifies the correlation between each target task and other tasks to obtain the correlation measurement, which is specifically used for:

对各个目标任务间的聚类特征进行欧式距离计算,以得到各个目标任务间的相似度;其中,各个目标任务之间的相似度越高,各个目标任务的聚类特征越接近,各个目标任务之间的相关性。The Euclidean distance between the clustering features of each target task is calculated to obtain the similarity between each target task; the higher the similarity between each target task, the closer the clustering features of each target task are, and the higher the correlation between each target task.

在决策支持模块中,对各个目标任务与其他任务之间的相关性进行量化处理时,可以使用欧式距离计算来获得各个目标任务间的相似度。以下是一个具体的计算过程示例,假设有三个目标任务:任务A、任务B和任务C。将使用欧式距离计算来量化它们之间的相似度。In the decision support module, when quantifying the correlation between each target task and other tasks, the Euclidean distance calculation can be used to obtain the similarity between each target task. The following is an example of a specific calculation process. Assume that there are three target tasks: Task A, Task B, and Task C. The Euclidean distance calculation will be used to quantify the similarity between them.

首先,需要确定任务A、任务B和任务C的聚类特征。假设选择CPU利用率作为聚类特征,并收集了每个任务的CPU利用率数据。First, we need to determine the clustering features of Task A, Task B, and Task C. Assume that CPU utilization is selected as the clustering feature and the CPU utilization data of each task is collected.

假设任务A的CPU利用率数据为 [60, 70, 80],任务B的CPU利用率数据为 [65,75, 85],任务C的CPU利用率数据为 [50, 75, 90]。Assume that the CPU utilization data of task A is [60, 70, 80], the CPU utilization data of task B is [65,75, 85], and the CPU utilization data of task C is [50, 75, 90].

然后,可以使用欧式距离计算来计算任务A、任务B和任务C之间的相似度。欧式距离可以表示为:Then, the Euclidean distance calculation can be used to calculate the similarity between Task A, Task B, and Task C. The Euclidean distance can be expressed as:

d(A, B) = sqrt((60-65)^2 + (70-75)^2 + (80-85)^2);d(A, B) = sqrt((60-65)^2 + (70-75)^2 + (80-85)^2);

d(A, C) = sqrt((60-50)^2 + (70-75)^2 + (80-90)^2);d(A, C) = sqrt((60-50)^2 + (70-75)^2 + (80-90)^2);

d(B, C) = sqrt((65-50)^2 + (75-75)^2 + (85-90)^2);d(B, C) = sqrt((65-50)^2 + (75-75)^2 + (85-90)^2);

通过计算,可以得到任务A与任务B的欧式距离d(A, B),任务A与任务C的欧式距离d(A, C),以及任务B与任务C的欧式距离d(B, C)。By calculation, we can obtain the Euclidean distance d(A, B) between task A and task B, the Euclidean distance d(A, C) between task A and task C, and the Euclidean distance d(B, C) between task B and task C.

接下来,可以使用这些欧式距离计算结果来量化任务之间的相似度。一种常用的方法是使用相似度度量,它可以表示为:Next, we can use these Euclidean distance calculations to quantify the similarity between tasks. A common approach is to use a similarity metric, which can be expressed as:

相似度 = 1 / (1 + 距离);Similarity = 1 / (1 + distance);

因此,可以计算出任务A与任务B、任务A与任务C、任务B与任务C之间的相似度,如下所示:Therefore, the similarity between task A and task B, task A and task C, and task B and task C can be calculated as follows:

相似度(A, B) = 1 / (1 + d(A, B));similarity(A, B) = 1 / (1 + d(A, B));

相似度(A, C) = 1 / (1 + d(A, C));similarity(A, C) = 1 / (1 + d(A, C));

相似度(B, C) = 1 / (1 + d(B, C));similarity(B, C) = 1 / (1 + d(B, C));

在本示例中,假设计算结果如下:In this example, assume the following calculations:

相似度(A, B) ≈ 0.098;Similarity(A, B) ≈ 0.098;

相似度(A, C) ≈ 0.071;Similarity(A, C) ≈ 0.071;

相似度(B, C) ≈ 0.071;Similarity(B, C) ≈ 0.071;

通过这个计算过程,可以量化任务A、任务B和任务C之间的相似度。这些相似度值可以用于决策支持模块中进行进一步的分析和计算,以确定各个目标任务的优先级执行顺序。Through this calculation process, the similarities between Task A, Task B, and Task C can be quantified. These similarity values can be used for further analysis and calculation in the decision support module to determine the priority execution order of each target task.

作为一个可选实施例,各个目标任务与其他任务之间的相关性至少包括资源竞争关系。基于此,决策支持模块12,对所述各个目标任务与其他任务之间的相关性进行量化处理,以得到相关性度量时,具体用于:As an optional embodiment, the correlation between each target task and other tasks at least includes resource competition. Based on this, the decision support module 12 quantifies the correlation between each target task and other tasks to obtain the correlation measurement, which is specifically used for:

若不同目标任务存在资源竞争关系,则量化不同目标任务对每种算力资源的需求度,并基于所述需求度确定各个目标任务与其他任务之间的相关性;其中,多个目标任务对同一种算力资源的需求度越高,所述多个目标任务之间的相关性越高。If there is a resource competition relationship between different target tasks, the demand of different target tasks for each computing resource is quantified, and the correlation between each target task and other tasks is determined based on the demand; among which, the higher the demand of multiple target tasks for the same computing resource, the higher the correlation between the multiple target tasks.

在决策支持模块中,针对各个目标任务与其他任务之间的资源竞争关系,可以量化不同目标任务对每种算力资源的需求度,并基于需求度来确定任务之间的相关性。以下是一个具体的计算过程示例,假设有三个目标任务:任务A、任务B和任务C。基于此假设,将使用算力资源作为需要进行竞争的资源。首先,需要确定每个任务对算力资源的需求度。假设任务A需要 70% 的算力资源,任务B需要 80% 的算力资源,任务C需要 65% 的算力资源。然后,可以基于需求度来计算任务之间的相关性。使用线性相关性,其中相关性可以表示为两个任务对同一种算力资源需求度的加权平均值。在本示例中,可以计算出任务A与任务B、任务A与任务C、任务B与任务C之间的相关性,如下所示:In the decision support module, the demand for each computing resource of different target tasks can be quantified for the resource competition relationship between each target task and other tasks, and the correlation between tasks can be determined based on the demand. The following is an example of a specific calculation process, assuming that there are three target tasks: Task A, Task B, and Task C. Based on this assumption, computing resources will be used as resources that need to be competed. First, the demand for computing resources of each task needs to be determined. Assume that Task A requires 70% of computing resources, Task B requires 80% of computing resources, and Task C requires 65% of computing resources. Then, the correlation between tasks can be calculated based on the demand. Linear correlation is used, where the correlation can be expressed as the weighted average of the demand for the same computing resource of two tasks. In this example, the correlation between Task A and Task B, Task A and Task C, and Task B and Task C can be calculated as follows:

相关性(A, B) = (需求度(A) + 需求度(B)) / 2;Correlation(A, B) = (Demand(A) + Demand(B)) / 2;

相关性(A, C) = (需求度(A) + 需求度C) / 2;Correlation(A, C) = (Demand(A) + DemandC) / 2;

相关性(B, C) = (需求度(B) + 需求度C) / 2;Correlation(B, C) = (Demand(B) + DemandC) / 2;

通过计算,可以得到任务A与任务B、任务A与任务C、任务B与任务C之间的相关性:Through calculation, we can get the correlation between task A and task B, task A and task C, and task B and task C:

相关性(A, B) = (70 + 80) / 2 = 75;Correlation(A, B) = (70 + 80) / 2 = 75;

相关性(A, C) = (70 + 65) / 2 = 67.5;Correlation(A, C) = (70 + 65) / 2 = 67.5;

相关性(B, C) = (80 + 65) / 2 = 72.5;Correlation(B, C) = (80 + 65) / 2 = 72.5;

这样,就可以量化任务A、任务B和任务C之间的相关性。这些相关性值可以用于决策支持模块中进行进一步的分析和计算,以确定各个目标任务的优先级执行顺序。In this way, the correlation between Task A, Task B, and Task C can be quantified. These correlation values can be used for further analysis and calculation in the decision support module to determine the priority execution order of each target task.

作为一个可选实施例,各个目标任务与其他任务之间的相关性至少包括前后任务依赖关系。基于此,决策支持模块12,对所述各个目标任务与其他任务之间的相关性进行量化处理,以得到相关性度量时,具体用于:As an optional embodiment, the correlation between each target task and other tasks at least includes the dependency relationship between previous and next tasks. Based on this, the decision support module 12 quantifies the correlation between each target task and other tasks to obtain the correlation measurement, which is specifically used for:

将各个目标任务之间的依赖关系转化为有向图模型;获取各个目标任务的依赖节点数量和子节点数量,并以各个目标任务之间的依赖程度和依赖方向作为任务依赖关系权值;通过计算每个任务依赖关系权值得到各个目标任务之间的相关性度量。The dependency relationship between each target task is converted into a directed graph model; the number of dependent nodes and the number of sub-nodes of each target task are obtained, and the degree of dependency and the direction of dependency between each target task are used as the task dependency weight; the correlation measurement between each target task is obtained by calculating the weight of each task dependency.

示例性地,在决策支持模块12中,针对各个目标任务与其他任务之间的前后任务依赖关系,可以将依赖关系转化为有向图模型,并通过节点数量和依赖方向来量化任务之间的相关性。以下是一个具体的计算过程示例,假设有三个目标任务:任务A、任务B和任务C。将使用有向图模型来表示任务之间的依赖关系。首先,根据任务之间的依赖关系,可以构建以下有向图模型:For example, in the decision support module 12, for the dependencies between each target task and other tasks, the dependencies can be converted into a directed graph model, and the correlation between the tasks can be quantified by the number of nodes and the dependency direction. The following is an example of a specific calculation process, assuming that there are three target tasks: Task A, Task B, and Task C. A directed graph model will be used to represent the dependencies between tasks. First, according to the dependencies between tasks, the following directed graph model can be constructed:

任务A → 任务BTask A → Task B

任务CTask C

然后,可以获取每个任务的依赖节点数量和子节点数量,并以依赖程度和依赖方向作为任务依赖关系的权值。在这个示例中,任务A有1个依赖节点(任务A依赖于任务B)和2个子节点(任务B和任务C);任务B有0个依赖节点和0个子节点;任务C有1个依赖节点(任务A)和0个子节点。接下来,可以根据依赖节点数量和子节点数量计算任务之间的相关性度量。一种常用的计算方法是使用加权度量,其中任务之间的相关性度量可以表示为:Then, the number of dependent nodes and the number of child nodes of each task can be obtained, and the degree of dependency and the direction of dependency can be used as the weight of the task dependency relationship. In this example, Task A has 1 dependent node (Task A depends on Task B) and 2 child nodes (Task B and Task C); Task B has 0 dependent nodes and 0 child nodes; Task C has 1 dependent node (Task A) and 0 child nodes. Next, the correlation measure between tasks can be calculated based on the number of dependent nodes and the number of child nodes. A commonly used calculation method is to use a weighted measure, where the correlation measure between tasks can be expressed as:

相关性度量 = α * 依赖节点数量 + β * 子节点数量Relevance measure = α * number of dependent nodes + β * number of child nodes

其中,α和β是权衡依赖程度和依赖方向的因子。Among them, α and β are factors that weigh the degree and direction of dependence.

在本示例中,假设选择α = 0.6和β = 0.4进行计算:In this example, we assume that α = 0.6 and β = 0.4 are chosen for calculation:

相关性度量(A, B) = 0.6 * 1 + 0.4 * 2 = 1.4;Correlation measure (A, B) = 0.6 * 1 + 0.4 * 2 = 1.4;

相关性度量(A, C) = 0.6 * 1 + 0.4 * 0 = 0.6;Correlation measure (A, C) = 0.6 * 1 + 0.4 * 0 = 0.6;

相关性度量(B, C) = 0.6 * 0 + 0.4 * 0 = 0;Correlation measure (B, C) = 0.6 * 0 + 0.4 * 0 = 0;

这样,就得到了任务A、任务B和任务C之间的相关性度量。这些相关性度量可以用于决策支持模块中进行进一步的分析和计算,以确定各个目标任务的优先级执行顺序。In this way, the correlation measures between Task A, Task B and Task C are obtained. These correlation measures can be used for further analysis and calculation in the decision support module to determine the priority execution order of each target task.

作为一个可选实施例,决策支持模块12,根据所述聚类结果,通过决策支持模型将存在异常的目标任务标记为异常任务时,具体用于:As an optional embodiment, the decision support module 12, when marking the target task with abnormalities as an abnormal task through the decision support model according to the clustering result, is specifically used to:

确定各个目标任务的预设期望模式:所述预设期望模式包括不同簇中各个目标任务之间的期望模式、或者同一簇中各个目标任务的期望模式;根据各个目标任务间的相似度、资源竞争关系和/或前后任务依赖关系,获取待判定目标任务与其他目标任务之间的异常值;通过决策支持模型,基于所述异常值从各个目标任务中定位并标记所述异常任务。Determine the preset expected pattern of each target task: the preset expected pattern includes the expected pattern between each target task in different clusters, or the expected pattern of each target task in the same cluster; obtain the outlier between the target task to be determined and other target tasks according to the similarity, resource competition relationship and/or previous and subsequent task dependency relationship between each target task; locate and mark the abnormal task from each target task based on the outlier value through a decision support model.

另一个可选实施例,决策支持模块12还用于定期评估标记结果,检查分类结果的准确性、误报率等。根据实际情况,需要不断优化决策支持模型的参数和算法,以提高异常任务的识别精度。In another optional embodiment, the decision support module 12 is also used to regularly evaluate the labeling results, check the accuracy of the classification results, the false alarm rate, etc. According to the actual situation, it is necessary to continuously optimize the parameters and algorithms of the decision support model to improve the recognition accuracy of abnormal tasks.

示例性地,假设有一组目标任务,并使用聚类算法将它们划分为不同的簇。在每个簇中,可以确定各个目标任务的预设期望模式。For example, suppose there is a set of target tasks, and use a clustering algorithm to divide them into different clusters. In each cluster, a preset expected mode of each target task can be determined.

对于不同簇中的目标任务,可以观察它们的期望模式,了解它们在相同簇中的典型行为。这些期望模式可以基于目标任务的指标、特征或行为来定义。例如,对于某个簇内的目标任务,期望模式可能是每天产生特定数量的输出。对于同一簇中的目标任务,可以比较它们的期望模式,以检测异常情况。通过计算目标任务之间的相似度、资源竞争关系和/或前后任务依赖关系,可以获取待判定目标任务与其他目标任务之间的异常值。For target tasks in different clusters, their expected patterns can be observed to understand their typical behaviors in the same cluster. These expected patterns can be defined based on the indicators, characteristics, or behaviors of the target tasks. For example, for a target task in a cluster, the expected pattern may be to produce a specific number of outputs per day. For target tasks in the same cluster, their expected patterns can be compared to detect anomalies. By calculating the similarity, resource competition relationship, and/or previous and next task dependencies between target tasks, outliers between the target task to be determined and other target tasks can be obtained.

通过决策支持模型,可以利用这些异常值来定位并标记异常任务。具体方法可能包括设置异常阈值或应用异常检测算法来判断目标任务是否偏离了预设期望模式。如果目标任务的指标或行为与预设期望模式明显不符,那么可以将其标记为异常任务。Through decision support models, these outliers can be used to locate and mark abnormal tasks. Specific methods may include setting anomaly thresholds or applying anomaly detection algorithms to determine whether the target task deviates from the preset expected pattern. If the indicators or behaviors of the target task are obviously inconsistent with the preset expected pattern, then it can be marked as an abnormal task.

标记异常任务的好处是,在后续的决策过程中,可以针对异常任务进行特殊处理,例如分配额外的资源、调整任务优先级或进行其他干预措施,以确保整个系统的正常运行。The benefit of marking abnormal tasks is that in the subsequent decision-making process, special treatment can be given to abnormal tasks, such as allocating additional resources, adjusting task priorities, or taking other intervention measures to ensure the normal operation of the entire system.

这种基于聚类结果和决策支持模型的标记异常任务的方法可以帮助运营人员及时发现和解决潜在问题,提高系统的可靠性和效率。This method of marking abnormal tasks based on clustering results and decision support models can help operators discover and solve potential problems in a timely manner and improve the reliability and efficiency of the system.

自适应优化学习模块14,用于通过优化奖励模型以所述聚类结果对应的质量评估值和/或性能指标为奖励项,对决策支持模型中的超参数组合进行动态优化,以获得最佳超参数组合;根据所述聚类结果对应的质量评估值和/或性能指标,对决策支持模型执行簇合并操作,以提升所述聚类结果的鲁棒性。The adaptive optimization learning module 14 is used to dynamically optimize the hyperparameter combination in the decision support model by optimizing the reward model with the quality evaluation value and/or performance index corresponding to the clustering result as the reward item to obtain the best hyperparameter combination; according to the quality evaluation value and/or performance index corresponding to the clustering result, perform a cluster merging operation on the decision support model to improve the robustness of the clustering result.

通过自适应优化学习模块14,一方面,通过优化奖励模型,结合聚类结果对应的质量评估值和/或性能指标作为奖励项,可以在决策支持模型中自动优化超参数组合。这样可以提高决策支持模型的性能,并最大程度地满足系统的需求和约束条件。通过动态优化超参数,系统可以自动学习和调整超参数,以适应不同的场景和任务需求。另一方面,根据聚类结果对应的质量评估值和/或性能指标,在决策支持模型中执行簇合并操作可以提升聚类结果的鲁棒性。簇合并操作可以将相似的任务或目标归为一类,减少聚类结果中的噪音或异常情况的影响,提高聚类结果的准确性和可靠性。这样可以帮助系统更好地理解目标任务之间的关系,提供更准确和可靠的决策支持。总而言之,通过自适应优化学习模块14的应用,可以将聚类结果和质量评估指标结合起来,对决策支持模型进行智能化的调整和优化。这种动态优化的方法可以提升系统的性能和鲁棒性,帮助系统更好地适应和应对不同的任务和环境变化,实现更高效和可靠的决策支持。Through the adaptive optimization learning module 14, on the one hand, by optimizing the reward model, combining the quality evaluation value and/or performance index corresponding to the clustering result as a reward item, the hyperparameter combination can be automatically optimized in the decision support model. This can improve the performance of the decision support model and meet the system's requirements and constraints to the greatest extent. By dynamically optimizing the hyperparameters, the system can automatically learn and adjust the hyperparameters to adapt to different scenarios and task requirements. On the other hand, according to the quality evaluation value and/or performance index corresponding to the clustering result, performing a cluster merging operation in the decision support model can improve the robustness of the clustering result. The cluster merging operation can classify similar tasks or targets into one category, reduce the impact of noise or abnormal conditions in the clustering results, and improve the accuracy and reliability of the clustering results. This can help the system better understand the relationship between the target tasks and provide more accurate and reliable decision support. In short, through the application of the adaptive optimization learning module 14, the clustering results and quality evaluation indicators can be combined to intelligently adjust and optimize the decision support model. This dynamic optimization method can improve the performance and robustness of the system, help the system better adapt to and respond to different tasks and environmental changes, and achieve more efficient and reliable decision support.

作为一个可选实施例,自适应优化学习模块14,根据所述聚类结果对应的质量评估值和/或性能指标,对决策支持模型执行簇合并操作,以提升所述聚类结果的鲁棒性时,具体用于:As an optional embodiment, the adaptive optimization learning module 14 performs a cluster merging operation on the decision support model according to the quality evaluation value and/or performance index corresponding to the clustering result to improve the robustness of the clustering result, specifically for:

根据所述聚类结果的质量评估值和/或性能指标,对每个簇的性能进行评估,以得到每个簇的评估指标;所述评估指标至少包括以下之一:轮廓系数、内部距离、类间距离;所述评估指标用于衡量簇的紧密度和分离度;对决策支持模型中符合合并条件的分簇结果进行质心合并;将合并结果更新到所述聚类结果中,得到更新后的聚类结果,并对更新后的每个簇的标签进行更新,以对决策支持模型进行后续的自适应优化和处理。According to the quality evaluation value and/or performance index of the clustering result, the performance of each cluster is evaluated to obtain the evaluation index of each cluster; the evaluation index includes at least one of the following: silhouette coefficient, internal distance, and inter-class distance; the evaluation index is used to measure the compactness and separation of the cluster; the clustering results that meet the merging conditions in the decision support model are centroidally merged; the merged result is updated to the clustering result to obtain the updated clustering result, and the label of each updated cluster is updated to perform subsequent adaptive optimization and processing on the decision support model.

具体来说,以下是一个可选实施例的具体计算过程:首先,根据聚类结果的质量评估值和/或性能指标,对每个簇的性能进行评估,以得到每个簇的评估指标。这些评估指标可以包括轮廓系数、内部距离、类间距离等。这些指标可以用于衡量簇的紧密度和分离度,即簇内的数据之间距离应尽可能小,而簇与簇之间的距离应尽可能大。进而,根据评估指标,可以对决策支持模型中符合合并条件的簇进行质心合并。具体来说,可以对相似度较高、评估指标较接近、距离较近的簇进行合并,以减少聚类结果中的噪音和异常情况,提高聚类结果的准确性和可靠性。合并之后,将合并结果更新到聚类结果中,得到更新后的聚类结果。为了保持一致性,还需要对更新后的每个簇的标签进行更新,以便后续的自适应优化和处理。标签的更新可以基于新的簇质心计算得到。通过这种自适应优化学习模块14,可以结合聚类结果的质量评估值和/或性能指标进行簇合并操作,从而提高聚类结果的准确性和可靠性。这种自适应优化学习模块14可以帮助系统更好地理解目标任务之间的关系,并提供更准确和可靠的决策支持。Specifically, the following is a specific calculation process of an optional embodiment: First, the performance of each cluster is evaluated according to the quality evaluation value and/or performance index of the clustering result to obtain the evaluation index of each cluster. These evaluation indexes may include silhouette coefficient, internal distance, inter-class distance, etc. These indexes can be used to measure the compactness and separation of the cluster, that is, the distance between the data in the cluster should be as small as possible, and the distance between the clusters should be as large as possible. Then, according to the evaluation index, the clusters that meet the merging conditions in the decision support model can be merged by centroid. Specifically, clusters with high similarity, close evaluation indexes, and close distances can be merged to reduce noise and abnormalities in the clustering results and improve the accuracy and reliability of the clustering results. After merging, the merged results are updated to the clustering results to obtain the updated clustering results. In order to maintain consistency, it is also necessary to update the labels of each updated cluster for subsequent adaptive optimization and processing. The update of the label can be calculated based on the new cluster centroid. Through this adaptive optimization learning module 14, the cluster merging operation can be performed in combination with the quality evaluation value and/or performance index of the clustering result, thereby improving the accuracy and reliability of the clustering result. This adaptive optimization learning module 14 can help the system better understand the relationship between the target tasks and provide more accurate and reliable decision support.

报告展示模块15,用于响应于用户操作,提供对所述目标任务的交互式分析,并向用户展示分析得到的所述目标任务的工作流信息,所述工作流信息包括任务执行状态、任务成功率、任务异常信息、资源分配情况。The report display module 15 is used to provide interactive analysis of the target task in response to user operations, and display the workflow information of the target task obtained by analysis to the user, wherein the workflow information includes task execution status, task success rate, task exception information, and resource allocation status.

在报告展示模块中,可以根据用户的操作请求,提供对目标任务的交互式分析,并向用户展示分析得到的工作流信息,包括任务执行状态、任务成功率、任务异常信息、资源分配情况等。以下是一个举例说明:In the report display module, interactive analysis of the target task can be provided according to the user's operation request, and the workflow information obtained from the analysis can be displayed to the user, including task execution status, task success rate, task exception information, resource allocation, etc. The following is an example:

假设某个企业已经使用WeTab平台来管理其业务流程,并通过前面的模块获取了关于目标任务的聚类结果和质量评估信息。此时,企业的可以通过报告展示模块,对其业务流程进行深入分析和监测,以监控和改进整个业务流程的执行效率和准确性。首先,可以通过报告展示模块,选择需要进行分析的目标任务并进行查询。例如,可以选择对某个簇内的目标任务进行查询和分析。其次,报告展示模块将会展示该簇内各个目标任务的工作流信息,包括任务执行状态、任务成功率、任务异常信息、资源分配情况等。例如,可以展示一个任务在过去一段时间内的执行情况,包括任务完成时间、资源使用情况等。并且,如果这个任务存在异常或出现故障时,可以展示相关的异常信息和处理记录。在此基础上,可以进行交互式的分析和比较,例如对比同一簇内不同任务的执行情况,或者比较不同簇之间的任务执行效率和准确性。并且,管理员员可以做出相关的决策或调整,例如增加或减少某项资源的分配,更改任务的运行顺序等,以提高整个业务流程的效率和准确性。Assume that an enterprise has used the WeTab platform to manage its business processes, and has obtained the clustering results and quality assessment information about the target tasks through the previous modules. At this point, the enterprise can use the report display module to conduct in-depth analysis and monitoring of its business processes to monitor and improve the execution efficiency and accuracy of the entire business process. First, you can select the target tasks that need to be analyzed and query them through the report display module. For example, you can choose to query and analyze the target tasks in a cluster. Secondly, the report display module will display the workflow information of each target task in the cluster, including task execution status, task success rate, task exception information, resource allocation, etc. For example, you can display the execution of a task in the past period of time, including task completion time, resource usage, etc. And, if there is an exception or failure in this task, you can display the relevant exception information and processing records. On this basis, interactive analysis and comparison can be carried out, such as comparing the execution of different tasks in the same cluster, or comparing the execution efficiency and accuracy of tasks between different clusters. In addition, administrators can make relevant decisions or adjustments, such as increasing or decreasing the allocation of a certain resource, changing the running order of tasks, etc., to improve the efficiency and accuracy of the entire business process.

通过这种方式,报告展示模块可以为企业提供及时、准确和有用的业务流程信息,在监控和改进业务流程方面发挥重要作用。In this way, the report display module can provide enterprises with timely, accurate and useful business process information, playing an important role in monitoring and improving business processes.

本申请实施例中,通过实时动态调整资源弹性分配策略,系统可以根据实际工作负载进行算力弹性调配,避免工作负载不平衡,进而提高任务的处理效率和响应速度。通过决策支持模型,系统可以对目标任务进行聚类分析和优先级执行顺序的确定,从而实现智能任务管理和调度,提高工作流中任务的处理准确性和优先级,减少任务处理时间。通过自适应优化学习模块,系统能够根据实际工作负载和质量评估值/性能指标动态优化决策支持模型中的超参数组合,提高模型的预测和决策准确性,进一步提升决策支持系统的智能化水平和性能表现。报告展示模块提供交互式分析和展示功能,用户可以通过界面直观地了解工作流的执行状态、成功率、异常信息和资源分配情况等,便于快速发现问题、优化调整和决策制定。综上所述,该系统能够提高工作流的处理效率和准确性,实现智能化任务管理和调度,优化决策支持模型的性能,同时提供全面的展示和分析功能,增强用户对工作流执行状态和结果的了解,有助于提升企业的生产效率和决策水平。In the embodiment of the present application, by dynamically adjusting the resource elastic allocation strategy in real time, the system can perform elastic allocation of computing power according to the actual workload, avoid workload imbalance, and thus improve the processing efficiency and response speed of tasks. Through the decision support model, the system can cluster the target tasks and determine the priority execution order, thereby realizing intelligent task management and scheduling, improving the processing accuracy and priority of tasks in the workflow, and reducing the task processing time. Through the adaptive optimization learning module, the system can dynamically optimize the hyperparameter combination in the decision support model according to the actual workload and quality evaluation value/performance index, improve the prediction and decision accuracy of the model, and further improve the intelligence level and performance of the decision support system. The report display module provides interactive analysis and display functions, and users can intuitively understand the execution status, success rate, abnormal information and resource allocation of the workflow through the interface, which is convenient for rapid problem discovery, optimization adjustment and decision making. In summary, the system can improve the processing efficiency and accuracy of the workflow, realize intelligent task management and scheduling, optimize the performance of the decision support model, and provide comprehensive display and analysis functions at the same time, enhance the user's understanding of the execution status and results of the workflow, and help improve the production efficiency and decision-making level of the enterprise.

在本申请的又一实施例中,还提供了一种基于人工智能的工作流智能化管理方法,所述方法包括:In another embodiment of the present application, a workflow intelligent management method based on artificial intelligence is also provided, the method comprising:

监控当前在线工作流的实时工作负载;Monitor the real-time workload of current online workflows;

根据实时工作负载,自适应调整目标任务的资源弹性分配策略,以实现算力弹性调配;Adaptively adjust the resource elastic allocation strategy of the target task according to the real-time workload to achieve elastic allocation of computing power;

通过决策支持模型对目标任务进行聚类分析,以获得聚类结果,聚类结果包括各组目标任务、以及各组目标任务之间的相关性;Performing cluster analysis on target tasks through a decision support model to obtain cluster results, which include each group of target tasks and the correlation between each group of target tasks;

基于聚类结果以及相关性,通过决策支持模型确定各组目标任务的优先级执行顺序;Based on the clustering results and correlation, the priority execution order of each group of target tasks is determined through the decision support model;

根据聚类结果,通过决策支持模型将存在异常的目标任务标记为异常任务;其中,异常任务不符合预设期望模式,或者异常任务与其他目标任务之间的相关性低于预设异常值;According to the clustering results, the target tasks with abnormalities are marked as abnormal tasks through the decision support model; wherein the abnormal tasks do not conform to the preset expected pattern, or the correlation between the abnormal tasks and other target tasks is lower than the preset abnormal value;

根据各组目标任务的优先级执行顺序以及资源弹性分配策略,对各组目标任务进行任务分配以及资源调度;According to the priority execution order of each group of target tasks and the resource elasticity allocation strategy, each group of target tasks is assigned tasks and resources are scheduled;

对异常任务执行资源重分配操作或隔离操作;Perform resource reallocation or isolation operations on abnormal tasks;

通过优化奖励模型以聚类结果对应的质量评估值和/或性能指标为奖励项,对决策支持模型中的超参数组合进行动态优化,以获得最佳超参数组合;By optimizing the reward model, the quality evaluation value and/or performance index corresponding to the clustering result is used as the reward item, and the hyperparameter combination in the decision support model is dynamically optimized to obtain the best hyperparameter combination;

根据聚类结果对应的质量评估值和/或性能指标,对决策支持模型执行簇合并操作,以提升聚类结果的鲁棒性;According to the quality evaluation value and/or performance index corresponding to the clustering result, a cluster merging operation is performed on the decision support model to improve the robustness of the clustering result;

响应于用户操作,提供对目标任务的交互式分析,并向用户展示分析得到的目标任务的工作流信息;工作流信息包括任务执行状态、任务成功率、任务异常信息、资源分配情况。In response to user operations, an interactive analysis of the target task is provided, and the workflow information of the target task obtained through the analysis is displayed to the user; the workflow information includes task execution status, task success rate, task exception information, and resource allocation status.

本申请提出的方法实施例还包括上述实施例中可由基于人工智能的工作流智能化管理系统执行的各个方法步骤。The method embodiment proposed in the present application also includes the various method steps in the above embodiments that can be executed by an artificial intelligence-based workflow intelligent management system.

在本申请的又一实施例中,还提供一种电子设备,如图2所示,包括:处理器、通信接口、存储器和通信总线,其中,处理器,通信接口,存储器通过通信总线完成相互间的通信;In another embodiment of the present application, an electronic device is also provided, as shown in FIG2 , including: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus;

存储器,用于存放计算机程序;Memory, used to store computer programs;

处理器,用于执行存储器上所存放的程序时,实现方法实施例所述的智能测试管理系统。The processor is used to implement the intelligent test management system described in the method embodiment when executing the program stored in the memory.

上述电子设备提到的通信总线1140可以是外设部件互连标准(PeripheralComponent Interconnect,PCI)总线或扩展工业标准结构(Extended Industry StandardArchitecture,EISA)总线等。该通信总线1140可以分为地址总线、数据总线、控制总线等。The communication bus 1140 mentioned in the above electronic device may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus 1140 may be divided into an address bus, a data bus, a control bus, etc.

为便于表示,图2中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。For ease of representation, FIG2 shows only one thick line, but this does not mean that there is only one bus or one type of bus.

通信接口1120用于上述电子设备与其他设备之间的通信。The communication interface 1120 is used for communication between the above electronic device and other devices.

存储器1130可以包括随机存取存储器(Random Access Memory,RAM),也可以包括非易失性存储器(non-volatil ememory),例如至少一个磁盘存储器。可选的,存储器还可以是至少一个位于远离前述处理器的存储装置。The memory 1130 may include a random access memory (RAM) or a non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

上述的处理器1110可以是通用处理器,包括中央处理器(Central Pro-The processor 1110 may be a general purpose processor, including a central processing unit (Central Processor).

cessing Unit,CPU)、网络处理器(Network Processor,NP)等;还可以是数字信号处理器(Digital Signal Processing,DSP)、专用集成电路(ApplicationSpecificIntegrated Circuit,ASIC)、现场可编程门阵列(Field-Programmable GateArray,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。It can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

相应地,本申请实施例还提供一种存储有计算机程序的计算机可读存储介质,计算机程序被执行时能够实现上述系统实施例中可由电子设备执行的各步骤。Accordingly, an embodiment of the present application further provides a computer-readable storage medium storing a computer program, which, when executed, can implement the various steps that can be executed by the electronic device in the above system embodiment.

本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to the flowcharts and/or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and/or box in the flowchart and/or block diagram, as well as the combination of the processes and/or boxes in the flowchart and/or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate a device for implementing the functions specified in one process or multiple processes in the flowchart and/or one box or multiple boxes in the block diagram.

这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.

这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.

在一个典型的配置中,计算设备包括一个或多个处理器 (CPU)、输入/输出接口、网络接口和内存。In a typical configuration, a computing device includes one or more processors (CPU), input/output interfaces, network interfaces, and memory.

内存可能包括计算机可读介质中的非永久性存储器,随机存取存储器 (RAM) 和/或非易失性内存等形式,如只读存储器 (ROM) 或闪存(flash RAM)。内存是计算机可读介质的示例。Memory may include non-permanent storage in a computer-readable medium, in the form of random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存 (PRAM)、静态随机存取存储器 (SRAM)、动态随机存取存储器 (DRAM)、其他类型的随机存取存储器 (RAM)、只读存储器 (ROM)、电可擦除可编程只读存储器 (EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘 (DVD) 或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体 (transitory media),如调制的数据信号和载波。Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

以上所述仅为本申请的实施例而已,并不用于限制本申请。对于本领域技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等,均应包含在本申请的权利要求范围之内。The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims (10)

1. An artificial intelligence based workflow intelligent management system, the system comprising:
The task management module is used for monitoring the real-time workload of the current online workflow; according to the real-time workload, the resource elastic allocation strategy of the target task is adaptively adjusted so as to realize the computational power elastic allocation;
The decision support module is used for carrying out cluster analysis on the target tasks through a decision support model so as to obtain a cluster result, wherein the cluster result comprises all groups of target tasks and the correlation among all groups of target tasks; determining the priority execution sequence of each group of target tasks through a decision support model based on the clustering result and the correlation; marking the abnormal target task as an abnormal task through a decision support model according to the clustering result; wherein the abnormal task does not conform to a preset expected mode, or the correlation between the abnormal task and other target tasks is lower than a preset abnormal value;
the resource management module is used for carrying out task allocation and resource scheduling on each group of target tasks according to the priority execution sequence of each group of target tasks and the resource elastic allocation strategy; performing resource reallocation operation or isolation operation on the abnormal task;
The self-adaptive optimization learning module is used for dynamically optimizing the super-parameter combination in the decision support model by optimizing the reward model by taking the quality evaluation value and/or the performance index corresponding to the clustering result as a reward item so as to obtain the optimal super-parameter combination; according to the quality evaluation value and/or the performance index corresponding to the clustering result, cluster merging operation is carried out on the decision support model so as to improve the robustness of the clustering result;
The report display module is used for responding to user operation, providing interactive analysis of the target task, and displaying workflow information of the target task obtained by analysis to a user, wherein the workflow information comprises task execution state, task success rate, task abnormality information and resource allocation condition.
2. The workflow intelligent management system based on artificial intelligence according to claim 1, wherein the task management module is specifically configured to, when adaptively adjusting a resource elastic allocation policy of a target task according to the real-time workload:
Acquiring the CPU utilization rate, the memory usage amount and the network flow of the current online workflow;
Combining seasonal factors and business characteristics of the target task, and dynamically predicting the CPU utilization rate, the memory usage amount and the network flow of the current online workflow through a load prediction model to obtain a load prediction time sequence corresponding to the target task;
According to the load prediction time sequence, executing resource elastic adjustment on the target task by utilizing a cloud computing platform to obtain a resource elastic allocation strategy of the target task;
the resource elastic allocation strategy comprises the steps of increasing or decreasing virtual machine instances, adjusting storage capacity and adjusting network bandwidth.
3. The workflow intelligent management system based on artificial intelligence according to claim 2, wherein the task management module, according to the load prediction time sequence, is specifically configured to, when performing resource elastic adjustment on the target task by using a cloud computing platform to obtain a resource elastic allocation policy of the target task:
According to the load prediction time sequence, evaluating the matching condition of the predicted resource demand of the target task and the current available resources;
If the predicted resource requirement is estimated to exceed the current resource bearing capacity, initiating a resource expansion request aiming at the target task by utilizing the elastic resource function of the cloud computing platform;
virtual machine resources in the cloud computing platform are called to obtain virtual machine instances matched with predicted resource requirements;
Dynamically adjusting the storage capacity and the network bandwidth of the target task based on the predicted resource demand so as to realize the elastic capacity expansion operation of the target task;
and forming the resource elastic allocation strategy according to the resource expansion request, the virtual machine instance to be matched, the storage capacity and the network bandwidth.
4. The workflow intelligent management system based on artificial intelligence of claim 1, wherein the decision support module is configured to, when performing cluster analysis on the target task by using a decision support model to obtain a cluster result:
Calculating the data point density of each target task according to the target cluster characteristics and the distance measurement of the target task; the target cluster feature comprises at least one of the following: CPU utilization, memory usage, I/O data; the distance measure is Manhattan distance;
If the data point density of the target task in the specific radius exceeds the minimum neighbor density, taking the target task as a core data characteristic;
And dividing target tasks similar to the characteristic density of the core data into the same cluster to obtain the clustering result.
5. The workflow intelligent management system based on artificial intelligence of claim 1, wherein the decision support module, when determining the priority execution order of each group of target tasks by a decision support model based on the clustering result and the correlation, is specifically configured to:
Acquiring cluster categories to which each target task belongs from the clustering result, and acquiring correlations between each target task and other tasks;
carrying out quantization processing on the relevance between each target task and other tasks to obtain a relevance measurement;
Taking the clustering result and the correlation measure as the input of the decision support model, and outputting the priority scores of the target tasks of each group through the decision support model;
And sequencing the priority scores of the target tasks of each group to obtain the priority execution sequence of the target tasks of each group.
6. The intelligent workflow management system of claim 5, wherein the relevance between each target task and other tasks comprises at least a similarity between target tasks;
The decision support module is specifically configured to, when performing quantization processing on the correlation between each target task and other tasks to obtain a correlation metric:
performing Euclidean distance calculation on the clustering features among the target tasks to obtain the similarity among the target tasks; the higher the similarity among the target tasks is, the closer the clustering features of the target tasks are, and the relevance among the target tasks is.
7. The intelligent workflow management system based on artificial intelligence of claim 5, wherein the correlation between each target task and other tasks comprises at least a resource competition relationship;
The decision support module is specifically configured to, when performing quantization processing on the correlation between each target task and other tasks to obtain a correlation metric:
If the resource competition relationship exists among different target tasks, quantifying the demand degree of the different target tasks for each computing power resource, and determining the correlation between each target task and other tasks based on the demand degree; the higher the demand of a plurality of target tasks on the same computing power resource, the higher the correlation among the plurality of target tasks.
8. The intelligent workflow management system based on artificial intelligence of claim 5, wherein the correlation between each target task and other tasks comprises at least a front-back task dependency;
The decision support module is specifically configured to, when performing quantization processing on the correlation between each target task and other tasks to obtain a correlation metric:
Converting the dependency relationship among all target tasks into a directed graph model; the method comprises the steps of obtaining the number of dependent nodes and the number of child nodes of each target task, and taking the degree of dependence and the dependence direction between each target task as task dependence relation weights; and calculating the correlation measurement between the target tasks by calculating the weight value of each task dependency relation.
9. The workflow intelligent management system based on artificial intelligence according to claim 1, wherein the decision support module is specifically configured to, when marking, according to the clustering result, a target task with an abnormality as an abnormal task through a decision support model:
Determining preset expected modes of each target task: the preset expected modes comprise expected modes among all target tasks in different clusters or expected modes of all target tasks in the same cluster;
Acquiring abnormal values between the target tasks to be judged and other target tasks according to the similarity among the target tasks, the resource competition relationship and/or the front-back task dependency relationship;
And positioning and marking the abnormal tasks from the target tasks based on the abnormal values through a decision support model.
10. The workflow intelligent management system based on artificial intelligence according to claim 1, wherein the adaptive optimization learning module is specifically configured to, when performing a cluster merging operation on a decision support model according to a quality evaluation value and/or a performance index corresponding to the clustering result to improve the robustness of the clustering result:
Evaluating the performance of each cluster according to the quality evaluation value and/or the performance index of the clustering result to obtain an evaluation index of each cluster; the evaluation index includes at least one of: profile coefficient, internal distance, inter-class distance; the evaluation index is used for measuring the compactness and the separation degree of the clusters;
centroid merging is carried out on clustering results meeting merging conditions in the decision support model;
Updating the merging result into the clustering result to obtain an updated clustering result, and updating the label of each updated cluster to perform subsequent self-adaptive optimization and processing on the decision support model.
CN202410846473.7A 2024-06-27 2024-06-27 Workflow intelligent management system based on artificial intelligence Withdrawn CN118502918A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410846473.7A CN118502918A (en) 2024-06-27 2024-06-27 Workflow intelligent management system based on artificial intelligence

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410846473.7A CN118502918A (en) 2024-06-27 2024-06-27 Workflow intelligent management system based on artificial intelligence

Publications (1)

Publication Number Publication Date
CN118502918A true CN118502918A (en) 2024-08-16

Family

ID=92238990

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410846473.7A Withdrawn CN118502918A (en) 2024-06-27 2024-06-27 Workflow intelligent management system based on artificial intelligence

Country Status (1)

Country Link
CN (1) CN118502918A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119026894A (en) * 2024-10-30 2024-11-26 华能信息技术有限公司 A work task management system
CN119166342A (en) * 2024-09-03 2024-12-20 长沙户迷网络科技有限公司 Multi-task collaborative data processing method and system based on cloud computing
CN119202342A (en) * 2024-09-19 2024-12-27 广州莱万科技股份有限公司 A method and system for realizing a data visualization large screen

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119166342A (en) * 2024-09-03 2024-12-20 长沙户迷网络科技有限公司 Multi-task collaborative data processing method and system based on cloud computing
CN119202342A (en) * 2024-09-19 2024-12-27 广州莱万科技股份有限公司 A method and system for realizing a data visualization large screen
CN119026894A (en) * 2024-10-30 2024-11-26 华能信息技术有限公司 A work task management system

Similar Documents

Publication Publication Date Title
CN117472587B (en) Resource scheduling system of AI intelligent computation center
Ismaeel et al. Proactive dynamic virtual-machine consolidation for energy conservation in cloud data centres
CN118502918A (en) Workflow intelligent management system based on artificial intelligence
CN111752706B (en) Resource allocation method, device and storage medium
US11651271B1 (en) Artificial intelligence system incorporating automatic model updates based on change point detection using likelihood ratios
US11636377B1 (en) Artificial intelligence system incorporating automatic model updates based on change point detection using time series decomposing and clustering
CN112508723B (en) Financial risk prediction method and device based on automatic preferential modeling and electronic equipment
Mahan et al. A novel resource productivity based on granular neural network in cloud computing
US20240303127A1 (en) Systems and methods for edge system resource capacity performance prediction
WO2025015849A1 (en) Network data analysis model scheduling method and apparatus, and computer device
CN119322682B (en) Self-adaptive calculation power scheduling system for large model training
Rozehkhani et al. Efficient cloud data center: An adaptive framework for dynamic Virtual Machine Consolidation
Huang et al. A novel approach for energy consumption management in cloud centers based on adaptive fuzzy neural systems
Morichetta et al. Demystifying deep learning in predictive monitoring for cloud-native SLOs
US20230376800A1 (en) Predicting runtime variation in big data analytics
Ismaeel et al. An efficient workload clustering framework for large-scale data centers
US11550691B2 (en) Computing resources schedule recommendation
CN119003138A (en) Heterogeneous multi-core collaborative management and automatic operation and maintenance system
CN119225933A (en) A process scheduling method, device, equipment, medium and computer program product
US12033097B2 (en) Utilizing machine learning and predictive modeling to manage and determine a predicted success rate of new product development
Moskalenko et al. Optimizing the parameters of functioning of the system of management of data center it infrastructure
Park et al. Combining genetic algorithms and bayesian neural networks for resource usage prediction in multi-tenant container environments
CN118760561A (en) Workload prediction method and device for services in a service cluster
CN118467156A (en) Data processing method and computer program product
CN115766507A (en) Business anomaly detection method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20240816