CN112912849A - 一种基于图数据的计算运行调度方法、系统、计算机可读介质及设备 - Google Patents

一种基于图数据的计算运行调度方法、系统、计算机可读介质及设备 Download PDF

Info

Publication number
CN112912849A
CN112912849A CN201880094017.4A CN201880094017A CN112912849A CN 112912849 A CN112912849 A CN 112912849A CN 201880094017 A CN201880094017 A CN 201880094017A CN 112912849 A CN112912849 A CN 112912849A
Authority
CN
China
Prior art keywords
processor
partitions
partition
calculated
idle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201880094017.4A
Other languages
English (en)
Inventor
樊文飞
于文渊
徐静波
罗小简
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Tmall Technology Co Ltd
Original Assignee
Zhejiang Tmall Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Tmall Technology Co Ltd filed Critical Zhejiang Tmall Technology Co Ltd
Publication of CN112912849A publication Critical patent/CN112912849A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083—Techniques for rebalancing the load in a distributed system
    • G06F9/5088—Techniques for rebalancing the load in a distributed system involving task migration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9024—Graphs; Linked lists
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching
    • G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/485—Task life-cycle, e.g. stopping, restarting, resuming execution
    • G06F9/4856—Task life-cycle, e.g. stopping, restarting, resuming execution resumption being on a different machine, e.g. task migration, virtual machine migration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching
    • G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Debugging And Monitoring (AREA)

Abstract

一种基于图数据的计算运行调度方法、调度系统、计算机可读介质及设备，所述调度方法包括：将图数据划分成多个分区(S1)；调度所述分区分配给多个处理器(S2)；根据每个分区的关键程度将所述分区先后交给所述处理器对应的线程计算(S3)；判断是否存在空闲处理器，当所述处理器包括一个或多个空闲线程时，则所述处理器为空闲处理器(S4)；将所述空闲处理器和其它处理器进行通信，寻找所述其它处理器对应的待计算分区(S5)；选择确定所述待计算分区(S6)；将所述确定的待计算分区绑定到所述空闲处理器的线程处理(S7)。

Description

PCT国内申请，说明书已公开。

Claims (10)

  1. PCT国内申请，权利要求书已公开。
CN201880094017.4A 2018-07-27 2018-07-27 一种基于图数据的计算运行调度方法、系统、计算机可读介质及设备 Pending CN112912849A (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/097517 WO2020019315A1 (zh) 2018-07-27 2018-07-27 一种基于图数据的计算运行调度方法、系统、计算机可读介质及设备

Publications (1)

Publication Number Publication Date
CN112912849A true CN112912849A (zh) 2021-06-04

Family

ID=69181176

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880094017.4A Pending CN112912849A (zh) 2018-07-27 2018-07-27 一种基于图数据的计算运行调度方法、系统、计算机可读介质及设备

Country Status (3)

Country Link
US (1) US20210149746A1 (zh)
CN (1) CN112912849A (zh)
WO (1) WO2020019315A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220164442A1 (en) * 2019-08-12 2022-05-26 Hewlett-Packard Development Company, L.P. Thread mapping

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040019891A1 (en) * 2002-07-25 2004-01-29 Koenen David J. Method and apparatus for optimizing performance in a multi-processing system
US20060020701A1 (en) * 2004-07-21 2006-01-26 Parekh Harshadrai G Thread transfer between processors
US20060029056A1 (en) * 2003-10-14 2006-02-09 Raptor Networks Technology, Inc. Virtual machine task management system
US20060206881A1 (en) * 2005-03-14 2006-09-14 Dan Dodge Process scheduler employing adaptive partitioning of critical process threads
US20110050713A1 (en) * 2009-09-03 2011-03-03 Advanced Micro Devices, Inc. Hardware-Based Scheduling of GPU Work
CN104850461A (zh) * 2015-05-12 2015-08-19 华中科技大学 一种面向numa架构的虚拟cpu调度优化方法
CN106445686A (zh) * 2016-09-21 2017-02-22 东软集团股份有限公司 资源分配方法及装置
CN107122244A (zh) * 2017-04-25 2017-09-01 华中科技大学 一种基于多gpu的图数据处理系统及方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6988268B2 (en) * 2002-04-30 2006-01-17 Microsoft Corporation IO completion architecture for user-mode networking
KR101834195B1 (ko) * 2012-03-15 2018-04-13 삼성전자주식회사 다중코어 시스템 및 로드 밸런싱 방법
US10019391B2 (en) * 2015-03-20 2018-07-10 International Business Machines Corporation Preventing software thread blocking due to interrupts
US10089155B2 (en) * 2015-09-22 2018-10-02 Advanced Micro Devices, Inc. Power aware work stealing
US11138516B2 (en) * 2017-06-30 2021-10-05 Visa International Service Association GPU enhanced graph model build and scoring engine

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040019891A1 (en) * 2002-07-25 2004-01-29 Koenen David J. Method and apparatus for optimizing performance in a multi-processing system
US20060029056A1 (en) * 2003-10-14 2006-02-09 Raptor Networks Technology, Inc. Virtual machine task management system
US20060020701A1 (en) * 2004-07-21 2006-01-26 Parekh Harshadrai G Thread transfer between processors
US20060206881A1 (en) * 2005-03-14 2006-09-14 Dan Dodge Process scheduler employing adaptive partitioning of critical process threads
US20110050713A1 (en) * 2009-09-03 2011-03-03 Advanced Micro Devices, Inc. Hardware-Based Scheduling of GPU Work
CN104850461A (zh) * 2015-05-12 2015-08-19 华中科技大学 一种面向numa架构的虚拟cpu调度优化方法
CN106445686A (zh) * 2016-09-21 2017-02-22 东软集团股份有限公司 资源分配方法及装置
CN107122244A (zh) * 2017-04-25 2017-09-01 华中科技大学 一种基于多gpu的图数据处理系统及方法

Also Published As

Publication number Publication date
US20210149746A1 (en) 2021-05-20
WO2020019315A1 (zh) 2020-01-30

Similar Documents

Publication Publication Date Title
Kc et al. Scheduling hadoop jobs to meet deadlines
CN109783237B (zh) 一种资源配置方法及装置
Zhao et al. Destination-aware task assignment in spatial crowdsourcing: A worker decomposition approach
CN102902573B (zh) 一种基于共享资源的任务的处理方法及装置
CN108519917B (zh) 一种资源池分配方法和装置
US9807152B2 (en) Distributed processing device and distributed processing system as well as distributed processing method
CN112236760B (zh) 一种图数据的更新方法、系统、计算机可读存储介质及设备
CN103226467A (zh) 数据并行处理方法、系统及负载均衡调度器
CN104008013A (zh) 一种核资源分配方法、装置及众核系统
CN103617087A (zh) 一种适合迭代计算的MapReduce优化方法
CN102834807A (zh) 多处理器系统负载均衡的方法和装置
CN112416585A (zh) 面向深度学习的gpu资源管理与智能化调度方法
CN112231102A (zh) 一种提升存储系统性能的方法、装置、设备、产品
CN114706689B (zh) 一种基于子任务特性的多核处理器任务调度方法及系统
CN115033340A (zh) 一种宿主机的选择方法及相关装置
CN109800078B (zh) 一种任务处理方法、任务分发终端及任务执行终端
CN105635285B (zh) 一种基于状态感知的vm迁移调度方法
CN112912849A (zh) 一种基于图数据的计算运行调度方法、系统、计算机可读介质及设备
Davidović et al. Parallel local search to schedule communicating tasks on identical processors
CN114153549A (zh) 一种虚拟机创建方法及相关设备
CN116302574A (zh) 一种基于MapReduce的并发处理方法
CN112912865B (zh) 一种图数据存储方法、系统及电子设备
CN116795524A (zh) 任务处理方法、装置、计算机设备、存储介质及程序产品
CN109558214B (zh) 异构环境下宿主机资源管理方法、装置和存储介质
CN112306675A (zh) 数据处理方法、相关设备以及计算机可读存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination