CN112612613A - 用于在虚拟分布式异构环境下实现多gpu调度的方法和系统 - Google Patents
用于在虚拟分布式异构环境下实现多gpu调度的方法和系统 Download PDFInfo
- Publication number
- CN112612613A CN112612613A CN202011574923.XA CN202011574923A CN112612613A CN 112612613 A CN112612613 A CN 112612613A CN 202011574923 A CN202011574923 A CN 202011574923A CN 112612613 A CN112612613 A CN 112612613A
- Authority
- CN
- China
- Prior art keywords
- gpu
- node
- module
- computing
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5072—Grid computing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
Claims (7)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011574923.XA CN112612613B (zh) | 2020-12-28 | 2020-12-28 | 用于在虚拟分布式异构环境下实现多gpu调度的方法和系统 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011574923.XA CN112612613B (zh) | 2020-12-28 | 2020-12-28 | 用于在虚拟分布式异构环境下实现多gpu调度的方法和系统 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112612613A true CN112612613A (zh) | 2021-04-06 |
CN112612613B CN112612613B (zh) | 2023-06-23 |
Family
ID=75248082
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011574923.XA Active CN112612613B (zh) | 2020-12-28 | 2020-12-28 | 用于在虚拟分布式异构环境下实现多gpu调度的方法和系统 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112612613B (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116777730A (zh) * | 2023-08-25 | 2023-09-19 | 湖南马栏山视频先进技术研究院有限公司 | 一种基于资源调度的gpu效能提高方法 |
CN117215802A (zh) * | 2023-11-07 | 2023-12-12 | 四川并济科技有限公司 | 一种针对虚拟化网络功能的gpu管理及调用方法 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016078008A1 (zh) * | 2014-11-19 | 2016-05-26 | 华为技术有限公司 | 调度数据流任务的方法和装置 |
US20190312772A1 (en) * | 2018-04-04 | 2019-10-10 | EMC IP Holding Company LLC | Topology-aware provisioning of hardware accelerator resources in a distributed environment |
CN110955526A (zh) * | 2019-12-16 | 2020-04-03 | 湖南大学 | 一种用于在分布式异构环境下实现多gpu调度的方法和系统 |
-
2020
- 2020-12-28 CN CN202011574923.XA patent/CN112612613B/zh active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016078008A1 (zh) * | 2014-11-19 | 2016-05-26 | 华为技术有限公司 | 调度数据流任务的方法和装置 |
US20190312772A1 (en) * | 2018-04-04 | 2019-10-10 | EMC IP Holding Company LLC | Topology-aware provisioning of hardware accelerator resources in a distributed environment |
CN110955526A (zh) * | 2019-12-16 | 2020-04-03 | 湖南大学 | 一种用于在分布式异构环境下实现多gpu调度的方法和系统 |
Non-Patent Citations (2)
Title |
---|
CARBONE P,ET AL.: "Apache funk: Stream and batch processing in a single engine", 《BULLETIN OF THE IEEE COMPUTER SOCIETY TECHNICAL COMMITTEE ON DATA ENGINEERING》 * |
严健康;陈更生;: "基于CPU/GPU异构资源协同调度的改进H-Storm平台", 计算机工程, no. 04 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116777730A (zh) * | 2023-08-25 | 2023-09-19 | 湖南马栏山视频先进技术研究院有限公司 | 一种基于资源调度的gpu效能提高方法 |
CN116777730B (zh) * | 2023-08-25 | 2023-10-31 | 湖南马栏山视频先进技术研究院有限公司 | 一种基于资源调度的gpu效能提高方法 |
CN117215802A (zh) * | 2023-11-07 | 2023-12-12 | 四川并济科技有限公司 | 一种针对虚拟化网络功能的gpu管理及调用方法 |
CN117215802B (zh) * | 2023-11-07 | 2024-02-09 | 四川并济科技有限公司 | 一种针对虚拟化网络功能的gpu管理及调用方法 |
Also Published As
Publication number | Publication date |
---|---|
CN112612613B (zh) | 2023-06-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7647590B2 (en) | Parallel computing system using coordinator and master nodes for load balancing and distributing work | |
US8234652B2 (en) | Performing setup operations for receiving different amounts of data while processors are performing message passing interface tasks | |
US8127300B2 (en) | Hardware based dynamic load balancing of message passing interface tasks | |
US20090064168A1 (en) | System and Method for Hardware Based Dynamic Load Balancing of Message Passing Interface Tasks By Modifying Tasks | |
US20090063885A1 (en) | System and Computer Program Product for Modifying an Operation of One or More Processors Executing Message Passing Interface Tasks | |
CN112612613B (zh) | 用于在虚拟分布式异构环境下实现多gpu调度的方法和系统 | |
US20210390405A1 (en) | Microservice-based training systems in heterogeneous graphic processor unit (gpu) cluster and operating method thereof | |
CN107329822B (zh) | 面向多源多核系统的基于超任务网的多核调度方法 | |
CN114911612A (zh) | 一种面向cpu-gpu异构资源的任务调度方法 | |
CN110955526B (zh) | 一种用于在分布式异构环境下实现多gpu调度的方法和系统 | |
Gu et al. | Elastic model aggregation with parameter service | |
Qu et al. | Improving the energy efficiency and performance of data-intensive workflows in virtualized clouds | |
Komarasamy et al. | Priority scheduling with consolidation based backfilling algorithm in cloud | |
CN114860417A (zh) | 多核神经网络处理器及用于该处理器多任务分配调度方法 | |
CN112346852A (zh) | 矩阵求和运算的分布式物理处理 | |
CN111240818A (zh) | 一种多相同gpu异构系统环境下的任务调度节能方法 | |
Jeyaraj et al. | MapReduce scheduler to minimize the size of intermediate data in shuffle phase | |
US20240220794A1 (en) | Training systems and operating method thereof | |
Maquelin | ADAM: a coarse-grain dataflow architecture that addresses the load balancing and throttling problems | |
Sandokji et al. | Communication and computation aware task scheduling framework toward exascale computing | |
Bagchi | Admission control and scheduling of remote processes in loosely-coupled distributed systems | |
Du et al. | Dynamic Priority Job Scheduling on a Hadoop YARN Platform | |
Mamdapure et al. | Task Scheduling in Hadoop | |
Chandra et al. | Dynamic load distribution algorithm performance in heterogeneous distributed system for I/O-intensive task | |
Parkavi et al. | Abstraction based K-tier partitioning scheme for parallel job scheduling in multiple cloud centers |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: Li Kenli Inventor after: Liu Chubo Inventor after: Zhou Xu Inventor after: Liu Yuanchun Inventor after: Tang Zhuo Inventor after: Guo Yaolian Inventor after: Song Yingjie Inventor after: Luo Wenming Inventor after: Yang Wangdong Inventor after: Cao Ronghui Inventor after: Xiao Guoqing Inventor before: Tang Zhuo Inventor before: Liu Chubo Inventor before: Zhou Xu Inventor before: Liu Yuanchun Inventor before: Li Kenli Inventor before: Guo Yaolian Inventor before: Song Yingjie Inventor before: Luo Wenming Inventor before: Yang Wangdong Inventor before: Cao Ronghui Inventor before: Xiao Guoqing |
|
CB03 | Change of inventor or designer information | ||
GR01 | Patent grant | ||
GR01 | Patent grant |