CN110291502A - 一种调度加速资源的方法、装置及加速系统 - Google Patents
一种调度加速资源的方法、装置及加速系统 Download PDFInfo
- Publication number
- CN110291502A CN110291502A CN201780030606.1A CN201780030606A CN110291502A CN 110291502 A CN110291502 A CN 110291502A CN 201780030606 A CN201780030606 A CN 201780030606A CN 110291502 A CN110291502 A CN 110291502A
- Authority
- CN
- China
- Prior art keywords
- accelerator
- virtual
- mark
- virtual machine
- physical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000001133 acceleration Effects 0.000 title claims abstract description 127
- 238000000034 method Methods 0.000 title claims abstract description 91
- 238000012545 processing Methods 0.000 claims abstract description 94
- 230000005540 biological transmission Effects 0.000 claims abstract description 17
- 238000012790 confirmation Methods 0.000 claims description 54
- 238000013507 mapping Methods 0.000 claims description 49
- 238000010200 validation analysis Methods 0.000 claims description 14
- 238000004321 preservation Methods 0.000 claims description 4
- 238000007726 management method Methods 0.000 description 116
- 238000010586 diagram Methods 0.000 description 24
- 230000006870 function Effects 0.000 description 22
- 230000008569 process Effects 0.000 description 14
- 239000000203 mixture Substances 0.000 description 12
- 238000004891 communication Methods 0.000 description 7
- 238000012217 deletion Methods 0.000 description 4
- 230000037430 deletion Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 238000013497 data interchange Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000035800 maturation Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
- H04L41/083—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability for increasing network speed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5072—Grid computing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5077—Logical partitioning of resources; Management or configuration of virtualized resources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/02—Standardisation; Integration
- H04L41/0246—Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols
- H04L41/0266—Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols using meta-data, objects or commands for formatting management information, e.g. using eXtensible markup language [XML]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45579—I/O management, e.g. providing access to device drivers or storage
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/505—Clust
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/509—Offload
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mathematical Physics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Memory System Of A Hierarchy Structure (AREA)
- Stored Programmes (AREA)
- Mobile Radio Communication Systems (AREA)
- Debugging And Monitoring (AREA)
Abstract
一种调度加速资源的方法、装置及加速系统,加速系统包括计算节点(10)和至少一个网络加速器(30),计算节点(10)包括虚拟机(102)和调度装置(104),网络加速器(30)包括至少一个物理加速器(302,303),方法包括:虚拟机(102)向调度装置(104)发送加速指令,所述加速指令包含待加速数据(S401);确定分配给虚拟机(102)的虚拟加速器(105)(S402);根据虚拟加速器(105)确定处理加速指令的网络加速器(30),并将加速指令发送给网络加速器(30)(S403),以便于网络加速器(30)将加速指令发送给处理加速指令的物理加速器(302,303)(S404);物理加速器(302,303)通过物理加速资源对待加速数据进行加速运算后返回运算结果(S405);将运算结果发送给虚拟机(102)(S406)。上述方法可实现虚拟化场景下异构加速资源的灵活调度,提升计算节点的计算性能。
Description
PCT国内申请,说明书已公开。
Claims (30)
- PCT国内申请,权利要求书已公开。
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/111147 WO2019095154A1 (zh) | 2017-11-15 | 2017-11-15 | 一种调度加速资源的方法、装置及加速系统 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110291502A true CN110291502A (zh) | 2019-09-27 |
CN110291502B CN110291502B (zh) | 2022-01-11 |
Family
ID=66538341
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201780030606.1A Active CN110291502B (zh) | 2017-11-15 | 2017-11-15 | 一种调度加速资源的方法、装置及加速系统 |
Country Status (5)
Country | Link |
---|---|
US (2) | US11336521B2 (zh) |
EP (3) | EP3693853B1 (zh) |
JP (2) | JP2021503124A (zh) |
CN (1) | CN110291502B (zh) |
WO (1) | WO2019095154A1 (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111523657A (zh) * | 2020-04-26 | 2020-08-11 | 云知声智能科技股份有限公司 | 神经网络加速器创建方法及装置、电子设备和存储介质 |
CN113742028A (zh) * | 2020-05-28 | 2021-12-03 | 伊姆西Ip控股有限责任公司 | 资源使用方法、电子设备和计算机程序产品 |
CN115659290A (zh) * | 2022-11-07 | 2023-01-31 | 海光信息技术股份有限公司 | 代码保护系统、方法、虚拟系统架构、芯片及电子设备 |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019095154A1 (zh) * | 2017-11-15 | 2019-05-23 | 华为技术有限公司 | 一种调度加速资源的方法、装置及加速系统 |
CN113535611A (zh) * | 2020-04-22 | 2021-10-22 | 华为技术有限公司 | 数据处理方法及装置、异构系统 |
CN111913794B (zh) * | 2020-08-04 | 2024-08-09 | 北京百度网讯科技有限公司 | 用于共用gpu的方法、装置、电子设备及可读存储介质 |
CN114422367B (zh) * | 2022-03-28 | 2022-09-06 | 阿里云计算有限公司 | 报文处理方法及装置 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102915285A (zh) * | 2011-09-14 | 2013-02-06 | 微软公司 | 虚拟化环境中的应用加速 |
CN103905508A (zh) * | 2012-12-28 | 2014-07-02 | 华为技术有限公司 | 云平台应用部署方法及装置 |
US20150058614A1 (en) * | 2008-08-29 | 2015-02-26 | International Business Machines Corporation | Distributed Acceleration Devices Management for Streams Processing |
CN105159753A (zh) * | 2015-09-25 | 2015-12-16 | 华为技术有限公司 | 加速器虚拟化的方法、装置及集中资源管理器 |
CN105979007A (zh) * | 2016-07-04 | 2016-09-28 | 华为技术有限公司 | 加速资源处理方法、装置及网络功能虚拟化系统 |
CN106572500A (zh) * | 2016-10-21 | 2017-04-19 | 同济大学 | 一种c‑ran中硬件加速器的调度方法 |
US20210073047A1 (en) * | 2017-09-30 | 2021-03-11 | Intel Corporation | Technologies for managing accelerator resources by cloud resource manager |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8046550B2 (en) * | 2008-07-14 | 2011-10-25 | Quest Software, Inc. | Systems and methods for performing backup operations of virtual machine files |
US8910153B2 (en) * | 2009-07-13 | 2014-12-09 | Hewlett-Packard Development Company, L. P. | Managing virtualized accelerators using admission control, load balancing and scheduling |
US9058183B2 (en) | 2009-12-29 | 2015-06-16 | Advanced Micro Devices, Inc. | Hypervisor isolation of processor cores to enable computing accelerator cores |
US8898324B2 (en) * | 2010-06-24 | 2014-11-25 | International Business Machines Corporation | Data access management in a hybrid memory server |
US8954490B2 (en) * | 2010-06-24 | 2015-02-10 | International Business Machines Corporation | Speculative and coordinated data access in a hybrid memory server |
CN103270492B (zh) | 2010-12-15 | 2016-08-17 | 国际商业机器公司 | 用于网络使能应用的硬件加速图形的方法和系统 |
US9842001B2 (en) * | 2012-06-27 | 2017-12-12 | International Business Machines Corporation | System level acceleration server |
US10261813B2 (en) * | 2013-09-25 | 2019-04-16 | Arm Limited | Data processing system for dispatching tasks from a plurality of applications to a shared resource provided by an accelerator |
CN104951353B (zh) * | 2014-03-28 | 2018-09-21 | 华为技术有限公司 | 一种对vnf实现加速处理的方法及装置 |
US9576332B1 (en) * | 2014-06-02 | 2017-02-21 | VCE IP Holding Company LLC | Systems and methods for remote graphics processing unit service |
CN104156663B (zh) * | 2014-07-31 | 2018-01-02 | 上海华为技术有限公司 | 一种硬件虚拟端口及处理器系统 |
US10481937B2 (en) * | 2015-03-23 | 2019-11-19 | Intel Corporation | Shadow command ring for graphics processor virtualization |
EP3089035A1 (en) * | 2015-04-30 | 2016-11-02 | Virtual Open Systems | Virtualization manager for reconfigurable hardware accelerators |
US9928112B2 (en) * | 2015-11-24 | 2018-03-27 | International Business Machines Corporation | Configuration of floating node boundaries |
US20170371694A1 (en) * | 2016-06-23 | 2017-12-28 | Advanced Micro Devices, Inc. | Virtualization of a graphics processing unit for network applications |
US10241956B2 (en) * | 2016-09-12 | 2019-03-26 | International Business Machines Corporation | Virtualizing coherent hardware accelerators |
CN106681793A (zh) * | 2016-11-25 | 2017-05-17 | 同济大学 | 一种基于kvm的加速器虚拟化数据处理系统及方法 |
US11178063B2 (en) * | 2017-06-30 | 2021-11-16 | Intel Corporation | Remote hardware acceleration |
WO2019095154A1 (zh) * | 2017-11-15 | 2019-05-23 | 华为技术有限公司 | 一种调度加速资源的方法、装置及加速系统 |
US10892944B2 (en) * | 2018-11-29 | 2021-01-12 | International Business Machines Corporation | Selecting and using a cloud-based hardware accelerator |
US10776164B2 (en) * | 2018-11-30 | 2020-09-15 | EMC IP Holding Company LLC | Dynamic composition of data pipeline in accelerator-as-a-service computing environment |
US10877542B2 (en) * | 2019-03-07 | 2020-12-29 | Alibaba Group Holding Limited | Power management system and method implementing interconnect controls |
-
2017
- 2017-11-15 WO PCT/CN2017/111147 patent/WO2019095154A1/zh unknown
- 2017-11-15 EP EP17932519.6A patent/EP3693853B1/en active Active
- 2017-11-15 EP EP22154877.9A patent/EP4033356A1/en not_active Withdrawn
- 2017-11-15 CN CN201780030606.1A patent/CN110291502B/zh active Active
- 2017-11-15 EP EP22215261.3A patent/EP4220396A1/en active Pending
- 2017-11-15 JP JP2020524091A patent/JP2021503124A/ja active Pending
-
2020
- 2020-05-13 US US15/930,780 patent/US11336521B2/en active Active
-
2022
- 2022-05-02 JP JP2022075909A patent/JP7423681B2/ja active Active
- 2022-05-06 US US17/738,218 patent/US20220263711A1/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150058614A1 (en) * | 2008-08-29 | 2015-02-26 | International Business Machines Corporation | Distributed Acceleration Devices Management for Streams Processing |
CN102915285A (zh) * | 2011-09-14 | 2013-02-06 | 微软公司 | 虚拟化环境中的应用加速 |
CN103905508A (zh) * | 2012-12-28 | 2014-07-02 | 华为技术有限公司 | 云平台应用部署方法及装置 |
CN105159753A (zh) * | 2015-09-25 | 2015-12-16 | 华为技术有限公司 | 加速器虚拟化的方法、装置及集中资源管理器 |
CN105979007A (zh) * | 2016-07-04 | 2016-09-28 | 华为技术有限公司 | 加速资源处理方法、装置及网络功能虚拟化系统 |
CN106572500A (zh) * | 2016-10-21 | 2017-04-19 | 同济大学 | 一种c‑ran中硬件加速器的调度方法 |
US20210073047A1 (en) * | 2017-09-30 | 2021-03-11 | Intel Corporation | Technologies for managing accelerator resources by cloud resource manager |
Non-Patent Citations (3)
Title |
---|
DIPANJAN SENGUPTA等: "Scheduling Multi-tenant Cloud Workloads on Accelerator-based Systems", 《SC14: INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS》 * |
YI CAO等: "A Distributed Multi-Node GPU Accelerated Parallel Rendering Scheme for Visualization Cluster Environment", 《2013 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION》 * |
张翰博等: "基于RBD的Docker虚拟化技术性能优化研究", 《信息技术》 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111523657A (zh) * | 2020-04-26 | 2020-08-11 | 云知声智能科技股份有限公司 | 神经网络加速器创建方法及装置、电子设备和存储介质 |
CN111523657B (zh) * | 2020-04-26 | 2023-06-20 | 云知声智能科技股份有限公司 | 神经网络加速器创建方法及装置、电子设备和存储介质 |
CN113742028A (zh) * | 2020-05-28 | 2021-12-03 | 伊姆西Ip控股有限责任公司 | 资源使用方法、电子设备和计算机程序产品 |
CN115659290A (zh) * | 2022-11-07 | 2023-01-31 | 海光信息技术股份有限公司 | 代码保护系统、方法、虚拟系统架构、芯片及电子设备 |
Also Published As
Publication number | Publication date |
---|---|
EP4033356A1 (en) | 2022-07-27 |
US20200274755A1 (en) | 2020-08-27 |
EP3693853A1 (en) | 2020-08-12 |
US20220263711A1 (en) | 2022-08-18 |
WO2019095154A1 (zh) | 2019-05-23 |
JP2022105146A (ja) | 2022-07-12 |
JP2021503124A (ja) | 2021-02-04 |
EP3693853B1 (en) | 2022-02-23 |
EP4220396A1 (en) | 2023-08-02 |
JP7423681B2 (ja) | 2024-01-29 |
US11336521B2 (en) | 2022-05-17 |
EP3693853A4 (en) | 2020-11-11 |
CN110291502B (zh) | 2022-01-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110291502A (zh) | 一种调度加速资源的方法、装置及加速系统 | |
CN113641457B (zh) | 容器创建方法、装置、设备、介质及程序产品 | |
US9311110B2 (en) | Techniques to initialize from a remotely accessible storage device | |
CN108628775B (zh) | 一种资源管理的方法和装置 | |
US20190158575A1 (en) | Platform as a service cloud server and multi-tenant operating method thereof | |
CN108322325A (zh) | 一种虚拟机管理方法及装置 | |
CN108628685A (zh) | 用本地BMC在结构上NVMe内分配共享资源的系统、设备和方法 | |
CN109417488A (zh) | 虚拟网络功能资源管理的方法和设备 | |
CN108628660A (zh) | 一种虚拟机扩缩容方法及虚拟管理设备 | |
US20180246772A1 (en) | Method and apparatus for allocating a virtual resource in network functions virtualization network | |
CN102413183B (zh) | 云智能交换机及其处理方法、系统 | |
US11023825B2 (en) | Platform as a service cloud server and machine learning data processing method thereof | |
CN111158905A (zh) | 调整资源的方法和装置 | |
WO2020108536A1 (zh) | 一种虚拟网络资源分配方法、系统及电子设备 | |
CN105718304A (zh) | 虚拟机管理方法及系统 | |
JP5420477B2 (ja) | 情報サービスシステム | |
CN112491794A (zh) | 一种端口转发方法、装置及相关设备 | |
CN114281516A (zh) | 一种基于numa属性的资源分配方法及装置 | |
CN112131011B (zh) | 用于管理资源的方法、计算设备和计算机可读存储介质 | |
CN114726657A (zh) | 中断管理和数据收发管理的方法、装置及智能网卡 | |
JP6541617B2 (ja) | 仮想サーバ管理装置、仮想サーバ管理方法及び仮想サーバ管理プログラム | |
CN109962788A (zh) | 多控制器调度方法、装置和系统及计算机可读存储介质 | |
CN114911411A (zh) | 一种数据存储方法、装置及网络设备 | |
WO2020245636A1 (en) | Method, apparatus and system for high performance peripheral component interconnect device resource sharing in cloud environments | |
CN116974736A (zh) | 一种设备虚拟化方法及相关设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |