CN111866187A - 分布式深度学习推理云平台任务调度方法 - Google Patents
分布式深度学习推理云平台任务调度方法 Download PDFInfo
- Publication number
- CN111866187A CN111866187A CN202010865843.3A CN202010865843A CN111866187A CN 111866187 A CN111866187 A CN 111866187A CN 202010865843 A CN202010865843 A CN 202010865843A CN 111866187 A CN111866187 A CN 111866187A
- Authority
- CN
- China
- Prior art keywords
- task
- cloud platform
- state
- parallel
- deep learning
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013135 deep learning Methods 0.000 title claims abstract description 14
- 238000000034 method Methods 0.000 title claims abstract description 14
- 239000000284 extract Substances 0.000 claims abstract description 10
- 230000009471 action Effects 0.000 claims description 15
- 230000006870 function Effects 0.000 claims description 9
- 239000011159 matrix material Substances 0.000 claims description 6
- 230000007704 transition Effects 0.000 claims description 6
- 238000010606 normalization Methods 0.000 claims description 3
- 230000004044 response Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
Claims (5)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010619405 | 2020-06-30 | ||
CN2020106194059 | 2020-06-30 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111866187A true CN111866187A (zh) | 2020-10-30 |
CN111866187B CN111866187B (zh) | 2022-10-04 |
Family
ID=72968208
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010865843.3A Active CN111866187B (zh) | 2020-06-30 | 2020-08-25 | 分布式深度学习推理云平台任务调度方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111866187B (zh) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112948109A (zh) * | 2021-02-20 | 2021-06-11 | 山东英信计算机技术有限公司 | 一种ai计算集群的配额弹性调度方法、装置及介质 |
CN113204434A (zh) * | 2021-07-05 | 2021-08-03 | 易纳购科技(北京)有限公司 | 基于k8s的计划任务执行方法、装置及计算机设备 |
CN113347430A (zh) * | 2021-05-13 | 2021-09-03 | 北京睿芯高通量科技有限公司 | 一种硬件转码加速设备的分布式调度装置及其使用方法 |
CN113568757A (zh) * | 2021-09-22 | 2021-10-29 | 中建电子商务有限责任公司 | 一种基于深度学习的大规模分布式推理引擎及系统 |
CN116578415A (zh) * | 2023-04-26 | 2023-08-11 | 中国人民解放军92942部队 | 一种面向大样本负载仿真的并行方法 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109034396A (zh) * | 2018-07-11 | 2018-12-18 | 北京百度网讯科技有限公司 | 用于处理分布式集群中的深度学习作业的方法和装置 |
US20190228303A1 (en) * | 2018-01-25 | 2019-07-25 | Beijing Baidu Netcom Science And Technology Co., Ltd. | Method and apparatus for scheduling resource for deep learning framework |
US20190324856A1 (en) * | 2018-04-18 | 2019-10-24 | EMC IP Holding Company LLC | Optimization of checkpoint operations for deep learning computing |
CN110399222A (zh) * | 2019-07-25 | 2019-11-01 | 北京邮电大学 | Gpu集群深度学习任务并行化方法、装置及电子设备 |
CN110489223A (zh) * | 2019-08-26 | 2019-11-22 | 北京邮电大学 | 一种异构集群中任务调度方法、装置及电子设备 |
US20200174840A1 (en) * | 2018-11-30 | 2020-06-04 | EMC IP Holding Company LLC | Dynamic composition of data pipeline in accelerator-as-a-service computing environment |
-
2020
- 2020-08-25 CN CN202010865843.3A patent/CN111866187B/zh active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190228303A1 (en) * | 2018-01-25 | 2019-07-25 | Beijing Baidu Netcom Science And Technology Co., Ltd. | Method and apparatus for scheduling resource for deep learning framework |
US20190324856A1 (en) * | 2018-04-18 | 2019-10-24 | EMC IP Holding Company LLC | Optimization of checkpoint operations for deep learning computing |
CN109034396A (zh) * | 2018-07-11 | 2018-12-18 | 北京百度网讯科技有限公司 | 用于处理分布式集群中的深度学习作业的方法和装置 |
US20200174840A1 (en) * | 2018-11-30 | 2020-06-04 | EMC IP Holding Company LLC | Dynamic composition of data pipeline in accelerator-as-a-service computing environment |
CN110399222A (zh) * | 2019-07-25 | 2019-11-01 | 北京邮电大学 | Gpu集群深度学习任务并行化方法、装置及电子设备 |
CN110489223A (zh) * | 2019-08-26 | 2019-11-22 | 北京邮电大学 | 一种异构集群中任务调度方法、装置及电子设备 |
Non-Patent Citations (1)
Title |
---|
肖正等: ""一种基于Q学习的分布式多任务流调度算法"", 《小型微型计算机系统》 * |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112948109A (zh) * | 2021-02-20 | 2021-06-11 | 山东英信计算机技术有限公司 | 一种ai计算集群的配额弹性调度方法、装置及介质 |
CN113347430A (zh) * | 2021-05-13 | 2021-09-03 | 北京睿芯高通量科技有限公司 | 一种硬件转码加速设备的分布式调度装置及其使用方法 |
CN113347430B (zh) * | 2021-05-13 | 2023-01-24 | 北京睿芯高通量科技有限公司 | 一种硬件转码加速设备的分布式调度装置及其使用方法 |
CN113204434A (zh) * | 2021-07-05 | 2021-08-03 | 易纳购科技(北京)有限公司 | 基于k8s的计划任务执行方法、装置及计算机设备 |
CN113204434B (zh) * | 2021-07-05 | 2021-09-21 | 易纳购科技(北京)有限公司 | 基于k8s的计划任务执行方法、装置及计算机设备 |
CN113568757A (zh) * | 2021-09-22 | 2021-10-29 | 中建电子商务有限责任公司 | 一种基于深度学习的大规模分布式推理引擎及系统 |
CN116578415A (zh) * | 2023-04-26 | 2023-08-11 | 中国人民解放军92942部队 | 一种面向大样本负载仿真的并行方法 |
CN116578415B (zh) * | 2023-04-26 | 2024-06-04 | 中国人民解放军92942部队 | 一种面向大样本负载仿真的并行方法 |
Also Published As
Publication number | Publication date |
---|---|
CN111866187B (zh) | 2022-10-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111866187B (zh) | 分布式深度学习推理云平台任务调度方法 | |
CN113254197B (zh) | 一种基于深度强化学习的网络资源调度方法及系统 | |
KR102361995B1 (ko) | 컨택트 센터 시스템 내의 행동 페어링을 위한 기술들 | |
CN111367657B (zh) | 一种基于深度强化学习的计算资源协同合作方法 | |
CN109857534A (zh) | 一种基于策略梯度强化学习的智能任务调度策略训练方法 | |
CN110262901A (zh) | 一种数据处理方法及数据处理系统 | |
CN111901485B (zh) | 外呼系统的控制方法及装置 | |
CN108845874A (zh) | 资源的动态分配方法及服务器 | |
CN108123998B (zh) | 多云数据中心中面向延迟敏感应用的启发式请求调度方法 | |
CN115543577B (zh) | 基于协变量的Kubernetes资源调度优化方法、存储介质及设备 | |
CN110383245A (zh) | 具有动态反馈的安全智能联网架构 | |
CN117682429B (zh) | 一种物料控制系统的天车搬运指令调度方法及装置 | |
CN115408136A (zh) | 一种基于遗传算法的rpa流程调度方法 | |
CN111143036A (zh) | 一种基于强化学习的虚拟机资源调度方法 | |
CN114546608A (zh) | 一种基于边缘计算的任务调度方法 | |
CN116932201A (zh) | 一种面向深度学习训练任务的多资源共享调度方法 | |
CN118210603A (zh) | 一种基于增强生长优化器的云资源调度方法 | |
CN109976873A (zh) | 容器化分布式计算框架的调度方案获取方法及调度方法 | |
CN109670579A (zh) | 模型生成方法和装置 | |
CN116048801A (zh) | 边缘环境下动态负载均衡的深度强话化学习资源调度方法 | |
CN109298934A (zh) | 心跳周期调整方法、装置及系统 | |
CN109101340A (zh) | 弹幕消息的动态分发方法、装置、设备和存储介质 | |
CN110928683B (zh) | 基于两类密集型虚拟机的边缘计算资源分配方法 | |
CN113535365A (zh) | 基于强化学习的深度学习训练作业资源放置系统及方法 | |
CN114327925A (zh) | 一种电力数据实时计算调度优化方法及系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20231106 Address after: 401120 Room 1, Floor A21, Pisces, No. 53, Middle Mount Huangshan Avenue, Yubei District, Chongqing Patentee after: Chongqing Zhongke Liangjiang Technology Development Co.,Ltd. Address before: 401121 No. 53, middle section of Huangshan Avenue, Yubei District, Chongqing Patentee before: Western Institute of advanced technology, Institute of computing, Chinese Academy of Sciences |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20231214 Address after: Room 204, 2nd Floor, Building 1, No. 68, West Street, Haidian Town, Haidian District, Beijing 100089 Patentee after: HYPERAI CLOUD TECHNOLOGY (BEIJING) Co.,Ltd. Address before: 401120 Room 1, Floor A21, Pisces, No. 53, Middle Mount Huangshan Avenue, Yubei District, Chongqing Patentee before: Chongqing Zhongke Liangjiang Technology Development Co.,Ltd. |
|
TR01 | Transfer of patent right |