CN107038067B - 分布式流处理中处理资源的管理方法和装置 - Google Patents
分布式流处理中处理资源的管理方法和装置 Download PDFInfo
- Publication number
- CN107038067B CN107038067B CN201610809508.5A CN201610809508A CN107038067B CN 107038067 B CN107038067 B CN 107038067B CN 201610809508 A CN201610809508 A CN 201610809508A CN 107038067 B CN107038067 B CN 107038067B
- Authority
- CN
- China
- Prior art keywords
- processing
- rate
- processing unit
- stream
- maximum
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5022—Mechanisms to release resources
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
Claims (16)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610809508.5A CN107038067B (zh) | 2016-09-07 | 2016-09-07 | 分布式流处理中处理资源的管理方法和装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610809508.5A CN107038067B (zh) | 2016-09-07 | 2016-09-07 | 分布式流处理中处理资源的管理方法和装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107038067A CN107038067A (zh) | 2017-08-11 |
CN107038067B true CN107038067B (zh) | 2020-12-04 |
Family
ID=59533068
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610809508.5A Active CN107038067B (zh) | 2016-09-07 | 2016-09-07 | 分布式流处理中处理资源的管理方法和装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107038067B (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107832129B (zh) * | 2017-10-24 | 2020-05-19 | 华中科技大学 | 一种面向分布式流计算系统的动态任务调度优化方法 |
CN112596503B (zh) * | 2020-12-18 | 2022-04-22 | 浙江中控技术股份有限公司 | 一种控制系统扫描周期的配置方法和相关设备 |
CN117240788B (zh) * | 2023-11-15 | 2024-03-08 | 南京邮电大学 | 一种基于sdn的数据中心网络拥塞控制方法 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101441557A (zh) * | 2008-11-08 | 2009-05-27 | 腾讯科技(深圳)有限公司 | 基于动态数据拆分的分布式并行计算的系统及其方法 |
CN104066193A (zh) * | 2014-06-06 | 2014-09-24 | 电信科学技术研究院 | 一种调度方法及装置 |
CN104978232A (zh) * | 2014-04-09 | 2015-10-14 | 阿里巴巴集团控股有限公司 | 用于实时流式计算的计算资源扩容、释放方法及其装置 |
CN105094967A (zh) * | 2015-06-26 | 2015-11-25 | 小米科技有限责任公司 | 进程运行方法及装置 |
-
2016
- 2016-09-07 CN CN201610809508.5A patent/CN107038067B/zh active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101441557A (zh) * | 2008-11-08 | 2009-05-27 | 腾讯科技(深圳)有限公司 | 基于动态数据拆分的分布式并行计算的系统及其方法 |
CN104978232A (zh) * | 2014-04-09 | 2015-10-14 | 阿里巴巴集团控股有限公司 | 用于实时流式计算的计算资源扩容、释放方法及其装置 |
CN104066193A (zh) * | 2014-06-06 | 2014-09-24 | 电信科学技术研究院 | 一种调度方法及装置 |
CN105094967A (zh) * | 2015-06-26 | 2015-11-25 | 小米科技有限责任公司 | 进程运行方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN107038067A (zh) | 2017-08-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10127086B2 (en) | Dynamic management of data stream processing | |
US8627330B2 (en) | Workload manager managing a workload of an enterprise data warehouse | |
CN111258737B (zh) | 一种资源调度的方法、装置和过滤式调度器 | |
US20150295970A1 (en) | Method and device for augmenting and releasing capacity of computing resources in real-time stream computing system | |
CN107295090B (zh) | 一种资源调度的方法和装置 | |
WO2017166643A1 (zh) | 一种任务资源的量化方法和装置 | |
US10735342B2 (en) | Dynamic buffer allocation in similar infrastructures | |
CN107038067B (zh) | 分布式流处理中处理资源的管理方法和装置 | |
CN111459641B (zh) | 一种跨机房的任务调度和任务处理的方法及装置 | |
CN108491255B (zh) | 自助式MapReduce数据优化分配方法及系统 | |
CN111432247B (zh) | 流量调度方法、装置、服务器及存储介质 | |
CN113228574A (zh) | 计算资源调度方法、调度器、物联网系统和计算机可读介质 | |
CN111522786A (zh) | 日志处理系统及方法 | |
CN106603256B (zh) | 一种流量控制方法及装置 | |
CN107491458A (zh) | 一种存储时间序列数据的方法和装置以及系统 | |
CN112860387A (zh) | 分布式任务调度方法、装置、计算机设备及存储介质 | |
CN112073327B (zh) | 一种抗拥塞的软件分流方法、装置及存储介质 | |
CN107203256A (zh) | 一种网络功能虚拟化场景下的节能分配方法与装置 | |
US11250001B2 (en) | Accurate partition sizing for memory efficient reduction operations | |
CN108536525B (zh) | 一种宿主机调度方法及装置 | |
Hassan et al. | Efficient resource scheduling for big data processing in cloud platform | |
CN112437015A (zh) | 分流调度方法、装置、系统和计算机可读存储介质 | |
US10540341B1 (en) | System and method for dedupe aware storage quality of service | |
CN115941622A (zh) | 一种带宽调节方法、系统、设备及存储介质 | |
CN115391051A (zh) | 视频计算任务调度方法、设备及计算机可读介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20200925 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20200925 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220418 Address after: Room 602, No. 618 Wai Road, Huangpu District, Shanghai Patentee after: Ant fortune (Shanghai) Financial Information Service Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee before: Innovative advanced technology Co.,Ltd. |