SG11201808118PA - Method and apparatus for task scheduling - Google Patents

Method and apparatus for task scheduling

Info

Publication number
SG11201808118PA
SG11201808118PA SG11201808118PA SG11201808118PA SG11201808118PA SG 11201808118P A SG11201808118P A SG 11201808118PA SG 11201808118P A SG11201808118P A SG 11201808118PA SG 11201808118P A SG11201808118P A SG 11201808118PA SG 11201808118P A SG11201808118P A SG 11201808118PA
Authority
SG
Singapore
Prior art keywords
task
network resources
reading
writing
cluster
Prior art date
Application number
SG11201808118PA
Inventor
Le He
Yan Huang
Yingjie Shi
Jie Zhang
Chen Zhang
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Publication of SG11201808118PA publication Critical patent/SG11201808118PA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083—Techniques for rebalancing the load in a distributed system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching
    • G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5033—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering data affinity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G06F9/5072—Grid computing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00
    • G06F2209/48—Indexing scheme relating to G06F9/48
    • G06F2209/486—Scheduler internals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00
    • G06F2209/50—Indexing scheme relating to G06F9/50
    • G06F2209/504—Resource capping

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

METHOD AND APPARATUS FOR TASK SCHEDULING The disclosed embodiments provide a task scheduling method and apparatus. Network resources needed for a task to perform cross-cluster reading and writing are analyzed to obtain usage information of the occupied network resources for reading and writing; and the task is scheduled according to the usage information of the network resources needed for reading and writing. Because the usage information of the network resources occupied for reading and writing respectively represent network resources that can be saved by the cluster where access data is located when the task is scheduled for reading and writing, it can be determined that the cluster to which the task is scheduled can enable the task to occupy less network resources, thereby solving the problem of high bandwidth usage across clusters in current systems. Fig.
SG11201808118PA 2016-03-25 2017-03-16 Method and apparatus for task scheduling SG11201808118PA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610179807.5A CN107229517A (en) 2016-03-25 2016-03-25 Method for scheduling task and device
PCT/CN2017/076877 WO2017162086A1 (en) 2016-03-25 2017-03-16 Task scheduling method and device

Publications (1)

Publication Number Publication Date
SG11201808118PA true SG11201808118PA (en) 2018-10-30

Family

ID=59899220

Family Applications (2)

Application Number Title Priority Date Filing Date
SG10202009481XA SG10202009481XA (en) 2016-03-25 2017-03-16 Method and apparatus for task scheduling
SG11201808118PA SG11201808118PA (en) 2016-03-25 2017-03-16 Method and apparatus for task scheduling

Family Applications Before (1)

Application Number Title Priority Date Filing Date
SG10202009481XA SG10202009481XA (en) 2016-03-25 2017-03-16 Method and apparatus for task scheduling

Country Status (6)

Country Link
US (1) US10922133B2 (en)
EP (1) EP3413197B1 (en)
CN (1) CN107229517A (en)
SG (2) SG10202009481XA (en)
TW (1) TWI738721B (en)
WO (1) WO2017162086A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3553747B1 (en) * 2018-04-09 2021-09-01 BlackBerry Limited Methods and devices for predictive coding of point clouds
CN109145053B (en) * 2018-08-01 2021-03-23 创新先进技术有限公司 Data processing method and device, client and server
CN109144791B (en) * 2018-09-30 2020-12-22 北京金山云网络技术有限公司 Data unloading method and device and data management server
US11579908B2 (en) 2018-12-18 2023-02-14 Vmware, Inc. Containerized workload scheduling
CN109743390B (en) * 2019-01-04 2022-02-22 深圳壹账通智能科技有限公司 Task scheduling method and device, computer equipment and storage medium
CN110188490B (en) * 2019-06-03 2021-03-23 珠海格力电器股份有限公司 Method and device for improving data simulation efficiency, storage medium and electronic device
CN114978929B (en) * 2022-04-29 2023-08-18 苏州浪潮智能科技有限公司 Network scheduling device and method
CN117472530B (en) * 2023-10-25 2024-04-05 上海宽睿信息科技有限责任公司 Centralized management-based data intelligent scheduling method and system

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6647408B1 (en) 1999-07-16 2003-11-11 Novell, Inc. Task distribution
US7519726B2 (en) * 2003-12-12 2009-04-14 International Business Machines Corporation Methods, apparatus and computer programs for enhanced access to resources within a network
US7490220B2 (en) 2004-06-08 2009-02-10 Rajeev Balasubramonian Multi-cluster processor operating only select number of clusters during each phase based on program statistic monitored at predetermined intervals
US7861246B2 (en) 2004-06-17 2010-12-28 Platform Computing Corporation Job-centric scheduling in a grid environment
JP4477437B2 (en) * 2004-07-02 2010-06-09 株式会社日立製作所 Storage device, inter-cluster data communication method, and cluster communication control program thereof
US20060184941A1 (en) 2005-02-15 2006-08-17 Bea Systems, Inc. Distributed task framework
US7934199B2 (en) 2005-09-16 2011-04-26 International Business Machines Corporation Automated operation of IT resources with multiple choice configuration
US8082362B1 (en) 2006-04-27 2011-12-20 Netapp, Inc. System and method for selection of data paths in a clustered storage system
CN101236513B (en) 2007-01-30 2012-07-18 阿里巴巴集团控股有限公司 Distributed task system and distributed task management process
US8281012B2 (en) * 2008-01-30 2012-10-02 International Business Machines Corporation Managing parallel data processing jobs in grid environments
US20090319608A1 (en) 2008-06-23 2009-12-24 Microsoft Corporation Automated task centered collaboration
US9239994B2 (en) 2009-02-25 2016-01-19 Empire Technology Development Llc Data centers task mapping
US8874505B2 (en) * 2011-01-11 2014-10-28 Hitachi, Ltd. Data replication and failure recovery method for distributed key-value store
CN103092683B (en) * 2011-11-07 2017-12-26 Sap欧洲公司 For data analysis based on didactic scheduling
CN103377075A (en) * 2012-04-28 2013-10-30 腾讯科技（深圳）有限公司 Task management method, device and system
CN103019853A (en) * 2012-11-19 2013-04-03 北京亿赞普网络技术有限公司 Method and device for dispatching job task
WO2015139164A1 (en) * 2014-03-17 2015-09-24 华为技术有限公司 Task scheduling method, apparatus and device
US9977699B2 (en) 2014-11-17 2018-05-22 Mediatek, Inc. Energy efficient multi-cluster system and its operations
CN104679479B (en) * 2015-03-12 2017-10-24 中国人民解放军信息工程大学 A kind of multinuclear cipher processor of the scheduling controlling mechanism of task based access control numbering
CN106161525B (en) 2015-04-03 2019-09-17 阿里巴巴集团控股有限公司 A kind of more cluster management methods and equipment
CN105162878B (en) * 2015-09-24 2018-08-31 网宿科技股份有限公司 Document distribution system based on distributed storage and method

Also Published As

Publication number Publication date
EP3413197A1 (en) 2018-12-12
TWI738721B (en) 2021-09-11
EP3413197A4 (en) 2019-10-02
EP3413197B1 (en) 2022-11-30
WO2017162086A1 (en) 2017-09-28
CN107229517A (en) 2017-10-03
US20190034228A1 (en) 2019-01-31
SG10202009481XA (en) 2020-11-27
TW201737113A (en) 2017-10-16
US10922133B2 (en) 2021-02-16

Similar Documents

Publication Publication Date Title
SG11201808118PA (en) Method and apparatus for task scheduling
GB2541625A (en) Systems and techniques for predictive data analytics
PH12019550060A1 (en) Method and system for selective access of stored or transmitted bioinformatics data
GB2553959A (en) Access control for data resources
CA2902821C (en) System for metadata management
WO2014145076A3 (en) Crowdsourcing domain specific intelligence
GB2525788A (en) Data synchronization
GB2569060A (en) Workload optimized data deduplication using ghost fingerprints
SG10201906917QA (en) Processing data from multiple sources
GB2507921A (en) Systems and methods for processing spectrum coexistence information to optimize spectrum allocation
MX2016007771A (en) Project management system providing optimized interaction with digital models.
IL290642A (en) Classification of data using aggregated information from multiple classification modules
MY185857A (en) Systems and methods for core droop mitigation based on license state
EP3101598A3 (en) Augmented neural networks
GB2514275A (en) Identifying and ranking solutions from multiple data sources
MX2017012505A (en) Setting different background model sensitivities by user defined regions and background filters.
MX2021003267A (en) Three-dimensional data encoding method, three-dimensional data decoding method, three-dimensional data encoding device, and three-dimensional data decoding device.
GB2517361A (en) Queuing data for multiple readers and writers
TR201900349T4 (en) Programming Based on Media or Channel Sensing
MX2018002572A (en) Systems and methods for enabling a user to generate a plan to access content using multiple content services.
WO2018160770A3 (en) Communicator
CN103440197B (en) A kind of method automatically generating difference test report based on contrast test
GB2527704A (en) Optical code
MX2015008690A (en) System and method for prescriptive analytics.
GB2562910A (en) Automatic execution of objects in a user interface