CN113821311A - 任务执行方法及存储设备 - Google Patents

任务执行方法及存储设备 Download PDF

Info

Publication number
CN113821311A
CN113821311A CN202010564326.2A CN202010564326A CN113821311A CN 113821311 A CN113821311 A CN 113821311A CN 202010564326 A CN202010564326 A CN 202010564326A CN 113821311 A CN113821311 A CN 113821311A
Authority
CN
China
Prior art keywords
processor
data
subtask
subtasks
storage device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010564326.2A
Other languages
English (en)
Chinese (zh)
Inventor
钟刊
崔文林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202010564326.2A priority Critical patent/CN113821311A/zh
Priority to PCT/CN2021/097449 priority patent/WO2021254135A1/fr
Priority to EP21825322.7A priority patent/EP4160405A4/fr
Publication of CN113821311A publication Critical patent/CN113821311A/zh
Priority to US18/067,492 priority patent/US20230124520A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching
    • G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G06F9/5066—Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G06F15/76—Architectures of general purpose stored program computers
    • G06F15/78—Architectures of general purpose stored program computers comprising a single central processing unit
    • G06F15/7807—System on chip, i.e. computer system on a single chip; System in package, i.e. computer system on one or more chips in a single package
    • G06F15/7821—Tightly coupled to memory, e.g. computational memory, smart memory, processor in memory
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN202010564326.2A 2020-06-19 2020-06-19 任务执行方法及存储设备 Pending CN113821311A (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN202010564326.2A CN113821311A (zh) 2020-06-19 2020-06-19 任务执行方法及存储设备
PCT/CN2021/097449 WO2021254135A1 (fr) 2020-06-19 2021-05-31 Procédé d'exécution de tâche et dispositif de stockage
EP21825322.7A EP4160405A4 (fr) 2020-06-19 2021-05-31 Procédé d'exécution de tâche et dispositif de stockage
US18/067,492 US20230124520A1 (en) 2020-06-19 2022-12-16 Task execution method and storage device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010564326.2A CN113821311A (zh) 2020-06-19 2020-06-19 任务执行方法及存储设备

Publications (1)

Publication Number Publication Date
CN113821311A true CN113821311A (zh) 2021-12-21

Family

ID=78912077

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010564326.2A Pending CN113821311A (zh) 2020-06-19 2020-06-19 任务执行方法及存储设备

Country Status (4)

Country Link
US (1) US20230124520A1 (fr)
EP (1) EP4160405A4 (fr)
CN (1) CN113821311A (fr)
WO (1) WO2021254135A1 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115658325A (zh) * 2022-11-18 2023-01-31 北京市大数据中心 数据处理方法、装置、多核处理器、电子设备以及介质
CN116074179A (zh) * 2023-03-06 2023-05-05 鹏城实验室 基于cpu-npu协同的高扩展节点系统及训练方法
CN116149856A (zh) * 2023-01-09 2023-05-23 中科驭数（北京）科技有限公司 算子计算方法、装置、设备及介质
WO2023143033A1 (fr) * 2022-01-30 2023-08-03 华为技术有限公司 Procédé et appareil d'accès à un nœud de stockage, et dispositif informatique
WO2023160319A1 (fr) * 2022-02-24 2023-08-31 华为技术有限公司 Procédé d'exécution de tâche et dispositif associé
WO2024041140A1 (fr) * 2022-08-23 2024-02-29 华为技术有限公司 Procédé de traitement de données, accélérateur et dispositif informatique
WO2024119764A1 (fr) * 2022-12-06 2024-06-13 苏州元脑智能科技有限公司 Procédé et appareil de planification de tâches, dispositif électronique et support de stockage

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11977780B2 (en) * 2021-05-17 2024-05-07 Samsung Electronics Co., Ltd. Near memory processing dual in-line memory module and method for operating the same
CN116594745A (zh) * 2023-05-11 2023-08-15 阿里巴巴达摩院(杭州)科技有限公司 任务执行方法、系统、芯片及电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102652309A (zh) * 2009-12-10 2012-08-29 国际商业机器公司 处理资源管理的计算机实现的方法
CN108491263A (zh) * 2018-03-02 2018-09-04 珠海市魅族科技有限公司 数据处理方法、数据处理装置、终端及可读存储介质
CN109885388A (zh) * 2019-01-31 2019-06-14 上海赜睿信息科技有限公司 一种适用于异构系统的数据处理方法和装置
CN110489223A (zh) * 2019-08-26 2019-11-22 北京邮电大学 一种异构集群中任务调度方法、装置及电子设备
CN110532103A (zh) * 2019-09-09 2019-12-03 北京西山居互动娱乐科技有限公司 一种多任务处理的方法及装置

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1910553A (zh) * 2004-01-08 2007-02-07 皇家飞利浦电子股份有限公司 基于存储器要求在多处理器系统中进行任务调度的方法和设备
CN101441615A (zh) * 2008-11-24 2009-05-27 中国人民解放军信息工程大学 面向任务流的高效能立体并行柔性可重构计算架构模型
US9753770B2 (en) * 2014-04-03 2017-09-05 Strato Scale Ltd. Register-type-aware scheduling of virtual central processing units
CN105589829A (zh) * 2014-09-15 2016-05-18 华为技术有限公司 基于多核处理器芯片的数据处理方法、装置以及系统
US10073715B2 (en) * 2016-12-19 2018-09-11 Intel Corporation Dynamic runtime task management
CN110502330A (zh) * 2018-05-16 2019-11-26 上海寒武纪信息科技有限公司 处理器及处理方法
US10871989B2 (en) * 2018-10-18 2020-12-22 Oracle International Corporation Selecting threads for concurrent processing of data
CN110196775A (zh) * 2019-05-30 2019-09-03 苏州浪潮智能科技有限公司 一种计算任务处理方法、装置、设备以及可读存储介质
US11106495B2 (en) * 2019-06-13 2021-08-31 Intel Corporation Techniques to dynamically partition tasks

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102652309A (zh) * 2009-12-10 2012-08-29 国际商业机器公司 处理资源管理的计算机实现的方法
CN108491263A (zh) * 2018-03-02 2018-09-04 珠海市魅族科技有限公司 数据处理方法、数据处理装置、终端及可读存储介质
CN109885388A (zh) * 2019-01-31 2019-06-14 上海赜睿信息科技有限公司 一种适用于异构系统的数据处理方法和装置
CN110489223A (zh) * 2019-08-26 2019-11-22 北京邮电大学 一种异构集群中任务调度方法、装置及电子设备
CN110532103A (zh) * 2019-09-09 2019-12-03 北京西山居互动娱乐科技有限公司 一种多任务处理的方法及装置

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023143033A1 (fr) * 2022-01-30 2023-08-03 华为技术有限公司 Procédé et appareil d'accès à un nœud de stockage, et dispositif informatique
WO2023160319A1 (fr) * 2022-02-24 2023-08-31 华为技术有限公司 Procédé d'exécution de tâche et dispositif associé
WO2024041140A1 (fr) * 2022-08-23 2024-02-29 华为技术有限公司 Procédé de traitement de données, accélérateur et dispositif informatique
CN115658325A (zh) * 2022-11-18 2023-01-31 北京市大数据中心 数据处理方法、装置、多核处理器、电子设备以及介质
CN115658325B (zh) * 2022-11-18 2024-01-23 北京市大数据中心 数据处理方法、装置、多核处理器、电子设备以及介质
WO2024119764A1 (fr) * 2022-12-06 2024-06-13 苏州元脑智能科技有限公司 Procédé et appareil de planification de tâches, dispositif électronique et support de stockage
CN116149856A (zh) * 2023-01-09 2023-05-23 中科驭数（北京）科技有限公司 算子计算方法、装置、设备及介质
CN116074179A (zh) * 2023-03-06 2023-05-05 鹏城实验室 基于cpu-npu协同的高扩展节点系统及训练方法

Also Published As

Publication number Publication date
EP4160405A4 (fr) 2023-10-11
WO2021254135A1 (fr) 2021-12-23
EP4160405A1 (fr) 2023-04-05
US20230124520A1 (en) 2023-04-20

Similar Documents

Publication Publication Date Title
CN113821311A (zh) 任务执行方法及存储设备
CN110168516B (zh) 用于大规模并行处理的动态计算节点分组方法及系统
US8230432B2 (en) Defragmenting blocks in a clustered or distributed computing system
US8112526B2 (en) Process migration based on service availability in a multi-node environment
US10268741B2 (en) Multi-nodal compression techniques for an in-memory database
Yang et al. Intermediate data caching optimization for multi-stage and parallel big data frameworks
US9684600B2 (en) Dynamic process/object scoped memory affinity adjuster
US20170228422A1 (en) Flexible task scheduler for multiple parallel processing of database data
Arfat et al. Big data for smart infrastructure design: Opportunities and challenges
CN112181613B (zh) 异构资源分布式计算平台批量任务调度方法及存储介质
Senthilkumar et al. A survey on job scheduling in big data
US8027972B2 (en) Nodal data normalization
Wang et al. Actcap: Accelerating mapreduce on heterogeneous clusters with capability-aware data placement
Ma et al. Dependency-aware data locality for MapReduce
US20160034528A1 (en) Co-processor-based array-oriented database processing
US20090319662A1 (en) Process Migration Based on Exception Handling in a Multi-Node Environment
US20220075655A1 (en) Efficient accelerator offload in multi-accelerator framework
US11762860B1 (en) Dynamic concurrency level management for database queries
US20210390405A1 (en) Microservice-based training systems in heterogeneous graphic processor unit (gpu) cluster and operating method thereof
Yankovitch et al. Hypersonic: A hybrid parallelization approach for scalable complex event processing
CN114443680A (zh) 数据库管理系统、相关装置、方法和介质
CN113792079B (zh) 数据查询方法、装置、计算机设备和存储介质
Pan et al. CongraPlus: towards efficient processing of concurrent graph queries on NUMA machines
CN110415162B (zh) 大数据中面向异构融合处理器的自适应图划分方法
US10824640B1 (en) Framework for scheduling concurrent replication cycles

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination