JP6886964B2 - 負荷平衡方法及び装置 - Google Patents

負荷平衡方法及び装置 Download PDF

Info

Publication number
JP6886964B2
JP6886964B2 JP2018505621A JP2018505621A JP6886964B2 JP 6886964 B2 JP6886964 B2 JP 6886964B2 JP 2018505621 A JP2018505621 A JP 2018505621A JP 2018505621 A JP2018505621 A JP 2018505621A JP 6886964 B2 JP6886964 B2 JP 6886964B2
Authority
JP
Japan
Prior art keywords
server
load
area
region
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018505621A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018525743A (ja
JP2018525743A5 (cg-RX-API-DMAC10.html
Inventor
シェン，チュンホイ
Original Assignee
アリババ グループ ホウルディング リミテッド
アリババ グループ ホウルディング リミテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by アリババ グループ ホウルディング リミテッド, アリババ グループ ホウルディング リミテッド filed Critical アリババ グループ ホウルディング リミテッド
Publication of JP2018525743A publication Critical patent/JP2018525743A/ja
Publication of JP2018525743A5 publication Critical patent/JP2018525743A5/ja
Application granted granted Critical
Publication of JP6886964B2 publication Critical patent/JP6886964B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5033—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering data affinity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083—Techniques for rebalancing the load in a distributed system
    • G06F9/5088—Techniques for rebalancing the load in a distributed system involving task migration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852—Delays
    • H04L43/087—Jitter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004—Server selection for load balancing
    • H04L67/101—Server selection for load balancing based on network conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0876—Network utilisation, e.g. volume of load or congestion level
    • H04L43/0882—Utilisation of link capacity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004—Server selection for load balancing
    • H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Computer And Data Communications (AREA)
JP2018505621A 2015-08-06 2016-07-25 負荷平衡方法及び装置 Active JP6886964B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201510477498.5A CN106445677A (zh) 2015-08-06 2015-08-06 负载均衡方法及设备
CN201510477498.5 2015-08-06
PCT/CN2016/091521 WO2017020742A1 (zh) 2015-08-06 2016-07-25 负载均衡方法及设备

Publications (3)

Publication Number Publication Date
JP2018525743A JP2018525743A (ja) 2018-09-06
JP2018525743A5 JP2018525743A5 (cg-RX-API-DMAC10.html) 2019-09-05
JP6886964B2 true JP6886964B2 (ja) 2021-06-16

Family

ID=57943807

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018505621A Active JP6886964B2 (ja) 2015-08-06 2016-07-25 負荷平衡方法及び装置

Country Status (4)

Country Link
US (1) US20180167461A1 (cg-RX-API-DMAC10.html)
JP (1) JP6886964B2 (cg-RX-API-DMAC10.html)
CN (1) CN106445677A (cg-RX-API-DMAC10.html)
WO (1) WO2017020742A1 (cg-RX-API-DMAC10.html)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111124657B (zh) * 2018-10-31 2024-03-08 北京金山云网络技术有限公司 资源管理方法、装置、电子设备及存储介质
US11036698B2 (en) * 2018-12-06 2021-06-15 International Business Machines Corporation Non-relational database coprocessor for reading raw data files copied from relational databases
CN110007866B (zh) * 2019-04-11 2020-03-31 苏州浪潮智能科技有限公司 一种存储单元性能优化方法、装置、存储设备及存储介质
US10976963B2 (en) 2019-04-15 2021-04-13 International Business Machines Corporation Probabilistically selecting storage units based on latency or throughput in a dispersed storage network
US11165860B2 (en) 2019-11-01 2021-11-02 Uber Technologies, Inc. Dynamically computing load balancer subset size in a distributed computing system
CN111666159B (zh) * 2020-06-28 2021-08-27 腾讯科技（深圳）有限公司 负载均衡控制方法和装置、存储介质及电子设备
US11489776B2 (en) * 2020-07-28 2022-11-01 Arista Networks, Inc. Multicore offloading of network processing
US11025710B1 (en) * 2020-10-26 2021-06-01 Verizon Digital Media Services Inc. Systems and methods for dynamic load balancing based on server utilization and content popularity
CN113608870B (zh) * 2021-07-28 2024-07-19 北京金山云网络技术有限公司 消息队列的负载均衡方法及装置、电子设备及存储介质
CN117014442A (zh) * 2022-04-27 2023-11-07 广联达西安科技有限公司 HBase表的负载均衡方法、装置、设备及可读存储介质
US11971791B2 (en) 2022-08-12 2024-04-30 Capital One Services, Llc Automated regional failover
CN116069594B (zh) * 2023-03-07 2023-06-16 武汉工程大学 一种负载均衡预测方法、装置、系统以及存储介质
CN116303357A (zh) * 2023-03-17 2023-06-23 苏州浪潮智能科技有限公司 一种HBase数据方法、装置、电子设备及可读介质
CN120469786B (zh) * 2025-07-15 2025-11-07 北京科杰科技有限公司 大数据的任务调度方法及系统

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1640873A4 (en) * 2003-06-27 2008-03-05 Fujitsu Ltd METHOD FOR MANAGING THE MEMORY CAPACITY, SERVER THEREFOR AND RECORDING MEDIUM
JP5105894B2 (ja) * 2006-03-14 2012-12-26 キヤノン株式会社 文書検索システム、文書検索装置及びその方法とプログラム、記憶媒体
CN101610287B (zh) * 2009-06-16 2012-03-14 浙江大学 一种应用于分布式海量存储系统的负载均衡方法
US9740762B2 (en) * 2011-04-01 2017-08-22 Mongodb, Inc. System and method for optimizing data migration in a partitioned database
US8595267B2 (en) * 2011-06-27 2013-11-26 Amazon Technologies, Inc. System and method for implementing a scalable data storage service
CN104102523A (zh) * 2013-04-03 2014-10-15 华为技术有限公司 迁移虚拟机的方法和资源调度平台
CN103268252A (zh) * 2013-05-12 2013-08-28 南京载玄信息科技有限公司 基于分布式存储的虚拟化平台系统及其实现方法
CN103226467B (zh) * 2013-05-23 2015-09-30 中国人民解放军国防科学技术大学 数据并行处理方法、系统及负载均衡调度器
US9934323B2 (en) * 2013-10-01 2018-04-03 Facebook, Inc. Systems and methods for dynamic mapping for locality and balance
CN103716381B (zh) * 2013-12-12 2017-04-12 华为技术有限公司 一种分布式系统的控制方法，及管理节点
CN104008012B (zh) * 2014-05-30 2017-10-20 长沙麓云信息科技有限公司 一种基于虚拟机动态迁移的高性能MapReduce实现方法

Also Published As

Publication number Publication date
US20180167461A1 (en) 2018-06-14
JP2018525743A (ja) 2018-09-06
WO2017020742A1 (zh) 2017-02-09
CN106445677A (zh) 2017-02-22

Similar Documents

Publication Publication Date Title
JP2018525743A (ja) 負荷平衡方法及び装置
US20220329651A1 (en) Apparatus for container orchestration in geographically distributed multi-cloud environment and method using the same
Chowdhury et al. Leveraging endpoint flexibility in data-intensive clusters
US10209908B2 (en) Optimization of in-memory data grid placement
US20170031622A1 (en) Methods for allocating storage cluster hardware resources and devices thereof
US20130263142A1 (en) Control device, control method, computer readable recording medium in which program is recorded, and distributed processing system
US20150199219A1 (en) Method and apparatus for server cluster management
US8589644B2 (en) Non-transitory medium, access control method, and information processing apparatus
EP3951607B1 (en) Data reading method, data writing method, and server
CN104580439B (zh) 一种云存储系统中使数据均匀分布的方法
CN110493317B (zh) 处理云平台资源碎片的方法及相关设备
US20160173620A1 (en) Time-based data placement in a distributed storage system
CN119806796B (zh) 弹性搜索集群的资源调度方法、装置及系统
WO2016041446A1 (zh) 一种资源分配方法、装置及设备
CN115941622A (zh) 一种带宽调节方法、系统、设备及存储介质
CN110178119B (zh) 处理业务请求的方法、装置与存储系统
US10761726B2 (en) Resource fairness control in distributed storage systems using congestion data
US11080092B1 (en) Correlated volume placement in a distributed block storage service
US10606478B2 (en) High performance hadoop with new generation instances
US10254973B2 (en) Data management system and method for processing distributed data
US10609132B2 (en) Hash data structure biasing
CN112685167B (zh) 资源使用方法、电子设备和计算机程序产品
US11048554B1 (en) Correlated volume placement in a distributed block storage service
CN119806395A (zh) 分布式存储系统的数据管理方法、电子设备和存储介质
US12450086B1 (en) Host fleet management optimizations in a cloud provider network

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190724

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20190724

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20200416

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20200513

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20200813

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200916

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210302

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210312

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210324

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20210423

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210517

R150 Certificate of patent or registration of utility model

Ref document number: 6886964

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R360 Written notification for declining of transfer of rights

Free format text: JAPANESE INTERMEDIATE CODE: R360

R360 Written notification for declining of transfer of rights

Free format text: JAPANESE INTERMEDIATE CODE: R360

R371 Transfer withdrawn

Free format text: JAPANESE INTERMEDIATE CODE: R371

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: R3D02