CN106445677A - 负载均衡方法及设备 - Google Patents

负载均衡方法及设备 Download PDF

Info

Publication number
CN106445677A
CN106445677A CN201510477498.5A CN201510477498A CN106445677A CN 106445677 A CN106445677 A CN 106445677A CN 201510477498 A CN201510477498 A CN 201510477498A CN 106445677 A CN106445677 A CN 106445677A
Authority
CN
China
Prior art keywords
partition
server
load
target
localization rate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510477498.5A
Other languages
English (en)
Chinese (zh)
Inventor
沈春辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201510477498.5A priority Critical patent/CN106445677A/zh
Priority to PCT/CN2016/091521 priority patent/WO2017020742A1/zh
Priority to JP2018505621A priority patent/JP6886964B2/ja
Publication of CN106445677A publication Critical patent/CN106445677A/zh
Priority to US15/890,319 priority patent/US20180167461A1/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5033—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering data affinity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083—Techniques for rebalancing the load in a distributed system
    • G06F9/5088—Techniques for rebalancing the load in a distributed system involving task migration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852—Delays
    • H04L43/087—Jitter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004—Server selection for load balancing
    • H04L67/101—Server selection for load balancing based on network conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0876—Network utilisation, e.g. volume of load or congestion level
    • H04L43/0882—Utilisation of link capacity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004—Server selection for load balancing
    • H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Computer And Data Communications (AREA)
CN201510477498.5A 2015-08-06 2015-08-06 负载均衡方法及设备 Pending CN106445677A (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201510477498.5A CN106445677A (zh) 2015-08-06 2015-08-06 负载均衡方法及设备
PCT/CN2016/091521 WO2017020742A1 (zh) 2015-08-06 2016-07-25 负载均衡方法及设备
JP2018505621A JP6886964B2 (ja) 2015-08-06 2016-07-25 負荷平衡方法及び装置
US15/890,319 US20180167461A1 (en) 2015-08-06 2018-02-06 Method and apparatus for load balancing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510477498.5A CN106445677A (zh) 2015-08-06 2015-08-06 负载均衡方法及设备

Publications (1)

Publication Number Publication Date
CN106445677A true CN106445677A (zh) 2017-02-22

Family

ID=57943807

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510477498.5A Pending CN106445677A (zh) 2015-08-06 2015-08-06 负载均衡方法及设备

Country Status (4)

Country Link
US (1) US20180167461A1 (enExample)
JP (1) JP6886964B2 (enExample)
CN (1) CN106445677A (enExample)
WO (1) WO2017020742A1 (enExample)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113608870A (zh) * 2021-07-28 2021-11-05 北京金山云网络技术有限公司 消息队列的负载均衡方法及装置、电子设备及存储介质
CN116303357A (zh) * 2023-03-17 2023-06-23 苏州浪潮智能科技有限公司 一种HBase数据方法、装置、电子设备及可读介质

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111124657B (zh) * 2018-10-31 2024-03-08 北京金山云网络技术有限公司 资源管理方法、装置、电子设备及存储介质
US11036698B2 (en) * 2018-12-06 2021-06-15 International Business Machines Corporation Non-relational database coprocessor for reading raw data files copied from relational databases
CN110007866B (zh) * 2019-04-11 2020-03-31 苏州浪潮智能科技有限公司 一种存储单元性能优化方法、装置、存储设备及存储介质
US10976963B2 (en) 2019-04-15 2021-04-13 International Business Machines Corporation Probabilistically selecting storage units based on latency or throughput in a dispersed storage network
US11165860B2 (en) 2019-11-01 2021-11-02 Uber Technologies, Inc. Dynamically computing load balancer subset size in a distributed computing system
CN111666159B (zh) * 2020-06-28 2021-08-27 腾讯科技（深圳）有限公司 负载均衡控制方法和装置、存储介质及电子设备
US11489776B2 (en) * 2020-07-28 2022-11-01 Arista Networks, Inc. Multicore offloading of network processing
US11025710B1 (en) * 2020-10-26 2021-06-01 Verizon Digital Media Services Inc. Systems and methods for dynamic load balancing based on server utilization and content popularity
US11971791B2 (en) * 2022-08-12 2024-04-30 Capital One Services, Llc Automated regional failover
CN116069594B (zh) * 2023-03-07 2023-06-16 武汉工程大学 一种负载均衡预测方法、装置、系统以及存储介质
CN120469786B (zh) * 2025-07-15 2025-11-07 北京科杰科技有限公司 大数据的任务调度方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120330954A1 (en) * 2011-06-27 2012-12-27 Swaminathan Sivasubramanian System And Method For Implementing A Scalable Data Storage Service
CN103226467A (zh) * 2013-05-23 2013-07-31 中国人民解放军国防科学技术大学 数据并行处理方法、系统及负载均衡调度器
CN103716381A (zh) * 2013-12-12 2014-04-09 华为技术有限公司 一种分布式系统的控制方法，及管理节点
CN104008012A (zh) * 2014-05-30 2014-08-27 长沙麓云信息科技有限公司 一种基于虚拟机动态迁移的高性能MapReduce实现机制
CN104102523A (zh) * 2013-04-03 2014-10-15 华为技术有限公司 迁移虚拟机的方法和资源调度平台
US20150095348A1 (en) * 2013-10-01 2015-04-02 Facebook, Inc. Systems and methods for dynamic mapping for locality and balance

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1640873A4 (en) * 2003-06-27 2008-03-05 Fujitsu Ltd METHOD FOR MANAGING THE MEMORY CAPACITY, SERVER THEREFOR AND RECORDING MEDIUM
JP5105894B2 (ja) * 2006-03-14 2012-12-26 キヤノン株式会社 文書検索システム、文書検索装置及びその方法とプログラム、記憶媒体
CN101610287B (zh) * 2009-06-16 2012-03-14 浙江大学 一种应用于分布式海量存储系统的负载均衡方法
US9740762B2 (en) * 2011-04-01 2017-08-22 Mongodb, Inc. System and method for optimizing data migration in a partitioned database
CN103268252A (zh) * 2013-05-12 2013-08-28 南京载玄信息科技有限公司 基于分布式存储的虚拟化平台系统及其实现方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120330954A1 (en) * 2011-06-27 2012-12-27 Swaminathan Sivasubramanian System And Method For Implementing A Scalable Data Storage Service
CN104102523A (zh) * 2013-04-03 2014-10-15 华为技术有限公司 迁移虚拟机的方法和资源调度平台
CN103226467A (zh) * 2013-05-23 2013-07-31 中国人民解放军国防科学技术大学 数据并行处理方法、系统及负载均衡调度器
US20150095348A1 (en) * 2013-10-01 2015-04-02 Facebook, Inc. Systems and methods for dynamic mapping for locality and balance
CN103716381A (zh) * 2013-12-12 2014-04-09 华为技术有限公司 一种分布式系统的控制方法，及管理节点
CN104008012A (zh) * 2014-05-30 2014-08-27 长沙麓云信息科技有限公司 一种基于虚拟机动态迁移的高性能MapReduce实现机制

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113608870A (zh) * 2021-07-28 2021-11-05 北京金山云网络技术有限公司 消息队列的负载均衡方法及装置、电子设备及存储介质
CN113608870B (zh) * 2021-07-28 2024-07-19 北京金山云网络技术有限公司 消息队列的负载均衡方法及装置、电子设备及存储介质
CN116303357A (zh) * 2023-03-17 2023-06-23 苏州浪潮智能科技有限公司 一种HBase数据方法、装置、电子设备及可读介质

Also Published As

Publication number Publication date
US20180167461A1 (en) 2018-06-14
WO2017020742A1 (zh) 2017-02-09
JP6886964B2 (ja) 2021-06-16
JP2018525743A (ja) 2018-09-06

Similar Documents

Publication Publication Date Title
CN106445677A (zh) 负载均衡方法及设备
US10356150B1 (en) Automated repartitioning of streaming data
US8751657B2 (en) Multi-client storage system and storage system management method
CN105094997B (zh) 一种云计算主机节点间物理内存共享方法和系统
CN103473365B (zh) 一种基于hdfs的文件存储方法、装置及分布式文件系统
US20130332608A1 (en) Load balancing for distributed key-value store
JP7467593B2 (ja) リソース割振り方法、記憶デバイス、および記憶システム
WO2021012956A1 (zh) 云平台的资源处理方法、相关设备及存储介质
WO2012173642A1 (en) Decentralized management of virtualized hosts
CN104580439B (zh) 一种云存储系统中使数据均匀分布的方法
US10616134B1 (en) Prioritizing resource hosts for resource placement
WO2017028696A1 (zh) 分布式存储系统的负载监控方法及设备
CN119806796B (zh) 弹性搜索集群的资源调度方法、装置及系统
WO2021057108A1 (zh) 一种读数据方法、写数据方法及服务器
CN104063501B (zh) 基于hdfs的副本平衡方法
US10761726B2 (en) Resource fairness control in distributed storage systems using congestion data
CN110995855B (zh) 微服务集群调度方法、调度装置及计算机可读存储介质
CN117648053A (zh) 一种数据存储方法、系统、设备及可读存储介质
US11080092B1 (en) Correlated volume placement in a distributed block storage service
US20160117107A1 (en) High Performance Hadoop with New Generation Instances
CN114253456A (zh) 一种缓存负载均衡方法和装置
US10824640B1 (en) Framework for scheduling concurrent replication cycles
CN117093357A (zh) 弹性搜索集群的资源调度方法、装置及系统
US11048554B1 (en) Correlated volume placement in a distributed block storage service
Huang et al. Resource provisioning with QoS in cloud storage

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170222

RJ01 Rejection of invention patent application after publication