CN104081353B - 可缩放环境中的动态负载平衡 - Google Patents

可缩放环境中的动态负载平衡 Download PDF

Info

Publication number
CN104081353B
CN104081353B CN201380007789.7A CN201380007789A CN104081353B CN 104081353 B CN104081353 B CN 104081353B CN 201380007789 A CN201380007789 A CN 201380007789A CN 104081353 B CN104081353 B CN 104081353B
Authority
CN
China
Prior art keywords
partition
server
load balancing
load
namespace
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201380007789.7A
Other languages
English (en)
Chinese (zh)
Other versions
CN104081353A (zh
Inventor
A·E·绍尔斯沃德
B·G·卡尔德
J·王
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp, Microsoft Technology Licensing LLC filed Critical Microsoft Corp
Publication of CN104081353A publication Critical patent/CN104081353A/zh
Application granted granted Critical
Publication of CN104081353B publication Critical patent/CN104081353B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G06F9/5077—Logical partitioning of resources; Management or configuration of virtualized resources
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083—Techniques for rebalancing the load in a distributed system

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Computer And Data Communications (AREA)
CN201380007789.7A 2012-02-03 2013-02-01 可缩放环境中的动态负载平衡 Active CN104081353B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/366,052 US8868711B2 (en) 2012-02-03 2012-02-03 Dynamic load balancing in a scalable environment
US13/366,052 2012-02-03
PCT/US2013/024366 WO2013116664A1 (en) 2012-02-03 2013-02-01 Dynamic load balancing in a scalable environment

Publications (2)

Publication Number Publication Date
CN104081353A CN104081353A (zh) 2014-10-01
CN104081353B true CN104081353B (zh) 2018-08-03

Family

ID=48903896

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380007789.7A Active CN104081353B (zh) 2012-02-03 2013-02-01 可缩放环境中的动态负载平衡

Country Status (6)

Country Link
US (1) US8868711B2 (https=)
EP (1) EP2810163A4 (https=)
JP (1) JP6185486B2 (https=)
KR (1) KR102013004B1 (https=)
CN (1) CN104081353B (https=)
WO (1) WO2013116664A1 (https=)

Families Citing this family (96)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8782434B1 (en) 2010-07-15 2014-07-15 The Research Foundation For The State University Of New York System and method for validating program execution at run-time
US10331801B2 (en) 2011-09-23 2019-06-25 Open Invention Network, Llc System for live-migration and automated recovery of applications in a distributed system
US10311027B2 (en) 2011-09-23 2019-06-04 Open Invention Network, Llc System for live-migration and automated recovery of applications in a distributed system
GB2495079A (en) 2011-09-23 2013-04-03 Hybrid Logic Ltd Live migration of applications and file systems in a distributed system
US9852010B2 (en) 2012-02-03 2017-12-26 Microsoft Technology Licensing, Llc Decoupling partitioning for scalability
US10860384B2 (en) 2012-02-03 2020-12-08 Microsoft Technology Licensing, Llc Managing partitions in a scalable environment
US20130219069A1 (en) * 2012-02-22 2013-08-22 Computer Associates Think, Inc. System and method for managing virtual hard disks in cloud environments
US9141430B2 (en) * 2012-04-30 2015-09-22 Hewlett-Packard Development Company, L.P. Scheduling mapreduce job sets
US9774676B2 (en) 2012-05-21 2017-09-26 Google Inc. Storing and moving data in a distributed storage system
US9298576B2 (en) 2012-06-04 2016-03-29 Google Inc. Collecting processor usage statistics
WO2013184712A2 (en) 2012-06-04 2013-12-12 Google Inc. Systems and methods of increasing database access concurrency using granular timestamps
US9659038B2 (en) 2012-06-04 2017-05-23 Google Inc. Efficient snapshot read of a database in a distributed storage system
US9449006B2 (en) 2012-06-04 2016-09-20 Google Inc. Method and system for deleting obsolete files from a file system
US9230000B1 (en) 2012-06-04 2016-01-05 Google Inc. Pipelining Paxos state machines
US9015721B2 (en) * 2012-07-30 2015-04-21 Hewlett-Packard Development Company, L. P. Managing array computations during programmatic run-time in a distributed computing environment
US10652318B2 (en) * 2012-08-13 2020-05-12 Verisign, Inc. Systems and methods for load balancing using predictive routing
US9122873B2 (en) 2012-09-14 2015-09-01 The Research Foundation For The State University Of New York Continuous run-time validation of program execution: a practical approach
US9069782B2 (en) 2012-10-01 2015-06-30 The Research Foundation For The State University Of New York System and method for security and privacy aware virtual machine checkpointing
CN103809953B (zh) * 2012-11-14 2018-09-07 腾讯科技（深圳）有限公司 多媒体播放监测方法及系统
US9225638B2 (en) 2013-05-09 2015-12-29 Vmware, Inc. Method and system for service switching using service tags
US9489443B1 (en) * 2013-05-24 2016-11-08 Amazon Technologies, Inc. Scheduling of splits and moves of database partitions
US9197546B2 (en) * 2013-08-06 2015-11-24 Oracle International Corporation System and method for providing a messaging cluster with hybrid partitions
US20150089062A1 (en) * 2013-09-25 2015-03-26 Virtual Bridges, Inc. Methods and systems for dynamically specializing and re-purposing computer servers in an elastically scaling cloud computing infrastructure
US9886310B2 (en) 2014-02-10 2018-02-06 International Business Machines Corporation Dynamic resource allocation in MapReduce
US9513806B2 (en) 2014-05-01 2016-12-06 Microsoft Technology Licensing, Llc Dimension based load balancing
US9609054B2 (en) 2014-05-01 2017-03-28 Microsoft Technology Licensing, Llc Load balancing scalable storage utilizing optimization modules
US9798303B2 (en) * 2014-05-01 2017-10-24 Rockwell Automation Technologies, Inc. Systems and methods for balancing loads in an industrial automation system
US10261942B2 (en) 2014-05-01 2019-04-16 Longsand Limited Embedded processing of structured and unstructured data using a single application protocol interface (API)
US9513939B2 (en) 2014-05-19 2016-12-06 International Business Machines Corporation Agile VM load balancing through micro-checkpointing and multi-architecture emulation
US9286001B2 (en) 2014-06-30 2016-03-15 Microsoft Licensing Technology Llc Effective range partition splitting in scalable storage
CN105302536A (zh) 2014-07-31 2016-02-03 国际商业机器公司 MapReduce应用的相关参数的配置方法和装置
US9935827B2 (en) 2014-09-30 2018-04-03 Nicira, Inc. Method and apparatus for distributing load among a plurality of service nodes
US10135737B2 (en) * 2014-09-30 2018-11-20 Nicira, Inc. Distributed load balancing systems
US10129077B2 (en) 2014-09-30 2018-11-13 Nicira, Inc. Configuring and operating a XaaS model in a datacenter
US10776373B2 (en) * 2014-10-28 2020-09-15 Salesforce.Com, Inc. Facilitating elastic allocation of organization-specific queue resources in an on-demand services environment
US9798634B2 (en) * 2014-10-30 2017-10-24 Sap Se Distributed failover for multi-tenant server farms based on load times of replicated tenants
US10218779B1 (en) * 2015-02-26 2019-02-26 Google Llc Machine level resource distribution
US10594743B2 (en) 2015-04-03 2020-03-17 Nicira, Inc. Method, apparatus, and system for implementing a content switch
US9826030B1 (en) * 2015-06-04 2017-11-21 Amazon Technologies, Inc. Placement of volume partition replica pairs
US9826041B1 (en) 2015-06-04 2017-11-21 Amazon Technologies, Inc. Relative placement of volume partitions
WO2016199955A1 (ko) * 2015-06-10 2016-12-15 울산과학기술원 코드 분산 해쉬테이블 기반의 맵리듀스 시스템 및 방법
US10242018B2 (en) * 2016-04-18 2019-03-26 International Business Machines Corporation Page allocations for encrypted files
WO2017209788A1 (en) * 2016-06-03 2017-12-07 Google Llc Weighted auto-sharding
CN107562531B (zh) * 2016-06-30 2020-10-09 华为技术有限公司 一种数据均衡方法和装置
US10001983B2 (en) * 2016-07-27 2018-06-19 Salesforce.Com, Inc. Rolling version update deployment utilizing dynamic node allocation
US10956415B2 (en) 2016-09-26 2021-03-23 Splunk Inc. Generating a subquery for an external data system using a configuration file
US11620336B1 (en) 2016-09-26 2023-04-04 Splunk Inc. Managing and storing buckets to a remote shared storage system based on a collective bucket size
US11860940B1 (en) 2016-09-26 2024-01-02 Splunk Inc. Identifying buckets for query execution using a catalog of buckets
US11604795B2 (en) 2016-09-26 2023-03-14 Splunk Inc. Distributing partial results from an external data system between worker nodes
US12013895B2 (en) 2016-09-26 2024-06-18 Splunk Inc. Processing data using containerized nodes in a containerized scalable environment
US11281706B2 (en) 2016-09-26 2022-03-22 Splunk Inc. Multi-layer partition allocation for query execution
US10353965B2 (en) 2016-09-26 2019-07-16 Splunk Inc. Data fabric service system architecture
US10268726B1 (en) * 2017-04-20 2019-04-23 Amazon Technologies, Inc. Partition key management for improved throughput
US12118009B2 (en) 2017-07-31 2024-10-15 Splunk Inc. Supporting query languages through distributed execution of query engines
US11921672B2 (en) 2017-07-31 2024-03-05 Splunk Inc. Query execution at a remote heterogeneous data store of a data fabric service
US12248484B2 (en) 2017-07-31 2025-03-11 Splunk Inc. Reassigning processing tasks to an external storage system
US11989194B2 (en) * 2017-07-31 2024-05-21 Splunk Inc. Addressing memory limits for partition tracking among worker nodes
US10797966B2 (en) 2017-10-29 2020-10-06 Nicira, Inc. Service operation chaining
US11012420B2 (en) 2017-11-15 2021-05-18 Nicira, Inc. Third-party service chaining using packet encapsulation in a flow-based forwarding element
US10659252B2 (en) 2018-01-26 2020-05-19 Nicira, Inc Specifying and utilizing paths through a network
US10797910B2 (en) 2018-01-26 2020-10-06 Nicira, Inc. Specifying and utilizing paths through a network
US10805192B2 (en) 2018-03-27 2020-10-13 Nicira, Inc. Detecting failure of layer 2 service using broadcast messages
US10728174B2 (en) 2018-03-27 2020-07-28 Nicira, Inc. Incorporating layer 2 service between two interfaces of gateway device
US11334543B1 (en) 2018-04-30 2022-05-17 Splunk Inc. Scalable bucket merging for a data intake and query system
US10944673B2 (en) 2018-09-02 2021-03-09 Vmware, Inc. Redirection of data messages at logical network gateway
US11595250B2 (en) 2018-09-02 2023-02-28 Vmware, Inc. Service insertion at logical network gateway
US10977140B2 (en) 2018-11-06 2021-04-13 International Business Machines Corporation Fault tolerant distributed system to monitor, recover and scale load balancers
US11086654B2 (en) 2019-02-22 2021-08-10 Vmware, Inc. Providing services by using multiple service planes
JP7014752B2 (ja) * 2019-06-03 2022-02-01 矢崎総業株式会社 蓄熱材組成物及び建築物の冷暖房用の蓄熱システム
US11528194B2 (en) * 2019-09-06 2022-12-13 Jpmorgan Chase Bank, N.A. Enterprise control plane for data streaming service
US12210912B2 (en) * 2019-09-11 2025-01-28 Synchronoss Technologies, Inc Method and system for uniform, consistent, stateless and deterministic consistent hashing for fixed size partitions
US11494380B2 (en) 2019-10-18 2022-11-08 Splunk Inc. Management of distributed computing framework components in a data fabric service system
US11283717B2 (en) 2019-10-30 2022-03-22 Vmware, Inc. Distributed fault tolerant service chain
US11140218B2 (en) 2019-10-30 2021-10-05 Vmware, Inc. Distributed service chain across multiple clouds
KR102251863B1 (ko) * 2019-11-01 2021-05-14 경희대학교 산학협력단 차량 클라우드 컴퓨팅을 위한 작업 할당 방법 및 이를 수행하는 서버 및 차량 데이터 처리 시스템
US11169855B2 (en) * 2019-12-03 2021-11-09 Sap Se Resource allocation using application-generated notifications
US11223494B2 (en) 2020-01-13 2022-01-11 Vmware, Inc. Service insertion for multicast traffic at boundary
US11847478B2 (en) 2020-01-17 2023-12-19 Vmware, Inc. Real-time feedback associated with configuring virtual infrastructure objects using tags
US11153406B2 (en) 2020-01-20 2021-10-19 Vmware, Inc. Method of network performance visualization of service function chains
US11659061B2 (en) 2020-01-20 2023-05-23 Vmware, Inc. Method of adjusting service function chains to improve network performance
US11922222B1 (en) 2020-01-30 2024-03-05 Splunk Inc. Generating a modified component for a data intake and query system using an isolated execution environment image
US11277331B2 (en) 2020-04-06 2022-03-15 Vmware, Inc. Updating connection-tracking records at a network edge using flow programming
KR102260549B1 (ko) * 2020-09-10 2021-06-04 한국전자기술연구원 연합 컨테이너 환경에서 자원 사용률 및 지리적 위치 기반 로드밸런싱 방법
US11675631B2 (en) 2020-09-29 2023-06-13 Kyndryl, Inc. Balancing mainframe and distributed workloads based on performance and costs
US11704313B1 (en) 2020-10-19 2023-07-18 Splunk Inc. Parallel branch operation using intermediary nodes
US11025710B1 (en) * 2020-10-26 2021-06-01 Verizon Digital Media Services Inc. Systems and methods for dynamic load balancing based on server utilization and content popularity
US11611625B2 (en) 2020-12-15 2023-03-21 Vmware, Inc. Providing stateful services in a scalable manner for machines executing on host computers
US11734043B2 (en) 2020-12-15 2023-08-22 Vmware, Inc. Providing stateful services in a scalable manner for machines executing on host computers
EP4016299A1 (en) * 2020-12-21 2022-06-22 Amadeus S.A.S. A method and a system for managing the computing resources in data regions
US11595469B2 (en) 2021-05-25 2023-02-28 Red Hat, Inc. Balancing data partitions among dynamic services in a cloud environment
US12072939B1 (en) 2021-07-30 2024-08-27 Splunk Inc. Federated data enrichment objects
KR20230070718A (ko) * 2021-11-15 2023-05-23 에스케이하이닉스 주식회사 테넌트를 식별하는 키-값 기반의 데이터 저장 장치 및 그 동작 방법
US12093272B1 (en) 2022-04-29 2024-09-17 Splunk Inc. Retrieving data identifiers from queue for search of external data system
US12271389B1 (en) 2022-06-10 2025-04-08 Splunk Inc. Reading query results from an external data system
US12287790B2 (en) 2023-01-31 2025-04-29 Splunk Inc. Runtime systems query coordinator
US12265525B2 (en) 2023-07-17 2025-04-01 Splunk Inc. Modifying a query for processing by multiple data processing systems

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030126200A1 (en) * 1996-08-02 2003-07-03 Wolff James J. Dynamic load balancing of a network of client and server computer
CN1523498A (zh) * 2003-02-20 2004-08-25 国际商业机器公司 计算系统中分区之间的动态处理器再分配
US20060080273A1 (en) * 2004-10-12 2006-04-13 International Business Machines Corporation Middleware for externally applied partitioning of applications
CN101009648A (zh) * 2006-12-27 2007-08-01 北京航空航天大学 多服务器的分层迭代负载平衡方法

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6801949B1 (en) 1999-04-12 2004-10-05 Rainfinity, Inc. Distributed server cluster with graphical user interface
US6415323B1 (en) 1999-09-03 2002-07-02 Fastforward Networks Proximity-based redirection system for robust and scalable service-node location in an internetwork
US6922685B2 (en) 2000-05-22 2005-07-26 Mci, Inc. Method and system for managing partitioned data resources
US7293255B2 (en) 2000-09-25 2007-11-06 Sun Microsystems, Inc. Apparatus and method for automated creation of resource types
US20020178262A1 (en) * 2001-05-22 2002-11-28 David Bonnell System and method for dynamic load balancing
US7356592B2 (en) 2002-01-24 2008-04-08 International Business Machines Corporation Method and apparatus for web farm traffic control
US6813637B2 (en) 2002-03-15 2004-11-02 Sun Microsystems, Inc. System and method for automatically partitioning an application between a web server and an application server
US7167678B2 (en) 2002-12-18 2007-01-23 Microsoft Corporation Persistent peer-to-peer networking over a piconet network
WO2005036367A2 (en) * 2003-10-08 2005-04-21 Unisys Corporation Virtual data center that allocates and manages system resources across multiple nodes
US7761514B2 (en) 2003-11-26 2010-07-20 International Business Machines Corporation Method and apparatus for providing dynamic group management for distributed interactive applications
JP2005182702A (ja) * 2003-12-24 2005-07-07 Fujitsu Ltd Ｉｐネットワークにおけるアクセス制御方式
US20060168107A1 (en) 2004-03-16 2006-07-27 Balan Rajesh K Generalized on-demand service architecture for interactive applications
US7979862B2 (en) 2004-12-21 2011-07-12 Hewlett-Packard Development Company, L.P. System and method for replacing an inoperable master workload management process
US20070143442A1 (en) * 2005-12-20 2007-06-21 Nec Laboratories America, Inc. Scalable Publish/Subscribe Broker Network Using Active Load Balancing
US7716180B2 (en) * 2005-12-29 2010-05-11 Amazon Technologies, Inc. Distributed storage system with web services client interface
US7958216B2 (en) 2006-03-31 2011-06-07 Sap Ag Method for implementing an unplanned shutdown of a computer system
US8180747B2 (en) 2007-11-12 2012-05-15 F5 Networks, Inc. Load sharing cluster file systems
US8392482B1 (en) 2008-03-31 2013-03-05 Amazon Technologies, Inc. Versioning of database partition maps
US9021071B2 (en) 2008-06-09 2015-04-28 International Business Machines Corporation Methods of federating applications providing modular data
EP2350805A1 (en) 2008-10-10 2011-08-03 Hitachi, Ltd. Storage system and method for controlling the same
US9996572B2 (en) * 2008-10-24 2018-06-12 Microsoft Technology Licensing, Llc Partition management in a partitioned, scalable, and available structured storage
US8122289B2 (en) * 2009-04-09 2012-02-21 Telefonaktiebolaget L M Ericsson (Publ) Load balancing and high availability of compute resources
US8966017B2 (en) 2009-07-09 2015-02-24 Novell, Inc. Techniques for cloud control and management
US20110078303A1 (en) * 2009-09-30 2011-03-31 Alcatel-Lucent Usa Inc. Dynamic load balancing and scaling of allocated cloud resources in an enterprise network
US8910176B2 (en) 2010-01-15 2014-12-09 International Business Machines Corporation System for distributed task dispatch in multi-application environment based on consensus for load balancing using task partitioning and dynamic grouping of server instance
US8364775B2 (en) 2010-08-12 2013-01-29 International Business Machines Corporation High availability management system for stateless components in a distributed master-slave component topology
US8665890B2 (en) * 2011-05-20 2014-03-04 The Regents Of The University Of California Hybrid cross-layer routing protocol for MANETs

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030126200A1 (en) * 1996-08-02 2003-07-03 Wolff James J. Dynamic load balancing of a network of client and server computer
CN1523498A (zh) * 2003-02-20 2004-08-25 国际商业机器公司 计算系统中分区之间的动态处理器再分配
US20060080273A1 (en) * 2004-10-12 2006-04-13 International Business Machines Corporation Middleware for externally applied partitioning of applications
CN101009648A (zh) * 2006-12-27 2007-08-01 北京航空航天大学 多服务器的分层迭代负载平衡方法

Also Published As

Publication number Publication date
KR102013004B1 (ko) 2019-08-21
KR20140119090A (ko) 2014-10-08
CN104081353A (zh) 2014-10-01
JP2015506523A (ja) 2015-03-02
WO2013116664A1 (en) 2013-08-08
US20130204991A1 (en) 2013-08-08
JP6185486B2 (ja) 2017-08-23
EP2810163A4 (en) 2016-08-10
US8868711B2 (en) 2014-10-21
EP2810163A1 (en) 2014-12-10

Similar Documents

Publication Publication Date Title
CN104081353B (zh) 可缩放环境中的动态负载平衡
US11886925B2 (en) Managing partitions in a scalable environment
US10635500B2 (en) Decoupling partitioning for scalability
US9460185B2 (en) Storage device selection for database partition replicas
AU2014311869B2 (en) Partition tolerance in cluster membership management
US10769036B2 (en) Distributed transaction log
US20220382601A1 (en) Configuration map based sharding for containers in a machine learning serving infrastructure
US20110314465A1 (en) Method and system for workload distributing and processing across a network of replicated virtual machines
WO2019164942A1 (en) Autonomous cell-based control plane for scalable virtualized computing
CN114546644A (zh) 集群资源调度方法、装置、软件程序、电子设备及存储介质
US12547445B2 (en) Auto time optimization for migration of applications
AU2024204134A1 (en) Cloud database storage system
Elgedawy DCaaS: Data consistency as a service for managing data uncertainty on the clouds
CN118981498A (zh) 分布式数据库的实时数据处理方法、装置及存储介质

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: MICROSOFT TECHNOLOGY LICENSING LLC

Free format text: FORMER OWNER: MICROSOFT CORP.

Effective date: 20150728

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20150728

Address after: Washington State

Applicant after: Micro soft technique license Co., Ltd

Address before: Washington State

Applicant before: Microsoft Corp.

GR01 Patent grant
GR01 Patent grant