WO2023154242A1 - Systems and methods for network load balancing using machine learning - Google Patents
Systems and methods for network load balancing using machine learning Download PDFInfo
- Publication number
- WO2023154242A1 WO2023154242A1 PCT/US2023/012385 US2023012385W WO2023154242A1 WO 2023154242 A1 WO2023154242 A1 WO 2023154242A1 US 2023012385 W US2023012385 W US 2023012385W WO 2023154242 A1 WO2023154242 A1 WO 2023154242A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- requests
- load balancing
- machine learning
- servers
- assigned
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Computer And Data Communications (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Technology related to network load balancing using machine learning is disclosed. Potential imbalances in some load balancing scenarios can be addressed by using a machine learning model to generate resource utilization predictions for requests and performing load balancing operations based on the resource utilization predictions. For example, requests can be stored in a plurality of queues based on the resource utilization predictions. The queues of requests can then be processed by a load balancer. For example, the requests in the plurality of queues can be assigned to a plurality' of servers independently of one another, wherein requests from one queue are assigned to a plurality of servers without regard for the way that requests from another queue are assigned to the plurality of servers, and vice versa. Thus, in at least some scenarios, imbalances in the processing loads of the plurality of the servers can be avoided.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202217669910A | 2022-02-11 | 2022-02-11 | |
US17/669,910 | 2022-02-11 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023154242A1 true WO2023154242A1 (en) | 2023-08-17 |
Family
ID=87564918
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2023/012385 WO2023154242A1 (en) | 2022-02-11 | 2023-02-06 | Systems and methods for network load balancing using machine learning |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2023154242A1 (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050183084A1 (en) * | 2004-02-13 | 2005-08-18 | International Business Machines Corporation | Autonomic workload classification using predictive assertion for wait queue and thread pool selection |
US9465548B1 (en) * | 2015-07-22 | 2016-10-11 | Netapp, Inc. | Methods and systems using model based techniques for determining performance capacity of a resource of a networked storage environment |
US9674064B1 (en) * | 2016-12-26 | 2017-06-06 | Republic Wireless, Inc. | Techniques for server transaction processing |
US20200226144A1 (en) * | 2019-01-10 | 2020-07-16 | Citrix Systems, Inc. | Resource scaling for distributed database services |
US20200311573A1 (en) * | 2019-04-01 | 2020-10-01 | Accenture Global Solutions Limited | Utilizing a machine learning model to predict a quantity of cloud resources to allocate to a customer |
US10810528B1 (en) * | 2019-07-19 | 2020-10-20 | Capital One Services, Llc | Identifying and utilizing the availability of enterprise resources |
US20210174281A1 (en) * | 2019-12-09 | 2021-06-10 | Microsoft Technology Licensing, Llc | Providing alternate resource deployment guidance for use with cloud services |
-
2023
- 2023-02-06 WO PCT/US2023/012385 patent/WO2023154242A1/en unknown
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050183084A1 (en) * | 2004-02-13 | 2005-08-18 | International Business Machines Corporation | Autonomic workload classification using predictive assertion for wait queue and thread pool selection |
US9465548B1 (en) * | 2015-07-22 | 2016-10-11 | Netapp, Inc. | Methods and systems using model based techniques for determining performance capacity of a resource of a networked storage environment |
US9674064B1 (en) * | 2016-12-26 | 2017-06-06 | Republic Wireless, Inc. | Techniques for server transaction processing |
US20200226144A1 (en) * | 2019-01-10 | 2020-07-16 | Citrix Systems, Inc. | Resource scaling for distributed database services |
US20200311573A1 (en) * | 2019-04-01 | 2020-10-01 | Accenture Global Solutions Limited | Utilizing a machine learning model to predict a quantity of cloud resources to allocate to a customer |
US10810528B1 (en) * | 2019-07-19 | 2020-10-20 | Capital One Services, Llc | Identifying and utilizing the availability of enterprise resources |
US20210174281A1 (en) * | 2019-12-09 | 2021-06-10 | Microsoft Technology Licensing, Llc | Providing alternate resource deployment guidance for use with cloud services |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Raghava et al. | Comparative study on load balancing techniques in cloud computing | |
Shah et al. | Static load balancing algorithms in cloud computing: challenges & solutions | |
JP2019533913A (en) | Load balancing optimization method and apparatus based on cloud monitoring | |
CN107734004A (en) | A kind of high concurrent SiteServer LBS based on Nginx, Redis | |
CN109104500A (en) | A kind of server load balancing method and device of dynamic adjustment | |
CN105391797A (en) | SDN-based cloud server load balancing method and device | |
CN102299959A (en) | Load balance realizing method of database cluster system and device | |
US8645545B2 (en) | Balancing the loads of servers in a server farm based on an angle between two vectors | |
CN103944997B (en) | In conjunction with the load-balancing method of random sampling and Intel Virtualization Technology | |
CN107872539B (en) | Data processing system and method based on cloud computing platform | |
CN102567080A (en) | Virtual machine position selection system facing load balance in cloud computation environment | |
Domanal et al. | Load balancing in cloud environment using a novel hybrid scheduling algorithm | |
Dhurandher et al. | A cluster-based load balancing algorithm in cloud computing | |
Li et al. | An SLA-aware load balancing scheme for cloud datacenters | |
Ma et al. | Dynamic task scheduling in cloud computing based on greedy strategy | |
CN105959411A (en) | Dynamic load balance distributed processing method in cloud computing environment based on coordination | |
CN110011930A (en) | The load-balancing method and device of multi-joint alliance's chain in a kind of block chain | |
CN111131486A (en) | Load adjustment method and device of execution node, server and storage medium | |
Jaykrushna et al. | Linear regression assisted prediction based load balancer for cloud computing | |
Komarasamy et al. | A novel approach for Dynamic Load Balancing with effective Bin Packing and VM Reconfiguration in cloud | |
Rashmi et al. | Enhanced load balancing approach to avoid deadlocks in cloud | |
Khodar et al. | New scheduling approach for virtual machine resources in cloud computing based on genetic algorithm | |
CN106059940A (en) | Flow control method and device | |
Jain et al. | An algorithm for dynamic load balancing in distributed systems with multiple supporting nodes by exploiting the interrupt service | |
WO2023154242A1 (en) | Systems and methods for network load balancing using machine learning |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23753349 Country of ref document: EP Kind code of ref document: A1 |