CN107920104A - A kind of method and system of cluster server caching load balancing - Google Patents

A kind of method and system of cluster server caching load balancing Download PDF

Info

Publication number
CN107920104A
CN107920104A CN201610887767.XA CN201610887767A CN107920104A CN 107920104 A CN107920104 A CN 107920104A CN 201610887767 A CN201610887767 A CN 201610887767A CN 107920104 A CN107920104 A CN 107920104A
Authority
CN
China
Prior art keywords
server
application server
cluster
data cached
caching
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610887767.XA
Other languages
Chinese (zh)
Inventor
吴鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TVM Beijing Technology Co Ltd
Original Assignee
TVM Beijing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TVM Beijing Technology Co Ltd filed Critical TVM Beijing Technology Co Ltd
Priority to CN201610887767.XA priority Critical patent/CN107920104A/en
Publication of CN107920104A publication Critical patent/CN107920104A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers

Abstract

The invention discloses a kind of method and system of cluster server caching load balancing, this method includes:Management server calculates the loading condition of application server caching;Data cached read/write task is distributed to the application server of free time;Application server collects data cached.Technical solution of the present invention enhances the caching process ability of server cluster, the O&M stability of server cluster is improved, the cost of server apparatus has been saved, ensure that the quality of service of server, the risk of server cluster operation is avoided, improves the efficiency of server cluster management.

Description

A kind of method and system of cluster server caching load balancing
Technical field
The present invention relates to technical field of the computer network, more particularly to a kind of method of cluster server caching load balancing And system.
Background technology
Server disposition, refers to dynamically set server cluster according to the actual demand of enterprise or user, right The equipment of server carries out software or the corresponding of hardware sets, operates, the capacity and processing energy of dynamic regulation server cluster Power, so as to meet the needs of enterprise or user, realizes the purpose of business activity.
With the continuous development become increasingly popular with network application of network broadband, customer service demand and to server process The demand of ability is in Fast growth phase, constantly challenges to server technology development.In order to solve business demand kimonos Imbalance between device disposal ability of being engaged in, server technology is from the one-to-many framework of one-node network server, to cluster Change, the migration of the multi-to-multi framework of multiserver, extend the disposal ability and bandwidth of server, it is cheap, efficient, reliable to realize Network service capabilities.Application server cluster can obtain very high calculating speed from the parallel computation of multiple computers, It can also be backuped with multiple computers, so that whole system still can be transported normally after any one machine disruptions service OK, the efficiency and stability of server handling ability be ensure that.
Server cluster is organically to connect the server of one group of independence by certain mechanism (network connection), group Into the multi-server system of a loose coupling, be deployed in application program in these servers can by network share memory, Messaging is carried out, interprocess communication is realized, so as to fulfill Distributed Calculation.Externally, server cluster is only one A system, externally provides unified service.
Server cluster pattern mainly has redundant mode and load-sharing mode.Redundant mode is also known as active/standby pattern, is one The asymmetric cluster topology of kind, has some servers dedicated for taking over their work when workspace server breaks down.It is negative It is a kind of symmetrical cluster topology to carry balanced mode, and each server has been borne by work, and all mutual equality of every server, does not have Dedicated for spare server.If server breaks down, remaining server, which may proceed to handle its own, to be divided The application load matched somebody with somebody, while the application load on the server to break down is handled, specifically connect by any platform or which platform server Pipe, will see that cluster service is configured with.
Server cluster load-balancing technique more commonly used at present mainly has:
1), the load balancing based on DNS.Load balancing is realized by the random name resolution in DNS service, in DNS Can be multiple and different same names of address configuration in server, and the client computer for finally inquiring about this name will solve One of address is obtained when analysing this name.Therefore, different ground can be obtained for same name, different client computer Location, they also just access the Web server in different address, so as to achieve the purpose that load balancing.
2), reverse proxy load balancing (such as Apache+JK+Tomcat combinations).It will can be asked using proxy server The Web server of inside is transmitted to, allows proxy server to ask equably to be transmitted to more internal web clothes according to certain algorithm It is engaged on one of device, so as to achieve the purpose that load balancing.This agent way and common agent way are different, standard generation Reason mode is that client uses the multiple external web servers of proxy access, and this agent way is multiple clients' use agency's visits Ask multiple internal Web services devices, therefore also referred to as reverse proxy pattern.
3) load-balancing technique (such as Linux Virtual, based on NAT (Network Address Translation) Server, abbreviation LVS).NAT (network address translation) refers to inwardly to be changed between location and external address, to possess The computer capacity of home address accesses external network, and works as certain that the computer access address transfer gateway in external network possesses During one external address, address conversion gateway can be transferred it in the home address of a mapping.So if address conversion net Close can by it is each connection uniformly be converted to different internal server addresses, hereafter the computer in external network just each with from Server communicates on the address that oneself is converted to, so as to achieve the purpose that load balancing.
But for the memory management of cluster server, there has been no ripe administrative skill.Streaming media on demand, P2P should Network traffics and server processing business can be caused with the popular the Internet, applications such as, large-scale 3D online games, shopping at network Short high peak and imbalance, need substantial amounts of memory of quoting quickly to handle data, can form industry particularly across the business of platform The wave crest and trough of business, the disposal ability of server cluster are greatly tested, and equipment has delay machine or the wind of loss of data Danger, causes bad experience to user, also result in the loss of economic interests.
The content of the invention
The present invention provides a kind of method of cluster server caching load balancing, is formed between server cluster caching negative Equilibrium is carried, strengthens the caching process ability of server cluster, improves the O&M stability of server cluster, saved server and set Standby cost, ensure that the quality of service of server, avoids the risk of server cluster operation, improves server cluster pipe The efficiency of reason.
Technical scheme provides a kind of method of cluster server caching load balancing, comprises the following steps:
Management server calculates the loading condition of application server caching;
Data cached read/write task is distributed to the application server of free time;
Application server collects data cached.
Further, the application server is at least one.
Further, every the caching load data of 10ms management servers renewal application server.
Further, data read/write task is distributed to the application server of free time every 5ms management servers.
Further, uniformly collected to data cached every 100ms application servers.
Further, in the case that application server delays machine, Buffer Utilization 0, then do not distribute data cached read/write and appoint Business.
Technical scheme additionally provides a kind of system of cluster server caching load balancing, including:Management clothes Business device and application server, wherein,
Management server is used to calculate the caching loading condition of application server, the data cached read/write task of distribution and pipe Reason the data cached of cluster application server uniformly collects;
Application server is used to perform data cached read/write task.
Further, every the load data of 10ms management servers renewal application server caching.
Further, data read/write task is distributed to the application server of free time every 5ms management servers.
Further, uniformly collected to data cached every 100ms application servers.
Technical solution of the present invention forms load balancing between server cluster caching, strengthens at the caching of server cluster Reason ability, improves the O&M stability of server cluster, has saved the cost of server apparatus, ensure that the business matter of server Amount, avoids the risk of server cluster operation, improves the efficiency of server cluster management.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by the explanations write Specifically noted structure is realized and obtained in book, claims and attached drawing.
Below by drawings and examples, technical scheme is described in further detail.
Brief description of the drawings
Attached drawing is used for providing a further understanding of the present invention, and a part for constitution instruction, the reality with the present invention Apply example to be used to explain the present invention together, be not construed as limiting the invention.In the accompanying drawings:
Fig. 1 is the method flow diagram that cluster server caches load balancing in the embodiment of the present invention one;
Fig. 2 is the system construction drawing that cluster server caches load balancing in the embodiment of the present invention one.
Embodiment
The preferred embodiment of the present invention is illustrated below in conjunction with attached drawing, it will be appreciated that described herein preferred real Apply example to be merely to illustrate and explain the present invention, be not intended to limit the present invention.
Fig. 1 caches the method flow diagram of load balancing, the flow of this method for cluster server in the embodiment of the present invention one Comprise the following steps:
Step 101, management server calculate the loading condition of application server caching.
Application server is at least one, more application servers and management server composition cluster server.
Every the caching load data of 10ms management servers renewal application server, the caching for obtaining application server is born Load situation.
Step 102, distribute to data cached read/write task idle application server.
According to the caching loading condition of application server, data read/write task is distributed into sky every 5ms management servers Not busy application server.
Application server is delayed in the case of machine, and Buffer Utilization 0, then do not distribute data cached read/write task.
Step 103, application server collect data cached.
Uniformly collected to data cached every 100ms application servers.
In order to realize the flow of above-mentioned cluster server caching load balancing, the present embodiment additionally provides a kind of cluster service The system that device caches load balancing, Fig. 2 are the system construction drawing that cluster server caches load balancing in the embodiment of the present invention one. As shown in Fig. 2, the system includes:Management server 201 and application server 202, wherein,
Management server is used to calculate the caching loading condition of application server, the data cached read/write task of distribution and pipe Reason the data cached of cluster application server uniformly collects;
Application server is used to perform data cached read/write task.
Every the load data of 10ms management servers renewal application server caching.
Data read/write task is distributed to the application server of free time every 5ms management servers.
Uniformly collected to data cached every 100ms application servers.
Technical solution in above-described embodiment forms load balancing between server cluster caching, strengthens server cluster Caching process ability, improve the O&M stability of server cluster, saved the cost of server apparatus, ensure that server Quality of service, avoid the risk of server cluster operation, improve the efficiency of server cluster management.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, system or computer program Product.Therefore, the present invention can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware Apply the form of example.Moreover, the present invention can use the computer for wherein including computer usable program code in one or more The shape for the computer program product that usable storage medium is implemented on (including but not limited to magnetic disk storage and optical memory etc.) Formula.
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product Figure and/or block diagram describe.It should be understood that it can be realized by computer program instructions every first-class in flowchart and/or the block diagram The combination of flow and/or square frame in journey and/or square frame and flowchart and/or the block diagram.These computer programs can be provided The processors of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce A raw machine so that the instruction performed by computer or the processor of other programmable data processing devices, which produces, to be used in fact The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, thus in computer or The instruction performed on other programmable devices is provided and is used for realization in one flow of flow chart or multiple flows and/or block diagram one The step of function of being specified in a square frame or multiple square frames.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art God and scope.In this way, if these modifications and changes of the present invention belongs to the scope of the claims in the present invention and its equivalent technologies Within, then the present invention is also intended to comprising including these modification and variations.

Claims (10)

  1. A kind of 1. method of cluster server caching load balancing, it is characterised in that comprise the following steps:
    Management server calculates the loading condition of application server caching;
    Data cached read/write task is distributed to the application server of free time;
    Application server collects data cached.
  2. 2. according to the method described in claim 1, it is characterized in that, the application server is at least one.
  3. 3. according to the method described in claim 1, it is characterized in that, every the slow of 10ms management servers renewal application server Deposit load data.
  4. 4. according to the method described in claim 1, it is characterized in that, data read/write task is distributed every 5ms management servers To idle application server.
  5. 5. according to the method described in claim 1, it is characterized in that, unite every 100ms application servers to data cached One collects.
  6. 6. according to the method described in claim 1, it is characterized in that, application server is delayed in the case of machine, Buffer Utilization is 0, then data cached read/write task is not distributed.
  7. A kind of 7. system of cluster server caching load balancing, it is characterised in that including:Management server and application service Device, wherein,
    Management server is used to calculate the caching loading condition of application server, the data cached read/write task of distribution and management collection Group the data cached of application server uniformly collects;
    Application server is used to perform data cached read/write task.
  8. 8. system according to claim 7, it is characterised in that every 10ms management servers renewal application server caching Load data.
  9. 9. system according to claim 7, it is characterised in that distribute data read/write task every 5ms management servers To idle application server.
  10. 10. system according to claim 7, it is characterised in that unite every 100ms application servers to data cached One collects.
CN201610887767.XA 2016-10-11 2016-10-11 A kind of method and system of cluster server caching load balancing Pending CN107920104A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610887767.XA CN107920104A (en) 2016-10-11 2016-10-11 A kind of method and system of cluster server caching load balancing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610887767.XA CN107920104A (en) 2016-10-11 2016-10-11 A kind of method and system of cluster server caching load balancing

Publications (1)

Publication Number Publication Date
CN107920104A true CN107920104A (en) 2018-04-17

Family

ID=61891950

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610887767.XA Pending CN107920104A (en) 2016-10-11 2016-10-11 A kind of method and system of cluster server caching load balancing

Country Status (1)

Country Link
CN (1) CN107920104A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109271243A (en) * 2018-08-31 2019-01-25 郑州云海信息技术有限公司 A kind of cluster task management system
CN110062032A (en) * 2019-04-01 2019-07-26 北京航天发射技术研究所 A kind of computer network clustered control platform application reconfiguration system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109271243A (en) * 2018-08-31 2019-01-25 郑州云海信息技术有限公司 A kind of cluster task management system
CN109271243B (en) * 2018-08-31 2021-09-17 郑州云海信息技术有限公司 Cluster task management system
CN110062032A (en) * 2019-04-01 2019-07-26 北京航天发射技术研究所 A kind of computer network clustered control platform application reconfiguration system

Similar Documents

Publication Publication Date Title
US10411956B2 (en) Enabling planned upgrade/downgrade of network devices without impacting network sessions
US9900252B2 (en) Application delivery controller and global server load balancer
Zhang et al. Proactive workload management in hybrid cloud computing
US10523748B2 (en) Managing health status of network devices in a distributed global server load balancing system
US10715479B2 (en) Connection redistribution in load-balanced systems
CN107078969A (en) Realize computer equipment, the system and method for load balancing
CN102164116B (en) Method, system and corresponding device for balancing load
CN104486402B (en) A kind of method based on large-scale website combined equalization
CN107733991A (en) One kind provides load balancing service implementation method based on OpenStack frameworks
CN106161552A (en) Load-balancing method and system under a kind of mass data environment
TW201424305A (en) CDN load balancing in the cloud
CN105308929A (en) Distributed load balancer
CN110430274A (en) A kind of document down loading method and system based on cloud storage
CN107483390A (en) A kind of cloud rendering web deployment subsystem, system and cloud rendering platform
CN110266822B (en) Shared load balancing implementation method based on nginx
CN104536988B (en) MonetDB Distributed Calculation storage methods
CN108259603A (en) A kind of load-balancing method and device
CN104320488A (en) Proxy server system and proxy service method
WO2021120633A1 (en) Load balancing method and related device
CN109617966A (en) A kind of cloud pipe Platform deployment system and method based on Openstack
JP2012118709A (en) Distribution system, storage capacity decision program, and storage capacity decision method
CN103401799A (en) Method and device for realizing load balance
CN101771703A (en) Information service system and method
CN104158732B (en) A kind of intelligent cloud service dynamic routing strategy
CN107920104A (en) A kind of method and system of cluster server caching load balancing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180417