CN106936623A - The management method of distributed cache system and cache cluster - Google Patents
The management method of distributed cache system and cache cluster Download PDFInfo
- Publication number
- CN106936623A CN106936623A CN201511034982.7A CN201511034982A CN106936623A CN 106936623 A CN106936623 A CN 106936623A CN 201511034982 A CN201511034982 A CN 201511034982A CN 106936623 A CN106936623 A CN 106936623A
- Authority
- CN
- China
- Prior art keywords
- cache
- cluster
- configuration information
- client
- caching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
Abstract
The present invention provides the management method of a kind of distributed cache system and cache cluster.The system includes：Multiple servers and caching web-based management device, caching web-based management device are used for：Distribution cache cluster is cache node allocation identification in cache cluster and is stored, and is sent to server when cache cluster is distributed and start order.Server is used for：The startup order that order caching web-based management device sends, according to the caching process started on order startup server, the mark of all cache nodes on server is obtained from caching web-based management device, detect the existing state of all cache nodes, if detecting a cache node not survive, the caching process on server is restarted immediately.Distributed cache system and the management method of cache cluster that the present invention is provided, the distribution for being capable of achieving cache cluster are more convenient, and the startup for caching process need not be operated manually, when a certain caching process breaks down, can voluntarily recover, it is not required that artificial operation, more facilitate.
Description
Technical field
The present invention relates to communication technical field, more particularly to a kind of distributed cache system and cache cluster
Management method.
Background technology
With the rising of each company's web site visit capacity, the performance of web site is used as influence Consumer's Experience
Key factor, run into increasing challenge, simple dilatation machine can not meet demand.It is slow
Deposit as the important technology for improving data access performance, the application in web site is more and more extensive.So
And, with the popularization that each company's caching technology is used, the automation distribution of cache cluster, Reliability Assurance,
Efficiently management becomes more and more important.
Memcached is a kind of distributed memory target cache system, for dynamic web page application subtracting
Light database loads, it reduces the secondary of reading database by data cached in internal memory and object
Number, so as to improve the access speed of website.In existing Memcached caching systems, including
Memcached client and servers, have multiple cache nodes on a server, each caching section
Point is independent Memcached cachings process, and multiple cache nodes constitute cache clusters, when there is caching
During business application, the caching process on server, Memcached client are manually booted by keeper
Configured and the cache node in memory buffers cluster and cache cluster in configuration file in advance in end
List, when Memcached clients receive cache access asks, by Memcached client
Be distributed on one of cache node for cache access request according to uniformity hash algorithm by end.
There is following defect in existing caching system：Caching process on server is needed by keeper
Manually boot, when a certain caching process breaks down, it is also desirable to restart recovery manually by keeper, very
Inconvenience, in the case that server in cache cluster is relatively more, this shortcoming is more prominent.
The content of the invention
The present invention provides the management method of a kind of distributed cache system and cache cluster, existing to solve
Process is cached in caching system to be needed to manually start and needs what is manually restarted to ask when caching process breaks down
Topic.
In a first aspect, the present invention provides a kind of distributed cache system, including：Multiple servers and caching
Web-based management device；Wherein,
The caching web-based management device is used for：Distribution cache cluster, is the cache node point in cache cluster
With identifying and store, and sent to the server when cache cluster is distributed and start order；
The server is used for：The startup order that the caching web-based management device sends is received, according to
It is described to start the caching process that order starts on the server, obtain institute from the caching web-based management device
The mark of all cache nodes on server is stated, the existing state of all cache nodes is detected, if detection
Do not survived to a cache node, the caching process on the server is restarted immediately.
Further, also include：Configuration center and client, the configuration center are used for：
Cache node in the caching web-based management device distribution cache cluster or renewal cache cluster
Afterwards, by the storage of the configuration information of the cache cluster in the configuration internal memory of the heart, the configuration information bag
Include：Configuration generation or timestamp, cluster identity ID, the corresponding cache clusters of the cluster ID of change
Cache node list and configuration information described in the client request cycle；
The order of the request configuration information that the client periodically sends is received, the internal memory is read,
The configuration information is returned to the client；
The client is used for：The order of the request configuration information is periodically sent to the configuration center,
Receive the configuration information that the configuration center is returned.
Further, the caching web-based management device is additionally operable to：
Before the cache node in updating cache cluster, configuration information described in the client request is changed
Cycle.
Further, the client specifically for：
When sending the order of the request configuration information to the configuration center first, if request failure,
Cache node list is read from the local profile of the client, then is initiated and the caching section for reading
The connection of the cache node in point list；
The order of the request configuration information is sent to the configuration center then according to predetermined period, is received
After the configuration information returned to the configuration center, if detecting the configuration life in the configuration information
Into or change timestamp change, then update the cache node in the client uniformity Hash ring
List, and in the local profile of the configuration information update to the client, will initiate and update
The connection of the cache node in cache node list afterwards.
Further, the caching web-based management device is additionally operable to：
A server is detected to delay after machine, by all cache nodes on the server of the machine of delaying migrate to
Other idle servers.
Further, the caching web-based management device is additionally operable to：
The state of each cache node in detection cache cluster, it is determined that during cache node abnormal state, hair
Play alarm.
Second aspect, the present invention provides a kind of management method of cache cluster, including：
Caching web-based management device distribution cache cluster is cache node allocation identification in cache cluster and is deposited
Storage, and send startup order to server when cache cluster is distributed；
After the server receives the startup order that the caching web-based management device sends, according to institute
State the caching process that order starts on the server that starts；
The server obtains all cache nodes on the server from the caching web-based management device
Mark, detects the existing state of all cache nodes, if detect a cache node not surviving, immediately
Restart the caching process on the server.
Further, also include：
The caching web-based management device updates the cache node in cache cluster；
Configuration center is slow in the caching web-based management device distribution cache cluster or renewal cache cluster
After depositing node, by the storage of the configuration information of the cache cluster in the configuration internal memory of the heart, the configuration
Information includes：The timestamp of configuration generation or change, cluster identity ID, the cluster ID are corresponding slow
Deposit the cache node list of cluster and the cycle of configuration information described in client request；
The client periodically sends the order of the request configuration information to the configuration center；
After the configuration center receives the order of the request configuration information, the internal memory is read,
The configuration information is returned to the client；
The client receives the configuration information that the configuration center is returned.
Further, the caching web-based management device was gone back before the cache node in updating cache cluster
Including：
The caching web-based management device changes the cycle of configuration information described in the client request.
Further, the client periodically sends the request configuration information to the configuration center
Order, including：
When the client sends the order of the request configuration information to the configuration center first, if please
Failure is asked, then cache node list is read from the local profile of the client, then initiate and read
The connection of the cache node in the cache node list for taking；
Then the client sends the request configuration information according to predetermined period to the configuration center
Order；
The client is received after the configuration information that the configuration center is returned, and is also included：
Detect whether the configuration generation in the configuration information or the timestamp of change change, if so,
Then update the cache node list in the client uniformity Hash ring, and by the configuration information update
To in the local profile of the client, initiate and the caching section in the cache node list after renewal
The connection of point.
Further, also include：
The caching web-based management device detects a server and delays after machine, by the server of the machine of delaying
All cache nodes are migrated to other idle servers.
Further, also include：
The state of each cache node in the caching web-based management device detection cache cluster, it is determined that caching
When node state is abnormal, alarm is initiated.
Distributed cache system and the management method of cache cluster that the present invention is provided, are managed by caching web
Reason device distribution cache cluster is cache node allocation identification in cache cluster and is stored, and slow in distribution
Sent to server when depositing cluster and start order, server starts server after startup order is received
On caching process, so be capable of achieving cache cluster distribution it is more convenient, cache process startup be not required to
Manually to operate.And all caching sections on the server are obtained from caching web-based management device by server
The mark of point, detects the existing state of all cache nodes, is not survived if detecting a cache node,
The caching process on the server is restarted immediately, and then when can realize that a certain caching process breaks down, can
Voluntarily recover, it is not required that artificial operation, more facilitate.
Brief description of the drawings
In order to illustrate more clearly of technical scheme of the invention or of the prior art, below will to embodiment or
The accompanying drawing to be used needed for description of the prior art is briefly described, it should be apparent that, describe below
In accompanying drawing be some embodiments of the present invention, for those of ordinary skill in the art, do not paying
On the premise of creative labor, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is the structural representation of distributed cache system embodiment one of the present invention；
Fig. 2 is the structural representation of distributed cache system embodiment two of the present invention；
Fig. 3 is the flow chart of the management method embodiment one of cache cluster of the present invention；
Fig. 4 is the flow chart of the management method embodiment two of cache cluster of the present invention；
Fig. 5 be cache cluster of the present invention management method in dynamic capacity-expanding processing procedure schematic diagram.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with the present invention
Accompanying drawing, is clearly and completely described to the technical scheme in the present invention, it is clear that described implementation
Example is a part of embodiment of the invention, rather than whole embodiments.Based on the embodiment in the present invention,
The every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example, belongs to the scope of protection of the invention.
Fig. 1 is the structural representation of distributed cache system embodiment one of the present invention, as shown in figure 1, this
The system of embodiment can include：Multiple servers 11 and caching web-based management device 12, wherein, caching
Web-based management device 12 is used for：Distribution cache cluster is cache node allocation identification in cache cluster and is deposited
Storage, and send startup order to server 11 when cache cluster is distributed.Server 11 is used for：Receive
The startup order that caching web-based management device 12 sends, according to the caching started on order startup server 11
Process, the mark of all cache nodes on server 11, detection are obtained from caching web-based management device 12
The existing state of all cache nodes, if detect a cache node not surviving, restarting immediately takes
Caching process on business device 11.Specifically, client is also included in system, server 11 is started certainly
After the caching process of body, by client order caching access request, and asked to perform according to cache access
Corresponding buffer service, is such as distributed to one of them according to uniformity hash algorithm by cache access request
On cache node.
Further, caching web-based management device 12 is additionally operable to：Detect a server to delay after machine, will occur
The all cache nodes on the server of machine of delaying are migrated to other idle servers, can so be solved at certain
One server is delayed the problem brought after machine, realizes the disaster tolerance of cache cluster.
Further, caching web-based management device is additionally operable to：The shape of each cache node in detection cache cluster
State, it is determined that during cache node abnormal state, initiating alarm.Specifically, it is determined that cache node state is different
Often, including following three kinds of situations：
If the first, detecting the cache node refusal Connection Time exceedes Preset Time, it is determined that cache node shape
State exception；Or,
2nd, get orders periodically are sent to cache node, continuous time-out time is more than Preset Time, or
The continuous expired times of person are more than preset times, it is determined that cache node abnormal state；Or,
3rd, stats orders periodically are sent to cache node, counts cache node status information, if hit
Rate is less than predetermined threshold value, it is determined that cache node abnormal state.
Specifically, caching web-based management device 12 can enable an administrator to automation distribution, deployment and manage
Cache cluster, can also enable business personnel check cache cluster details, the condition monitoring of cache node and
Controlling alarm can be carried out to cache cluster, and then flexible monitoring alarm can be provided, so that keeper does
Go out corresponding treatment.
The distributed cache system that the present embodiment is provided, cache cluster is distributed by caching web-based management device,
For the cache node allocation identification in cache cluster and store, and sent out to server when cache cluster is distributed
Startup is sent to order, server starts the caching process on server, so after startup order is received
The distribution for being capable of achieving cache cluster is more convenient, and the startup for caching process need not be operated manually.And pass through
Server obtains the mark of all cache nodes on the server from caching web-based management device, and detection is all
The existing state of cache node, if detect a cache node not surviving, restarts the service immediately
Caching process on device, and then when can realize that a certain caching process breaks down, can voluntarily recover, it is not required that
Artificial operation, more facilitates.
Fig. 2 is the structural representation of distributed cache system embodiment two of the present invention, as shown in Fig. 2 this
The system of embodiment can also include on the basis of system shown in Figure 1：Configuration center 13 and client
14, configuration center 13 is used for：Cache cluster is distributed in caching web-based management device 12 or update cache set
After cache node in group, the configuration information of cache cluster is stored in the internal memory of configuration center 13, should
Internal memory is such as Redis, and configuration information includes：Configuration generation or change timestamp, cluster identity (Identity,
Referred to as：ID), the cache node list of the corresponding cache clusters of cluster ID and client request configuration information
Cycle, receive the order of the request configuration information that client 14 periodically sends, read internal memory, return
Configuration information is to client 14.
Client 14 is used for：The order of request configuration information is periodically sent to configuration center 13, is received
The configuration information that configuration center 13 is returned.Further, caching web-based management device 12 is additionally operable to：More
Before cache node in new cache cluster, the cycle of client request configuration information is changed.
Wherein, client 14 specifically for：When sending the order of request configuration information to configuration center first,
If request failure, reads cache node list, then initiate and read from the local profile of client
The connection of the cache node in the cache node list for taking.Sent to configuration center then according to predetermined period
The order of configuration information is asked, after receiving the configuration information of configuration center return, if detecting with confidence
The timestamp of configuration generation or change in breath changes, then in renewal client uniformity Hash ring
Cache node list, and in the local profile of configuration information update to client, will initiate and update
The connection of the cache node in cache node list afterwards.Wherein, the local profile of client is slow
Deposit the explanation of cluster relevant configuration, such as include the IP port numbers of data center, cluster ID, Key prefix,
Parameter, request max-timeout time, serializing mode of network connection etc. are set up with server to set.
In the present embodiment, by setting configuration center and client in distributed cache system, work as user
After cache node in being allocated to cache cluster or update cache cluster by caching web-based management device,
The cache node updated in cache cluster for example adds at least one cache node, all notifies configuration center,
The configuration information of the cache cluster after configuration center storage distribution, then by client periodically from configuration
The configuration information of the cache cluster that center requests are constantly updated, initiates with the cache cluster for updating with confidence
The connection of the cache node included in breath, is capable of achieving the dynamic capacity-expanding of cache cluster when business procedure runs,
Existing caching system is solved after application program launching operation, usable buffer service internal memory can not
With the problem of dynamic capacity-expanding.
Further, caching web-based management device also include caching application module, data center management module and
Physical machine management module, wherein, caching application module examines original oa communications, mail application, mail
Batch process standard, such as application for the treatment of caching, system manager is facilitated to check caching application and check examination ＆ approval,
Data center, the addition of physical machine management module or deletion of physically machine are added or deleted to data center management module,
Data center management module, physical machine management module facilitate caching system keeper to unite all cache resources
Raise planning.
It should be noted that during cache cluster dilatation, different clients pull new configuration information when
Between it is different, configuration may be inconsistent in the short time, in order to reduce the inconsistent risk brought of cached configuration,
Before dilatation, it is necessary first to adjust configuration and pull interval, tapered to most short, that is, be exactly to cache web
Manager changed the cycle of client request configuration information before the cache node in updating cache cluster.
In addition, in cluster dilatation, a node is only extended every time, after client stable operation for a period of time again
Extension next node.Because the point spread of quantity, may result in client uniformity Hash at double
All cache node redistributions on ring, cache hit rate is almost reduced to zero.
In the present embodiment, further, caching web-based management device 12 is additionally operable to：A server is detected to delay
After machine, all cache nodes on the server of the machine of delaying are migrated to other idle servers.So
Can solve the problems, such as to be brought after a certain server delays machine, realize the disaster tolerance of cache cluster.
Further, caching web-based management device is additionally operable to：The shape of each cache node in detection cache cluster
State, it is determined that during cache node abnormal state, initiating alarm.
Fig. 3 is the flow chart of the management method embodiment one of cache cluster of the present invention, as shown in figure 3, this
The method of embodiment can include：
S101, caching web-based management device distribution cache cluster, are the cache node distribution mark in cache cluster
Know and store, and startup order is sent to server when cache cluster is distributed.
Specifically, user submits caching application on caching web-based management device, and caching web-based management device determines
The parameters such as cluster ID, data center's title, caching specification.Caching system keeper selection is nearest with computer room
Data center, for example distribute cache cluster in units of 8 nodes, and be the distribution of each cache node
One mark.Caching system keeper submits assignment configuration to, and caching web-based management device can call zookeeper
Service, sends and starts order to server, by the caching process on startup of server server.
After S102, server receive the startup order that caching web-based management device sends, ordered according to starting
Start the caching process on server.
S103, server obtain the mark of all cache nodes on server from caching web-based management device,
The existing state of all cache nodes is detected, if detect a cache node not surviving, is opened again immediately
Caching process on dynamic server.
Wherein, after the startup of server caching process of itself, by client order caching access request,
And corresponding buffer service is performed according to cache access request, this is cached according to uniformity hash algorithm such as
Access request is distributed on one of cache node.
Further, can also include：Caching web-based management device detects a server and delays after machine, will send out
All cache nodes on the server of raw machine of delaying are migrated to other idle servers, can so be solved
A certain server is delayed the problem brought after machine, realizes the disaster tolerance of cache cluster.
Further, can also include：Each cache node in caching web-based management device detection cache cluster
State, it is determined that during cache node abnormal state, initiating alarm.Specifically, it is determined that cache node shape
State exception, including following three kinds of situations：
If the first, detecting the cache node refusal Connection Time exceedes Preset Time, it is determined that cache node shape
State exception；Or,
2nd, get orders periodically are sent to cache node, continuous time-out time is more than Preset Time, or
The continuous expired times of person are more than preset times, it is determined that cache node abnormal state；Or,
3rd, stats orders periodically are sent to cache node, counts cache node status information, if hit
Rate is less than predetermined threshold value, it is determined that cache node abnormal state.
Specifically, caching web-based management device can enable an administrator to automation distribution, deployment and manage slow
Cluster is deposited, business personnel is checked the condition monitoring and energy of cache cluster details, cache node
It is enough that controlling alarm is carried out to cache cluster, and then flexible monitoring alarm can be provided, so that keeper makes
Corresponding treatment.
The management method of the cache cluster that the present embodiment is provided, cache set is distributed by caching web-based management device
Group is cache node allocation identification in cache cluster and is stored, and when cache cluster is distributed to service
Device sends and starts order, and server starts the caching process on server after startup order is received,
The distribution for being so capable of achieving cache cluster is more convenient, and the startup for caching process need not be operated manually.And
The mark of all cache nodes on the server, detection are obtained from caching web-based management device by server
The existing state of all cache nodes, if detect a cache node not surviving, restarting immediately should
Caching process on server, and then when can realize that a certain caching process breaks down, can voluntarily recover, also not
Artificial operation is needed, is more facilitated.
Fig. 4 is the flow chart of the management method embodiment two of cache cluster of the present invention, as shown in figure 4, this
The method of embodiment can also include on the basis of embodiment illustrated in fig. 3：
S201, caching web-based management device change the cycle of client request configuration information.
S202, caching web-based management device update the cache node in cache cluster.
S203, configuration center are in caching web-based management device distribution cache cluster or renewal cache cluster
After cache node, the configuration information of cache cluster is stored in the internal memory of configuration center, configuration information bag
Include：The timestamp of configuration generation or change, cluster identity ID, the corresponding cache clusters of cluster ID it is slow
Deposit the cycle of node listing and client request configuration information.
S204, client periodically send the order of request configuration information to configuration center.
Specifically, when client sends the order of request configuration information to configuration center first, if request is lost
Lose, then cache node list is read from the local profile of client, then initiate and the caching for reading
The connection of the cache node in node listing.
Then client sends the order of request configuration information according to predetermined period to configuration center.
After S205, configuration center receive the order of request configuration information, internal memory is read, return and match somebody with somebody confidence
Cease to client.
S206, client receive the configuration information that configuration center is returned.
Further, after client receives the configuration information that configuration center is returned, also include：
Whether the timestamp of configuration generation or change in detection configuration information changes, if so, then more
Cache node list in new client uniformity Hash ring, and by the sheet of configuration information update to client
In ground configuration file, the connection with the cache node in the cache node list after renewal is initiated.
Further, can also include：Caching web-based management device detects a server and delays after machine, will send out
All cache nodes on the server of raw machine of delaying are migrated to other idle servers, can so be solved
A certain server is delayed the problem brought after machine, realizes the disaster tolerance of cache cluster.
Further, can also include：Each cache node in caching web-based management device detection cache cluster
State, it is determined that during cache node abnormal state, initiating alarm.
In the present embodiment, by setting configuration center and client in distributed cache system, work as user
After cache node in being allocated to cache cluster or update cache cluster by caching web-based management device,
The cache node updated in cache cluster for example adds at least one cache node, all notifies configuration center,
The configuration information of the cache cluster after configuration center storage distribution, then by client periodically from configuration
The configuration information of the cache cluster that center requests are constantly updated, initiates with the cache cluster for updating with confidence
The connection of the cache node included in breath, is capable of achieving the dynamic capacity-expanding of cache cluster when business procedure runs,
Existing caching system is solved after application program launching operation, usable buffer service internal memory can not
With the problem of dynamic capacity-expanding.
Fig. 5 be cache cluster of the present invention management method in dynamic capacity-expanding processing procedure schematic diagram, such as scheme
Shown in 5, the processing procedure of dynamic capacity-expanding includes：
S301, keeper change the drawing of the cache cluster configuration information for wanting dilatation by caching web-based management device
Interval is taken, that is, changes the cycle of client request configuration information, and updated in Redis.
S302, client periodically send the order of request configuration information to configuration center.
It is exactly that client periodically pulls new configuration information to configuration center.
S303, configuration center read new configuration from Redis, return to the new request of client with confidence
The cycle of breath.
S304, keeper carry out dilatation to cache cluster, and update configuration by caching web-based management device
Information is to Redis.
S305, caching web-based management device send to server and order simultaneously, start newly assigned cache node
Process.
S306, client send the order of request configuration information according to new cycle to configuration center,
Configuration center reads new configuration information from Redis, return to the new cache cluster of client with confidence
Breath, the cache node list on client update consistency hash rings.
S307, client initiate connection to the cache node of new addition.
As original cache node is Memcached#1-Memcached#8 mono- in cache cluster in Fig. 5
Totally 8 cache nodes, the cache node of new addition is Memcached#9-Memcached#16.
It should be noted that during cache cluster dilatation, different clients pull new configuration information when
Between it is different, configuration may be inconsistent in the short time, in order to reduce the inconsistent risk brought of cached configuration,
Before dilatation, it is necessary first to adjust configuration and pull interval, tapered to most short, that is, be exactly to cache web
Manager changed the cycle of client request configuration information before the cache node in updating cache cluster.
In addition, in cluster dilatation, a node is only extended every time, after client stable operation for a period of time again
Extension next node.Because the point spread of quantity, may result in client uniformity Hash at double
All cache node redistributions on ring, cache hit rate is almost reduced to zero.
One of ordinary skill in the art will appreciate that：Realize all or part of step of above-mentioned each method embodiment
Suddenly can be completed by the related hardware of programmed instruction.Foregoing program can be stored in a computer can
In reading storage medium.The program upon execution, performs the step of including above-mentioned each method embodiment；And
Foregoing storage medium includes：ROM, RAM, magnetic disc or CD etc. are various can be with store program codes
Medium.
Finally it should be noted that：Various embodiments above is merely illustrative of the technical solution of the present invention, rather than right
Its limitation；Although being described in detail to the present invention with reference to foregoing embodiments, this area it is common
Technical staff should be understood：It can still modify to the technical scheme described in foregoing embodiments,
Or equivalent is carried out to which part or all technical characteristic；And these modifications or replacement, and
The scope of the essence disengaging various embodiments of the present invention technical scheme of appropriate technical solution is not made.
Claims (12)
1. a kind of distributed cache system, it is characterised in that including：Multiple servers and caching web
Manager；Wherein,
The caching web-based management device is used for：Distribution cache cluster, is the cache node point in cache cluster
With identifying and store, and sent to the server when cache cluster is distributed and start order；
The server is used for：The startup order that the caching web-based management device sends is received, according to
It is described to start the caching process that order starts on the server, obtain institute from the caching web-based management device
The mark of all cache nodes on server is stated, the existing state of all cache nodes is detected, if detection
Do not survived to a cache node, the caching process on the server is restarted immediately.
2. system according to claim 1, it is characterised in that also include：Configuration center and client
End, the configuration center is used for：
Cache node in the caching web-based management device distribution cache cluster or renewal cache cluster
Afterwards, by the storage of the configuration information of the cache cluster in the configuration internal memory of the heart, the configuration information bag
Include：Configuration generation or timestamp, cluster identity ID, the corresponding cache clusters of the cluster ID of change
Cache node list and configuration information described in the client request cycle；
The order of the request configuration information that the client periodically sends is received, the internal memory is read,
The configuration information is returned to the client；
The client is used for：The order of the request configuration information is periodically sent to the configuration center,
Receive the configuration information that the configuration center is returned.
3. system according to claim 2, it is characterised in that the caching web-based management device is also used
In：
Before the cache node in updating cache cluster, configuration information described in the client request is changed
Cycle.
4. system according to claim 2, it is characterised in that the client specifically for：
When sending the order of the request configuration information to the configuration center first, if request failure,
Cache node list is read from the local profile of the client, then is initiated and the caching section for reading
The connection of the cache node in point list；
The order of the request configuration information is sent to the configuration center then according to predetermined period, is received
After the configuration information returned to the configuration center, if detecting the configuration life in the configuration information
Into or change timestamp change, then update the cache node in the client uniformity Hash ring
List, and in the local profile of the configuration information update to the client, will initiate and update
The connection of the cache node in cache node list afterwards.
5. the system according to claim any one of 1-4, it is characterised in that the caching web pipes
Reason device is additionally operable to：
A server is detected to delay after machine, by all cache nodes on the server of the machine of delaying migrate to
Other idle servers.
6. the system according to claim any one of 1-4, it is characterised in that the caching web pipes
Reason device is additionally operable to：
The state of each cache node in detection cache cluster, it is determined that during cache node abnormal state, hair
Play alarm.
7. a kind of management method of cache cluster, it is characterised in that including：
Caching web-based management device distribution cache cluster is cache node allocation identification in cache cluster and is deposited
Storage, and send startup order to server when cache cluster is distributed；
After the server receives the startup order that the caching web-based management device sends, according to institute
State the caching process that order starts on the server that starts；
The server obtains all cache nodes on the server from the caching web-based management device
Mark, detects the existing state of all cache nodes, if detect a cache node not surviving, immediately
Restart the caching process on the server.
8. method according to claim 7, it is characterised in that also include：
The caching web-based management device updates the cache node in cache cluster；
Configuration center is slow in the caching web-based management device distribution cache cluster or renewal cache cluster
After depositing node, by the storage of the configuration information of the cache cluster in the configuration internal memory of the heart, the configuration
Information includes：The timestamp of configuration generation or change, cluster identity ID, the cluster ID are corresponding slow
Deposit the cache node list of cluster and the cycle of configuration information described in client request；
The client periodically sends the order of the request configuration information to the configuration center；
After the configuration center receives the order of the request configuration information, the internal memory is read,
The configuration information is returned to the client；
The client receives the configuration information that the configuration center is returned.
9. method according to claim 8, it is characterised in that the caching web-based management device is more
Before cache node in new cache cluster, also include：
The caching web-based management device changes the cycle of configuration information described in the client request.
10. method according to claim 8, it is characterised in that the client is to the configuration
Center periodically sends the order of the request configuration information, including：
When the client sends the order of the request configuration information to the configuration center first, if please
Failure is asked, then cache node list is read from the local profile of the client, then initiate and read
The connection of the cache node in the cache node list for taking；
Then the client sends the request configuration information according to predetermined period to the configuration center
Order；
The client is received after the configuration information that the configuration center is returned, and is also included：
Detect whether the configuration generation in the configuration information or the timestamp of change change, if so,
Then update the cache node list in the client uniformity Hash ring, and by the configuration information update
To in the local profile of the client, initiate and the caching section in the cache node list after renewal
The connection of point.
11. method according to claim any one of 7-10, it is characterised in that also include：
The caching web-based management device detects a server and delays after machine, by the server of the machine of delaying
All cache nodes are migrated to other idle servers.
12. method according to claim any one of 7-10, it is characterised in that also include：
The state of each cache node in the caching web-based management device detection cache cluster, it is determined that caching
When node state is abnormal, alarm is initiated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511034982.7A CN106936623A (en) | 2015-12-31 | 2015-12-31 | The management method of distributed cache system and cache cluster |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511034982.7A CN106936623A (en) | 2015-12-31 | 2015-12-31 | The management method of distributed cache system and cache cluster |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106936623A true CN106936623A (en) | 2017-07-07 |
Family
ID=59444391
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511034982.7A Pending CN106936623A (en) | 2015-12-31 | 2015-12-31 | The management method of distributed cache system and cache cluster |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106936623A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107463630A (en) * | 2017-07-14 | 2017-12-12 | 太仓诚泽网络科技有限公司 | Multiterminal webpage control system |
| CN108540533A (en) * | 2018-03-14 | 2018-09-14 | 聚好看科技股份有限公司 | A kind of method and apparatus of response request |
| CN109039804A (en) * | 2018-07-12 | 2018-12-18 | 武汉斗鱼网络科技有限公司 | A kind of file reading and electronic equipment |
| CN109634746A (en) * | 2018-12-05 | 2019-04-16 | 四川长虹电器股份有限公司 | A kind of the utilization system and optimization method of web cluster caching |
| CN109657005A (en) * | 2018-12-10 | 2019-04-19 | 浪潮(北京)电子信息产业有限公司 | A kind of data cache method of distributed cluster system, device and equipment |
| CN110399272A (en) * | 2019-07-29 | 2019-11-01 | 中国工商银行股份有限公司 | Log processing equipment, method, electronic equipment and computer readable storage medium |
| CN110399271A (en) * | 2019-07-29 | 2019-11-01 | 中国工商银行股份有限公司 | Log processing equipment, method, electronic equipment and computer readable storage medium |
| CN111107120A (en) * | 2018-10-29 | 2020-05-05 | 亿阳信通股份有限公司 | Redis cluster construction method and system |
| CN111242620A (en) * | 2020-01-15 | 2020-06-05 | 阳光易购(湖南)科技有限公司 | Data caching and querying method of block chain transaction system, terminal and storage medium |
| CN111541555A (en) * | 2020-03-24 | 2020-08-14 | 中国平安人寿保险股份有限公司 | Group chat optimization method and related product |
| CN111639061A (en) * | 2020-05-26 | 2020-09-08 | 深圳壹账通智能科技有限公司 | Data management method, device, medium and electronic equipment in Redis cluster |
| CN115001956A (en) * | 2022-05-24 | 2022-09-02 | 中国平安财产保险股份有限公司 | Server cluster operation method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050172076A1 (en) * | 2004-01-30 | 2005-08-04 | Gateway Inc. | System for managing distributed cache resources on a computing grid |
| CN101710341A (en) * | 2009-12-22 | 2010-05-19 | 北京航空航天大学 | Transparent and universal file cache system |
| US20120331084A1 (en) * | 2011-06-24 | 2012-12-27 | Motorola Mobility, Inc. | Method and System for Operation of Memory System Having Multiple Storage Devices |
| CN103475690A (en) * | 2013-06-17 | 2013-12-25 | 携程计算机技术（上海）有限公司 | Memcached instance configuration method and Memcached instance configuration system |
| CN104580432A (en) * | 2014-12-23 | 2015-04-29 | 上海帝联信息科技股份有限公司 | Memcached system, memory cache data provision method and device, memory cache data maintenance method and device as well as cluster maintenance method and device |
| CN104823170A (en) * | 2012-11-26 | 2015-08-05 | 亚马逊技术股份有限公司 | Distributed caching cluster management |
-
2015
- 2015-12-31 CN CN201511034982.7A patent/CN106936623A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050172076A1 (en) * | 2004-01-30 | 2005-08-04 | Gateway Inc. | System for managing distributed cache resources on a computing grid |
| CN101710341A (en) * | 2009-12-22 | 2010-05-19 | 北京航空航天大学 | Transparent and universal file cache system |
| US20120331084A1 (en) * | 2011-06-24 | 2012-12-27 | Motorola Mobility, Inc. | Method and System for Operation of Memory System Having Multiple Storage Devices |
| CN104823170A (en) * | 2012-11-26 | 2015-08-05 | 亚马逊技术股份有限公司 | Distributed caching cluster management |
| CN103475690A (en) * | 2013-06-17 | 2013-12-25 | 携程计算机技术（上海）有限公司 | Memcached instance configuration method and Memcached instance configuration system |
| CN104580432A (en) * | 2014-12-23 | 2015-04-29 | 上海帝联信息科技股份有限公司 | Memcached system, memory cache data provision method and device, memory cache data maintenance method and device as well as cluster maintenance method and device |
Non-Patent Citations (1)
| Title |
|---|
| 郭栋等: "基于Memcached的缓存资源集中管理方法", 《计算机技术与发展》 * |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107463630A (en) * | 2017-07-14 | 2017-12-12 | 太仓诚泽网络科技有限公司 | Multiterminal webpage control system |
| CN108540533A (en) * | 2018-03-14 | 2018-09-14 | 聚好看科技股份有限公司 | A kind of method and apparatus of response request |
| CN108540533B (en) * | 2018-03-14 | 2021-01-22 | 聚好看科技股份有限公司 | Request answering method and device |
| CN109039804B (en) * | 2018-07-12 | 2020-08-25 | 武汉斗鱼网络科技有限公司 | File reading method and electronic equipment |
| CN109039804A (en) * | 2018-07-12 | 2018-12-18 | 武汉斗鱼网络科技有限公司 | A kind of file reading and electronic equipment |
| CN111107120B (en) * | 2018-10-29 | 2022-09-02 | 亿阳信通股份有限公司 | Redis cluster construction method and system |
| CN111107120A (en) * | 2018-10-29 | 2020-05-05 | 亿阳信通股份有限公司 | Redis cluster construction method and system |
| CN109634746A (en) * | 2018-12-05 | 2019-04-16 | 四川长虹电器股份有限公司 | A kind of the utilization system and optimization method of web cluster caching |
| CN109657005A (en) * | 2018-12-10 | 2019-04-19 | 浪潮(北京)电子信息产业有限公司 | A kind of data cache method of distributed cluster system, device and equipment |
| CN110399271A (en) * | 2019-07-29 | 2019-11-01 | 中国工商银行股份有限公司 | Log processing equipment, method, electronic equipment and computer readable storage medium |
| CN110399272B (en) * | 2019-07-29 | 2022-02-18 | 中国工商银行股份有限公司 | Log processing device, method, electronic device, and computer-readable storage medium |
| CN110399272A (en) * | 2019-07-29 | 2019-11-01 | 中国工商银行股份有限公司 | Log processing equipment, method, electronic equipment and computer readable storage medium |
| CN111242620A (en) * | 2020-01-15 | 2020-06-05 | 阳光易购(湖南)科技有限公司 | Data caching and querying method of block chain transaction system, terminal and storage medium |
| CN111541555A (en) * | 2020-03-24 | 2020-08-14 | 中国平安人寿保险股份有限公司 | Group chat optimization method and related product |
| CN111639061A (en) * | 2020-05-26 | 2020-09-08 | 深圳壹账通智能科技有限公司 | Data management method, device, medium and electronic equipment in Redis cluster |
| CN115001956A (en) * | 2022-05-24 | 2022-09-02 | 中国平安财产保险股份有限公司 | Server cluster operation method, device, equipment and storage medium |
| CN115001956B (en) * | 2022-05-24 | 2023-06-16 | 中国平安财产保险股份有限公司 | Method, device, equipment and storage medium for running server cluster |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106936623A (en) | The management method of distributed cache system and cache cluster | |
| CN109831500B (en) | Synchronization method for configuration file and Pod in Kubernetes cluster | |
| CN104715001B (en) | The method and system of write operation is performed for the shared resource in the cluster to data handling system | |
| US9892006B2 (en) | Non-blocking listener registration in the presence of data grid nodes joining the cluster | |
| US10922303B1 (en) | Early detection of corrupt data partition exports | |
| US9367261B2 (en) | Computer system, data management method and data management program | |
| CN105049502B (en) | The method and apparatus that device software updates in a kind of cloud network management system | |
| CN105069152B (en) | data processing method and device | |
| US9537951B2 (en) | Management of network devices within a dispersed data storage network | |
| CN103024065A (en) | System configuration management method for cloud storage system | |
| CN106603319A (en) | Fault processing method, management server, and logic server | |
| CN113010496B (en) | Data migration method, device, equipment and storage medium | |
| CN107404509A (en) | Distributed Services configure system and approaches to IM | |
| CN108228393A (en) | A kind of implementation method of expansible big data High Availabitity | |
| CN109639773A (en) | A kind of the distributed data cluster control system and its method of dynamic construction | |
| JP2016162389A (en) | Thin client system, connection management device, virtual machine operating device, method, and program | |
| CN110334079B (en) | Data migration method and device | |
| CN104516744A (en) | Software updating method and system | |
| US8117181B2 (en) | System for notification of group membership changes in directory service | |
| EP3570169B1 (en) | Method and system for processing device failure | |
| CN108200151B (en) | ISCSI Target load balancing method and device in distributed storage system | |
| CN105323271B (en) | Cloud computing system and processing method and device thereof | |
| CN113726546A (en) | Configuration method, device, system, computing equipment and storage medium | |
| US11153173B1 (en) | Dynamically updating compute node location information in a distributed computing environment | |
| CN106792843B (en) | Equipment management method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170707 |
|
| RJ01 | Rejection of invention patent application after publication |