CN110581873B - Cross-cluster redirection method and monitoring server - Google Patents

Cross-cluster redirection method and monitoring server Download PDF

Info

Publication number
CN110581873B
CN110581873B CN201810593576.1A CN201810593576A CN110581873B CN 110581873 B CN110581873 B CN 110581873B CN 201810593576 A CN201810593576 A CN 201810593576A CN 110581873 B CN110581873 B CN 110581873B
Authority
CN
China
Prior art keywords
cluster
resource
target
monitoring server
monitoring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810593576.1A
Other languages
Chinese (zh)
Other versions
CN110581873A (en
Inventor
徐舟
程路
王易风
余海江
舒继峰
范东东
许昊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Group Zhejiang Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Group Zhejiang Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Group Zhejiang Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201810593576.1A priority Critical patent/CN110581873B/en
Publication of CN110581873A publication Critical patent/CN110581873A/en
Application granted granted Critical
Publication of CN110581873B publication Critical patent/CN110581873B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/505Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/50Testing arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources

Abstract

The embodiment of the invention provides a cross-cluster redirection method, which comprises the following steps: if the target resource is not cached in the first cluster, sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster containing the target resource; and sending the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to a terminal through 302 redirection messages. According to the cross-cluster redirection method provided by the embodiment of the invention, the cluster is subjected to cloud caching, and cross-cluster redirection is performed in the cloud caching, so that the resource loading time in the starting process of the monitoring process can be effectively reduced, the memory resource consumption of the monitoring server can be reduced, and the pressure of the service process and the database of each cluster management server can be effectively reduced.

Description

Cross-cluster redirection method and monitoring server
Technical Field
The embodiment of the invention relates to the technical field of internet communication, in particular to a cross-cluster redirection method and a monitoring server.
Background
The cache cluster monitoring server monitors HTTP GET and HEAD requests in a link in a bypass light splitting mode, when the resource type requested by a user can be cached and the request frequency reaches a preset threshold value, the monitoring server informs the cluster management server, the cluster management server informs a specific cache server in the cluster to return resources, and then information such as url, file name and the like of the resources is recorded in a mysql database of the management server. After the resources are updated, the management server synchronizes the information such as the resource records to all the monitoring servers in the cluster, and when the user accesses the existing resources in the cache, the monitoring servers send 302 a redirection message to guide the interrupted user to the cache to acquire the resources.
Aiming at the characteristics that the number of users in the current network is large, the scale of the outlet links is large, and the outlet links are distributed in a plurality of machine rooms, the strategy that different outlet links are served by a specific cache cluster is adopted at present, and the aim is to increase the flexibility of system deployment and the flexibility of link capacity expansion. Under the condition that multiple cache clusters coexist, different provincial networks and third-party outlet links can be taken according to the same resource request of users in different regions, and then the same resource request is monitored by monitoring servers of different clusters, so that the multiple clusters repeatedly return to the same resource from a public network for multiple times, the repeated occupation of outlet bandwidth is caused, and the cache gain ratio index is influenced.
There is therefore a need for a cross-cluster redirection method to solve the above problems.
Disclosure of Invention
To solve the above problems, embodiments of the present invention provide a cross-cluster redirection method and a monitoring server, which overcome the above problems or at least partially solve the above problems.
In a first aspect, an embodiment of the present invention provides a cross-cluster redirection method, including: if the target resource is not cached in the first cluster, sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster containing the target resource;
and sending the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to a terminal through 302 redirection messages.
In a second aspect, an embodiment of the present invention further provides a monitoring server, including:
the determining module is used for sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster containing the target resource if the target resource is not cached in the first cluster;
and the redirection module is used for sending the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to the terminal through 302 redirection messages.
A third aspect of the present invention provides a monitoring server device, including:
a processor, a memory, a communication interface, and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the memory stores program instructions executable by the processor, which when invoked by the processor are capable of performing a cross-cluster redirection method as described above.
A fourth aspect of the present invention provides a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the above method.
According to the cross-cluster redirection method provided by the embodiment of the invention, the cluster is subjected to cloud caching, and cross-cluster redirection is performed in the cloud caching, so that the resource loading time in the starting process of the monitoring process can be effectively reduced, the memory resource consumption of the monitoring server can be reduced, and the pressure of the service process and the database of each cluster management server can be effectively reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a cross-cluster redirection method according to an embodiment of the present invention;
fig. 2 is a structural diagram of a monitoring server according to an embodiment of the present invention;
fig. 3 is a block diagram of a monitoring server device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some embodiments, but not all embodiments, of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Currently, in the prior art, the following two problems mainly exist in the process of redirection:
1. each cluster is used for periodically calculating the hot spot resources in the cluster, and the calculation mode of the hot spot resources increases the resource overhead of the database and the load of a management process. The database of the cache cluster management server records information such as the size, creation time, latest service time, service connection times, service flow and the like of cached resource files, and the recording quantity of the file resources usually reaches tens of millions.
2. After the process is restarted, the monitoring server loads a large number of hot spot resources of other clusters besides the resources in the cluster, so that high requirements are put forward on the memory capacity of the monitoring server, the resource loading time is prolonged, and the resource records loaded into the memory are frequently updated, which affects the redirection efficiency.
To solve the above problem, fig. 1 is a schematic flow diagram of a cross-cluster redirection method provided by an embodiment of the present invention, and as shown in fig. 1, the method includes:
110. if the target resource is not cached in the first cluster, sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster containing the target resource;
120. and sending the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to a terminal through 302 redirection messages.
It should be noted that the main execution body in the embodiment of the present invention is a monitoring server in the first cluster, and when the monitoring server receives a target resource retrieval request sent by a terminal and there is no target resource in the first cluster, the cross-cluster redirection scheme provided in the embodiment of the present invention needs to be used to obtain the target resource in another cluster.
It should be further noted that the cross-cluster redirection scheme provided by the embodiment of the present invention is suitable for provinces where multiple clusters are deployed, and since each cluster is deployed in the same province, the number of route hops through which equipment communicates between computer rooms is small, and a network outlet computer room is connected to a network outlet computer room or a direct link is provided, so that bandwidth and communication quality are guaranteed. The monitoring servers are all configured with public network IP addresses, the servers among different clusters can access each other, the network delay is in millisecond level, and the possibility of searching the memory resources of the monitoring servers among different clusters is provided.
In step 110, the cloud cache is a cloud cache set formed by all clusters including the first cluster, and the cloud cache can well solve the problem that the same resource repeatedly returns to the source in a plurality of clusters. After the cloud cache sharing function is started by each cluster, the management server of each cluster periodically calculates the hot spot resources in the cluster, and then the hot spot resources are periodically synchronized to other clusters. The monitoring server loads hot spot resources of other clusters regularly, when the resources accessed by the user are not cached in the cluster, but the other clusters are cached, the monitoring server informs a cache server in the cluster, the user requests to the cache server of the other clusters to obtain the resources by acting, and meanwhile, file copies are reserved locally.
It should be noted that, when the number of times of accessing the specific resource in the cluster reaches the trigger threshold of the cloud cache, the resource is changed into a locally cached resource in the recorded database of the cluster.
In step 110, the resource retrieving is a process of retrieving, from other clusters, which cluster can provide the target resource when the target resource is not cached in the current cluster and the target resource is cached in other clusters. An optimal cluster capable of providing target resources is determined from a plurality of clusters included in the cloud cache through resource retrieval, and the optimal cluster is used as a target cluster.
Further, after the target cluster is determined in step 110, in step 120, the IP address of the cache server and the storage path of the target resource on the disk of the cache server corresponding to the target cluster may be determined according to the storage of the target resource in the determined target cluster, and then these information may be sent to the terminal in the form of 302 redirection message. Therefore, the terminal can directly obtain the resources from the cache server of the target cluster.
According to the cross-cluster redirection method provided by the embodiment of the invention, the cluster is subjected to cloud caching, and cross-cluster redirection is performed in the cloud caching, so that the resource loading time in the starting process of the monitoring process can be effectively reduced, the memory resource consumption of the monitoring server can be reduced, and the pressure of the service process and the database of each cluster management server can be effectively reduced.
On the basis of the foregoing embodiment, if it is detected that the target resource is not cached in the first cluster, the sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine the target cluster including the target resource includes:
loading the resource directory of the first cluster, and detecting whether the target resource is contained in the resource directory of the first cluster;
if the target resource is not detected in the resource directory of the first cluster, sending a resource retrieval instruction to monitoring servers corresponding to clusters except the first cluster in a cloud cache to determine a target monitoring server containing the target resource;
and determining the target cluster according to the determined target monitoring server.
As can be seen from the content of the foregoing embodiment, the cross-cluster redirection method provided in the embodiment of the present invention can retrieve the content of other cluster caches in the cloud cache, determine the target cluster containing the target resource, and direct the terminal to directly acquire the target resource from the target cluster through the 302 redirection message.
The specific determination process for the target cluster is as follows: only the resource record of the current cluster, that is, the first cluster, is loaded, and the resource records of other clusters in the cloud cache are not loaded any more, so that for the resource which is not cached in the current cluster but is cached in other clusters, the monitoring server of the first cluster can perform resource retrieval to the monitoring servers of other clusters in real time, thereby determining the target monitoring server containing the target resource.
It can be understood that there is a corresponding relationship between the monitoring server and the cluster, so that after the target monitoring server is determined, the target cluster can be correspondingly determined.
On the basis of the foregoing embodiment, the sending a resource retrieval instruction to a monitoring server corresponding to each cluster in a cloud cache except for the first cluster to determine a target monitoring server including the target resource includes:
simultaneously sending a resource retrieval instruction to a monitoring server corresponding to each cluster except the first cluster in the cloud cache, wherein the resource retrieval instruction is used for indicating the monitoring server to perform target resource retrieval in a memory of the monitoring server;
and taking the first monitoring server which carries out retrieval response reply according to the resource retrieval instruction as the target monitoring server.
As can be seen from the above description of the embodiments, the embodiments of the present invention are resource search performed in the monitoring server corresponding to the cluster. Specifically, the resource retrieval scheme provided in the embodiment of the present invention is that the monitoring server of the first cluster simultaneously sends the resource retrieval instruction to the monitoring servers of other clusters. The resource retrieval instruction can instruct the monitoring servers of other clusters to perform target resource retrieval in the memories of the monitoring servers, and the monitoring servers of the clusters do not need to perform retrieval in the management server database of the clusters as in the prior art.
In addition, the method provided by the embodiment of the invention adopts one-time batch sending when sending the resource retrieval instruction, and aims to shorten the resource retrieval times, improve the single retrieval quantity and further improve the resource retrieval performance.
It should be noted that, because the number of monitoring servers included in the cluster is large, data is loaded in the memory, the resource retrieval speed is fast, and the resource retrieval is balanced to all monitoring servers. The scheme for resource retrieval in the memory of the monitoring server provided by the embodiment of the invention avoids the pressure of retrieval from different cluster monitoring servers to the cluster management server database, and can also improve the retrieval efficiency.
Further, each monitoring server will detect whether the resource record contains the target resource after receiving the resource retrieval instruction, and if so, a corresponding retrieval response reply needs to be made, so as to inform the monitoring server of the first cluster. Then, since the sending is performed to all clusters simultaneously in the sending process, but the response speeds of different clusters may be different, in consideration of the retrieval speed, the embodiment of the present invention preferentially uses the monitoring server corresponding to the first received retrieval response reply as the target monitoring server, and the next received retrieval response replies are discarded.
On the basis of the foregoing embodiment, the taking the first monitoring server that performs the retrieval response reply according to the resource retrieval instruction as the target monitoring server further includes:
and if the information of searching response reply of any monitoring server according to the resource searching instruction is not received within the preset time, sending the information of resource request acquisition failure to the terminal.
As can be seen from the content of the foregoing embodiment, the solution monitoring server provided in the embodiment of the present invention needs to perform a retrieval response reply according to the resource retrieval instruction. In consideration of timeliness of resource retrieval, in the embodiment of the invention, when the monitoring server sends the resource retrieval instruction, the timer is started to time, and no retrieval response reply of other cluster monitoring servers is received within a specified time, the resource requested by the user is considered to be not cached in all cache clusters, the monitoring server informs the management server of the request of the user for the resource, the management server uniformly records the access times of the resource, and meanwhile, the monitoring server gives up the action of guiding the terminal to redirect and obtain the resource.
On the basis of the above embodiment, each cluster in the cloud cache corresponds to one or more monitoring servers, and the resource records loaded by each monitoring server corresponding to each cluster are the same.
It should be noted that, in the embodiment of the present invention, each monitoring server is grouped in advance, and the grouping standard is performed according to a cluster, that is, all monitoring servers in the same cluster are distributed in the same group.
Then, since the resource records loaded by all the monitoring servers in the same cluster are completely consistent, the resource retrieval is performed only in the memory of a specific monitoring server in each cluster, for example: in a cloud cache system consisting of N clusters, the monitoring server only needs to search resources on N-1 monitoring servers, so that the resource searching overhead among different clusters is minimized.
As can be seen from the above, when resource search is performed, each cluster corresponds to a specific monitoring server, and search is directly performed on the specific monitoring server. However, in order to avoid the problem that a part of monitoring servers obtain too many retrieval requests and another part of monitoring servers obtain too few retrieval requests, it is necessary to reasonably distribute the request load on each cluster monitoring server. Therefore, the embodiment of the invention also provides a scheme that one cluster corresponds to a plurality of monitoring servers.
For convenience of description, the embodiment of the present invention is described in a manner that one cluster corresponds to two monitoring servers, but the embodiment of the present invention does not specifically limit the corresponding number of the clusters and the monitoring servers.
In the embodiment of the invention, one cluster corresponds to two monitoring servers, wherein one monitoring server is a main server, and the other monitoring server is an auxiliary server. For example: the monitoring server 1 of the cluster 1 performs resource retrieval on the target servers of the monitoring server 1 and the monitoring server 2 of the cluster 2, the monitoring server 1 of the cluster 2 is a main server, the monitoring server 2 of the cluster 2 is a standby server, and the standby server provides service under the request that the main server cannot provide service. TCP connection is established in advance between each monitoring server in the cluster 1 and the corresponding monitoring server in the cluster 2, and connection multiplexing is carried out, so that the resource retrieval speed can be effectively accelerated.
On the basis of the above embodiment, the method further includes:
when one cluster corresponds to a plurality of monitoring servers, for any one cluster, if the resource retrieval instruction sent to the monitoring server corresponding to the cluster fails, the resource retrieval instruction is sent to another monitoring server corresponding to the cluster again through a preset redundant path.
As can be seen from the foregoing description of the embodiments, the cluster provided in the embodiments of the present invention may correspond to one or more monitoring servers. And one of them is used as a main server, and the other monitoring servers are used as secondary servers for alternative. Then when the resource retrieval instruction fails to be sent to the primary server, a new primary server needs to be selected from the secondary servers to resend the resource retrieval instruction. Specifically, the embodiment of the present invention may be implemented by establishing a redundant path between the server and the sending-end monitoring server.
On the basis of the foregoing embodiment, the sending the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to the terminal through a 302 redirection message includes:
determining a cache server for storing target resources based on the resource monitoring record of the target monitoring server corresponding to the target cluster;
and sending the IP address information of the cache server and the storage path information on the disk of the cache server corresponding to the target cluster to the terminal through a 302 redirection message.
As can be seen from the content of the foregoing embodiment, the monitoring server of the first cluster provided in the embodiment of the present invention does not load the resource records of other clusters any more, but only loads the resource records of the first cluster. And aiming at the resources which are not cached in the first cluster but are cached in other clusters, the monitoring server carries out resource retrieval on the monitoring servers of other clusters in real time, sends a redirection message according to the retrieval result and guides the user to the servers of other clusters having the resources to obtain the resources. The direction of user requests is no longer limited to the inside of the cluster, but extends to the various clusters that make up the cloud cache.
According to the retrieval result on the target monitoring server, the server IP address information stored by the resource and the storage path of the resource on the disk can be integrated, and the information is sent to the terminal by the 302 redirection message, wherein the IP address of the Location field of the 302 redirection message points to the IP address of the cache server owned by other clusters, but not the IP address of the cache server of the first cluster, so that the cross-cluster redirection guidance of the user for directly obtaining the resource from the cache servers of other clusters is realized.
Fig. 2 is a structural diagram of a monitoring server according to an embodiment of the present invention, and as shown in fig. 2, the system includes: a determination module 210 and a redirection module 220, wherein:
the determining module 210 is configured to, if it is detected that the target resource is not cached in the first cluster, send a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster including the target resource;
the redirection module 220 is configured to send the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to the terminal through a 302 redirection message.
Specifically, how to perform cross-cluster redirection through the determining module 210 and the redirecting module 220 may be used to execute the technical solution of the cross-cluster redirection method embodiment shown in fig. 1, and the implementation principle and the technical effect are similar, which are not described herein again.
According to the monitoring server provided by the embodiment of the invention, the cluster is subjected to cloud caching, and cross-cluster redirection is performed in the cloud caching, so that the resource loading time in the starting process of the monitoring process can be effectively reduced, the memory resource consumption of the monitoring server can be reduced, and the pressure of the service process and the database of each cluster management server can be effectively reduced.
An embodiment of the present invention provides a monitoring server device, including: at least one processor; and at least one memory communicatively coupled to the processor, wherein:
fig. 3 is a block diagram of a monitoring server device according to an embodiment of the present invention, and referring to fig. 3, the monitoring server device includes: a processor (processor)310, a communication Interface (Communications Interface)320, a memory (memory)330 and a bus 340, wherein the processor 310, the communication Interface 320 and the memory 330 communicate with each other via the bus 340. The processor 310 may call logic instructions in the memory 330 to perform the following method: if the target resource is not cached in the first cluster, sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster containing the target resource; and sending the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to a terminal through 302 redirection messages.
An embodiment of the present invention discloses a computer program product, which includes a computer program stored on a non-transitory computer readable storage medium, the computer program including program instructions, when the program instructions are executed by a computer, the computer can execute the methods provided by the above method embodiments, for example, the method includes: if the target resource is not cached in the first cluster, sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster containing the target resource; and sending the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to a terminal through 302 redirection messages.
Embodiments of the present invention provide a non-transitory computer-readable storage medium, which stores computer instructions, where the computer instructions cause the computer to perform the methods provided by the above method embodiments, for example, the methods include: if the target resource is not cached in the first cluster, sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster containing the target resource; and sending the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to a terminal through 302 redirection messages.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment may be implemented by software plus a necessary general hardware platform, and may also be implemented by hardware. Based on the understanding, the above technical solutions substantially or otherwise contributing to the prior art may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the various embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (7)

1. A cross-cluster redirection method, comprising:
if the target resource is not cached in the first cluster, sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster containing the target resource;
sending the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to a terminal through a 302 redirection message, so that the terminal can directly obtain the target resource from the cache server corresponding to the target cluster;
if it is detected that the target resource is not cached in the first cluster, sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster containing the target resource, including:
loading the resource directory of the first cluster, and detecting whether the target resource is contained in the resource directory of the first cluster;
if the target resource is not detected in the resource directory of the first cluster, sending a resource retrieval instruction to monitoring servers corresponding to clusters except the first cluster in a cloud cache to determine a target monitoring server containing the target resource;
Determining the target cluster according to the determined target monitoring server;
each cluster corresponds to one or more monitoring servers in the cloud cache, and the resource records loaded by each monitoring server corresponding to each cluster are the same;
the method further comprises the following steps:
when one cluster corresponds to a plurality of monitoring servers, for any one cluster, if the resource retrieval instruction sent to the monitoring server corresponding to the cluster fails, the resource retrieval instruction is sent to another monitoring server corresponding to the cluster again through a preset redundant path.
2. The method according to claim 1, wherein the sending a resource retrieval instruction to the monitoring servers corresponding to the clusters in the cloud cache except the first cluster to determine a target monitoring server containing the target resource comprises:
simultaneously sending a resource retrieval instruction to a monitoring server corresponding to each cluster except the first cluster in the cloud cache, wherein the resource retrieval instruction is used for indicating the monitoring server to perform target resource retrieval in a memory of the monitoring server;
and taking the first monitoring server which carries out retrieval response reply according to the resource retrieval instruction as the target monitoring server.
3. The method according to claim 2, wherein the step of using the first monitoring server that replies to the retrieval response according to the resource retrieval instruction as the target monitoring server further comprises:
and if the information of searching response reply of any monitoring server according to the resource searching instruction is not received within the preset time, sending the information of resource request acquisition failure to the terminal.
4. The method according to claim 1, wherein the sending the IP address of the cache server corresponding to the target cluster and the storage path of the target resource on the disk of the cache server corresponding to the target cluster to the terminal through a 302 redirection message comprises:
determining a cache server for storing target resources based on the resource monitoring record of the target monitoring server corresponding to the target cluster;
and sending the IP address information of the cache server and the storage path information on the disk of the cache server corresponding to the target cluster to the terminal through a 302 redirection message.
5. A monitoring server, comprising:
the determining module is used for sending a resource retrieval instruction to each cluster except the first cluster in the cloud cache to determine a target cluster containing the target resource if the target resource is not cached in the first cluster;
A redirection module, configured to send an IP address of the cache server corresponding to the target cluster and a storage path of the target resource on the disk of the cache server corresponding to the target cluster to a terminal through a 302 redirection message, so that the terminal directly obtains the target resource from the cache server corresponding to the target cluster;
the determining module is specifically configured to:
loading the resource directory of the first cluster, and detecting whether the target resource is contained in the resource directory of the first cluster;
if the target resource is not detected in the resource directory of the first cluster, sending a resource retrieval instruction to monitoring servers corresponding to clusters except the first cluster in a cloud cache to determine a target monitoring server containing the target resource;
determining the target cluster according to the determined target monitoring server;
each cluster corresponds to one or more monitoring servers in the cloud cache, and the resource records loaded by each monitoring server corresponding to each cluster are the same;
when one cluster corresponds to a plurality of monitoring servers, for any one cluster, if the resource retrieval instruction sent to the monitoring server corresponding to the cluster fails, the resource retrieval instruction is sent to another monitoring server corresponding to the cluster again through a preset redundant path.
6. The monitoring server equipment is characterized by comprising a memory and a processor, wherein the processor and the memory are communicated with each other through a bus; the memory stores program instructions executable by the processor, the processor invoking the program instructions to perform the method of any of claims 1 to 4.
7. A non-transitory computer-readable storage medium storing computer instructions that cause a computer to perform the method of any one of claims 1 to 4.
CN201810593576.1A 2018-06-11 2018-06-11 Cross-cluster redirection method and monitoring server Active CN110581873B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810593576.1A CN110581873B (en) 2018-06-11 2018-06-11 Cross-cluster redirection method and monitoring server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810593576.1A CN110581873B (en) 2018-06-11 2018-06-11 Cross-cluster redirection method and monitoring server

Publications (2)

Publication Number Publication Date
CN110581873A CN110581873A (en) 2019-12-17
CN110581873B true CN110581873B (en) 2022-06-14

Family

ID=68809380

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810593576.1A Active CN110581873B (en) 2018-06-11 2018-06-11 Cross-cluster redirection method and monitoring server

Country Status (1)

Country Link
CN (1) CN110581873B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115150475A (en) * 2021-03-31 2022-10-04 贵州白山云科技股份有限公司 Scheduling method, device, medium and equipment
CN114938394A (en) * 2022-04-13 2022-08-23 京东科技信息技术有限公司 Cross-cluster network control method, device, equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102834814A (en) * 2010-04-20 2012-12-19 日本电气株式会社 Distribution system, distribution control device, and distribution control method
CN102855284A (en) * 2012-08-03 2013-01-02 北京联创信安科技有限公司 Method and system for managing data of cluster storage system
US8706865B1 (en) * 2011-01-06 2014-04-22 Israel L'Heureux Enhanced network communications using diagnostic information
CN105138661A (en) * 2015-09-02 2015-12-09 西北大学 Hadoop-based k-means clustering analysis system and method of network security log
CN106507181A (en) * 2016-11-30 2017-03-15 北京酷我科技有限公司 A kind of method for being obtained and stored in line video data
CN107925685A (en) * 2015-07-31 2018-04-17 思杰系统有限公司 The redirector browsed for secure web-page

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102834814A (en) * 2010-04-20 2012-12-19 日本电气株式会社 Distribution system, distribution control device, and distribution control method
US8706865B1 (en) * 2011-01-06 2014-04-22 Israel L'Heureux Enhanced network communications using diagnostic information
CN102855284A (en) * 2012-08-03 2013-01-02 北京联创信安科技有限公司 Method and system for managing data of cluster storage system
CN107925685A (en) * 2015-07-31 2018-04-17 思杰系统有限公司 The redirector browsed for secure web-page
CN105138661A (en) * 2015-09-02 2015-12-09 西北大学 Hadoop-based k-means clustering analysis system and method of network security log
CN106507181A (en) * 2016-11-30 2017-03-15 北京酷我科技有限公司 A kind of method for being obtained and stored in line video data

Also Published As

Publication number Publication date
CN110581873A (en) 2019-12-17

Similar Documents

Publication Publication Date Title
US10911530B2 (en) Content delivery method, virtual server management method, cloud platform, and system
CN103023768B (en) Edge routing node and its method from multi-source prefetching content
CN108156013B (en) Page service disaster tolerance method and device and electronic equipment
EP2227016A1 (en) A content buffering, querying method and point-to-point media transmitting system
CN107332908B (en) Data transmission method and system
CN112134721B (en) API gateway degradation method and terminal
CN111683013B (en) Routing method of acceleration network and acceleration network
KR20090094292A (en) Method, device and system for distributing file data
US20150220438A1 (en) Dynamic hot volume caching
CN110581873B (en) Cross-cluster redirection method and monitoring server
CN103107944B (en) A kind of content positioning method and routing device
JP2003122658A (en) Data distribution method
US20140222988A1 (en) Method for adaptive content discovery for distributed shared caching system
CN113676514B (en) File source returning method and device
US20220353320A1 (en) System for providing exact communication delay guarantee of request response for distributed service
US11606415B2 (en) Method, apparatus and system for processing an access request in a content delivery system
CN113301079B (en) Data acquisition method, system, computing device and storage medium
CN115706741A (en) Method and device for returning slice file
EP3685567B1 (en) Load shedding of traffic based on current load state of target capacity
CN113301173A (en) Domain name updating system and method, message forwarding method and server
CN114124797B (en) Server routing method and device, electronic equipment and storage medium
CN109644160B (en) Hybrid method for name resolution and producer selection in ICN by classification
KR102235622B1 (en) Method and Apparatus for Cooperative Edge Caching in IoT Environment
US11914590B1 (en) Database request router improving server cache utilization
CN115277851B (en) Service request processing method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant