WO2022206529A1 - Resource request processing method and apparatus, computer device, and medium - Google Patents

Abstract

The present disclosure relates to a resource request processing method, and is applied to a first edge node of a content delivery network. The method comprises: receiving a resource request of a client; determining whether the resource requested by the resource request is in the first edge node; when there is no resource, determining the type of the resource; when the resource is a first type of resource, the first edge node determines a second edge node, the first edge node returns a first response message of the resource request to the client, the first response message being used to instruct the client to send an adjusted resource request to the second edge node, wherein the first edge node returning the first response message of the resource request to the client comprises address information of the second edge node; when the resource is a second type of resource, the first edge node obtains the resource from an upper-layer node or a source station and returns same to the client.

Description

A method, apparatus, computer equipment and medium for processing a resource request

This disclosure is based on the Chinese patent application with the application number of 202110332154.0 and the invention titled "A method, device, computer equipment and medium for processing resource requests" filed with the China Patent Office on March 29, 2021, and requires the Chinese patent application priority, the entire content of this Chinese patent application is hereby incorporated into the present disclosure by reference.

technical field

The embodiments of the present disclosure relate to, but are not limited to, a method, an apparatus, a computer device, and a medium for processing a resource request.

Background technique

The full name of CDN is Content Delivery Network, that is, Content Delivery Network. CDN is an intelligent virtual network built on the basis of the existing network, relying on edge servers deployed in various places, through the load balancing, content distribution, scheduling and other functional modules of the central platform, so that users can obtain the desired content nearby and reduce network congestion.

The CDN hit rate refers to the probability of hitting the cache when a user accesses it. The architecture of CDN is a multi-layer cache aggregation structure. The first layer is the edge node, the middle layer is composed of one or more layers of parent nodes, and the last layer is the origin site. In the related art, the client randomly accesses the CDN edge node through DNS resolution. When the request content is not hit, the edge node forwards the request to the upper-level parent node, which increases the cost of returning to the parent, resulting in high CDN return rate, internal bandwidth consumption, and network performance. Problems such as poor performance and large delay directly affect the overall performance of the CDN, resulting in poor user experience.

SUMMARY OF THE INVENTION

The following is an overview of the subject matter detailed in this disclosure. This summary is not intended to limit the scope of protection of the claims.

In order to overcome the problems existing in the related art, the present disclosure provides a method, apparatus, computer equipment and medium for processing a resource request.

According to a first aspect of the present disclosure, there is provided a method for processing a resource request, applied to a first edge node of a content distribution network, the method comprising:

The first edge node receives the resource request from the client;

The first edge node judges whether the resource requested by the resource request exists in the first edge node;

When the resource does not exist, the first edge node judges the type of the resource;

When the resource is the first type of resource, the first edge node determines a second edge node, the first edge node returns a first response message for the resource request to the client, the first edge node The response message is used to instruct the client to send the adjusted resource request to the second edge node, wherein the first response message returned by the first edge node to the client for the resource request includes the first response message. address information of the second edge node;

When the resource is of the second type, the first edge node acquires the resource from an upper node or an origin station and returns it to the client.

In some exemplary embodiments, the first edge node determines the type of the resource, including:

When the access times of the resource within a preset time is less than the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is a first type of resource;

When the number of times of accessing the resource within a preset time is greater than or equal to the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is of the second type.

In some exemplary embodiments, the number of times of accessing the resource within the preset time includes:

The access times of the resource at the first edge node within the preset time, and/or the total access times of the resource in the edge node group in the area where the client is located within the preset time.

In some exemplary embodiments, the first preset threshold is set according to historical access conditions of the address information included in the resource request on the first edge node, and/or according to the location of the client in the area where the client is located. On the edge node group, the historical access situation of the address information included in the resource request is set.

In some exemplary embodiments, the first edge node determines the second edge node, including:

determining, by the first edge node, a resource identifier according to the resource request;

The first edge node performs consistent hash calculation on the resource identifier to generate a hash value of the resource, where the resource identifier includes a uniform resource locator or a domain name;

The first edge node calculates the hash value of all or part of the edge nodes in the area where the first edge node is located, and allocates the hash value of each edge node on the consistent hash ring;

The first edge node determines the corresponding second edge node on a consistent hash ring according to the hash value of the resource.

In some exemplary embodiments, after the second edge node is determined by the first edge node, the method further includes:

The first edge node records the second edge node, and when the resource request for accessing the same resource is received again and the resource is of the first type, the first edge node returns the information to the client. The first response message of the resource request includes the recorded address information of the second edge node.

In some exemplary embodiments, the first edge node determines the second edge node, further comprising:

The second edge node is determined according to the load situation of each edge node in the edge node group where the first edge node is located.

In some exemplary embodiments, before the first edge node determines the type of the resource, the method further includes:

The first edge node determines whether its own load is greater than or equal to a second preset threshold;

If the judgment is no, the first edge node judges the resource type of the resource.

In some exemplary embodiments, the method further includes:

If the judgment is yes, the first edge node determines a third edge node, and the first edge node returns a second response message for the resource request to the client;

The second response message is used to instruct the client to send the adjusted resource request to the third edge node.

In some exemplary embodiments, the method further includes:

When it is determined that the resource exists in the first edge node, the resource is directly returned to the client.

In some exemplary embodiments, the first response message is used to instruct the client to send an adjusted resource request to the second edge node, so that the second edge node returns to the client The adjusted resource requests the requested resource, where the resource is a resource whose starting position is the key frame position closest to the system time at which the adjusted resource request arrives at the second edge node.

According to a second aspect of the present disclosure, there is provided an apparatus for processing a resource request, which is applied to a first edge node of a content distribution network, the apparatus comprising:

The receiving module is set to receive the resource request of the client;

a judgment module, configured to judge whether the resource requested by the resource request exists in the first edge node; when the resource does not exist, the judgment module judges the type of the resource;

a determining module, configured to determine the second edge node by the determining module when the determining module determines that the resource is the first type of resource;

A response module, configured to return a first response message of the resource request to the client when the determination module determines that the resource is a first type resource, where the first response message is used to indicate The client sends the adjusted resource request to the second edge node, wherein the first response message that the response module returns to the client for the resource request includes address information of the second edge node;

The response module is further configured to, when the judgment module judges that the resource is a resource of the second type, the response module obtains the resource from the upper-layer node or the source station and returns it to the client.

In some exemplary embodiments, the judging module is specifically set as:

When the access times of the resource within a preset time is less than the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is a first type of resource;

When the number of times of accessing the resource within a preset time is greater than or equal to the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is of the second type.

In some exemplary embodiments, the number of times of accessing the resource within the preset time includes:

The access times of the resource at the first edge node within the preset time, and/or the total access times of the resource in the edge node group in the area where the client is located within the preset time.

In some exemplary embodiments, the first preset threshold is set according to historical access conditions of the address information included in the resource request on the first edge node, and/or according to the location of the client in the area where the client is located. On the edge node group, the historical access situation of the address information included in the resource request is set.

In some exemplary embodiments, the determining module is further configured to:

The determining module determines a resource identifier according to the resource request;

The determining module performs consistent hash calculation on the resource identifier to generate a hash value of the resource, wherein the resource identifier includes a uniform resource locator or a domain name;

The determining module calculates the hash value of all or part of the edge nodes in the area where the first edge node is located, and allocates the hash value of each edge node on the consistent hash ring;

The determining module determines the corresponding second edge node on a consistent hash ring according to the hash value of the resource.

In some exemplary embodiments, the response module is further configured to:

The response module records the second edge node, and when the resource request for accessing the same resource is received again and the resource is of the first type, the response module returns the resource request to the client. The first response message includes the recorded address information of the second edge node.

In some exemplary embodiments, the determining module is further configured to:

The determining module determines the second edge node according to the load situation of each edge node in the edge node group where the first edge node is located.

In some exemplary embodiments, the judging module is further configured to:

The judgment module judges whether the load of the first edge node is greater than or equal to a second preset threshold;

If the judgment is no, the judgment module judges the resource type of the resource.

In some exemplary embodiments, if the judgment module judges yes,

The determining module is further configured to determine a third edge node;

The response module is further configured to, when the judgment module judges yes, the response module returns a second response message of the resource request to the client; the second response message is used to indicate the client The terminal sends the adjusted resource request to the third edge node.

In some exemplary embodiments, the response module is configured to:

When the judgment module judges that the resource exists in the first edge node, the response module directly returns the resource to the client.

In some exemplary embodiments, the first response message is used to instruct the client to send an adjusted resource request to the second edge node, so that the second edge node returns to the client The adjusted resource requests the requested resource, where the resource is a resource whose starting position is the key frame position closest to the system time at which the adjusted resource request arrives at the second edge node.

According to a third aspect of the present disclosure, there is provided a computer device comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the executable instructions in the memory to achieve The method of any one of the first aspects.

According to a fourth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium having executable instructions stored thereon, the executable instructions implementing the method of the first aspect when executed by a processor.

The technical solutions provided by the present disclosure may include the following beneficial effects: by using the resource request processing method of the present disclosure, the hit rate of resource requests at edge nodes can be improved, the cost of returning to the parent can be effectively reduced, the internal consumption bandwidth can be reduced, and the CDN edge node can be improved. utilization efficiency.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. Other aspects will become apparent upon reading and understanding of the drawings and detailed description.

Description of drawings

The accompanying drawings, which constitute a part of the present disclosure, are used to provide a further understanding of the present disclosure, and the exemplary embodiments of the present disclosure and their descriptions are used to explain the present disclosure and do not constitute an improper limitation of the present disclosure. In the attached image:

FIG. 1 is a schematic flowchart of a method for processing a resource request according to an exemplary embodiment;

2 is a block diagram of an apparatus for processing a resource request according to an exemplary embodiment;

Fig. 3 is a block diagram of a computer device according to an exemplary embodiment.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments These are some, but not all, embodiments of the present disclosure. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present disclosure. It should be noted that, the embodiments in the present application and the features in the embodiments may be arbitrarily combined with each other if there is no conflict.

FIG. 1 is a schematic flowchart of a method for processing a resource request provided by an exemplary embodiment of the present application.

As shown in FIG. 1 , the method for processing a resource request according to the present disclosure is applicable to a first edge node of a content distribution network, including:

Step 101, the first edge node receives the resource request sent by the client;

In some exemplary embodiments, the client may be a terminal device such as a desktop computer, a notebook computer, a smart phone, or an IOT device, or a server device such as a conventional server, a cloud server, or a server array. programs running on the machine. After receiving the resource request sent by the client, the scheduling center node in the content distribution network will schedule the request to the first edge node in the content distribution network. In the content distribution network, the edge node that receives the resource request from the client will be defined. is the first edge node.

The resource request received by the first edge node includes at least a resource identifier and a client identifier. The resource identifier may be a uniform resource locator, a domain name, a resource name, etc., and the resource requested by the client can be determined according to the resource identifier. The client identifier may be client address information, client type, client ID, and the like.

Step 102, the first edge node judges whether the resource requested by the resource request exists in the first edge node;

In some exemplary embodiments, when receiving a resource request from a user, the first edge node obtains the resource identifier in the resource request, and the first edge node queries whether the resource requested by the client exists locally, and if it exists (hit), The first edge node directly returns resources to the client.

Step 103, when the resource does not exist, the first edge node judges the type of the resource;

In some exemplary embodiments, when the first server determines that the resource does not exist locally (misses), the first edge node determines the type of the resource. In an embodiment of the present disclosure, the types of resources can be distinguished according to the resource format, the protocol type of the resource request, the size of the resource file, the channel to which the resource belongs, the popularity of resource access, etc.; It can meet different customer needs. For example, customers can divide resources into popular channel resources and general channel resources according to the needs of content operation. Through this distinction, CDN manufacturers can more accurately grasp the processing methods of different content.

In an embodiment of the present disclosure, a resource type matching table may be deployed on an edge node in advance, and/or a preset threshold may be preset for judging the resource type. In one embodiment of the present disclosure, resource types can be distinguished by resource access heat, a preset first preset threshold used to determine resource access heat, and the number of resource accesses is compared with the first preset threshold. Threshold comparison to judge the resource type.

In an embodiment of the present disclosure, when the number of accesses to the resource within the preset time is less than the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is of the first type; If the number of accesses is greater than or equal to the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is of the second type. The address information included in the resource request may be information such as domain name, IP, and URL associated with the resource carried in the resource request, and the first preset threshold includes at least the following two setting methods:

Method 1: Perform manual estimation settings according to the business characteristics of the domain name;

Mode 2: Set according to the historical access status of the domain name carried in the resource request on the first edge node, and/or, according to the historical access status of the domain name carried in the resource request on the edge node group in the area where the client is located. set up;

By counting the number of visits of edge nodes to different domain names in historical time, and calculating the first preset thresholds for different domain names based on the experience of those skilled in the art and any well-known algorithm or through machine learning, the resource type The classification is more accurate, and more fine-grained bandwidth control is achieved at the edge nodes.

The first predictions for different domain names are obtained by calculating the total number of visits to different areas by the edge node group in the area where the client is located in historical time, and based on the experience of those skilled in the art and any well-known algorithm or by machine learning. Setting a threshold can control the number of resources in the area where the client is located to return to the upper-layer node or source station, so that a certain type of resources can be aggregated or dispersed based on the characteristics of a certain area, reducing the overall bandwidth consumption.

By counting the number of visits of edge nodes to different domain names in historical time and the total number of visits of edge node groups to different regions in historical time in the region where the client is located, based on the experience of those skilled in the art and any well-known algorithm or machine In the learning method, the corresponding preset thresholds are respectively set, the two preset thresholds are compared, and the smaller preset threshold is selected as the first preset threshold, so as to simultaneously take into account more fine-grained bandwidth control and control resources on the client The number of back-to-upper nodes or back-to-origin stations in the edge node group. The period of the historical time may be manually set according to the actual situation, and may specifically be the past month, the past half year, the past one year, or the past entire time period, which is not limited in this embodiment.

Step 104, when judging that the resource is the first type of resource, the first edge node determines the second edge node, and the first edge node returns a first response message for the resource request to the client, where the first response message is used to instruct the client to send the The second edge node sends the adjusted resource request, wherein the first response message that the first edge node returns to the client for the resource request includes address information of the second edge node.

In some exemplary embodiments, when the first edge node determines that the resource requested by the user is the first type of resource, the first edge node determines the second edge node, including: the first edge node obtains the resource corresponding to the area to which the client belongs. The edge node group and the resource identifier in the resource request; the first edge node determines the second edge node in the edge node group based on the resource identifier, and the first edge node sends a response message to the client for the resource request, wherein the first edge node The response message that returns the resource request to the client includes the address information of the second edge node and/or the identification information of the second edge node, so that the client can send the adjusted resource request to the second edge node, and then start from the second edge node. The second edge node obtains the resources requested by the client.

Step 105, when the resource is the second type of resource, the first edge node obtains the resource from the upper node or the source station and returns it to the client.

Specifically, when the first edge node determines that the resource is the second type of resource, that is, in this embodiment, when the resource requested by the client is a resource with high access popularity, the first edge node obtains the resource from the upper-layer node by , when the upper-layer node does not have the resource, or there is no upper-layer node, the first edge node obtains the resource to the client through back-to-source.

In an embodiment of the present disclosure, in step 102, before the first edge node determines the type of the resource, the method further includes: the first edge node determines whether its own load is greater than or equal to a second preset threshold; if the determination is yes , the first edge node determines that there is a third edge node of the resource requested by the resource request in its area according to the resource identifier of the resource request, and returns the second response message of the resource request to the client, so that the client sends the third edge node to the third edge node. Send the adjusted resource request; if the judgment is no, the first edge node further judges the resource type.

When the load of the first edge node is greater than or equal to the second preset threshold, it indicates that the load of the first edge node is large and cannot quickly respond to the resource request sent by the client. In order to improve user access experience and achieve the purpose of quickly responding to resource requests , the first edge node determines that there is a third edge node of the resource requested by the resource request in its area according to the resource identifier of the resource request, and sends a second response message containing the address information of the third edge node to the client, so that the client The adjusted resource request may be sent to the third edge node according to the second response information. When the load of the first edge node itself is less than the second preset threshold, it indicates that the load of the first edge service itself is small and can quickly respond to the user's resource request, and then the first edge node continues to judge the resource type of the resource.

In an embodiment of the present disclosure, in step 103, the first edge node determines the type of the resource by counting the number of accesses to the resource within a preset time, wherein the number of accesses to the resource within the preset time includes: : the number of times the resource is accessed on the first edge node within the preset time, and/or the total number of times the resource is accessed on the edge node group in the area where the client is located within the preset time, as follows:

Manner 1: Obtain the resource identifier in the resource request; according to the resource identifier, determine the total number of accesses to the resource on the first edge node within a preset time;

Method 2: Determine the region to which the client belongs and the resource identifier in the resource request, and obtain the edge node group corresponding to the region to which the client belongs based on the region to which the client belongs; and obtain the total amount of resources on the edge node group within a preset time according to the resource identifier. The number of visits, where the total number of visits is the sum of the times of visits to resources on each edge node in the edge node group within a preset time.

In practical applications, the edge node can determine the resource requested by the user according to the resource identifier in the resource request, and then can obtain all resource requests for the resource. It should be noted that each edge node in each area can be locally The access times of the resource are counted according to a preset collection period (for example, 1 minute), and further, the respective access times are uploaded to the scheduling center node, or the scheduling center node obtains from each edge node regularly.

In mode 1, when the first edge node receives the resource request from the user, it can locally count the total number of accesses to the resource within a preset time, for example, it can count the total number of accesses to the resource by the first edge node within 5 minutes. The number of visits. The preset time can be the first 5 minutes, the first 10 minutes, etc., ending at the current moment when the user resource request is received. The collection period and the duration of the preset time are not specifically limited here.

It should be noted that, in the second method, the first edge node obtains the client identifier of the resource request, determines the area to which the client belongs by using the client identifier, and then obtains the edge node group corresponding to the area to which the client belongs. In practical applications, the first edge node can query the edge node group corresponding to the area to which the client belongs according to the client identifier or information about the area to which the client belongs.

Specifically, the first edge node can obtain the total access times of the resource by the edge node group through statistics by itself, or directly obtain from the scheduling center node.

Specifically, the scheduling center node obtains the number of accesses to the resource in each edge node, and the scheduling center node counts the number of accesses to the resource by all edge nodes in each area according to a preset statistical period (for example, 1 minute), and then according to The preset synchronization period (for example, 1 minute) synchronizes the access times of all edge nodes to the resource to each edge node in the corresponding area. The first edge node only needs to summarize the access times synchronized by the scheduling center node, that is, through the first An edge node locally counts the total access times of the edge node group to the resource within a preset time, for example, summing the access times of each edge node in the edge node group to the resource within 5 minutes, so that the edge node can pass its own The total number of visits to the resource by the edge node group is obtained by statistics.

It should be noted that the scheduling center node obtains the number of accesses to the resource in each edge node, and can count the number of accesses to the resource by all edge nodes in each area according to a preset statistical period (for example, 1 minute), and report to the corresponding All edge nodes in the region synchronize data. In addition, instead of synchronizing data to each edge node in the corresponding area, the edge node directly sends query information to obtain the total number of accesses to the resource by the edge node group to the scheduling center node, and the query information at least includes the duration of the preset time, the client The identifier (or the area to which the client belongs) and the resource identifier. The dispatch center node determines the edge node group corresponding to the area to which the client belongs according to the client identifier (or the area to which the client belongs) in the query information, and counts the edge node group within a preset time. The sum of the access times of each edge node to the resource is sent to the edge node, so that the edge node can obtain the total access times of the resource by the edge node group from the scheduling center node.

The preset time may be the first 5 minutes, the first 10 minutes, etc., ending at the current moment when the user resource request is received, and the duration of the statistical period, the synchronization period, and the preset time is not specifically limited here.

Specifically, in an embodiment of the present disclosure, in step 104, the first edge node determines the second edge node, including: the first edge node determines the resource identifier according to the resource request; the first edge node matches the resource identifier The first edge node calculates the hash value of all or part of the edge nodes in the area where the first edge node is located, and assigns each edge The hash value of the node is allocated on the consistent hash ring; the first edge node determines the corresponding second edge node on the consistent hash ring according to the hash value of the resource.

It should be noted that the first edge node can obtain the resource identifier in the resource request, and the resource identifier can be a uniform resource locator URL or a domain name. According to the resource identifier, the hash value corresponding to the resource identifier is calculated by a consistent hash algorithm. , that is, the hash value corresponding to the resource. For different resource identifiers, different hash values can usually be calculated. Therefore, there can be a one-to-one correspondence between resource identifiers and hash values. Or the hash value of the IP address of some edge nodes, calculate the hash value corresponding to each edge node, that is, the hash value of each edge node, and assign the hash value of each edge node on the consistent hash ring; On the consistent hash ring, starting from the location of the hash value of the resource, search along the preset direction to find the location corresponding to the hash value of the IP address of each edge node, and use the hash value of the IP address of the first edge node to be searched. The edge node represented at the location is determined to be the second edge node. In this embodiment, the resource request on the edge node can be more concentrated through the consistent hashing algorithm. The client sends the adjusted resource request to the second edge node determined according to the resource identifier, and when the second edge node has resources, returns the resources to the client; when the second edge node does not have resources, sends the resource to the upper node or The origin site obtains resources.

In an embodiment of the present disclosure, by locating the second edge node through a consistent hash algorithm, it can be ensured that the same first type resource can be accessed to the second edge node every time the resource is accessed, so that the resource is on the edge The high hit rate of the node effectively reduces the back-to-source rate and makes the access of edge nodes more concentrated, which not only reduces the bandwidth for returning to the parent, but also provides a better user experience.

In an embodiment of the present disclosure, after the first edge node determines the second edge node, the first edge node may also record the second edge node, when a resource request for accessing the same resource is received again and the resource is the first edge node In the case of one type of resource, the first edge node may directly return to the client a response message containing the recorded address information of the second edge node according to the recorded information. By recording the message of the second edge node, the time for determining the second edge node can be omitted, and the efficiency of the client in obtaining the requested resource can be improved.

Specifically, in an embodiment of the present disclosure, in step 104, the first edge node returns a first response message of the resource request to the client, including: obtaining the resource identifier in the resource request and the address information of the second edge node ; The first edge node generates a first response message for the resource request according to the resource identifier and address information, and returns the first response message to the client.

In practical applications, when the first edge node determines that the resource requested by the user is the first type of resource, it can construct a first response message according to the obtained uniform resource locator URL and the address information of the second edge node. The first edge node Send the first response message to the client, so that the client sends the adjusted resource request to the second edge node after receiving the first response message, so that the client can obtain the resource requested by the user through the second edge node , the address information of the second edge node may be the IP address of the second edge node, wherein the first response message may carry the HTTP status code 30X, when the status code is 30X, it indicates that the client is instructed to resend a request, and the first response message may carry the HTTP status code 30X. The edge node sends a response header Location, specifying the URL address of the new request.

The second edge node and the first edge node belong to the same logical area, which may be, for example, a geographic area or an operator.

In an embodiment of the present disclosure, the first edge node receives the resource request from the client, and when judging that the resource requested by the user does not exist (misses) in the first edge node, according to the resource request, determine the resource type of the resource requested by the user, when it is determined that the resource requested by the user is the first type of resource, determine the second edge node according to the resource identifier of the resource, and then send a response message to the client for the resource request, and the client sends a response message to the client according to the response message. The second edge node sends the adjusted resource request, so that the client can obtain the resource requested by the user through the second edge node in the same geographical area, which can realize that when the resource requested by the user belongs to the access heat in the first edge node When the first type resource is low, it instructs the client to send the adjusted resource request to other edge nodes that are most likely to have the resources requested by the user, which reduces the cost of returning to the parent and improves the hit rate of cold resources on edge nodes. It reduces the access delay caused by the internal bandwidth consumption and the performance of the parent node, and at the same time, enables the resources in the edge nodes that belong to the same area as the first edge node to be accessed, and improves the utilization rate of resources in other edge nodes in the same area. access rate.

In an embodiment of the present disclosure, in step 104, the first edge node determines the second edge node, which further includes determining the second edge node according to the load situation of each edge node in the edge node group where the first edge node is located . The first edge node selects the edge node with lower load according to the load situation of each edge node in the edge node group, and determines it as the second edge node, and the first edge node sends the response information carrying the address information of the second edge node to the client , the client sends a resource request according to the address information of the second edge node, the first edge node can quickly respond to the user's resource request by screening the second edge node with lower load, improve the response speed and success rate of the user's request for resources, and improve the User experience. When the selected edge node with lower load does not have the resource, the second edge node obtains the resource by returning to the upper-layer node or the source station, and sends it to the client. In this embodiment, the edge node can also judge the bandwidth of the machine, CPU, IO, packet loss rate and other quality data instead of the load to judge and screen the target edge node.

In an embodiment of the present disclosure, the first response message is used to instruct the client to send the adjusted resource request to the second edge node, so that the second edge node returns the resource requested by the adjusted resource request to the client. That is, after the client sends the adjusted resource request to the second edge node according to the first response message, the client receives the resource requested by the adjusted resource request returned by the second edge node, and the resource is the resource after distance adjustment The resource that requests the starting position of the key frame position that reaches the second edge node with the closest system time. In the live broadcast scenario, after the host starts the live broadcast, the host will push the live video data to the edge node in real time. When the user's resource request reaches the second edge node, in order to ensure that the user can accurately obtain the corresponding information when the request arrives Time video resources, the second edge node will push the key frame position closest to the system time when the resource request reaches the second edge node as the resource at the starting position to the client, so that the user can watch the clear live streaming content in time. Does not produce blur and freeze.

According to a large amount of experimental data, it is concluded that the method provided by the embodiments of the present disclosure is used to perform resource requests, so that the probability of the edge node being missed is low. For the same first type resource, in N regions, the first edge When the node is not hit, the first edge node will return to the parent or the source N times at most, effectively reducing the bandwidth of returning to the parent or the source by 15-20%. Moreover, the processing method of different resource type requests is determined by judging and deciding on the edge node. Reallocating and adjusting edge nodes that process requests can also greatly improve the utilization efficiency of CDN edge nodes.

FIG. 2 exemplarily shows a block diagram of an apparatus for resource request processing according to the present disclosure.

As shown in FIG. 2, an apparatus for processing a resource request is provided, which is applied to a first edge node of a content distribution network, and the apparatus includes:

The receiving module 201 is configured to receive the resource request of the client;

The judging module 202 is configured to judge whether the resource requested by the resource request exists in the first edge node; when the resource does not exist, the judging module 202 judges the type of the resource;

The determining module 203 is configured to determine the second edge node when the determining module 202 determines that the resource is the first type of resource;

The response module 204 is configured to, when the determination module 202 determines that the resource is the first type of resource, the response module 204 returns a first response message of the resource request to the client, and the first response message is set to instruct the client to send the adjustment to the second edge node The subsequent resource request, wherein the first response message that the response module 204 returns to the client for the resource request includes the address information of the second edge node;

The response module 204 is further configured to, when the determination module 202 determines that the resource is the second type of resource, the response module 204 obtains the resource from the upper-layer node or the source station and returns it to the client.

Wherein, the judging module 202 is specifically set as:

When the number of times the resource is accessed within the preset time is less than the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is of the first type;

When the number of accesses to the resource within the preset time is greater than or equal to the first preset threshold corresponding to the address information included in the resource request, the resource is determined to be of the second type.

The number of accesses to the resource within the preset time period includes:

The number of times the resource is accessed at the first edge node within the preset time, and/or the total number of times the resource is accessed by the edge node group in the area where the client is located within the preset time.

The first preset threshold is set according to the historical access situation of the address information included in the resource request on the first edge node, and/or according to the address included in the resource request on the edge node group in the area where the client is located Set the historical access to information.

Wherein, the determining module 203 is also set to:

The determining module 203 determines the resource identifier according to the resource request;

The determination module 203 performs consistent hash calculation on the resource identifier, and generates a hash value of the resource, wherein the resource identifier includes a uniform resource locator or a domain name;

The determination module 203 calculates the hash values of all or part of the edge nodes in the area where the first edge node is located, and allocates the hash values of each edge node on the consistent hash ring;

The determining module 203 determines the corresponding second edge node on the consistent hash ring according to the hash value of the resource.

Wherein, the response module 204 is also set to:

The response module 204 records the second edge node, and when the resource request for accessing the same resource is received again and the resource is the first type of resource, the response module 204 returns the first response message of the resource request to the client including the recorded second edge node. Address information.

Wherein, the determining module 203 is also set to:

The determining module 203 determines the second edge node according to the load situation of each edge node in the edge node group where the first edge node is located.

Wherein, the judging module 202 is also set to:

The judgment module 202 judges whether the load of the first edge node is greater than or equal to the second preset threshold;

If the judgment is no, the judgment module 202 judges the resource type of the resource.

Wherein, if the judgment module 202 judges to be yes,

The determining module 203 is further configured to determine the third edge node;

The response module 204 is further configured to, when the judgment module 202 judges as yes, the response module 204 returns a second response message of the resource request to the client; the second response message is used to instruct the client to send the adjusted resource to the third edge node ask.

Wherein, the response module 204 is set to,

When the determination module 202 determines that the resource exists in the first edge node, the response module 204 directly returns the resource to the client.

The first response message is used to instruct the client to send the adjusted resource request to the second edge node, so that the second edge node returns the resource requested by the adjusted resource request to the client, and the resource is the resource after distance adjustment The resource that requests the starting position of the key frame position that reaches the second edge node with the closest system time.

An embodiment of the present disclosure provides a computer device, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the executable instructions in the memory to implement the above method for processing a resource request.

FIG. 3 is a block diagram of a computer device 300 for a method for processing a resource request according to an exemplary embodiment. For example, computer device 300 may be provided as a server. Referring to FIG. 3 , the computer device 300 includes a processor 301, and the number of the processors can be set to one or more as required. Computer device 300 also has memory 302 for storing instructions executable by processor 301, such as application programs. The number of memories can be set to one or more as required. It can store one or more applications. The processor 301 is configured to execute instructions to perform the steps of the above-mentioned resource request processing method.

Embodiments of the present disclosure also provide a non-transitory computer-readable storage medium including instructions, on which executable instructions are stored, and when the executable instructions are executed by a processor, the above-mentioned method for processing a resource request is implemented. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

As will be appreciated by those skilled in the art, embodiments of the present disclosure may be provided as a method, an apparatus (apparatus), or a computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied therein. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data , including but not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices, or may be used for Any other medium that stores desired information and can be accessed by a computer, etc. In addition, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and can include any information delivery media, as is well known to those of ordinary skill in the art .

The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (apparatus) and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The means implements the functions specified in one or more of the flowcharts and/or one or more blocks of the block diagrams

These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

In this disclosure, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that an article or device comprising a list of elements includes not only those elements, but also elements not expressly listed. other elements, or elements inherent to the article or equipment. Without further limitation, an element defined by the phrase "comprising" does not preclude the presence of additional identical elements in the article or device comprising said element.

While the preferred embodiments of the present disclosure have been described, additional changes and modifications to these embodiments may occur to those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiment and all changes and modifications that fall within the scope of the present disclosure.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present disclosure without departing from the spirit and scope of the present disclosure. Thus, provided that these modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and their equivalents, the present disclosure is intended to include such modifications and variations as well.

Industrial Applicability

In the present disclosure, using the resource request processing method of the present disclosure can improve the hit rate of resource requests at edge nodes, effectively reduce the cost of returning to the parent, reduce the internal consumption bandwidth, and improve the utilization efficiency of CDN edge nodes.

Claims (24)

1. A method for processing a resource request, applied to a first edge node of a content distribution network, the method comprising:

   The first edge node receives the resource request from the client;

   The first edge node judges whether the resource requested by the resource request exists in the first edge node;

   When the resource does not exist, the first edge node judges the type of the resource;

   When the resource is the first type of resource, the first edge node determines a second edge node, the first edge node returns a first response message for the resource request to the client, the first edge node The response message is used to instruct the client to send the adjusted resource request to the second edge node, wherein the first response message returned by the first edge node to the client for the resource request includes the first response message. address information of the second edge node;

   When the resource is of the second type, the first edge node acquires the resource from an upper node or an origin station and returns it to the client.
2. The method of claim 1, wherein the first edge node determines the type of the resource, comprising:

   When the access times of the resource within a preset time is less than the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is a first type of resource;

   When the number of times of accessing the resource within a preset time is greater than or equal to the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is of the second type.
3. The method of claim 2, wherein the number of times of accessing the resource within the preset time comprises:

   The access times of the resource at the first edge node within the preset time, and/or the total access times of the resource in the edge node group in the area where the client is located within the preset time.
4. The method according to claim 2, wherein the first preset threshold is set according to historical access conditions of the address information included in the resource request on the first edge node, and/or according to the region where the client is located The historical access situation of the address information included in the resource request is set on the edge node group within the resource request.
5. The method of claim 1, wherein the first edge node determines the second edge node, comprising:

   determining, by the first edge node, a resource identifier according to the resource request;

   The first edge node performs consistent hash calculation on the resource identifier to generate a hash value of the resource, where the resource identifier includes a uniform resource locator or a domain name;

   The first edge node calculates the hash value of all or part of the edge nodes in the area where the first edge node is located, and allocates the hash value of each edge node on the consistent hash ring;

   The first edge node determines the corresponding second edge node on a consistent hash ring according to the hash value of the resource.
6. The method of claim 1, wherein after the second edge node is determined by the first edge node, the method further comprises:

   The first edge node records the second edge node, and when the resource request for accessing the same resource is received again and the resource is of the first type, the first edge node returns the information to the client. The first response message of the resource request includes the recorded address information of the second edge node.
7. The method of claim 1, wherein the first edge node determines the second edge node, further comprising:

   The second edge node is determined according to the load situation of each edge node in the edge node group where the first edge node is located.
8. The method according to claim 1, wherein before the first edge node judges the type of the resource, the method further comprises:

   The first edge node determines whether its own load is greater than or equal to a second preset threshold;

   If the judgment is no, the first edge node judges the resource type of the resource.
9. The method of claim 8, further comprising:

   If the judgment is yes, the first edge node determines a third edge node, and the first edge node returns a second response message for the resource request to the client;

   The second response message is used to instruct the client to send the adjusted resource request to the third edge node.
10. The method of claim 1, further comprising:

    When it is determined that the resource exists in the first edge node, the resource is directly returned to the client.
11. The method of claim 1, wherein the first response message is used to instruct the client to send an adjusted resource request to the second edge node, so that the second edge node sends the client The terminal returns the resource requested by the adjusted resource request, where the resource is the resource whose starting position is the key frame position closest to the system time at which the adjusted resource request arrives at the second edge node.
12. An apparatus for processing a resource request, applied to a first edge node of a content distribution network, the apparatus comprising:

    The receiving module is set to receive the resource request of the client;

    a judgment module, configured to judge whether the resource requested by the resource request exists in the first edge node; when the resource does not exist, the judgment module judges the type of the resource;

    a determining module, configured to determine the second edge node by the determining module when the determining module determines that the resource is the first type of resource;

    A response module, configured to return a first response message of the resource request to the client when the determination module determines that the resource is a first type resource, where the first response message is used to indicate The client sends the adjusted resource request to the second edge node, wherein the first response message that the response module returns to the client for the resource request includes address information of the second edge node;

    The response module is further configured to, when the judgment module judges that the resource is a resource of the second type, the response module obtains the resource from the upper-layer node or the source station and returns it to the client.
13. The device according to claim 12, wherein the judging module is specifically set as:

    When the access times of the resource within a preset time is less than the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is a first type of resource;

    When the number of times of accessing the resource within a preset time is greater than or equal to the first preset threshold corresponding to the address information included in the resource request, it is determined that the resource is of the second type.
14. The apparatus of claim 13, wherein the number of times of accessing the resource within the preset time comprises:

    The access times of the resource at the first edge node within the preset time, and/or the total access times of the resource in the edge node group in the area where the client is located within the preset time.
15. The apparatus according to claim 14, wherein the first preset threshold is set according to historical access conditions of the address information included in the resource request on the first edge node, and/or according to the region where the client is located The historical access situation of the address information included in the resource request is set on the edge node group within the resource request.
16. The apparatus of claim 12, wherein the determining module is further configured to:

    The determining module determines a resource identifier according to the resource request;

    The determining module performs consistent hash calculation on the resource identifier to generate a hash value of the resource, wherein the resource identifier includes a uniform resource locator or a domain name;

    The determining module calculates the hash value of all or part of the edge nodes in the area where the first edge node is located, and assigns the hash value of each edge node on the consistent hash ring;

    The determining module determines the corresponding second edge node on a consistent hash ring according to the hash value of the resource.
17. The apparatus of claim 12, wherein the response module is further configured to:

    The response module records the second edge node, and when the resource request for accessing the same resource is received again and the resource is of the first type, the response module returns the resource request to the client. The first response message includes the recorded address information of the second edge node.
18. The apparatus of claim 12, wherein the determining module is further configured to:

    The determining module determines the second edge node according to the load situation of each edge node in the edge node group where the first edge node is located.
19. The device of claim 12, wherein the judgment module is further configured to:

    The judgment module judges whether the load of the first edge node is greater than or equal to a second preset threshold;

    If the judgment is no, the judgment module judges the resource type of the resource.
20. The device according to claim 19, wherein, if the judgment module judges yes,

    The determining module is further configured to determine a third edge node;

    The response module is further configured to, when the judgment module judges yes, the response module returns a second response message of the resource request to the client; the second response message is used to indicate the client The terminal sends the adjusted resource request to the third edge node.
21. The apparatus of claim 12, wherein the response module is configured to,

    When the judgment module judges that the resource exists in the first edge node, the response module directly returns the resource to the client.
22. The apparatus of claim 12, wherein the first response message is used to instruct the client to send an adjusted resource request to the second edge node, so that the second edge node sends an adjusted resource request to the client The terminal returns the resource requested by the adjusted resource request, where the resource is the resource whose starting position is the key frame position closest to the system time at which the adjusted resource request arrives at the second edge node.
23. A computer device comprising a processor, a memory and a computer program stored on the memory, wherein the processor implements the steps of the method according to any one of claims 1-11 when the processor executes the computer program.
24. A computer-readable storage medium having executable instructions stored thereon, wherein the executable instructions, when executed by a processor, implement the steps of the method according to any one of claims 1-11.

Images