CN104702625A - Method and device for scheduling access request in CDN (Content Delivery Network) - Google Patents
Method and device for scheduling access request in CDN (Content Delivery Network) Download PDFInfo
- Publication number
- CN104702625A CN104702625A CN201510148470.7A CN201510148470A CN104702625A CN 104702625 A CN104702625 A CN 104702625A CN 201510148470 A CN201510148470 A CN 201510148470A CN 104702625 A CN104702625 A CN 104702625A
- Authority
- CN
- China
- Prior art keywords
- rank
- data
- idc node
- temperature rank
- temperature
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses a method and a device for scheduling an access request in CDN (Content Delivery Network). The method is that all IDC nodes in the CDN are pre-divided into at least two storage levels according to the storage capacity; the IDC nodes at different storage levels are respectively used for responding to the access request of data at different hot levels. The method comprises the steps of receiving the access request of a user to target data; determining the hot level of the target data according to the pre-counted data information at each hot level; further determining a set of the IDC nodes at the storage level corresponding to the hot level; selecting one IDC node to respond to the access request from the determined set. According to the technical scheme, the method has the advantages that the data in the IDC nodes are avoided frequent updating, and the use experience of a user can be increased.
Description
Technical field
The present invention relates to Internet technical field, particularly access request dispatching method and device in a kind of CDN.
Background technology
Along with the fast development of Internet technology, a lot of large-scale website tends to use CDN technology to carry out the distribution of web site contents.CDN, full name is Content Distribution Network, i.e. content distributing network.CDN comprises multiple IDC (Internet Data Center, Internet data center) node and dispatch server, and each IDC node comprises multiple data cache server, stores the data through website distribution in data cache server.When user has the demand of access websites data, through the scheduling of dispatch server, can directly communicate with the IDC node communicating with cost less, data needed for acquisition, alleviate network congestion problems, improve the accelerating website access of user, promote Consumer's Experience.
Existing a kind of access request dispatching method is, dispatch server receives the access request of user, the name feature of the data of accessing is needed according to user, the possible memory location of calculated data, namely determine the IDC node of the access request responding user, the access request of user is dispatched in determined IDC node.
In actual applications, the process of the access request of dispatch server determined IDC node response user has two kinds of situations, a kind of situation is, in this node, store the data that user needs to access, directly these data can be returned to user, another kind of situation is, the data that user needs to access are not stored in this node, need Hui Yuan to the overall storage server of website, acquisition user preserves in this locality and returns to user after needing the data of accessing.That is, the data that the access request of IDC node response user returns to user all need to store in this locality.But because the storage capacity of IDC node is limited, constantly respond in the storage resource request process of user at it, if the data wherein stored reach the upper limit of its storage capacity, the data to it stores are needed to upgrade, namely long-time not accessed data are deleted, store the data that new access request is corresponding.By existing this dispatching method, probably the access request of data lower for a lot of access frequency is dispatched in the less IDC node of storage capacity, the data stored in this IDC node are made to be easy to reach the upper limit of its storage capacity, cause stored data frequent updating, increase back source flux expense, and the process of Hui Yuan adds the time delay of response user request, affects the experience of user.
Summary of the invention
For solving the problem, the embodiment of the invention discloses access request dispatching method and device in a kind of CDN.Technical scheme is as follows:
Access request dispatching method in a kind of CDN, all IDC nodes in described CDN, be divided at least two in advance according to storage capacity and stored rank, different other IDC node of storage level is respectively used to respond the access request for the data of different temperature rank, and, rank A and B is stored for any two, if the storage capacity that storage rank is the IDC node of A is less than store the storage capacity that rank is the IDC node of B, data temperature corresponding to access request that IDC node responds that then to store rank be A is superior to and stores data temperature rank corresponding to access request that IDC node that rank is B responds, described method comprises:
Receive the access request of user for target data;
According to the data message adding up each temperature rank obtained in advance, determine the temperature rank of described target data;
According to the temperature rank of described target data, determine the set with other IDC node of the storage level corresponding with this temperature rank;
According to the communication cost of IDC node each in user and determined set, from determined set, select one for responding the IDC node of described access request.
In a kind of embodiment of the present invention, the quantity of the data of each temperature rank is determined according to the storage capacity with other IDC node of storage level corresponding with each temperature rank.
In a kind of embodiment of the present invention, for the n-th temperature rank, determined the quantity Q of the data of this temperature rank by following formula
n:
Q
n＝C
n*P
n*Q
n/M
n；
Wherein, C
nbe the memory capacity of other IDC node of storage level corresponding to the n-th temperature rank; P
nfor presetting the first parameter value, for characterizing the heap(ed) capacity utilization rate of other IDC node of storage level corresponding to the n-th temperature rank; Q
nfor presetting the second parameter value, for the probability that characterization data is accessed in other IDC node of storage level that the n-th temperature rank is corresponding; M
nfor the mean value of all size of data.
In a kind of embodiment of the present invention, described access request carries the area information at user place, the described temperature rank according to described target data, determines the set with other IDC node of the storage level corresponding with this temperature rank, comprising:
According to the temperature rank of described target data and the area information at user place, in the IDC node in this region of service, determine the set with other IDC node of the storage level corresponding with this temperature rank.
In a kind of embodiment of the present invention, determined the communication cost of each IDC node in user and determined set by following steps:
According to the range information of IDC node each in user and determined set, use network of network type matching degree information, and in determined set each IDC node load state information in one or more information, determine the communication cost of each IDC node in user and determined set.
Access request dispatching device in a kind of CDN, all IDC nodes in described CDN, be divided at least two in advance according to storage capacity and stored rank, different other IDC node of storage level is respectively used to respond the access request for the data of different temperature rank, and, rank A and B is stored for any two, if the storage capacity that storage rank is the IDC node of A is less than store the storage capacity that rank is the IDC node of B, data temperature corresponding to access request that IDC node responds that then to store rank be A is superior to and stores data temperature rank corresponding to access request that IDC node that rank is B responds, described device comprises:
Access request receiver module, for receiving the access request of user for target data;
Temperature rank determination module, for according to the data message adding up each temperature rank obtained in advance, determines the temperature rank of described target data;
IDC node set determination module, for the temperature rank according to described target data, determines the set with other IDC node of the storage level corresponding with this temperature rank;
IDC sensor selection problem module, for the communication cost according to IDC node each in user and determined set, selects one for responding the IDC node of described access request from determined set.
In a kind of embodiment of the present invention, the quantity of the data of each temperature rank is determined according to the storage capacity with other IDC node of storage level corresponding with each temperature rank.
In a kind of embodiment of the present invention, also comprise quantity determination module:
Described quantity determination module, for for the n-th temperature rank, determines the quantity Q of the data of this temperature rank by following formula
n:
Q
n＝C
n*P
n*Q
n/M
n；
Wherein, C
nbe the memory capacity of other IDC node of storage level corresponding to the n-th temperature rank; P
nfor presetting the first parameter value, for characterizing the heap(ed) capacity utilization rate of other IDC node of storage level corresponding to the n-th temperature rank; Q
nfor presetting the second parameter value, for the probability that characterization data is accessed in other IDC node of storage level that the n-th temperature rank is corresponding; M
nfor the mean value of all size of data.
In a kind of embodiment of the present invention, described IDC node set determination module, specifically for:
According to the temperature rank of described target data and the area information at user place, in the IDC node in this region of service, determine the set with other IDC node of the storage level corresponding with this temperature rank.
In a kind of embodiment of the present invention, also comprise communication cost determination module,
Described communication cost determination module, for the range information according to IDC node each in user and determined set, use network of network type matching degree information, and in determined set each IDC node load state information in one or more information, determine the communication cost of each IDC node in user and determined set.
The technical scheme that the application embodiment of the present invention provides, in advance classification is carried out to the IDC node in CDN, the storage capacity storing the low IDC node of rank is less, for responding the access request for the high data of temperature rank, because the data in website have obvious focus concentration effect, in certain hour section, the temperature rank of data is more stable, allow the access request responding the data for corresponding temperature rank in other IDC set of node of different storage level, the frequent updating of data in IDC node can be reduced, save back source flux expense, reduce the time delay of response user request, promote the experience of user.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is a kind of implementing procedure figure of access request dispatching method in CDN in the embodiment of the present invention;
Fig. 2 is the another kind of implementing procedure figure of access request dispatching method in CDN in the embodiment of the present invention;
Fig. 3 is a kind of structural representation of access request dispatching device in CDN in the embodiment of the present invention.
Embodiment
First in a kind of CDN provided the embodiment of the present invention, the applied environment of access request dispatching method is described.
In CDN, can according to the storage capacity of each IDC node, all IDC nodes are divided in advance at least two and store rank, such as, if the storage capacity of IDC node is higher than a certain predetermined threshold value, then be defined as the first storage rank, if the storage capacity of IDC node is lower than a certain predetermined threshold value, be then defined as the second storage rank, certainly, can be undertaken by operation personnel other division of storage level of IDC node, can also by the storage capacity automatic decision of system according to IDC.
Different other IDC node of storage level is respectively used to respond the access request for the data of different temperature rank, and, rank A and B is stored for any two, if storing rank is that the storage capacity of the IDC node of A is less than and stores the storage capacity that rank is the IDC node of B, then stores data temperature corresponding to access request that IDC node that rank is A responds and be superior to and store data temperature rank corresponding to access request that IDC node that rank is B responds.Store number of levels identical with temperature number of levels.
Under this applied environment, in a kind of CDN that the embodiment of the present invention provides, access request dispatching method can comprise the following steps:
Receive the access request of user for target data;
According to the data message adding up each temperature rank obtained in advance, determine the temperature rank of described target data;
According to the temperature rank of described target data, determine the set with other IDC node of the storage level corresponding with this temperature rank;
According to the communication cost of IDC node each in user and determined set, from determined set, select one for responding the IDC node of described access request.
The executive agent of above-mentioned steps is the dispatch server in CDN.
In actual applications, the frequency difference that different data are accessed within a period of time, corresponding different temperatures, has different temperature ranks.By statistical history visit data in advance, the data message of each temperature rank can be obtained, and according to this information, the temperature rank of target data can be determined.Because other IDC node of different storage level is for responding the access request of the data for different temperature rank, so according to the temperature rank of target data, the set with other IDC node of the storage level corresponding with this temperature rank can be determined.That is, the IDC node in set has consistent storage rank, and this storage rank is corresponding with this temperature rank, and these IDC nodes all can be used for responding the access request for target data.According to the communication cost of user with each IDC node in set, from set, select one for responding the IDC node of this access request, thus complete the scheduling of access request.
The technical scheme that the application embodiment of the present invention provides, in advance classification is carried out to the IDC node in CDN, the storage capacity storing the low IDC node of rank is less, for responding the access request for the high data of temperature rank, because the data in website have obvious focus concentration effect, in certain hour section, the temperature rank of data is more stable, allow the access request responding the data for corresponding temperature rank in other IDC set of node of different storage level, the frequent updating of data in IDC node can be reduced, save back source flux expense, reduce the time delay of response user request, promote the experience of user.
Technical scheme in the embodiment of the present invention is understood better in order to make those skilled in the art, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Shown in Figure 1, be a kind of implementing procedure figure of access request dispatching method in the CDN that the embodiment of the present invention provides, the method can comprise the following steps:
S110: receive the access request of user for target data;
When user needs the data of accessing certain website, can by the access request of the uniform resource position mark URL transmission of this website for target data, dispatch server receives this access request, determines the target data of the required access of user, continues the operation performing step S120.
S120: according to the data message adding up each temperature rank obtained in advance, determine the temperature rank of described target data;
As previously mentioned, the storage rank of the IDC node in CDN pre-determines, and the storage rank of an IDC node is high, and represent that the storage capacity of this IDC node is large, contrary, the storage rank of an IDC node is low, represents that the storage capacity of this IDC node is little.Different other IDC node of storage level is respectively used to respond the access request for the data of different temperature rank, stores number of levels consistent with temperature number of levels, and the how many individual storage ranks by IDC node division, just have how many temperature ranks accordingly in advance.
The data temperature rank storing access request that the high IDC node of rank responds corresponding is low, and that is, the storage capacity of IDC node is larger, and data temperature rank corresponding to the access request that can respond is lower.Quantity for the higher data of temperature rank can do certain restriction, the access request of the too much data low for temperature rank is avoided to be dispatched in the less IDC node of storage capacity, in a kind of embodiment of the present invention, the quantity of the data of each temperature rank can be determined according to the storage capacity with other IDC node of storage level corresponding with each temperature rank, concrete, for the n-th temperature rank, the quantity Q of the data of this temperature rank can be determined by following formula
n:
Q
n＝C
n*P
n*Q
n/M
n；
Wherein, C
nbe the memory capacity of other IDC node of storage level corresponding to the n-th temperature rank; P
nfor presetting the first parameter value, for characterizing the heap(ed) capacity utilization rate of other IDC node of storage level corresponding to the n-th temperature rank, can be empirical value; Q
nfor presetting the second parameter value, for the probability that characterization data is accessed in other IDC node of storage level that the n-th temperature rank is corresponding, can be empirical value; M
nfor the mean value of all size of data.
Concrete, preset the first parameter value can set based on experience value, as being set to 90%, preset the second parameter value can set based on experience value, as being set to 30%, the mean value of all size of data can be arranged according to actual conditions, and as the video data of video website, mean size can be set to 30MB.The mean value of default first parameter value of different temperature rank, default second parameter value, size of data can be set to identical value or different value according to actual conditions.
In actual applications, dispatch server can comprise scheduling unit and statistic unit, can be performed by scheduling unit the scheduling of the access request of user, history accessing request information is stored in the dispatching log of scheduling unit, can be performed by statistic unit the statistics of the data message of each temperature rank, statistic unit can the dispatching log of real-time collecting scheduling unit, and to the history access request in dispatching log for data add up, the data message of each temperature rank can be obtained, and by this information pushing to scheduling unit.
Statistic unit can have two kinds of modes for the statistics of the data message of each temperature rank:
First kind of way is, statistic unit is every certain cycle, history access request in this cycle is analyzed, according to history access request in this cycle for the visit capacity of data, the temperature of calculated data, thus according to temperature order from high to low, the temperature rank of each data can be determined.Concrete defining method can be determine according to the data proportion of predetermined each temperature rank or quantity.
For convenience of understanding, respectively above-mentioned concrete defining method is illustrated.
Example 1, the temperature rank of each data is determined according to the data proportion of predetermined each temperature rank, suppose to determine to have four temperature ranks according to storage number of levels, after obtaining the temperature of each data, according to temperature order from high to low, determine that the data of the temperature of front 5% are high dsc data, be decided to be the first temperature rank, determine that the data of the temperature of 5% ~ 15% are for time dsc data, be decided to be the second temperature rank, determine that the data of the temperature of 15% ~ 30% are general data, be decided to be the 3rd temperature rank, other data are unexpected winner data, be decided to be the 4th temperature rank.
Example 2, the temperature rank of each data is determined according to the quantity of the data of determined each temperature rank, same hypothesis is determined to have four temperature ranks according to storage number of levels, after obtaining the temperature of each data, according to temperature order from high to low, determine temperature front 10,000 data be high dsc data, be decided to be the first temperature rank, determine that the front data of 10,000 ~ 100,000 are for time dsc data, be decided to be the second temperature rank, determine that the front data of 100,000 ~ 1,000,000 are general data, be decided to be the 3rd temperature rank, other data are unexpected winner data, are decided to be the 4th temperature rank.
The second way is, statistic unit is analyzed the history access request in each cycle in different cycles, according to history access request in each cycle for the visit capacity of data, the temperature of calculated data, thus according to temperature order from high to low, the temperature rank of each data can be determined.Concrete defining method can be determine according to the data proportion of predetermined each temperature rank or quantity.
For convenience of understanding, this mode is illustrated.
Same hypothesis is determined to have four temperature ranks according to storage rank, the corresponding high dsc data of the first temperature rank, the corresponding time dsc data of the second temperature rank, the corresponding general data of the 3rd temperature rank, the corresponding unexpected winner data of the 4th temperature rank.
Within every five minutes, statistics works as the temperature of data in the first five minute, according to temperature in descending order, the temperature rank of the data of preset ratio or quantity is decided to be the first temperature rank, as the temperature rank of the data of front 5% is decided to be the first temperature rank, or the temperature rank of front 10,000 data is decided to be the first temperature rank;
Statistics per hour is when the temperature of data in last hour, according to temperature in descending order, the temperature rank of the data of preset ratio or quantity is decided to be the second temperature rank, as the temperature rank of the data of front 10% is decided to be the second temperature rank, or the temperature rank of front 100,000 data is decided to be the second temperature rank;
Every day, statistics worked as the temperature of data in the previous day, according to temperature in descending order, the temperature rank of the data of preset ratio or quantity is decided to be the 3rd temperature rank, as the temperature rank of the data of front 20% is decided to be the 3rd temperature rank, or the temperature rank of front 1,000,000 data is decided to be the 3rd temperature rank;
The temperature rank of other data is decided to be the 4th temperature rank.
Wherein, if certain data has multiple temperature rank in different measurement period, be then as the criterion with the highest temperature rank.
Be understandable that, use and add up compared with the data message of short period to high temperature rank, high dsc data information can be got in time.
Certainly, the statistics for the data message of each temperature rank is not limited to above two kinds of modes, is also not limited to the said ratio of above citing and numerical value, can carry out according to actual needs adjusting and adding up.
After statistic unit completes statistical work, statistics can be pushed to scheduling unit, with by the data message of scheduling unit according to each temperature rank, determine the temperature rank of target data.Be understandable that, statistic unit carries out the statistics of the data message of each temperature rank according to history access request, it may not be the total data of website, some data may because newly reach the standard grade reason or other reasons, never accessed by the user, if receive the access request for these data, and in the data message of each temperature rank obtained in advance, there is no the information of these data, can directly these data be processed as unexpected winner data, the temperature rank by these data is decided to be minimum temperature rank.In addition, data message for minimum temperature rank can not keep a record, to save the memory space of dispatch server, when receiving the access request for certain data, if these data do not belong to the data of higher thermal degree rank, then the temperature rank of these data can be decided to be minimum temperature rank.
S130: according to the temperature rank of described target data, determines the set with other IDC node of the storage level corresponding with this temperature rank;
Determine the temperature rank of target data in step S120, the set with other IDC node of the storage level corresponding with this temperature rank can be determined further.Such as, the temperature rank of the target data determined is the first temperature rank, the storage rank corresponding with the first temperature rank is the first storage rank, judges that in CDN, which IDC node is the first storage rank, determines the set with other IDC node of the first storage level.
In actual applications, if CDN is placed according to region for the placement of IDC node, other divides IDC node in each region can be carried out respectively storage level, when receiving the access request of user, when carrying the area information at user place in access request, according to the region at user place, in the IDC node in this region of service, the set with other IDC node of the storage level corresponding with the temperature rank of target data can be determined.Such process can reduce the response delay of IDC node to user access request.
S140: according to the communication cost of IDC node each in user and determined set, selects one for responding the IDC node of described access request from determined set.
Be understandable that, the distance of user and IDC node, the network of network type used, or the factors such as the load condition of IDC node, all may affect the experience of user, so in a kind of embodiment of the present invention, can according to the range information of IDC node each in user and determined set, use network of network type matching degree information, and in determined set each IDC node load state information in one or more information, determine the communication cost of each IDC node in user and determined set.
Certainly, IDC node comprises multiple data cache server, when determining certain IDC node for responding the access request of user, can further according to certain algorithm, as hash algorithm, by information such as data names, from this IDC node, select a data cache server, and the IP address of this data cache server is returned to user, set up the communication connection of user and data cache server.
In the CDN provide the embodiment of the present invention, the flow process of access request dispatching method carries out whole description, shown in Figure 2:
Supposing that the temperature rank of high dsc data is the first temperature rank, is the second temperature rank compared with the temperature rank of dsc data, and the temperature rank of general data is the 3rd temperature rank, and the temperature rank of unexpected winner data is the 4th temperature rank.
Step S201, receives the access request of user for target data.
Step S202, determines the temperature rank of target data:
If target data is high dsc data, then forward step S203 to, and then forward step S207 to;
If target data is comparatively dsc data, then forwards step S204 to, and then forward step S208 to;
If target data is general data, then forward step S205 to, and then forward step S209 to;
If target data is unexpected winner data, then forward step S206 to, and then forward step S210 to.
S211, determines data cache server from corresponding IDC node.
Wherein, the IDC of HC shown in Fig. 2 represents other IDC node of the first storage level that the first temperature rank is corresponding, TC IDC represents other IDC node of the second storage level that the second temperature rank is corresponding, LC IDC represents that other IDC node of the 3rd storage level that the 3rd temperature rank is corresponding, GC IDC represent other IDC node of the 4th storage level that the 4th temperature rank is corresponding.
The technical scheme that the application embodiment of the present invention provides, in advance classification is carried out to the IDC node in CDN, the storage capacity storing the low IDC node of rank is less, for responding the access request for the high data of temperature rank, because the data in website have obvious focus concentration effect, in certain hour section, the temperature rank of data is more stable, allow the access request responding the data for corresponding temperature rank in other IDC set of node of different storage level, the frequent updating of data in IDC node can be reduced, save back source flux expense, reduce the time delay of response user request, promote the experience of user.
Corresponding to embodiment of the method above, the embodiment of the present invention additionally provides access request dispatching device in a kind of CDN, the application scenarios of this device is: all IDC nodes in described CDN, be divided at least two in advance according to storage capacity and stored rank, different other IDC node of storage level is respectively used to respond the access request for the data of different temperature rank, and, rank A and B is stored for any two, if the storage capacity that storage rank is the IDC node of A is less than store the storage capacity that rank is the IDC node of B, data temperature corresponding to access request that IDC node responds that then to store rank be A is superior to and stores data temperature rank corresponding to access request that IDC node that rank is B responds.
Shown in Figure 3, this device can comprise with lower module:
Access request receiver module 310, for receiving the access request of user for target data;
Temperature rank determination module 320, for according to the data message adding up each temperature rank obtained in advance, determines the temperature rank of described target data;
IDC node set determination module 330, for the temperature rank according to described target data, determines the set with other IDC node of the storage level corresponding with this temperature rank;
IDC sensor selection problem module 340, for the communication cost according to IDC node each in user and determined set, selects one for responding the IDC node of described access request from determined set.
In a kind of embodiment of the present invention, the quantity of the data of each temperature rank is determined according to the storage capacity with other IDC node of storage level corresponding with each temperature rank.
In a kind of embodiment of the present invention, quantity determination module can also be comprised:
Described quantity determination module, for for the n-th temperature rank, determines the quantity Q of the data of this temperature rank by following formula
n:
Q
n＝C
n*P
n*Q
n/M
n；
Wherein, C
nbe the memory capacity of other IDC node of storage level corresponding to the n-th temperature rank; P
nfor presetting the first parameter value, for characterizing the heap(ed) capacity utilization rate of other IDC node of storage level corresponding to the n-th temperature rank; Q
nfor presetting the second parameter value, for the probability that characterization data is accessed in other IDC node of storage level that the n-th temperature rank is corresponding; M
nfor the mean value of all size of data.
In a kind of embodiment of the present invention, described IDC node set determination module 330, specifically for:
According to the temperature rank of described target data and the area information at user place, in the IDC node in this region of service, determine the set with other IDC node of the storage level corresponding with this temperature rank.
In a kind of embodiment of the present invention, communication cost determination module can also be comprised:
Described communication cost determination module, for the range information according to IDC node each in user and determined set, use network of network type matching degree information, and in determined set each IDC node load state information in one or more information, determine the communication cost of each IDC node in user and determined set.
The device that the application embodiment of the present invention provides, in advance classification is carried out to the IDC node in CDN, the storage capacity storing the low IDC node of rank is less, for responding the access request for the high data of temperature rank, because the data in website have obvious focus concentration effect, in certain hour section, the temperature rank of data is more stable, allow the access request responding the data for corresponding temperature rank in other IDC set of node of different storage level, the frequent updating of data in IDC node can be reduced, save back source flux expense, reduce the time delay of response user request, promote the experience of user.
It should be noted that, in this article, the such as relational terms of first and second grades and so on is only used for an entity or operation to separate with another entity or operating space, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment comprising described key element and also there is other identical element.
Each embodiment in this specification all adopts relevant mode to describe, between each embodiment identical similar part mutually see, what each embodiment stressed is the difference with other embodiments.Especially, for device embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.
One of ordinary skill in the art will appreciate that all or part of step realized in said method execution mode is that the hardware that can carry out instruction relevant by program has come, described program can be stored in computer read/write memory medium, here the alleged storage medium obtained, as: ROM/RAM, magnetic disc, CD etc.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.All any amendments done within the spirit and principles in the present invention, equivalent replacement, improvement etc., be all included in protection scope of the present invention.
Claims (10)
1. access request dispatching method in a CDN, it is characterized in that, all IDC nodes in described CDN, be divided at least two in advance according to storage capacity and stored rank, different other IDC node of storage level is respectively used to respond the access request for the data of different temperature rank, and, rank A and B is stored for any two, if the storage capacity that storage rank is the IDC node of A is less than store the storage capacity that rank is the IDC node of B, data temperature corresponding to access request that IDC node responds that then to store rank be A is superior to and stores data temperature rank corresponding to access request that IDC node that rank is B responds, described method comprises:
Receive the access request of user for target data;
According to the data message adding up each temperature rank obtained in advance, determine the temperature rank of described target data;
According to the temperature rank of described target data, determine the set with other IDC node of the storage level corresponding with this temperature rank;
According to the communication cost of IDC node each in user and determined set, from determined set, select one for responding the IDC node of described access request.
2. method according to claim 1, is characterized in that, the quantity of the data of each temperature rank is determined according to the storage capacity with other IDC node of storage level corresponding with each temperature rank.
3. method according to claim 2, is characterized in that, for the n-th temperature rank, is determined the quantity Q of the data of this temperature rank by following formula
n:
Q
n＝C
n*P
n*Q
n/M
n；
Wherein, C
nbe the memory capacity of other IDC node of storage level corresponding to the n-th temperature rank; P
nfor presetting the first parameter value, for characterizing the heap(ed) capacity utilization rate of other IDC node of storage level corresponding to the n-th temperature rank; Q
nfor presetting the second parameter value, for the probability that characterization data is accessed in other IDC node of storage level that the n-th temperature rank is corresponding; M
nfor the mean value of all size of data.
4. method according to claim 1, it is characterized in that, described access request carries the area information at user place, the described temperature rank according to described target data, determine the set with other IDC node of the storage level corresponding with this temperature rank, comprising:
According to the temperature rank of described target data and the area information at user place, in the IDC node in this region of service, determine the set with other IDC node of the storage level corresponding with this temperature rank.
5. the method according to any one of Claims 1-4, is characterized in that, is determined the communication cost of each IDC node in user and determined set by following steps:
According to the range information of IDC node each in user and determined set, use network of network type matching degree information, and in determined set each IDC node load state information in one or more information, determine the communication cost of each IDC node in user and determined set.
6. access request dispatching device in a CDN, it is characterized in that, all IDC nodes in described CDN, be divided at least two in advance according to storage capacity and stored rank, different other IDC node of storage level is respectively used to respond the access request for the data of different temperature rank, and, rank A and B is stored for any two, if the storage capacity that storage rank is the IDC node of A is less than store the storage capacity that rank is the IDC node of B, data temperature corresponding to access request that IDC node responds that then to store rank be A is superior to and stores data temperature rank corresponding to access request that IDC node that rank is B responds, described device comprises:
Access request receiver module, for receiving the access request of user for target data;
Temperature rank determination module, for according to the data message adding up each temperature rank obtained in advance, determines the temperature rank of described target data;
IDC node set determination module, for the temperature rank according to described target data, determines the set with other IDC node of the storage level corresponding with this temperature rank;
IDC sensor selection problem module, for the communication cost according to IDC node each in user and determined set, selects one for responding the IDC node of described access request from determined set.
7. device according to claim 6, is characterized in that, the quantity of the data of each temperature rank is determined according to the storage capacity with other IDC node of storage level corresponding with each temperature rank.
8. device according to claim 7, is characterized in that, also comprises quantity determination module:
Described quantity determination module, for for the n-th temperature rank, determines the quantity Q of the data of this temperature rank by following formula
n:
Q
n＝C
n*P
n*Q
n/M
n；
Wherein, C
nbe the memory capacity of other IDC node of storage level corresponding to the n-th temperature rank; P
nfor presetting the first parameter value, for characterizing the heap(ed) capacity utilization rate of other IDC node of storage level corresponding to the n-th temperature rank; Q
nfor presetting the second parameter value, for the probability that characterization data is accessed in other IDC node of storage level that the n-th temperature rank is corresponding; M
nfor the mean value of all size of data.
9. device according to claim 6, is characterized in that, described IDC node set determination module, specifically for:
According to the temperature rank of described target data and the area information at user place, in the IDC node in this region of service, determine the set with other IDC node of the storage level corresponding with this temperature rank.
10. the device according to any one of claim 6 to 9, is characterized in that, also comprises communication cost determination module,
Described communication cost determination module, for the range information according to IDC node each in user and determined set, use network of network type matching degree information, and in determined set each IDC node load state information in one or more information, determine the communication cost of each IDC node in user and determined set.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510148470.7A CN104702625B (en) | 2015-03-31 | 2015-03-31 | Access request dispatching method and device in a kind of CDN network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510148470.7A CN104702625B (en) | 2015-03-31 | 2015-03-31 | Access request dispatching method and device in a kind of CDN network |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104702625A true CN104702625A (en) | 2015-06-10 |
| CN104702625B CN104702625B (en) | 2018-04-13 |
Family
ID=53349393
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510148470.7A Active CN104702625B (en) | 2015-03-31 | 2015-03-31 | Access request dispatching method and device in a kind of CDN network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104702625B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107370811A (en) * | 2017-07-14 | 2017-11-21 | 北京知道创宇信息技术有限公司 | A kind of resource distribution method of CDN, computing device and readable storage medium storing program for executing |
| CN107770283A (en) * | 2017-11-08 | 2018-03-06 | 北京奇艺世纪科技有限公司 | A kind of control method of file download, apparatus and system |
| CN108234632A (en) * | 2017-12-29 | 2018-06-29 | 北京奇虎科技有限公司 | A kind of data distributing method and device of content distributing network CDN |
| CN108347465A (en) * | 2017-01-23 | 2018-07-31 | 阿里巴巴集团控股有限公司 | A kind of method and device of selection network data center |
| CN105391765B (en) * | 2015-10-14 | 2018-11-09 | 中国联合网络通信集团有限公司 | A kind of method and system of content storage |
| CN108810144A (en) * | 2018-06-14 | 2018-11-13 | 北京中飞艾维航空科技有限公司 | A kind of data transmission method, server and storage medium |
| CN108804351A (en) * | 2018-05-30 | 2018-11-13 | 郑州云海信息技术有限公司 | A kind of caching replacement method and device |
| CN109144791A (en) * | 2018-09-30 | 2019-01-04 | 北京金山云网络技术有限公司 | Data conversion storage method, apparatus and data management server |
| CN109981778A (en) * | 2019-03-27 | 2019-07-05 | 百度在线网络技术（北京）有限公司 | Service implementing method, device, equipment and the storage medium of content distributing network |
| CN111277860A (en) * | 2020-01-23 | 2020-06-12 | 北京邮电大学 | Method, device and equipment for caching video in mobile edge network and readable medium |
| CN113296924A (en) * | 2020-04-28 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Content distribution method, device, system and storage medium |
| CN114422522A (en) * | 2020-10-13 | 2022-04-29 | 贵州白山云科技股份有限公司 | Cache distribution method, device, medium and equipment |
| CN114697683A (en) * | 2022-03-25 | 2022-07-01 | 腾讯音乐娱乐科技（深圳）有限公司 | Intelligent scheduling method, equipment and computer program product for streaming media file |
| CN115250295A (en) * | 2021-04-26 | 2022-10-28 | 北京字跳网络技术有限公司 | Media content processing method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011143946A1 (en) * | 2011-01-24 | 2011-11-24 | 华为技术有限公司 | Method and system for managing multilevel caches of edge server in cdn |
| CN102411542A (en) * | 2011-10-26 | 2012-04-11 | 上海文广互动电视有限公司 | Dynamic hierarchical storage system and method |
| CN103312776A (en) * | 2013-05-08 | 2013-09-18 | 青岛海信传媒网络技术有限公司 | Method and device for caching contents of videos by edge node server |
| CN104270463A (en) * | 2014-10-21 | 2015-01-07 | 无锡云捷科技有限公司 | CDN dynamic server selection method |
| CN104394441A (en) * | 2014-11-27 | 2015-03-04 | 北京奇艺世纪科技有限公司 | Video content distribution scheduling method, device and system |
-
2015
- 2015-03-31 CN CN201510148470.7A patent/CN104702625B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011143946A1 (en) * | 2011-01-24 | 2011-11-24 | 华为技术有限公司 | Method and system for managing multilevel caches of edge server in cdn |
| CN102411542A (en) * | 2011-10-26 | 2012-04-11 | 上海文广互动电视有限公司 | Dynamic hierarchical storage system and method |
| CN103312776A (en) * | 2013-05-08 | 2013-09-18 | 青岛海信传媒网络技术有限公司 | Method and device for caching contents of videos by edge node server |
| CN104270463A (en) * | 2014-10-21 | 2015-01-07 | 无锡云捷科技有限公司 | CDN dynamic server selection method |
| CN104394441A (en) * | 2014-11-27 | 2015-03-04 | 北京奇艺世纪科技有限公司 | Video content distribution scheduling method, device and system |
Non-Patent Citations (1)
| Title |
|---|
| 单芝栋: ""视频网格中自适应热度变化的条块化存储"", 《专题技术与工程应用》 * |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105391765B (en) * | 2015-10-14 | 2018-11-09 | 中国联合网络通信集团有限公司 | A kind of method and system of content storage |
| CN108347465A (en) * | 2017-01-23 | 2018-07-31 | 阿里巴巴集团控股有限公司 | A kind of method and device of selection network data center |
| CN108347465B (en) * | 2017-01-23 | 2021-02-02 | 阿里巴巴集团控股有限公司 | Method and device for selecting network data center |
| CN107370811A (en) * | 2017-07-14 | 2017-11-21 | 北京知道创宇信息技术有限公司 | A kind of resource distribution method of CDN, computing device and readable storage medium storing program for executing |
| CN107370811B (en) * | 2017-07-14 | 2020-11-27 | 北京知道创宇信息技术股份有限公司 | Resource distribution method of CDN (content delivery network), computing equipment and readable storage medium |
| CN107770283B (en) * | 2017-11-08 | 2020-10-23 | 北京奇艺世纪科技有限公司 | Method, device and system for controlling file downloading |
| CN107770283A (en) * | 2017-11-08 | 2018-03-06 | 北京奇艺世纪科技有限公司 | A kind of control method of file download, apparatus and system |
| CN108234632A (en) * | 2017-12-29 | 2018-06-29 | 北京奇虎科技有限公司 | A kind of data distributing method and device of content distributing network CDN |
| CN108804351B (en) * | 2018-05-30 | 2021-10-29 | 郑州云海信息技术有限公司 | Cache replacement method and device |
| CN108804351A (en) * | 2018-05-30 | 2018-11-13 | 郑州云海信息技术有限公司 | A kind of caching replacement method and device |
| CN108810144A (en) * | 2018-06-14 | 2018-11-13 | 北京中飞艾维航空科技有限公司 | A kind of data transmission method, server and storage medium |
| CN109144791A (en) * | 2018-09-30 | 2019-01-04 | 北京金山云网络技术有限公司 | Data conversion storage method, apparatus and data management server |
| CN109981778A (en) * | 2019-03-27 | 2019-07-05 | 百度在线网络技术（北京）有限公司 | Service implementing method, device, equipment and the storage medium of content distributing network |
| CN111277860B (en) * | 2020-01-23 | 2021-04-06 | 北京邮电大学 | Method, device and equipment for caching video in mobile edge network and readable medium |
| CN111277860A (en) * | 2020-01-23 | 2020-06-12 | 北京邮电大学 | Method, device and equipment for caching video in mobile edge network and readable medium |
| CN113296924A (en) * | 2020-04-28 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Content distribution method, device, system and storage medium |
| CN113296924B (en) * | 2020-04-28 | 2022-07-22 | 阿里巴巴集团控股有限公司 | Content distribution method, device, system and storage medium |
| CN114422522A (en) * | 2020-10-13 | 2022-04-29 | 贵州白山云科技股份有限公司 | Cache distribution method, device, medium and equipment |
| CN114422522B (en) * | 2020-10-13 | 2024-02-13 | 贵州白山云科技股份有限公司 | Cache distribution method, device, medium and equipment |
| CN115250295A (en) * | 2021-04-26 | 2022-10-28 | 北京字跳网络技术有限公司 | Media content processing method, device, equipment and storage medium |
| WO2022228390A1 (en) * | 2021-04-26 | 2022-11-03 | 北京字跳网络技术有限公司 | Media content processing method, apparatus and device, and storage medium |
| CN114697683A (en) * | 2022-03-25 | 2022-07-01 | 腾讯音乐娱乐科技（深圳）有限公司 | Intelligent scheduling method, equipment and computer program product for streaming media file |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104702625B (en) | 2018-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104702625A (en) | Method and device for scheduling access request in CDN (Content Delivery Network) | |
| CN109327550B (en) | Access request distribution method and device, storage medium and computer equipment | |
| US10489476B2 (en) | Methods and devices for preloading webpages | |
| JP5655083B2 (en) | Prefetch content items based on social distance | |
| CN101136911B (en) | Method to download files using P2P technique and P2P download system | |
| CN104765749B (en) | A kind of date storage method and device | |
| CN103312733B (en) | Information processing method and device | |
| CN104954468A (en) | Resource allocation method and resource allocation device | |
| JP2011501299A (en) | Dynamically updated virtual list view | |
| CN103236989B (en) | Buffer control method in a kind of content distributing network, equipment and system | |
| CN104284201A (en) | Video content processing method and device | |
| CN105159604A (en) | Disk data read-write method and system | |
| CN103747047A (en) | CDN file storage method, file distribution control center and system thereof | |
| CN104219069A (en) | Access frequency control method, device and control system | |
| US20200084121A1 (en) | Node of a Network and a Method of Operating the Same for Resource Distribution | |
| CN103186660B (en) | Information source selection system, information source system of selection | |
| CN101226542A (en) | Method for caching report | |
| CN109165096B (en) | Cache utilization system and method for web cluster | |
| CN111131841A (en) | Live indirect access method and device, electronic equipment and storage medium | |
| CN112351088A (en) | CDN cache method, device, computer equipment and storage medium | |
| CN103747049A (en) | CDN file distribution method, control center and system | |
| CN106547805A (en) | The method and apparatus of optimization database index | |
| CN102970349B (en) | A kind of memory load equalization methods of DHT network | |
| CN110187836A (en) | A kind of data-erasure method, device, computer and storage medium | |
| CN105471938A (en) | Server load management method and server load management device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |