CN103747047A - CDN file storage method, file distribution control center and system thereof - Google Patents
CDN file storage method, file distribution control center and system thereof Download PDFInfo
- Publication number
- CN103747047A CN103747047A CN201310723056.5A CN201310723056A CN103747047A CN 103747047 A CN103747047 A CN 103747047A CN 201310723056 A CN201310723056 A CN 201310723056A CN 103747047 A CN103747047 A CN 103747047A
- Authority
- CN
- China
- Prior art keywords
- file
- stored
- control centre
- superthermal
- focus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention provides a CDN file storage method, a file distribution control center and a system thereof, and relates to the field of network multimedia technology. According to the invention, reasonable storage modes can be flexibly allocated for files according to types of the files. Thus, visit pressure of a content distribution system is balanced; system resources are utilized reasonably; network congestion is relieved; system overloads are avoided; and performance of a CDN system is raised. The method comprises the following steps: the file distribution control center acquires files to be stored; the file distribution control center judges types of the files to be stored; if the files to be stored are cold-spot files, the file distribution control center sends a first file storage message to a storage node so as to make a server of the storage node store the cold-spot files; and if the files to be stored are hotspot files or ultra-hotspot files, the file distribution control center sends a second file storage message to the storage node and an edge node so as to make the storage node and the edge node store the hotspot files or ultra-hotspot files.
Description
Technical field
The present invention relates to network multimedia technology field, relate in particular to a kind of CDN file memory method, file distributing control centre and system.
Background technology
CDN(Content Delivery Network, content distributing network) be a kind of one deck intelligent virtual network on existing Internet basic forming by place node server everywhere at network.CDN can be in real time leads user's request on the nearest service node of user again according to the connection of network traffics and each node, load state and to integrated informations such as user's distance and response times, its objective is and can select the node close to relatively from user to send the required content of user to user, alleviate the situation of network congestion, improve the response speed of website.
In prior art, under a node of content delivering system, can cover multiple servers, file distributing control centre has determined which file is stored in which server of which node.Common, file distributing control centre can be as far as possible by more file distribution in the server of each node, to make user in all parts of the country can obtain the required file of user nearby.
But, because prior art file distributing control centre is evenly distributed on All Files in the server of each node, some cold spot file is likely not accessed for a long time, and the situation that some focus file or superthermal dot file are repeatedly asked in there will be at one time, therefore cause the unbalanced of content delivering system access pressure, produced system overload, the irrational situation of system resource utilization.
Summary of the invention
Embodiments of the invention provide a kind of CDN file memory method, file distributing control centre and system, can according to the type of file, be the rational storage mode of file allocation neatly, the balanced access pressure of content delivering system, reasonably utilize system resource, alleviate network congestion, avoid system overload, promoted the performance of CDN system.
For achieving the above object, embodiments of the invention adopt following technical scheme:
First aspect, the embodiment of the present invention provides a kind of CDN file memory method, is applied to content delivering system, and described method comprises:
File distributing control centre obtains file to be stored;
Described file distributing control centre judges the type of described file to be stored, and wherein, the type of described file to be stored is cold spot file, focus file or superthermal dot file;
If described file to be stored is described cold spot file, described file distributing control centre sends the first file storing message to memory node, to make cold spot file described in a server stores of described memory node;
If described file to be stored is described focus file or described superthermal dot file, described file distributing control centre sends the second file storing message to described memory node and fringe node, to make described memory node and described fringe node store described focus file or described superthermal dot file.
In the possible implementation of the first, according to first aspect, described the second file storing message comprises focus file storing message and superthermal dot file storing message;
If described file to be stored is focus file or superthermal dot file, described file distributing control centre sends the second file storing message to described memory node and fringe node, specifically comprises:
If described file to be stored is described focus file, described file distributing control centre sends described focus file storing message to described memory node and described fringe node, to make focus file described in a server of described memory node and a server stores of described fringe node;
If described file to be stored is described superthermal dot file, described file distributing control centre sends described superthermal dot file storing message to described memory node and described fringe node, to make the Servers-all of described memory node and the described superthermal dot file of the Servers-all storage of described fringe node.
In the possible implementation of the second, in conjunction with first aspect or the possible implementation of the first, before described file distributing control centre obtains file to be stored, described method also comprises:
Described file distributing control centre obtains the first data;
Described file distributing control centre analyzes described the first data, spanned file list of types, and described file type list is for the type of log file;
Described file distributing control centre stores described file type list.
In the third possible implementation, in conjunction with first aspect or possible implementation or the possible implementation of the second of the first, described the first data at least comprise log statistic data and page exposure data;
Described file distributing control centre analyzes described the first data, and spanned file list of types, specifically comprises:
Described file distributing control centre is according to log statistic data and page exposure data, the liveness of statistics file, the visit capacity in the access sum that the liveness of described file is file, last access time or the first Preset Time section;
If the liveness of described file is less than the first default thresholding, the type that described file distributing control centre records described file in described file type list is cold spot file;
If the liveness of described file is more than or equal to the first default thresholding, and be less than the second default thresholding, the type that described file distributing control centre records described file in described file type list is focus file;
If the liveness of described file is more than or equal to the second default thresholding, the type that described file distributing control centre records described file in described file type list is superthermal dot file.
In the 4th kind of possible implementation, in conjunction with first aspect or the possible implementation of the first, to the third possible implementation, described file distributing control centre judges the type of described file to be stored, specifically comprises:
The type that described file to be stored is searched in described file type list by described file distributing control centre.
Second aspect, the embodiment of the present invention provides a kind of file distributing control centre, is applied to content delivering system, and described file distributing control centre comprises:
The first acquisition module, for obtaining file to be stored;
Judge module, for judging the type of described file to be stored, wherein, the type of described file to be stored is cold spot file, focus file or superthermal dot file;
The first sending module, if be described cold spot file for described file to be stored, sends the first file storing message to memory node, to make cold spot file described in a server stores of described memory node;
The second sending module, if be described focus file or described superthermal dot file for described file to be stored, send the second file storing message to described memory node and fringe node, to make described memory node and described fringe node store described focus file or described superthermal dot file.
In the possible implementation of the first, according to second aspect, described the second file storing message comprises focus file storing message and superthermal dot file storing message;
Described the second sending module, specifically comprises:
First sends submodule, if be described focus file for described file to be stored, send described focus file storing message to described memory node and described fringe node, to make focus file described in a server of described memory node and a server stores of described fringe node;
Second sends submodule, if be described superthermal dot file for described file to be stored, send described superthermal dot file storing message to described memory node and described fringe node, to make the Servers-all of described memory node and the described superthermal dot file of the Servers-all storage of described fringe node.
In the possible implementation of the second, in conjunction with second aspect or the possible implementation of the first, described file distributing control centre, also comprises:
The second acquisition module, before obtaining file to be stored at described the first acquisition module, obtains the first data;
Processing module, for analyzing described the first data, spanned file list of types, described file type list is for the type of log file;
Memory module, for storing described file type list.
In the third possible implementation, in conjunction with second aspect or possible implementation or the possible implementation of the second of the first, described the first data at least comprise log statistic data and page exposure data;
Described processing module, specifically comprises:
Statistics submodule, for according to log statistic data and page exposure data, the liveness of statistics file, the visit capacity in the access sum that the liveness of described file is file, last access time or the first Preset Time section;
The first record sub module, if be less than the first default thresholding for the liveness of described file, the type that records described file in described file type list is cold spot file;
The second record sub module, if be more than or equal to the first default thresholding for the liveness of described file, and is less than the second default thresholding, and the type that records described file in described file type list is focus file;
The 3rd record sub module, if be more than or equal to the second default thresholding for the liveness of described file, the type that records described file in described file type list is superthermal dot file.
In the 4th kind of possible implementation, in conjunction with second aspect or the possible implementation of the first, to the third possible implementation, described judge module, specifically for the type of searching described file to be stored in described file type list.
The third aspect, the embodiment of the present invention provides a kind of content delivering system, comprise the described file distributing control centre with above-mentioned arbitrary feature, for storing the memory node of cold spot file, focus file or superthermal dot file, and for storing the fringe node of described focus file or described superthermal dot file.
A kind of CDN file memory method, file distributing control centre and system that the embodiment of the present invention provides, method comprises: file distributing control centre obtains file to be stored; File distributing control centre judges the type of file to be stored, and wherein, the type of file to be stored is cold spot file, focus file or superthermal dot file; If file to be stored is cold spot file, file distributing control centre sends the first file storing message to memory node, to make a server stores cold spot file of memory node; If file to be stored is focus file or superthermal dot file, file distributing control centre sends the second file storing message to memory node and fringe node, to make memory node and fringe node storage focus file or superthermal dot file.
With Distribution Control Center in prior art as far as possible by more file distribution compared with the method in the server of each node, pass through this method, file distributing control centre can judge the type of file to be stored, and dissimilar according to file to be stored, file to be stored is stored in the server of different nodes.Because file distributing control centre can be the rational storage mode of file allocation according to the type of file neatly, therefore avoided cold spot file likely not accessed for a long time, and the situation that some focus file or superthermal dot file are repeatedly asked in there will be at one time, and then the balanced access pressure of content delivering system, reasonably utilize system resource, alleviate network congestion, avoid system overload, promoted the performance of CDN system.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the schematic flow sheet of a kind of CDN file memory method in the embodiment of the present invention 1;
Fig. 2 is the schematic flow sheet of a kind of CDN file memory method in the embodiment of the present invention 2;
Fig. 3 is the structural representation one of a kind of file distributing control centre in the embodiment of the present invention 3;
Fig. 4 is the structural representation two of a kind of file distributing control centre in the embodiment of the present invention 3;
Fig. 5 is the structural representation three of a kind of file distributing control centre in the embodiment of the present invention 3;
Fig. 6 is the structural representation four of a kind of file distributing control centre in the embodiment of the present invention 3.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Based on the embodiment in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
In addition, term " system " and " network " are often used interchangeably in this article herein.Herein term " with ", be only a kind of incidence relation of describing affiliated partner, can there are three kinds of relations in expression, for example, A and B, can represent: individualism A exists A and B, these three kinds of situations of individualism B simultaneously.In addition, character "/" herein, generally represents that forward-backward correlation is to liking a kind of relation of "or".
The file distributing control centre that the present invention mentions carries out management and the control of CDN system, and memory node is the node of having stored system All Files, and fringe node is the ordinary node that service is provided for user.Common, memory node is core CDN node, has stored intrasystem All Files; Fringe node is edge C DN node, for user access.The embodiment of the present invention is exactly is core CDN node with memory node, and fringe node is that edge C DN node is example, carries out specific embodiment of the invention description.
Embodiment 1
The embodiment of the present invention provides a kind of CDN file memory method, can be applied to content delivering system, and as shown in Figure 1, CDN file memory method, comprising:
S101, file distributing control centre obtain file to be stored.
CDN is a kind of one deck intelligent virtual network on existing Internet basic forming by place node server everywhere at network.In the prior art, under a node of content delivering system, can cover multiple servers, file distributing control centre has determined which file is stored in which server of which node.Common, file distributing control centre can be as far as possible by more file distribution in the server of each node, to make user in all parts of the country can obtain the required file of user nearby.But, because prior art file distributing control centre is evenly distributed on All Files in the server of each node, some cold spot file is likely not accessed for a long time, and the situation that some focus file or superthermal dot file are repeatedly asked in there will be at one time, therefore cause the unbalanced of content delivering system access pressure, produced system overload, the irrational situation of system resource utilization.
The embodiment of the present invention provides a kind of CDN file memory method, can according to the type of file, be the rational storage mode of file allocation neatly, the balanced access pressure of content delivering system, reasonably utilize system resource, alleviate network congestion, avoid system overload, promoted the performance of CDN system.
First, file distributing control centre obtains file to be stored.
Concrete, file to be stored at least comprises multimedia file; The quantity of file to be stored is more than or equal to one; The present invention does not limit.
S102, file distributing control centre judge the type of file to be stored, and wherein, the type of file to be stored is cold spot file, focus file or superthermal dot file.
In file distributing control centre, obtain after file to be stored, file distributing control centre judges the type of file to be stored.
Wherein, the type of file to be stored is cold spot file, focus file or superthermal dot file.Cold spot file can be indicated for a long time no one's access, or the lower file of visit capacity; Focus file can be indicated recently accessed, or the relatively high file of visit capacity; Focus file can be indicated frequent accessed recently, or the file of visit capacity sudden fast rush.
Concrete, how file distributing control centre divides the method for cold spot file, focus file and superthermal dot file, and how file distributing control centre judges that the method for the type of file to be stored will be described in detail in the following embodiments, repeat no more herein.
If S103 file to be stored is cold spot file, file distributing control centre sends the first file storing message to memory node, to make a server stores cold spot file of memory node.
If file to be stored is cold spot file, represent for a long time no one access of file to be stored or visit capacity lower, for this file, in content delivering system, do not need to store a lot of parts, only need to be stored in a server under the memory node of having stored intrasystem All Files, therefore, file distributing control centre sends the first file storing message to memory node, to make a server stores cold spot file of memory node.
It should be noted that, a server stores cold spot file of memory node, this server is according to hash algorithm, by certain rule, calculates, the present invention does not limit.
If S104 file to be stored is focus file or superthermal dot file, file distributing control centre sends the second file storing message to memory node and fringe node, to make memory node and fringe node storage focus file or superthermal dot file.
A step arranged side by side with step S103, if file to be stored is focus file or superthermal dot file, represent that file access amount to be stored is relatively high, for this file, in content delivering system, need to store a lot of parts of load pressures with mitigation system simultaneously, now, memory node and the common fringe node of having stored intrasystem All Files all need to store described file, therefore, file distributing control centre sends the second file storing message to memory node and fringe node, to make memory node and fringe node storage focus file or superthermal dot file.
Concrete, the method that focus file and superthermal dot file are stored respectively in memory node and fringe node will be described in detail in the following embodiments, repeat no more herein.
A kind of CDN file memory method, file distributing control centre and system that the embodiment of the present invention provides, method comprises: file distributing control centre obtains file to be stored; File distributing control centre judges the type of file to be stored, and wherein, the type of file to be stored is cold spot file, focus file or superthermal dot file; If file to be stored is cold spot file, file distributing control centre sends the first file storing message to memory node, to make a server stores cold spot file of memory node; If file to be stored is focus file or superthermal dot file, file distributing control centre sends the second file storing message to memory node and fringe node, to make memory node and fringe node storage focus file or superthermal dot file.
With Distribution Control Center in prior art as far as possible by more file distribution compared with the method in the server of each node, pass through this method, file distributing control centre can judge the type of file to be stored, and dissimilar according to file to be stored, file to be stored is stored in the server of different nodes.Because file distributing control centre can be the rational storage mode of file allocation according to the type of file neatly, therefore avoided cold spot file likely not accessed for a long time, and the situation that some focus file or superthermal dot file are repeatedly asked in there will be at one time, and then the balanced access pressure of content delivering system, reasonably utilize system resource, alleviate network congestion, avoid system overload, promoted the performance of CDN system.
Embodiment 2
The embodiment of the present invention provides a kind of CDN file memory method, can be applied to content delivering system, and as shown in Figure 2, CDN file memory method, comprising:
S201, file distributing control centre obtain the first data.
In the prior art, under a node of content delivering system, can cover multiple servers, file distributing control centre has determined which file is stored in which server of which node.Common, file distributing control centre can be as far as possible by more file distribution in the server of each node, to make user in all parts of the country can obtain the required file of user nearby.But, because prior art file distributing control centre is evenly distributed on All Files in the server of each node, some cold spot file is likely not accessed for a long time, and the situation that some focus file or superthermal dot file are repeatedly asked in there will be at one time, therefore cause the unbalanced of content delivering system access pressure, produced system overload, the irrational situation of system resource utilization.
The embodiment of the present invention provides a kind of CDN file memory method, can according to the type of file, be the rational storage mode of file allocation neatly, the balanced access pressure of content delivering system, reasonably utilize system resource, alleviate network congestion, avoid system overload, promoted the performance of CDN system.
First, file distributing control centre obtains the first data.
Wherein, the first data at least comprise log statistic data and page exposure data.
S202, file distributing control centre analyze the first data, spanned file list of types, and file type list is for the type of log file.
Wherein, the first data at least comprise log statistic data and page exposure data.
File distributing control centre is getting after the first data, analyzes the first data, spanned file list of types, and file type list is for the type of log file.Because file distributing control centre need to distinguish file to be stored, judge where file to be stored need to be stored in, and therefore, file distributing control centre need to analyze the first data, file type list, distinguishes file to be stored thus.The embodiment of the present invention is that the type of the file based on to be stored is that cold spot file, focus file or superthermal dot file carry out storage file.
Concrete, file distributing control centre analyzes the first data, and the step S202 of spanned file list of types can comprise step S202a-S202d:
S202a, file distributing control centre be according to log statistic data and page exposure data, the liveness of statistics file, the visit capacity in the access sum that the liveness of file is file, last access time or the first Preset Time section.
It should be noted that, file distributing control centre analyzes log statistic data and page exposure data, can draw the access of multimedia file, the number of times of downloading, watch, collecting, the finally time of access, and the visit capacity in the first Preset Time section.Wherein, the first Preset Time section is a period of time that default is good; Visit capacity in the first Preset Time section was illustrated in this period of time, accessed the total amount of this multimedia file, for example, and 24 hours visit capacities with inner multimedia file A, or the visit capacity of 1 month inner multimedia file B.
You need to add is that, for the accuracy of the liveness of statistics file, file distributing control centre can add up the access sum of multimedia file, last access time simultaneously, and first visit capacity in Preset Time section, not merely be confined to wherein a kind of data of statistics, the present invention does not limit.
If the liveness of S202b file is less than the first default thresholding, file distributing control centre in file type list the type of log file be cold spot file.
If the liveness of file is less than the first default thresholding, represent for a long time no one's access of this file, or visit capacity is lower, the liveness of this file is lower, file distributing control centre in file type list the type of log file be cold spot file.
If the liveness of S202c file is more than or equal to the first default thresholding, and be less than the second default thresholding, file distributing control centre in file type list the type of log file be focus file.
A step arranged side by side with step S202b, if the liveness of file is more than or equal to the first default thresholding, and be less than the second default thresholding, represent that this file may be recently accessed, but visit capacity is not again too high, the liveness of this file is in the middle reaches of All Files level, file distributing control centre in file type list the type of log file be focus file.
If the liveness of S202d file is more than or equal to the second default thresholding, file distributing control centre in file type list the type of log file be superthermal dot file.
With step S202b and a S202c step arranged side by side, if the liveness of file is more than or equal to the second default thresholding, represent that this file may be frequent accessed recently, or visit capacity is increased sharply suddenly, the liveness of this file is higher, file distributing control centre in file type list the type of log file be superthermal dot file.
S203, file distributing control centre storage file list of types.
S204, file distributing control centre obtain file to be stored.
Concrete, file to be stored at least comprises multimedia file; The quantity of file to be stored is more than or equal to one; The present invention does not limit.
The type of file to be stored is searched in file type list by S205, file distributing control centre.
In file distributing control centre, obtain after file to be stored, the type of file to be stored is searched in file type list by file distributing control centre.
Wherein, the type of file to be stored is cold spot file, focus file or superthermal dot file.Cold spot file can be indicated for a long time no one's access, or the lower file of visit capacity; Focus file can be indicated recently accessed, or the relatively high file of visit capacity; Focus file can be indicated frequent accessed recently, or the file of visit capacity sudden fast rush.
Exemplary, in file distributing control centre, obtain after file to be stored, the method that the type of file A to be stored is searched in file type list by file distributing control centre is specially: file distributing control centre reads the title of file A to be stored, and in file type list, finding the type corresponding with the title of file A to be stored, the type of determining file A to be stored is cold spot file, focus file or superthermal dot file on earth.
If S206 file to be stored is cold spot file, file distributing control centre sends the first file storing message to memory node, to make a server stores cold spot file of memory node.
If file to be stored is cold spot file, represent for a long time no one access of file to be stored or visit capacity lower, for this file, in content delivering system, do not need to store a lot of parts, only need to be stored in a server under the memory node of having stored intrasystem All Files, therefore, file distributing control centre sends the first file storing message to memory node, to make a server stores cold spot file of memory node.
It should be noted that, a server stores cold spot file of memory node, this server is according to hash algorithm, by certain rule, calculates, the present invention does not limit.
If S207 file to be stored is focus file or superthermal dot file, file distributing control centre sends the second file storing message to memory node and fringe node, to make memory node and fringe node storage focus file or superthermal dot file.
A step arranged side by side with step S206, if file to be stored is focus file or superthermal dot file, represent that file access amount to be stored is relatively high, for this file, in content delivering system, need to store a lot of parts of load pressures with mitigation system simultaneously, now, memory node and the common fringe node of having stored intrasystem All Files all need to store described file, therefore, file distributing control centre sends the second file storing message to memory node and fringe node, to make memory node and fringe node storage focus file or superthermal dot file.
Wherein, the second file storing message comprises focus file storing message and superthermal dot file storing message.
Concrete, if file to be stored is focus file or superthermal dot file, file distributing control centre sends the second file storing message can comprise S207a and S207b to the step S207 of memory node and fringe node:
If S207a file to be stored is focus file, file distributing control centre sends focus file storing message to memory node and fringe node, to make server of memory node and a server stores focus file of fringe node.
If file to be stored is focus file, represent that file access amount to be stored is relatively high, for this file, in content delivering system, need to store a lot of parts of load pressures with mitigation system simultaneously, now, memory node and the common fringe node of having stored intrasystem All Files all need to store described file.But meanwhile, because the liveness of focus file is not high especially, this file that only needed an each memory node and fringe node server stores under covering.Therefore, file distributing control centre sends focus file storing message to memory node and fringe node, to make server of memory node and a server stores focus file of fringe node.
It should be noted that, server of memory node and a server stores focus file of fringe node, this server is according to hash algorithm, by certain rule, calculates, the present invention does not limit.
If S207b file to be stored is superthermal dot file, file distributing control centre sends superthermal dot file storing message to memory node and fringe node, to make the Servers-all of memory node and the Servers-all of fringe node store superthermal dot file.
A step arranged side by side with step S207a, if file to be stored is superthermal dot file, represent that file access amount to be stored is very high, for this file, in content delivering system, need to store a lot of parts of load pressures with mitigation system simultaneously, now, memory node and the common fringe node of having stored intrasystem All Files all need to store described file.But meanwhile,, because the liveness of superthermal dot file is very high, only this file of server stores under each memory node and fringe node covering still has and may cause load pressure to system.Therefore, file distributing control centre sends superthermal dot file storing message to memory node and fringe node, to make the Servers-all of memory node and the Servers-all of fringe node store superthermal dot file.
A kind of CDN file memory method, file distributing control centre and system that the embodiment of the present invention provides, method comprises: file distributing control centre obtains file to be stored; File distributing control centre judges the type of file to be stored, and wherein, the type of file to be stored is cold spot file, focus file or superthermal dot file; If file to be stored is cold spot file, file distributing control centre sends the first file storing message to memory node, to make a server stores cold spot file of memory node; If file to be stored is focus file or superthermal dot file, file distributing control centre sends the second file storing message to memory node and fringe node, to make memory node and fringe node storage focus file or superthermal dot file.
With Distribution Control Center in prior art as far as possible by more file distribution compared with the method in the server of each node, pass through this method, file distributing control centre can judge the type of file to be stored, and dissimilar according to file to be stored, file to be stored is stored in the server of different nodes.Because file distributing control centre can be the rational storage mode of file allocation according to the type of file neatly, therefore avoided cold spot file likely not accessed for a long time, and the situation that some focus file or superthermal dot file are repeatedly asked in there will be at one time, and then the balanced access pressure of content delivering system, reasonably utilize system resource, alleviate network congestion, avoid system overload, promoted the performance of CDN system.
Embodiment 3
The embodiment of the present invention provides a kind of file distributing control centre, is applied to content delivering system, and as shown in Figure 3, described file distributing control centre comprises:
The first acquisition module 10, for obtaining file to be stored.
The first sending module 12, if be described cold spot file for described file to be stored, sends the first file storing message to memory node, to make cold spot file described in a server stores of described memory node.
The second sending module 13, if be described focus file or described superthermal dot file for described file to be stored, send the second file storing message to described memory node and fringe node, to make described memory node and described fringe node store described focus file or described superthermal dot file.
Further, described the second file storing message comprises focus file storing message and superthermal dot file storing message.
As shown in Figure 4, described the second sending module 13, specifically comprises:
First sends submodule 130, if be described focus file for described file to be stored, send described focus file storing message to described memory node and described fringe node, to make focus file described in a server of described memory node and a server stores of described fringe node.
Second sends submodule 131, if be described superthermal dot file for described file to be stored, send described superthermal dot file storing message to described memory node and described fringe node, to make the Servers-all of described memory node and the described superthermal dot file of the Servers-all storage of described fringe node.
Further, as shown in Figure 5, described file distributing control centre, also comprises:
The second acquisition module 14, before obtaining file to be stored at described the first acquisition module 10, obtains the first data.
Memory module 16, for storing described file type list.
Further, described the first data at least comprise log statistic data and page exposure data.
As shown in Figure 6, described processing module 15, specifically comprises:
Statistical module 150, for according to log statistic data and page exposure data, the liveness of statistics file, the visit capacity in the access sum that the liveness of described file is file, last access time or the first Preset Time section.
The first record sub module 151, if be less than the first default thresholding for the liveness of described file, the type that records described file in described file type list is cold spot file.
The second record sub module 152, if be more than or equal to the first default thresholding for the liveness of described file, and is less than the second default thresholding, and the type that records described file in described file type list is focus file.
The 3rd record sub module 153, if be more than or equal to the second default thresholding for the liveness of described file, the type that records described file in described file type list is superthermal dot file.
Further, described judge module 11, specifically for the type of searching described file to be stored in described file type list.
A kind of file distributing control centre that the embodiment of the present invention provides, this file Distribution Control Center comprises: the first acquisition module, for obtaining file to be stored; Judge module, for judging the type of described file to be stored, wherein, the type of described file to be stored is cold spot file, focus file or superthermal dot file; The first sending module, if be described cold spot file for described file to be stored, sends the first file storing message to memory node, to make cold spot file described in a server stores of described memory node; The second sending module, if be described focus file or described superthermal dot file for described file to be stored, send the second file storing message to described memory node and fringe node, to make described memory node and described fringe node store described focus file or described superthermal dot file.
With Distribution Control Center in prior art as far as possible by more file distribution compared with the method in the server of each node, pass through this method, file distributing control centre can judge the type of file to be stored, and dissimilar according to file to be stored, file to be stored is stored in the server of different nodes.Because file distributing control centre can be the rational storage mode of file allocation according to the type of file neatly, therefore avoided cold spot file likely not accessed for a long time, and the situation that some focus file or superthermal dot file are repeatedly asked in there will be at one time, and then the balanced access pressure of content delivering system, reasonably utilize system resource, alleviate network congestion, avoid system overload, promoted the performance of CDN system.
Embodiment 4
The embodiment of the present invention provides a kind of content delivering system, comprise the described file distributing control centre in above-described embodiment 3 with arbitrary feature of describing, for storing the memory node of cold spot file, focus file or superthermal dot file, and for storing the fringe node of described focus file or described superthermal dot file.
With Distribution Control Center in prior art as far as possible by more file distribution compared with the method in the server of each node, pass through this method, file distributing control centre can judge the type of file to be stored, and dissimilar according to file to be stored, file to be stored is stored in the server of different nodes.Because file distributing control centre can be the rational storage mode of file allocation according to the type of file neatly, therefore avoided cold spot file likely not accessed for a long time, and the situation that some focus file or superthermal dot file are repeatedly asked in there will be at one time, and then the balanced access pressure of content delivering system, reasonably utilize system resource, alleviate network congestion, avoid system overload, promoted the performance of CDN system.
Through the above description of the embodiments, those skilled in the art can be well understood to, for convenience and simplicity of description, only with the division of above-mentioned each functional module, be illustrated, in practical application, can above-mentioned functions be distributed and by different functional modules, completed as required, the internal structure that is about to device be divided into different functional modules, to complete all or part of function described above.The system of foregoing description, the specific works process of device and unit, can, with reference to the corresponding process in preceding method embodiment, not repeat them here.
In the several embodiment that provide in the application, should be understood that, disclosed system, apparatus and method, can realize by another way.For example, device embodiment described above is only schematic, for example, the division of described module or unit, be only that a kind of logic function is divided, during actual realization, can have other dividing mode, for example multiple unit or assembly can in conjunction with or can be integrated into another system, or some features can ignore, or do not carry out.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, indirect coupling or the communication connection of device or unit can be electrically, machinery or other form.
The described unit as separating component explanation can or can not be also physically to separate, and the parts that show as unit can be or can not be also physical locations, can be positioned at a place, or also can be distributed in multiple network element.Can select according to the actual needs some or all of unit wherein to realize the object of the present embodiment scheme.
In addition, the each functional unit in each embodiment of the present invention can be integrated in a processing unit, can be also that the independent physics of unit exists, and also can be integrated in a unit two or more unit.Above-mentioned integrated unit both can adopt the form of hardware to realize, and also can adopt the form of SFU software functional unit to realize.
If described integrated unit is realized and during as production marketing independently or use, can be stored in a computer read/write memory medium using the form of SFU software functional unit.Based on such understanding, the all or part of of the part that technical scheme of the present invention contributes to prior art in essence in other words or this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions (can be personal computers in order to make a computer equipment, server, or the network equipment etc.) or processor (processor) carry out all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: various media that can be program code stored such as USB flash disk, portable hard drive, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CDs.
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited to this, any be familiar with those skilled in the art the present invention disclose technical scope in; can expect easily changing or replacing, within all should being encompassed in protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of described claim.
Claims (11)
1. a CDN file memory method, is characterized in that, is applied to content delivering system, and described method comprises:
File distributing control centre obtains file to be stored;
Described file distributing control centre judges the type of described file to be stored, and wherein, the type of described file to be stored is cold spot file, focus file or superthermal dot file;
If described file to be stored is described cold spot file, described file distributing control centre sends the first file storing message to memory node, to make cold spot file described in a server stores of described memory node;
If described file to be stored is described focus file or described superthermal dot file, described file distributing control centre sends the second file storing message to described memory node and fringe node, to make described memory node and described fringe node store described focus file or described superthermal dot file.
2. CDN file memory method according to claim 1, is characterized in that, described the second file storing message comprises focus file storing message and superthermal dot file storing message;
If described file to be stored is focus file or superthermal dot file, described file distributing control centre sends the second file storing message to described memory node and fringe node, specifically comprises:
If described file to be stored is described focus file, described file distributing control centre sends described focus file storing message to described memory node and described fringe node, to make focus file described in a server of described memory node and a server stores of described fringe node;
If described file to be stored is described superthermal dot file, described file distributing control centre sends described superthermal dot file storing message to described memory node and described fringe node, to make the Servers-all of described memory node and the described superthermal dot file of the Servers-all storage of described fringe node.
3. CDN file memory method according to claim 1, is characterized in that, before described file distributing control centre obtains file to be stored, described method also comprises:
Described file distributing control centre obtains the first data;
Described file distributing control centre analyzes described the first data, spanned file list of types, and described file type list is for the type of log file;
Described file distributing control centre stores described file type list.
4. CDN file memory method according to claim 3, is characterized in that, described the first data at least comprise log statistic data and page exposure data;
Described file distributing control centre analyzes described the first data, and spanned file list of types, specifically comprises:
Described file distributing control centre is according to log statistic data and page exposure data, the liveness of statistics file, the visit capacity in the access sum that the liveness of described file is file, last access time or the first Preset Time section;
If the liveness of described file is less than the first default thresholding, the type that described file distributing control centre records described file in described file type list is cold spot file;
If the liveness of described file is more than or equal to the first default thresholding, and be less than the second default thresholding, the type that described file distributing control centre records described file in described file type list is focus file;
If the liveness of described file is more than or equal to the second default thresholding, the type that described file distributing control centre records described file in described file type list is superthermal dot file.
5. CDN file memory method according to claim 4, is characterized in that, described file distributing control centre judges the type of described file to be stored, specifically comprises:
The type that described file to be stored is searched in described file type list by described file distributing control centre.
6. a file distributing control centre, is characterized in that, is applied to content delivering system, and described file distributing control centre comprises:
The first acquisition module, for obtaining file to be stored;
Judge module, for judging the type of described file to be stored, wherein, the type of described file to be stored is cold spot file, focus file or superthermal dot file;
The first sending module, if be described cold spot file for described file to be stored, sends the first file storing message to memory node, to make cold spot file described in a server stores of described memory node;
The second sending module, if be described focus file or described superthermal dot file for described file to be stored, send the second file storing message to described memory node and fringe node, to make described memory node and described fringe node store described focus file or described superthermal dot file.
7. file distributing according to claim 6 control centre, is characterized in that, described the second file storing message comprises focus file storing message and superthermal dot file storing message;
Described the second sending module, specifically comprises:
First sends submodule, if be described focus file for described file to be stored, send described focus file storing message to described memory node and described fringe node, to make focus file described in a server of described memory node and a server stores of described fringe node;
Second sends submodule, if be described superthermal dot file for described file to be stored, send described superthermal dot file storing message to described memory node and described fringe node, to make the Servers-all of described memory node and the described superthermal dot file of the Servers-all storage of described fringe node.
8. file distributing according to claim 6 control centre, is characterized in that, described file distributing control centre, also comprises:
The second acquisition module, before obtaining file to be stored at described the first acquisition module, obtains the first data;
Processing module, for analyzing described the first data, spanned file list of types, described file type list is for the type of log file;
Memory module, for storing described file type list.
9. file distributing according to claim 8 control centre, is characterized in that, described the first data at least comprise log statistic data and page exposure data;
Described processing module, specifically comprises:
Statistics submodule, for according to log statistic data and page exposure data, the liveness of statistics file, the visit capacity in the access sum that the liveness of described file is file, last access time or the first Preset Time section;
The first record sub module, if be less than the first default thresholding for the liveness of described file, the type that records described file in described file type list is cold spot file;
The second record sub module, if be more than or equal to the first default thresholding for the liveness of described file, and is less than the second default thresholding, and the type that records described file in described file type list is focus file;
The 3rd record sub module, if be more than or equal to the second default thresholding for the liveness of described file, the type that records described file in described file type list is superthermal dot file.
10. file distributing according to claim 9 control centre, is characterized in that, described judge module, specifically for the type of searching described file to be stored in described file type list.
11. 1 kinds of content delivering systems, it is characterized in that, comprise the file distributing control centre having as described in any one in claim 5-10, for storing the memory node of cold spot file, focus file or superthermal dot file, and for storing the fringe node of described focus file or described superthermal dot file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310723056.5A CN103747047A (en) | 2013-12-24 | 2013-12-24 | CDN file storage method, file distribution control center and system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310723056.5A CN103747047A (en) | 2013-12-24 | 2013-12-24 | CDN file storage method, file distribution control center and system thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103747047A true CN103747047A (en) | 2014-04-23 |
Family
ID=50504034
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310723056.5A Pending CN103747047A (en) | 2013-12-24 | 2013-12-24 | CDN file storage method, file distribution control center and system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103747047A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105100953A (en) * | 2014-05-23 | 2015-11-25 | 中国移动通信集团江苏有限公司 | Method and system for video distribution |
| CN105447086A (en) * | 2015-11-06 | 2016-03-30 | 深圳市网心科技有限公司 | File storage method and server for implementing storage method |
| CN105763585A (en) * | 2014-12-17 | 2016-07-13 | 中兴通讯股份有限公司 | Method of implementing data pushing function and GSLB |
| CN105959368A (en) * | 2016-04-29 | 2016-09-21 | 成都信息工程大学 | Social cloud hot spot resource prediction and disposition method |
| CN106936877A (en) * | 2015-12-31 | 2017-07-07 | 华为软件技术有限公司 | A kind of content distribution method, apparatus and system |
| WO2018145228A1 (en) * | 2017-02-13 | 2018-08-16 | Pivotal Software, Inc. | Quality of access reports in distributed storage systems |
| CN105069074B (en) * | 2015-07-30 | 2018-11-20 | 江苏天联信息科技发展有限公司 | policy configuration file processing method, device and system |
| CN110290399A (en) * | 2019-06-25 | 2019-09-27 | 深圳市网心科技有限公司 | A kind of data distributing method, system, device and computer readable storage medium |
| CN110471897A (en) * | 2019-08-22 | 2019-11-19 | 湖南快乐阳光互动娱乐传媒有限公司 | File management method and device |
| CN110856007A (en) * | 2019-11-21 | 2020-02-28 | 咪咕视讯科技有限公司 | Content distribution network, storage optimization method thereof, electronic device, and storage medium |
| CN111309254A (en) * | 2020-02-03 | 2020-06-19 | 北京字节跳动网络技术有限公司 | Data processing method and device, readable medium and electronic equipment |
| CN111405317A (en) * | 2019-01-02 | 2020-07-10 | 中国移动通信有限公司研究院 | Video distribution and downloading method and device |
| CN113296924A (en) * | 2020-04-28 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Content distribution method, device, system and storage medium |
| CN113542420A (en) * | 2021-07-19 | 2021-10-22 | 北京金山云网络技术有限公司 | Hotspot file processing method and device, electronic equipment and medium |
| CN114422522A (en) * | 2020-10-13 | 2022-04-29 | 贵州白山云科技股份有限公司 | Cache distribution method, device, medium and equipment |
| CN114640690A (en) * | 2022-05-17 | 2022-06-17 | 浙江省公众信息产业有限公司无线运营分公司 | File storage method, system, medium and equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1752894A2 (en) * | 2005-07-21 | 2007-02-14 | Sony Corporation | Content providing system, content providing apparatus and method, content distribution server, and content receiving terminal |
| CN1956448A (en) * | 2005-10-28 | 2007-05-02 | 中兴通讯股份有限公司 | Contents distributing method based on outer condition trigger node action |
| CN101345690A (en) * | 2007-07-12 | 2009-01-14 | 中国电信股份有限公司 | Contents grading memory of telecommunication level P2P network and transmission method |
| CN101729272A (en) * | 2008-10-27 | 2010-06-09 | 华为技术有限公司 | Method, system and device for content distribution, and media server |
| CN103220367A (en) * | 2013-05-13 | 2013-07-24 | 深圳市中博科创信息技术有限公司 | Data replicating method and data storing system |
-
2013
- 2013-12-24 CN CN201310723056.5A patent/CN103747047A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1752894A2 (en) * | 2005-07-21 | 2007-02-14 | Sony Corporation | Content providing system, content providing apparatus and method, content distribution server, and content receiving terminal |
| CN1956448A (en) * | 2005-10-28 | 2007-05-02 | 中兴通讯股份有限公司 | Contents distributing method based on outer condition trigger node action |
| CN101345690A (en) * | 2007-07-12 | 2009-01-14 | 中国电信股份有限公司 | Contents grading memory of telecommunication level P2P network and transmission method |
| CN101729272A (en) * | 2008-10-27 | 2010-06-09 | 华为技术有限公司 | Method, system and device for content distribution, and media server |
| CN103220367A (en) * | 2013-05-13 | 2013-07-24 | 深圳市中博科创信息技术有限公司 | Data replicating method and data storing system |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105100953A (en) * | 2014-05-23 | 2015-11-25 | 中国移动通信集团江苏有限公司 | Method and system for video distribution |
| CN105100953B (en) * | 2014-05-23 | 2019-07-05 | 中国移动通信集团江苏有限公司 | A kind of method and system of video distribution |
| CN105763585A (en) * | 2014-12-17 | 2016-07-13 | 中兴通讯股份有限公司 | Method of implementing data pushing function and GSLB |
| CN105069074B (en) * | 2015-07-30 | 2018-11-20 | 江苏天联信息科技发展有限公司 | policy configuration file processing method, device and system |
| CN105447086A (en) * | 2015-11-06 | 2016-03-30 | 深圳市网心科技有限公司 | File storage method and server for implementing storage method |
| CN106936877A (en) * | 2015-12-31 | 2017-07-07 | 华为软件技术有限公司 | A kind of content distribution method, apparatus and system |
| CN105959368A (en) * | 2016-04-29 | 2016-09-21 | 成都信息工程大学 | Social cloud hot spot resource prediction and disposition method |
| CN105959368B (en) * | 2016-04-29 | 2019-04-02 | 成都信息工程大学 | A kind of method of social activity cloud hot point resource prediction and deployment |
| WO2018145228A1 (en) * | 2017-02-13 | 2018-08-16 | Pivotal Software, Inc. | Quality of access reports in distributed storage systems |
| CN111405317B (en) * | 2019-01-02 | 2022-01-25 | 中国移动通信有限公司研究院 | Video distribution and downloading method and device |
| CN111405317A (en) * | 2019-01-02 | 2020-07-10 | 中国移动通信有限公司研究院 | Video distribution and downloading method and device |
| CN110290399A (en) * | 2019-06-25 | 2019-09-27 | 深圳市网心科技有限公司 | A kind of data distributing method, system, device and computer readable storage medium |
| CN110290399B (en) * | 2019-06-25 | 2021-09-24 | 深圳市网心科技有限公司 | Data distribution method, system, device and computer readable storage medium |
| CN110471897A (en) * | 2019-08-22 | 2019-11-19 | 湖南快乐阳光互动娱乐传媒有限公司 | File management method and device |
| CN110471897B (en) * | 2019-08-22 | 2021-10-01 | 湖南快乐阳光互动娱乐传媒有限公司 | File management method and device |
| CN110856007B (en) * | 2019-11-21 | 2021-12-03 | 咪咕视讯科技有限公司 | Content distribution network, storage optimization method thereof, electronic device, and storage medium |
| CN110856007A (en) * | 2019-11-21 | 2020-02-28 | 咪咕视讯科技有限公司 | Content distribution network, storage optimization method thereof, electronic device, and storage medium |
| CN111309254A (en) * | 2020-02-03 | 2020-06-19 | 北京字节跳动网络技术有限公司 | Data processing method and device, readable medium and electronic equipment |
| CN113296924A (en) * | 2020-04-28 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Content distribution method, device, system and storage medium |
| CN113296924B (en) * | 2020-04-28 | 2022-07-22 | 阿里巴巴集团控股有限公司 | Content distribution method, device, system and storage medium |
| CN114422522A (en) * | 2020-10-13 | 2022-04-29 | 贵州白山云科技股份有限公司 | Cache distribution method, device, medium and equipment |
| CN114422522B (en) * | 2020-10-13 | 2024-02-13 | 贵州白山云科技股份有限公司 | Cache distribution method, device, medium and equipment |
| CN113542420A (en) * | 2021-07-19 | 2021-10-22 | 北京金山云网络技术有限公司 | Hotspot file processing method and device, electronic equipment and medium |
| CN113542420B (en) * | 2021-07-19 | 2023-07-04 | 北京金山云网络技术有限公司 | Processing method and device of hot spot file, electronic equipment and medium |
| CN114640690A (en) * | 2022-05-17 | 2022-06-17 | 浙江省公众信息产业有限公司无线运营分公司 | File storage method, system, medium and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103747047A (en) | CDN file storage method, file distribution control center and system thereof | |
| CN103747112A (en) | CDN back-to-source method, first server and system thereof | |
| US8577892B2 (en) | Utilizing affinity groups to allocate data items and computing resources | |
| CN103746934A (en) | CDN bandwidth balancing method, CDN control center and system | |
| CN103747049A (en) | CDN file distribution method, control center and system | |
| US20100312749A1 (en) | Scalable lookup service for distributed database | |
| CN106407207B (en) | Real-time newly-added data updating method and device | |
| US10356150B1 (en) | Automated repartitioning of streaming data | |
| AU2016238862B2 (en) | Adaptive service timeouts | |
| CN104462240A (en) | Method and system for realizing hierarchical storage and management in cloud storage | |
| US9355121B1 (en) | Segregating data and metadata in a file system | |
| CN103077197A (en) | Data storing method and device | |
| CN106407191B (en) | Data processing method and server | |
| CN110381151A (en) | A kind of warping apparatus detection method and device | |
| CN105354193A (en) | Caching method, query method, caching apparatus and query apparatus for database data | |
| CN103747276A (en) | CDN data deletion method and CDN server | |
| CN111562884A (en) | Data storage method and device and electronic equipment | |
| CN102970349B (en) | A kind of memory load equalization methods of DHT network | |
| CN105653463A (en) | Storage management system, management unit and method | |
| US11431669B2 (en) | Server configuration method and apparatus | |
| CN103747043A (en) | CDN server dispatching method, CDN control center and system | |
| CN104883394A (en) | Method and system for server load balancing | |
| CN105338097A (en) | Terminal screen size-based flow control method, terminal and business server | |
| CN111597129A (en) | Cache management method and device, storage medium and solid-state nonvolatile storage device | |
| CN103746870A (en) | CDN delivery network analysis method, file delivery control center and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160108 Address after: 100081 Beijing, Zhongguancun, South Street, No. 1, building 689, building 1153, No., No. 5 Applicant after: LETV CLOUD COMPUTING CO., LTD. Address before: Room six, building 19, building 68, No. 100089 South Road, Haidian District, Beijing Applicant before: LeTV Information Technology (Beijing) Co., Ltd. |
|
| AD01 | Patent right deemed abandoned |
Effective date of abandoning: 20190104 |
|
| AD01 | Patent right deemed abandoned |