CN102891869A - CDN (Content Delivery Network) and content distribution and scheduling method - Google Patents
CDN (Content Delivery Network) and content distribution and scheduling method Download PDFInfo
- Publication number
- CN102891869A CN102891869A CN2011102027058A CN201110202705A CN102891869A CN 102891869 A CN102891869 A CN 102891869A CN 2011102027058 A CN2011102027058 A CN 2011102027058A CN 201110202705 A CN201110202705 A CN 201110202705A CN 102891869 A CN102891869 A CN 102891869A
- Authority
- CN
- China
- Prior art keywords
- content
- server
- media server
- list
- edge
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention relates to a CDN (Content Delivery Network), comprising a content distribution layer, at least one-level delivery layer and an edge service layer, wherein the content distribution layer comprises a central content management server and at least one content storage server, and contents are stored in the content storage server respectively and are uniformly managed by the central content management server; the delivery layer comprises a content delivery server and at least one central media server, wherein the content delivery server obtains the contents in the content storage server through the central content management server and then delivers the obtained contents to the central media server; and the edge service layer comprises at least one edge server, the edge server acquires the contents in the central media server, stores the contents as popular programs, and provides the on-demand service for users.
Description
Technical field
The present invention relates to a kind of content distributing network, and relate to content issue and the dispatching method of realizing based on this network, the particularly method of the issue of the content of oriented towards education resource and scheduling.
Background technology
At present, there is the content distributing network (Content Delivery Network, be called for short CDN) of oneself in domestic and international many companies, mostly are used for doing the issue of streaming medium content, but there are some functions limitations in the CDN of standard to the issue of teaching resource.
In educational system, its form of service need to be supported flexibly manual distribution policy, and content operator can directly be pushed to the content of making center media server (CMS) and edge media server (EMS), makes the user can in time carry out program request.
Need to support to manage and the content issue by zones such as provinces and cities, satisfy each provinces and cities' educational system to version difference and other requirement of content regions, can be content distributed separately for certain city or certain school, also can unify to the whole province content distributed.
Need to support the plurality of kinds of contents form, make things convenient for the expansion of content format and administrative staff to manage and safeguard, therefore need to manage, distribute and preserve with bibliographic structure content.
The Automatic dispatching strategy that needs intelligence rationally is increased in number of copies on the server with the content of high temperature, and content that will low temperature reduces the number of copies on server, makes content according to temperature accurately, reasonably be distributed on the Edge Server.When service is provided for the user, can dispatch based on load condition and user's proximity of Edge Server, selecting provides service from the server of user close to relatively, improves service quality.
Summary of the invention
Be easy-to-read, the noun abbreviation of using among the present invention is listed below.
CDN:Content Delivery Network, content distributing network.
CCM:Central Content Manage, the centre point management server provides the functions such as Content Management, distribution management.
CSS:Content Storage Server, content storage server is stored part or all content, all whole contents of CSS storage.
CMS:Central Media Server, center media server provides the user order program service, stores all online programs.
EMS:Edge Media Server, the edge media server provides the user order program service, stores online hot broadcast program.
CCS:Content Cache Server, content caching server provides content distribution service, the content that buffer memory need to be distributed.
CDS:Content Distribute Server, content distributing server provides management and the control of contents distribution, and the memory contents distributed data provides the content load service.
The purpose of this invention is to provide a kind of content distributing network, this content distributing network can satisfy the demand of the flexible distributing contents of content supplier, the smooth expansion of support media server; Strengthen content intelligence proportioning, alleviate center media server pressure, improve the service ability of whole system; Select relatively idle server nearby, improve the service quality to the user.
For achieving the above object, the present invention is by the following technical solutions:
A kind of content distributing network, it comprises content issue layer, at least one grade of distributing layer and edge service layer,
Described content issue layer comprises centre point management server and at least one content storage server, and wherein, content is placed on respectively on the content storage server, is managed concentratedly by the centre point management server;
Described distributing layer is made of content distributing server and at least one center media server, wherein, content distributing server is transferred content in the content storage server by the centre point management server, then content distributing server with the contents distribution transferred to center media server;
Described edge service layer is made of at least one Edge Server, and Edge Server obtains content from center media server, and this content is stored as the hot broadcast program, for the user provides order program service.
When the content storage server load was excessive, described center media server was from another regional center media server downloading contents.
Described distributing layer also comprises content caching server, and described content caching server carries out buffer memory to the content of downloading from content storage server, and then offers center media server.
Adopt the P2P downloading mode between described center media server and content caching server, content storage server, another regional center media server; Adopt the P2P downloading mode between described edge media server and other edge media servers.
In described content storage server, bibliographic structure is all adopted in depositing and downloading of content, and a resource saves as a subdirectory, and there are a plurality of files and subdirectory in the inside, during download the whole catalogue download of resource is come.
A kind of method that fast content is pushed to center media server and edge media server that realizes based on above-mentioned network, it may further comprise the steps:
(1), the content operation personnel formulate the contents distribution plan;
(2) if meaningful caching server, then content caching server is from the content storage server downloading contents, if carrying out content again when load drops to normal range (NR), downloads content storage server overburden then wait for, if there is not content caching server, and execution in step (3) then;
(3), to the plan appointment time, center media server automatically performs, according to the policy selection loading source;
(4), center media server download complete after, write distribution of content information to database;
(5), distributing layer is made the distribution schedule creation of edge media server automatically according to the initial temperature of content;
(6), with the metamessage of the content door of reaching the standard grade, browse and program request for the user provides;
(7), to the plan appointment time, the edge media server automatically performs, according to the policy selection loading source;
(8), the edge media server download complete after, write distribution of content information to database;
(9), with the metamessage of the content edge media server of reaching the standard grade, browse and program request for the user provides.
Described step (5) specifically may further comprise the steps:
(5.1) calculate quantity that needs are distributed in the edge media server to satisfy user's service request according to the service ability of the initial temperature of content and server, if initial temperature is 0, then be not distributed to the edge media server;
(5.2) the load Bit-reversed current according to the edge media server selects the minimum N platform of load as the distribution destination server;
(5.3) check the disk space of destination server, if Insufficient disk space then do deletion and plan to remove enough spaces and distribute, specific strategy is as follows:
(5.3.1) the content on this server according to program request temperature Bit-reversed;
(5.3.2) filter out the program request temperature and surpass the initial temperature of distributing contents and the content in resident duration;
(5.3.3) begin to add up from the minimum content of program request temperature, the shared disk space size of calculation content is until size is cumulative complete above the content size that needs distribution or tabulation;
If (5.3.4) size surpasses the content size that needs distribution, then make deletion plan and the distribution schedule creation of this server, circulation step (5.3) is until handle all destination servers;
If (5.3.5) the cumulative complete size of contents list is then abandoned this destination server still less than the content size of needs distribution, enter step (5.2), reselect destination server.
The method that a kind of content that realizes based on above-mentioned network refreshes automatically may further comprise the steps:
1., obtain all contents lisies (all_list) of a group switching centre media server and edge media server;
2., remove residence time less than the content of the resident duration of setting, obtain contents list (do_list);
3., obtain the middle all the elements of contents list (do_list) at T user's in the time interval program request amount Pt;
4., the content in the contents list (do_list) is carried out Bit-reversed according to user's program request amount Pt;
5., each content in the circular treatment contents list (do_list), according to program request amount, content size, content duration, server number and the concurrent service ability of server of content, calculating each content should be at the calculating number of copies Vt of edge media server distribution;
6., obtain the current actual number of copies Vc on the edge media server of each content in the contents list (do_list);
7., relatively calculating number of copies Vt and the actual number of copies Vc of each content in the contents list (do_list), will calculate number of copies Vt and add Distribution List (dis_list) greater than the content of actual number of copies Vc, and record distribution umber Vd, wherein Vd=Vt-Vc; Add delete list (del_list) with calculating the content of number of copies Vt less than actual number of copies Vc, and record deletion umber Vr, Vr=Vc-Vt;
8., each content in the circular treatment delete list (del_list), searching has the edge media of this content server and by the load Bit-reversed of server, Vr server of the deletion umber that load is the highest adds the deletion plan, and the contents list of update server and disk remaining space;
9., each content in the circular treatment Distribution List (dis_list), search the edge media server of this content not and by the load ordering of server, Vd server of load distribution umber minimum and that enough disk spaces are arranged added distribution schedule creation, and the contents list of update server and disk remaining space;
10., the edge media server is at network idle execution deletion plan and distribution schedule creation, to adjust content in the distribution of edge media server.
A kind of method of the content load that realizes based on above-mentioned network, it may further comprise the steps:
I, user's legitimacy is verified, adopted general data security and system security technology to protect, the user by checking can not program request and is browsed any content;
Ii, preferentially load to and have this content and user load minimum but do not surpass the edge media server of threshold value in the one's respective area, if do not have suitable edge media server then load to center media server;
Iii, secondly load to and have this content and user load minimum but do not surpass the edge media server of threshold value in the close region, if do not have suitable edge media server then load to center media server;
If there is not suitable server more than the iv, then search suitable edge media server or center media server from the close region in higher level zone and higher level zone;
V, find suitable edge media server or center media server after, if media server is to share storage, then preferentially load to the local disk of sharing storage, if local disk this content then load on the blade of sharing storage not;
If vi user uses public network IP, then load on the public network IP of media server, if the user uses the VPN network, then load on the VPN network of media server;
Vii, the user is redirected on the public network or VPN network of media server.
Adopt the present invention of technique scheme, networking mode is flexible, the smooth expansion of support media server; Manual ways of distribution can be pushed to content center media server and edge media server fast easily; The Automatic dispatching strategy of intelligence distributes content more reasonable in server network; The user load strategy is selected relatively idle server nearby accurately, improves the service quality to the user.
Description of drawings
Fig. 1 is network structure of the present invention.
Fig. 2 is the download flow chart of CMS.
Fig. 3 is the download flow chart of EMS.
Fig. 4 is the flow chart of making the EMS distribution schedule creation.
Fig. 5 is the flow chart of automatically adjusting distribution of content.
Fig. 6 is the flow chart of content load.
Embodiment
A kind of content distributing network, it comprises content issue layer, at least one grade of distributing layer and edge service layer.
In the whole system, content issue layer has a centre point management server CCM centralized management, the content that one or more content storage server CSS storage is made, wherein, content is placed on respectively on a plurality of content storage server CSS, by the centralized management of centre point management server, when increasing, content can expand easily like this.
Distributing layer comprises content distributing server CDS and the content caching server CCS that is positioned at a zone (province or city), and content caching server CCS perhaps is not set as required; One or more center media server CMS stores all online contents, and above-mentioned content caching server carries out buffer memory to the content of downloading from content storage server, and then offers center media server.Wherein, content distributing server is transferred content in the content storage server by the centre point management server, then content distributing server with the contents distribution transferred to center media server.
The content that one or more edge media server EMS stores a part of hot broadcast is set in the edge service layer, and Edge Server obtains content from center media server, and this content is stored as the hot broadcast program, for the user provides order program service.
Contents distribution and deletions all among the present invention are all carried out with the form of plan, and unified management can be checked the plan executing state easily and intuitively, and whether each program runs succeeded, and what problem each server has very clear.The execution sequence of plan adopts following strategy, and when an existing distribution schedule creation of server also had the deletion plan, preferential execution deletion plan was distributed to ensure enough disk spaces.When existing manual plan has again when automatically refreshing plan, preferentially carry out manual plan.Plan of the same type divides rank, the preferential execution that rank is high, and the plan of doing first when rank is the same is carried out first, when meaningful needs are promptly distributed, can jump the queue according to priority like this.Consider the operation situation of utilizing situation and system of network during executive plan, adopted the network idle to distribute the strategy of distributing with speed limit.The executing state of automatic monitoring and maintenance plan is carried out plan and is re-executed when makeing mistakes, and has saved a lot of manpowers and time.These measures allow content operator can be flexibly, easily content is distributed management.
In content storage server CSS, content deposit and download the employing bibliographic structure, a resource saves as a subdirectory, can there be a plurality of files and subdirectory in the inside, during download the whole catalogue of resource is downloaded and comes.The advantage of doing like this has flexibly autgmentability in being, support the content segmentation, support the various forms such as video, Flash, PPT, Word, picture, the management of various format content, the flow process such as deposit, download, reach the standard grade are just the same, make things convenient for administrative staff to manage and safeguard.
The present invention supports content caching server to enable or do not enable two kinds of patterns, for large-scale application or the many situations of media server, enable content caching server, can first content be downloaded to content caching server from content storage server, provide again center media server to download, further reduce the distribution pressure of content storage server, reduced the concurrent reading and writing pressure to the content storage server disk, improved distribution and the service ability of system.For small-sized system or the fewer situation of media server, do not enable content caching server, can reduce system cost, center media server is directly from the content storage server downloading contents.
When not having content caching server, in order to reduce the pressure of content storage server, a kind of improvement project is arranged.When the load of content storage server was excessive, center media server can be downloaded from another regional center media server by strategy.
The present invention adopts manageable P2P downloading mode, center media server can be downloaded from other center media server, also can download from content caching server or content storage server, the edge media server can be downloaded from other edge media server and center media server, greatly alleviate the pressure of center media server, also improved to a great extent the distribution capability of whole system.Center media server and edge media server can be downloaded simultaneously in addition, have accelerated the distribution speed of whole system.The network configuration of distribution is seen Fig. 1.
The present invention adopts the mode of centralized management, centralized dispatching, and the legitimacy of server is authenticated, and has guaranteed the fail safe of system for content.Because media server adopts the mode of request center certification, so when media server uses the VPN network, also support the distribution of content to download.
The order of downloading contents has adopted intelligent strategy, such as by the file size order, press file what sequentially, according to plan order, random sequence etc., guarantee A server B server downloading contents b in downloading contents a, can realize that like this intersection between the server is downloaded.
Intelligent algorithm has been adopted in the selection of loading source, and, some strategies such as network traffics preferential, type of server preferential such as the zone can guarantee to download from the fastest server.Close region can arrange and adjust according to the real network situation, network traffics and speed are carried out Auto-Sensing, record the network traffics of each server and to up, the downstream rate of other server, different type of servers can be selected different loading source types, can download from CCS or CMS such as CMS, EMS can download from CMS or EMS.The download flow process of CMS is seen Fig. 2, and the download flow process of EMS is seen Fig. 3.
The present invention adopts the strategy of reaching the standard grade flexibly, the door of reaching the standard grade after the center media server download is complete, the edge media server itself of reaching the standard grade after the download of edge media server is complete.The user both can browse and on-demand content by door like this, when door Network Abnormal or edge media server use the VPN network, can ask that the edge media server browses and program request by the receiving of VPN direct network again.
Make again the distribution schedule creation of edge media server after center media server is downloaded successfully according to the initial temperature of content, if insufficient space is made first the deletion plan, so just guaranteed that the edge media server has enough disk spaces in downloading contents.If on the make just make the distribution schedule creation of edge media server when heart media server distribution schedule creation, the situation of edge media server disk insufficient space when just might appear at actual download because might other content operator before and after the making plan or operating personnel also made distribution schedule creation.Make the flow process of edge media server distribution schedule creation and see Fig. 4.
The content of edge media server refreshes has automatically considered the ageing of content, has introduced the concept of resident duration; Consider the concurrent service ability of edge media server, calculated the number of copies of the best according to the program request amount of content; Consider the disk space restriction of edge media server, can automatically delete the content of low program request degree, reasonably utilize disk space, basically can be with 90% user load to the edge media server.Automatically the flow process of adjusting distribution of content is seen Fig. 5.
The content of sharing storage automatically refreshes and the content (configuring the capacity of local disk and shared storage with reference to sixteen principles) of hot broadcast can be flushed to the local disk of sharing storage.When this content of user's program request, preferentially load to the local disk of sharing storage like this, and it is all fast than blade to share the local disk read or write speed of storing, this has also further alleviated the pressure of shared storage blade, has improved the service quality of system.
The integrality of periodic maintenance distribution of content database and door data and correctness make distribution of content remain consistent with content on the disk, reduce the chance that load and program request make mistakes.The correctness of maintenance and administration center data is for administrative staff carry out contents distribution and deletion action provides accurately data.
Content load has used general data security and system security technology to protect, and prevents from stealing chain, prevents from attacking; Try one's best user load on user's edge media server nearest, that load is minimum, when the edge media server not should in perhaps during overburden, load to again on the center media server, all the time guarantee that, the minimum server of load minimum with flow provides service for the user, both improve user's program request quality, improved again the service ability of whole system.Media server is supported public network and two kinds of networks of VPN in addition, satisfies more network users' service request.The flow process of content load is seen Fig. 6.
A kind of method that fast content is pushed to center media server and edge media server that realizes based on above-mentioned network comprises step.
1, the content operation personnel formulate the contents distribution plan, comprise what content of distribution, be distributed to the what sundry services does device, when begin to distribute and the attributes such as initial temperature of content.
If 2 meaningful caching servers (CCS), then content caching server is from content storage server (CSS) downloading contents, if content storage server overburden then wait for that carrying out content when load drops to normal range (NR) downloads again.If there is not content caching server, then execution in step 3.
3, the time centre media server to the plan appointment automatically performs, and according to certain policy selection loading source, specific strategy is as follows.
3.1 the legitimacy to server is verified, adopts the modes such as agreement encryption and timestamp, prevents that agreement is replicated or distorts, and can not download any content by the server of checking.
Whether lock 3.2 check server and distribution services, can not download any content for the server that locks or distribution services.
3.3 preferentially in the one's respective area, have other center media server of this content and select the fastest the downloading of network speed.
If 3.4 this content not all of all center media server in the one's respective area has in close region the center media server of this content and selects the fastest the downloading of network speed.
3.5 if this content not all of all center media server in the close region is then downloaded this content from content caching server, if there is not content caching server, then download this content from content storage server.
3.6 if the network traffics of content caching server or content storage server surpass threshold value, perhaps the performances such as FTP linking number, cpu busy percentage, memory usage surpass threshold value, download when then the performance of center media server waiting for content caching server or content storage server drops to normal range (NR) again.
4, center media server download complete after, write distribution of content information to database.
5, make the distribution schedule creation of edge media server according to the initial temperature of content, concrete steps are as follows.
5.1 be distributed in the service request that a few edge of table media servers could satisfy the user according to the initial temperature of content and the service ability calculating needs of server, if initial temperature is 0, then be not distributed to the edge media server.
5.2 the load Bit-reversed current according to the edge media server selects the minimum N platform of load as the distribution destination server.
5.3 check the disk space of destination server, if Insufficient disk space then do deletion and plan to remove enough spaces and distribute, specific strategy is as follows.
5.3.1 the content on this server according to program request temperature Bit-reversed.
Surpass the initial temperature of distributing contents and the content in resident duration 5.3.2 filter out the program request temperature.
5.3.3 begin to add up from the minimum content of program request temperature, the shared disk space size of calculation content is until size is cumulative complete above the content size that needs distribution or tabulation.
5.3.4 if size surpasses the content size that needs distribution, then make deletion plan and the distribution schedule creation of this server, circulation step 4.3 is until handle all destination servers.
5.3.5 if the cumulative complete size of contents list is then abandoned this destination server still less than the content size of needs distribution, enter step 4.2, reselect destination server.
6, the metamessage of content is reached the standard grade door provides the user to browse and program request.
7, the time edge media server to the plan appointment automatically performs, and according to certain policy selection loading source, specific strategy is as follows.
7.1 the legitimacy to server is verified, adopts the modes such as agreement encryption and timestamp, prevents that agreement is replicated or distorts, and can not download any content by the server of checking.
Whether lock 7.2 check server and distribution services, can not download any content for the server that locks or distribution services.
7.3 preferentially in the one's respective area, have other center media server of this content and the edge media server and select the fastest the downloading of network speed.
If 7.4 all center media server in the one's respective area and edge media server this content not all has in close region the center media server of this content and the edge media server and selects the fastest the downloading of network speed.
If 7.5 all center media server in the close region and edge media server this content is not all waited for then that center media server is downloaded to download after complete again.
7.6 check current performance and the network traffics of destination server and source server, carry out speed limit distribution or at full speed distribution according to the current loading condition of server.
8, the edge media server download complete after, write distribution of content information to database.
9, the metamessage of content is reached the standard grade edge media server is browsed and program request for the user provides as campus version server.
A kind of method that refreshes edge media server and the same shared storage server distribution of content of use that realizes based on above-mentioned network wherein refreshes the edge media server content and comprises step.
1., obtain the contents list all_list of a group switching centre media server and edge media server.
2., remove residence time less than the content of the resident duration of setting, obtain contents list do_list.
3., obtain among the tabulation do_list all the elements at T user's in the time interval program request amount Pt.
4., the content that will tabulate among the do_list is carried out Bit-reversed according to user's program request amount Pt.
5., each content among the circular treatment tabulation do_list, according to the factors such as concurrent service ability of program request amount, content size, content duration, server number and the server of content, calculating each content should be at the number of copies Vt of edge media server distribution.
6., obtain the current copy distribution number Vc on the edge media server of each content among the tabulation do_list.
Calculating number of copies Vt and the actual number of copies Vc of each content among the do_list of 7., relatively tabulating Vt is added Distribution List dis_list greater than the content of Vc, and record need the umber Vd=Vt-Vc of distribution; With the content adding delete list del_list of Vt less than Vc, and record needs the umber Vr=Vc-Vt of deletion.
8., each content among the circular treatment delete list del_list, searching has the edge media of this content server and by the load Bit-reversed of server, the Vr that load is the highest server adds the deletion plan, and the contents list of update server and disk remaining space.
9., each content among the circular treatment Distribution List dis_list, search the edge media server of this content not and by the load ordering of server, load Vd server minimum and that enough disk spaces are arranged added distribution schedule creation, and the contents list of update server and disk remaining space.
10., the edge media server carries out deletion plan and distribution schedule creation in the network idle, reach and adjust content in the purpose of edge media server reasonable layout.When executive plan, concrete content execution sequence, select the source algorithm, carry out the strategy such as server legitimacy authentication and speed limit distribution and manual distribution consistent.
Wherein, refresh shared memory contents and comprise step.
1, obtains the contents list p_list that shares the storage upper blade, and sort by the program request temperature.
2, according to total size of sharing the storage local disk, take out the program of top n hot broadcast from contents list p_list, be saved in tabulation pdo_list.
3, obtain the contents list s_list that shares the upper local disk of storage.
4, comparison pdo_list and s_list will have among the s_list, and do not have the deletion plan of the content adding corresponding with service device of s_list-pdo_list among the pdo_list.
5, compare pdo_list and s_list, will have among the pdo_list, and do not have the content of pdo_list-s_list to join tabulation pdis_list among the s_list.
6, the content in the circular treatment pdis_list tabulation, the selection load is minimum and have the server of enough local disk space to add distribution schedule creation.
The method of a kind of supervision and maintenance plan state comprises step.
1, monitors the plan executing state, if failed download, then download state is reverted to " recovery makes mistakes " state, if reach the standard grade unsuccessfully, then will download and upper line states all reverts to " recovery makes mistakes " state, because major part is reached the standard grade wrong all because content metamessage mistake causes, need again to download.
2, will the make mistakes recovery number of times+1 of plan when recovering will no longer automatically to recover when number of times surpasses setting threshold, needs report manually investigate processing.
3, will plan executing state and be reported to CCM, and make administrative staff unify easily to manage, check intuitively the executing state of regional.
The method that a kind of maintenance content distributes comprises step.
1, the content on the traversal media server is deleted the content of damaging, the content that file is incomplete from disk, and the update content distributed data base.
2, the content that has in the distribution of content database but do not have on the media server disk is deleted from the distribution of content database.
3, the content that does not have in the distribution of content database but have on the media server disk is inserted the distribution of content database.
4, compare the content information of distribution of content database and door and administrative center, be as the criterion with distribution of content, with the unnecessary content information deletion of door and administrative center, few content information inserts.
A kind of method of content load comprises step:
I, user's legitimacy is verified, adopted general data security and system security technology to protect, the user by checking can not program request and is browsed any content.
Ii, preferentially load to and have this content and user load minimum but do not surpass the edge media server of threshold value in the one's respective area, if do not have suitable edge media server then load to center media server.
Iii, secondly load to and have this content and user load minimum but do not surpass the edge media server of threshold value in the close region, if do not have suitable edge media server then load to center media server.
If there is not suitable server more than the iv, then search suitable edge media server or center media server from the close region in higher level zone and higher level zone.
V, find suitable edge media server or center media server after, if media server is to share storage, then preferentially load to the local disk of sharing storage, if local disk this content then load on the blade of sharing storage not.
If vi user uses public network IP, then load on the public network IP of media server, if the user uses the VPN network, then load on the VPN network of media server.
Vii, the user is redirected on the public network or VPN network of media server.
Claims (9)
1. content distributing network, it comprises content issue layer, at least one grade of distributing layer and edge service layer, it is characterized in that:
Described content issue layer comprises centre point management server and at least one content storage server, and wherein, content is placed on respectively on the content storage server, is managed concentratedly by the centre point management server;
Described distributing layer is made of content distributing server and at least one center media server, wherein, content distributing server is transferred content in the content storage server by the centre point management server, then content distributing server with the contents distribution transferred to center media server;
Described edge service layer is made of at least one Edge Server, and Edge Server obtains content from center media server, and this content is stored as the hot broadcast program, for the user provides order program service.
2. content distributing network according to claim 1, it is characterized in that: when the content storage server load was excessive, described center media server was from another regional center media server downloading contents.
3. content distributing network according to claim 1, it is characterized in that: described distributing layer also comprises content caching server, described content caching server carries out buffer memory to the content of downloading from content storage server, and then offers center media server.
4. content distributing network according to claim 3 is characterized in that: adopt the P2P downloading mode between described center media server and content caching server, content storage server, another regional center media server; Adopt the P2P downloading mode between described edge media server and other edge media servers.
5. content distributing network according to claim 1, it is characterized in that: in described content storage server, bibliographic structure is all adopted in depositing and downloading of content, a resource saves as a subdirectory, there are a plurality of files and subdirectory in the inside, during download the whole catalogue download of resource is come.
6. method that fast content is pushed to center media server and edge media server that realizes based on the described network of claim 1, it may further comprise the steps:
(1), the content operation personnel formulate the contents distribution plan;
(2) if meaningful caching server, then content caching server is from the content storage server downloading contents, if carrying out content again when load drops to normal range (NR), downloads content storage server overburden then wait for, if there is not content caching server, and execution in step (3) then;
(3), to the plan appointment time, center media server automatically performs, according to the policy selection loading source;
(4), center media server download complete after, write distribution of content information to database;
(5), distributing layer is made the distribution schedule creation of edge media server automatically according to the initial temperature of content;
(6), with the metamessage of the content door of reaching the standard grade, browse and program request for the user provides;
(7), to the plan appointment time, the edge media server automatically performs, according to the policy selection loading source;
(8), the edge media server download complete after, write distribution of content information to database;
(9), with the metamessage of the content edge media server of reaching the standard grade, browse and program request for the user provides.
7. the method that fast content is pushed to center media server and edge media server according to claim 6 is characterized in that, described step (5) specifically may further comprise the steps:
(5.1) calculate quantity that needs are distributed in the edge media server to satisfy user's service request according to the service ability of the initial temperature of content and server, if initial temperature is 0, then be not distributed to the edge media server;
(5.2) the load Bit-reversed current according to the edge media server selects the minimum N platform of load as the distribution destination server;
(5.3) check the disk space of destination server, if Insufficient disk space then do deletion and plan to remove enough spaces and distribute, specific strategy is as follows:
(5.3.1) the content on this server according to program request temperature Bit-reversed;
(5.3.2) filter out the program request temperature and surpass the initial temperature of distributing contents and the content in resident duration;
(5.3.3) begin to add up from the minimum content of program request temperature, the shared disk space size of calculation content is until size is cumulative complete above the content size that needs distribution or tabulation;
If (5.3.4) size surpasses the content size that needs distribution, then make deletion plan and the distribution schedule creation of this server, circulation step (5.3) is until handle all destination servers;
If (5.3.5) the cumulative complete size of contents list is then abandoned this destination server still less than the content size of needs distribution, enter step (5.2), reselect destination server.
8. method that the content that realizes based on the described network of claim 1 refreshes automatically, it may further comprise the steps:
1., obtain all contents lisies (all_list) of a group switching centre media server and edge media server;
2., remove residence time less than the content of the resident duration of setting, obtain contents list (do_list);
3., obtain the middle all the elements of contents list (do_list) at T user's in the time interval program request amount Pt;
4., the content in the contents list (do_list) is carried out Bit-reversed according to user's program request amount Pt;
5., each content in the circular treatment contents list (do_list), according to program request amount, content size, content duration, server number and the concurrent service ability of server of content, calculating each content should be at the calculating number of copies Vt of edge media server distribution;
6., obtain the current actual number of copies Vc on the edge media server of each content in the contents list (do_list);
7., relatively calculating number of copies Vt and the actual number of copies Vc of each content in the contents list (do_list), will calculate number of copies Vt and add Distribution List (dis_list) greater than the content of actual number of copies Vc, and record distribution umber Vd, wherein Vd=Vt-Vc; Add delete list (del_list) with calculating the content of number of copies Vt less than actual number of copies Vc, and record deletion umber Vr, Vr=Vc-Vt;
8., each content in the circular treatment delete list (del_list), searching has the edge media of this content server and by the load Bit-reversed of server, Vr server of the deletion umber that load is the highest adds the deletion plan, and the contents list of update server and disk remaining space;
9., each content in the circular treatment Distribution List (dis_list), search the edge media server of this content not and by the load ordering of server, Vd server of load distribution umber minimum and that enough disk spaces are arranged added distribution schedule creation, and the contents list of update server and disk remaining space;
10., the edge media server is at network idle execution deletion plan and distribution schedule creation, to adjust content in the distribution of edge media server.
9. the method for a content load that realizes based on the described network of claim 1, it may further comprise the steps:
I, user's legitimacy is verified, adopted general data security and system security technology to protect, the user by checking can not program request and is browsed any content;
Ii, preferentially load to and have this content and user load minimum but do not surpass the edge media server of threshold value in the one's respective area, if do not have suitable edge media server then load to center media server;
Iii, secondly load to and have this content and user load minimum but do not surpass the edge media server of threshold value in the close region, if do not have suitable edge media server then load to center media server;
If there is not suitable server more than the iv, then search suitable edge media server or center media server from the close region in higher level zone and higher level zone;
V, find suitable edge media server or center media server after, if media server is to share storage, then preferentially load to the local disk of sharing storage, if local disk this content then load on the blade of sharing storage not;
If vi user uses public network IP, then load on the public network IP of media server, if the user uses the VPN network, then load on the VPN network of media server;
Vii, the user is redirected on the public network or VPN network of media server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110202705.8A CN102891869B (en) | 2011-07-20 | 2011-07-20 | CDN (Content Delivery Network) and content distribution and scheduling method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110202705.8A CN102891869B (en) | 2011-07-20 | 2011-07-20 | CDN (Content Delivery Network) and content distribution and scheduling method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102891869A true CN102891869A (en) | 2013-01-23 |
| CN102891869B CN102891869B (en) | 2015-07-15 |
Family
ID=47535235
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110202705.8A Active CN102891869B (en) | 2011-07-20 | 2011-07-20 | CDN (Content Delivery Network) and content distribution and scheduling method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102891869B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103402128A (en) * | 2013-07-17 | 2013-11-20 | 深圳市龙视传媒有限公司 | Program content management method and device |
| CN104580304A (en) * | 2013-10-18 | 2015-04-29 | 北大方正集团有限公司 | Data downloading method, device and system for distributed platform |
| CN104735481A (en) * | 2013-12-19 | 2015-06-24 | 北京四达时代软件技术股份有限公司 | Video content distribution scheduling method, servers and system |
| CN104967651A (en) * | 2015-03-02 | 2015-10-07 | 深圳市腾讯计算机系统有限公司 | Data push, storage and downloading methods and devices based on CDN architecture |
| CN105843838A (en) * | 2015-02-02 | 2016-08-10 | 国际商业机器公司 | Method and system for managing enterprise network peer-to-peer shared storage |
| CN106101225A (en) * | 2016-06-14 | 2016-11-09 | 苏州嗨嗨网络科技有限公司 | A kind of site resource distribution method and system |
| CN106341474A (en) * | 2016-09-06 | 2017-01-18 | 上海海事大学 | Data control center based on ICN and SDN network and content management method thereof |
| CN106790552A (en) * | 2016-12-23 | 2017-05-31 | 航天星图科技（北京）有限公司 | A kind of content providing system based on content distributing network |
| CN109040308A (en) * | 2018-09-12 | 2018-12-18 | 杭州趣链科技有限公司 | A kind of document distribution system and document distribution method based on IPFS |
| CN109151519A (en) * | 2018-09-03 | 2019-01-04 | 视联动力信息技术股份有限公司 | A kind of configuration distribution method and system based on view networking |
| CN110113654A (en) * | 2019-04-10 | 2019-08-09 | 深圳市宏辉智通科技有限公司 | A kind of P4P technical application method based on local area network |
| CN110651262A (en) * | 2017-05-22 | 2020-01-03 | 麻省理工学院 | Hierarchical distributed storage system and techniques for edge computing systems |
| CN111083519A (en) * | 2019-11-06 | 2020-04-28 | 石家庄微泽科技有限公司 | VR content distribution system and method based on cloud and edge computing |
| CN112350952A (en) * | 2020-10-28 | 2021-02-09 | 武汉绿色网络信息服务有限责任公司 | Controller distribution method and network service system |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1489333A (en) * | 2002-10-10 | 2004-04-14 | 华为技术有限公司 | Method for updating content in content-transmitting network |
| CN1592248A (en) * | 2003-08-29 | 2005-03-09 | 华为技术有限公司 | Layered content distributing network and method thereof |
| CN1981501A (en) * | 2004-03-12 | 2007-06-13 | 汤姆森许可公司 | Method of scheduling the distribution of content files and cache server |
| CN101123602A (en) * | 2006-08-11 | 2008-02-13 | 郑州威科姆电子科技有限公司 | Content scheduling method based on network TV system |
| CN101136932A (en) * | 2006-10-20 | 2008-03-05 | 中兴通讯股份有限公司 | Cluster type stream media networking system and its content issue and service method |
| CN101150421A (en) * | 2006-09-22 | 2008-03-26 | 华为技术有限公司 | A distributed content distribution method, edge server and content distribution network |
| CN101477669A (en) * | 2009-01-08 | 2009-07-08 | 刘钢 | P2P downloading experience for network audio and video product retail e-commerce and application implementation process |
| CN101557423A (en) * | 2009-05-07 | 2009-10-14 | 北京邮电大学 | System and method for realizing streaming media content service |
| CN101557499A (en) * | 2008-04-09 | 2009-10-14 | 中兴通讯股份有限公司 | System and method for delivering media and method for renewing resource of media delivering system |
| CN101582919A (en) * | 2009-04-14 | 2009-11-18 | 冯俊秋 | Method and system for playing of Internet television |
| CN101645922A (en) * | 2009-04-17 | 2010-02-10 | 中国科学院声学研究所 | CDN network system based on geographical position information encoding and distribution treatment method |
-
2011
- 2011-07-20 CN CN201110202705.8A patent/CN102891869B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1489333A (en) * | 2002-10-10 | 2004-04-14 | 华为技术有限公司 | Method for updating content in content-transmitting network |
| CN1592248A (en) * | 2003-08-29 | 2005-03-09 | 华为技术有限公司 | Layered content distributing network and method thereof |
| CN1981501A (en) * | 2004-03-12 | 2007-06-13 | 汤姆森许可公司 | Method of scheduling the distribution of content files and cache server |
| CN101123602A (en) * | 2006-08-11 | 2008-02-13 | 郑州威科姆电子科技有限公司 | Content scheduling method based on network TV system |
| CN101150421A (en) * | 2006-09-22 | 2008-03-26 | 华为技术有限公司 | A distributed content distribution method, edge server and content distribution network |
| CN101136932A (en) * | 2006-10-20 | 2008-03-05 | 中兴通讯股份有限公司 | Cluster type stream media networking system and its content issue and service method |
| CN101557499A (en) * | 2008-04-09 | 2009-10-14 | 中兴通讯股份有限公司 | System and method for delivering media and method for renewing resource of media delivering system |
| CN101477669A (en) * | 2009-01-08 | 2009-07-08 | 刘钢 | P2P downloading experience for network audio and video product retail e-commerce and application implementation process |
| CN101582919A (en) * | 2009-04-14 | 2009-11-18 | 冯俊秋 | Method and system for playing of Internet television |
| CN101645922A (en) * | 2009-04-17 | 2010-02-10 | 中国科学院声学研究所 | CDN network system based on geographical position information encoding and distribution treatment method |
| CN101557423A (en) * | 2009-05-07 | 2009-10-14 | 北京邮电大学 | System and method for realizing streaming media content service |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103402128A (en) * | 2013-07-17 | 2013-11-20 | 深圳市龙视传媒有限公司 | Program content management method and device |
| CN104580304A (en) * | 2013-10-18 | 2015-04-29 | 北大方正集团有限公司 | Data downloading method, device and system for distributed platform |
| CN104735481A (en) * | 2013-12-19 | 2015-06-24 | 北京四达时代软件技术股份有限公司 | Video content distribution scheduling method, servers and system |
| CN104735481B (en) * | 2013-12-19 | 2018-07-06 | 北京四达时代软件技术股份有限公司 | A kind of video content distribution scheduling method, server and system |
| CN105843838A (en) * | 2015-02-02 | 2016-08-10 | 国际商业机器公司 | Method and system for managing enterprise network peer-to-peer shared storage |
| CN104967651A (en) * | 2015-03-02 | 2015-10-07 | 深圳市腾讯计算机系统有限公司 | Data push, storage and downloading methods and devices based on CDN architecture |
| CN104967651B (en) * | 2015-03-02 | 2017-06-27 | 深圳市腾讯计算机系统有限公司 | Data-pushing, storage, method for down loading and device based on CDN frameworks |
| CN106101225A (en) * | 2016-06-14 | 2016-11-09 | 苏州嗨嗨网络科技有限公司 | A kind of site resource distribution method and system |
| CN106341474A (en) * | 2016-09-06 | 2017-01-18 | 上海海事大学 | Data control center based on ICN and SDN network and content management method thereof |
| CN106341474B (en) * | 2016-09-06 | 2019-11-05 | 上海海事大学 | It is a kind of that center and its contents management method are managed based on the data of ICN and SDN network |
| CN106790552B (en) * | 2016-12-23 | 2019-04-09 | 中科星图股份有限公司 | A kind of content providing system based on content distributing network |
| CN106790552A (en) * | 2016-12-23 | 2017-05-31 | 航天星图科技（北京）有限公司 | A kind of content providing system based on content distributing network |
| CN110651262A (en) * | 2017-05-22 | 2020-01-03 | 麻省理工学院 | Hierarchical distributed storage system and techniques for edge computing systems |
| CN110651262B (en) * | 2017-05-22 | 2024-03-26 | 麻省理工学院 | Hierarchical distributed storage system and techniques for edge computing systems |
| CN109151519A (en) * | 2018-09-03 | 2019-01-04 | 视联动力信息技术股份有限公司 | A kind of configuration distribution method and system based on view networking |
| CN109151519B (en) * | 2018-09-03 | 2021-01-22 | 视联动力信息技术股份有限公司 | Configuration distribution method and system based on video network |
| CN109040308A (en) * | 2018-09-12 | 2018-12-18 | 杭州趣链科技有限公司 | A kind of document distribution system and document distribution method based on IPFS |
| CN110113654A (en) * | 2019-04-10 | 2019-08-09 | 深圳市宏辉智通科技有限公司 | A kind of P4P technical application method based on local area network |
| CN111083519A (en) * | 2019-11-06 | 2020-04-28 | 石家庄微泽科技有限公司 | VR content distribution system and method based on cloud and edge computing |
| CN112350952A (en) * | 2020-10-28 | 2021-02-09 | 武汉绿色网络信息服务有限责任公司 | Controller distribution method and network service system |
| CN112350952B (en) * | 2020-10-28 | 2023-04-07 | 武汉绿色网络信息服务有限责任公司 | Controller distribution method and network service system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102891869B (en) | 2015-07-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102891869B (en) | CDN (Content Delivery Network) and content distribution and scheduling method | |
| US8099402B2 (en) | Distributed data storage and access systems | |
| US8954976B2 (en) | Data storage in distributed resources of a network based on provisioning attributes | |
| CN105357296A (en) | Elastic caching system based on Docker cloud platform | |
| US20100332530A1 (en) | Islands of data | |
| US20120047201A1 (en) | Apparatus and method of acquiring or distributing content | |
| Kuo et al. | A hybrid cloud storage architecture for service operational high availability | |
| CN102857578B (en) | A kind of file uploading method of network hard disc, system and net dish client | |
| CN107180102A (en) | The storage method and system of a kind of target characteristic data | |
| Chen et al. | E2FS: an elastic storage system for cloud computing | |
| CN104348793B (en) | The storage method of storage server system and data message | |
| CN102164317A (en) | Internet protocol (IP) set-top box-oriented multi-server segmented downloading system | |
| CN104182487A (en) | Unified storage method supporting various storage modes | |
| Rajalakshmi et al. | An improved dynamic data replica selection and placement in cloud | |
| CN101626389A (en) | Network node management method | |
| Singh et al. | Scalable metadata management techniques for ultra-large distributed storage systems--A systematic review | |
| CN102752399A (en) | Peer-to-peer security file sharing method based on cloud storage | |
| CN102932443A (en) | HDFS (hadoop distributed file system) cluster based distributed cloud storage system | |
| CN202872848U (en) | Cloud storage terminal equipment based on cloud information and cloud computing services | |
| CN106649702A (en) | File storage method and apparatus of cloud storage system, and cloud storage system | |
| CN107810501A (en) | Heterogeneous cache is filled | |
| US9578120B1 (en) | Messaging with key-value persistence | |
| CN111565144A (en) | Data layered storage management method for instant communication tool | |
| CN104038771B (en) | A kind of high-effect files in stream media distributed memory system and method based on Hadoop2 | |
| CN102497359B (en) | Thin client streaming media-based service system running method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |