CN102891869B - CDN (Content Delivery Network) and content distribution and scheduling method - Google Patents
CDN (Content Delivery Network) and content distribution and scheduling method Download PDFInfo
- Publication number
- CN102891869B CN102891869B CN201110202705.8A CN201110202705A CN102891869B CN 102891869 B CN102891869 B CN 102891869B CN 201110202705 A CN201110202705 A CN 201110202705A CN 102891869 B CN102891869 B CN 102891869B
- Authority
- CN
- China
- Prior art keywords
- content
- server
- media server
- list
- edge
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Information Transfer Between Computers (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention relates to a CDN (Content Delivery Network), comprising a content distribution layer, at least one-level delivery layer and an edge service layer, wherein the content distribution layer comprises a central content management server and at least one content storage server, and contents are stored in the content storage server respectively and are uniformly managed by the central content management server; the delivery layer comprises a content delivery server and at least one central media server, wherein the content delivery server obtains the contents in the content storage server through the central content management server and then delivers the obtained contents to the central media server; and the edge service layer comprises at least one edge server, the edge server acquires the contents in the central media server, stores the contents as popular programs, and provides the on-demand service for users.
Description
Technical field
The present invention relates to a kind of content distributing network, and relate to the method issued based on the content issue of this real-time performance and the content of dispatching method, particularly oriented towards education resource and dispatch.
Background technology
At present, there are oneself content distributing network (Content Delivery Network, be called for short CDN) in domestic and international many companies, be mostly used for doing the issue of streaming medium content, but the issue of the CDN of standard to teaching resource exist some functions limitation.
In educational system, its form of service needs to support manual distribution policy flexibly, and the content made directly can be pushed to center media server (CMS) and edge media server (EMS) by content operator, makes user can carry out program request in time.
Need to support to carry out management and content issue by regions such as provinces and cities, meet each provinces and cities' educational system to version differences and other requirement of content regions, can be that certain city or certain school are content distributed separately, also can unify to the whole province content distributed.
Need to support plurality of kinds of contents form, facilitate the expansion of content format and administrative staff to administer and maintain, therefore need to manage with bibliographic structure content, distribute and preserve.
Need the Automatic dispatching strategy of intelligence, the content of high temperature is rationally increased number of copies on the server, the content of low temperature is reduced number of copies on the server, make content accurately, reasonably be distributed on Edge Server according to temperature.When providing service for user, can dispatch based on the load condition of Edge Server and user's proximity, select from user relatively close to server providing services, improve service quality.
Summary of the invention
For convenience of reading, the noun abbreviation of using in the present invention is listed below.
CDN:Content Delivery Network, content distributing network.
CCM:Central Content Manage, centre point management server, provides the function such as Content Management, distribution management.
CSS:Content Storage Server, content storage server, stores part or all content, and all CSS store whole contents.
CMS:Central Media Server, center media server, provides user order program service, stores online all programs.
EMS:Edge Media Server, edge media server, provides user order program service, stores online hot broadcast program.
CCS:Content Cache Server, content caching server, provides content distribution service, and buffer memory needs the content of distribution.
CDS:Content Distribute Server, content distributing server, provides management and the control of contents distribution, stores distribution of content data, provides content load service.
The object of this invention is to provide a kind of content distributing network, this content distributing network can meet the demand of the flexible distributing contents of content supplier, the smooth expansion of support media server; Strengthen content intelligence proportioning, alleviate center media server pressure, improve the service ability of whole system; Select the server of relative free nearby, improve the service quality to user.
For achieving the above object, the present invention is by the following technical solutions:
A kind of content distributing network, it comprises content and issues layer, at least one grade of distributing layer and edge service layer,
Described content is issued layer and is comprised centre point management server and at least one content storage server, and wherein, content is placed in content storage server respectively, is managed concentratedly by centre point management server;
Described distributing layer is made up of content distributing server and at least one center media server, wherein, content distributing server transfers the content in content storage server by centre point management server, then content distributing server by the contents distribution transferred to center media server;
Described edge service layer is made up of at least one Edge Server, and Edge Server obtains content from center media server, and this content is stored as hot broadcast program, for user provides order program service.
When content storage server load is excessive, described center media server is from the center media server downloading contents in another region.
Described distributing layer also comprises content caching server, and described content caching server carries out buffer memory to the content downloaded from content storage server, and then is supplied to center media server.
P2P downloading mode is adopted between the center media server in described center media server and content caching server, content storage server, another region; P2P downloading mode is adopted between described edge media server and other edge media servers.
In described content storage server, depositing and downloading of content all adopts bibliographic structure, and a resource saves as a subdirectory, and there are multiple file and subdirectory in the inside, the whole catalogue of resource is downloaded and come during download.
Based on quick method content being pushed to center media server and edge media server of above-mentioned real-time performance, it comprises the following steps:
(1), content operation personnel formulate contents distribution plan;
(2) if meaningful caching server, then content caching server is from content storage server downloading contents, if content storage server overburden, when waiting for that load drops to normal range (NR), carry out content download again, if there is no content caching server, then perform step (3);
(3), to the time of planning to specify, center media server automatically performs, according to policy selection loading source;
(4), after center media server downloads, to database write distribution of content information;
(5), distributing layer makes the distribution schedule creation of edge media server automatically according to the initial temperature of content;
(6), by the metamessage of content to reach the standard grade door, browse and program request for user provides;
(7), to the time of planning to specify, edge media server automatically performs, according to policy selection loading source;
(8), after edge media server downloads, to database write distribution of content information;
(9), by the metamessage of content to reach the standard grade edge media server, browse and program request for user provides.
Described step (5) specifically comprises the following steps:
(5.1) need the quantity being distributed in edge media server to meet the service request of user according to the initial temperature of content and the service ability calculating of server, if initial temperature is 0, be not then distributed to edge media server;
(5.2) current according to edge media server load Bit-reversed, the N platform selecting load minimum is as distribution destination server;
(5.3) check the disk space of destination server, if Insufficient disk space, do deletion plan and distribute to remove enough spaces, specific strategy is as follows:
(5.3.1) the content on this server according to program request temperature Bit-reversed;
(5.3.2) filter out program request temperature and exceed the initial temperature of distributing contents and the content in resident duration;
(5.3.3) add up from the content that program request temperature is minimum, disk space size shared by Computed-torque control, until size exceed needs distribution content size or list add up complete;
If (5.3.4) size exceedes the content size of needs distribution, then make deletion plan and the distribution schedule creation of this server, circulation step (5.3), until process all destination servers;
If (5.3.5) contents list add up complete size be still less than needs distribution content size, then abandon this destination server, enter step (5.2), reselect destination server.
Based on the method that the content of above-mentioned real-time performance refreshes automatically, comprise the following steps:
1. all content list (all_list) of a group switching centre media server and edge media server, is obtained;
2., remove residence time and be less than the content of the resident duration of setting, obtain contents list (do_list);
3. the program request amount Pt of all the elements user in T time interval in contents list (do_list), is obtained;
4., the content in contents list (do_list) is carried out Bit-reversed according to user's program request amount Pt;
5. each content, in circular treatment contents list (do_list), according to the program request amount of content, content size, content duration, server number and server concurrent services ability, calculating each content should at the calculating number of copies Vt of edge media server distribution;
6., the current actual number of copies Vc on edge media server of each content in contents list (do_list) is obtained;
7., compare the calculating number of copies Vt of each content in contents list (do_list) and actual number of copies Vc, the content that calculating number of copies Vt is greater than actual number of copies Vc is added Distribution List (dis_list), and record distribution number Vd, wherein Vd=Vt-Vc; The content that calculating number of copies Vt is less than actual number of copies Vc is added delete list (del_list), and number Vr deleted in record, Vr=Vc-Vt;
8. each content, in circular treatment delete list (del_list), search the edge media server that there is this content and by the load Bit-reversed of server, deletion number Vr server the highest for load is added deletion plan, and the contents list of update server and disk remaining space;
9. each content, in circular treatment Distribution List (dis_list), search the edge media server of not this content and sort by the load of server, by minimum for load and have distribution number Vd server of enough disk spaces to add distribution schedule creation, and the contents list of update server and disk remaining space;
10., edge media server performs the plan of deletion and distribution schedule creation, with the distribution of Suitable content at edge media server in network idle.
Based on a method for the content load of above-mentioned real-time performance, it comprises the following steps:
I, the legitimacy of user to be verified, adopt general data security and system security technology to protect, can not program request and browse any content by the user of checking;
Ii, preferentially load in one's respective area and have this content and user load is minimum but do not exceed the edge media server of threshold value, if there is no suitable edge media server, load to center media server;
Iii, secondly load in close region and have this content and user load is minimum but do not exceed the edge media server of threshold value, if there is no suitable edge media server, load to center media server;
If iv does not have suitable server above, then search suitable edge media server or center media server from the close region in higher level region and higher level region;
V, find suitable edge media server or center media server after, if media server be share store, then preferentially load to share store local disk, if local disk not this content, load to share store blade on;
If vi user uses public network IP, then load in the public network IP of media server, if user uses VPN, then load in the VPN of media server;
In vii, public network user being redirected to media server or VPN.
Adopt the present invention of technique scheme, networking mode is flexible, the smooth expansion of support media server; Manual ways of distribution easily, can be pushed to center media server and edge media server fast by content; The Automatic dispatching strategy of intelligence, makes content distribute in server network more reasonable; User load strategy accurately, selects the server of relative free nearby, improves the service quality to user.
Accompanying drawing explanation
Fig. 1 is network structure of the present invention.
Fig. 2 is the download flow chart of CMS.
Fig. 3 is the download flow chart of EMS.
Fig. 4 is the flow chart making EMS distribution schedule creation.
Fig. 5 is the flow chart of automatic Suitable content distribution.
Fig. 6 is the flow chart of content load.
Embodiment
A kind of content distributing network, it comprises content and issues layer, at least one grade of distributing layer and edge service layer.
In whole system, content issues layer has a centre point management server CCM to manage concentratedly, the content that one or more content storage server CSS storage is made, wherein, content is placed on multiple content storage server CSS respectively, managed concentratedly by centre point management server, can expand easily when content increases like this.
Distributing layer comprises the content distributing server CDS and content caching server CCS that are positioned at a region (province or city), or does not arrange content caching server CCS as required; One or more center media server CMS stores all online contents, and above-mentioned content caching server carries out buffer memory to the content downloaded from content storage server, and then is supplied to center media server.Wherein, content distributing server transfers the content in content storage server by centre point management server, then content distributing server by the contents distribution transferred to center media server.
Arrange the content that one or more edge media server EMS stores a part of hot broadcast in edge service layer, Edge Server obtains content from center media server, and this content is stored as hot broadcast program, for user provides order program service.
Contents distributions all in the present invention and deletion are all carried out with the form of plan, and unified management, can check plan executing state easily and intuitively, whether each program runs succeeded, and what problem each server has very clear.The execution sequence of plan adopts following strategy, when an existing distribution schedule creation of server also has deletion plan, preferentially performs the plan of deletion, distributes to ensure enough disk spaces.When existing manual plan has again automatic refreshing plan, the manual plan of preferential execution.Plan of the same type divides rank, the preferential execution that rank is high, and the plan first done when rank is the same first performs, and like this when meaningful needs are promptly distributed, can jump the queue according to priority.Take into account the utilization power of network and the traffic-operating period of system during executive plan, have employed the strategy that network idle carries out distributing and speed limit is distributed.The executing state of automatic monitoring and maintenance plan, makes plan perform when makeing mistakes and is re-executed, save a lot of manpower and time.These measures allow content operator can carry out distribution management to content flexibly, easily.
In content storage server CSS, content deposit and download employing bibliographic structure, a resource saves as a subdirectory, and can there be multiple file and subdirectory in the inside, the whole catalogue of resource is downloaded and come during download.The advantage done like this has autgmentability flexibly in being, support content section, support the various form such as video, Flash, PPT, Word, picture, the management of various format content, deposit, download, the flow process such as to reach the standard grade is just the same, facilitates administrative staff to administer and maintain.
The present invention supports content caching server to enable or does not enable two kinds of patterns, for large-scale application or the many situation of media server, enable content caching server, first content can be downloaded to content caching server from content storage server, reoffer center media server to download, reduce further the distribution pressure of content storage server, reduce the concurrent reading and writing pressure to content storage server disk, improve distribution and the service ability of system.For small-sized system or the fewer situation of media server, do not enable content caching server, can reduce system cost, center media server is directly from content storage server downloading contents.
When there is no content caching server, in order to reduce the pressure of content storage server, there is a kind of improvement project.When the load of content storage server is excessive, center media server can be downloaded from the center media server in another region by strategy.
The present invention adopts manageable P2P downloading mode, center media server can be downloaded from other center media server, also can download from content caching server or content storage server, edge media server can be downloaded from other edge media server and center media server, significantly reduce the pressure of center media server, also greatly enhance the distribution capability of whole system.Center media server and edge media server can be downloaded simultaneously in addition, accelerate the distribution speed of whole system.The network configuration of distribution is shown in Fig. 1.
The present invention adopts the mode of centralized management, centralized dispatching, carries out certification, ensure that the fail safe of system for content to the legitimacy of server.Because media server adopts the mode of request center certification, so also support that the distribution of content is downloaded when media server uses during VPN.
The order of downloading contents have employed the strategy of intelligence, such as press file size order, by file how many order, according to plan order, random sequence etc., ensure A server B server downloading contents b when downloading contents a, the intersection that can realize like this between server is downloaded.
The selection of loading source have employed the algorithm of intelligence, and some strategies such as such as area preference, network traffics are preferential, type of server, can ensure to download from the fastest server.Close region can carry out arranging and adjusting according to real network situation, network traffics and speed carry out Auto-Sensing, record the network traffics of each server and up, the downstream rate to other server, different type of servers can select different loading source types, such as CMS can download from CCS or CMS, and EMS can download from CMS or EMS.The download flow process of CMS is shown in Fig. 2, and the download flow process of EMS is shown in Fig. 3.
The present invention adopts strategy of reaching the standard grade flexibly, door of reaching the standard grade after center media server download, edge media server itself of reaching the standard grade after the download of edge media server.Such user both can be browsed and on-demand content by door, when door Network Abnormal or edge media server use VPN, can directly access edge media server again carry out browsing and program request by VPN.
Center media server downloads the distribution schedule creation making edge media server successfully again according to the initial temperature of content, if insufficient space first makes deletion plan, this ensures that thering the edge media server when downloading contents has enough disk spaces.If on the make just make the distribution schedule creation of edge media server while heart media server distribution schedule creation, the situation of edge media server disk insufficient space when just likely appearing at actual download, because likely other content operator or operating personnel have also made distribution schedule creation before and after making plan.The flow process making edge media server distribution schedule creation is shown in Fig. 4.
The content of edge media server automatically refreshes and take into account the ageing of content, has introduced the concept of resident duration; Take into account the concurrent services ability of edge media server, calculate best number of copies according to the program request gauge of content; Consider the disk space restriction of edge media server, automatically can delete the content of low program request degree, reasonably utilize disk space, substantially can by the user load of 90% to edge media server.The flow process of automatic Suitable content distribution is shown in Fig. 5.
Share the content stored automatically to refresh and the content of hot broadcast (with reference to sixteen principles to configure local disk and to share the capacity stored) can be flushed to the local disk shared and store.Like this when this content of user's program request, preferentially load to the local disk shared and store, and it is all fast than blade to share the local disk read or write speed stored, this also further mitigates the pressure of shared storage blade, improves the service quality of system.
The integrality of periodic maintenance distribution of content database and door data and correctness, make distribution of content remain consistent with the content on disk, the chance that minimizing load and program request make mistakes.The correctness of maintenance and administration center data, carries out contents distribution for administrative staff and deletion action provides data accurately.
Content load employs general data security and system security technology is protected, and prevents from stealing chain, prevents from attacking; As far as possible by user load to from user nearest, on edge media server that load is minimum, when edge media server not this interior perhaps overburden time, load to again in center media server, all the time the server that guarantee flow is minimum, load is minimum provides service for user, both improve the program request quality of user, turn improve the service ability of whole system.Media server supports public network and VPN two kinds of networks in addition, meets the service request of more Multi net voting user.The flow process of content load is shown in Fig. 6.
A kind of quick method content being pushed to center media server and edge media server based on above-mentioned real-time performance comprises step.
The attributes such as 1, content operation personnel formulate contents distribution plan, the initial temperature of comprise what content of distribution, be distributed to which server, when start distribution and content.
If 2 meaningful caching servers (CCS), then content caching server is from content storage server (CSS) downloading contents, if content storage server overburden, carries out content download again when waiting for that load drops to normal range (NR).If there is no content caching server, then perform step 3.
3, automatically perform to the time centre media server planning to specify, according to certain policy selection loading source, specific strategy is as follows.
The legitimacy of 3.1 pairs of servers is verified, adopts the modes such as agreement encryption and timestamp, prevents agreement to be replicated or distort, can not download any content by the server of checking.
3.2 check whether server and distribution services lock, and can not download any content for the server locked or distribution services.
3.3 preferentially have selection carrying out that network speed is the fastest other center media server of this content to download in one's respective area.
If all not this contents of all center media server in 3.4 one's respective areas, have in close region the center media server of this content and select carrying out that network speed is the fastest to download.
If all not this contents of all center media server in 3.5 close regions, then download this content from content caching server, if do not have content caching server, then download this content from content storage server.
If the network traffics of 3.6 content caching servers or content storage server exceed threshold value, or the performances such as FTP linking number, cpu busy percentage, memory usage exceed threshold value, then download when the performance of center media server waiting for content caching server or content storage server drops to normal range (NR) again.
4, after center media server is downloaded, to database write distribution of content information.
5, make the distribution schedule creation of edge media server according to the initial temperature of content, concrete steps are as follows.
5.1 need to be distributed in the service request that a few edge of table media server could meet user according to the initial temperature of content and the service ability calculating of server, if initial temperature is 0, are not then distributed to edge media server.
The 5.2 load Bit-reverseds current according to edge media server, the N platform selecting load minimum is as distribution destination server.
The disk space of 5.3 inspection destination servers, if Insufficient disk space, do deletion plan and distribute to remove enough spaces, specific strategy is as follows.
5.3.1 the content on this server according to program request temperature Bit-reversed.
5.3.2 filter out program request temperature and exceed the initial temperature of distributing contents and the content in resident duration.
5.3.3 add up from the content that program request temperature is minimum, disk space size shared by Computed-torque control, until size exceed needs distribution content size or list add up complete.
If 5.3.4 size exceedes the content size of needs distribution, then make deletion plan and the distribution schedule creation of this server, circulation step 4.3, until process all destination servers.
If 5.3.5 contents list add up complete size be still less than needs distribution content size, then abandon this destination server, enter step 4.2, reselect destination server.
6, the metamessage of content to be reached the standard grade to door, provide user to browse and program request.
7, automatically perform to the time edge media server planning to specify, according to certain policy selection loading source, specific strategy is as follows.
The legitimacy of 7.1 pairs of servers is verified, adopts the modes such as agreement encryption and timestamp, prevents agreement to be replicated or distort, can not download any content by the server of checking.
7.2 check whether server and distribution services lock, and can not download any content for the server locked or distribution services.
7.3 preferentially have selection carrying out that network speed is the fastest other center media server of this content and edge media server to download in one's respective area.
If all center media server in 7.4 one's respective areas and edge media server all not this contents, have in close region the center media server of this content and edge media server and select carrying out that network speed is the fastest to download.
If all center media server in 7.5 close regions and edge media server all not this contents, then wait for that center media server is downloaded after downloading again.
The current performance of 7.6 inspection destination servers and source server and network traffics, the loading condition current according to server carries out speed limit distribution or distribution at full speed.
8, after edge media server is downloaded, to database write distribution of content information.
9, the metamessage of content to be reached the standard grade to edge media server, browse and program request for user provides as campus version server.
Based on the refreshing edge media server of above-mentioned real-time performance and a method for the same shared storage server distribution of content of use, wherein refresh edge media server content and comprise step.
1. the contents list all_list of a group switching centre media server and edge media server, is obtained.
2., remove residence time and be less than the content of the resident duration of setting, obtain contents list do_list.
3. the program request amount Pt of all the elements user in T time interval in list do_list, is obtained.
4., the content in list do_list is carried out Bit-reversed according to user's program request amount Pt.
5. each content, in circular treatment list do_list, according to factors such as the concurrent services ability of the program request amount of content, content size, content duration, server number and server, calculating each content should at the number of copies Vt of edge media server distribution.
6., the current replica allocation number Vc on edge media server of each content in list do_list is obtained.
7., compare the calculating number of copies Vt of each content in list do_list and actual number of copies Vc, content Vt being greater than Vc adds Distribution List dis_list, and record needs the number Vd=Vt-Vc of distribution; Content Vt being less than Vc adds delete list del_list, and record needs the number Vr=Vc-Vt of deletion.
8. each content, in circular treatment delete list del_list, search the edge media server that there is this content and by the load Bit-reversed of server, Vr the highest for a load server is added deletion plan, and the contents list of update server and disk remaining space.
9. each content, in circular treatment Distribution List dis_list, search the edge media server of not this content and sort by the load of server, by minimum for load and have the Vd of an enough disk spaces server to add distribution schedule creation, and the contents list of update server and disk remaining space.
10., edge media server network idle perform delete plan and distribution schedule creation, reach the object of Suitable content at edge media server reasonable layout.When executive plan, concrete content execution sequence, select the algorithm in source, carry out the strategies such as server legitimacy certification and speed limit distribution and manual distribution is consistent.
Wherein, refresh the shared content that stores and comprise step.
1, obtain the contents list p_list sharing and store upper blade, and sort by program request temperature.
2, according to sharing the total size storing local disk, from the program that contents list p_list takes out top n hot broadcast, list pdo_list is saved in.
3, the contents list s_list sharing and store upper local disk is obtained.
4, compare pdo_list and s_list, have in s_list, and in pdo_list, do not have the content of s_list-pdo_list to add the deletion plan of corresponding server.
5, compare pdo_list and s_list, have in pdo_list, and in s_list, do not have the content of pdo_list-s_list to join list pdis_list.
6, the content in circular treatment pdis_list list, selects load minimum and has the server of enough local disk space to add distribution schedule creation.
A method for supervision and maintenance plan state, comprises step.
1, plan executing state is monitored, if failed download, then download state is reverted to " make mistakes recovery " state, if reach the standard grade unsuccessfully, then download and upper line states are all reverted to " make mistakes recovery " state, because major part is reached the standard grade, mistake is all because content meta-information mistake causes, and needs again to download.
2, by the recovery number of times+1 of plan of makeing mistakes, when recovering will no longer automatically to recover when number of times exceedes setting threshold, report is needed manually to carry out investigation process.
3, plan executing state is reported to CCM, administrative staff can be managed easily in unification, check the executing state of regional intuitively.
A method for maintenance content distribution, comprises step.
1, travel through the content on media server, the content that the content of damage, file is incomplete is deleted from disk, and upgrades distribution of content database.
2, will to have in distribution of content database but the content that media server disk does not have is deleted from distribution of content database.
3, will not have in distribution of content database but the content that media server disk has inserts distribution of content database.
4, compare the content information of distribution of content database and door and administrative center, be distributed as standard with content, deleted by the unnecessary content information of door and administrative center, few content information inserts.
A method for content load, comprises step:
I, the legitimacy of user to be verified, adopt general data security and system security technology to protect, can not program request and browse any content by the user of checking.
Ii, preferentially load in one's respective area and have this content and user load is minimum but do not exceed the edge media server of threshold value, if there is no suitable edge media server, load to center media server.
Iii, secondly load in close region and have this content and user load is minimum but do not exceed the edge media server of threshold value, if there is no suitable edge media server, load to center media server.
If iv does not have suitable server above, then search suitable edge media server or center media server from the close region in higher level region and higher level region.
V, find suitable edge media server or center media server after, if media server be share store, then preferentially load to share store local disk, if local disk not this content, load to share store blade on.
If vi user uses public network IP, then load in the public network IP of media server, if user uses VPN, then load in the VPN of media server.
In vii, public network user being redirected to media server or VPN.
Claims (8)
1. a content distributing network, it comprises content and issues layer, at least one grade of distributing layer and edge service layer, it is characterized in that:
Described content is issued layer and is comprised centre point management server and at least one content storage server, and wherein, content is placed in content storage server respectively, is managed concentratedly by centre point management server;
Described distributing layer is made up of content distributing server and at least one center media server, wherein, content distributing server transfers the content in content storage server by centre point management server, then content distributing server by the contents distribution transferred to center media server; When not having content caching server, when the load of content storage server is excessive, center media server is downloaded from the center media server in another region;
Described center media server selects the strategy of loading source to comprise: preferentially have in one's respective area other center media server of this content and select carrying out that network speed is the fastest to download; If all not this contents of all center media server in one's respective area, have in close region the center media server of this content and select carrying out that network speed is the fastest to download; If all not this contents of all center media server in close region, then download this content from content caching server, if do not have content caching server, then download this content from content storage server;
Described edge service layer is made up of at least one edge media server, edge media server obtains content from center media server, and this content is stored as hot broadcast program, best number of copies is calculated according to the program request gauge of content, in conjunction with the ageing Suitable content of content in the distribution of edge media server, hot broadcast content flushed to automatically edge media server and share the local disk stored, for user provides order program service;
Described edge media server selects the strategy of loading source to comprise: preferentially have in one's respective area other center media server of this content and edge media server and select carrying out that network speed is the fastest to download; If all center media server in one's respective area and edge media server all not this contents, have in close region the center media server of this content and edge media server and select carrying out that network speed is the fastest to download; If all center media server in close region and edge media server all not this contents, then wait for that center media server is downloaded after downloading again; Check current performance and the network traffics of destination server and source server, the loading condition current according to server carries out speed limit distribution or distribution at full speed.
2. content distributing network according to claim 1, it is characterized in that: described distributing layer also comprises content caching server, described content caching server carries out buffer memory to the content downloaded from content storage server, and then is supplied to center media server.
3. content distributing network according to claim 2, is characterized in that: adopt P2P downloading mode between the center media server in described center media server and content caching server, content storage server, another region; P2P downloading mode is adopted between described edge media server and other edge media servers.
4. content distributing network according to claim 1, it is characterized in that: in described content storage server, depositing and downloading of content all adopts bibliographic structure, a resource saves as a subdirectory, there are multiple file and subdirectory in the inside, the whole catalogue of resource is downloaded and come during download.
5., based on quick method content being pushed to center media server and edge media server of real-time performance described in claim 1, it comprises the following steps:
(1), content operation personnel formulate contents distribution plan;
(2) if meaningful caching server, then content caching server is from content storage server downloading contents, if content storage server overburden, when waiting for that load drops to normal range (NR), carry out content download again, if there is no content caching server, then perform step (3);
(3), to the time of planning to specify, center media server automatically performs, according to policy selection loading source;
(4), after center media server downloads, to database write distribution of content information;
(5), distributing layer makes the distribution schedule creation of edge media server automatically according to the initial temperature of content;
(6), by the metamessage of content to reach the standard grade door, browse and program request for user provides;
(7), to the time of planning to specify, edge media server automatically performs, according to policy selection loading source;
(8), after edge media server downloads, to database write distribution of content information;
(9), by the metamessage of content to reach the standard grade edge media server, browse and program request for user provides.
6. the method fast content being pushed to center media server and edge media server according to claim 5, it is characterized in that, described step (5) specifically comprises the following steps:
(5.1) need the quantity being distributed in edge media server to meet the service request of user according to the initial temperature of content and the service ability calculating of server, if initial temperature is 0, be not then distributed to edge media server;
(5.2) current according to edge media server load Bit-reversed, the N platform selecting load minimum is as distribution destination server;
(5.3) check the disk space of destination server, if Insufficient disk space, do deletion plan and distribute to remove enough spaces, specific strategy is as follows:
(5.3.1) the content on this server according to program request temperature Bit-reversed;
(5.3.2) filter out program request temperature and exceed the initial temperature of distributing contents and the content in resident duration;
(5.3.3) add up from the content that program request temperature is minimum, disk space size shared by Computed-torque control, until size exceed needs distribution content size or list add up complete;
If (5.3.4) size exceedes the content size of needs distribution, then make deletion plan and the distribution schedule creation of this server, circulation step (5.3), until process all destination servers;
If (5.3.5) contents list add up complete size be still less than needs distribution content size, then abandon this destination server, enter step (5.2), reselect destination server.
7., based on the method that the content of real-time performance described in claim 1 refreshes automatically, it comprises the following steps:
1. all content list (all_list) of a group switching centre media server and edge media server, is obtained;
2., remove residence time and be less than the content of the resident duration of setting, obtain contents list (do_list);
3. the program request amount Pt of all the elements user in T time interval in contents list (do_list), is obtained;
4., the content in contents list (do_list) is carried out Bit-reversed according to user's program request amount Pt;
5. each content, in circular treatment contents list (do_list), according to the program request amount of content, content size, content duration, server number and server concurrent services ability, calculating each content should at the calculating number of copies Vt of edge media server distribution;
6., the current actual number of copies Vc on edge media server of each content in contents list (do_list) is obtained;
7., compare the calculating number of copies Vt of each content in contents list (do_list) and actual number of copies Vc, the content that calculating number of copies Vt is greater than actual number of copies Vc is added Distribution List (dis_list), and record distribution number Vd, wherein Vd=Vt-Vc; The content that calculating number of copies Vt is less than actual number of copies Vc is added delete list (del_list), and number Vr deleted in record, Vr=Vc-Vt;
8. each content, in circular treatment delete list (del_list), search the edge media server that there is this content and by the load Bit-reversed of server, deletion number Vr server the highest for load is added deletion plan, and the contents list of update server and disk remaining space;
9. each content, in circular treatment Distribution List (dis_list), search the edge media server of not this content and sort by the load of server, by minimum for load and have distribution number Vd server of enough disk spaces to add distribution schedule creation, and the contents list of update server and disk remaining space;
10., edge media server performs the plan of deletion and distribution schedule creation, with the distribution of Suitable content at edge media server in network idle.
8., based on a method for the content load of real-time performance described in claim 1, it comprises the following steps:
I, the legitimacy of user to be verified, adopt general data security and system security technology to protect, can not program request and browse any content by the user of checking;
Ii, preferentially load in one's respective area and have this content and user load is minimum but do not exceed the edge media server of threshold value, if there is no suitable edge media server, load to center media server;
Iii, secondly load in close region and have this content and user load is minimum but do not exceed the edge media server of threshold value, if there is no suitable edge media server, load to center media server;
If iv does not have suitable server above, then search suitable edge media server or center media server from the close region in higher level region and higher level region;
V, find suitable edge media server or center media server after, if media server be share store, then preferentially load to share store local disk, if local disk not this content, load to share store blade on;
If vi user uses public network IP, then load in the public network IP of media server, if user uses VPN, then load in the VPN of media server;
In vii, public network user being redirected to media server or VPN.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110202705.8A CN102891869B (en) | 2011-07-20 | 2011-07-20 | CDN (Content Delivery Network) and content distribution and scheduling method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110202705.8A CN102891869B (en) | 2011-07-20 | 2011-07-20 | CDN (Content Delivery Network) and content distribution and scheduling method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102891869A CN102891869A (en) | 2013-01-23 |
| CN102891869B true CN102891869B (en) | 2015-07-15 |
Family
ID=47535235
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110202705.8A Active CN102891869B (en) | 2011-07-20 | 2011-07-20 | CDN (Content Delivery Network) and content distribution and scheduling method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102891869B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103402128A (en) * | 2013-07-17 | 2013-11-20 | 深圳市龙视传媒有限公司 | Program content management method and device |
| CN104580304A (en) * | 2013-10-18 | 2015-04-29 | 北大方正集团有限公司 | Data downloading method, device and system for distributed platform |
| CN104735481B (en) * | 2013-12-19 | 2018-07-06 | 北京四达时代软件技术股份有限公司 | A kind of video content distribution scheduling method, server and system |
| US9800659B2 (en) * | 2015-02-02 | 2017-10-24 | International Business Machines Corporation | Enterprise peer-to-peer storage and method of managing peer network storage |
| CN104967651B (en) * | 2015-03-02 | 2017-06-27 | 深圳市腾讯计算机系统有限公司 | Data-pushing, storage, method for down loading and device based on CDN frameworks |
| CN106101225A (en) * | 2016-06-14 | 2016-11-09 | 苏州嗨嗨网络科技有限公司 | A kind of site resource distribution method and system |
| CN106341474B (en) * | 2016-09-06 | 2019-11-05 | 上海海事大学 | It is a kind of that center and its contents management method are managed based on the data of ICN and SDN network |
| CN106790552B (en) * | 2016-12-23 | 2019-04-09 | 中科星图股份有限公司 | A kind of content providing system based on content distributing network |
| CN110651262B (en) * | 2017-05-22 | 2024-03-26 | 麻省理工学院 | Hierarchical distributed storage system and techniques for edge computing systems |
| CN109151519B (en) * | 2018-09-03 | 2021-01-22 | 视联动力信息技术股份有限公司 | Configuration distribution method and system based on video network |
| CN109040308A (en) * | 2018-09-12 | 2018-12-18 | 杭州趣链科技有限公司 | A kind of document distribution system and document distribution method based on IPFS |
| CN110113654A (en) * | 2019-04-10 | 2019-08-09 | 深圳市宏辉智通科技有限公司 | A kind of P4P technical application method based on local area network |
| CN111083519A (en) * | 2019-11-06 | 2020-04-28 | 石家庄微泽科技有限公司 | VR content distribution system and method based on cloud and edge computing |
| CN112350952B (en) * | 2020-10-28 | 2023-04-07 | 武汉绿色网络信息服务有限责任公司 | Controller distribution method and network service system |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1489333A (en) * | 2002-10-10 | 2004-04-14 | 华为技术有限公司 | Method for updating content in content-transmitting network |
| CN1592248A (en) * | 2003-08-29 | 2005-03-09 | 华为技术有限公司 | Layered content distributing network and method thereof |
| CN1981501A (en) * | 2004-03-12 | 2007-06-13 | 汤姆森许可公司 | Method of scheduling the distribution of content files and cache server |
| CN101123602A (en) * | 2006-08-11 | 2008-02-13 | 郑州威科姆电子科技有限公司 | Content scheduling method based on network TV system |
| CN101136932A (en) * | 2006-10-20 | 2008-03-05 | 中兴通讯股份有限公司 | Cluster type stream media networking system and its content issue and service method |
| CN101150421A (en) * | 2006-09-22 | 2008-03-26 | 华为技术有限公司 | A distributed content distribution method, edge server and content distribution network |
| CN101477669A (en) * | 2009-01-08 | 2009-07-08 | 刘钢 | P2P downloading experience for network audio and video product retail e-commerce and application implementation process |
| CN101557423A (en) * | 2009-05-07 | 2009-10-14 | 北京邮电大学 | System and method for realizing streaming media content service |
| CN101557499A (en) * | 2008-04-09 | 2009-10-14 | 中兴通讯股份有限公司 | System and method for delivering media and method for renewing resource of media delivering system |
| CN101582919A (en) * | 2009-04-14 | 2009-11-18 | 冯俊秋 | Method and system for playing of Internet television |
| CN101645922A (en) * | 2009-04-17 | 2010-02-10 | 中国科学院声学研究所 | CDN network system based on geographical position information encoding and distribution treatment method |
-
2011
- 2011-07-20 CN CN201110202705.8A patent/CN102891869B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1489333A (en) * | 2002-10-10 | 2004-04-14 | 华为技术有限公司 | Method for updating content in content-transmitting network |
| CN1592248A (en) * | 2003-08-29 | 2005-03-09 | 华为技术有限公司 | Layered content distributing network and method thereof |
| CN1981501A (en) * | 2004-03-12 | 2007-06-13 | 汤姆森许可公司 | Method of scheduling the distribution of content files and cache server |
| CN101123602A (en) * | 2006-08-11 | 2008-02-13 | 郑州威科姆电子科技有限公司 | Content scheduling method based on network TV system |
| CN101150421A (en) * | 2006-09-22 | 2008-03-26 | 华为技术有限公司 | A distributed content distribution method, edge server and content distribution network |
| CN101136932A (en) * | 2006-10-20 | 2008-03-05 | 中兴通讯股份有限公司 | Cluster type stream media networking system and its content issue and service method |
| CN101557499A (en) * | 2008-04-09 | 2009-10-14 | 中兴通讯股份有限公司 | System and method for delivering media and method for renewing resource of media delivering system |
| CN101477669A (en) * | 2009-01-08 | 2009-07-08 | 刘钢 | P2P downloading experience for network audio and video product retail e-commerce and application implementation process |
| CN101582919A (en) * | 2009-04-14 | 2009-11-18 | 冯俊秋 | Method and system for playing of Internet television |
| CN101645922A (en) * | 2009-04-17 | 2010-02-10 | 中国科学院声学研究所 | CDN network system based on geographical position information encoding and distribution treatment method |
| CN101557423A (en) * | 2009-05-07 | 2009-10-14 | 北京邮电大学 | System and method for realizing streaming media content service |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102891869A (en) | 2013-01-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102891869B (en) | CDN (Content Delivery Network) and content distribution and scheduling method | |
| CN105357296A (en) | Elastic caching system based on Docker cloud platform | |
| CN105159603B (en) | A kind of restorative procedure of distributed data-storage system | |
| US8954976B2 (en) | Data storage in distributed resources of a network based on provisioning attributes | |
| US8886690B2 (en) | Distributed data storage and access systems | |
| CN104092719B (en) | Document transmission method, device and distributed cluster file system | |
| US20100010999A1 (en) | Data Access in Distributed Systems | |
| CN102857578B (en) | A kind of file uploading method of network hard disc, system and net dish client | |
| CN103475732A (en) | Distributed file system data volume deployment method based on virtual address pool | |
| BR112014000597B1 (en) | METHOD AND SYSTEM FOR DOWNLOADING A MULTIMEDIA FILE | |
| CN104113597A (en) | Multi- data-centre hadoop distributed file system (HDFS) data read-write system and method | |
| CN104469391B (en) | A kind of digital TV contents dissemination system and method based on cloud platform | |
| EP2307991A2 (en) | Distributed data storage and access systems | |
| CN101388909A (en) | P2P play-on-demand system and service method | |
| CN106101213A (en) | Information-distribution type storage method | |
| CN102420863B (en) | Rapid file distribution system, method thereof and apparatus thereof | |
| Chen et al. | E2FS: an elastic storage system for cloud computing | |
| CN102164317A (en) | Internet protocol (IP) set-top box-oriented multi-server segmented downloading system | |
| CN104182487A (en) | Unified storage method supporting various storage modes | |
| CN106101212A (en) | Big data access method under cloud platform | |
| CN106960011A (en) | Metadata of distributed type file system management system and method | |
| CN202872848U (en) | Cloud storage terminal equipment based on cloud information and cloud computing services | |
| CN102932443A (en) | HDFS (hadoop distributed file system) cluster based distributed cloud storage system | |
| CN203015044U (en) | Radio and television omni-media broadcasting system | |
| CN106649702A (en) | File storage method and apparatus of cloud storage system, and cloud storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |