CN105516238B - Data request method, device, node server and CDN system - Google Patents

Data request method, device, node server and CDN system Download PDF

Info

Publication number
CN105516238B
CN105516238B CN201510816506.4A CN201510816506A CN105516238B CN 105516238 B CN105516238 B CN 105516238B CN 201510816506 A CN201510816506 A CN 201510816506A CN 105516238 B CN105516238 B CN 105516238B
Authority
CN
China
Prior art keywords
content
request
service processes
node server
linking request
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510816506.4A
Other languages
Chinese (zh)
Other versions
CN105516238A (en
Inventor
马杰
陈健生
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN201510816506.4A priority Critical patent/CN105516238B/en
Publication of CN105516238A publication Critical patent/CN105516238A/en
Application granted granted Critical
Publication of CN105516238B publication Critical patent/CN105516238B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • H04L41/0654Management of faults, events, alarms or notifications using network fault recovery
    • H04L41/0659Management of faults, events, alarms or notifications using network fault recovery by isolating or reconfiguring faulty entities
    • H04L41/0661Management of faults, events, alarms or notifications using network fault recovery by isolating or reconfiguring faulty entities by reconfiguring faulty entities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/02Topology update or discovery
    • H04L45/021Ensuring consistency of routing table updates, e.g. by using epoch numbers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/74Address processing for routing
    • H04L45/745Address table lookup; Address filtering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/10Network architectures or network communication protocols for network security for controlling access to devices or network resources
    • H04L63/101Access control lists [ACL]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services

Abstract

The invention discloses a kind of data request method, the method is applied in the node router in content distributing network CDN system, which comprises receives linking request by this service processes;Judge that this service processes of local node server are recorded with the presence or absence of the information of the content of the linking request, and if it exists, then obtain the content;Otherwise judge that other service processes of local node server are recorded with the presence or absence of the information of the content of the linking request, and if it exists, then obtain the content;Otherwise superior node server obtains the content of the linking request;Linking request described in the content response based on acquisition.Data request method disclosed by the invention can optimize the routing of CDN node content, avoid the identical content with the different service processes superior node server repetitive requests of server, effectively reduce link bandwidth consumption.The invention also discloses a kind of request of data device, node server and CDN systems.

Description

Data request method, device, node server and CDN system
Technical field
The present invention relates to Data Disaster-Tolerance Technology fields, more specifically to a kind of data request method, device and section Point server and CDN (Content Delivery Network, content distributing network) system.
Background technique
In the prior art, in order to improve CDN node server resource utilization rate, and the stability of holding service, more Carry out the framework model that more CDN content dissemination systems uses multicore multi-process, i.e., runs multiple services on a server Process, each service processes respectively provide content distribution service, run and be independent of each other between service processes, handle in this way, even if Wherein some process exception will not influence other normal work processes and continue to provide stable service.For example it is regarded in internet In frequency live broadcast service, a node server operates above 10 service processes in CDN network, and each service processes are upward alone First nodes carry out content requests, and identical content can be respectively sent to run on same server each by even higher level of node A service processes, then, if request content is identical, sent 10 times then identical request content is always met together to this server, The increase of superior node load, the waste of downlink traffic are caused, the waste of server itself uplink traffic is also increased and born certainly Lotus, simultaneously as the processing of scheduling, 10 service processes are requested to even higher level of node cluster respectively, due to dispatching, The superior node server distributed may be different, and it is inconsistent to lead to walk routing possibility when each process requested content distribution, It may influence service quality.
Specifically, as shown in Figure 1, it is assumed that at the beginning, service processes WorkerM in CDN node server S, service into Information above journey WorkerN all without content Stream.When service processes WorkerM, service processes WorkerN are successively received It is as follows to the step of when accessing linking request content Stream, being executed using the data request method of the prior art:
Service processes WorkerM above A:CDN server S receives access linking request, request content Stream;
B: service processes WorkerM access scheduling system requests superior node server address;
C: the factors such as scheduling system trade-off load, geographical location return to superior node server to service processes WorkerM The address of B.
After D: service processes WorkerM obtains the address of superior node server B, in superior node server B request Hold Stream, and response chains are requested;
Service processes WorkerN above E:CDN server S receives another way and accesses linking request, request content Stream;
F: service processes WorkerN access scheduling system, request superior node server address;
G: scheduling system trade-off load, the factors such as geographical location return to superior node server to service processes WorkerN The address of A (being in same location server cluster with superior node server B, server A may be more excellent at this time).
After H: service processes WorkerN obtains the address of superior node server A, in superior node server A request Hold Stream, and response chains are requested.
As it can be seen that in existing CDN system, under more service processes operational modes, since each service processes can be to Superior node server request content will cause superior node server in book server in the identical situation of request content The repetition of appearance is sent, and wastes uplink and downlink flow, and increase load.
In some CDN service quotient, solves the problems, such as above-mentioned repetitive requests content by technological means, such as servicing Agent process is disposed on device is responsible for the content requests iterative process being locally-downloaded between process and superior node cluster specially, After downloading process receives link, all downloading process elder generations access agent, agency's foundation requests access to superior node cluster server, After superior node acquisition content success requesting node is locally-downloaded by acting on behalf of, due to this in content distribution to all by agency All downloading process in ground will access proxy process, this be easy to cause agent process single-point load too high, to reduce server Utilization rate, and development and agency scheduler module is wanted, to cause cost increase and maintenance difficulties to increase, thus practical effect It is bad, while if agent process is abnormal failure, all decline processes cannot all continue offer service, be unfavorable for Risk control.
Summary of the invention
The object of the present invention is to provide a kind of data request method, device, node server and CDN systems, can optimize The routing of CDN node content avoids the identical content with the different service processes superior node server repetitive requests of server, Effectively reduce link bandwidth consumption.
The embodiment of the invention provides a kind of data request method, the method is applied to content distributing network CDN system In node router in, which comprises
Linking request is received by this service processes;
Judge that this service processes of local node server are recorded with the presence or absence of the information of the content of the linking request, if In the presence of then obtaining the content;Otherwise
Judge that other service processes of local node server are recorded with the presence or absence of the information of the content of the linking request, If it exists, then the content is obtained;Otherwise
Superior node server obtains the content of the linking request;
Linking request described in content response based on acquisition.
As an improvement of the above scheme, when judging local node server, there are the information of the content of linking request notes When other service processes of record are no less than one, then the service processes of the linking request minimum number of selection content described in come Obtain the content.
As an improvement of the above scheme, local section is judged by inquiring the independent content routing table of this service processes maintenance Information record of this service processes of point server with the presence or absence of the content of the linking request;Wherein, the independent content road The information of each content of corresponding service processes is recorded by table.
As an improvement of the above scheme, judged by inquiring the global content routing table that all service processes are safeguarded jointly Information record of other service processes of local node server with the presence or absence of the content of the linking request;Wherein, described complete The linking request quantity and access of each content of each service processes of office's content routing table record local node router Location.
As an improvement of the above scheme, judged by inquiring the global content routing table that all service processes are safeguarded jointly When local node server is no less than one there are other service processes that the information of the content of the linking request records, then select The service processes of the linking request minimum number of the content described in are selected, and are redirected described in acquisition by corresponding access address Content.
As an improvement of the above scheme, in this service processes for judging local node server, there are the linking requests After the information of content records and obtains the content, further includes:
The linking request quantity of the content of minute book service processes in the global content routing table is added 1, with more The new global content routing table.
As an improvement of the above scheme, in other service processes for judging local node server, there are the linking requests Content information record and obtain the content after, further includes:
The global content routing table is updated, the linking request of the content of the service processes of the content will be acquired Quantity adds 1, while the access address of this service processes being recorded in described and is held, and initializing linking request quantity is 1;
The independent content routing table for updating this service processes increases the information record of the content.
As an improvement of the above scheme, the superior node server obtains the content of the linking request specifically:
Access scheduling system, the address of request superior node server;
The superior node server address that the scheduling system returns is received, and according to the superior node server address To the content of linking request described in the superior node server request.
As an improvement of the above scheme, after the content that superior node server obtains the linking request, further includes:
The independent content routing table for updating this service processes increases the information record of the content;
The global content routing table is updated, increases this service processes to the linking request of the content, initialization link Number of requests is 1, and the access address of this service processes is recorded in described and is held.
As an improvement of the above scheme, further includes:
When any service processes of local node service occur abnormal, then pass through managing process to the global content road It is updated by table, to remove the linking request quantity and access address of each content of exception service process.
The embodiment of the present invention is corresponding to provide a kind of request of data device, and described device is applied to content distributing network CDN In node router in system, described device includes:
Linking request receiving module, for receiving linking request by this service processes;
First execution module, for judging this service processes of local node server with the presence or absence of the linking request The information of content records;If it exists, then the content is obtained;
Second execution module, for judging this service processes of local node server in the first execution module, there is no institutes Under the information record case for stating the content of linking request, judge other service processes of local node server with the presence or absence of described The information of the content of linking request records, and if it exists, then obtains the content;
Third execution module, for judging that other service processes of local node server are not present in the second execution module Under the information record case of the content of the linking request, the content of the linking request is obtained in superior node server;
Respond module, linking request described in the content response based on acquisition.
As an improvement of the above scheme, second execution module is further used for: when judging that local node server deposits When other service processes of the information record of the content of the linking request are no less than one, then the content described in is selected The service processes of linking request minimum number obtain the content.
As an improvement of the above scheme, the independent content road that first execution module is safeguarded by inquiring this service processes Judge that this service processes of local node server are recorded with the presence or absence of the information of the content of the linking request by table;Its In, the independent content routing table records the information of each content of corresponding service processes.
As an improvement of the above scheme, the overall situation that second execution module is safeguarded jointly by inquiring all service processes Content routing table judges other service processes of local node server with the presence or absence of the information of the content of the linking request Record;Wherein, the link of each content of each service processes of the global content routing table record local node router Number of requests and access address.
As an improvement of the above scheme, second execution module is further used for: total by inquiring all service processes Judge what local node server was recorded there are the information of the content of the linking request with the global content routing table of maintenance When other service processes are no less than one, then the service processes of the linking request minimum number of the content described in are selected, and led to It crosses corresponding access address and redirects the acquisition content.
It as an improvement of the above scheme, further include the first update module, for judging local node in the first execution module After this service processes of server record there are the information of the content of the linking request and obtain the content, by the overall situation The linking request quantity of the content of minute book service processes adds 1 in content routing table, to update the global content routing Table.
It as an improvement of the above scheme, further include the second update module, for judging local node in the second execution module After other service processes of server record there are the information of the content of the linking request and obtain the content,
The global content routing table is updated, the linking request of the content of the service processes of the content will be acquired Quantity adds 1, while the access address of this service processes being recorded in described and is held, and initializing linking request quantity is 1;With And
The independent content routing table for updating this service processes increases the information record of the content.
As an improvement of the above scheme, the third execution module is specifically used for:
Access scheduling system, the address of request superior node server;
The superior node server address that the scheduling system returns is received, and according to the superior node server address To the content of linking request described in the superior node server request.
It as an improvement of the above scheme, further include third update module, for being taken in third execution module superior node After business device obtains the content of the linking request,
The independent content routing table for updating this service processes increases the information record of the content;And
The global content routing table is updated, increases this service processes to the linking request of the content, initialization link Number of requests is 1, and the access address of this service processes is recorded in described and is held.
As an improvement of the above scheme, further includes:
Exception processing module, when any service processes for detecting local node service occur abnormal, by manage into Journey is updated to the global content routing table, to remove the linking request quantity and visit of each content of exception service process Ask address.
The embodiment of the invention also provides a kind of node servers, including request of data device as described above.
The embodiment of the invention also provides a kind of content distributing network CDN systems, including multiple node clothes as described above Business device, the node server in the superior and the subordinate are communicated by scheduling system.
Compared with prior art, data request method disclosed by the invention, device, node server and CDN system pass through When this service processes receives linking request, first determine whether that this service processes of local node server are asked with the presence or absence of the link The information for the content asked records, and if it exists, then obtains the content directly in response to request;If it is not, then judging local node service Information record of other service processes of device with the presence or absence of the content of the linking request, and if it exists, then obtain the content;It is no Then superior node server obtains the content of the linking request.Therefore, data request method of the invention, device, node Server and CDN system, under more service processes operational modes, only meeting superior node server requests identical content primary, It avoids superior node server from sending the repetition of the identical content of local node server, saves under superior node server Row flow reduces its load, to reduce link bandwidth consumption, avoids network oscillation, ensure that service quality.
Detailed description of the invention
Fig. 1 is the processing schematic of the data request method of content distributing network CDN system in the prior art.
Fig. 2 is a kind of flow diagram of data request method in the embodiment of the present invention.
Fig. 3 is a kind of abnormality processing schematic diagram of data request method in the embodiment of the present invention.
Fig. 4 is a kind of idiographic flow schematic diagram of data request method in the embodiment of the present invention.
Fig. 5 is the processing schematic of the data request method of the content distributing network CDN system of the embodiment of the present invention.
Fig. 6 is a kind of structural block diagram of request of data device in the embodiment of the present invention.
Fig. 7 is the structural block diagram of another request of data device in the embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
It referring to fig. 2, is a kind of flow diagram of data request method provided in an embodiment of the present invention.The number of the present embodiment It is applied in the node router in content distributing network CDN system according to requesting method, the method includes the steps:
S101, linking request is received by this service processes;
S102, judge that this service processes of local node server are remembered with the presence or absence of the information of the content of the linking request Record, and if it exists, then obtain the content (step S103);It is no to then follow the steps
S104, judge that other service processes of local node server whether there is the information of the content of the linking request Record, and if it exists, then obtain the content (step S105);It is no to then follow the steps
S106, superior node server obtain the content of the linking request;And
Linking request described in S107, the content response based on acquisition.
Wherein, local node server can be any node server in content distributing network CDN system, when local section When point server is user's access node server, local node server can receive the linking request that user equipment is sent;When When local node server is non-user access node server, local node server can receive the transmission of other node servers Linking request.In the present embodiment, any node server in content distributing network CDN system is all made of more service processes Operational mode, therefore, local node server can receive linking request by any service processes (for example, this service processes).
In step s 102, specifically, judging local by the independent content routing table for inquiring the maintenance of this service processes Information record of this service processes of node server with the presence or absence of the content of the linking request;Wherein, the independent content Routing table records the information of each content of corresponding service processes.
In step S104, specifically, being sentenced by inquiring the global content routing table that all service processes are safeguarded jointly Information record of other service processes of disconnected local node server with the presence or absence of the content of the linking request;Wherein, described The linking request quantity and access of each content of each service processes of global content routing table record local node router Address.
In addition, when judging local node service by inquiring the global content routing table that all service processes are safeguarded jointly When device is no less than one there are other service processes that the information of the content of the linking request records, then selection is interior described in The service processes of the linking request minimum number of appearance, and redirected by corresponding access address and obtain the content.Wherein, weight Orientation (Redirect), which refers to, goes to other positions (such as: webpage for a various network requests again fixed direction by various methods The variation of redirection, the redirection of domain name, Route Selection is also to data message via a kind of redirection in path.
In addition, if judging this service processes of local node server, there are the information of the content of linking request records Further include executing step and after obtaining the content:
S1031, the linking request quantity of the content of minute book service processes in the global content routing table is added 1, to update the global content routing table.
In addition, if judging other service processes of local node server, there are the information of the content of linking request notes After recording and obtaining the content, further comprise the steps of:
S1051, the global content routing table is updated, the chain of the content of the service processes of the content will be acquired It connects number of requests and adds 1, while the access address of this service processes being recorded in described and is held, and initializes linking request quantity It is 1;
S1052, the independent content routing table for updating this service processes increase the information record of the content.
In step s 106, the content that superior node server obtains the linking request specifically includes step:
S1061, access scheduling system, the address of request superior node server;
S1062, the superior node server address that the scheduling system returns is received, and according to the superior node service Content of the device address to linking request described in the superior node server request.
In addition, further including executing step after the content that superior node server obtains the linking request:
S1063, the independent content routing table for updating this service processes increase the information record of the content;
S1064, the global content routing table is updated, increases this service processes to the linking request of the content, initially Changing linking request quantity is 1, and the access address of this service processes is recorded in described and is held.
Therefore, in the present embodiment, any node server in content distributing network CDN system operates above multiple clothes Business process, when this location server is accepted the interview hyperlink request by this service processes, this service processes is according in linking request Hold, according to this service processes or other service processes of local node server, whether there is or not the request contents, provide different contents and visit It asks the way diameter:
(1) inquire the content routing table of this service processes maintenance first, substantial information record then directly in response to request, Global content routing table is updated simultaneously, the access link number of the corresponding content of this service processes is increased by 1;
(2) if the content routing table of this service processes maintenance is recorded without the information of corresponding content, local node is accessed The local global content routing table of all service processes maintenances of server, whether inquiry other service processes of local node server The content has been obtained to local node server;
If there is other multiple service processes obtain the content to local node server, then local global content road is traversed By table, selection has the content and access linking request minimum number service processes, obtains its access path, passes through redirection It obtains access content and passes through global routing table, linking request access path at this point, changing the access path of linking request Are as follows: request-> this service processes-> local node server overall situation routing table-> other service processes, corresponding content point Hair routing are as follows: other service processes-> this service processes change linking request access from the point of view of network request access path Path is redirection process, also changes the path of content distribution accordingly, and contents routing path is changed;
If only one other example service processes obtains content to locally, then the process is selected, its access path is obtained, Access content is obtained by redirecting;
It, can respond request (distribution content) after obtaining the content to this service processes success;Meanwhile it updating in the overall situation Hold routing table, the linking request quantity of the content for the service processes for being acquired the content is added 1, and by this service processes Access address be recorded in it is described in hold, and initialize linking request quantity be 1;And update the independent interior of this service processes Hold routing table, increases the information record of the content.
(3) if access content does not arrive local node server, access scheduling system, the request of superior node server Content requests access to path are as follows: request-> this service processes-> scheduling system-> superior node server, it is corresponding Content distribution routing are as follows: superior node server-> this service processes;
It, can respond request (distribution content) after obtaining the content to this service processes success;Meanwhile updating this service processes Independent content routing table, increase the content information record;And the global content routing table is updated, increase this service For process to the linking request of the content, initialization linking request quantity is 1, and the access address of this service processes is recorded in It is held in described, when new hyperlink request reaches next time, for other process queried accesses.
In addition, selection has the service processes of content and the access to content linking request minimum number to make requests content money Source is to be evenly distributed to access link respectively as far as possible to realize that access links to be supported between each process and realize equilibrium Above a case process, process single-point load too high is avoided the problem that.
In the present embodiment, it is preferred that further include abnormality processing step, comprising:
When any service processes of local node service occur abnormal, then pass through managing process to the global content road It is updated by table, to remove the linking request quantity and access address of each content of exception service process.
Specifically, as shown in figure 3, if some service processes in local node server are (for example, service processes WorkerA) there is exception, then from managing process to global content routing table more new information, exception service process occurs in removing The content information of WorkerA records (the linking request quantity and access address of each content of exception service process), thus disconnected The service processes (for example, service processes WorkerB) of other normal works and linking for abnormal process WorkerA are opened, meanwhile, this Other service processes worked normally in ground node server update the independent content routing table of therein independent maintenance, clearly Except the abnormal process content information of oneself access, makes new link no longer access exception process, reduce the influence of abnormal process, health The information record of process is then unaffected, can continue to provide normal content distribution service.
With reference to Fig. 4, the realization of detailed description of the present invention data request method is carried out below by a specific embodiment Journey.Likewise, the data request method of the present embodiment is applied in the node router in content distributing network CDN system, use In optimization CDN node content routing, route optimization process includes step:
The service processes WorkerN acquisition of S201, local node server S execute timeslice, start to receive link, link To service processes WorkerN request content resource Stream;
S202, service processes WorkerN inquire the independent content routing table of this service processes maintenance;Wherein, described independent Content routing table records the information of each content of corresponding service processes;
S203, judge whether this service processes has content resource Stream;If WorkerN has content resource Stream thens follow the steps S218, updates global content routing table, by the linking request quantity of the content of this service processes Add 1, and skips to and execute step S221;If WorkerN does not have content resource Stream, S205 is thened follow the steps;
S205, the global content routing table for inquiring local node server;Wherein, the global content routing table minute book The linking request quantity and access address of each content of each service processes of ground node router;
S206, judge whether other service processes have registration content resource by inquiring global content routing table Stream;If there is the register information of content Stream in global content routing table, S208 is thened follow the steps;If global content routing Register information without content Stream in table, thens follow the steps S215;
S208, the corresponding register information of the content in global content routing table is traversed, found in service processes WorkerM The linking request minimum number of content Stream is accessed above;
S209, inquiry and the access address for obtaining service processes WorkerM;
S210, service processes WorkerN are redirected to process WorkerM, request content Stream according to access address;
S211, judge whether request content Stream succeeds;If failure, thens follow the steps S212;If success, holds Row step S213;
S212, respond request, request failure;And terminate.
S213, global content routing table is updated, the linking request quantity of the content Stream of service processes WorkerM is added 1, while the access address of service processes WorkerN being recorded under content Stream, and initializing linking request quantity is 1;
S214, the independent content routing table for updating service processes WorkerN increase the information record of content Stream;It jumps To execution S221;
S215, service processes WorkerN access scheduling system, the address of request superior node server;
S216, service processes WorkerN carry out content requests acquisition according to the address superior node that scheduling system returns Content Stream;
S217, judge whether request content Stream succeeds;If failure, thens follow the steps S212;If success, holds Row step S219;
S219, the independent content routing table for updating service processes WorkerN increase the information record of content Stream;
S220, the global content routing table is updated, increases service processes WorkerN and the link of content Stream is asked It asks, initialization linking request quantity is 1, and the access address of service processes WorkerN is recorded under content Stream;
S221, respond request distribute content Stream.
New hyperlink request repeats above-mentioned steps.
In the embodiment of the present invention, by maintenance content routing table, comprising inside service processes independent content routing table with All process instances access the global content routing table of maintenance jointly, load in conjunction with the link to request content of each service processes Information changes its access to content path, access to content path can be made optimal by the linking request of access by way of redirection Change.
With reference to Fig. 5, it is assumed that at the beginning, service processes WorkerM, service processes WorkerN in CDN node server S Information all without content Stream above.When service processes WorkerM, service processes WorkerN successively receive access chain When meeting request content Stream, using the embodiment of the present invention data request method execute the step of it is as follows:
1, the service processes WorkerM on the node server S of CDN receives access linking request, request content Stream;
2, service processes WorkerM access scheduling system requests superior node dispatch server address;
3, scheduling system returns to superior node server address B and gives service processes WorkerM;
4, service processes WorkerM superior node server B request content Stream;
5, after the success of service processes WorkerM request content, content Stream information is registered to global content routing table, The access interface of oneself is registered, and the access number of links load for initializing content Stream is 1;And respond request, distribution Content Stream;
6, the service processes WorkerN above CDN server S receives another way and accesses linking request, request content Stream;
7, service processes WorkerN inquires global content routing table, obtains the content Stream on service processes WorkerM Access path;
8, service processes WorkerN is redirected to service processes WorkerM and carries out content Stream request;
9, service processes WorkerN obtains content Stream, and respond request from service processes WorkerM, carries out content Distribution.
As it can be seen that data request method of the invention is applied to interior compared with the data request method of the prior art of Fig. 1 After node router in content distributing network CDN system, by optimization CDN node content routing, following beneficial effect is brought Fruit:
(1) service processes WorkerN after optimizing to the request of content Stream need not request scheduling system again, do not have to again Superior node cluster server is accessed, reduces the load of scheduling system, on the same stage the hyperlink request of the identical content of node server, Superior node server cluster is only primary with processing, reduces the load of superior node server cluster, especially big concurrent It (is exactly, such as in 1 second to occur largely requesting access to link while accessing this taking in synchronization or a certain very short time section Business device) when, it can be substantially reduced the downlink traffic of superior node cluster, improve the stability and scheduling of CDN network group system The stability of system improves performance.
(2) after optimizing for same node server S, same content Stream only can superior node cluster Server is requested 1 time, and the additional request of identical content is avoided.
(3) other subsequent service processes are directed to the access request and data distribution of same content after optimizing, and take in node Be engaged in device S locally complete, response quickly, avoid on the same stage server difference service processes difference is scheduled to the request of identical content Superior node, avoid the formation of multirouting.
(4) optimize after can on present node server unexpectedly may multi-section affix one's name to service processes, it is whole so as to increase The load capacity of a CDN system, and do not have to additional increase server hardware resource, server resource is maximally utilized as far as possible.
(5) the content requests routing of service processes WorkerN is changed after optimizing, and all access requests are in local section It is completed on point server, promotes the response time, content requests routing is also completed in local node server, and raising responds successfully Rate.
It,, only can superior under more service processes operational modes by the optimization of content routing table in the embodiment of the present invention Node server request content is primary, and superior node server is avoided to send the repetition of the identical content of local node server, The downlink traffic for saving superior node server, reduces its load;By safeguarding local server overall situation content routing table, pass through Redirection process changes content routing, and retargetable to other service processes of local node server carries out content resource acquisition, Especially when big concurrent, it is identical not have to superior node server re-request for the different service processes of node server on the same stage Content avoids network oscillation, ensure that service quality to reduce link bandwidth consumption, and reduces CDN scheduling system Load, while abnormality processing is considered, influence when by abnormal occurring reduces as far as possible;In addition, when there is multiple service processes to have When having content, content is obtained from the least service processes of the access to content number of links every time, balance access to content is linked at Load between each service processes, thus the problem for avoiding service processes single-point excessively high, thus improve the utilization rate of system with And response success rate.
It is a kind of structural block diagram of request of data device in the embodiment of the present invention with reference to Fig. 6.The request of data device application In node router in content distributing network CDN system, described device includes:
Linking request receiving module 301, for receiving linking request by this service processes;
First execution module 302, for judging that this service processes of local node server are asked with the presence or absence of the link The information for the content asked records;If it exists, then the content is obtained;
Second execution module 303, for judging this service processes of local node server not in the first execution module 302 There are under the information record case of the content of the linking request, judge whether other service processes of local node server are deposited In the information record of the content of the linking request, and if it exists, then obtain the content;
Third execution module 304, for judging other service processes of local node server in the second execution module 303 There is no under the information record case of the content of the linking request, the linking request is obtained in superior node server Content;
Respond module 305, linking request described in the content response based on acquisition.
Wherein, local node server can be any node server in content distributing network CDN system, when local section When point server is user's access node server, local node server can receive the linking request that user equipment is sent;When When local node server is non-user access node server, local node server can receive the transmission of other node servers Linking request.In the present embodiment, any node server in content distributing network CDN system is all made of more service processes Operational mode, therefore, local node server can receive linking request by any service processes (for example, this service processes).
Specifically, first execution module 302 is sentenced by inquiring the independent content routing table of this service processes maintenance Information record of this service processes of disconnected local node server with the presence or absence of the content of the linking request;Wherein, the list Only content routing table records the information of each content of corresponding service processes.
Specifically, second execution module 303 is by inquiring the global content routing that all service processes are safeguarded jointly Table judges other service processes of local node server with the presence or absence of the information record of the content of the linking request;Its In, the linking request quantity of each content of each service processes of the overall situation content routing table record local node router And access address.
And second execution module 303 is further used for: by inquiring in the overall situation that all service processes are safeguarded jointly Hold other service processes that routing table records to judge local node server there are the information of the content of the linking request not When less than one, then the service processes of the linking request minimum number of the content described in are selected, and passes through corresponding access Location, which redirects, obtains the content.
The third execution module 304 is specifically used for:
Access scheduling system, the address of request superior node server;
The superior node server address that the scheduling system returns is received, and according to the superior node server address To the content of linking request described in the superior node server request.
It in another embodiment, further include as shown in fig. 7, the request of data device of the present embodiment is on the basis of Fig. 6 One update module 306, the second update module 307 and third update module 308, in which:
First update module 306 is used to judge that this service processes of local node server are deposited in the first execution module 302 After information in the content of the linking request records and obtains the content, minute book in the global content routing table is taken The linking request quantity of the content of business process adds 1, to update the global content routing table.
Second update module 307 is used to judge other service processes of local node server in the second execution module 303 After recording there are the information of the content of the linking request and obtain the content, the global content routing table is updated, it will be by The linking request quantity for obtaining the content of the service processes of the content adds 1, while by the access address of this service processes It is recorded in described and holds, and initializing linking request quantity is 1;And the independent content routing table of this service processes is updated, Increase the information record of the content.
Third update module 308 is used to obtain the linking request in 304 superior node server of third execution module Content after, update the independent content routing table of this service processes, increase the content information record;And it updates described complete Office's content routing table increases this service processes to the linking request of the content, and initializing linking request quantity is 1, and incite somebody to action this The access address of service processes is recorded in described and holds.
Preferably, on the basis of Fig. 6 or Fig. 7, the request of data device of the embodiment of the present invention further include:
Exception processing module, for passing through pipe when any service processes for detecting local node service occur abnormal Reason process is updated to the global content routing table, to remove the linking request quantity of each content of exception service process And access address.
The embodiment of the invention discloses a kind of node server, which includes that Fig. 6 or data shown in Fig. 7 are asked Seek device.The node server of the present embodiment, only can superior node server request phase under more service processes operational modes It is primary with content, it avoids superior node server from sending the repetition of the identical content of local node server, saves higher level's section The downlink traffic of point server reduces its load, to reduce link bandwidth consumption, avoids network oscillation, ensure that Service Quality Amount.
The embodiment of the invention discloses a kind of content distributing network CDN systems, including multiple node servers, in up and down The node server of grade is communicated by scheduling system, and each described node server includes shown in Fig. 6 or Fig. 7 Request of data device.Since each node server in the content distributing network CDN system of the present embodiment uses such as Fig. 6 Or request of data device shown in Fig. 7, so that each node server under more service processes operational modes, only understands superior section Point server requests identical content primary, and superior node server is avoided to send out the repetition of the identical content of local node server It send, saves the downlink traffic of superior node server, to improve stability and the scheduling system of content distributing network CDN system The stability of system, improves performance, and can on node server unexpectedly may multi-section affix one's name to service processes, to increase entire The load capacity of CDN system, and do not have to additional increase server hardware resource, server resource is maximally utilized as far as possible.
In conclusion data request method disclosed by the invention, device, node server and CDN system pass through this service When process receives linking request, first determine whether this service processes of local node server with the presence or absence of the interior of the linking request The information of appearance records, and if it exists, then obtains the content directly in response to request;If it is not, then judging its of local node server He records service processes with the presence or absence of the information of the content of the linking request, and if it exists, then obtains the content;Otherwise upwards Grade node server obtains the content of the linking request.Therefore, data request method of the invention, device, node server And CDN system, under more service processes operational modes, only meeting superior node server requests identical content primary, avoids Grade node server sends the repetition of the identical content of local node server, saves the downstream of superior node server Amount, reduces its load, to reduce link bandwidth consumption, avoids network oscillation, ensure that service quality.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, the program can be stored in a computer-readable storage medium In, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, the storage medium can be magnetic Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access Memory, RAM) etc..
The above is a preferred embodiment of the present invention, it is noted that for those skilled in the art For, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also considered as Protection scope of the present invention.

Claims (22)

1. a kind of data request method, which is characterized in that the method is applied to the node road in content distributing network CDN system By in device, which comprises
Linking request is received by this service processes;
Judge that this service processes of local node server are recorded with the presence or absence of the information of the content of the linking request, if depositing Then obtaining the content;Otherwise
Judge that other service processes of local node server are recorded with the presence or absence of the information of the content of the linking request, if depositing Then obtaining the content;Otherwise
Superior node server obtains the content of the linking request;
Linking request described in the content response based on acquisition.
2. data request method as described in claim 1, which is characterized in that when judging local node server, there are the chains Other service processes of information record of the content of request are connect when being no less than one, then the linking request of selection content described in The service processes of minimum number obtain the content.
3. data request method as described in claim 1, which is characterized in that by inquiring the independent interior of this service processes maintenance Hold routing table to judge that this service processes of local node server are recorded with the presence or absence of the information of the content of the linking request; Wherein, the independent content routing table records the information of each content of corresponding service processes.
4. data request method as claimed in claim 3, which is characterized in that safeguarded jointly by all service processes of inquiry Global content routing table judges other service processes of local node server with the presence or absence of the content of the linking request Information record;Wherein, the global content routing table records each content of each service processes of local node router Linking request quantity and access address.
5. data request method as claimed in claim 4, which is characterized in that safeguarded jointly by all service processes of inquiry There are other services that the information of the content of the linking request records to judge local node server for global content routing table When process is no less than one, then the service processes of the linking request minimum number of the content described in are selected, and by corresponding Access address, which redirects, obtains the content.
6. data request method as claimed in claim 4, which is characterized in that judge local node server this service into After journey records there are the information of the content of the linking request and obtains the content, further includes:
The linking request quantity of the content of minute book service processes in the global content routing table is added 1, to update State global content routing table.
7. data request method as claimed in claim 4, which is characterized in that in other services for judging local node server After process records there are the information of the content of the linking request and obtains the content, further includes:
The global content routing table is updated, the linking request quantity of the content of the service processes of the content will be acquired Add 1, while the access address of this service processes being recorded in described and is held, and initializing linking request quantity is 1;
The independent content routing table for updating this service processes increases the information record of the content.
8. data request method as described in claim 1, which is characterized in that the superior node server obtains the chain Connect the content of request specifically:
Access scheduling system, the address of request superior node server;
Receive the superior node server address that the scheduling system returns, and according to the superior node server address to institute State the content of linking request described in superior node server request.
9. data request method as claimed in claim 4, which is characterized in that obtain the link in superior node server After the content of request, further includes:
The independent content routing table for updating this service processes increases the information record of the content;
The global content routing table is updated, increases this service processes to the linking request of the content, initializes linking request Quantity is 1, and the access address of this service processes is recorded in described and is held.
10. data request method as claimed in claim 4, which is characterized in that further include:
When any service processes of local node service occur abnormal, then pass through managing process to the global content routing table It is updated, to remove the linking request quantity and access address of each content of exception service process.
11. a kind of request of data device, which is characterized in that described device is applied to the node in content distributing network CDN system In router, described device includes:
Linking request receiving module, for receiving linking request by this service processes;
First execution module, for judging that this service processes of local node server whether there is the content of the linking request Information record;If it exists, then the content is obtained;
Second execution module, for judging this service processes of local node server in the first execution module, there is no the chains It connects under the information record case of the content of request, judges other service processes of local node server with the presence or absence of the link The information of the content of request records, and if it exists, then obtains the content;
Third execution module, for judging other service processes of local node server in the second execution module, there is no described Under the information record case of the content of linking request, the content of the linking request is obtained in superior node server;
Respond module, linking request described in the content response based on acquisition.
12. request of data device as claimed in claim 11, which is characterized in that second execution module is further used for: When other service processes for judging that local node server is recorded there are the information of the content of the linking request are no less than one When, then select the service processes of the linking request minimum number of the content described in obtain the content.
13. request of data device as claimed in claim 11, which is characterized in that first execution module is by inquiring this clothes The independent content routing table of business process maintenance is asked to judge that this service processes of local node server whether there is the link The information for the content asked records;Wherein, the independent content routing table records the information of each content of corresponding service processes.
14. request of data device as claimed in claim 13, which is characterized in that second execution module is all by inquiry The global content routing table that service processes are safeguarded jointly judges other service processes of local node server with the presence or absence of institute State the information record of the content of linking request;Wherein, each clothes of the global content routing table record local node router The linking request quantity and access address of each content of business process.
15. request of data device as claimed in claim 14, which is characterized in that second execution module is further used for: By inquiring the global content routing table that all service processes are safeguarded jointly, to judge local node server, there are the links When other service processes of the information record of the content of request are no less than one, then the linking request number of the content described in is selected Least service processes are measured, and is redirected by corresponding access address and obtains the content.
16. request of data device as claimed in claim 14, which is characterized in that further include the first update module, for the One execution module judges that this service processes of local node server are recorded and obtained there are the information of the content of the linking request After taking the content, the linking request quantity of the content of minute book service processes in the global content routing table is added 1, To update the global content routing table.
17. request of data device as claimed in claim 14, which is characterized in that further include the second update module, for the Two execution modules judge other service processes of local node server there are the information of the content of linking request records simultaneously After obtaining the content,
The global content routing table is updated, the linking request quantity of the content of the service processes of the content will be acquired Add 1, while the access address of this service processes being recorded in described and is held, and initializing linking request quantity is 1;And
The independent content routing table for updating this service processes increases the information record of the content.
18. request of data device as claimed in claim 11, which is characterized in that the third execution module is specifically used for:
Access scheduling system, the address of request superior node server;
Receive the superior node server address that the scheduling system returns, and according to the superior node server address to institute State the content of linking request described in superior node server request.
19. request of data device as claimed in claim 14, which is characterized in that further include third update module, for the After three execution module superior node servers obtain the content of the linking request,
The independent content routing table for updating this service processes increases the information record of the content;And
The global content routing table is updated, increases this service processes to the linking request of the content, initializes linking request Quantity is 1, and the access address of this service processes is recorded in described and is held.
20. request of data device as claimed in claim 14, which is characterized in that further include:
Exception processing module, when any service processes for detecting local node service occur abnormal, by managing process to The overall situation content routing table is updated, to remove the linking request quantity and access of each content of exception service process Location.
21. a kind of node server, which is characterized in that including the described in any item request of data devices of such as claim 11-20.
22. a kind of content distributing network CDN system, which is characterized in that including multiple node serves as claimed in claim 21 Device, the node server in the superior and the subordinate are communicated by scheduling system.
CN201510816506.4A 2015-11-23 2015-11-23 Data request method, device, node server and CDN system Active CN105516238B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510816506.4A CN105516238B (en) 2015-11-23 2015-11-23 Data request method, device, node server and CDN system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510816506.4A CN105516238B (en) 2015-11-23 2015-11-23 Data request method, device, node server and CDN system

Publications (2)

Publication Number Publication Date
CN105516238A CN105516238A (en) 2016-04-20
CN105516238B true CN105516238B (en) 2019-03-19

Family

ID=55723869

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510816506.4A Active CN105516238B (en) 2015-11-23 2015-11-23 Data request method, device, node server and CDN system

Country Status (1)

Country Link
CN (1) CN105516238B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110392020B (en) * 2018-04-18 2021-05-07 网宿科技股份有限公司 Streaming media resource transmission method and system
CN108337327A (en) * 2018-04-26 2018-07-27 拉扎斯网络科技(上海)有限公司 A kind of resource acquiring method and proxy server
CN109005118A (en) * 2018-08-21 2018-12-14 中国平安人寿保险股份有限公司 Search method, apparatus, computer equipment and the storage medium of CDN source station address
CN111385208B (en) * 2018-12-29 2022-08-09 广州市百果园信息技术有限公司 Routing method, routing device, computer equipment and storage medium
CN111756681A (en) * 2019-03-29 2020-10-09 北京金山云网络技术有限公司 Streaming media cascade scheduling method and device, electronic equipment and storage medium
CN112769900B (en) * 2020-12-22 2023-04-25 中冶赛迪信息技术(重庆)有限公司 Data distribution method, system, medium and electronic terminal

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103024018A (en) * 2012-12-04 2013-04-03 北京蓝汛通信技术有限责任公司 Method and device for operating multiple content distribution network (CDN) service processes in single device
CN104811323A (en) * 2014-01-23 2015-07-29 腾讯科技(深圳)有限公司 Data requesting method, data requesting device, node server and CDN (content delivery network) system
CN104935636A (en) * 2015-04-29 2015-09-23 广州杰赛科技股份有限公司 Network channel acceleration method and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103024018A (en) * 2012-12-04 2013-04-03 北京蓝汛通信技术有限责任公司 Method and device for operating multiple content distribution network (CDN) service processes in single device
CN104811323A (en) * 2014-01-23 2015-07-29 腾讯科技(深圳)有限公司 Data requesting method, data requesting device, node server and CDN (content delivery network) system
CN104935636A (en) * 2015-04-29 2015-09-23 广州杰赛科技股份有限公司 Network channel acceleration method and system

Also Published As

Publication number Publication date
CN105516238A (en) 2016-04-20

Similar Documents

Publication Publication Date Title
CN105516238B (en) Data request method, device, node server and CDN system
CN101883103B (en) Method and system for client-side scaling of Web server farm architecture in a cloud data center
JP4413426B2 (en) Optimized network resource location
Tang et al. QoS-aware replica placement for content distribution
CN102656922B (en) Utilize for using swarm intelligence to carry out the system and method for the framework of information router at large scale distributed system
JP3627005B2 (en) System and method integrating load distribution and resource management in an Internet environment
CN104660700B (en) A kind of method and system of content distributing network
US20030023669A1 (en) Dynamic HTTP load balancing method and apparatus
US9185006B2 (en) Exchange of server health and client information through headers for request management
CN101431532A (en) Content routing method, load balancing equipment and resource management equipment
US20030229682A1 (en) Meta content delivery network system
US20060179059A1 (en) Cluster monitoring system with content-based event routing
CN101841526A (en) Cluster streaming media server system applied to large-scale user demand
JPH1145204A (en) Method and system for dynamically duplicating cache in network by using reverse tree generating method
CN108027805A (en) Load distribution in data network
JP2002140309A (en) Service system
CN105207947B (en) A kind of gradual traffic scheduling method and system of filtering shake
CN103078880A (en) Content information processing method, system and equipment based on multiple content delivery networks
CN101551888A (en) Advertising information release system and corresponding method for controlling advertisement release
CN104780221A (en) Intellectual property comprehensive service platform system for middle and small-sized enterprises
CN101820365B (en) Service bus supporting dynamic optimization of QoS of composite service
CN103166980A (en) Internet data pulling method and system
EP0905621A1 (en) Internet performance network
CN109618003A (en) A kind of servers' layout method, server and storage medium
CN107197039B (en) A kind of PAAS platform service packet distribution method and system based on CDN

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant