CN106603703B - Return source node determination method and device - Google Patents

Return source node determination method and device Download PDF

Info

Publication number
CN106603703B
CN106603703B CN201611249913.2A CN201611249913A CN106603703B CN 106603703 B CN106603703 B CN 106603703B CN 201611249913 A CN201611249913 A CN 201611249913A CN 106603703 B CN106603703 B CN 106603703B
Authority
CN
China
Prior art keywords
node
data center
internet data
target
center node
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611249913.2A
Other languages
Chinese (zh)
Other versions
CN106603703A (en
Inventor
丁浩
王大伟
孙犁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201611249913.2A priority Critical patent/CN106603703B/en
Publication of CN106603703A publication Critical patent/CN106603703A/en
Application granted granted Critical
Publication of CN106603703B publication Critical patent/CN106603703B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention discloses a back source node determining method and a back source node determining device, which are applied to a target internet data center node, and are used for receiving and storing a file list sent by other internet data center nodes except a self node in advance; the file list records identification information of currently stored data of an Internet data center node which sends the file list; the method comprises the following steps: when the node detects that no target data requested by a user exists, determining an internet data center node storing the target data according to the file list and the identification information of the target data; determining the network speed corresponding to each determined internet data center node; and determining the internet data center node corresponding to the determined maximum network speed as a back source node. By applying the embodiment of the invention, the quality of the source returning service is ensured.

Description

Return source node determination method and device
Technical Field
The present invention relates to the field of data source returning technologies, and in particular, to a method and an apparatus for determining a source returning node.
Background
The back source is an important technology in a CDN (Content Delivery Network). The back-sourcing means that when an IDC (Internet Data Center) node in the CDN that receives the user Data request does not have Data requested by the user, the IDC node requests the Data requested by the user from the back-sourcing node.
Currently, the back source node is mainly determined by the following two ways:
the first method is as follows: based on static IP configuration. In the mode, each IDC node is statically configured with an IP address which can be returned to the source; when returning to the source, calculating the statically configured IP address through a consistent hash algorithm; and determining the back source node according to the calculation result.
The second method comprises the following steps: based on the scheduler approach. In the method, the dispatcher judges the back-source request to determine the back-source node.
However, by applying the above two methods, the determined network speed of the back-source node is not considered, and thus it cannot be ensured that the determined back-source node is a node capable of providing the optimal download speed, that is, the quality of the back-source service cannot be ensured.
Disclosure of Invention
The embodiment of the invention aims to provide a back-source node determining method and device to ensure the quality of back-source service.
In order to achieve the above object, the embodiment of the present invention discloses a method for determining a back source node, which is applied to a target internet data center node, and is configured to receive and store in advance a file list sent by other internet data center nodes except a self node; the file list records identification information of currently stored data of an Internet data center node which sends the file list;
the method comprises the following steps:
when the self node detects that no target data requested by a user exists, determining an Internet data center node storing the target data according to the file list and the identification information of the target data, wherein the identification information of the target data is carried in a data request aiming at the target data, which is sent to the target Internet data center node by the user;
determining a network speed corresponding to each determined internet data center node, wherein the network speed is as follows: the target internet data center node downloads data from the determined internet data center node at a data downloading speed;
and determining the internet data center node corresponding to the determined maximum network speed as a back source node.
Optionally, the determining the determined network speed corresponding to each internet data center node includes:
and aiming at each determined internet data center node, determining the receiving speed of the target internet data center node when the target internet data center node receives the file list sent by the internet data center node as the network speed corresponding to the internet data center node.
Optionally, the determining the determined network speed corresponding to each internet data center node includes:
detecting the downloading speed of each downloading path in real time aiming at each downloading path from the target internet data center node to each internet data center node except the target internet data center node;
and determining the maximum download speed in the currently detected download speeds of each download path from the target internet data center node to the internet data center node as the network speed corresponding to the internet data center node aiming at each determined internet data center node.
Optionally, the determining the determined network speed corresponding to each internet data center node includes:
detecting the downloading speed of each downloading path from the target internet data center node to each determined internet data center node;
and determining the maximum download speed in the detected download speeds of each download path from the target internet data center node to the internet data center node as the network speed corresponding to the internet data center node aiming at each determined internet data center node.
Optionally, the method further includes:
sending a downloading request aiming at the target data to a first internet data center node which is closest to the back-source node in a path from the target internet data center node to the back-source node, so that the first internet data center node requests the back-source node for the target data according to the downloading request;
and under the condition that the first internet data center node does not request the target data from the back source node, determining a global storage node storing all data as the back source node.
Optionally, the method further includes:
requesting the target data from the back-source node;
and in the case that the target data is not requested from the back source node, determining the global storage node storing all data as the back source node.
In order to achieve the above object, an embodiment of the present invention discloses a back source node determining device, which is applied to a target internet data center node, and the device includes: a storage module, a first determination module, a second determination module, and a third determination module, wherein,
the storage module is used for receiving and storing a file list sent by other internet data center nodes except the self node in advance; the file list records identification information of currently stored data of an Internet data center node which sends the file list;
the first determining module is configured to determine, when a node itself detects that there is no target data requested by a user, an internet data center node in which the target data is stored according to the file list and identification information of the target data, where the identification information of the target data is carried in a data request for the target data, which is sent to the target internet data center node by the user;
the second determining module is configured to determine a network speed corresponding to each determined internet data center node, where the network speed is: the target internet data center node downloads data from the determined internet data center node at a data downloading speed;
and the third determining module is used for determining the internet data center node corresponding to the determined maximum network speed as a back source node.
Optionally, the second determining module is specifically configured to:
and aiming at each determined internet data center node, determining the receiving speed of the target internet data center node when the target internet data center node receives the file list sent by the internet data center node as the network speed corresponding to the internet data center node.
Optionally, the second determining module is specifically configured to:
detecting the downloading speed of each downloading path in real time aiming at each downloading path from the target internet data center node to each internet data center node except the target internet data center node;
and determining the maximum download speed in the currently detected download speeds of each download path from the target internet data center node to the internet data center node as the network speed corresponding to the internet data center node aiming at each determined internet data center node.
Optionally, the second determining module is specifically configured to:
detecting the downloading speed of each downloading path from the target internet data center node to each determined internet data center node;
and determining the maximum download speed in the detected download speeds of each download path from the target internet data center node to the internet data center node as the network speed corresponding to the internet data center node aiming at each determined internet data center node.
Optionally, the apparatus further comprises: a sending module and a fourth determining module, wherein,
the sending module is configured to send a download request for the target data to a first internet data center node closest to the back-source node in a path from the target internet data center node to the back-source node, so that the first internet data center node requests the back-source node for the target data according to the download request;
the fourth determining module is configured to determine, as the back-source node, a global storage node storing all data when the first internet data center node does not request the back-source node for the target data.
Optionally, the apparatus further comprises: a request module and a fifth determination module, wherein,
the request module is used for requesting the target data from the back source node;
the fifth determining module is configured to determine, as the back-source node, a global storage node storing all data when the back-source node does not request the target data.
As can be seen from the above technical solutions, the embodiments of the present invention provide a method and an apparatus for determining a back-source node, which are applied to a target internet data center node; receiving and storing a file list sent by other internet data center nodes except the self node in advance; the file list records identification information of currently stored data of an Internet data center node which sends the file list; the method comprises the following steps: when the node detects that no target data requested by a user exists, determining an internet data center node storing the target data according to the file list and the identification information of the target data; determining a network speed corresponding to each determined internet data center node, wherein the network speed is as follows: the target internet data center node downloads data from the determined internet data center node at a data downloading speed; and determining the internet data center node corresponding to the determined maximum network speed as a back source node.
By applying the method and the device for determining the back-source node provided by the embodiment of the invention, the internet data center node corresponding to the maximum network speed in the network speeds of the internet data center nodes storing the target data requested by the user is determined as the back-source node by considering the network speed of the internet data center node storing the target data requested by the user. The determined source returning node is a node capable of providing the optimal downloading speed, and the quality of source returning service is ensured.
Of course, it is not necessary for any product or method of practicing the invention to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a first flowchart illustrating a back-source node determining method according to an embodiment of the present invention;
fig. 2 is a second flowchart illustrating a back-source node determining method according to an embodiment of the present invention;
fig. 3 is a third flowchart illustrating a back-source node determining method according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a back-source node determining apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a back-source node determining apparatus according to a second embodiment of the present invention;
fig. 6 is a schematic structural diagram of a third back-source node determining apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to solve the problem of the prior art, embodiments of the present invention provide a method and an apparatus for determining a back-source node. It should be noted that the method and apparatus for determining a back-source node provided in the embodiments of the present invention are preferably applied to an IDC (Internet Data Center) node in a CDN (content delivery Network). First, a method for determining a back-source node provided in an embodiment of the present invention is described below.
Fig. 1 is a first flowchart of a back-to-source node determining method according to an embodiment of the present invention, which may include:
s101: receiving and storing a file list sent by other internet data center nodes except the self node in advance;
the file list records identification information of currently stored data of an Internet data center node which sends the file list;
for example, suppose there are 4 IDC nodes in the CDN, and the 4 IDC nodes are IDC node 1, IDC node 2, IDC node 3, and IDC node 4, respectively; data A, data B and data C are stored in the IDC node 1; data B, data C and data X are stored in the IDC node 2; data Y and data Z are stored in the IDC node 3; the IDC node 4 stores therein data X, data Y, and data Z.
In practical application, each IDC node can send the identification information recorded with the currently stored data of the IDC node to other IDC nodes at intervals or at preset time points; or when the data stored in the IDC node changes (such as data addition and data deletion), the identification information recorded with the data currently stored in the IDC node is sent to other IDC nodes; and the change condition of the data in the period of time can be sent to other IDC nodes at intervals or at preset time points.
Through the three modes, each IDC node can obtain a file list of other IDCs except the IDC node, wherein the IDC records the identification information of the currently stored data.
S102: when the node detects that no target data requested by a user exists, determining an internet data center node storing the target data according to the file list and the identification information of the target data;
the identification information of the target data is carried in a data request aiming at the target data, which is sent to the target internet data center node by a user.
For example, assume that the node that receives the data request for the target data X from the user is IDC node 1.
The IDC node 1 detects that the node itself does not have the target data X requested by the user, and determines that the Internet data center node storing the target data X is respectively as follows according to a file list of the stored identification information of the currently stored data recorded in each IDC except the IDC node itself and the identification information of the target data X: IDC node 2 and IDC node 4.
In practical applications, the type of the target data requested by the user may be video, audio, picture, and the like, and the embodiment of the present invention does not limit the type of the target data requested by the user.
S103: determining the network speed corresponding to each determined internet data center node;
wherein the network speed is: the target internet data center node downloads data from the determined internet data center node at a data downloading speed;
in practical application, the determined network speed corresponding to each internet data center node can be determined in any one of the following three manners.
The first method is as follows: and aiming at each determined internet data center node, determining the receiving speed of the target internet data center node when the target internet data center node receives the file list sent by the internet data center node as the network speed corresponding to the internet data center node.
The second method comprises the following steps: detecting the downloading speed of each downloading path in real time aiming at each downloading path from the target internet data center node to each internet data center node except the target internet data center node;
and determining the maximum download speed in the currently detected download speeds of each download path from the target internet data center node to the internet data center node as the network speed corresponding to the internet data center node aiming at each determined internet data center node.
The third method comprises the following steps: detecting the downloading speed of each downloading path from the target internet data center node to each determined internet data center node;
and determining the maximum download speed in the detected download speeds of each download path from the target internet data center node to the internet data center node as the network speed corresponding to the internet data center node aiming at each determined internet data center node.
The following description is made in correspondence with the determination of the network speed corresponding to each determined internet data center node in the above-described manner.
Assuming that the receiving speed of the IDC node 1 when receiving the file list sent by the IDC node 2 is 3M/s (mega/second), determining the 3M/s as the network speed corresponding to the IDC node 2; assuming that the receiving speed of the IDC node 1 when receiving the file list sent by the IDC node 4 is 5M/s (mega/second), the 5M/s is determined as the network speed corresponding to the IDC node 4.
Specifically, the IDC nodes transmit the file list to each other, may calculate a data transmission path through a shortest path algorithm or an optimal path algorithm, and transmits the file list through the calculated data transmission path.
The following description is made in correspondence with the determination of the network speed corresponding to each determined internet data center node in the second mode.
Suppose that 2 download paths are shared by IDC node 1 and IDC node 2, wherein one download path is IDC node 2- > IDC node 3- > IDC node 1, and the other download path is IDC node 2- > IDC node 1;
1 download path is shared by IDC node 1 and IDC node 3, wherein the download path is IDC node 3- > IDC node 1;
the IDC node 1 and the IDC node 4 share 2 download paths, wherein one download path is IDC node 4- > IDC node 3- > IDC node 1, and the other download path is IDC node 4- > IDC node 1.
The downloading speed of the current downloading path of IDC node 2- > IDC node 3- > IDC node 1 is detected to be 3M/s; the download path is IDC node 2- > the download speed of IDC node 1 is 1M/s; the downloading path is IDC node 3- > the downloading speed of IDC node 1 is 3M/s; the downloading speed of the downloading path of IDC node 4- > IDC node 3- > IDC node 1 is 5M/s; the download path is IDC node 4- > the download speed of IDC node 1 is 2M/s.
For the determined IDC node 2, determining 3M/s as the network speed corresponding to the IDC node 2; for the determined IDC node 4, 5M/s is determined as the network speed corresponding to the IDC node 4.
It should be noted that, a technology for detecting a download speed of a download path is a prior art, and details thereof are not described herein in the embodiments of the present invention.
The following description is made in correspondence with the determination of the network speed corresponding to each determined internet data center node in the third manner.
Suppose that 2 download paths are shared from IDC node 1 to the determined IDC node 2, wherein one download path is IDC node 2- > IDC node 3- > IDC node 1, and the other download path is IDC node 2- > IDC node 1;
the IDC node 1 and the determined IDC node 4 share 2 download paths, wherein one download path is IDC node 4- > IDC node 3- > IDC node 1, and the other download path is IDC node 4- > IDC node 1.
Detecting that the downloading speed of the downloading path of IDC node 2- > IDC node 3- > IDC node 1 is 3M/s; the download path is IDC node 2- > the download speed of IDC node 1 is 1M/s; the downloading speed of the downloading path of IDC node 4- > IDC node 3- > IDC node 1 is 5M/s; the download path is IDC node 4- > the download speed of IDC node 1 is 2M/s.
For the determined IDC node 2, determining 3M/s as the network speed corresponding to the IDC node 2; for the determined IDC node 4, 5M/s is determined as the network speed corresponding to the IDC node 4.
It should be noted that, a technology for detecting a download speed of a download path is a prior art, and details thereof are not described herein in the embodiments of the present invention. The difference between the third mode and the second mode is that: the downloading speed of each downloading path from the target internet data center node to each internet data center node except the target internet data center node does not need to be detected in real time, and the downloading speed of each downloading path from the target internet data center node to each determined internet data center node only needs to be detected after the internet data center node storing the target data is determined.
S104: and determining the internet data center node corresponding to the determined maximum network speed as a back source node.
Exemplarily, the network speed corresponding to the IDC node 2 is determined to be 3M/S through S103; and determining that the network speed corresponding to the IDC node 4 is 5M/s, and determining the IDC node 4 as a back source node.
It should be noted that, the target data X, IDC node 1, IDC node 2, IDC node 3, and IDC node 4 are used as examples in the embodiment of the present invention, and are only a specific example of the present invention, and do not limit the present invention.
By applying the embodiment of the invention shown in fig. 1, the network speed of the internet data center node storing the target data requested by the user is considered, and the internet data center node corresponding to the maximum network speed in the network speeds of the internet data center nodes storing the target data requested by the user is determined as the back source node. The determined source returning node is a node capable of providing the optimal downloading speed, and the quality of source returning service is ensured.
Fig. 2 is a second flowchart illustrating a method for determining a back-source node according to an embodiment of the present invention, where the embodiment shown in fig. 2 of the present invention adds the following two steps based on the embodiment shown in fig. 1,
s105: sending a downloading request aiming at the target data to a first internet data center node which is closest to the back-source node in a path from the target internet data center node to the back-source node, so that the first internet data center node requests the back-source node for the target data according to the downloading request;
s106: and under the condition that the first internet data center node does not request the target data from the back source node, determining a global storage node storing all data as the back source node.
For example, the target data X and the back-source node are taken as the IDC node 4 for explanation.
When the IDC node 4 is determined as a back source node and a path for downloading the target data X from the IDC node 4 is IDC node 4- > IDC node 3- > IDC node 1, the IDC node 3 is a node closest to the IDC node 4 at the moment, the IDC node 1 can send a downloading request aiming at the target data X to the IDC node 3, and the IDC node 3 requests the IDC node 4 for the target data X after receiving the downloading request; if the request does not reach the target data X, the IDC node 4 sends a file list to the IDC node 1 until the IDC node 3 requests the target data X from the IDC node 4, the data stored in the IDC node 4 changes, and the target data X is not stored any more; the IDC node 3 may send a message that the IDC node 4 no longer stores the target data X to the IDC node 1, and after receiving the message, the IDC node 1 determines the global storage node storing all data as a back source node and requests the target data X from the global storage node.
It should be noted that, in the embodiment of the present invention, the target data X and the back source node are used as the IDC node 4 for description, which is only a specific example of the present invention and does not limit the present invention.
By applying the embodiment of the invention shown in fig. 2, the network speed of the internet data center node storing the target data requested by the user is considered, and the internet data center node corresponding to the maximum network speed in the network speeds of the internet data center nodes storing the target data requested by the user is determined as the back source node. The determined source returning node is a node capable of providing the optimal downloading speed, and the quality of source returning service is ensured. And when the determined data of the back source node changes and no more data requested by the user is stored, the global storage node storing all the data is determined as the back source node, the data requested by the user is requested from the global storage node, and the user can obtain the requested data.
Fig. 3 is a third flowchart illustrating a method for determining a back-source node according to an embodiment of the present invention, where the embodiment shown in fig. 3 of the present invention adds the following two steps based on the embodiment shown in fig. 1,
s107: requesting the target data from the back-source node;
s108: and in the case that the target data is not requested from the back source node, determining the global storage node storing all data as the back source node.
For example, the target data X and the back-source node are taken as the IDC node 4 for explanation.
When the IDC node 4 is determined as a back source node, the IDC node 1 can directly request the IDC node 4 for the target data X; if the request does not reach the target data X, the IDC node 4 sends a file list to the IDC node 1 until the IDC node 1 requests the target data X from the IDC node 4, the data stored in the IDC node 4 changes, and the target data X is not stored any more; at this time, the IDC node 1 determines the global storage node storing all data as a back source node, and requests the target data X from the global storage node.
It should be noted that, in the embodiment of the present invention, the target data X and the back source node are taken as the IDC node 4 for illustration, which is only a specific example of the present invention and does not limit the present invention.
By applying the embodiment shown in fig. 3 of the present invention, the internet data center node corresponding to the maximum network speed among the network speeds of the internet data center nodes storing the target data requested by the user is determined as the back source node, taking into account the network speed of the internet data center node storing the target data requested by the user. The determined source returning node is a node capable of providing the optimal downloading speed, and the quality of source returning service is ensured. And when the determined data of the back source node changes and no more data requested by the user is stored, the global storage node storing all the data is determined as the back source node, the data requested by the user is requested from the global storage node, and the user can obtain the requested data.
Corresponding to the above method embodiment, the embodiment of the present invention further provides a back source node determining apparatus.
Fig. 4 is a schematic structural diagram of a back-source node determining apparatus according to an embodiment of the present invention; the method can comprise the following steps: a storage module 401, a first determination module 402, a second determination module 403, and a third determination module 404, wherein,
the storage module 401 is configured to receive and store in advance a file list sent by other internet data center nodes except a node of the storage module; the file list records identification information of currently stored data of an Internet data center node which sends the file list;
a first determining module 402, configured to determine, when a node detects that there is no target data requested by a user, an internet data center node storing the target data according to the file list and identification information of the target data, where the identification information of the target data is carried in a data request for the target data, which is sent to the target internet data center node by the user;
a second determining module 403, configured to determine a network speed corresponding to each determined internet data center node, where the network speed is: the target internet data center node downloads data from the determined internet data center node at a data downloading speed;
the second determining module 403 shown in the embodiment of the present invention may be specifically configured to:
and aiming at each determined internet data center node, determining the receiving speed of the target internet data center node when the target internet data center node receives the file list sent by the internet data center node as the network speed corresponding to the internet data center node.
The second determining module 403 shown in the embodiment of the present invention may be specifically configured to:
detecting the downloading speed of each downloading path in real time aiming at each downloading path from the target internet data center node to each internet data center node except the target internet data center node;
and determining the maximum download speed in the currently detected download speeds of each download path from the target internet data center node to the internet data center node as the network speed corresponding to the internet data center node aiming at each determined internet data center node.
The second determining module 403 shown in the embodiment of the present invention may be specifically configured to:
detecting the downloading speed of each downloading path from the target internet data center node to each determined internet data center node;
and determining the maximum download speed in the detected download speeds of each download path from the target internet data center node to the internet data center node as the network speed corresponding to the internet data center node aiming at each determined internet data center node.
A third determining module 404, configured to determine the internet data center node corresponding to the determined maximum network speed as a back-to-source node.
By applying the embodiment shown in fig. 4 of the present invention, the internet data center node corresponding to the maximum network speed among the network speeds of the internet data center nodes storing the target data requested by the user is determined as the back source node, taking into account the network speed of the internet data center node storing the target data requested by the user. The determined source returning node is a node capable of providing the optimal downloading speed, and the quality of source returning service is ensured.
Fig. 5 is a schematic structural diagram of a back-source node determining apparatus according to a second embodiment of the present invention; the embodiment of the invention shown in fig. 5 is added to the embodiment shown in fig. 4: a sending module 405 and a fourth determining module 406, wherein,
a sending module 405, configured to send a download request for the target data to a first internet data center node closest to the back-source node in a path from the target internet data center node to the back-source node, so that the first internet data center node requests the back-source node for the target data according to the download request;
a fourth determining module 406, configured to determine, as the back-source node, a global storage node storing all data when the first internet data center node does not request the back-source node for the target data.
By applying the embodiment shown in fig. 5 of the present invention, the internet data center node corresponding to the maximum network speed among the network speeds of the internet data center nodes storing the target data requested by the user is determined as the back source node, taking into account the network speed of the internet data center node storing the target data requested by the user. The determined source returning node is a node capable of providing the optimal downloading speed, and the quality of source returning service is ensured. And when the determined data of the back source node changes and no more data requested by the user is stored, the global storage node storing all the data is determined as the back source node, the data requested by the user is requested from the global storage node, and the user can obtain the requested data.
Fig. 6 is a schematic structural diagram of a back-source node determining apparatus according to an embodiment of the present invention; the embodiment of the invention shown in fig. 6 is added to the embodiment shown in fig. 4: a request module 407 and a fifth determination module 408, wherein,
a request module 407, configured to request the target data from the back-source node;
a fifth determining module 408, configured to determine, as the back-source node, a global storage node storing all data in a case that the back-source node does not request the target data.
By applying the embodiment shown in fig. 6 of the present invention, the internet data center node corresponding to the maximum network speed among the network speeds of the internet data center nodes storing the target data requested by the user is determined as the back source node, taking into account the network speed of the internet data center node storing the target data requested by the user. The determined source returning node is a node capable of providing the optimal downloading speed, and the quality of source returning service is ensured. And when the determined data of the back source node changes and no more data requested by the user is stored, the global storage node storing all the data is determined as the back source node, the data requested by the user is requested from the global storage node, and the user can obtain the requested data.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
Those skilled in the art will appreciate that all or part of the steps in the above method embodiments may be implemented by a program to instruct relevant hardware to perform the steps, and the program may be stored in a computer-readable storage medium, which is referred to herein as a storage medium, such as: ROM/RAM, magnetic disk, optical disk, etc.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims (4)

1. A back source node determining method is characterized in that the back source node determining method is applied to a target internet data center node, and is used for receiving and storing a file list sent by other internet data center nodes except a self node in advance; the file list records identification information of currently stored data of an Internet data center node which sends the file list;
the method comprises the following steps:
when the self node detects that no target data requested by a user exists, determining an Internet data center node storing the target data according to the file list and the identification information of the target data, wherein the identification information of the target data is carried in a data request aiming at the target data, which is sent to the target Internet data center node by the user;
for each determined internet data center node, determining a receiving speed of the target internet data center node when the target internet data center node receives the updated file list sent by the internet data center node as a network speed corresponding to the internet data center node, wherein the network speed is as follows: the target internet data center node downloads data from the determined internet data center node at a speed represented by the data volume downloaded per second;
determining the internet data center node corresponding to the determined maximum network speed as a back source node;
requesting the target data from the back-source node;
and in the case that the target data is not requested from the back source node, determining the global storage node storing all data as the back source node.
2. The method of claim 1, further comprising:
sending a downloading request aiming at the target data to a first internet data center node which is closest to the back-source node in a path from the target internet data center node to the back-source node, so that the first internet data center node requests the back-source node for the target data according to the downloading request;
and under the condition that the first internet data center node does not request the target data from the back source node, determining a global storage node storing all data as the back source node.
3. A back-source node determining apparatus, applied to a target internet data center node, the apparatus comprising: a storage module, a first determination module, a second determination module, a third determination module, a request module, and a fifth determination module, wherein,
the storage module is used for receiving and storing a file list sent by other internet data center nodes except the self node in advance; the file list records identification information of currently stored data of an Internet data center node which sends the file list;
the first determining module is configured to determine, when a node itself detects that there is no target data requested by a user, an internet data center node in which the target data is stored according to the file list and identification information of the target data, where the identification information of the target data is carried in a data request for the target data, which is sent to the target internet data center node by the user;
the second determining module is configured to determine, for each determined internet data center node, a receiving speed at which the target internet data center node receives the updated file list sent by the internet data center node, as a network speed corresponding to the internet data center node, where the network speed is: the target internet data center node downloads data from the determined internet data center node at a speed represented by the data volume downloaded per second;
the third determining module is configured to determine an internet data center node corresponding to the determined maximum network speed as a back source node;
the request module is used for requesting the target data from the back source node;
the fifth determining module is configured to determine, as the back-source node, a global storage node storing all data when the back-source node does not request the target data.
4. The apparatus of claim 3, further comprising: a sending module and a fourth determining module, wherein,
the sending module is configured to send a download request for the target data to a first internet data center node closest to the back-source node in a path from the target internet data center node to the back-source node, so that the first internet data center node requests the back-source node for the target data according to the download request;
the fourth determining module is configured to determine, as the back-source node, a global storage node storing all data when the first internet data center node does not request the back-source node for the target data.
CN201611249913.2A 2016-12-29 2016-12-29 Return source node determination method and device Active CN106603703B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611249913.2A CN106603703B (en) 2016-12-29 2016-12-29 Return source node determination method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611249913.2A CN106603703B (en) 2016-12-29 2016-12-29 Return source node determination method and device

Publications (2)

Publication Number Publication Date
CN106603703A CN106603703A (en) 2017-04-26
CN106603703B true CN106603703B (en) 2020-09-04

Family

ID=58605199

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611249913.2A Active CN106603703B (en) 2016-12-29 2016-12-29 Return source node determination method and device

Country Status (1)

Country Link
CN (1) CN106603703B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108282668B (en) * 2018-01-26 2020-11-24 北京奇艺世纪科技有限公司 Video acquisition method and system
CN110086721B (en) 2018-01-26 2021-03-12 北京金山云网络技术有限公司 Return source relation management system, method, device, server and storage medium
CN110213315B (en) * 2018-05-30 2022-01-07 腾讯科技(深圳)有限公司 Path determining method and device
CN110166800B (en) * 2019-05-22 2021-08-20 北京奇艺世纪科技有限公司 Video source returning method, system, device and computer readable storage medium
CN110300170A (en) * 2019-06-28 2019-10-01 杭州复杂美科技有限公司 Block chain distributed storage method for down loading, equipment and storage medium
CN110290217B (en) * 2019-07-01 2022-04-26 腾讯科技(深圳)有限公司 Data request processing method and device, storage medium and electronic device
CN112235402B (en) * 2020-10-14 2023-04-07 杭州安恒信息技术股份有限公司 Network source returning method, network source returning system and related device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102726031A (en) * 2011-07-22 2012-10-10 华为技术有限公司 Content processing method, device and system
CN104394441A (en) * 2014-11-27 2015-03-04 北京奇艺世纪科技有限公司 Video content distribution scheduling method, device and system
CN105871975A (en) * 2015-11-17 2016-08-17 乐视云计算有限公司 Method and device for selecting source server

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103327121A (en) * 2013-07-10 2013-09-25 亿览在线网络技术(北京)有限公司 P2P (Peer-to-Peer Network) network resource transmission method and device for same
CN104811323A (en) * 2014-01-23 2015-07-29 腾讯科技(深圳)有限公司 Data requesting method, data requesting device, node server and CDN (content delivery network) system
US9600504B2 (en) * 2014-09-08 2017-03-21 International Business Machines Corporation Data quality analysis and cleansing of source data with respect to a target system
CN106059856A (en) * 2016-06-20 2016-10-26 乐视控股(北京)有限公司 File retrieval method, file retrieval apparatus and content delivery network (CDN) system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102726031A (en) * 2011-07-22 2012-10-10 华为技术有限公司 Content processing method, device and system
CN104394441A (en) * 2014-11-27 2015-03-04 北京奇艺世纪科技有限公司 Video content distribution scheduling method, device and system
CN105871975A (en) * 2015-11-17 2016-08-17 乐视云计算有限公司 Method and device for selecting source server

Also Published As

Publication number Publication date
CN106603703A (en) 2017-04-26

Similar Documents

Publication Publication Date Title
CN106603703B (en) Return source node determination method and device
CN107483614B (en) Content scheduling method and communication network based on CDN (content delivery network) and P2P network
CN109347968B (en) Method, equipment and system for downloading data blocks of resource file
US7436780B2 (en) Method and apparatus for approximating location of node attached to a network
US7970820B1 (en) Locality based content distribution
CN102546656B (en) Method, system and device for finding user in social network
US20150113065A1 (en) Contiguous Location-Based User Networks
CN110703980B (en) File transmission method and device
US10313452B2 (en) Migrating a chat message service provided by a chat server to a new chat server
CN106453460B (en) File distribution method, device and system
EP3189446A1 (en) A method, cloud synchronization function means and file system for handling files and directories in a cloud storage service
CN106375471B (en) Edge node determination method and device
JP6624619B2 (en) Resource subscription method, resource subscription device, and resource subscription system
JP5847185B2 (en) Content sharing method and apparatus using group change information in content-centric network environment
TW201251398A (en) System and method for dynamic routing for push notifications
CN109873855A (en) A kind of resource acquiring method and system based on block chain network
EP3176994A1 (en) Explicit content deletion commands in a content centric network
EP3228047B1 (en) Methods and network nodes for monitoring services in a content delivery network
CN107580021A (en) A kind of method and apparatus of file transmission
CN101820439A (en) Display method, device and client for files
CN103595808B (en) A kind of file update information method for pushing and device
US8798081B2 (en) Event delivery system, rendezvous node, broker node, load distribution method for event delivery system, load distribution method for rendezvous node, delivery route construction method for broker node, storage medium storing load distribution program, and storage medium storing delivery route construction program
CN101883079A (en) Method and device used for accelerating to request multimedia contents in internet
CN110555040A (en) Data caching method and device and server
WO2017113726A1 (en) Advertisement downloading method, client and server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant