CN113037869B - Method and apparatus for back-sourcing of content distribution network system - Google Patents
Method and apparatus for back-sourcing of content distribution network system Download PDFInfo
- Publication number
- CN113037869B CN113037869B CN202110397708.5A CN202110397708A CN113037869B CN 113037869 B CN113037869 B CN 113037869B CN 202110397708 A CN202110397708 A CN 202110397708A CN 113037869 B CN113037869 B CN 113037869B
- Authority
- CN
- China
- Prior art keywords
- source
- communication
- operator
- communication outlet
- proportion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- H04L67/5682—Policies or rules for updating, deleting or replacing the stored data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The content delivery network CDN system comprises a CDN node, the CDN node is provided with communication outlets corresponding to a plurality of different operators, and the CDN node is used for transmitting a source returning request sent by a client to a source station through the communication outlets, and relates to the technical field of computer networks, in particular to the field of cloud service. The method comprises the following steps: acquiring the source returning proportion of communication outlets of each operator corresponding to the CDN nodes; under the condition that the CDN node detects a first source returning request, determining a target communication outlet used for transmitting the first source returning request in communication outlets of a plurality of different operators based on source returning proportion; and sending a first source returning request to the source station based on the target communication outlet.
Description
Technical Field
The present disclosure relates to the field of computer network technologies, and in particular, to a method and an apparatus for returning a source for a content distribution network system.
Background
A Content Delivery Network (CDN) has a basic idea of avoiding bottlenecks and links on the internet that may affect data transmission speed and stability as much as possible, so that Content transmission is faster and more stable. By placing node servers at various positions of the network to form a layer of intelligent virtual network on the basis of the existing internet, the CDN system can redirect the request of a user to a service node closest to the user in real time according to network flow, connection of each node, load condition, distance to the user, response time and other comprehensive information. The method aims to enable the user to obtain the required content nearby, solve the problem of internet congestion and improve the response speed of the user in accessing the website.
When a user browses a website through terminal equipment, a request is sent to a CDN edge node, the CDN edge node can detect whether the cache of user request data is overdue or not, if the cache of the user request data is not overdue, the user request is directly responded, and at the moment, an HTTP request is finished. If the data has expired, the CDN edge node also needs to issue a back-to-the-source request to the source station (via a premium CDN node) to pull the most recent data.
Disclosure of Invention
The present disclosure provides a method, apparatus, system, device, storage medium, and computer program product for back-sourcing of a content distribution network system.
According to a first aspect of the present disclosure, a method for back-sourcing in a content delivery network system is provided, where the content delivery network CDN system includes a CDN node, the CDN node is provided with communication outlets corresponding to a plurality of different operators, and the CDN node is configured to transmit a back-sourcing request sent by a client to a source station through the communication outlets, where the method includes: obtaining the source returning proportion of communication outlets of each operator corresponding to the CDN nodes; under the condition that the CDN node detects a first source returning request, determining a target communication outlet used for transmitting the first source returning request in communication outlets of a plurality of different operators based on source returning proportion; and sending a first source returning request to the source station based on the target communication outlet.
According to a second aspect of the present disclosure, there is provided an apparatus for back-sourcing in a content delivery network system, where the content delivery network CDN system includes a CDN node, the CDN node is provided with communication outlets corresponding to a plurality of different operators, and the CDN node is configured to transmit a back-sourcing request sent by a client to a source station through the communication outlets, and the apparatus includes: the obtaining unit is configured to obtain the source returning proportion of communication outlets of each operator corresponding to the CDN node; the determining unit is configured to determine, in a case that the CDN node detects the first back-source request, a target communication outlet for transmitting the first back-source request among communication outlets of the multiple different operators based on the back-source proportion; a sending unit configured to send a first feed-back request to the source station based on the target communication outlet.
According to a third aspect of the present disclosure, there is provided a system for back-sourcing of a content distribution network system, comprising: a client configured to send a back-to-source request to a CDN node; a CDN node configured to perform the method of any of the first aspects; a source station configured to receive a first feed-back request sent by the CDN node.
According to a fourth aspect of the present disclosure, there is provided an electronic device for back-source of a content distribution network system, comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of the first aspects.
According to a fifth aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method according to any one of the first aspect.
According to a sixth aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of the first aspects.
The method and the device for the source return of the content distribution network system, provided by the embodiment of the disclosure, can distribute the communication outlets according to the source return proportion of an operator, realize load balance, improve the quality of source return pull flow, and avoid the bandwidth pressure of the operator caused by adopting a single operator communication outlet source return in the related technology.
It should be understood that the statements in this section are not intended to identify key or critical features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
FIG. 1 is an exemplary system architecture diagram in which one embodiment of the present disclosure may be applied;
FIG. 2 is a flow diagram of one embodiment of a method for back sourcing of a content distribution network system according to the present disclosure;
FIG. 3 is a flow diagram of yet another embodiment of a method for back sourcing of a content distribution network system according to the present disclosure;
FIG. 4 is a schematic diagram of one application scenario for a method for back-sourcing of a content distribution network system, in accordance with the present disclosure;
FIG. 5 is a block diagram of one embodiment of an apparatus for back-sourcing of a content distribution network system according to the present disclosure;
fig. 6 is a block diagram of an electronic device used to implement a method for back-sourcing of a content distribution network system of an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 illustrates an exemplary system architecture 100 to which embodiments of the method for back-sourcing of a content distribution network system or the apparatus for back-sourcing of a content distribution network system of the present disclosure may be applied.
As shown in fig. 1, system architecture 100 may include end devices 101 (i.e., clients), n-level CDN nodes 102, and source stations 103. A DNS (Domain Name System) server may be included in the actual application, which is not shown in the figure. The terminal device 101, the n-level CDN node 102, the DNS server and the source station 103 are connected by a network. The network may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
A user may use a terminal device 101 to interact with a source station 103 through an n-level CDN node 102 to receive or send messages or the like. The terminal device 101 may be installed with various communication client applications, such as a live application, a web browser application, a shopping application, a search application, an instant messaging tool, a mailbox client, social platform software, and the like.
The terminal apparatus 101 may be hardware or software. When the terminal device 101 is a hardware, it may be various electronic devices having a display screen and supporting web browsing, including but not limited to a smart phone, a tablet computer, an e-book reader, an MP3 player (Moving Picture Experts Group Audio Layer III, motion Picture Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion Picture Experts compression standard Audio Layer 4), a laptop portable computer, a desktop computer, and the like. When the terminal apparatus 101 is software, it can be installed in the electronic apparatuses listed above. It may be implemented as multiple pieces of software or software modules (e.g., to provide distributed services) or as a single piece of software or software module. And is not particularly limited herein.
A currently common CDN network architecture is a multi-level architecture. CDNs are classified into multiple stages as delivery nodes. What accepts the user request is an edge node (a primary CDN in fig. 1), which goes back up to the source secondary node. The secondary node continues back up to the source. The level two nodes continue back up to the source, repeating this multiple times to level n nodes (higher level CDN) and then back to the source station.
The high-level CDN has network cards of multiple operators and correspondingly has communication outlets of multiple operators. Currently, live broadcasting is mainly realized by a mode of adding a streaming media center (source station) to a CDN node. And the multi-stage CDN converges step by step, and then the high-level CDN of one path of live broadcast rooms pulls the stream to the streaming media center. The current way of pulling back the source is mainly to use a default single network card (i.e. the network outlet of a single operator) to return the source. When the number of live broadcast rooms is large, the number of streams returning to the streaming media center is large, and at the moment, the exit bandwidth of a single CDN network card and the entrance bandwidth of the streaming media center are occupied to be large.
When a user browses a website through the terminal device 101, the browser of the terminal device 101 can locally store a copy of a picture or other files in the website, so that when the user visits the website again, the browser does not need to download all files, and the downloading amount is reduced, which means that the page loading speed is increased. The browser of the terminal device 101 first checks whether the local cache is expired, if so, a request is sent to the CDN edge node, the CDN edge node detects whether the cache of the user request data is expired, if not, the user request is directly responded to, and at this time, one HTTP request is completed. If the data has expired, the CDN edge node also needs to issue a back-to-the-source request to the source station to pull the most recent data.
The DNS server sets a CNAME (canonical name) pointing to the web address of the browser request of the terminal device, the request pointing to the intelligent DNS load balancing system in the CDN network. The intelligent DNS load balancing system resolves the domain name and returns the IP node (CDN node) with the highest response speed to the user to the terminal device 101 of the user. The terminal device 101 sends a request to the IP node, and since it is the first access, the CDN node requests an origin web site (origin site) and caches the content.
The source station 103 may be a server that provides various services, such as a background web server that provides support for web pages displayed on the terminal device 101. The background web server may analyze and perform other processing on the detected data such as the web page request, and feed back a processing result (e.g., web page data) to the terminal device.
It should be noted that the method for back-sourcing of the content delivery network system provided by the embodiment of the present disclosure is generally performed by a CDN node (optionally, when the system includes multiple stages of CDNs, the method may be performed by a higher-level CDN node, or may also be performed by an edge CDN), and accordingly, the back-sourcing apparatus for the content delivery network system is generally disposed in the CDN node. The method may also be performed by a dispatch center, in which the means for back-sourcing of the content distribution network system is located accordingly. Optionally, a log collection server may be further arranged, and is configured to collect logs recorded by each CDN node and then perform node tracking analysis.
It should be understood that the number of end devices, CDN nodes and source stations in fig. 1 is merely illustrative. There may be any number of end devices, CDN nodes and source stations, as desired for implementation.
Referring to fig. 2, a flow 200 of one embodiment of a method for back-sourcing of a content distribution network system in accordance with the present disclosure is shown. The method for returning the source of the content distribution network system comprises the following steps:
In this embodiment, an executing entity (for example, the CDN node or the scheduling center shown in fig. 1) of the method for back sourcing of the content delivery network system may obtain the back sourcing weights of the communication outlets of the operators of the CDN nodes. Preferably, the CDN node is a premium CDN node, in direct communication with the origin station.
In this embodiment, the source return proportion is used to represent a usage proportion of the CDN node corresponding to a communication outlet (network card) of each operator. Optionally, the CDN node sends a request to the source station, and based on the request, the source station returns data carrying the source weight back to the CDN node. Or, the CDN node may determine the source return proportion according to the history data of the source return
Optionally, based on the source return data in the preset time period, the ratio of the source return request number and/or the ratio of the source return flow rate is obtained, and based on the ratio of the source return request number and/or the source return flow rate, the source return specific gravity is determined:
1. the ratio of the source return request numbers:
the statistical data comes from the request records on all edge nodes, wherein, the requests with no cache or expired (cacheable) cache and the requests without cacheability are counted back to the source request, and the other requests directly hitting the cache are hit requests. The calculation formula is as follows: the source return request ratio is the source return request number/(source return request number + request number sent by the user).
2. The return source flow ratio:
the back source flow ratio is the ratio of the flow generated by the size of the back source request file to the flow generated by the request itself, and the calculation formula is as follows: and the ratio of the source returning flow to the source returning flow/(the source returning flow + the flow requested to be accessed by the user).
Optionally, the ratio of the back-source request number or the back-source flow rate counted by the CDN nodes may be used as the back-source proportion, or the weighted sum of them may be used as the back-source proportion.
For example, through the above calculation, the return source proportion corresponding to three operators mobile, internet and telecommunication is 20: 30: 50.
In this embodiment, the target communication outlet may be determined based on the source-back weight, and in the case of more source-back requests, the assignment may be presented in proportion to or approximately in proportion to the source-back weight indication. For example, for different first fallback requests, which may correspond to different determined target communication outlets, the dynamic adjustment is based on the fallback weight.
Optionally, the determining, based on the source return ratio, a target communication outlet for transmitting the first source return request in communication outlets of multiple different operators includes the following steps:
2021. and acquiring the stream name carried in the first source returning request.
In the present embodiment, there is a corresponding stream name corresponding to each piece of streaming media data (e.g., live stream), that is, data to be returned to the source pull stream. The first request of source back carries the information of stream name. By parsing the first back-source request, the stream name may be obtained.
2022. And determining a target communication outlet based on the stream name and the source return proportion.
Alternatively, each operator may be divided into different intervals according to the return source weight. For example, the mobile, internet and telecommunication return source proportion is 30: 40: 30, the mobile, telecom, and Unicom value intervals can be set to [0,29], [30,59], [60,99], respectively. The stream names may be converted to data between 0-99 and then the corresponding operator is determined based on the interval in which the data is located. And taking the determined communication outlet of the operator as a target communication outlet. Correspondingly, the communication entrance corresponding to the operator is used as the target communication entrance.
In some optional implementations of this embodiment, determining the target communication outlet based on the stream name and the source return weight includes:
step 1, obtaining a hash value corresponding to the stream name.
For example, the stream name may be converted to a hash value by a hash algorithm (e.g., CRC 32). The converted hash value and the stream name can be mapped to obtain a mapping table.
After the source returning request is received, the hash value corresponding to the stream name can be directly obtained from the mapping table according to the stream name.
Alternatively, the stream name may be converted into an integer value by an existing string-to-number algorithm. Such as the encryption algorithm MD5, etc. Integer values obtained using the same algorithm for the same class name are fixed. The next time the same stream name is returned to the source, the same value will still be obtained.
And 2, sequencing the source returning proportions of the operators according to a preset sequence to obtain a numerical value interval corresponding to the communication outlet of each operator.
In this embodiment, the source-returning proportions of the operators are ranked, and if the source-returning proportions of mobile, internet and telecommunication are 30: 40: 30, after being sorted in the order from small to big, the number is 30: 30: 40. the numerical value intervals corresponding to the mobile, telecommunication and communication outlets are respectively [0,29], [30,59], [60,99 ].
And 3, performing modular extraction on the sum of the hash value and the source return proportions of a plurality of operators, and determining a target communication outlet according to the communication outlet corresponding to the value interval where the modular value is located.
In this embodiment, the total of the source-back specific gravities of the operators is calculated, and the integral value obtained through calculation is used to be modulo with the total, so as to check which interval falls in. For example, if the modulo 56 is in the interval [30,59], the hit ranked weight 30 corresponds to telecom, and if the modulo 78 is in the interval [60,99], the hit ranked weight 40 corresponds to Union.
In this embodiment, the CDN node has network cards of multiple operators. And determining a target communication outlet according to the selected operator, and binding a network card corresponding to the target communication outlet, for example, selecting a mobile network card for binding, wherein the local IP address is mobile, and data receiving/sending is performed through the mobile network card.
And step 203, sending a first source returning request to the source station based on the target communication outlet.
In this embodiment, a source return request is initiated to the source station through the selected target communication outlet, a network connection is established, and data can be obtained from the source station and then returned to the terminal device.
Optionally, the source station may determine an operator corresponding to the target communication outlet as a target operator, and open a communication inlet corresponding to the target operator to receive the first request for returning to the source. Therefore, the situation that the stream is pulled across operators when the CDN node goes to the source station to pull the stream is eliminated, and the quality of the same network back to the source is ensured.
According to the method for returning the source of the content distribution network system, provided by the embodiment of the disclosure, the peak value of the single operator outlet bandwidth of the CDN and the single operator inlet bandwidth of the source station is greatly reduced according to the ratio of the source return to the source, the requirement on the single operator outlet bandwidth in actual use is reduced, load balance is realized, and the quality of the source return pull stream is improved.
In some optional implementations of this embodiment, the method further includes: determining availability of outlets of each operator; and distributing the source returning proportion of the communication outlet of the unavailable operator to the communication outlet of the available operator to obtain the target source returning proportion of the communication outlet of the available operator. And determining a target communication outlet for transmitting the first source return request in the communication outlets of the available operators based on the target source return proportion.
In this embodiment, optionally, a request may be sent to the source station through the CDN node to obtain availability of the operator communication outlet. Or, the availability of the communication outlet of the operator may also be determined according to the history log of the CDN node, for example, if the last time the information transmission through the telecom network card fails, the outlet of the telecom is considered to be unavailable. Alternatively, it may be determined that the operator's communication outlet is unavailable through the received network failure notification.
For example, if moving: communication: the telecommunication return source specific gravity is 20: 30: and 50, when the mobile outlet is not available, allocating the proportion of the mobile 20 to the communication and the telecommunication. Can be divided equally or proportionally. If sharing, then connecting: the weight of the telecommunication is 40: 60. the outlets are redistributed, so that the use efficiency of available resources can be improved, and the selection of unavailable network cards is avoided, thereby improving the success rate of network connection, reducing time delay and improving user experience.
In some optional implementations of this embodiment, the method further includes: and allocating the source returning proportion of the communication outlet of the unavailable operator according to the weight proportion between the source returning proportion of the communication outlet of the available operator. For example, in the above example, the mobile 20 is scaled by the ratio of communication to telecommunications 30: 50, distributing, wherein the outlet proportion of the distributed operators is communicated: telecommunication 37.5: 72.5. the proportional distribution method can embody fairness and improve load balance.
Referring to fig. 3, a flow 300 of yet another embodiment of a method for back sourcing of a content distribution network system is shown. The process 300 of the method for back-sourcing a content distribution network system comprises the following steps:
The steps 301-302 are substantially the same as the steps 201-202, and therefore will not be described in detail.
In this embodiment, the source station domain name may be sent to a DNS server, and when the DNS resolves the domain name, an IP address belonging to the same operator as the current IP address of the CDN node is preferentially selected. For example, the source domain name currently corresponds to three IP addresses respectively, and belongs to telecommunications, communications, and mobility respectively. If the CDN node is bound with a telecom network card, the DNS resolves the domain name of the source station into a telecom IP address and returns the telecom IP address to the CDN node. But if the current corresponding telecommunication network card of the source station is unavailable, the DNS obtains the information and disables the telecommunication IP. And returns to the CDN node a unicom IP address or a mobile IP address.
And step 304, determining whether the communication outlets corresponding to the numerical value intervals where the IP addresses and the modulus values are located belong to the same operator.
In this embodiment, the operator may be determined according to the IP address field to which the IP address belongs, and then the operator corresponding to the IP address is matched with the operator corresponding to the communication outlet corresponding to the numerical value interval in which the module value is located, so as to determine whether the operators belong to the same operator.
In this embodiment, if the IP address of the source station analyzed by the DNS and the network card bound to the CDN node belong to the same operator, cross-network source return is not involved, and the communication outlet corresponding to the value interval where the modulus is located may be directly determined as the target communication outlet.
And step 306, if the communication outlets corresponding to the numerical value intervals where the IP addresses and the module values are located do not belong to the same operator, re-determining the target communication outlet according to the operator to which the IP addresses belong.
In this embodiment, if the IP address of the source station resolved by the DNS and the target communication outlet of the CDN node do not belong to the same operator, cross-network source return may be caused, and the stream pulling performance may be affected, so that the target communication outlet needs to be re-determined and a network card needs to be bound, and the IP address of the source station resolved by the DNS and the IP address of the source station belong to the same operator. For example, if the network card of the telecommunication is bound, and the current DNS resolution result is the connection, the CDN node releases the binding with the network card of the telecommunication, and binds again into the connection network card.
Alternatively, if the IP address and the destination communication outlet do not belong to the same carrier, indicating that the outlet of the carrier to which the destination communication outlet belongs is not available, the proportion of the outlets of the unavailable carrier may be reallocated to other carriers. The redistribution can be carried out in an equal distribution mode, and can also be carried out according to the proportion of the outlets of the available operators. Step 303 and 305 are re-executed.
Step 307 is substantially the same as step 203 and thus will not be described again.
As can be seen from fig. 3, a flow 300 of the method for back-sourcing of a content distribution network system in this embodiment represents a step of re-binding a network card. Therefore, the scheme described in the embodiment can avoid the situation of cross-network source return, and ensure the quality of source return pull stream. In addition, the peak value of the exit bandwidth of a CDN single operator and the peak value of the entrance bandwidth of a source station single operator are greatly reduced according to the proportion of returning to the source, and the requirement of the exit bandwidth of the single operator in actual use is reduced. The situation that the CDN goes to the source station to pull the stream and pulls the stream across operators is eliminated, and the quality of the same network back to the source is guaranteed. A robust back source egress selection scheme is provided.
With continued reference to fig. 4, fig. 4 is a schematic diagram of an application scenario of the method for back-sourcing of a content distribution network system according to the present embodiment, applied to a live back-sourcing scenario. In the application scenario of fig. 4, the specific process is as follows:
401. and acquiring the source return proportion of the communication outlet of each operator.
402. The availability of the communication outlets of the respective operators is checked.
403. And allocating the source-back weight of the communication outlet of the unavailable operator to the communication outlet of the available operator. The sharing may be done in a weighted ratio between the return source weights of the communication outlets of the available carriers. For example, if moving: communication: the weight of the telecommunication is 20: 30: 50, when a movement exit is not available, scaling the movement 20 to 30: a proportion of 50 is given to the communications and telecommunications. The redistributed operator outlet proportions are as follows: telecommunication 37.5: 72.5.
404. and sequencing the source returning proportions of the operators according to a preset sequence to obtain a numerical value interval corresponding to the communication outlet of each operator. Ranking the specific weight of each operator outlet, if the proportion of mobile communication telecommunication is 30: 40: 30, then 30 after the ranking: 30: 40. direct broadcast back source support uses proportional back source offload by various operators simultaneously. Each path of live broadcast stream has its own stream name, and weight hashing is performed by using the stream name. For example, for cdn with a mobile, telecom, unicom outlet, assume that according to 1: 1: 1 is returned to the source.
405. And calculating a hash value corresponding to the stream name by using a crc32 algorithm, and calculating by taking the live stream name as a key to obtain the hash value.
406. See which operator interval the hash value falls within. And calculating the sum of the export weights of each operator, and checking which interval falls in by using the hash value obtained by calculation and the sum modulo.
407. And determining a target communication outlet according to the selected operator. For example, a modulo 56 hit may be ranked weight 30, and a modulo 78 hit may be ranked weight 40.
408. And acquiring an ip address corresponding to the stream name.
409. It is checked whether the ip address belongs to the same operator as the destination communication outlet.
410. If not, the target communication outlet is re-determined according to the operator to which the ip address belongs
411. And sending a first source returning request to the source station based on the target communication outlet.
According to the method for returning the source of the content distribution network system, provided by the embodiment of the disclosure, the peak value of the single operator outlet bandwidth of the CDN and the single operator inlet bandwidth of the source station is greatly reduced according to the ratio of the source return to the source, the requirement on the single operator outlet bandwidth in actual use is reduced, load balance is realized, and the quality of the source return pull stream is improved.
With further reference to fig. 5, as an implementation of the methods shown in the above-mentioned figures, the present disclosure provides an embodiment of an apparatus for back-sourcing in a content distribution network system, which corresponds to the embodiment of the method shown in fig. 2, and which is particularly applicable to various electronic devices.
As shown in fig. 5, the apparatus 500 for source returning of a content delivery network system according to this embodiment includes a CDN node, where the CDN node is provided with communication outlets corresponding to a plurality of different operators, and the CDN node is configured to transmit a source returning request sent by a client to a source station through the communication outlets, and the apparatus 500 includes: acquisition section 501, determination section 502, and transmission section 503. The obtaining unit 501 is configured to obtain the source return weight of the communication outlets of each operator corresponding to the CDN node; a determining unit 502, configured to determine, in a case that the CDN node detects a first back source request, a target communication egress for transmitting the first back source request among communication exits of the multiple different operators based on the back source proportion; a sending unit 503, configured to send the first fallback request to the source station based on the target communication egress.
In this embodiment, the specific processing of the obtaining unit 501, the determining unit 502, and the sending unit 503 of the device 500 for returning to the source of the content distribution network system may refer to step 201, step 202, and step 203 in the corresponding embodiment of fig. 2.
In some optional implementations of the present embodiment, the determining unit 502 is further configured to: acquiring a stream name carried in the first source returning request; and determining a target communication outlet based on the stream name and the source return proportion.
In some optional implementations of the present embodiment, the determining unit 502 is further configured to: obtaining a hash value corresponding to the stream name; sorting the source returning proportion of each operator according to a preset sequence to obtain a numerical value interval corresponding to a communication outlet of each operator; taking a module of the sum of the hash value and the source return specific gravity corresponding to each operator, and determining a target communication outlet according to a communication outlet corresponding to a numerical interval in which the module value is positioned;
in some optional implementations of the present embodiment, the determining unit 502 is further configured to: the IP address of the source station is obtained. And if the communication outlet corresponding to the numerical value interval of the IP address and the modulus belongs to the same operator, determining the communication outlet corresponding to the numerical value interval of the modulus as a target communication outlet.
In some optional implementations of this embodiment, the determining unit 502 is further configured to: and if the communication outlets corresponding to the numerical value intervals where the IP address and the modulus of the source station are located do not belong to the same operator, determining the target communication outlet according to the operator to which the IP address belongs.
In some optional implementations of this embodiment, the obtaining unit 501 is further configured to: the availability of communication outlets of the respective operators is determined. Distributing the source returning proportion of the unavailable communication outlet of the operator to the available communication outlet of the operator to obtain the target source returning proportion of the available communication outlet of the operator; the determining unit 502 is further configured to: and determining a target communication outlet for transmitting the first source returning request in the communication outlets of the available operators based on the target source returning proportion.
In some optional implementations of this embodiment, the obtaining unit 501 is further configured to: and allocating the source returning weight of the communication outlet of the unavailable operator according to the weight proportion between the source returning weight of the communication outlet of the available operator.
The present disclosure also provides a system, an electronic device, a readable storage medium, and a computer program product for back sourcing of a CDN system according to embodiments of the present disclosure.
A system for back-sourcing a content distribution network system, comprising: a client configured to send a back-to-source request to a CDN node; a CDN node configured to perform the method of flows 200 or 300; a source station configured to receive a first feed-back request sent by the CDN node.
An electronic device for back-sourcing of a content distribution network system, comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of flows 200 or 300.
A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of flows 200 or 300.
A computer program product comprising a computer program which, when executed by a processor, implements the method according to flow 200 or 300.
FIG. 6 illustrates a schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 6, the device 600 comprises a computing unit 601, which may perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM)602 or loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM603, various programs and data required for the operation of the device 600 can also be stored. The calculation unit 601, the ROM 602, and the RAM603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
A number of components in the device 600 are connected to the I/O interface 605, including: an input unit 606 such as a keyboard, a mouse, or the like; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The computing unit 601 performs the various methods and processes described above, such as the method for back-sourcing of a content distribution network system. For example, in some embodiments, the method for back sourcing of a content distribution network system may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM 602 and/or the communication unit 609. When the computer program is loaded into RAM603 and executed by the computing unit 601, one or more steps of the method for back-sourcing of a content distribution network system described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured by any other suitable means (e.g., by means of firmware) to perform the method for back sourcing of the content distribution network system.
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, causes the functions/acts specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user may provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a server of a distributed system or a server incorporating a blockchain. The server can also be a cloud server, or an intelligent cloud computing server or an intelligent cloud host with artificial intelligence technology. The server may be a server of a distributed system or a server incorporating a blockchain. The server can also be a cloud server, or an intelligent cloud computing server or an intelligent cloud host with artificial intelligence technology.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and the present disclosure is not limited herein.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.
Claims (15)
1. A method for returning a source of a Content Delivery Network (CDN) system comprises a CDN node, wherein the CDN node is provided with communication outlets corresponding to a plurality of different operators, and is used for transmitting a source returning request sent by a client to a source station through the communication outlets, and the method comprises the following steps:
acquiring the source returning proportion of communication outlets of each operator corresponding to the CDN nodes;
under the condition that the CDN node detects a first source returning request, determining a target communication outlet used for transmitting the first source returning request in communication outlets of the multiple different operators based on the source returning proportion;
sending the first source returning request to a source station based on the target communication outlet;
wherein the determining a target communication outlet for transmitting the first fallback request among the communication outlets of the plurality of different operators based on the fallback proportion comprises:
acquiring a stream name carried in the first source returning request;
and determining the target communication outlet based on the flow name and the back source proportion.
2. The method of claim 1, wherein said determining the target communication outlet based on the flow name and the back-source weight comprises:
obtaining a hash value corresponding to the stream name;
sorting the source returning proportion of each operator according to a preset sequence to obtain a numerical value interval corresponding to a communication outlet of each operator;
and performing modular extraction on the sum of the hash value and the source return specific gravity corresponding to the multiple operators, and determining the target communication outlet according to the communication outlet corresponding to the numerical value interval in which the modular value is positioned.
3. The method of claim 2, wherein the determining the target communication outlet according to the communication outlet corresponding to the value range in which the modulus value is located comprises:
acquiring the IP address of the source station;
and if the communication outlet corresponding to the numerical value interval of the IP address and the modulus belongs to the same operator, determining the communication outlet corresponding to the numerical value interval of the modulus as the target communication outlet.
4. The method of claim 3, wherein the determining the target communication outlet according to the communication outlet corresponding to the value range in which the modulus value is located comprises:
and if the communication outlets corresponding to the value intervals of the IP address of the source station and the modulus do not belong to the same operator, determining the target communication outlet according to the operator to which the IP address belongs.
5. The method of any of claims 1-4, wherein the obtaining the back-source weight of the communication outlets of the respective operators corresponding to the CDN nodes comprises:
determining the availability of communication outlets of each operator; allocating the source returning proportion of the communication outlet of the unavailable operator to the communication outlet of the available operator to obtain the target source returning proportion of the communication outlet of the available operator;
the determining, based on the feedback proportion, a target communication outlet of the communication outlets of the multiple different operators for transmitting the first feedback request includes:
and determining a target communication outlet for transmitting the first source return request in the communication outlets of the available operators based on the target source return proportion.
6. The method of claim 5, wherein said assigning back-sources of unavailable carrier communication outlets to available carrier communication outlets comprises:
and allocating the source returning weight of the communication outlet of the unavailable operator according to the weight proportion between the source returning weight of the communication outlet of the available operator.
7. A device for returning source of a Content Delivery Network (CDN) system, wherein the Content Delivery Network (CDN) system comprises a CDN node, the CDN node is provided with communication outlets corresponding to a plurality of different operators, the CDN node is used for transmitting a returning source request sent by a client to a source station through the communication outlets, and the device comprises:
the obtaining unit is configured to obtain the source returning proportion of communication outlets of each operator corresponding to the CDN node;
a determining unit, configured to determine, in a case that the CDN node detects a first back-source request, a target communication egress for transmitting the first back-source request among communication exits of the multiple different operators based on the back-source proportion;
a sending unit configured to send the first feed-back request to a source station based on the target communication outlet;
wherein the determination unit is further configured to:
acquiring a stream name carried in the first source returning request;
and determining the target communication outlet based on the flow name and the back source proportion.
8. The apparatus of claim 7, wherein the determination unit is further configured to:
obtaining a hash value corresponding to the stream name;
sorting the source returning proportion of each operator according to a preset sequence to obtain a numerical value interval corresponding to a communication outlet of each operator;
and performing modulus operation on the sum of the hash value and the source return proportions corresponding to the multiple operators, and determining the target communication outlet according to the communication outlet corresponding to the numerical value interval in which the modulus value is positioned.
9. The apparatus of claim 8, wherein the determination unit is further configured to:
acquiring the IP address of the source station;
and if the communication outlet corresponding to the numerical value interval of the IP address and the modulus belongs to the same operator, determining the communication outlet corresponding to the numerical value interval of the modulus as the target communication outlet.
10. The apparatus of claim 9, wherein the determining unit is further configured to:
and if the communication outlet corresponding to the numerical value interval where the IP address of the source station and the modulus are located does not belong to the same operator, determining the target communication outlet according to the operator to which the IP address belongs.
11. The apparatus according to any one of claims 7-10, wherein the obtaining unit is further configured to:
determining the availability of communication outlets of each operator;
distributing the source returning proportion of the unavailable communication outlet of the operator to the available communication outlet of the operator to obtain the target source returning proportion of the available communication outlet of the operator;
the determination unit is further configured to:
and determining a target communication outlet for transmitting the first source return request in the communication outlets of the available operators based on the target source return proportion.
12. The apparatus of claim 11, wherein the obtaining unit is further configured to:
and allocating the source returning proportion of the communication outlet of the unavailable operator according to the weight proportion between the source returning proportion of the communication outlet of the available operator.
13. A system for back-sourcing a content distribution network system, comprising:
a client configured to send a back-to-source request to the CDN node;
a CDN node configured to perform the method of any of claims 1-6;
a source station configured to receive a first feed-back request sent by the CDN node.
14. An electronic device for back-sourcing of a content distribution network system, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.
15. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110397708.5A CN113037869B (en) | 2021-04-14 | 2021-04-14 | Method and apparatus for back-sourcing of content distribution network system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110397708.5A CN113037869B (en) | 2021-04-14 | 2021-04-14 | Method and apparatus for back-sourcing of content distribution network system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113037869A CN113037869A (en) | 2021-06-25 |
| CN113037869B true CN113037869B (en) | 2022-09-30 |
Family
ID=76456593
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110397708.5A Active CN113037869B (en) | 2021-04-14 | 2021-04-14 | Method and apparatus for back-sourcing of content distribution network system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113037869B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113596105B (en) * | 2021-07-06 | 2023-12-26 | 深圳市华曦达科技股份有限公司 | Content acquisition method, edge node and computer readable storage medium |
| CN113766650B (en) * | 2021-08-26 | 2022-06-28 | 武汉天地同宽科技有限公司 | Internet resource obtaining method and system based on dynamic balance |
| CN113778972B (en) * | 2021-09-15 | 2022-05-17 | 北京百度网讯科技有限公司 | Method for estimating log increment in Content Delivery Network (CDN) system |
| CN113992760B (en) * | 2021-10-22 | 2024-03-01 | 北京百度网讯科技有限公司 | Method, device, equipment and storage medium for scheduling back source traffic |
| CN114245182B (en) * | 2021-12-16 | 2023-11-21 | 上海哔哩哔哩科技有限公司 | Live video stream acquisition method and device |
| CN114189523A (en) * | 2021-12-17 | 2022-03-15 | 中国电信股份有限公司 | Method, device and storage medium for back source of edge node of CDN (content delivery network) |
| CN114629795B (en) * | 2022-01-30 | 2024-01-02 | 阿里巴巴（中国）有限公司 | Bandwidth usage method and content distribution network |
| CN114598654B (en) * | 2022-01-30 | 2024-07-05 | 阿里巴巴（中国）有限公司 | Flow equalization processing method and device based on content delivery network CDN |
| CN115002497B (en) * | 2022-05-27 | 2024-03-12 | 上海哔哩哔哩科技有限公司 | Live broadcast source-returning scheduling method and system and source-returning server |
| CN115412737B (en) * | 2022-08-30 | 2024-03-08 | 上海哔哩哔哩科技有限公司 | Live broadcast return source relay node determining method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104320681A (en) * | 2014-11-07 | 2015-01-28 | 百视通网络电视技术发展有限责任公司 | CDN back-to-source service method and system |
| WO2017012475A1 (en) * | 2015-07-17 | 2017-01-26 | 阿里巴巴集团控股有限公司 | Data acquisition method and device |
| CN107395683A (en) * | 2017-06-26 | 2017-11-24 | 网宿科技股份有限公司 | The system of selection of a kind of time source path and server |
| CN109040102A (en) * | 2018-08-27 | 2018-12-18 | 北京搜狐新动力信息技术有限公司 | A kind of live transmission method and system of internet live streaming CDN |
| CN109547547A (en) * | 2018-11-23 | 2019-03-29 | 北京知道创宇信息技术有限公司 | Return source dispatching method, device and its storage medium |
| CN110572687A (en) * | 2019-08-09 | 2019-12-13 | 北京达佳互联信息技术有限公司 | Live broadcast source-returning aggregation method, device, system, equipment and storage medium |
| CN112422702A (en) * | 2020-08-10 | 2021-02-26 | 上海哔哩哔哩科技有限公司 | CDN back-to-source method, system and computer equipment |
-
2021
- 2021-04-14 CN CN202110397708.5A patent/CN113037869B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104320681A (en) * | 2014-11-07 | 2015-01-28 | 百视通网络电视技术发展有限责任公司 | CDN back-to-source service method and system |
| WO2017012475A1 (en) * | 2015-07-17 | 2017-01-26 | 阿里巴巴集团控股有限公司 | Data acquisition method and device |
| CN107395683A (en) * | 2017-06-26 | 2017-11-24 | 网宿科技股份有限公司 | The system of selection of a kind of time source path and server |
| CN109040102A (en) * | 2018-08-27 | 2018-12-18 | 北京搜狐新动力信息技术有限公司 | A kind of live transmission method and system of internet live streaming CDN |
| CN109547547A (en) * | 2018-11-23 | 2019-03-29 | 北京知道创宇信息技术有限公司 | Return source dispatching method, device and its storage medium |
| CN110572687A (en) * | 2019-08-09 | 2019-12-13 | 北京达佳互联信息技术有限公司 | Live broadcast source-returning aggregation method, device, system, equipment and storage medium |
| CN112422702A (en) * | 2020-08-10 | 2021-02-26 | 上海哔哩哔哩科技有限公司 | CDN back-to-source method, system and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113037869A (en) | 2021-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113037869B (en) | Method and apparatus for back-sourcing of content distribution network system | |
| CN106657379A (en) | Implementation method and system for NGINX server load balancing | |
| CN103179217B (en) | A kind of load-balancing method for WEB application server farm and device | |
| CN111464323A (en) | Node bandwidth scheduling method and scheduling device | |
| CN103338252B (en) | Realizing method of distributed database concurrence storage virtual request mechanism | |
| US20170126583A1 (en) | Method and electronic device for bandwidth allocation based on online media services | |
| US20230069240A1 (en) | Dynamic cloning of application infrastructures | |
| CN102932271A (en) | Method and device for realizing load balancing | |
| CN110198267B (en) | Traffic scheduling method, system and server | |
| US20160028641A1 (en) | Advanced notification of workload | |
| CN112653632A (en) | Flow control realization method and device | |
| CN113867946A (en) | Method, device, storage medium and electronic equipment for accessing resources | |
| CN112561301A (en) | Work order distribution method, device, equipment and computer readable medium | |
| CN113765969A (en) | Flow control method and device | |
| CN110247847B (en) | Method and device for back source routing between nodes | |
| US20230063599A1 (en) | Edge computing network, data transmission method and apparatus, device and storage medium | |
| CN115567602A (en) | CDN node back-to-source method, device and computer readable storage medium | |
| CN115190180A (en) | Method and device for scheduling network resource request during sudden increase of network resource request | |
| EP2622499B1 (en) | Techniques to support large numbers of subscribers to a real-time event | |
| CN109768897B (en) | Server deployment method and device | |
| CN111770121A (en) | Method and device for service access based on directional flow | |
| CN113626175A (en) | Data processing method and device | |
| US11086822B1 (en) | Application-based compression | |
| CN114793234B (en) | Message processing method, device, equipment and storage medium | |
| CN113992760B (en) | Method, device, equipment and storage medium for scheduling back source traffic |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20210625 Assignee: Beijing Intellectual Property Management Co.,Ltd. Assignor: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. Contract record no.: X2023110000093 Denomination of invention: Method and apparatus for backtracking in content distribution network systems Granted publication date: 20220930 License type: Common License Record date: 20230818 |
|
| EE01 | Entry into force of recordation of patent licensing contract |