CN111464585B - Multi-cloud-based high-availability CDN service system - Google Patents
Multi-cloud-based high-availability CDN service system Download PDFInfo
- Publication number
- CN111464585B CN111464585B CN201911277459.5A CN201911277459A CN111464585B CN 111464585 B CN111464585 B CN 111464585B CN 201911277459 A CN201911277459 A CN 201911277459A CN 111464585 B CN111464585 B CN 111464585B
- Authority
- CN
- China
- Prior art keywords
- cdn
- manufacturer
- configuration
- cloud
- domain name
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 claims abstract description 12
- 238000001514 detection method Methods 0.000 claims abstract description 10
- 230000001133 acceleration Effects 0.000 claims abstract description 7
- 230000000694 effects Effects 0.000 claims description 5
- 230000001360 synchronised effect Effects 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 4
- 238000011084 recovery Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1034—Reaction to server failures by a load balancer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/02—Standardisation; Integration
- H04L41/0246—Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols
- H04L41/0253—Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols using browsers or web-pages for accessing management information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0663—Performing the actions predefined by failover planning, e.g. switching to standby network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/45—Network directories; Name-to-address mapping
- H04L61/4505—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
- H04L61/4511—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/101—Server selection for load balancing based on network conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1029—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers using data related to the state of servers by a load balancer
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a multi-cloud-based high-availability CDN service mechanism which comprises a multi-cloud CDN configuration module, a CDN fault detection module and a line switching module, wherein the CDN configuration module constructs a CDN configuration service based on a multi-cloud CDN, the configuration of at least one standby manufacturer can be redundantly set by default while providing CDN access of a main manufacturer, the CDN fault detection module deploys CDN monitoring nodes in various regions in the whole country, collects real-time response time length information of various domain name acceleration nodes, and synchronizes the collected information to a configuration center through a message queue.
Description
Technical Field
The invention relates to the technical field of networks, in particular to a high-availability CDN service system based on multiple clouds.
Background
With the rapid development of the cloud computing era and particularly the arrival of the streaming media big video era, the following problems will be faced when users rely on only a single CDN service provided by a service provider:
1) the service effective time of the single service provider is uncertain, the fault tolerance rate is low, and high availability cannot be really realized.
2) Different service providers have larger difference of CDN node density in different areas, and the optimal cost performance can not be realized by depending on a single service provider.
3) CDN vendors continue to break the above limitations with technical and resource means, but because of competition, the resources of a single service provider are relatively closed.
In summary, depending on the single CDN service provider, the needs in the aspects of capacity, disaster recovery, effect, cost, and the like cannot be well met, and through the multi-cloud high-availability CDN service, the problems of existing disaster recovery, capacity, and the like are solved through intelligent scheduling of CDN lines, and the cost reduction and the effect of increasing efficiency are achieved to a certain extent.
Disclosure of Invention
The present invention is directed to provide a highly available CDN service system based on multiple clouds to solve the problems mentioned in the background art.
In order to achieve the purpose, the invention provides the following technical scheme:
a highly available CDN service system based on multiple clouds comprises a multi-cloud CDN configuration module, a CDN fault detection module and a line switching module, wherein the CDN configuration module constructs CDN configuration service based on the multiple clouds CDN, the configuration of at least one standby manufacturer can be redundantly set by default while the CDN access of a main manufacturer is provided, the CDN fault detection module deploys CDN monitoring nodes in all regions of the whole country, real-time response time length information of all domain name acceleration nodes is collected, the collected information is synchronized to a configuration center through a message queue, through real-time calculation, whether the main manufacturer CDN service fails or not is judged through calculating whether a main manufacturer line has a state of packet loss or high delay and the like, meanwhile, the standby manufacturer node information is analyzed, the most appropriate standby manufacturer ranking is obtained through scoring, when the configuration center determines that the main manufacturer fails, the line switching module adjusts the alias recording relation on the DNSPOD, and switching the CDN service to the line of the most appropriate spare CDN manufacturer.
As a further scheme of the invention: and the multi-cloud CDN configuration module selects a plurality of CDN manufacturers with the node quality, the technical index and the service support reaching the standard as a main line and a standby line of CDN service.
As a further scheme of the invention: the multi-cloud CDN configuration module provides a CDN service management open interface for uniformly creating an acceleration domain name, configuring the acceleration domain name and configuring a cache rule.
As a further scheme of the invention: the user can configure through the provided visual Web interface.
As a further scheme of the invention: when a certain accelerated domain name is configured, the CDN configuration is synchronized to at least two CDN providers at the same time, and the DNSPOD newly-added alias record points to one CDN manufacturer, namely a main manufacturer, so that the accelerated domain name redundancy configuration is completed.
As a further scheme of the invention: the CDN fault detection module comprehensively analyzes the collected results through a big data real-time analysis technology, scores and evaluates each manufacturer according to line delay, a jam rate, a downloading speed and an opening speed, scores and ranks each manufacturer, and finds the faults of the main manufacturer and obtains a real-time optimal spare manufacturer in time.
As a further scheme of the invention: at the user end, through DNS resolution, the CDN acceleration line is also quickly switched to a standby CDN provider, and when a new alias record on the DNSPOD takes effect, the user end can quickly recover from the fault.
Compared with the prior art, the invention has the beneficial effects that: the invention can realize real-time monitoring of CDN service faults and quick recovery of faults at a minute level, thereby realizing high availability of CDN service, avoiding huge pressure brought to a source station by a large amount of source returning flow due to CDN faults, and ensuring stable customer service.
Drawings
Fig. 1 is a general topology structural diagram.
Fig. 2 is a schematic diagram of main/standby configuration redundancy.
FIG. 3 is a schematic diagram of monitoring node conditions.
Fig. 4 is a schematic diagram of fast automatic switching.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-4, example 1: in the embodiment of the invention, a high-availability CDN service system based on multiple clouds comprises a multi-cloud CDN configuration module, a CDN fault detection module and a line switching module, and the following sub-modules are described as follows:
(1) multi-cloud CDN configuration
And constructing a CDN configuration service based on the multi-cloud CDN, and defaulting the configuration of at least one standby manufacturer while providing CDN access of a main manufacturer.
Through the redundancy configuration, when the manufacturer switches, the accelerated domain name and the synchronous configuration do not need to be established in a standby manufacturer, the switching time can be shortened, and the fault emergency response speed is improved.
(2) CDN fault detection
The working principle of CDN fault detection is as follows:
the method comprises the steps of creating a monitoring domain name for each manufacturer, configuring the monitoring domain name as the same source station, and refreshing the content of the source station at regular time through a program.
And secondly, deploying CDN monitoring nodes in various regions in the country, and collecting real-time response time length information of various domain name acceleration nodes.
And synchronizing the collected information to a configuration center through a message queue, judging whether CDN service of a main manufacturer fails or not through calculating whether the line of the main manufacturer has the states of packet loss or high delay and the like through real-time calculation, analyzing node information of spare manufacturers, and obtaining the most appropriate spare manufacturer through score ranking.
By monitoring and analyzing the nodes of each manufacturer, whether the main manufacturer breaks down or not can be automatically monitored, and meanwhile, reasonable basis is provided for automatically switching to a proper standby manufacturer.
(3) Line switching
When the fault of the main manufacturer is determined, the CDN service is switched to the line of the most appropriate backup CDN manufacturer by adjusting the alias record relation on the DNSPOD.
By adjusting the domain name resolution alias record, the alias record can take effect in only a few minutes, so that the time for switching the CDN service from a main manufacturer to a standby manufacturer is shortened, and the rapid switching is realized.
Example 2: on the basis of the embodiment 1, the user can also carry out configuration through the provided visual Web interface.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.
Claims (1)
1. A high-availability CDN service system based on multiple clouds comprises a multi-cloud CDN configuration module, a CDN fault detection module and a line switching module, and the following sub-modules are set forth:
(1) configuring a multi-cloud CDN; constructing a CDN configuration service based on the multi-cloud CDN, and defaulting the configuration of at least one spare manufacturer while providing CDN access of a main manufacturer; through the redundancy configuration, when the manufacturer switches, an accelerated domain name and synchronous configuration do not need to be established in a standby manufacturer, the switching time can be shortened, and the fault emergency response speed is improved; (2) detecting CDN faults; the working principle of CDN fault detection is as follows: firstly, establishing a monitoring domain name for each manufacturer, configuring the monitoring domain name as a same source station, and regularly refreshing the content of the source station through a program; deploying CDN monitoring nodes in various regions in the country, and collecting real-time response duration information of various domain name acceleration nodes; synchronizing the collected information to a configuration center through a message queue, judging whether CDN service of a main manufacturer fails or not by calculating whether a line of the main manufacturer has packet loss or a state with higher delay or not through real-time calculation, analyzing node information of spare manufacturers, and obtaining the most appropriate spare manufacturer through scoring and ranking; by monitoring and analyzing the nodes of each manufacturer, whether the main manufacturer fails or not can be automatically monitored, and meanwhile, a reasonable basis is provided for automatically switching to a proper standby manufacturer; (3) switching lines; when the CDN service of the main manufacturer is determined to be in fault, the CDN service is switched to the line of the most appropriate spare CDN manufacturer by adjusting the alias recording relation on the DNSPOD; by adjusting the domain name resolution alias record, the alias record can take effect in only a few minutes, so that the time for switching the CDN service from a main manufacturer to a standby manufacturer is shortened, and the rapid switching is realized.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911277459.5A CN111464585B (en) | 2019-12-05 | 2019-12-05 | Multi-cloud-based high-availability CDN service system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911277459.5A CN111464585B (en) | 2019-12-05 | 2019-12-05 | Multi-cloud-based high-availability CDN service system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111464585A CN111464585A (en) | 2020-07-28 |
| CN111464585B true CN111464585B (en) | 2021-09-07 |
Family
ID=71679932
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911277459.5A Active CN111464585B (en) | 2019-12-05 | 2019-12-05 | Multi-cloud-based high-availability CDN service system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111464585B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114095475B (en) * | 2020-12-28 | 2024-06-14 | 京东科技控股股份有限公司 | Data processing method, device, electronic equipment, system and storage medium |
| CN112583648B (en) * | 2021-02-24 | 2021-06-25 | 北京城建设计发展集团股份有限公司 | Intelligent service fault processing method based on DNS |
| CN113660510A (en) * | 2021-08-19 | 2021-11-16 | 杭州时趣信息技术有限公司 | Video processing cloud manufacturer configuration method, device and system |
| CN114363155A (en) * | 2022-01-05 | 2022-04-15 | 北京爱学习博乐教育科技有限公司 | Backup recovery method and system for CDN resources |
| CN117294582A (en) * | 2023-11-22 | 2023-12-26 | 畅捷通信息技术股份有限公司 | High availability method, system and storage medium of multi-cloud content distribution network |
| CN117938405B (en) * | 2024-03-21 | 2024-05-31 | 北京火山引擎科技有限公司 | CDN service arrangement method, device, equipment and storage medium in multi-cloud environment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101764747A (en) * | 2009-12-24 | 2010-06-30 | 北京世纪互联宽带数据中心有限公司 | Intelligent dispatching method, device and system of content delivery network flow |
| CN109547271A (en) * | 2019-01-06 | 2019-03-29 | 广州泳泳信息科技有限公司 | A kind of network state real time monitoring warning system based on big data |
| CN109918106A (en) * | 2019-02-21 | 2019-06-21 | 广东星辉天拓互动娱乐有限公司 | A kind of mixing CDN unifies the automatic method for refreshing in source station and system |
| CN110134553A (en) * | 2019-05-13 | 2019-08-16 | 重庆八戒电子商务有限公司 | A kind of system and method automatically switched based on dual-active data center flow |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130290124A1 (en) * | 2012-04-26 | 2013-10-31 | Disney Enterprises, Inc. | Data delivery optimization via an auction system |
| CN103117876B (en) * | 2013-01-24 | 2018-10-26 | 中兴通讯股份有限公司 | The synchronous method and device of user state information |
| FR3004609A1 (en) * | 2013-04-10 | 2014-10-17 | France Telecom | CENTRALIZED ARCHITECTURE FOR THE ESTABLISHMENT OF FEDERATIONS OF CONTENT DISTRIBUTORS |
| CN106803967A (en) * | 2017-02-13 | 2017-06-06 | 北京奇虎科技有限公司 | A kind for the treatment of method and apparatus of live data |
| CN107172220A (en) * | 2017-07-26 | 2017-09-15 | 上海鋆创信息技术有限公司 | The switching dispatching method and equipment of many CDN services |
| CN107911722B (en) * | 2017-10-31 | 2020-06-16 | 贝壳找房(北京)科技有限公司 | Content distribution network scheduling method and device, electronic equipment and computer readable storage medium |
| CN109905734A (en) * | 2017-12-08 | 2019-06-18 | 北京京东尚科信息技术有限公司 | Method and device, live broadcast system, storage medium and the electronic equipment shunted is broadcast live |
| CN109769040A (en) * | 2018-12-14 | 2019-05-17 | 平安普惠企业管理有限公司 | Content delivery network service switching method, device, equipment and storage medium |
| CN110392094B (en) * | 2019-06-03 | 2021-03-19 | 网宿科技股份有限公司 | Method for acquiring service data and converged CDN system |
-
2019
- 2019-12-05 CN CN201911277459.5A patent/CN111464585B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101764747A (en) * | 2009-12-24 | 2010-06-30 | 北京世纪互联宽带数据中心有限公司 | Intelligent dispatching method, device and system of content delivery network flow |
| CN109547271A (en) * | 2019-01-06 | 2019-03-29 | 广州泳泳信息科技有限公司 | A kind of network state real time monitoring warning system based on big data |
| CN109918106A (en) * | 2019-02-21 | 2019-06-21 | 广东星辉天拓互动娱乐有限公司 | A kind of mixing CDN unifies the automatic method for refreshing in source station and system |
| CN110134553A (en) * | 2019-05-13 | 2019-08-16 | 重庆八戒电子商务有限公司 | A kind of system and method automatically switched based on dual-active data center flow |
Non-Patent Citations (1)
| Title |
|---|
| 常州监控公司推出CDN监测解决方案;星牛监控;《http://www.czxnjk.com/Article/czjkgstccd.html》;20170915;正文第1-2页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111464585A (en) | 2020-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111464585B (en) | Multi-cloud-based high-availability CDN service system | |
| CN112398717B (en) | System and method for determining data flow paths in an overlay network | |
| US20200287806A1 (en) | Predicting application and network performance | |
| CN111147287B (en) | Network simulation method and system in SDN scene | |
| CN111543038B (en) | Network stream splicing using middleware stream splicing | |
| US9450700B1 (en) | Efficient network fleet monitoring | |
| JP5643433B2 (en) | Method and apparatus for protocol event management | |
| CN112395041A (en) | Underlay-overlay correlation | |
| CN108287905B (en) | Method for extracting and storing network flow characteristics | |
| CN110377459A (en) | A kind of disaster tolerance system, disaster tolerance processing method, monitoring node and backup cluster | |
| CN102984501A (en) | Network video-recording cluster system | |
| CN105187512A (en) | Method and system for load balancing of virtual machine clusters | |
| CN109992427B (en) | DPI association rule backfill processing method, device, equipment and medium | |
| CN102394914A (en) | Cluster brain-split processing method and device | |
| CN113641511A (en) | Message communication method and device | |
| CN103873379A (en) | Distributed route destroy-resistant strategy collocation method and system based on overlay network | |
| CN110581782A (en) | Disaster tolerance data processing method, device and system | |
| CN104468537A (en) | System and method for achieving safety audit | |
| CN113364651B (en) | Distributed network flow collection method | |
| CN111813848A (en) | Data real-time acquisition and analysis method based on kafka log middleware | |
| CN109639488B (en) | Multi-extranet shunt acceleration method and system | |
| CN112737980B (en) | Time-based network slice resource dynamic partitioning method and device | |
| Tiwari et al. | Reconfigurable streaming for the mobile edge | |
| Basu et al. | Architecture of a cloud-based fault-tolerant control platform for improving the qos of social multimedia applications on sd-wan | |
| CN115102986A (en) | Internet of things data distribution and storage method and system in edge environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 361000 3F-A317, Zone C, Innovation Building, Software Park, Torch High tech Zone, Xiamen City, Fujian Province Patentee after: Fujian Reliable Cloud Computing Technology Co.,Ltd. Country or region after: China Address before: 361008 3f-a317, Zone C, innovation building, software park, torch high tech Zone, Xiamen, Fujian Patentee before: Xiamen Biebeyun Co.,Ltd. Country or region before: China |