CN106385455A - CDN (Content Delivery Network) mirror-based whole site lock setting method - Google Patents
CDN (Content Delivery Network) mirror-based whole site lock setting method Download PDFInfo
- Publication number
- CN106385455A CN106385455A CN201610844733.2A CN201610844733A CN106385455A CN 106385455 A CN106385455 A CN 106385455A CN 201610844733 A CN201610844733 A CN 201610844733A CN 106385455 A CN106385455 A CN 106385455A
- Authority
- CN
- China
- Prior art keywords
- cdn
- site
- mirror image
- mirror
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F16/972—Access to data in other repository systems, e.g. legacy data or dynamic Web page generation
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a CDN (Content Delivery Network) mirror-based whole site lock setting method. The method includes the following steps that: step 1, a site is connected into a CDN; step 2, one CDN node is used as a master node, the data of the source site are initiatively crawled by a crawler and are stored locally, and the data of the source site are adopted as mirror resources of the web site and are delivered to other CDN nodes; step 3, all the CDN nodes set the resources obtained by the crawler to be read-only and reconfigure the user request content access policy of the site, and the site requests to be surrogated to a local mirror; and step 4, when a user requests the site, the CDN directly access and returns the mirror resources obtained by the crawler and does not request the source site. With the method of the invention adopted, the risk of being attacked of the source site can be effectively decreased; and when the source site is abnormal due to maintenance or attack, the CDN nodes can replace the source site, and therefore, the usability of the site to the user can be improved.
Description
Technical field
The present invention relates to CDN technical field is and in particular to a kind of lock method to set up based on the whole station of CDN mirror image.
Background technology
CDN (content distributing network) refers to a kind of computer network system interconnecting by the Internet, using near
The server of every user, faster, more reliably by music, picture, video, application program and alternative document is sent to user,
Web content to provide high-performance, extensibility and low cost passes to user.
The content service that CDN provides is based on caching server, also referred to as proxy caching (Surrogate), and it is located at net
The edge of network, only has the distant of " jumps (Single Hop) " away from user.When user accesses website, can be according to dns resolution
The request of user can be navigated on the caching server of CDN nearby by strategy, and CDN, according to content management strategy, first looks for
Whether the caching of association requests is had on local cache server, then directly the resource of caching is returned to access if there are this caching
User, otherwise CDN can arrive source station and ask corresponding resource to return user, and according to cache policy by result in local cache, with
Directly use for subsequent request.So, in the case that caching is effective, proxy caching is the equal of content supplier's source server
A part resource transparent mirror picture.
Abnormal in order to prevent server hardware or software etc. from occurring, and lead to externally service unavailable, background server meeting
There is provided disaster tolerance mirror image in case using when abnormal maintenance, this scheme is to provide identical server independent of each other
Equipment, when one occurs extremely, switching imports to abnormal flow on the node of other backups.Have one in this way
Fixed limitation：1) website needs the resource backup of redundancy；2) situations such as website runs into attack or access network is abnormal, that is,
Service is unavailable so that backup is also resulted in, and system robustness is low；3) when running into whole station point and need to safeguard, externally service
Unavailable.
Content of the invention
The technical problem to be solved is to provide a kind of whole station lock method to set up based on CDN mirror image, in CDN section
Build interim source station resource mirror image for station services on point, Source Site not only can be solved well in inadequate resource with timely
Between relatively more urgent in the case of it is impossible to quickly do the problem of redundancy backup, and can lead in the case of by security threat
Cross the mirroring service in CDN, isolation source station and the external world, open the protective effect to source station.
For solving above-mentioned technical problem, the technical solution used in the present invention is：
A kind of whole station lock method to set up based on CDN mirror image, comprises the following steps：
Step 1：Website accesses CDN；
Step 2：Using a CDN node as host node, actively crawl the data of source station by reptile, be saved in local,
As the mirror image resources of website, and by this resource dissemination to other CDN node；
Step 3：The resource that all CDN node arrange acquired in reptiles is read-only, and reconfigure the user of this website please
Seek access to content strategy, this site requests acts on behalf of local mirror image；
Step 4：When this website of user's request, CDN directly accesses and returns the mirror image resources of reptile acquisition, no longer
Request source station.
According to such scheme, also include step 5：The more New Policy that CDN configures according to source station, regularly goes again to crawl source station
Up-to-date resource.
Compared with prior art, the invention has the beneficial effects as follows：
1st, CDN node is obtained by the method for reptile and backs up source station resource, without source station authority, can automatically complete simultaneously
Timing updates.
2nd, source station resource total caching CDN node is so that source station accesses isolation with extraneous, and CDN node built-in security
Safeguard function, effectively reduces source station by risk of attacks；When source station is because safeguarding or being attacked appearance exception, CDN node can be replaced
For source station, improve the availability to user for the website.
3rd, redundancy backup, save resources can be saved in source station.
Brief description
Fig. 1 is the network architecture diagram of whole station lock in the present invention.
Specific embodiment
The present invention is further detailed explanation with reference to the accompanying drawings and detailed description.Currently a lot of medium and small website
In order to preferably provide smooth Consumer's Experience service to user, can select to access third party's CDN platform.But due to itself skill
The reasons such as art ability, resource, itself source station ought run into when extensive maintenance it is impossible to rapidly backing up to site resource and leading
Stream, leads to station services unavailable in certain time.
CDN node has high bandwidth, resource foot in itself, and network node is distributed the characteristic such as wide, if can in CDN node be
Station services build interim source station resource mirror image, not only can solve Source Site well and compare in inadequate resource and time
It is impossible to quickly do the problem of redundancy backup in the case of urgent, and can in the case of by security threat, by
The mirroring service of CDN, isolation source station and the external world, open the protective effect to source station.This deployment site resource mirror image on CDN
Technical scheme we term it " whole station lock ", details are as follows.
Precondition：Website accesses CDN.When user needs to open whole station lock, it is as follows that CDN realizes flow process：
1st, using a CDN node as host node, actively crawl the data of source station by reptile, be saved in local, as
The mirror image resources of website, and by this resource dissemination to other CDN node.
2nd, the resource that all CDN node arrange acquired in reptile is read-only, and protection is tampered, and reconfigures this website
User's request access to content strategy, this site requests acts on behalf of local mirror image.
3rd, when this website of user's request, CDN will not remove to search caching again, but accesses the mirror image money that reptile obtains
Source.Even if searching unsuccessfully, ask for less than source station also will not be gone to.So be equivalent to by CDN, isolated user and source station.Reach
The purpose of protection source station.
4th, CDN regularly can go again to crawl the up-to-date resource in source station according to the more New Policy of source station configuration.
As shown in figure 1, after opening, CDN node may be considered the mirror image of a Timing Synchronization of source station A, all of
Request CDN node is directly processed, and eliminates the reliance on source station.Additionally, all CDN node accessing this website can be arranged crawl money simultaneously
Source, and preserve and locally do mirror image, replace after host node crawls and distribute again.
Claims (2)
1. a kind of whole station lock method to set up based on CDN mirror image is it is characterised in that comprise the following steps：
Step 1：Website accesses CDN；
Step 2：Using a CDN node as host node, actively crawl the data of source station by reptile, be saved in local, as
The mirror image resources of website, and by this resource dissemination to other CDN node；
Step 3：The resource that all CDN node arrange acquired in reptiles is read-only, and reconfigures in the user's request of this website
Hold access strategy, this site requests acts on behalf of local mirror image；
Step 4：When this website of user's request, CDN directly accesses and returns the mirror image resources of reptile acquisition, no longer asks
Source station.
2. as claimed in claim 1 a kind of whole station lock method to set up based on CDN mirror image it is characterised in that also including step
5：The more New Policy that CDN configures according to source station, regularly goes again to crawl the up-to-date resource in source station.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610844733.2A CN106385455A (en) | 2016-09-23 | 2016-09-23 | CDN (Content Delivery Network) mirror-based whole site lock setting method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610844733.2A CN106385455A (en) | 2016-09-23 | 2016-09-23 | CDN (Content Delivery Network) mirror-based whole site lock setting method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106385455A true CN106385455A (en) | 2017-02-08 |
Family
ID=57936830
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610844733.2A Pending CN106385455A (en) | 2016-09-23 | 2016-09-23 | CDN (Content Delivery Network) mirror-based whole site lock setting method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106385455A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109274750A (en) * | 2018-10-07 | 2019-01-25 | 杭州安恒信息技术股份有限公司 | A method of it is normally accessed based on user after the broken string of cloud platform guarantee website online |
| CN109861951A (en) * | 2017-11-30 | 2019-06-07 | 北京安云世纪科技有限公司 | A kind of Website access method, device, system |
| CN109873707A (en) * | 2017-12-04 | 2019-06-11 | 北京安云世纪科技有限公司 | Website access method, device, system |
| CN110830531A (en) * | 2018-08-09 | 2020-02-21 | 阿里巴巴集团控股有限公司 | Resource request processing method and device, storage system, electronic device and storage device |
| CN111770119A (en) * | 2020-09-03 | 2020-10-13 | 云盾智慧安全科技有限公司 | Website resource acquisition method, system, device and computer storage medium |
| CN113179328A (en) * | 2021-05-19 | 2021-07-27 | 上海七牛信息技术有限公司 | Resource distribution method and system for PCDN (Primary Contourlet distribution) network |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103475654A (en) * | 2013-09-06 | 2013-12-25 | 北京奇虎科技有限公司 | Method for optimizing network paths, equipment and network system |
| CN104113512A (en) * | 2013-04-18 | 2014-10-22 | 华为技术有限公司 | CDN system, advertisement push system and advertisement push method |
| CN105205143A (en) * | 2015-09-18 | 2015-12-30 | 杭州华为数字技术有限公司 | File storage and processing method, device and system |
| CN105634992A (en) * | 2015-12-29 | 2016-06-01 | 网宿科技股份有限公司 | CDN platform self-adaptive bandwidth control method and system |
-
2016
- 2016-09-23 CN CN201610844733.2A patent/CN106385455A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104113512A (en) * | 2013-04-18 | 2014-10-22 | 华为技术有限公司 | CDN system, advertisement push system and advertisement push method |
| CN103475654A (en) * | 2013-09-06 | 2013-12-25 | 北京奇虎科技有限公司 | Method for optimizing network paths, equipment and network system |
| CN105205143A (en) * | 2015-09-18 | 2015-12-30 | 杭州华为数字技术有限公司 | File storage and processing method, device and system |
| CN105634992A (en) * | 2015-12-29 | 2016-06-01 | 网宿科技股份有限公司 | CDN platform self-adaptive bandwidth control method and system |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109861951A (en) * | 2017-11-30 | 2019-06-07 | 北京安云世纪科技有限公司 | A kind of Website access method, device, system |
| CN109873707A (en) * | 2017-12-04 | 2019-06-11 | 北京安云世纪科技有限公司 | Website access method, device, system |
| CN110830531A (en) * | 2018-08-09 | 2020-02-21 | 阿里巴巴集团控股有限公司 | Resource request processing method and device, storage system, electronic device and storage device |
| CN109274750A (en) * | 2018-10-07 | 2019-01-25 | 杭州安恒信息技术股份有限公司 | A method of it is normally accessed based on user after the broken string of cloud platform guarantee website online |
| CN111770119A (en) * | 2020-09-03 | 2020-10-13 | 云盾智慧安全科技有限公司 | Website resource acquisition method, system, device and computer storage medium |
| CN111770119B (en) * | 2020-09-03 | 2020-11-27 | 云盾智慧安全科技有限公司 | Website resource acquisition method, system, device and computer storage medium |
| CN113179328A (en) * | 2021-05-19 | 2021-07-27 | 上海七牛信息技术有限公司 | Resource distribution method and system for PCDN (Primary Contourlet distribution) network |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106385455A (en) | CDN (Content Delivery Network) mirror-based whole site lock setting method | |
| US10715485B2 (en) | Managing dynamic IP address assignments | |
| US6920558B2 (en) | Method and apparatus for securely and dynamically modifying security policy configurations in a distributed system | |
| CN107360234B (en) | Computer readable storage medium | |
| US20190238636A1 (en) | Systems and methods for synchronizing microservice data stores | |
| CN103677967B (en) | A kind of remote date transmission system of data base and method for scheduling task | |
| US20230096032A1 (en) | Hybrid Approach To Data Governance | |
| US20080005780A1 (en) | Master security policy server | |
| CN107734026A (en) | A kind of design method, device and the equipment of network attached storage cluster | |
| WO2004025466A2 (en) | Distributed computing infrastructure | |
| US20180359145A1 (en) | Unified software defined networking configuration management over multiple hosting environments | |
| CN102571972B (en) | The distributed file system access of site-aware is carried out from outside enterprise network | |
| CN107819891A (en) | Data processing method, device, computer equipment and storage medium | |
| US12013953B2 (en) | Performance standby nodes for a secure storage system | |
| CN104104582B (en) | A kind of data storage path management method, client and server | |
| JP2010009090A (en) | Cluster node control program, cluster node control method, and cluster node control apparatus of file server | |
| EP4050850A1 (en) | Service upgrading method, device and system | |
| CN104516744A (en) | Software updating method and system | |
| CN107786650A (en) | A kind of synchronous method, the apparatus and system of storage medium and management strategy | |
| Compastié et al. | A software-defined security strategy for supporting autonomic security enforcement in distributed cloud | |
| CN106657360A (en) | Synchronization method and system for NIS servers under Linux system | |
| CN107590032A (en) | The method and storage cluster system of storage cluster failure transfer | |
| CN109714354B (en) | Website security management system and website security control method | |
| CN114301763A (en) | Distributed cluster fault processing method and system, electronic device and storage medium | |
| US20240248968A1 (en) | Systems of and methods for managing tenant and user identity information in a multi-tenant environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170208 |