CN108268209A - Date storage method and CDN system in a kind of CDN system - Google Patents
Date storage method and CDN system in a kind of CDN system Download PDFInfo
- Publication number
- CN108268209A CN108268209A CN201611265989.4A CN201611265989A CN108268209A CN 108268209 A CN108268209 A CN 108268209A CN 201611265989 A CN201611265989 A CN 201611265989A CN 108268209 A CN108268209 A CN 108268209A
- Authority
- CN
- China
- Prior art keywords
- node
- data
- edge
- fringe
- edge node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003860 storage Methods 0.000 title claims abstract description 71
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000005012 migration Effects 0.000 claims description 12
- 238000013508 migration Methods 0.000 claims description 12
- 238000007726 management method Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 11
- 230000005540 biological transmission Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000000243 solution Substances 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000003362 replicative effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/062—Securing storage systems
- G06F3/0622—Securing storage systems in relation to access
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/10—Protecting distributed programs or content, e.g. vending or licensing of copyrighted material ; Digital rights management [DRM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0637—Permissions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/2141—Access rights, e.g. capability lists, access control lists, access tables, access matrices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Technology Law (AREA)
- Multimedia (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses the date storage methods and CDN system in a kind of CDN system.In this method, after data to be stored are got, the data to be stored are sent to first edge node, so that first edge node stores the data；The data are copied in at least second edge node in addition to first edge node, so that at least one second edge node stores the data, and the data will not be sent to core node.Further, it is also possible to according to the loading condition of fringe node, the data stored in first, second fringe node are replicated or are moved in other fringe nodes.In the above method; since data to be stored are directly stored in fringe node; rather than it first stores in core node; each fringe node is sent the data to by core node again to store; so that the data of storage are not preserved the core node that can be accessed in all users; the safety of data is increased, is more advantageous to the copyright protection of data.
Description
Technical field
The present invention relates to the date storage methods and CDN system in internet arena more particularly to a kind of CDN system.
Background technology
CDN (Content Delivery Network, content distributing network) is that one kind is deposited by being set everywhere in network
One on the existing Internet basic layer intelligent virtual network that node is formed is stored up, passes through the load balancing of central platform, interior
Hold the function modules such as distribution, scheduling, user is made to obtain required content nearby, reduce network congestion, improve user's access response speed
Degree and hit rate.
The basic principle of CDN is widely used various memory nodes, these memory nodes are distributed to user accesses relatively
In the area of concentration or network.It is using global load technology that the access direction of user is closest when user accesses website
, on memory node working properly, asked by memory node directly in response to user.Memory node in CDN system includes core
Heart node and fringe node.The data being injected into CDN system are first stored in core node, then that these data are same
It walks in fringe node, user to be facilitated to access.When user asks to access data, CDN system is according to the guiding strategy of setting
Select fringe node, first data to be visited are searched from fringe node whether there is, if in the presence of if directly from fringe node
Data needed for download, otherwise in Hui Yuan to core node download needed for data.
In the data that acquisition has higher requirements for safety, if not including representing to have in the request of acquisition data obtains
The mark of weighting limit is then obtained according to the fringe node request that will not select to be stored with the data when being oriented to policy selection fringe node
Access evidence.However, being oriented to strategy only so that data cannot be obtained from fringe node, do not interfere with Hui Yuan and obtained to core node
Data, there are Information Security, the hidden danger of copyright problem.
Invention content
An embodiment of the present invention provides the date storage method in a kind of CDN system and a kind of CDN system, to realize
Data to be stored are directly stored in the fringe node in CDN system, to ensure the safety of data.
Date storage method in CDN system provided in an embodiment of the present invention, including：
Obtain data to be stored；
First edge node is sent said data to, so that the first edge node stores the data；
The data are copied at least one second edge node in addition to first edge node so that it is described extremely
A few second edge node stores the data, and the data will not be sent to core node.
Optionally, it is described to send said data to first edge node, including：
According to the loading condition of each fringe node, first edge node is selected from each fringe node；
Send said data to first edge node.
Optionally, first edge node is sent said data to, including：
If including specific identifier in the data, first edge node is sent said data to；The specific mark
Knowledge, which is used to indicate the data, to be stored in fringe node.
Optionally, the data are copied at least one second edge node in addition to first edge node, wrapped
It includes：
According to the load feelings of pre-set backup number and other each fringe nodes in addition to first edge node
Condition selects at least one second edge node for being used to back up the data of corresponding number；
The data are separately sent to back up for backing up at least one second edge node of the data.
Optionally, this method further includes：
When the loading condition in the first edge node meets preset condition, according to except first edge node and second
The loading condition of other each fringe nodes except fringe node selects at least one third in other described each fringe nodes
Fringe node；The data stored in the first edge node are sent at least one third fringe node to carry out
Backup, alternatively, by the Data Migration stored in the first edge node at least one third fringe node；
And/or
When the loading condition in the second edge node meets preset condition, according to except first edge node and second
The loading condition of other each fringe nodes except fringe node selects at least one 4th in other described each fringe nodes
Fringe node；The data stored in the second edge node are sent at least one 4th fringe node to carry out
Backup, alternatively, by the Data Migration stored in the second edge node at least one 4th fringe node.
Optionally, this method further includes：
The request for accessing the data is received,
After confirming that the request has access rights, according to the first edge node, second edge node, third side
The loading condition of one or more of edge node and the 4th fringe node is determined as the edge section that the request provides service
Point.
CDN system provided in an embodiment of the present invention, including：Data publication node, core node and multiple fringe nodes；
The data publication node for obtaining data to be stored, selects the first side from the multiple fringe node
Edge node sends said data to first edge node；
The data for storing the data, and are copied to the multiple fringe node by the first edge node
In at least one second edge node in addition to the first edge node so that at least one second edge node
The data are stored, and the data will not be sent to core node.
Optionally, when institute's data publication node selects first edge node from the multiple fringe node, it is specifically used for：
According to the loading condition of the multiple fringe node, first edge node is selected from the multiple fringe node.
Optionally, the data publication node, is specifically used for：
If including specific identifier in the data, first edge node is sent said data to；The specific mark
Knowledge, which is used to indicate master's data, to be stored in fringe node.
Optionally, the first edge node is copied in the multiple fringe node by the data except described first
When at least one second edge node except fringe node, it is specifically used for：
According to other in pre-set backup number and the multiple fringe node in addition to first edge node
The loading condition of each fringe node selects at least one second edge node for being used to back up the data of corresponding number；
The data are separately sent to back up for backing up at least one second edge node of the data.
Optionally, the first edge node is additionally operable to：When the loading condition of the first edge node meet it is preset
During condition, according in the multiple fringe node in addition to the first edge node and the second edge node other are each
The loading condition of fringe node selects at least one third fringe node；Send said data at least one third
Fringe node is backed up or by the Data Migration to the third fringe node；And/or
The second edge node is additionally operable to：When the loading condition of the second edge node meets preset condition,
According to other each edge sections in the multiple fringe node in addition to the first edge node and the second edge node
The loading condition of point selects at least one 4th fringe node；Send said data at least one 4th edge section
Point is backed up or by the Data Migration to the 4th fringe node.
Optionally, it further includes：
Ingress node, for receiving the request for accessing the data；After confirming that the request has access rights, according to
One or more of the first edge node, second edge node, third fringe node and the 4th fringe node are born
Load situation is determined as the fringe node that the request provides service.
In the above embodiment of the present invention, after data to be stored are got, data to be stored are sent to first
Fringe node, so that first edge node stores the data；The data are copied in addition to first edge node extremely
In few second edge node, so that above-mentioned at least one second edge node stores the data.Due to by data to be stored
It is directly stored in fringe node rather than first stores in core node, then each fringe node is sent the data to by core node
Storage so that the data of storage are not preserved in the core node that can be accessed in all users, increase the safety of data
Property is more advantageous to the copyright protection of data.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly introduced, it should be apparent that, the accompanying drawings in the following description is only some embodiments of the present invention, for this
For the those of ordinary skill in field, without creative efforts, other are can also be obtained according to these attached drawings
Attached drawing.
Fig. 1 is the CDN system configuration diagram suitable for the embodiment of the present invention；
Fig. 2 is one of flow diagram of date storage method in CDN system provided in an embodiment of the present invention；
Fig. 3 is the two of the flow diagram of the date storage method in CDN system provided in an embodiment of the present invention；
Fig. 4 is the three of the flow diagram of the date storage method in CDN system provided in an embodiment of the present invention.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, the present invention is made below in conjunction with attached drawing into
One step it is described in detail.
Due to the rapid development of internet, since CDN system can reduce network blockage, promotion subscriber network access body
It tests, can resource be used appropriately, therefore the application of CDN system seems more important.However, the hair with CDN system
Exhibition, also brings new challenge, while smooth internet information transmission, raising user's acquisition data speed is ensured, logarithm
It is also increasingly serious according to the protection problem of copyright.
When using CDN system, the providers of data stores data into CDN system, and CDN system is by data to be stored
It stores in core node, then the data in core node is synchronized in fringe node and are preserved.When user's acquisition request number
According to when, for CDN system according to the guiding strategy of setting, such as region, priority, network etc. select fringe node, and check choosing
The data for the acquisition request whether being stored in the fringe node selected obtain data if having from fringe node, should if not having
Fringe node can also ask to obtain the data from other fringe nodes or core node.If by the data of family acquisition request
For the data having higher requirements to safety or need protect copyright data, CDN system also according to obtain data request sentence
Whether there is the mark for obtaining data permission in the disconnected request, it, should according to the guiding strategy of setting if there is no the mark in request
Request will not be sent in the fringe node for being stored with the data.Although it can not be obtained from the fringe node for be stored with the data
Access evidence, but the process that Hui Yuan obtains data to upper layer node or core node can't be influenced, if being stored in core node
There are the data, you can obtain the data, whether there will not be acquisition permission to judge this request again.
For example, the supplier of film, when film data is uploaded to internet, film data is obtained in order to improve user
Speed, film data can be stored in CDN system, typically store film into the core node of CDN system, then
Film is synchronized to by core node in fringe node.There is no the user of download permission when the film is downloaded in request, in request
Do not represent that there is the mark of download permission, according to be oriented to strategy, the request be sent to user it is nearer, without storage shadow
The fringe node of piece.Due to not storing the film in the fringe node, need to send to other fringe nodes and download the film
Request, according to strategy is oriented to, other requested fringe nodes remain as the fringe node for not storing the film.Multiple
When request can not still download film, then source download can be carried out back, that is, sends the request to upper layer node or core node, because
The film is stored in core node so that the user of no download permission can also download success so that the copyright of film does not have
It is effectively protected, to film supplier, quotient causes damages.
To solve the above-mentioned problems, an embodiment of the present invention provides the date storage method in a kind of CDN system, to reality
Now data to be stored are directly stored in the fringe node in CDN system, to ensure the safety of data.
Fig. 1 illustratively gives a kind of CDN system suitable for date storage method provided in an embodiment of the present invention
Organization Chart.As shown in the figure, CDN system can include Ingress node, core memory cluster (i.e. several core nodes), core number
According to library, fringe node cluster (i.e. several fringe nodes), edge data library, publisher node.
Wherein, publisher node is used for the instruction of storage data sent according to data providing, and data to be stored are sent out
In the core node or fringe node that send.Data to be stored can be uploaded directly into publisher node by data providing, also may be used
To provide the address for downloading the data to be stored, so that publisher node downloads data to be stored according to the address.
Core memory cluster and edge storage cluster are used to store data.In the prior art, data providing provides
Data are first stored in core memory cluster, and then basis is synchronized to again in edge storage cluster.
Wherein, since the quantity of the fringe node in edge storage cluster is more, level can also be further divided,
Two-level node cluster i.e. as shown in Figure 1 and fringe node cluster.Data in core node, which are first synchronized, is stored in the core
In the two-level node of heart node administration, then each two-level node is sent data in the fringe node that it is managed again so that side
The data are stored in edge node.Correspondingly, when obtaining data from CDN system, first check in fringe node whether store
There are required data, if not having, check in the two-level node for managing the fringe node whether be stored with required data, if two level section
Do not have in point yet, then check in the core node for managing the two-level node whether be stored with required data.
Preserve what is stored in core memory cluster and edge storage cluster in core database and edge data library respectively
Data list.For example, preserving the film list stored in core memory cluster in core database, can include in the list
The information such as title of a film, data format, size of data.Certainly, core database can also be integrated in some core node
In, likewise, edge data library can also be integrated in some fringe node.
Ingress node is used to receive the request of the acquisition data of user's transmission, and according to the guiding strategy of CDN system, selection
For providing the fringe node or core node of service.For example, Ingress node will be used according to nearby principle, load balancing principle
The request that family obtains data is sent to the fringe node nearer with user, if there is the data needed for user in the fringe node,
Corresponding data are obtained from the fringe node, otherwise, choose other fringe nodes or Hui Yuan to core node.
It should be appreciated that the Organization Chart of CDN system shown in FIG. 1 is only to be suitable for the invention a specific embodiment, it can
With application date storage method provided in an embodiment of the present invention CDN system can also only include Fig. 1 in part of nodes or
It can also can also be integrated in a node including multiple nodes shown in other unshowned nodes or Fig. 1, this
Inventive embodiments are not restricted this.
It is the flow diagram of the date storage method in CDN system provided in an embodiment of the present invention referring to Fig. 2.Such as figure
Shown, this method includes the following steps：
Step 201 obtains data to be stored.
By taking CDN system framework shown in FIG. 1 as an example, above-mentioned steps 201 can be performed by publisher node.Publisher node can be with
The data of the upload in data providing are directly acquired, the data acquisition address that can also be provided according to data providing, slave phase
Data to be stored are obtained in the address answered.
It optionally, can also be specific according to whether being carried in data to be stored after data to be stored are got
Mark determines to perform data storage procedure according to the prior art, also according to date storage method provided in an embodiment of the present invention
It is stored；Wherein specific identifier is used to indicate data and needs to be stored in fringe node.
The data of progress legitimate verification are needed when having higher requirements for safety, obtaining data, hair can be injected into
The specific identifier is carried when in cloth node, it, should be according to provided in an embodiment of the present invention to show that it is to be protected that the data need
Date storage method is stored.There is no the data of high requirement for safety, the specific identifier can not be carried, you can press
It is stored according to the prior art.
Step 202 transmits data to first edge node, so that first edge node stores the data.
It should be appreciated that " the first edge node " is only used for distinguishing with other fringe nodes, some is not refered in particular to
Fringe node.
Publisher node can select a fringe node from multiple fringe nodes in the CDN system and wait to deposit for storing
The data of storage, and by data transmission to be stored to the first edge node selected, so that the storage of first edge node should
Data.
Optionally, publisher node can be according to the loading condition of each fringe node in the CDN system, from each edge
First edge node is selected in node.Publisher node it is smaller can to choose a load in the fringe node nearer with user
Fringe node store the data, the loading condition for enabling to fringe node in the CDN system is more balanced.
Step 203 loads to data to be stored at least one second edge node in addition to first edge node,
So that above-mentioned at least one second edge node stores the data.
In the prior art, data to be stored is first stored in core node, then is copied data to by core node
In fringe node, to facilitate user's quick obtaining data, and fringe node will not again replicate data and be sent to other edges
Node.
However, during using date storage method provided in an embodiment of the present invention, since data to be stored is to be stored directly
Into first edge node, if first edge node by data still according to no longer replicating and be sent to other edges in the prior art
Node, then the data are only stored in first edge node, then cannot be from relatively closely when user is in the acquisition request data
Fringe node in quick obtaining data, it is necessary to data can just be got by accessing first edge node.
To solve the above-mentioned problems, the first edge node in the embodiment of the present invention can also be from its in the CDN system
He selects at least one second edge node in fringe node, data are replicated and are sent at least one second side selected
In edge node.
Optionally, first edge node can according in pre-set backup number and the CDN system remove the first side
The loading condition of other each fringe nodes except edge node selects the second edge section for being used to back up the data of corresponding number
Point.Wherein, pre-set backup number, can be the pre-set default value of the CDN system or data carry
What supplier was set when data are injected into the CDN system by publisher node by data providing, it is, of course, also possible to pass through it
He is configured method, and the embodiment of the present invention is not restricted this.
Optionally, when the loading condition of first edge node meets preset condition, according to except first edge node and second
The loading condition of other each fringe nodes except fringe node selects at least one third edge in other each fringe nodes
Node；Then the data in first edge node are replicated and is sent to third fringe node and backed up, alternatively, by the first side
In Data Migration to third fringe node in edge node.
Wherein, the preset condition of load can be that some data is requested the number of download and reaches predetermined threshold value, alternatively, together
When request from the fringe node request of downloading data reach predetermined threshold value, alternatively, the cpu busy percentage of the fringe node reaches
Predetermined threshold value etc., the invention is not limited in this regard.
Similarly, when the load of second edge node meets preset condition, according to except first edge node and second edge
The loading condition of other each fringe nodes except node selects at least one 4th edge section in other each fringe nodes
Point；Then the data in second edge node are replicated and is sent to the 4th fringe node and backed up, alternatively, by second edge
In Data Migration to the 4th fringe node in node.
Optionally, when CDN system receives the access request of data of client transmission, first judge whether the request has
Access rights.If the request has access rights, according to the loading condition for the fringe node for being stored with the data, from above-mentioned the
A fringe node is selected in one fringe node, second edge node, third fringe node and the 4th fringe node as that should ask
Offer service is provided.
In a specific embodiment, an edge management services module, multiple can be included in a fringe node
Edge storage services module and multiple edge streaming media service modules.Wherein, edge management services module can manage the side
All edge service memory modules and edge streaming media service module in edge node；The data of edge storage services module and side
The quantity of edge streaming media service module is identical, and an edge streaming media service module is corresponding with an edge memory module.
Streaming media service module in edge can receive the request of the acquisition data of user's transmission, can also be to its corresponding side
Edge memory module sends the message such as heartbeat, load.Edge storage services module can be where it fringe node in edge
Edge management services module in management services module and other fringe nodes reports heartbeat, load, the information for storing data
The message such as state；The message reported can be that timing sends or reports when the triggering event occurs.
When data providing will need the film A storages by special protection to CDN system by publisher node, flow
It can be as shown in Figure 3.Publisher node selects first edge node according to loading condition from CDN system, and is calculated according to Hash
Method selects an edge storage services module, i.e. first edge storage services module from first edge node, for storing shadow
The data of piece A.First edge management services module of the first edge storage services module into first edge node and other
Edge management services module in fringe node reports heartbeat, load, the message such as information state for storing data.First edge pipe
Reason service module can receive the message and other edges that all edge storage services modules report in first edge node
The message that edge storage services module in node reports, to know the loading condition of each edge storage services module and storage
Data information etc.；The message that first edge management services module is reported according to first edge storage services module, determines first
The data of new injection film A are stored in edge storage services module, according to pre-set backup number and other each sides
The loading condition of edge storage services module determines N number of second edge storage services module for backing up film A, second edge
Storage services module can be in first edge node or other fringe nodes in.First edge management service
Module notifies second edge storage services module from first edge storage service after second edge storage services module is determined
Backup film A in module, second edge storage services module then send asking for backup film A to first edge storage services module
It asks, the data of film A are sent to second edge storage services module and backed up by first edge storage services module.
When the number that the data of film A are requested download reaches preset times or first edge management services module
Loading condition when meeting preset condition, first edge management services module by the data backup of film A or can also move to
In other edge storage services modules, as shown in Figure 4.First edge management services module is according to first edge storage services module
The message reported determines that film A in first edge storage services module is requested the number of download and reaches preset times or really
Determine first edge storage services module present load it is larger when, can be selected from other edge storage services modules load it is smaller
Edge storage services module, for the data of film A being copied to or being moved in the edge storage services module selected,
I.e. first edge management service management module notifies the edge storage services module of selection from first edge storage services module
The data of film A are obtained, notified edge storage services module sends to first edge storage services module and obtains film A
Data request, first edge storage services module is by the data payload of film A or migrates to other edge storage service moulds
Block.
There is no the film B of particular/special requirement to safety, it can be stored according to the prior art, first stored it in
In core node, then backuped in fringe node by core node.As user acquisition request film B, first from fringe node
Edge storage services module in search whether to be stored with the data of film B, the data of film B are sent to client if having
End, if not having, searches from other edge service modules in the fringe node, if also not having, reselects a side
Edge node, continues to search for, and when not finding repeatedly, is then searched from two-level node or core node.
And having the film A of particular/special requirement to safety, aforementioned data storage method, the data of film A are stored on time
In first edge node, then by first edge node standby to other fringe nodes.As user acquisition request film A, enter
Mouth server determines whether the request has the permission for downloading film A.If the request has download permission, basis is pre-set
Guiding strategy, a smaller fringe node of load is selected to be provided down for the request from the fringe node for being stored with film A
Carry service.If the request does not have download permission, strategy is oriented to according to pre-set, never stores the edge of film A
Fringe node is selected to be supplied to the client for sending and asking in node, downloaded so that client is sent to the fringe node selected
Request however, there is no storage film A in the fringe node selected, can not provide download service, which can be with
The request for downloading film A is sent to other fringe nodes, however other fringe nodes asked still are the side without storing film A
Edge node, therefore repeatedly request cannot provide download, therefore Hui Yuan asks to download to core node, however also do not have in core node
There is storage film A, therefore download service cannot be provided for the request, ensure that the copyright of film A.
In the above embodiment of the present invention, after data to be stored are got, data to be stored are sent to first
Fringe node, so that first edge node stores the data；The data are copied in addition to first edge node extremely
In few second edge node, so that above-mentioned at least one second edge node stores the data.Due to by data to be stored
It is directly stored in fringe node rather than first stores in core node, then each fringe node is sent the data to by core node
Storage so that the data of storage are not preserved in the core node that can be accessed in all users, increase the safety of data
Property is more advantageous to the copyright protection of data.
Based on identical technical concept, the embodiment of the present invention additionally provides a kind of CDN system, to realize above method reality
Example is applied, which can be as shown in Figure 1.The CDN system includes at least：Data publication node and multiple fringe nodes, into one
Step ground, can also include Ingress node.
Data publication node for obtaining data to be stored, selects first edge section from the multiple fringe node
Point sends said data to first edge node.
First edge node for storing the data, and the data is copied in the multiple fringe node and are removed
In at least one second edge node except the first edge node, so that at least one second edge node storage
The data.
Optionally, when institute's data publication node selects first edge node from the multiple fringe node, it is specifically used for：
According to the loading condition of the multiple fringe node, first edge node is selected from the multiple fringe node.
Optionally, the data publication node, is specifically used for：
If including specific identifier in the data, first edge node is sent said data to；The specific mark
Knowledge, which is used to indicate master's data, to be stored in fringe node.
Optionally, the first edge node is copied in the multiple fringe node by the data except described first
When at least one second edge node except fringe node, it is specifically used for：
According to other in pre-set backup number and the multiple fringe node in addition to first edge node
The loading condition of each fringe node selects at least one second edge node for being used to back up the data of corresponding number；
The data are separately sent to back up for backing up at least one second edge node of the data.
Optionally, the first edge node is additionally operable to：When the loading condition of the first edge node meet it is preset
During condition, according in the multiple fringe node in addition to the first edge node and the second edge node other are each
The loading condition of fringe node selects at least one third fringe node；Send said data at least one third
Fringe node is backed up or by the Data Migration to the third fringe node.
Optionally, the second edge node is additionally operable to：When the loading condition of the second edge node meet it is preset
During condition, according in the multiple fringe node in addition to the first edge node and the second edge node other are each
The loading condition of fringe node selects at least one 4th fringe node；Send said data to the described at least one 4th
Fringe node is backed up or by the Data Migration to the 4th fringe node.
Optionally, which further includes：Ingress node, for receiving the request for accessing the data；Confirming described ask
It asks with after access rights, according to the first edge node, second edge node, third fringe node and the 4th edge section
The loading condition of one or more of point is determined as the fringe node that the request provides service.
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that it can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided
The processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that the instruction performed by computer or the processor of other programmable data processing devices is generated for real
The device of function specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction generation being stored in the computer-readable memory includes referring to
Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or
The function of being specified in multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps are performed on calculation machine or other programmable devices to generate computer implemented processing, so as in computer or
The instruction offer performed on other programmable devices is used to implement in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Although preferred embodiments of the present invention have been described, but those skilled in the art once know basic creation
Property concept, then additional changes and modifications may be made to these embodiments.So appended claims be intended to be construed to include it is excellent
It selects embodiment and falls into all change and modification of the scope of the invention.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
God and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (12)
1. a kind of date storage method in content distributing network CDN system, which is characterized in that including：
Obtain data to be stored；
First edge node is sent said data to, so that the first edge node stores the data；
The data are copied at least one second edge node in addition to first edge node, so that described at least one
A second edge node stores the data, and the data will not be sent to core node.
2. the method as described in claim 1, which is characterized in that it is described to send said data to first edge node, including：
According to the loading condition of each fringe node, first edge node is selected from each fringe node；
Send said data to first edge node.
3. the method as described in claim 1, which is characterized in that first edge node is sent said data to, including：
If including specific identifier in the data, first edge node is sent said data to；The specific identifier is used
It to be stored in fringe node in the instruction data.
4. the method as described in claim 1, which is characterized in that copy to the data in addition to first edge node extremely
In a few second edge node, including：
According to pre-set backup number and the loading condition of other each fringe nodes in addition to first edge node, choosing
Select at least one second edge node for being used to back up the data of corresponding number；
The data are separately sent to back up for backing up at least one second edge node of the data.
5. the method as described in claim 1, which is characterized in that further include：
When the loading condition in the first edge node meets preset condition, according to except first edge node and second edge
The loading condition of other each fringe nodes except node selects at least one third edge in other described each fringe nodes
Node；It is standby that the data stored in the first edge node are sent at least one third fringe node progress
Part, alternatively, by the Data Migration stored in the first edge node at least one third fringe node；With/
Or
When the loading condition in the second edge node meets preset condition, according to except first edge node and second edge
The loading condition of other each fringe nodes except node selects at least one 4th edge in other described each fringe nodes
Node；It is standby that the data stored in the second edge node are sent at least one 4th fringe node progress
Part, alternatively, by the Data Migration stored in the second edge node at least one 4th fringe node.
6. the method as described in any one of claim 1 to 5, which is characterized in that further include：
The request for accessing the data is received,
After confirming that the request has access rights, according to the first edge node, second edge node, third edge section
The loading condition of point and one or more of the 4th fringe node is determined as the fringe node that the request provides service.
7. a kind of content distributing network CDN system, which is characterized in that including：Data publication node, core node and multiple edges
Node；
The data publication node for obtaining data to be stored, selects first edge section from the multiple fringe node
Point sends said data to first edge node；
The first edge node for storing the data, and the data is copied in the multiple fringe node and are removed
In at least one second edge node except the first edge node, so that at least one second edge node storage
The data, and the data will not be sent to core node.
8. system as claimed in claim 7, which is characterized in that institute's data publication node is selected from the multiple fringe node
During first edge node, it is specifically used for：
According to the loading condition of the multiple fringe node, first edge node is selected from the multiple fringe node.
9. system as claimed in claim 7, which is characterized in that the data publication node is specifically used for：
If including specific identifier in the data, first edge node is sent said data to；The specific identifier is used
It to be stored in fringe node in instruction master's data.
10. system as claimed in claim 7, which is characterized in that the data are being copied to institute by the first edge node
When stating at least one second edge node in multiple fringe nodes in addition to the first edge node, it is specifically used for：
According to other each sides in pre-set backup number and the multiple fringe node in addition to first edge node
The loading condition of edge node selects at least one second edge node for being used to back up the data of corresponding number；
The data are separately sent to back up for backing up at least one second edge node of the data.
11. system as claimed in claim 7, which is characterized in that the first edge node is additionally operable to：When the first edge
When the loading condition of node meets preset condition, according to removing the first edge node and described in the multiple fringe node
The loading condition of other each fringe nodes except second edge node selects at least one third fringe node；By the number
It is backed up or by the Data Migration to third edge section according at least one third fringe node is sent to
Point；And/or
The second edge node is additionally operable to：When the loading condition of the second edge node meets preset condition, according to
Other each fringe nodes in the multiple fringe node in addition to the first edge node and the second edge node
Loading condition selects at least one 4th fringe node；Send said data at least one 4th fringe node into
Row backup or by the Data Migration to the 4th fringe node.
12. the system as described in any one of claim 7 to 11, which is characterized in that further include：
Ingress node, for receiving the request for accessing the data；After confirming that the request has access rights, according to described
The load feelings of one or more of first edge node, second edge node, third fringe node and the 4th fringe node
Condition is determined as the fringe node that the request provides service.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611265989.4A CN108268209A (en) | 2016-12-31 | 2016-12-31 | Date storage method and CDN system in a kind of CDN system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611265989.4A CN108268209A (en) | 2016-12-31 | 2016-12-31 | Date storage method and CDN system in a kind of CDN system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108268209A true CN108268209A (en) | 2018-07-10 |
Family
ID=62770207
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611265989.4A Pending CN108268209A (en) | 2016-12-31 | 2016-12-31 | Date storage method and CDN system in a kind of CDN system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108268209A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109756561A (en) * | 2018-12-12 | 2019-05-14 | 北京世纪互联宽带数据中心有限公司 | Date storage method and its device, electronic equipment, computer-readable medium |
| CN109981777A (en) * | 2019-03-27 | 2019-07-05 | 深圳市网心科技有限公司 | Copy maintaining method, server, copy memory node and system based on CDN |
| CN110149407A (en) * | 2019-05-24 | 2019-08-20 | 深圳市网心科技有限公司 | Method for network access and device, computer installation and storage medium |
| CN110601802A (en) * | 2019-08-16 | 2019-12-20 | 网宿科技股份有限公司 | Method and device for reducing cluster return-to-father bandwidth |
| CN111444043A (en) * | 2020-03-27 | 2020-07-24 | 中移雄安信息通信科技有限公司 | Data backup method, device, node, system and medium |
| CN111597259A (en) * | 2020-05-12 | 2020-08-28 | 北京爱奇艺科技有限公司 | Data storage system, method, device, electronic equipment and storage medium |
| CN111726403A (en) * | 2020-06-11 | 2020-09-29 | 深圳市赛宇景观设计工程有限公司 | Cross-cloud-platform big data management method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101127882A (en) * | 2007-08-31 | 2008-02-20 | 中兴通讯股份有限公司 | Distributed storage method for distributed network TV system and this system |
| CN101136932A (en) * | 2006-10-20 | 2008-03-05 | 中兴通讯股份有限公司 | Cluster type stream media networking system and its content issue and service method |
| CN102769669A (en) * | 2012-07-03 | 2012-11-07 | Ut斯达康通讯有限公司 | Intelligent content distribution control device and system |
| CN103685368A (en) * | 2012-09-10 | 2014-03-26 | 中国电信股份有限公司 | Method and system for migrating data |
| CN105930357A (en) * | 2016-04-07 | 2016-09-07 | 深圳市慧动创想科技有限公司 | Distributed file system, and data node data storage processing method and device |
-
2016
- 2016-12-31 CN CN201611265989.4A patent/CN108268209A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101136932A (en) * | 2006-10-20 | 2008-03-05 | 中兴通讯股份有限公司 | Cluster type stream media networking system and its content issue and service method |
| CN101127882A (en) * | 2007-08-31 | 2008-02-20 | 中兴通讯股份有限公司 | Distributed storage method for distributed network TV system and this system |
| CN102769669A (en) * | 2012-07-03 | 2012-11-07 | Ut斯达康通讯有限公司 | Intelligent content distribution control device and system |
| CN103685368A (en) * | 2012-09-10 | 2014-03-26 | 中国电信股份有限公司 | Method and system for migrating data |
| CN105930357A (en) * | 2016-04-07 | 2016-09-07 | 深圳市慧动创想科技有限公司 | Distributed file system, and data node data storage processing method and device |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109756561A (en) * | 2018-12-12 | 2019-05-14 | 北京世纪互联宽带数据中心有限公司 | Date storage method and its device, electronic equipment, computer-readable medium |
| CN109756561B (en) * | 2018-12-12 | 2022-10-14 | 北京世纪互联宽带数据中心有限公司 | Data storage method and device, electronic equipment and computer readable medium |
| CN109981777A (en) * | 2019-03-27 | 2019-07-05 | 深圳市网心科技有限公司 | Copy maintaining method, server, copy memory node and system based on CDN |
| CN110149407A (en) * | 2019-05-24 | 2019-08-20 | 深圳市网心科技有限公司 | Method for network access and device, computer installation and storage medium |
| CN110601802A (en) * | 2019-08-16 | 2019-12-20 | 网宿科技股份有限公司 | Method and device for reducing cluster return-to-father bandwidth |
| CN110601802B (en) * | 2019-08-16 | 2022-05-20 | 网宿科技股份有限公司 | Method and device for reducing cluster return-to-father bandwidth |
| CN111444043A (en) * | 2020-03-27 | 2020-07-24 | 中移雄安信息通信科技有限公司 | Data backup method, device, node, system and medium |
| CN111597259A (en) * | 2020-05-12 | 2020-08-28 | 北京爱奇艺科技有限公司 | Data storage system, method, device, electronic equipment and storage medium |
| CN111726403A (en) * | 2020-06-11 | 2020-09-29 | 深圳市赛宇景观设计工程有限公司 | Cross-cloud-platform big data management method and system |
| CN111726403B (en) * | 2020-06-11 | 2021-01-29 | 和宇健康科技股份有限公司 | Cross-cloud-platform big data management method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108268209A (en) | Date storage method and CDN system in a kind of CDN system | |
| US9009728B2 (en) | Method and apparatus for widget and widget-container distribution control based on content rules | |
| CA2720085C (en) | Rule-based content request handling | |
| US9229997B1 (en) | Embeddable cloud analytics | |
| CN104537076B (en) | A kind of file read/write method and device | |
| CN109213724B (en) | Method and system for updating files or storing and updating data and storage | |
| CN106506587A (en) | A kind of Docker image download methods based on distributed storage | |
| CN107395659A (en) | A kind of method and device of service handling and common recognition | |
| US20090165017A1 (en) | Stateless proportionally consistent addressing | |
| CN102891869B (en) | CDN (Content Delivery Network) and content distribution and scheduling method | |
| JP2019517042A (en) | Providing access to hybrid applications offline | |
| CN106487850A (en) | The methods, devices and systems of mirror image are obtained under a kind of cloud environment | |
| CN106557269A (en) | The method and apparatus of storage cloud disk resource | |
| US20220295133A1 (en) | Technologies for managing collaborative and multiplatform media content playlists | |
| CN106960011A (en) | Metadata of distributed type file system management system and method | |
| Rajalakshmi et al. | An improved dynamic data replica selection and placement in cloud | |
| US10162876B1 (en) | Embeddable cloud analytics | |
| CN105635124A (en) | Flow control method and device | |
| CN107844542A (en) | A kind of distributed document storage method and device | |
| CN104054308B (en) | Application layer resources selection method, device and system | |
| CN106940712A (en) | Sequence generating method and equipment | |
| Ohashi et al. | Token-based sharing control for IPFS | |
| CN107516048A (en) | The method and apparatus of file access in a kind of control distributed file system | |
| CN106888238A (en) | A kind of method of data synchronization and device | |
| CN106161517A (en) | The method and apparatus that cloud storage accesses is realized by cloud file system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180710 |