CN110191187A - CDN server data managing method, equipment and computer readable storage medium - Google Patents

CDN server data managing method, equipment and computer readable storage medium Download PDF

Info

Publication number
CN110191187A
CN110191187A CN201910482686.5A CN201910482686A CN110191187A CN 110191187 A CN110191187 A CN 110191187A CN 201910482686 A CN201910482686 A CN 201910482686A CN 110191187 A CN110191187 A CN 110191187A
Authority
CN
China
Prior art keywords
cdn
servers
server
cdn server
stored
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910482686.5A
Other languages
Chinese (zh)
Inventor
陈巧莲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hubei Wuwu Interconnection Technology Co Ltd
Original Assignee
Hubei Wuwu Interconnection Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hubei Wuwu Interconnection Technology Co Ltd filed Critical Hubei Wuwu Interconnection Technology Co Ltd
Priority to CN201910482686.5A priority Critical patent/CN110191187A/en
Publication of CN110191187A publication Critical patent/CN110191187A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • H04L67/1008Server selection for load balancing based on parameters of servers, e.g. available memory or workload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
    • H04L67/63Routing a service request depending on the request content or context

Abstract

The invention discloses a kind of CDN server data managing method, equipment and computer readable storage mediums, this method comprises: detection is stored with identical data with the presence or absence of at least two CDN servers in several CDN servers in same CDN server set;At least two CDN servers are stored with identical data if it exists, then a maximum CDN server of residual memory space is determined from least two CDN servers;The identical data is deleted from other CDN servers at least two CDN servers in addition to the maximum CDN server of the residual memory space.Through the invention, under the premise of not influencing normally to provide CDN service, the link storage pressure of CDN server ensure that the efficiency of CDN server, and then ensure that the performance of CDN system.

Description

CDN server data managing method, equipment and computer readable storage medium
Technical field
The present invention relates to technical field of data administration more particularly to CDN server data managing methods, equipment and computer Readable storage medium storing program for executing.
Background technique
CDN (Content Delivery Network, content distributing network) is one kind by placing section everywhere in network One on the existing Internet basic layer intelligent virtual network that point server is constituted.CDN can be in real time according to net The connection of network flow and each node, load state and to the integrated informations such as the distance of user and response time by the request of user It re-directs on the service node nearest from user, the purpose is to the node from user's relative close can be selected to send to user Content needed for user alleviates the situation of network congestion, improves the response speed of website.
I.e. on each CDN node server, need to store mass data, and the memory space of CDN node server is It is limited, if storage data quantity is excessive, the efficiency of CDN server will be reduced, and then affect the performance of CDN system.
Summary of the invention
The main purpose of the present invention is to provide a kind of CDN server data managing method, equipment and computer-readable deposit Storage media, it is intended to solve to reduce the efficiency of CDN server, and then influence CDN system in the prior art since storage data quantity is excessive The technical issues of performance of system.
To achieve the above object, the present invention provides a kind of CDN server data managing method, the CDN server data Management method the following steps are included:
Detection whether there is at least two CDN servers in several CDN servers in same CDN server set It is stored with identical data;
At least two CDN servers are stored with identical data if it exists, then determine from least two CDN servers One maximum CDN server of residual memory space;
By the identical data except the maximum CDN clothes of the residual memory space from least two CDN servers It is deleted in other CDN servers except business device.
Optionally, whether there is at least in several CDN servers in same CDN server set in the detection Before the step of two CDN servers are stored with identical data, further includes:
Detection whether there is an at least CDN server in several CDN servers in same CDN server set Residual memory space be less than preset threshold;
The residual memory space of at least one CDN server is less than preset threshold if it exists, then executes the detection and be in Identical data is stored with the presence or absence of at least two CDN servers in several CDN servers in same CDN server set Step.
Optionally, whether there is at least in several CDN servers in same CDN server set in the detection After the step of two CDN servers are stored with identical data, further includes:
At least two CDN servers are stored with identical data if it does not exist, then are calculated by lru algorithm and generate deletion column Table;
Delete the corresponding file of the delete list stored in several CDN servers.
Optionally, described at least two CDN servers are stored with identical data if it exists, then from least two CDN It is determined in server and includes: the step of a residual memory space maximum CDN server
At least two CDN servers are stored with identical data if it exists, then obtain at least two CDN servers respectively Residual memory space information;
Based on the respective residual memory space information, a residue is determined from least two CDN servers The maximum CDN server of memory space.
In addition, to achieve the above object, the present invention also provides a kind of CDN server data management apparatus, which is characterized in that The CDN server data management apparatus includes: memory, processor and is stored on the memory and can be in the processing The CDN server data administrator run on device is realized such as when the CDN server data administrator is executed by processor Above the step of CDN server data managing method.
In addition, to achieve the above object, it is described computer-readable the present invention also provides a kind of computer readable storage medium CDN server data administrator is stored on storage medium, when the CDN server data administrator is executed by processor The step of realizing CDN server data managing method as described above.
In the present invention, detection whether there is at least two in several CDN servers in same CDN server set CDN server is stored with identical data;At least two CDN servers are stored with identical data if it exists, then from described at least two A maximum CDN server of residual memory space is determined in platform CDN server;By the identical data from described at least two It is deleted in other CDN servers in CDN server in addition to the maximum CDN server of the residual memory space.Pass through this Invention, under the premise of not influencing normally to provide CDN service, the link storage pressure of CDN server ensure that CDN service The efficiency of device, and then ensure that the performance of CDN system.
Detailed description of the invention
Fig. 1 is that the CDN server data management apparatus structure for the hardware running environment that the embodiment of the present invention is related to is shown It is intended to;
Fig. 2 is the flow diagram of CDN server data managing method first embodiment of the present invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
As shown in FIG. 1, FIG. 1 is the CDN server data managements for the hardware running environment that the embodiment of the present invention is related to Device structure schematic diagram.
As shown in Figure 1, the CDN server data management apparatus may include: processor 1001, such as CPU, network interface 1004, user interface 1003, memory 1005, communication bus 1002.Wherein, communication bus 1002 for realizing these components it Between connection communication.User interface 1003 may include display screen (Display), input unit such as keyboard (Keyboard), Optional user interface 1003 can also include standard wireline interface and wireless interface.Network interface 1004 optionally may include Standard wireline interface and wireless interface (such as WI-FI interface).Memory 1005 can be high speed RAM memory, be also possible to steady Fixed memory (non-volatile memory), such as magnetic disk storage.Memory 1005 optionally can also be independently of The storage device of aforementioned processor 1001.
It will be understood by those skilled in the art that CDN server data management apparatus structure shown in Fig. 1 is not constituted pair The restriction of CDN server data management apparatus may include components more more or fewer than diagram, or combine certain components, Or different component layout.
As shown in Figure 1, as may include that operating system, network are logical in a kind of memory 1005 of computer storage medium Believe module, Subscriber Interface Module SIM and CDN server data administrator.
In CDN server data management apparatus shown in Fig. 1, network interface 1004 is mainly used for connecting background service Device carries out data communication with background server;User interface 1003 be mainly used for connect client (user terminal), with client into Row data communication;And processor 1001 can be used for calling the CDN server data administrator stored in memory 1005, and Execute following operation:
Detection whether there is at least two CDN servers in several CDN servers in same CDN server set It is stored with identical data;
At least two CDN servers are stored with identical data if it exists, then determine from least two CDN servers One maximum CDN server of residual memory space;
By the identical data except the maximum CDN clothes of the residual memory space from least two CDN servers It is deleted in other CDN servers except business device.
Further, processor 1001 can call the CDN server data administrator stored in memory 1005, also Execute following operation:
Detection whether there is an at least CDN server in several CDN servers in same CDN server set Residual memory space be less than preset threshold;
The residual memory space of at least one CDN server is less than preset threshold if it exists, then executes the detection and be in Identical data is stored with the presence or absence of at least two CDN servers in several CDN servers in same CDN server set Step.
Further, processor 1001 can call the CDN server data administrator stored in memory 1005, also Execute following operation:
At least two CDN servers are stored with identical data if it does not exist, then are calculated by lru algorithm and generate deletion column Table;
Delete the corresponding file of the delete list stored in several CDN servers.
Further, processor 1001 can call the CDN server data administrator stored in memory 1005, also Execute following operation:
At least two CDN servers are stored with identical data if it exists, then obtain at least two CDN servers respectively Residual memory space information;
Based on the respective residual memory space information, a residue is determined from least two CDN servers The maximum CDN server of memory space.
It is the flow diagram of CDN server data managing method first embodiment of the present invention referring to Fig. 2, Fig. 2.
In one embodiment, CDN server data managing method includes:
Step S10, detection whether there is at least two in several CDN servers in same CDN server set CDN server is stored with identical data;
CDN (Content Delivery Network, content distributing network) is to place node server everywhere in network Quantity it is huge enough, be correspondingly arranged on CDN server set, CDN server collection for the Local DNS informations of different clients It include several CDN servers in conjunction.The data of every CDN server are provided by source server.
In the present embodiment, in order to save the memory space of CDN server, need to detect in same CDN server set In several CDN servers in be stored with identical data with the presence or absence of at least two CDN servers.For example, being in same The CDN server of same CDN server set includes: CDN server 1, CDN server 2, CDN server 3, CDN server 4 And CDN server 5, then detect CDN server 1, CDN server 2, CDN server 3, CDN server 4 and CDN server Identical data is stored with the presence or absence of at least two CDN servers in 5.
Step S20, at least two CDN servers are stored with identical data if it exists, then from least two CDN services A maximum CDN server of residual memory space is determined in device;
In the present embodiment, described at least two CDN servers are stored with identical data if it exists, then from described at least two Determine the step of a residual memory space maximum CDN server to include: at least two CDN clothes if it exists in CDN server Business device is stored with identical data, then obtains the respective residual memory space information of at least two CDN servers;Based on described Respective residual memory space information determines a maximum CDN of residual memory space from least two CDN servers Server.
In the present embodiment, at least two CDN servers are stored with identical data, such as CDN server 2, CDN clothes if it exists It is stored with identical data in business device 3 and CDN server 5, then obtains residual memory space information S1, CDN of CDN server 2 The residual memory space information S2 of the server 3 and residual memory space information S3 of CDN server 5.Then compare CDN service Residual memory space information S1, the residual memory space information S2 of CDN server 3 and the residue of CDN server 5 of device 2 are deposited Spatial information S3 is stored up, if S3 is maximum, the maximum CDN server of residual memory space is CDN server 5.
Step S30, by the identical data except the residual memory space is maximum from least two CDN servers CDN server except other CDN servers on delete.
In the present embodiment, if being stored with identical data in CDN server 2, CDN server 3 and CDN server 5, and surplus The remaining maximum CDN server of memory space is CDN server 5, then by identical data from CDN server 2 and CDN server 3 Upper deletion.
In the present embodiment, detection whether there is at least two in several CDN servers in same CDN server set Platform CDN server is stored with identical data;At least two CDN servers are stored with identical data if it exists, then from it is described at least A maximum CDN server of residual memory space is determined in two CDN servers;By the identical data from described at least two It is deleted in other CDN servers in platform CDN server in addition to the maximum CDN server of the residual memory space.Pass through The present embodiment, under the premise of not influencing normally to provide CDN service, the link storage pressure of CDN server ensure that CDN The efficiency of server, and then ensure that the performance of CDN system.
Further, in one embodiment of CDN server data managing method of the present invention, before step S10, further includes:
Detection whether there is an at least CDN server in several CDN servers in same CDN server set Residual memory space be less than preset threshold;
The residual memory space of at least one CDN server is less than preset threshold if it exists, thens follow the steps S10.
In the present embodiment, if there is an at least CDN in several CDN servers in same CDN server set The residual memory space of server is less than preset threshold, then illustrates that the data volume of at least server storage is excessive, Ke Nengying Server performance is rung, needs the server excessive to the data volume of storage to carry out data and deletes, therefore, execute step S10.
Further, in one embodiment of CDN server data managing method of the present invention, after step slo, further includes:
At least two CDN servers are stored with identical data if it does not exist, then are calculated by lru algorithm and generate deletion column Table;
Delete the corresponding file of the delete list stored in several CDN servers.
In the present embodiment, at least two CDN servers are stored with identical data if it does not exist, then carry out by other means Data are deleted.By analyzing access log, calculated using LRU (Least Recently Used, least recently used) algorithm Which file least referenced, subsequent CDN server generates delete list, to delete the file of least referenced.
In addition, the embodiment of the present invention also proposes a kind of computer readable storage medium, the computer readable storage medium On be stored with CDN server data administrator, realized when the CDN server data administrator is executed by processor as above The step of CDN server data managing method each embodiment.
The specific embodiment of computer readable storage medium of the present invention is each with above-mentioned CDN server data managing method Embodiment is essentially identical, and this will not be repeated here.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row His property includes, so that the process, method, article or the system that include a series of elements not only include those elements, and And further include other elements that are not explicitly listed, or further include for this process, method, article or system institute it is intrinsic Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do There is also other identical elements in the process, method of element, article or system.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art The part contributed out can be embodied in the form of software products, which is stored in one as described above In storage medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal device executes the present invention respectively Method described in a embodiment.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills Art field, is included within the scope of the present invention.

Claims (9)

1. a kind of CDN server data managing method, which is characterized in that the CDN server data managing method includes following Step:
Detection is in several CDN servers in same CDN server set with the presence or absence of at least two CDN server storages There is identical data;
At least two CDN servers are stored with identical data if it exists, then one is determined from least two CDN servers The maximum CDN server of residual memory space;
The identical data is removed into the maximum CDN server of the residual memory space from least two CDN servers Except other CDN servers on delete.
2. CDN server data managing method as described in claim 1, which is characterized in that be in same CDN in the detection In several CDN servers in server set with the presence or absence of at least two CDN servers are stored with identical data the step of it Before, further includes:
Detection is in several CDN servers in the same CDN server set with the presence or absence of the surplus of at least CDN server Remaining memory space is less than preset threshold;
The residual memory space of at least one CDN server is less than preset threshold if it exists, then executes the detection in same The step of identical data is stored in several CDN servers in CDN server set with the presence or absence of at least two CDN servers Suddenly.
3. CDN server data managing method as described in claim 1, which is characterized in that be in same CDN in the detection In several CDN servers in server set with the presence or absence of at least two CDN servers are stored with identical data the step of it Afterwards, further includes:
At least two CDN servers are stored with identical data if it does not exist, then are calculated by lru algorithm and generate delete list;
Delete the corresponding file of the delete list stored in several CDN servers.
4. CDN server data managing method as described in claim 1, which is characterized in that at least two CDN if it exists Server is stored with identical data, then a maximum CDN of residual memory space is determined from least two CDN servers The step of server includes:
At least two CDN servers are stored with identical data if it exists, then it is respective surplus to obtain at least two CDN servers Remaining storage space information;
Based on the respective residual memory space information, a remaining storage is determined from least two CDN servers The maximum CDN server in space.
5. a kind of CDN server data management apparatus, which is characterized in that the CDN server data management apparatus includes: storage Device, processor and it is stored in the CDN server data administrator that can be run on the memory and on the processor, institute It states when CDN server data administrator is executed by the processor and realizes following steps:
Detection is in several CDN servers in same CDN server set with the presence or absence of at least two CDN server storages There is identical data;
At least two CDN servers are stored with identical data if it exists, then one is determined from least two CDN servers The maximum CDN server of residual memory space;
The identical data is removed into the maximum CDN server of the residual memory space from least two CDN servers Except other CDN servers on delete.
6. CDN server data management apparatus as claimed in claim 5, which is characterized in that the CDN server data management Program also realizes following steps when being executed by the processor:
Detection is in several CDN servers in the same CDN server set with the presence or absence of the surplus of at least CDN server Remaining memory space is less than preset threshold;
The residual memory space of at least one CDN server is less than preset threshold if it exists, then executes the detection in same The step of identical data is stored in several CDN servers in CDN server set with the presence or absence of at least two CDN servers Suddenly.
7. CDN server data management apparatus as claimed in claim 5, which is characterized in that the CDN server data management Program also realizes following steps when being executed by the processor:
At least two CDN servers are stored with identical data if it does not exist, then are calculated by lru algorithm and generate delete list;
Delete the corresponding file of the delete list stored in several CDN servers.
8. CDN server data management apparatus as claimed in claim 5, which is characterized in that the CDN server data management Program also realizes following steps when being executed by the processor:
At least two CDN servers are stored with identical data if it exists, then it is respective surplus to obtain at least two CDN servers Remaining storage space information;
Based on the respective residual memory space information, a remaining storage is determined from least two CDN servers The maximum CDN server in space.
9. a kind of computer readable storage medium, which is characterized in that be stored with CDN service on the computer readable storage medium Device data administrator is realized when the CDN server data administrator is executed by processor as appointed in Claims 1-4 The step of CDN server data managing method described in one.
CN201910482686.5A 2019-06-04 2019-06-04 CDN server data managing method, equipment and computer readable storage medium Pending CN110191187A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910482686.5A CN110191187A (en) 2019-06-04 2019-06-04 CDN server data managing method, equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910482686.5A CN110191187A (en) 2019-06-04 2019-06-04 CDN server data managing method, equipment and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN110191187A true CN110191187A (en) 2019-08-30

Family

ID=67720312

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910482686.5A Pending CN110191187A (en) 2019-06-04 2019-06-04 CDN server data managing method, equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN110191187A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103747276A (en) * 2013-12-24 2014-04-23 乐视网信息技术(北京)股份有限公司 CDN data deletion method and CDN server
CN103873506A (en) * 2012-12-12 2014-06-18 鸿富锦精密工业(深圳)有限公司 Data block duplication removing system in storage cluster and method thereof
CN105487818A (en) * 2015-11-27 2016-04-13 清华大学 Efficient duplicate removal method for repeated redundant data in cloud storage system
CN105824881A (en) * 2016-03-10 2016-08-03 中国人民解放军国防科学技术大学 Repeating data and deleted data placement method and device based on load balancing
CN105824720A (en) * 2016-03-10 2016-08-03 中国人民解放军国防科学技术大学 Continuous data reading oriented data placement method of deduplication and erasure correcting combined system
CN106066896A (en) * 2016-07-15 2016-11-02 中国人民解放军理工大学 A kind of big Data duplication applying perception deletes storage system and method
CN108089816A (en) * 2017-11-14 2018-05-29 西北工业大学 A kind of query formulation data de-duplication method and device based on load balancing
CN108563649A (en) * 2017-12-12 2018-09-21 南京富士通南大软件技术有限公司 Offline De-weight method based on GlusterFS distributed file systems

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103873506A (en) * 2012-12-12 2014-06-18 鸿富锦精密工业(深圳)有限公司 Data block duplication removing system in storage cluster and method thereof
CN103747276A (en) * 2013-12-24 2014-04-23 乐视网信息技术(北京)股份有限公司 CDN data deletion method and CDN server
CN105487818A (en) * 2015-11-27 2016-04-13 清华大学 Efficient duplicate removal method for repeated redundant data in cloud storage system
CN105824881A (en) * 2016-03-10 2016-08-03 中国人民解放军国防科学技术大学 Repeating data and deleted data placement method and device based on load balancing
CN105824720A (en) * 2016-03-10 2016-08-03 中国人民解放军国防科学技术大学 Continuous data reading oriented data placement method of deduplication and erasure correcting combined system
CN106066896A (en) * 2016-07-15 2016-11-02 中国人民解放军理工大学 A kind of big Data duplication applying perception deletes storage system and method
CN108089816A (en) * 2017-11-14 2018-05-29 西北工业大学 A kind of query formulation data de-duplication method and device based on load balancing
CN108563649A (en) * 2017-12-12 2018-09-21 南京富士通南大软件技术有限公司 Offline De-weight method based on GlusterFS distributed file systems

Similar Documents

Publication Publication Date Title
CN106899680B (en) The fragment treating method and apparatus of multi-tiling chain
CN108052675B (en) Log management method, system and computer readable storage medium
CN107395659A (en) A kind of method and device of service handling and common recognition
CN101557427A (en) Method for providing diffluent information and realizing the diffluence of clients, system and server thereof
CN107357896A (en) Expansion method, device, system and the data base cluster system of data-base cluster
CN106230971B (en) Big document distribution method based on CDN
CN109981702B (en) File storage method and system
CN106294352A (en) A kind of document handling method, device and file system
CN113010818A (en) Access current limiting method and device, electronic equipment and storage medium
CN105868333A (en) File processing method and device
CN109359263B (en) User behavior feature extraction method and system
US10873552B2 (en) Large data management in communication applications through multiple mailboxes
US11868310B2 (en) Composite storage of objects in multi-tenant devices
CN108471385B (en) Flow control method and device for distributed system
CN107613040A (en) A kind of method and apparatus of domain name system DNS server lookup
CN106856438A (en) A kind of method of Network instantiation, device and NFV systems
CN108200132A (en) Resource acquiring method, device, equipment and computer readable storage medium
EP3049940A1 (en) Data caching policy in multiple tenant enterprise resource planning system
CN104008096B (en) A kind of application operating method and apparatus based on browser
CN109361778A (en) A kind of method and terminal managing session
CN114257550A (en) Automatic control method and device for interface access flow, storage medium and server
CN109245915A (en) A kind of method and system for realizing server set equilibrium allotment
CN109582439A (en) DCN dispositions method, device, equipment and computer readable storage medium
CN107911443A (en) A kind of session information processing method, device, server and readable storage medium storing program for executing
CN103416027A (en) Cache optimization method, cache and cache optimization system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190830

RJ01 Rejection of invention patent application after publication