CN112653727A - Network data load management method based on CDN technology - Google Patents

Network data load management method based on CDN technology Download PDF

Info

Publication number
CN112653727A
CN112653727A CN202011419517.6A CN202011419517A CN112653727A CN 112653727 A CN112653727 A CN 112653727A CN 202011419517 A CN202011419517 A CN 202011419517A CN 112653727 A CN112653727 A CN 112653727A
Authority
CN
China
Prior art keywords
network data
information
real
servers
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011419517.6A
Other languages
Chinese (zh)
Inventor
李锦基
黄永权
王勋
田华雨
陈莹铧
骆新坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gold Sea Comm Corp
Original Assignee
Gold Sea Comm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gold Sea Comm Corp filed Critical Gold Sea Comm Corp
Priority to CN202011419517.6A priority Critical patent/CN112653727A/en
Publication of CN112653727A publication Critical patent/CN112653727A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines

Abstract

The invention relates to the technical field of CDN (content delivery network), in particular to a network data load management method based on CDN technology, which comprises the following steps: generating a real-time database: the network data load adjusting module receives Domain Name Service (DNS) requests and corresponding identifications sent by the servers, determines CDN nodes of the servers and Internet Protocol (IP) addresses of the CDN nodes of the servers according to preset rules and the DNS requests, and generates corresponding real-time databases according to storage contents of the servers, the corresponding CDN nodes and the corresponding Internet Protocol (IP) addresses; the small-sized side servers are arranged at the positions close to the users, the distance between the small-sized side servers and the users is shortened, network contents are enabled to be distributed most efficiently with the smallest load, network congestion is relieved, the overall performance of internet access is improved, screening is carried out through the intermediate real-time database during access, the access is more accurate, and invalid access is avoided.

Description

Network data load management method based on CDN technology
Technical Field
The invention relates to the technical field of CDN, in particular to a network data load management method based on CDN technology.
Background
The CDN technology can realize real-time connection with each node according to network flow through a layer of intelligent virtual network on the basis of the existing Internet, which is formed by placing node servers at each position of the network, but the existing network data load management method excessively emphasizes load uniformity indexes, neglects effective utilization of lines, causes overlong reflection of user request information and even causes request failure, and provides a network data load management method based on the CDN technology to solve the problem.
SUMMARY OF THE PATENT FOR INVENTION
The invention aims to provide a network data load management method based on a CDN technology, which solves the problems that the current network data load management method excessively emphasizes load uniformity indexes, neglects effective utilization of lines, causes overlong reflection of user request information and even causes request failure.
In order to achieve the purpose, the invention provides the following technical scheme: a network data load management method based on CDN technology comprises the following steps:
step 1: generating a real-time database: the network data load adjusting module receives Domain Name Service (DNS) requests and corresponding identifications sent by the servers, determines CDN nodes of the servers and Internet Protocol (IP) addresses of the CDN nodes of the servers according to preset rules and the DNS requests, and generates corresponding real-time databases according to storage contents of the servers, the corresponding CDN nodes and the corresponding Internet Protocol (IP) addresses;
step 2: data transmission: the network data are sent to an information receiving and sending module, the information receiving and sending module receives the network data and then sends the network data to a real-time database, the network data received by the real-time database need to be searched by a data searching module, so that corresponding information of a server corresponding to the network data is determined, and then the real-time database transmits the information to the corresponding server;
and step 3: and (3) retrieval: after the server receives the corresponding information, the request retrieval module firstly responds, and judges whether the received information meets the load capacity of the corresponding server; if yes, transmitting the information to a load decomposition module;
and 4, step 4: redistribution: and after receiving the corresponding information, the load decomposition module decomposes the information and then transmits the decomposed information data to the redistribution module for redistribution.
Preferably, in step 1, the real-time database includes a title profile library of contents of each server, and generates an IP address and a link corresponding to the corresponding server.
Preferably, in step 1, the real-time databases are respectively stored in a plurality of mini servers and are arranged at a plurality of positions.
Preferably, in step 2, a transmission route is automatically generated according to the network data position by adopting a proximity principle during network data transmission.
Preferably, in step 2, the network data load adjusting module adjusts paths of network transmission to balance network data on each path.
Preferably, in step 3, if the information is not satisfied, the information is transmitted to the continuous searching module to perform searching for a plurality of times, and then the information is transmitted to the load decomposition module.
Preferably, in step 3, the request retrieval module, the load decomposition module and the continuous retrieval module form a network data scheduling unit, and the network data scheduling unit is connected to the network data load adjustment module.
Preferably, in step 4, the network data scheduling unit sends the processing result of the network data to the real-time database, and the real-time database sends the processing result to the target user.
Compared with the prior art, the invention has the following beneficial effects:
the invention sets a plurality of small-sized side servers at the position close to the user, shortens the distance between the small-sized side servers and the user, ensures that the network content is distributed most efficiently with the minimum load, ensures that the user can obtain information nearby, relieves network congestion, improves the overall performance of internet access, and screens through the intermediate real-time database during access to ensure that the access is more accurate and avoid invalid access.
Drawings
FIG. 1 is a flow chart of the inventive patent architecture;
FIG. 2 is a schematic diagram illustrating the operation of the present invention;
fig. 3 is a flow chart of patent information distribution according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments in the patent of the invention without any inventive work belong to the protection scope of the patent of the invention.
Referring to fig. 1-3, the present invention provides a technical solution: a network data load management method based on CDN technology comprises the following steps:
step 1: generating a real-time database: the network data load adjusting module receives Domain Name Service (DNS) requests and corresponding identifications sent by the servers, determines CDN nodes of the servers and Internet Protocol (IP) addresses of the CDN nodes of the servers according to preset rules and the DNS requests, and generates corresponding real-time databases according to storage contents of the servers, the corresponding CDN nodes and the corresponding Internet Protocol (IP) addresses;
step 2: data transmission: the network data are sent to an information receiving and sending module, the information receiving and sending module receives the network data and then sends the network data to a real-time database, the network data received by the real-time database need to be searched by a data searching module, so that corresponding information of a server corresponding to the network data is determined, and then the real-time database transmits the information to the corresponding server;
and step 3: and (3) retrieval: after the server receives the corresponding information, the request retrieval module firstly responds, and judges whether the received information meets the load capacity of the corresponding server; if yes, transmitting the information to a load decomposition module;
and 4, step 4: redistribution: and after receiving the corresponding information, the load decomposition module decomposes the information and then transmits the decomposed information data to the redistribution module for redistribution.
The first embodiment is as follows:
generating a real-time database: the network data load adjusting module receives Domain Name Service (DNS) requests and corresponding identifications sent by the servers, determines CDN nodes of the servers and Internet Protocol (IP) addresses of the CDN nodes of the servers according to preset rules and the DNS requests, and generates corresponding real-time databases according to storage contents of the servers, the corresponding CDN nodes and the corresponding Internet Protocol (IP) addresses; data transmission: the network data are sent to an information receiving and sending module, the information receiving and sending module receives the network data and then sends the network data to a real-time database, the network data received by the real-time database need to be searched by a data searching module, so that corresponding information of a server corresponding to the network data is determined, and then the real-time database transmits the information to the corresponding server; and (3) retrieval: after the server receives the corresponding information, the request retrieval module firstly responds, and judges whether the received information meets the load capacity of the corresponding server; if yes, transmitting the information to a load decomposition module; redistribution: and after receiving the corresponding information, the load decomposition module decomposes the information and then transmits the decomposed information data to the redistribution module for redistribution.
Example two:
in the first embodiment, the following steps are added:
in step 1, the real-time database contains a title profile library of each server content, and generates an IP address and a link corresponding to the corresponding server, and the real-time database is stored in a plurality of mini servers respectively and is arranged at a plurality of positions, thereby facilitating information transmission.
Generating a real-time database: the network data load adjusting module receives Domain Name Service (DNS) requests and corresponding identifications sent by the servers, determines CDN nodes of the servers and Internet Protocol (IP) addresses of the CDN nodes of the servers according to preset rules and the DNS requests, and generates corresponding real-time databases according to storage contents of the servers, the corresponding CDN nodes and the corresponding Internet Protocol (IP) addresses; data transmission: the network data are sent to an information receiving and sending module, the information receiving and sending module receives the network data and then sends the network data to a real-time database, the network data received by the real-time database need to be searched by a data searching module, so that corresponding information of a server corresponding to the network data is determined, and then the real-time database transmits the information to the corresponding server; and (3) retrieval: after the server receives the corresponding information, the request retrieval module firstly responds, and judges whether the received information meets the load capacity of the corresponding server; if yes, transmitting the information to a load decomposition module; redistribution: and after receiving the corresponding information, the load decomposition module decomposes the information and then transmits the decomposed information data to the redistribution module for redistribution.
Example three:
in the second embodiment, the following steps are added:
in step 2, a principle of proximity is adopted during network data transmission, a transmission route is automatically generated according to the position of the network data, and the network data load adjusting module adjusts the network transmission route, so that the network data on each route are balanced, and the information transmission efficiency is improved.
Generating a real-time database: the network data load adjusting module receives Domain Name Service (DNS) requests and corresponding identifications sent by the servers, determines CDN nodes of the servers and Internet Protocol (IP) addresses of the CDN nodes of the servers according to preset rules and the DNS requests, and generates corresponding real-time databases according to storage contents of the servers, the corresponding CDN nodes and the corresponding Internet Protocol (IP) addresses; data transmission: the network data are sent to an information receiving and sending module, the information receiving and sending module receives the network data and then sends the network data to a real-time database, the network data received by the real-time database need to be searched by a data searching module, so that corresponding information of a server corresponding to the network data is determined, and then the real-time database transmits the information to the corresponding server; and (3) retrieval: after the server receives the corresponding information, the request retrieval module firstly responds, and judges whether the received information meets the load capacity of the corresponding server; if yes, transmitting the information to a load decomposition module; redistribution: and after receiving the corresponding information, the load decomposition module decomposes the information and then transmits the decomposed information data to the redistribution module for redistribution.
Example four:
in the third embodiment, the following steps are added:
in step 3, if the information is not satisfied, the information is transmitted to the continuous retrieval module for retrieval for multiple times, then the information is transmitted to the load decomposition module, the request retrieval module, the load decomposition module and the continuous retrieval module form a network data scheduling unit, and the network data scheduling unit is connected with the network data load regulation module to enable the network data to be distributed into corresponding servers.
Generating a real-time database: the network data load adjusting module receives Domain Name Service (DNS) requests and corresponding identifications sent by the servers, determines CDN nodes of the servers and Internet Protocol (IP) addresses of the CDN nodes of the servers according to preset rules and the DNS requests, and generates corresponding real-time databases according to storage contents of the servers, the corresponding CDN nodes and the corresponding Internet Protocol (IP) addresses; data transmission: the network data are sent to an information receiving and sending module, the information receiving and sending module receives the network data and then sends the network data to a real-time database, the network data received by the real-time database need to be searched by a data searching module, so that corresponding information of a server corresponding to the network data is determined, and then the real-time database transmits the information to the corresponding server; and (3) retrieval: after the server receives the corresponding information, the request retrieval module firstly responds, and judges whether the received information meets the load capacity of the corresponding server; if yes, transmitting the information to a load decomposition module; redistribution: and after receiving the corresponding information, the load decomposition module decomposes the information and then transmits the decomposed information data to the redistribution module for redistribution.
Example five:
in the fourth example, the following steps were added:
in step 4, the network data scheduling unit sends the processing result of the network data to the real-time database, and the real-time database sends the processing result to the target user, so that information feedback is facilitated.
Generating a real-time database: the network data load adjusting module receives Domain Name Service (DNS) requests and corresponding identifications sent by the servers, determines CDN nodes of the servers and Internet Protocol (IP) addresses of the CDN nodes of the servers according to preset rules and the DNS requests, and generates corresponding real-time databases according to storage contents of the servers, the corresponding CDN nodes and the corresponding Internet Protocol (IP) addresses; data transmission: the network data are sent to an information receiving and sending module, the information receiving and sending module receives the network data and then sends the network data to a real-time database, the network data received by the real-time database need to be searched by a data searching module, so that corresponding information of a server corresponding to the network data is determined, and then the real-time database transmits the information to the corresponding server; and (3) retrieval: after the server receives the corresponding information, the request retrieval module firstly responds, and judges whether the received information meets the load capacity of the corresponding server; if yes, transmitting the information to a load decomposition module; redistribution: and after receiving the corresponding information, the load decomposition module decomposes the information and then transmits the decomposed information data to the redistribution module for redistribution.
Although embodiments of the present patent have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the present patent, the scope of which is defined in the appended claims and their equivalents.

Claims (8)

1. A network data load management method based on CDN technology is characterized in that: the method comprises the following steps:
step 1: generating a real-time database: the network data load adjusting module receives Domain Name Service (DNS) requests and corresponding identifications sent by the servers, determines CDN nodes of the servers and Internet Protocol (IP) addresses of the CDN nodes of the servers according to preset rules and the DNS requests, and generates corresponding real-time databases according to storage contents of the servers, the corresponding CDN nodes and the corresponding Internet Protocol (IP) addresses;
step 2: data transmission: the network data are sent to an information receiving and sending module, the information receiving and sending module receives the network data and then sends the network data to a real-time database, the network data received by the real-time database need to be searched by a data searching module, so that corresponding information of a server corresponding to the network data is determined, and then the real-time database transmits the information to the corresponding server;
and step 3: and (3) retrieval: after the server receives the corresponding information, the request retrieval module firstly responds, and judges whether the received information meets the load capacity of the corresponding server; if yes, transmitting the information to a load decomposition module;
and 4, step 4: redistribution: and after receiving the corresponding information, the load decomposition module decomposes the information and then transmits the decomposed information data to the redistribution module for redistribution.
2. The network data load management method based on the CDN technique as recited in claim 1, wherein: in step 1, the real-time database includes a title profile library of contents of each server, and generates an IP address and a link corresponding to the corresponding server.
3. The network data load management method based on the CDN technique as recited in claim 1, wherein: in step 1, the real-time databases are stored in a plurality of mini servers respectively and are arranged at a plurality of positions.
4. The network data load management method based on the CDN technique as recited in claim 1, wherein: and in the step 2, a transmission route is automatically generated according to the position of the network data by adopting a principle of proximity during the transmission of the network data.
5. The network data load management method based on the CDN technique as recited in claim 1, wherein: in step 2, the network data load adjusting module adjusts the paths of network transmission to balance the network data on each path.
6. The network data load management method based on the CDN technique as recited in claim 1, wherein: and in the step 3, if the information is not satisfied, transmitting the information to a continuous retrieval module for multiple times of retrieval, and then transmitting the information to a load decomposition module.
7. The network data load management method based on the CDN technique as recited in claim 1, wherein: in the step 3, the request retrieval module, the load decomposition module and the continuous retrieval module form a network data scheduling unit, and the network data scheduling unit is connected with the network data load regulation module.
8. The CDN-technology-based network data load management method of claim 7, wherein: in step 4, the network data scheduling unit sends the processing result of the network data to the real-time database, and the real-time database sends the processing result to the target user.
CN202011419517.6A 2020-12-07 2020-12-07 Network data load management method based on CDN technology Pending CN112653727A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011419517.6A CN112653727A (en) 2020-12-07 2020-12-07 Network data load management method based on CDN technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011419517.6A CN112653727A (en) 2020-12-07 2020-12-07 Network data load management method based on CDN technology

Publications (1)

Publication Number Publication Date
CN112653727A true CN112653727A (en) 2021-04-13

Family

ID=75350323

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011419517.6A Pending CN112653727A (en) 2020-12-07 2020-12-07 Network data load management method based on CDN technology

Country Status (1)

Country Link
CN (1) CN112653727A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023087820A1 (en) * 2021-11-18 2023-05-25 中兴通讯股份有限公司 Load balancing method and device, and computer-readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102546774A (en) * 2011-12-27 2012-07-04 厦门市美亚柏科信息股份有限公司 CDN (content distribution network) routing method for secondary redirection and system
CN103297472A (en) * 2012-03-01 2013-09-11 上海盛霄云计算技术有限公司 Redirection method and content distribution node applied to content distribution network
CN105847353A (en) * 2016-03-22 2016-08-10 中国科学院信息工程研究所 Mobile CDN (content delivery network) content scheduling method and system for mobile communication network
CN109981477A (en) * 2019-03-07 2019-07-05 北京华安普特网络科技有限公司 A kind of network data load management system based on CDN technology

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102546774A (en) * 2011-12-27 2012-07-04 厦门市美亚柏科信息股份有限公司 CDN (content distribution network) routing method for secondary redirection and system
CN103297472A (en) * 2012-03-01 2013-09-11 上海盛霄云计算技术有限公司 Redirection method and content distribution node applied to content distribution network
CN105847353A (en) * 2016-03-22 2016-08-10 中国科学院信息工程研究所 Mobile CDN (content delivery network) content scheduling method and system for mobile communication network
CN109981477A (en) * 2019-03-07 2019-07-05 北京华安普特网络科技有限公司 A kind of network data load management system based on CDN technology

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023087820A1 (en) * 2021-11-18 2023-05-25 中兴通讯股份有限公司 Load balancing method and device, and computer-readable storage medium

Similar Documents

Publication Publication Date Title
JP5745169B2 (en) Content processing method, content processing device, and content processing system
Tang et al. QoS-aware replica placement for content distribution
US8139483B2 (en) Network traffic control in peer-to-peer environments
US8861527B1 (en) Network-assisted routing for topology-aware overlay networks
US8665757B2 (en) Method and node for finding content in a content distribution network, and method for creating a virtual representation of a content distribution network
CN101014045B (en) Distributed method of service management in service loading network
CN105162900B (en) A kind of domain name mapping of multi-node collaboration and caching method and system
US20040249939A1 (en) Methods and apparatus for dynamic and optimal server set selection
CN103329487A (en) Method and router for service named routing
CN104022911A (en) Content route managing method of fusion type content distribution network
US20130166680A1 (en) Method, apparatus, and network system for acquiring content
JP7202558B1 (en) DIGITAL OBJECT ACCESS METHOD AND SYSTEM IN HUMAN-CYBER-PHYSICAL COMBINED ENVIRONMENT
Westcott et al. Hierarchical routing for very large networks
CN112653727A (en) Network data load management method based on CDN technology
Yang et al. A reinforcement learning based data storage and traffic management in information-centric data center networks
CN1852145A (en) System and method for identifying authority using relative inquire
EP2385656B1 (en) Method and system for controlling data communication within a network
CN112052198A (en) Hash route cooperative caching method based on node betweenness popularity under energy consumption monitoring platform
Ayyasamy et al. A qos-aware intelligent replica management architecture for content distribution in peer-to-peer overlay networks
KR20040001355A (en) Network constructing method for multimedia contents distribution and multimedia contents service method using it
Sarkar et al. Population-based clustering to enhance the utilization of surrogate in Content Delivery Networks
Anandaraj et al. An efficient QOS based multimedia content distribution mechanism in P2P network
WO2023115592A1 (en) Back-to-source method and apparatus of cdn node server
Kaiser et al. Self-organized autonomous Web proxies
Meng et al. Elastic caching solutions for content dissemination services elastic caching solutions for content dissemination services of ip-based internet technologies prospective

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210413