CN113259151B - Domain name bandwidth detail monitoring method and system in CDN (content delivery network) for converged content delivery - Google Patents
Domain name bandwidth detail monitoring method and system in CDN (content delivery network) for converged content delivery Download PDFInfo
- Publication number
- CN113259151B CN113259151B CN202110395433.1A CN202110395433A CN113259151B CN 113259151 B CN113259151 B CN 113259151B CN 202110395433 A CN202110395433 A CN 202110395433A CN 113259151 B CN113259151 B CN 113259151B
- Authority
- CN
- China
- Prior art keywords
- domain name
- cdn
- bandwidth
- period
- domain
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0896—Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/45—Network directories; Name-to-address mapping
- H04L61/4505—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
- H04L61/4511—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]
Abstract
The embodiment of the invention provides a method and a system for monitoring domain name bandwidth details in a CDN (content delivery network) fused with content delivery, wherein the method comprises the following steps: periodically extracting domain names meeting preset conditions from all domain names owned by a domain name owner according to a set first period, and forming a first domain name set by the extracted domain names meeting the preset conditions; uniformly ranking the bandwidth of each CDN occupied by each domain name in a second period according to the descending order of the size of the bandwidth of each domain name in the first domain name set, extracting the domain name with the CDN bandwidth ranking before the preset name time, and forming a second domain name set by the domain name with the extracted CDN bandwidth ranking before the preset name time; and periodically acquiring the CDN bandwidth detail occupied by each domain name in the second domain name set by taking the third period as a unit, and displaying the CDN bandwidth detail occupied by each domain name. The number of processed domain names is reduced, and the access amount to a third-party commercial CDN interface is reduced.
Description
Technical Field
The invention relates to the field of converged CDN (content delivery network), in particular to a method and a system for monitoring domain name bandwidth detail in a converged content delivery network CDN.
Background
The converged CDN is realized on the basis of traditional CDN acceleration, monitoring on the service quality of network lines and nodes is added, and optimal, stable and efficient CDN service is provided by matching with a self-developed intelligent scheduling algorithm. At present, manufacturers capable of providing a converged CDN service in the market, such as a seven-cow cloud and a rephoto cloud, basically bring services of a plurality of third-party CDN manufacturers into their resource pools, and flexibly use nodes and bandwidth resources of the manufacturers through their own monitoring and scheduling algorithms when in use. The essential point is that monitoring must be in place, statistical indexes such as accelerated bandwidth/flow, source returning bandwidth/flow, flow hit rate, request number, http error state code detail and the like of the third-party commercial CDN can be timely and accurately obtained through an interface provided by the third-party commercial CDN to measure the bandwidth magnitude, service stability, charging cost, failure processing timeliness and the like of the service provided by the CDN, and finally, whether the performance-price ratio is high or not is judged through multi-party comparison, and whether the selection is worth. Usually, according to the service requirement, it may be necessary to further obtain the same statistical index of different time granularities, mainly for observing the stability of the service in real time.
In the process of implementing the invention, the applicant finds that at least the following problems exist in the prior art: the common implementation manner in the prior art is to obtain various statistical indexes of the CDN for each domain name one by one. If the number of the service domain names is small or the index statistical items are not many, no problem exists; if the service domain names are very many and the index statistics are also many, the response data is very large and is very difficult to process.
Disclosure of Invention
The embodiment of the invention provides a method and a system for monitoring domain bandwidth details in a converged Content Delivery Network (CDN), which reduce the number of processed domain names, reduce the access amount to third-party commercial CDN interfaces and also reduce the workload of the existing data acquisition program.
In order to achieve the above object, in one aspect, an embodiment of the present invention provides a method for monitoring domain bandwidth details in a CDN, where the CDN is composed of multiple CDNs, and the method includes:
periodically extracting domain names meeting preset conditions from all domain names owned by a domain name owner according to a set first period, and forming a first domain name set by the extracted domain names meeting the preset conditions; the domain name meeting the preset condition is as follows: in a first period, at least one CDN bandwidth exceeds a first bandwidth threshold in the bandwidths of the CDNs occupied by the domain name in the fused CDN;
uniformly ranking the bandwidth of each CDN occupied by each domain name in a second period according to the descending order of the size of the bandwidth of each domain name in the first domain name set, extracting the domain name with the CDN bandwidth ranking before the preset name time, and forming a second domain name set by the domain name with the extracted CDN bandwidth ranking before the preset name time; the time length of the second period is less than that of the first period, and the end point of the second period is the same as that of the first period;
periodically acquiring CDN bandwidth details occupied by each domain name in the second domain name set by taking a third period as a unit, and displaying the CDN bandwidth details occupied by each domain name; and the duration of the third period is less than the duration of the first period.
On the other hand, an embodiment of the present invention provides a domain bandwidth detail monitoring system in a CDN, where the CDN is composed of multiple CDNs, and the domain bandwidth detail monitoring system in the CDN includes:
the first detection unit is used for periodically extracting domain names meeting preset conditions from all domain names owned by a domain name owner according to a set first period, and forming a first domain name set by the extracted domain names meeting the preset conditions; the domain name meeting the preset condition is as follows: in a first period, at least one CDN bandwidth exceeds a first bandwidth threshold in the bandwidths of the CDNs occupied by the domain name in the fused CDN;
the comparison and extraction unit is used for uniformly ranking the bandwidth of each CDN occupied by each domain name in a second period according to the descending order of the size of the bandwidth of each domain name in all domain names in the first domain name set, extracting the domain name with the CDN bandwidth ranking before the preset name, and forming a second domain name set by the domain name with the extracted CDN bandwidth ranking before the preset name; the time length of the second period is less than that of the first period, and the end point of the second period is the same as that of the first period;
the second detection unit is used for periodically acquiring CDN bandwidth details occupied by each domain name in the second domain name set by taking a third period as a unit; the duration of the third period is less than the duration of the first period;
and the display unit is used for displaying the CDN bandwidth details occupied by each domain name.
The technical scheme has the following beneficial effects: only the domain name group with the top bandwidth rank is filtered, and only the bandwidth detail is requested for all domain names in the domain name group with the top bandwidth rank, so that the number of the domain names to be processed is greatly reduced, the access amount to a third-party commercial CDN interface is reduced, and the workload of the existing data acquisition program is also reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a method for monitoring domain bandwidth details in a CDN of a converged content delivery network according to an embodiment of the present invention;
fig. 2 is a structural diagram of a domain name bandwidth detail monitoring system in the CDN of the converged content delivery network according to the embodiment of the present invention;
fig. 3 is a schematic diagram of an architecture of a 5-minute bandwidth and a 5-minute provincial operator detail bandwidth in a CDN of a converged content delivery network according to an embodiment of the present invention;
FIG. 4 is a 5 minute bandwidth topN ranking of domain names on various commercial CDNs for an embodiment of the present invention;
FIG. 5 is a 5 minute bandwidth topN ranking of domain names on Aliskive cloud for an embodiment of the present invention;
FIG. 6 is a 5 minute total bandwidth (in bps) for a CDN (Aliskiren cloud) of an embodiment of the present invention;
fig. 7 is a 5 minute operator bandwidth detail (in bps) of the DN in accordance with an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, in combination with the embodiment of the present invention, a method for monitoring details of domain bandwidth in a CDN of a converged content delivery network is provided, where the CDN of the converged content delivery network is composed of multiple CDNs, and the method for monitoring details of domain bandwidth in the CDN of the converged content delivery network includes:
s101: periodically extracting domain names meeting preset conditions from all domain names owned by a domain name owner according to a set first period, and forming a first domain name set by the extracted domain names meeting the preset conditions; the domain name meeting the preset condition is as follows: in a first period, at least one CDN bandwidth exceeds a first bandwidth threshold in the bandwidths of the CDNs occupied by the domain name in the fused CDN;
s102: uniformly ranking the bandwidth of each CDN occupied by each domain name in a second period according to the descending order of the size of the bandwidth of each domain name in the first domain name set, extracting the domain name with the CDN bandwidth ranking before the preset name time, and forming a second domain name set by the domain name with the extracted CDN bandwidth ranking before the preset name time; the time length of the second period is less than that of the first period, and the end point of the second period is the same as that of the first period;
s103: periodically acquiring CDN bandwidth details occupied by each domain name in the second domain name set by taking a third period as a unit, and displaying the CDN bandwidth details occupied by each domain name; and the duration of the third period is less than the duration of the first period.
Preferably, step 101 specifically includes:
s1011: acquiring a latest domain name group for a domain name owner to use the converged CDN to perform service; traversing the latest domain name group, and periodically acquiring the bandwidth of each CDN occupied by each domain name in the latest domain name group according to a second period; the bandwidth of each CDN occupied by each domain name obtained by a plurality of continuous second periods forms the bandwidth of each CDN occupied by each domain name in the fused CDN in the first period; wherein the first period is comprised of the consecutive plurality of second periods;
s1012: extracting each CDN bandwidth peak value of each domain name from all CDN bandwidth in a first period of each domain name, wherein each CDN under any domain name corresponds to one CDN bandwidth peak value; and forming a first domain name set by the domain name of which any CDN bandwidth peak value exceeds a first bandwidth threshold value.
Preferably, the method further comprises the following steps:
s1013: and writing the acquired bandwidth data of each CDN occupied by each domain name in the latest domain name group into a first distributed data table through a distributed queue, wherein the first distributed data table is positioned in a database which is analyzed by real-time data and is based on column storage.
Preferably, the CDN bandwidth detail refers to bandwidth of each network operator used by the CDN;
step 103 specifically comprises:
s1031: periodically acquiring the bandwidth of each network operator of each CDN occupied by the domain name in a third period aiming at any domain name in the second domain name set;
s1032: and writing the bandwidth data of each network operator of each CDN of all domain names into a second distributed data table through a distributed queue, wherein the second distributed data table is positioned in a database which is used for real-time data analysis and is based on column storage.
Preferably, step 104 specifically includes:
summing the CDN bandwidth details occupied by each domain name to obtain the approximate bandwidth of each CDN of each domain name; and automatically generating a curve graph of the approximate bandwidth of each CDN of each domain name, and displaying the automatically generated curve graph.
As shown in fig. 2, in combination with the embodiment of the present invention, a domain bandwidth detail monitoring system in a CDN for converged content delivery is provided, where the CDN for converged content delivery is composed of multiple CDNs, and the domain bandwidth detail monitoring system in the CDN for converged content delivery includes:
the first detection unit 21 is configured to periodically extract domain names meeting preset conditions from domain names owned by a domain name owner according to a set first period, and form a first domain name set with the extracted domain names meeting the preset conditions; the domain name meeting the preset condition is as follows: in a first period, at least one CDN bandwidth exceeds a first bandwidth threshold in the bandwidths of the CDNs occupied by the domain name in the fused CDN;
the comparison extraction unit 22 is configured to perform uniform ranking on bandwidths of the CDNs occupied by the domain names in the second period according to a descending order of size for all domain names in the first domain name set, extract a domain name with a CDN bandwidth ranking before a preset number of names, and form a second domain name set with the extracted domain name with the CDN bandwidth ranking before the preset number of names; the time length of the second period is less than that of the first period, and the end point of the second period is the same as that of the first period;
a second detection unit 23, configured to periodically obtain, by using a third period as a unit, details of CDN bandwidths occupied by domain names in a second domain name set; the duration of the third period is less than the duration of the first period;
and the display unit 24 is configured to display the CDN bandwidth details occupied by each domain name.
Preferably, the first detection unit 21 includes:
a CDN bandwidth obtaining subunit 211, configured to obtain a latest domain name group for a domain name owner to use the converged CDN to perform service; traversing the latest domain name group, and periodically acquiring the bandwidth of each CDN occupied by each domain name in the latest domain name group according to a second period; the bandwidth of each CDN occupied by each domain name obtained by a plurality of continuous second periods forms the bandwidth of each CDN occupied by each domain name in the fused CDN in the first period; wherein the first period is comprised of the consecutive plurality of second periods;
a CDN bandwidth peak extracting subunit 212, configured to extract, for each domain name, each CDN bandwidth peak of the domain name from all CDN bandwidths in a first period of the domain name, where each CDN corresponds to one CDN bandwidth peak under any domain name; and forming a first domain name set by the domain name of which any CDN bandwidth peak value exceeds a first bandwidth threshold value.
Preferably, a column-based stored database 25 of real-time data analysis is also included, wherein:
the CDN bandwidth obtaining subunit 211 is further configured to write, through a distributed queue, bandwidth data of each CDN occupied by each domain name in the obtained latest domain name group into a first distributed data table, where the first distributed data table is located in a database based on column storage for real-time data analysis.
Preferably, the CDN bandwidth detail refers to bandwidth of each network operator used by the CDN;
the second detection unit 23 is specifically configured to:
periodically acquiring the bandwidth of each network operator of each CDN occupied by the domain name in a third period aiming at any domain name in the second domain name set; and writing the bandwidth data of each network operator of each CDN of all domain names into a second distributed data table through a distributed queue, wherein the second distributed data table is positioned in a database which is used for real-time data analysis and is based on column storage.
Preferably, the display unit 24 is specifically configured to:
summing the CDN bandwidth details occupied by each domain name to obtain the approximate bandwidth of each CDN of each domain name; and automatically generating a curve graph of the approximate bandwidth of each CDN of each domain name, and displaying the automatically generated curve graph.
The embodiment of the invention has the following beneficial effects:
according to the method, only the domain name group with the highest bandwidth rank is filtered, the bandwidth details of operators are saved only by aiming at all domain names in the domain name group with the highest bandwidth rank, the number of domain names to be processed is greatly reduced, the access amount to third-party commercial CDN interfaces is reduced, the workload of the existing data acquisition program is also reduced, and the purposes of carrying out careful monitoring on the bandwidths of all third-party commercial fusion CDN in use and carrying out real-time early warning intervention according to the monitoring are achieved.
The above technical solutions of the embodiments of the present invention are described in detail below with reference to specific application examples, and reference may be made to the foregoing related descriptions for technical details that are not described in the implementation process.
The invention discloses a method for monitoring and counting domain name bandwidth details in a CDN (content delivery network) for fusing content, which solves the problem of bandwidth detail counting of the CDN for fusing.
When a domain name owner such as a microblog uses an accelerated service of a plurality of commercial CDNs, a microblog client fault occurs, users in some regions cannot access the microblog, and a fault range needs to be quickly located to find whether a problem arises in the service of a certain CDN in the regions where the microblog cannot be accessed. Therefore, careful monitoring and real-time early warning of the bandwidth of all the third-party commercial converged CDNs in use are required.
The same statistical index with different time granularities is obtained according to the service, for example, the bandwidth of 1 minute is mainly used for observing the service stability problem of the domain name in real time, and the service can be quickly found and cut away when a fault occurs; the bandwidth of 5 minutes is mainly used for data statistics and charging; the detail of the bandwidth of the provincial operators with the granularity of 5 minutes is used for more accurately checking the specific geographic area and the operators with the problems on the line and further reducing the problem searching range. The values of 1 minute and 5 minutes can be changed, and are specifically determined according to compromise of various factors such as technical strength, hardware resources, service timeliness requirements and the like of the third-party commercial CDN to obtain the optimal effect.
For example, the Ariiyun, the Baishan cloud and the Tencent cloud all have domain name acceleration business services. How to efficiently obtain (operator-less) bandwidth details of their converged CDN for numerous domain names with business services?
The bandwidth is a statistical indicator (here, the above acceleration bandwidth is referred to specifically as the "back source bandwidth", and the acceleration bandwidth is referred to as the "bandwidth" here), and is described below with a domain name domestic bandwidth of 5 minutes (variable).
There are currently two types of 5 minute bandwidth: one is a 5-minute total bandwidth, such as the bandwidth of the main domain name f.video.weibo cdn.com of microblog video at time 2020-11-1218: 45:00 on the airy cloud (see fig. 6); another is the bandwidth specification of the 5 minute province operator, such as the bandwidth of f.video.weibo cdn.com at time 2020-11-1218: 45:00 in the Guangdong telecommunications region of Alice cloud (see FIG. 7). The difference between these two bandwidths is, as the name implies, the cumulative sum of the latter, the detail data of the former, and the larger data size of the latter than the former. For example, if the domain name is covered by the Guangdong telecom, Hunan Mobile, Shaanxi Union, etc. in the Aliyun, the detailed bandwidth of the operator in the province of 5 minutes corresponding to the time in the areas can be accumulated, and then the total bandwidth of the domain name in the Aliyun at the time of 5 minutes can be obtained.
The difficulty of counting the bandwidth detail of the operators in the provinces of 5 minutes in China is mainly shown in the following steps:
in order to acquire the most accurate sampling bandwidth data, the latest data of the last 5 minutes is generally acquired every time, the data of the first 30 minutes (the value can be configured) is acquired, a sampling point is acquired according to 5 minutes, namely 6 sampling points, and 5 points are acquired repeatedly;
the purpose of intentionally repeating the sampling points is to make the value of each sampling point have a chance of 6 times of refreshing, if the interface processing of the third party commercial CDN is not timely, the values of the sampling points returned in the first few times may be inaccurate, but the values in the last few times are accurate, and the processing can effectively avoid the situation that the interface data is not timely.
Each time, a 5-minute bandwidth query request for all domain names is sent to an interface service provided by a third-party commercial CDN, which is a great challenge for the interface service, and it must be able to handle massive concurrency, count massive user access logs across the country, summarize in real time, and respond quickly.
Taking the f.video.weibo cdn.com domain name of the airy cloud service as an example, assuming that the airy cloud has services in 3 operators (telecom, mobile, unicom) of 20 provinces in China, if 5 minutes of total bandwidth is calculated, only one calculation is performed, if 5 minutes of detailed bandwidth of the operators is calculated, 20 × 3 is required to be calculated 60 times, and the calculation amount is increased by 60 times! In fact, the data statistics inside the Aliskiu will be much larger than this, and if there are many small operators, it will process more access logs, which results in a significant increase in the computational resources used.
The bandwidth distribution of each domain name is extremely unbalanced and meets the '28 rule'. Some domain names have large bandwidth all the time, some domain names have large bandwidth and sometimes do not have the large bandwidth, the domain names change along with time, no rule exists possibly, some domain names have small bandwidth all the time, but basically, the phenomenon exists at every moment, few part of domain names occupy most of the bandwidth, and most of the domain names have small bandwidth. For these domain names, requests still need to be sent in order to accurately obtain their bandwidth.
Each time a request is sent to an interface, if the response times out, the bandwidth collection program will often resend the request, which will further exacerbate the degradation of the interface service, make the interface service more time out, and even eventually fail to provide the service. The more domain names that collect bandwidth data, the greater this probability.
In order to solve the technical problem more efficiently, the method of the present invention sets a threshold, for example, only considering domain names whose past (first period) bandwidth peak exceeds a first bandwidth threshold (for example, 100Mbps), counts the domain name topN ranking of 5-minute (second period) bandwidth on each commercial CDN, and then requests bandwidth details of national provinces and operators for 5 minutes (third period), and only calculates the domain name of the part, and after the method is verified by operation, the finally obtained domain name (domain name whose first period bandwidth peak exceeds the first bandwidth threshold) counts the total bandwidth and the total bandwidth counted after requesting the bandwidth of 5 minutes of all domain names, which have little difference. FIG. 3 is a schematic diagram of the architecture of the present invention.
The invention has two data acquisition programs, the MonitorV2 program (the first detection unit) is to call the corresponding interface to acquire the 5-minute bandwidth data of all domain names, the data acquisition amount is small, the calculation amount required to be processed by the interface is small, so that the request can be sent to all domain names; the Clairvoyance program (second detection unit) calls another interface to acquire 5-minute operator bandwidth detail data of the topN domain name group, the data acquisition amount of the Claivoyance program is very large, the calculation amount required to be processed by the interface is large, only the key domain name groups can be requested, all domain names cannot be requested, and all domain names do not need to be requested.
The following are the key operating steps of the invention, both the MonitorV2 program and the Clairvoyance program being executed every 5 minutes:
acquiring a domain name group of new waves in business service of each third-party commercial CDNCDN (Ali cloud, Baishan cloud, Huashi cloud, Xinlangyun, Tencent cloud and the like) by a MonitorV2 program and a Clairvoyance program, and if the domain name group changes, acquiring the latest domain name group in time;
traversing the domain name groups by a MonitorV2 program, counting 5-minute bandwidth data of each commercial CDNCDN, and writing the 5-minute bandwidth data into a first distributed data table (CDN _ bandwidth _ all) in ClickHouse through a distributed queue kafka;
the Clairvoyance program queries the ClickHouse table edge. CDN _ Bandwidth _ all for the bandwidth topN ranking of the domain name on each business CDNCDN over the past hour with a uniform threshold of 100Mbps, and only domain names with bandwidth exceeding the threshold are considered to obtain bandwidth details. Note that the threshold and time range (period) may be determined according to the best results obtained by compromising various factors such as the technical strength of the third party commercial CDN, hardware resources, and the timeliness of service requirements, so as to be able to identify domain names with larger traffic in time, and to concentrate statistical data statistics on domain name groups with header traffic because they have a greater influence on the statistical result of the total amount of bandwidth. The corresponding SQL query statement is as follows:
the processing logic of this ClickHouse SQL statement is that, in statistics 2020-11-09, peak bandwidth (in bps) of each domain name on each third-party CDN in a period of 14:40:00-15:40:00, the specific processing details of the data are all implemented internally by ClickHouse, it finds the maximum bandwidth of each domain name in each CDN during this hour, and finally arranges all domain name bandwidths in descending order according to size and displays them according to CDN groups. See, e.g., fig. 4 (bandwidth sorted from top to bottom) for a partial screenshot of the query result.
According to the topN bandwidth ranking, domain names with peak bandwidth exceeding 100Mbps can be filtered from domain names adopting the arilocos service, and the rest of domain names can be discarded, and a part of screenshots is shown in fig. 5.
And 4, calling corresponding interfaces by a Claivoyance program only for the domain names with the bandwidth topN ranking, inquiring about the bandwidth details of the 5-minute province operators of the commercial CDNs, and writing the bandwidth details into a second distributed data table edge, CDN _ prov _ isp _ bandwidth _ all in ClickHouse through Kafka.
5. Reading time sequence data from the two tables of ClickHouse, namely CDN _ bandwidth _ all and edge CDN _ prov _ isp _ bandwidth _ all, counting the sum of 5-minute bandwidth on each household CDN and the sum of 5-minute provincial operator bandwidth details on a Grafana billboard, and comparing the statistical data to find that the data are basically matched.
The beneficial effects obtained by the invention are as follows:
according to the '28 rule', amplification abandon is small, key domain name analysis is grasped, only the domain name group with the highest bandwidth rank is filtered, the bandwidth detail of an operator is requested to be saved only for all domain names in the domain name group with the highest bandwidth rank, the number of domain names to be processed is greatly reduced, the access amount to a third-party commercial CDN interface is reduced, the workload of the existing data acquisition program is also reduced, and the purpose of carrying out careful monitoring and real-time early warning intervention according to monitoring on the bandwidth of all third-party commercial fusion CDN in use is realized.
It should be understood that the specific order or hierarchy of steps in the processes disclosed is an example of exemplary approaches. Based upon design preferences, it is understood that the specific order or hierarchy of steps in the processes may be rearranged without departing from the scope of the present disclosure. The accompanying method claims present elements of the various steps in a sample order, and are not intended to be limited to the specific order or hierarchy presented.
In the foregoing detailed description, various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments of the subject matter require more features than are expressly recited in each claim. Rather, as the following claims reflect, invention lies in less than all features of a single disclosed embodiment. Thus, the following claims are hereby expressly incorporated into the detailed description, with each claim standing on its own as a separate preferred embodiment of the invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. To those skilled in the art; various modifications to these embodiments will be readily apparent, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
What has been described above includes examples of one or more embodiments. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the aforementioned embodiments, but one of ordinary skill in the art may recognize that many further combinations and permutations of various embodiments are possible. Accordingly, the embodiments described herein are intended to embrace all such alterations, modifications and variations that fall within the scope of the appended claims. Furthermore, to the extent that the term "includes" is used in either the detailed description or the claims, such term is intended to be inclusive in a manner similar to the term "comprising" as "comprising" is interpreted when employed as a transitional word in a claim. Furthermore, any use of the term "or" in the specification of the claims is intended to mean a "non-exclusive or".
Those of skill in the art will further appreciate that the various illustrative logical blocks, units, and steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate the interchangeability of hardware and software, various illustrative components, elements, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design requirements of the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.
The various illustrative logical blocks, or elements, described in connection with the embodiments disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor, an Application Specific Integrated Circuit (ASIC), a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other similar configuration.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. For example, a storage medium may be coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC, which may be located in a user terminal. In the alternative, the processor and the storage medium may reside in different components in a user terminal.
In one or more exemplary designs, the functions described above in connection with the embodiments of the invention may be implemented in hardware, software, firmware, or any combination of the three. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media that facilitate transfer of a computer program from one place to another. Storage media may be any available media that can be accessed by a general purpose or special purpose computer. For example, such computer-readable media can include, but is not limited to, RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store program code in the form of instructions or data structures and which can be read by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Additionally, any connection is properly termed a computer-readable medium, and, thus, is included if the software is transmitted from a website, server, or other remote source via a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wirelessly, e.g., infrared, radio, and microwave. Such discs (disk) and disks (disc) include compact disks, laser disks, optical disks, DVDs, floppy disks and blu-ray disks where disks usually reproduce data magnetically, while disks usually reproduce data optically with lasers. Combinations of the above may also be included in the computer-readable medium.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (10)
1. A method for monitoring domain name bandwidth details in a CDN (content delivery network) for converged content delivery is characterized in that the CDN for converged content delivery consists of a plurality of CDNs and comprises the following steps:
periodically extracting domain names meeting preset conditions from all domain names owned by a domain name owner according to a set first period, and forming a first domain name set by the extracted domain names meeting the preset conditions; the domain name meeting the preset condition is as follows: in a first period, at least one CDN bandwidth exceeds a first bandwidth threshold in the bandwidths of the CDNs occupied by the domain name in the fused CDN;
uniformly ranking the bandwidth of each CDN occupied by each domain name in a second period according to the descending order of the size of the bandwidth of each domain name in the first domain name set, extracting the domain name with the CDN bandwidth ranking before the preset name time, and forming a second domain name set by the domain name with the extracted CDN bandwidth ranking before the preset name time; the time length of the second period is less than that of the first period, and the end point of the second period is the same as that of the first period;
periodically acquiring CDN bandwidth details occupied by each domain name in the second domain name set by taking a third period as a unit, and displaying the CDN bandwidth details occupied by each domain name; and the duration of the third period is less than the duration of the first period.
2. The method for detail monitoring of domain name bandwidth in a CDN of converged content delivery network according to claim 1, wherein the extracting domain names satisfying preset conditions from the domain names owned by the domain name owners periodically according to a first period, and forming the extracted domain names satisfying the preset conditions into a first domain name set specifically includes:
acquiring a latest domain name group for a domain name owner to use the converged CDN to perform service; traversing the latest domain name group, and periodically acquiring the bandwidth of each CDN occupied by each domain name in the latest domain name group according to a second period; the bandwidth of each CDN occupied by each domain name obtained by a plurality of continuous second periods forms the bandwidth of each CDN occupied by each domain name in the fused CDN in the first period; wherein the first period is comprised of the consecutive plurality of second periods;
extracting each CDN bandwidth peak value of each domain name from all CDN bandwidth in a first period of each domain name, wherein each CDN under any domain name corresponds to one CDN bandwidth peak value; and forming a first domain name set by the domain name of which any CDN bandwidth peak value exceeds a first bandwidth threshold value.
3. The method for monitoring details of domain name bandwidth in a CDN as recited in claim 2, further comprising:
and writing the acquired bandwidth data of each CDN occupied by each domain name in the latest domain name group into a first distributed data table through a distributed queue, wherein the first distributed data table is positioned in a database which is analyzed by real-time data and is based on column storage.
4. The method for monitoring domain name bandwidth detail in a CDN of claim 3, wherein the CDN bandwidth detail is a bandwidth of each network operator used by the CDN;
the periodically obtaining the CDN bandwidth detail occupied by each domain name in the second domain name set by using the third period as a unit specifically includes:
periodically acquiring the bandwidth of each network operator of each CDN occupied by the domain name in a third period aiming at any domain name in the second domain name set;
and writing the bandwidth data of each network operator of each CDN of all domain names into a second distributed data table through a distributed queue, wherein the second distributed data table is positioned in a database which is used for real-time data analysis and is based on column storage.
5. The method for monitoring the details of the domain bandwidth in the CDN of the converged content delivery network according to claim 1, wherein the displaying the details of the CDN bandwidth occupied by each domain specifically includes:
summing the CDN bandwidth details occupied by each domain name to obtain the approximate bandwidth of each CDN of each domain name; and automatically generating a curve graph of the approximate bandwidth of each CDN of each domain name, and displaying the automatically generated curve graph.
6. The utility model provides a domain name bandwidth detail monitored control system among integration content delivery network CDN which characterized in that, integration CDN comprises a plurality of CDN, domain name bandwidth detail monitored control system among the integration CDN includes:
the first detection unit is used for periodically extracting domain names meeting preset conditions from all domain names owned by a domain name owner according to a set first period, and forming a first domain name set by the extracted domain names meeting the preset conditions; the domain name satisfying the preset condition is as follows: in a first period, at least one CDN bandwidth exceeds a first bandwidth threshold in bandwidths of the CDNs occupied by the domain name in the converged CDN;
the comparison and extraction unit is used for uniformly ranking the bandwidth of each CDN occupied by each domain name in a second period according to the descending order of the size of the bandwidth of each domain name in all domain names in the first domain name set, extracting the domain name with the CDN bandwidth ranking before the preset name, and forming a second domain name set by the domain name with the extracted CDN bandwidth ranking before the preset name; the time length of the second period is less than that of the first period, and the end point of the second period is the same as that of the first period;
the second detection unit is used for periodically acquiring CDN bandwidth details occupied by each domain name in the second domain name set by taking a third period as a unit; the duration of the third period is less than the duration of the first period;
and the display unit is used for displaying the CDN bandwidth details occupied by each domain name.
7. The system for monitoring details of domain name bandwidth in a CDN as recited in claim 6, wherein the first detecting unit includes:
a CDN bandwidth obtaining subunit, configured to obtain a latest domain name group for a domain name owner to use the converged CDN to perform service; traversing the latest domain name group, and periodically acquiring the bandwidth of each CDN occupied by each domain name in the latest domain name group according to a second period; the bandwidth of each CDN occupied by each domain name obtained by a plurality of continuous second periods forms the bandwidth of each CDN occupied by each domain name in the fused CDN in the first period; wherein the first period is comprised of the consecutive plurality of second periods;
the CDN bandwidth peak extracting subunit is used for extracting each CDN bandwidth peak of each domain from all CDN bandwidth in a first period of each domain, wherein each CDN under any domain name corresponds to one CDN bandwidth peak; and forming a first domain name set by the domain name of which any CDN bandwidth peak value exceeds a first bandwidth threshold value.
8. The system for monitoring details of domain name bandwidth in a CDN as recited in claim 7, further comprising a database based on column storage for real-time data analysis, wherein:
the CDN bandwidth obtaining subunit is further configured to write bandwidth data of each CDN occupied by each domain name in the obtained latest domain name group into a first distributed data table through a distributed queue, where the first distributed data table is located in a database of real-time data analysis based on column storage.
9. The system for monitoring domain name bandwidth detail in a CDN of claim 8, wherein the CDN bandwidth detail is bandwidth of each network operator used by the CDN;
the second detection unit is specifically configured to:
periodically acquiring the bandwidth of each network operator of each CDN occupied by the domain name in a third period aiming at any domain name in the second domain name set; and writing the bandwidth data of each network operator of each CDN of all domain names into a second distributed data table through a distributed queue, wherein the second distributed data table is positioned in a database which is used for real-time data analysis and is based on column storage.
10. The system for monitoring details of domain name bandwidth in a CDN of converged content delivery network according to claim 6, wherein the presentation unit is specifically configured to:
summing the CDN bandwidth details occupied by each domain name to obtain the approximate bandwidth of each CDN of each domain name; and automatically generating a curve graph of the approximate bandwidth of each CDN of each domain name, and displaying the automatically generated curve graph.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110395433.1A CN113259151B (en) | 2021-04-13 | 2021-04-13 | Domain name bandwidth detail monitoring method and system in CDN (content delivery network) for converged content delivery |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110395433.1A CN113259151B (en) | 2021-04-13 | 2021-04-13 | Domain name bandwidth detail monitoring method and system in CDN (content delivery network) for converged content delivery |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113259151A CN113259151A (en) | 2021-08-13 |
| CN113259151B true CN113259151B (en) | 2022-05-17 |
Family
ID=77220872
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110395433.1A Active CN113259151B (en) | 2021-04-13 | 2021-04-13 | Domain name bandwidth detail monitoring method and system in CDN (content delivery network) for converged content delivery |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113259151B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114095384B (en) * | 2021-10-29 | 2023-03-24 | 新浪网技术(中国)有限公司 | CDN fused service quality real-time display method and system |
| CN117061367B (en) * | 2023-10-13 | 2024-02-23 | 联通在线信息科技有限公司 | CDN node bandwidth guiding method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103684870A (en) * | 2013-12-25 | 2014-03-26 | 乐视网信息技术（北京）股份有限公司 | Method and system for obtaining bandwidth flow of CDN (Content Delivery Network) |
| WO2015001495A1 (en) * | 2012-02-23 | 2015-01-08 | Ericsson Television Inc. | Bandwith policy management in a self-corrected content delivery network |
| CN106464680A (en) * | 2014-03-17 | 2017-02-22 | 爱立信股份有限公司 | Bandwidth management in a content distribution network |
| CN106713456A (en) * | 2016-12-22 | 2017-05-24 | 上海帝联信息科技股份有限公司 | Network bandwidth statistics method and device |
| CN109361622A (en) * | 2018-11-30 | 2019-02-19 | 网宿科技股份有限公司 | The method and CDN system of bandwidth control are carried out to the service connection of CDN system |
-
2021
- 2021-04-13 CN CN202110395433.1A patent/CN113259151B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015001495A1 (en) * | 2012-02-23 | 2015-01-08 | Ericsson Television Inc. | Bandwith policy management in a self-corrected content delivery network |
| CN103684870A (en) * | 2013-12-25 | 2014-03-26 | 乐视网信息技术（北京）股份有限公司 | Method and system for obtaining bandwidth flow of CDN (Content Delivery Network) |
| CN106464680A (en) * | 2014-03-17 | 2017-02-22 | 爱立信股份有限公司 | Bandwidth management in a content distribution network |
| CN106713456A (en) * | 2016-12-22 | 2017-05-24 | 上海帝联信息科技股份有限公司 | Network bandwidth statistics method and device |
| CN109361622A (en) * | 2018-11-30 | 2019-02-19 | 网宿科技股份有限公司 | The method and CDN system of bandwidth control are carried out to the service connection of CDN system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113259151A (en) | 2021-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109408347B (en) | A kind of index real-time analyzer and index real-time computing technique | |
| CN113259151B (en) | Domain name bandwidth detail monitoring method and system in CDN (content delivery network) for converged content delivery | |
| CN103647800B (en) | Recommend the method and system of application resource | |
| US20200372007A1 (en) | Trace and span sampling and analysis for instrumented software | |
| CA2761216A1 (en) | Method and system for establishing a notification service for a device | |
| CN110337059B (en) | Analysis algorithm, server and network system for family relationship of user | |
| US20100023699A1 (en) | System and Method for Usage Analyzer of Subscriber Access to Communications Network | |
| CN104427519B (en) | IP address ownership place management method and device | |
| CN111263409B (en) | Method, system and related equipment for providing metadata information of network function service | |
| CN107835132B (en) | Method and device for tracking flow source | |
| CN110637292B (en) | System and method for querying a resource cache | |
| CN106815260B (en) | Index establishing method and equipment | |
| CN109885656B (en) | Microblog forwarding prediction method and device based on quantification heat degree | |
| CN111552885A (en) | System and method for realizing automatic real-time message pushing operation | |
| CN104462096B (en) | Public sentiment method for monitoring and analyzing and device | |
| CN103796207A (en) | Method and device for identifying false subscriber number | |
| CN104902498A (en) | Identification method and device for subscriber re-networking | |
| US10997171B2 (en) | Database performance analysis based on a random archive | |
| CN108876644B (en) | Similar account calculation method and device based on social network | |
| WO2017000592A1 (en) | Data processing method, apparatus and system | |
| CN114281648A (en) | Data acquisition method and device, electronic equipment and storage medium | |
| CN102663053A (en) | Distributed server system based on image content search | |
| CN111522870B (en) | Database access method, middleware and readable storage medium | |
| CN105515842B (en) | A kind of general polling system and querying method based on network data | |
| CN106980697A (en) | A kind of catalogue distribution querying method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230419 Address after: Room 501-502, 5/F, Sina Headquarters Scientific Research Building, Block N-1 and N-2, Zhongguancun Software Park, Dongbei Wangxi Road, Haidian District, Beijing, 100193 Patentee after: Sina Technology (China) Co.,Ltd. Address before: 100193 7th floor, scientific research building, Sina headquarters, plot n-1, n-2, Zhongguancun Software Park, Dongbei Wangxi Road, Haidian District, Beijing, 100193 Patentee before: Sina.com Technology (China) Co.,Ltd. |
|
| TR01 | Transfer of patent right |