CN107465526B - Internet video CDN server quality monitoring system and method - Google Patents

Internet video CDN server quality monitoring system and method Download PDF

Info

Publication number
CN107465526B
CN107465526B CN201610390550.8A CN201610390550A CN107465526B CN 107465526 B CN107465526 B CN 107465526B CN 201610390550 A CN201610390550 A CN 201610390550A CN 107465526 B CN107465526 B CN 107465526B
Authority
CN
China
Prior art keywords
cdn
kpi
http
server
terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610390550.8A
Other languages
Chinese (zh)
Other versions
CN107465526A (en
Inventor
吴雪波
翁昌清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dekscom Technologies Ltd
Original Assignee
Dekscom Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dekscom Technologies Ltd filed Critical Dekscom Technologies Ltd
Priority to CN201610390550.8A priority Critical patent/CN107465526B/en
Publication of CN107465526A publication Critical patent/CN107465526A/en
Application granted granted Critical
Publication of CN107465526B publication Critical patent/CN107465526B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/14Arrangements for monitoring or testing data switching networks using software, i.e. software packages
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/50Testing arrangements
    • H04L43/55Testing of service level quality, e.g. simulating service usage

Abstract

The invention discloses a system and a method for monitoring the quality of an Internet video CDN server, wherein the monitoring system comprises: a terminal QoS soft probe and a CDN quality monitoring center management platform. The terminal QoS soft probe comprises a network packet capturing and protocol analyzing module, a CDN KPI statistical module and a KPI reporting communication module; the CDN quality monitoring center management platform comprises a terminal KPI acquisition module and a CDN KPI gathering and counting module. The quality monitoring system and method for the Internet video CDN servers, provided by the invention, have the advantages that QoS soft probes are deployed at OTT terminals of real users, QoS index collection is carried out on CDN servers actually accessed by the OTT terminals, a large number of CDN QoS indexes reported by the OTT terminals are subjected to summary statistics, and the performance and the service quality of each CDN server are calculated.

Description

Internet video CDN server quality monitoring system and method
Technical Field
The invention belongs to the technical field of communication, and relates to a quality monitoring system, in particular to a quality monitoring system of an internet video CDN server; meanwhile, the invention also relates to a quality monitoring method for the Internet video CDN server.
Background
With the rapid development of IP networks and applications and the increasing competition of telecommunication markets, large telecommunication operators around the world are raising a hot tide of the construction and service development of three-network convergence networks with IPTV as the leading factor. On The other hand, internet televisions, mobile video and multi-screen interactive services dominated by OTT (over The top) video technology are also increasing, and The consumption of OTT video contents through smart phones, tablet computers, PCs and internet televisions is increasing at an alarming rate.
As a digital video service, OTT tv service will compete with traditional cable tv and IPTV. As people have become accustomed to the low-cost charging standards of cable television and uninterrupted service availability, how to ensure that the quality of experience of OTT users can reach (or exceed) cable television becomes a key element of OTT video success.
Unlike the traditional IPTV video protocol stack (MPEG-TS video stream based on UDP/RTP), OTT video uses the standard HTTP/TCP protocol to deliver media data files. The TCP protocol can guarantee reliable media data transmission by means of a retransmission mechanism, but cannot guarantee that all retransmitted data can arrive at the client in time before their scheduled play-out time. When this occurs, the client must stop waiting, which results in the phenomenon of the player screen being stuck and waiting for buffering.
The reasons for blocking the OTT video may be various, including IP bearer network problems (serious packet loss, too large delay, or insufficient bandwidth), CDN server performance problems, or OTT video terminal performance problems. The influence of the performance and the deployment position of the CDN server on the OTT video quality is crucial, including: (1) the CDN server should be deployed at a network position close to an OTT terminal served by the CDN server as much as possible so as to reduce the pressure of video flow on an IP backbone network and ensure that the network bandwidth can meet the requirements of OTT video stream code streams; (2) the load pressure of the CDN server is in a proper level, and a good performance state is kept, so that the HTTP request of the OTT terminal can be quickly responded, and a higher video stream downloading throughput rate is provided.
As can be seen from the above, in order to ensure the OTT video quality, the performance status and the service quality of each CDN server must be effectively monitored, a warning needs to be given in time when a performance problem occurs in the CDN server, and load balancing scheduling and network deployment location optimization of the CDN server should be performed reasonably according to the performance and load of the CDN server.
The CDN is called a Content Delivery Network, i.e., a Content Delivery Network. The basic idea is to avoid bottlenecks and links possibly influencing data transmission speed and stability on the Internet as far as possible, so that content transmission is faster and more stable. By placing node servers at various positions of the network to form a layer of intelligent virtual network on the basis of the existing internet, the CDN system can redirect the request of a user to a service node closest to the user in real time according to network flow, connection of each node, load condition, distance to the user, response time and other comprehensive information. The method aims to enable the user to obtain the required content nearby, solve the problem of internet congestion and improve the response speed of the user for accessing the website.
The traditional CDN service quality monitoring system is generally realized by adopting a hard probe simulation terminal dial test mode, namely, the hard probe is deployed at different positions of a network, an OTT terminal is simulated to initiate an HTTP request to a CDN server to download a specified video stream URL, and then various performance indexes of the CDN server in a video stream downloading process, such as HTTP success rate, HTTP response delay, HTTP error codes and the like, are measured. The main limitations of this CDN quality monitoring scheme include:
(1) because each CDN server node in the network needs to deploy a dial-up hard probe to monitor CDN nodes in the whole network, a large investment cost for the hard probe is usually required.
(2) Because the dial-up test probe can only realize the sampling dial-up test of the CDN content resources by setting a group of specific video URLs, the comprehensive monitoring of the CDN main content resources can not be realized.
(3) Because the content resources of the CDN often change, maintenance personnel need to update the video URL of the dial-up test task periodically, which also brings more workload to the management and maintenance of the CDN quality monitoring system.
In view of the above, there is an urgent need to design a new monitoring method to overcome the above-mentioned drawbacks of the existing monitoring methods.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: the quality monitoring system for the Internet video CDN server can reduce the complexity and cost of system management and maintenance and can realize the coverage of the OTT video terminal of the whole network.
In addition, the invention also provides a quality monitoring method for the Internet video CDN server, which can reduce the complexity and cost of system management and maintenance and can realize the coverage of the OTT video terminal of the whole network.
In order to solve the technical problems, the invention adopts the following technical scheme:
an internet video CDN server quality monitoring system, the monitoring system comprising: a terminal QoS soft probe and a CDN quality monitoring center management platform;
the terminal QoS soft probe comprises a network packet capturing and protocol analyzing module, a CDN KPI statistical module and a KPI reporting communication module;
the network packet capturing and protocol analyzing module is used for capturing an IP data packet of a wired or wireless network port of the terminal, deeply analyzing a protocol of the data packet according to TCP/IP protocol specification, tracking and analyzing a protocol interaction and video stream downloading process of the terminal accessing the CDN server, and transmitting related protocol field information to the CDN KPI statistical module;
the CDN KPI statistical module is used for performing statistical analysis on a protocol field of a terminal accessing a CDN server and calculating the following KPI parameters:
IP address of CDN server: the IP address of the server of the video stream requested by the terminal;
number of HTTP requests: the number of video stream HTTP GET request messages sent by a terminal to a server;
number of HTTP successful responses: the server gives the number of successful responses to the video stream HTTP GET request sent by the terminal, wherein the unsuccessful responses include: no response and HTTP error response code return within the set time;
HTTP response latency: calculating the time difference from the terminal initiating the HTTP GET request message of the video stream to the receiving of the first data packet of the video stream;
the KPI reporting communication module is used for sending the CDN KPI parameters of the sampling period to a CDN quality center management server according to a set period; when a terminal QoS soft probe reports KPI parameters, a TCP connection is established with a central management server according to a set port, then CDNKPI parameters are packaged into an HTTP POST message according to an XML format and sent to the central management server, and the TCP connection is removed after the sending is finished; the CDN KPI parameters comprise an IP address of a CDN server, HTTP request number, HTTP successful response number and HTTP response time delay;
the CDN quality monitoring center management platform comprises a terminal KPI acquisition module and a CDN KPI gathering and counting module;
the terminal KPI acquisition module is used for carrying out protocol interaction with terminal QoS soft probes distributed at different positions of a network and acquiring CDN KPI parameters reported by the QoS soft probes; the specific process comprises the following steps: monitoring a TCP connection request from a QoS soft probe at a set port; after receiving the HTTP POST message of the soft probe, parsing the XML data content therein, and extracting CDN KPI parameters included therein includes: IP address of CDN server, HTTP request number, HTTP success response number, HTTP response time delay; then, writing the CDN KPI parameters of the terminal into a database in a recording form;
the CDN KPI gathering and counting module is used for carrying out statistical analysis on CDN KPI records reported by all terminals in a database, carrying out classification gathering and counting according to CDN server IP addresses, and counting the overall performance KPI of each CDN server, and comprises the following steps:
HTTP request success rate C: the calculation formula is A/B, wherein A is the total number of HTTP successful responses sent to all terminals by the CDN server; b is the total number of HTTP requests sent by all terminals to the CDN server;
average HTTP response latency D: calculating the average value of HTTP response time delay of the CDN server reported by all the terminals, wherein the unit is millisecond;
health degree H of the CDN server: the parameter value range is 0-100, and the higher the score is, the better the CDN server quality is; the calculation formula is H50C + 50E/100, where E is the latency score calculated from the average HTTP response latency D of the server, the calculation formula: e is 100-D/5; if E <0, E is 0.
An internet video CDN server quality monitoring system, the monitoring system comprising: a terminal QoS soft probe and a CDN quality monitoring center management platform;
the terminal QoS soft probe comprises a network packet capturing and protocol analyzing module, a CDN KPI statistical module and a KPI reporting communication module;
the network packet capturing and protocol analyzing module is used for capturing an IP data packet of a wired or wireless network port of the terminal, deeply analyzing a protocol of the data packet according to TCP/IP protocol specification, tracking and analyzing a protocol interaction and video stream downloading process of the terminal accessing the CDN server, and transmitting related protocol field information to the CDN KPI statistical module;
the CDN KPI statistical module is used for performing statistical analysis on a protocol field of a terminal accessing a CDN server and calculating each KPI parameter;
the KPI reporting communication module is used for sending the CDN KPI parameters of the sampling period to a CDN quality center management server according to a set period;
the CDN quality monitoring center management platform comprises a terminal KPI acquisition module and a CDN KPI gathering and counting module;
the terminal KPI acquisition module is used for carrying out protocol interaction with terminal QoS soft probes distributed at different positions of a network and acquiring CDN KPI parameters reported by the QoS soft probes;
the CDN KPI summarizing and counting module is used for carrying out statistical analysis on CDN KPI records reported by all terminals in a database, carrying out classifying and summarizing statistics according to CDN server IP addresses, and counting the overall performance KPI of each CDN server.
As a preferred solution of the present invention, the KPI parameters calculated by the CDN KPI statistics module include:
IP address of CDN server: the IP address of the server of the video stream requested by the terminal;
number of HTTP requests: the number of video stream HTTP GET request messages sent by a terminal to a server;
number of HTTP successful responses: the server gives the number of successful responses to the video stream HTTP GET request sent by the terminal, wherein the unsuccessful responses include: no response and HTTP error response code return within the set time;
HTTP response latency: the time difference from the HTTP GET request message of the video stream initiated by the terminal to the first packet of the video stream is calculated.
As a preferred scheme of the present invention, each time the terminal QoS soft probe reports a KPI parameter, the terminal QoS soft probe establishes a TCP connection with the central management server according to a set port, then encapsulates the CDN KPI parameter into an HTTP POST message according to an XML format, sends the HTTP POST message to the central management server, and removes the TCP connection after sending the CDN KPI parameter; the CDN KPI parameters include I P addresses of CDN servers, HTTP request number, HTTP successful response number, and HTTP response delay.
As a preferred scheme of the present invention, a specific process of the terminal KPI acquisition module includes: monitoring a TCP connection request from a QoS soft probe at a set port; after receiving the HTTP POST message of the soft probe, parsing the XML data content therein, and extracting CDN KPI parameters included therein includes: IP address of CDN server, HTTP request number, HTTP success response number, HTTP response time delay; and then writing the CDN KPI parameters of the terminal into a database in a recording form.
As a preferred scheme of the present invention, the calculating, by the CDN KPI summary statistics module, the overall performance KPI of each CDN server includes:
HTTP request success rate C: the calculation formula is A/B, wherein A is the total number of HTTP successful responses sent to all terminals by the CDN server; b is the total number of HTTP requests sent by all terminals to the CDN server;
average HTTP response latency D: calculating the average value of HTTP response time delay of the CDN server reported by all the terminals, wherein the unit is millisecond;
health degree H of the CDN server: the parameter value range is 0-100, and the higher the score is, the better the CDN server quality is; the calculation formula is H50C + 50E/100, where E is the latency score calculated from the average HTTP response latency D of the server, the calculation formula: e is 100-D/5; if E <0, E is 0.
A quality monitoring method of the quality monitoring system of the Internet video CDN server comprises the following steps:
step S1, the network packet capturing and protocol analyzing module captures the IP data packet of the wired or wireless network port of the terminal, deeply analyzes the protocol of the data packet according to the TCP/IP protocol standard, tracks and analyzes the protocol interaction and video stream downloading process of the terminal accessing the CDN server, and transmits the related protocol field information to the CDN KPI statistical module;
step S2, the CDN KPI statistics module performs statistical analysis on the protocol field of the terminal accessing the CDN server, and calculates the following KPI parameters:
IP address of CDN server: the IP address of the server of the video stream requested by the terminal;
number of HTTP requests: the number of video stream HTTP GET request messages sent by a terminal to a server;
number of HTTP successful responses: the server gives the number of successful responses to the video stream HTTP GET request sent by the terminal, wherein the unsuccessful responses include: no response and HTTP error response code return within the set time;
HTTP response latency: calculating the time difference from the HTTP GET request message of the video stream initiated by the terminal to the first data packet of the video stream;
step S3, the KPI reporting communication module sends the CDN KPI parameter of the sampling period to the CDN quality center management server according to the set period; each time a terminal QoS soft probe reports KPI parameters, a TCP connection is established with a central management server according to a set port, then the CDN KPI parameters are packaged into HTTP POST messages according to an XML format and sent to the central management server, and the TCP connection is removed after the sending is finished; the CDN KPI parameters comprise an IP address of a CDN server, HTTP request number, HTTP successful response number and HTTP response time delay;
step S4, the terminal KPI acquisition module is responsible for carrying out protocol interaction with terminal QoS soft probes distributed at different positions of the network, and acquiring CDN KPI parameters reported by the QoS soft probes; the specific process comprises the following steps: monitoring a TCP connection request from a QoS soft probe at a set port; after receiving the HTTP POST message of the soft probe, parsing the XML data content therein, and extracting CDN KPI parameters included therein includes: IP address of CDN server, HTTP request number, HTTP success response number, HTTP response time delay; then, writing the CDN KPI parameters of the terminal into a database in a recording form;
step S5, the CDN KPI summarizing and counting module performs statistical analysis on CDN KPI records reported by all terminals in the database, performs classification summarizing and counting according to CDN server IP addresses, and calculates the overall performance KPI of each CDN server, including:
HTTP request success rate C: the calculation formula is A/B, wherein A is the total number of HTTP successful responses sent to all terminals by the CDN server; b is the total number of HTTP requests sent by all terminals to the CDN server;
average HTTP response latency D: calculating the average value of HTTP response time delay of the CDN server reported by all the terminals, wherein the unit is millisecond;
health degree H of the CDN server: the parameter value range is 0-100, and the higher the score is, the better the CDN server quality is; the calculation formula is H50C + 50E/100, where E is the latency score calculated from the average HTTP response latency D of the server, the calculation formula: e is 100-D/5; if E <0, E is 0.
A quality monitoring method for an Internet video CDN server comprises the following steps:
step S1, the network packet capturing and protocol analyzing module captures the IP data packet of the wired or wireless network port of the terminal, deeply analyzes the protocol of the data packet according to the TCP/IP protocol standard, tracks and analyzes the protocol interaction and video stream downloading process of the terminal accessing the CDN server, and transmits the related protocol field information to the CDN KPI statistical module;
step S2, a CDN KPI statistical module performs statistical analysis on a protocol field of a terminal accessing a CDN server to calculate each KPI parameter;
step S3, the KPI reporting communication module sends the CDN KPI parameter of the sampling period to the CDN quality center management server according to the set period;
step S4, the terminal KPI acquisition module performs protocol interaction with terminal QoS soft probes distributed at different positions of the network, and acquires CDN KPI parameters reported by the QoS soft probes;
and step S5, the CDN KPI summarizing and counting module performs statistical analysis on CDN KPI records reported by all terminals in the database, performs classifying and summarizing statistics according to CDN server IP addresses, and counts the overall performance KPI of each CDN server.
As a preferred embodiment of the present invention, in step S2, the following KPI parameters are calculated:
IP address of CDN server: the IP address of the server of the video stream requested by the terminal;
number of HTTP requests: the number of video stream HTTP GET request messages sent by a terminal to a server;
number of HTTP successful responses: the server gives the number of successful responses to the video stream HTTP GET request sent by the terminal, wherein the unsuccessful responses include: no response and HTTP error response code return within the set time;
HTTP response latency: the time difference from the HTTP GET request message of the video stream initiated by the terminal to the first packet of the video stream is calculated.
As a preferred embodiment of the present invention, in step S5, the step of counting the overall performance KPI of each CDN server includes:
HTTP request success rate C: the calculation formula is A/B, wherein A is the total number of HTTP successful responses sent to all terminals by the CDN server; b is the total number of HTTP requests sent by all terminals to the CDN server;
average HTTP response latency D: calculating the average value of HTTP response time delay of the CDN server reported by all the terminals, wherein the unit is millisecond;
health degree H of the CDN server: the parameter value range is 0-100, and the higher the score is, the better the CDN server quality is; the calculation formula is H50C + 50E/100, where E is the latency score calculated from the average HTTP response latency D of the server, the calculation formula: e is 100-D/5; if E <0, E is 0.
The invention has the beneficial effects that: the quality monitoring system and method for the Internet video CDN servers, provided by the invention, have the advantages that QoS soft probes are deployed at OTT terminals of real users, QoS index collection is carried out on CDN servers actually accessed by the OTT terminals, a large number of CDN QoS indexes reported by the OTT terminals are subjected to summary statistics, and the performance and the service quality of each CDN server are calculated. Therefore, compared with the traditional CDN quality dial testing system, the CDN service quality monitoring scheme provided by the invention has the following advantages:
(1) the system deployment cost is low, the scheme is a pure software-based probe scheme, the probe deployment cost is extremely low, and the coverage of the OTT video terminal in the whole network can be conveniently realized.
(2) The QoS index of the CDN server monitored by the scheme can reflect the access load and performance condition of a real OTT user terminal to the CDN server, and the full monitoring of main CDN resources (namely the real access video content of a user) is naturally realized.
(3) According to the scheme, the video URL accessed by the CDN node and the actual terminal can be automatically found without any configuration, so that the complexity and the cost of system management and maintenance are greatly reduced.
Drawings
Fig. 1 is a schematic diagram of the quality monitoring system of the internet video CDN server according to the present invention.
Detailed Description
Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
Example one
Referring to fig. 1, the present invention discloses a quality monitoring system for an internet video CDN server, wherein the monitoring system comprises: a terminal QoS soft probe and a CDN quality monitoring center management platform.
The terminal QoS soft probe comprises a network packet capturing and protocol analyzing module, a CDN KPI statistical module and a KPI reporting communication module.
The network packet capturing and protocol analyzing module is used for capturing an IP data packet of a wired or wireless network port of the terminal, deeply analyzing a protocol of the data packet according to TCP/IP protocol specification, tracking and analyzing a protocol interaction and video stream downloading process of the terminal accessing the CDN server, and transmitting related protocol field information to the CDN KPI statistical module.
And the CDN KPI statistical module is used for performing statistical analysis on a protocol field of a terminal accessing a CDN server and calculating the following KPI parameters.
IP address of CDN server: the IP address of the server of the video stream requested by the terminal;
number of HTTP requests: the number of video stream HTTP GET request messages sent by a terminal to a server;
number of HTTP successful responses: the server gives the number of successful responses to the video stream HTTP GET request sent by the terminal, wherein the unsuccessful responses include: no response and HTTP error response code return within the set time;
HTTP response latency: the time difference from the HTTP GET request message of the video stream initiated by the terminal to the first packet of the video stream is calculated.
The KPI reporting communication module is used for sending the CDN KPI parameters of the sampling period to a CDN quality center management server according to a set period; each time a terminal QoS soft probe reports KPI parameters, a TCP connection is established with a central management server according to a set port, then the CDN KPI parameters are packaged into HTTP POST messages according to an XML format and sent to the central management server, and the TCP connection is removed after the sending is finished; the CDN KPI parameters comprise an IP address of a CDN server, HTTP request number, HTTP successful response number and HTTP response time delay.
The CDN quality monitoring center management platform comprises a terminal KPI acquisition module and a CDNKPI gathering and counting module.
The terminal KPI acquisition module is used for carrying out protocol interaction with terminal QoS soft probes distributed at different positions of a network and acquiring CDN KPI parameters reported by the QoS soft probes; the specific process comprises the following steps: monitoring a TCP connection request from a QoS soft probe at a set port; after receiving the HTTP POST message of the soft probe, parsing the XML data content therein, and extracting the CDNKPI parameters contained therein includes: IP address of CDN server, HTTP request number, HTTP success response number, HTTP response time delay; and then writing the CDN KPI parameters of the terminal into a database in a recording form.
The CDN KPI gathering and counting module is used for carrying out statistical analysis on CDN KPI records reported by all terminals in a database, carrying out classification gathering and counting according to CDN server IP addresses, and counting the overall performance KPI of each CDN server, and comprises the following steps:
HTTP request success rate C: the calculation formula is A/B, wherein A is the total number of HTTP successful responses sent to all terminals by the CDN server; b is the total number of HTTP requests sent by all terminals to the CDN server;
average HTTP response latency D: calculating the average value of HTTP response time delay of the CDN server reported by all the terminals, wherein the unit is millisecond;
health degree H of the CDN server: the parameter value range is 0-100, and the higher the score is, the better the CDN server quality is; the calculation formula is H50C + 50E/100, where E is the latency score calculated from the average HTTP response latency D of the server, the calculation formula: e is 100-D/5; if E <0, E is 0.
The invention discloses the quality monitoring system and a quality monitoring method of the quality monitoring system of the internet video CDN server, wherein the quality monitoring method comprises the following steps:
step S1, the network packet capturing and protocol analyzing module captures an IP data packet of a wired or wireless network port of the terminal, deeply analyzes a protocol of the data packet according to TCP/IP protocol specification, performs tracking analysis on the protocol interaction and video stream downloading process of the terminal accessing a CDN server, and transmits related protocol field information to the CDN KPI statistical module;
step S2, the CDN KPI statistics module performs statistical analysis on a protocol field of the terminal accessing the CDN server, and calculates the following KPI parameters:
IP address of CDN server: the IP address of the server of the video stream requested by the terminal;
number of HTTP requests: the number of video stream HTTP GET request messages sent by a terminal to a server;
number of HTTP successful responses: the server gives the number of successful responses to the video stream HTTP GET request sent by the terminal, wherein the unsuccessful responses include: no response and HTTP error response code return within the set time;
HTTP response latency: calculating the time difference from the HTTP GET request message of the video stream initiated by the terminal to the first data packet of the video stream;
step S3, the KPI reporting communication module sends the CDN KPI parameters of the sampling period to a CDN quality center management server according to a set period; each time a terminal QoS soft probe reports KPI parameters, a TCP connection is established with a central management server according to a set port, then the CDN KPI parameters are packaged into HTTP POST messages according to an XML format and sent to the central management server, and the TCP connection is removed after the sending is finished; the CDN KPI parameters comprise an IP address of a CDN server, HTTP request number, HTTP successful response number and HTTP response time delay;
step S4, the terminal KPI acquisition module is responsible for carrying out protocol interaction with terminal QoS soft probes distributed at different positions of a network, and acquiring CDN KPI parameters reported by the QoS soft probes; the specific process comprises the following steps: monitoring a TCP connection request from a QoS soft probe at a set port; after receiving the HTTP POST message of the soft probe, parsing the XML data content therein, and extracting CDN KPI parameters included therein includes: IP address of CDN server, HTTP request number, HTTP success response number, HTTP response time delay; then, writing the CDN KPI parameters of the terminal into a database in a recording form;
step S5, the CDN KPI summarizing and counting module performs statistical analysis on CDN KPI records reported by all terminals in the database, performs summarizing and counting according to CDN server IP addresses, and calculates the overall performance KPI of each CDN server, including:
HTTP request success rate C: the calculation formula is A/B, wherein A is the total number of HTTP successful responses sent to all terminals by the CDN server; b is the total number of HTTP requests sent by all terminals to the CDN server;
average HTTP response latency D: calculating the average value of HTTP response time delay of the CDN server reported by all the terminals, wherein the unit is millisecond;
health degree H of the CDN server: the parameter value range is 0-100, and the higher the score is, the better the CDN server quality is; the calculation formula is H50C + 50E/100, where E is the latency score calculated from the average HTTP response latency D of the server, the calculation formula: e is 100-D/5; if E <0, E is 0.
Example two
The technical scheme of the invention comprises two main components: a terminal QoS soft probe and a CDN quality monitoring center management platform.
The terminal QoS soft probe comprises three software modules:
(1) the network packet capturing and protocol analyzing module: the module captures an IP data packet of a wired or wireless network port of the terminal, deeply analyzes a protocol according to TCP/IP protocol specification, performs tracking analysis on a protocol interaction and video stream downloading process of the terminal accessing a CDN server, and transmits related protocol field information to the CDN KPI statistical module.
(2) CDN KPI statistics module: the module carries out statistical analysis on the protocol field of the terminal accessing the CDN server and calculates the following KPI parameters:
Figure BDA0001008852440000131
IP address of CDN server: the server IP address of the video stream requested by the terminal.
Figure BDA0001008852440000132
Number of HTTP requests: and the number of the video stream HTTP GET request messages sent by the terminal to the server.
Figure BDA0001008852440000133
Number of HTTP successful responses: the server gives the number of successful responses to the video stream HTTP GET request sent by the terminal, wherein the unsuccessful responses include: no response and return of HTTP error response code (including 4XX and 5XX) within a set time (e.g. 60 seconds).
Figure BDA0001008852440000134
HTTP response latency: the time difference from the HTTP GET request message of the video stream initiated by the terminal to the first packet of the video stream is calculated.
(3) KPI reports communication module: the module sends the CDN KPI parameter of the sampling period to the CDN quality center management server according to a set period (e.g., every 5 minutes). Each time when a terminal QoS soft probe reports KPI parameters, a TCP connection is established with a central management server according to a set port (such as 9001), then the CDN KPI parameters (including the IP address of the CDN server, HTTP request number, HTTP successful response number and HTTP response time delay) are packaged into an HTTP POST message according to an XML format and sent to the central management server, and the TCP connection is removed after the sending is finished.
The CDN quality monitoring center management platform comprises two software modules:
(1) terminal KPI acquisition module: the module is responsible for carrying out protocol interaction with terminal QoS soft probes distributed at different positions of a network, and collecting CDN KPI parameters reported by the QoS soft probes. The specific process comprises the following steps: listening for a TCP connection request from a QoS soft probe at a set port (e.g., 9001); after receiving the HTTP POST message of the soft probe, parsing the XML data content therein, and extracting CDN KPI parameters included therein includes: IP address of CDN server, HTTP request number, HTTP success response number, HTTP response time delay; and then writing the CDN KPI parameters of the terminal into a database in a recording form.
(2) CDN KPI gathers statistics module: the module is responsible for carrying out statistical analysis on CDN KPI records reported by all terminals in a database, carrying out classification and summary statistics according to CDN server IP addresses, and carrying out statistics on the overall performance KPI of each CDN server, and comprises the following steps:
Figure BDA0001008852440000135
HTTP request success rate (C): the calculation formula is A/B, wherein A is the total number of HTTP successful responses sent by the CDN server to all terminals; and B is the total number of HTTP requests sent by all the terminals to the CDN server.
Figure BDA0001008852440000136
Average HTTP response latency (D): and calculating the average value of the HTTP response time delay of the CDN server reported by all the terminals, wherein the unit is millisecond.
Figure BDA0001008852440000141
Health of CDN server (H): the parameter value range is 0-100, and the higher the score is, the better the CDN server quality is; the formula is H50C + 50E/100, where E is the latency score calculated from the average HTTP response latency (D) of the server, the formula: e ═ 100-D/5 (if E<0, E ═ 0).
EXAMPLE III
An internet video CDN server quality monitoring system, the monitoring system comprising: a terminal QoS soft probe and a CDN quality monitoring center management platform.
The terminal QoS soft probe comprises a network packet capturing and protocol analyzing module, a CDN KPI statistical module and a KPI reporting communication module. The CDN quality monitoring center management platform comprises a terminal KPI acquisition module and a CDN KPI gathering and counting module.
The network packet capturing and protocol analyzing module is used for capturing an IP data packet of a wired or wireless network port of the terminal, deeply analyzing a protocol of the data packet according to TCP/IP protocol specification, tracking and analyzing a protocol interaction and video stream downloading process of the terminal accessing the CDN server, and transmitting related protocol field information to the CDN KPI statistical module.
And the CDN KPI statistical module is used for performing statistical analysis on a protocol field of a terminal accessing a CDN server and calculating each KPI parameter.
And the KPI reporting communication module is used for sending the CDN KPI parameters of the sampling period to a CDN quality center management server according to a set period.
And the terminal KPI acquisition module is used for carrying out protocol interaction with terminal QoS soft probes distributed at different positions of a network and acquiring CDN KPI parameters reported by the QoS soft probes.
The CDN KPI summarizing and counting module is used for carrying out statistical analysis on CDN KPI records reported by all terminals in a database, carrying out classifying and summarizing statistics according to CDN server IP addresses, and counting the overall performance KPI of each CDN server.
A quality monitoring method for an Internet video CDN server comprises the following steps:
step S1, the network packet capturing and protocol analyzing module captures the IP data packet of the wired or wireless network port of the terminal, deeply analyzes the protocol of the data packet according to the TCP/IP protocol standard, tracks and analyzes the protocol interaction and video stream downloading process of the terminal accessing the CDN server, and transmits the related protocol field information to the CDN KPI statistical module;
step S2, a CDN KPI statistical module performs statistical analysis on a protocol field of a terminal accessing a CDN server to calculate each KPI parameter;
step S3, the KPI reporting communication module sends the CDN KPI parameter of the sampling period to the CDN quality center management server according to the set period;
step S4, the terminal KPI acquisition module performs protocol interaction with terminal QoS soft probes distributed at different positions of the network, and acquires CDN KPI parameters reported by the QoS soft probes;
and step S5, the CDN KPI summarizing and counting module performs statistical analysis on CDN KPI records reported by all terminals in the database, performs classifying and summarizing statistics according to CDN server IP addresses, and counts the overall performance KPI of each CDN server.
In summary, the quality monitoring system and method for the internet video CDN servers provided by the invention deploy QoS soft probes at OTT terminals of real users, collect QoS indexes of CDN servers actually accessed by the OTT terminals, and perform summary statistics on a large number of CDN QoS indexes reported by the OTT terminals, thereby calculating the performance and service quality of each CDN server. Therefore, compared with the traditional CDN quality dial testing system, the CDN service quality monitoring scheme provided by the invention has the following advantages:
(1) the system deployment cost is low, the scheme is a pure software-based probe scheme, the probe deployment cost is extremely low, and the coverage of the OTT video terminal in the whole network can be conveniently realized.
(2) The QoS index of the CDN server monitored by the scheme can reflect the access load and performance condition of a real OTT user terminal to the CDN server, and the full monitoring of main CDN resources (namely the real access video content of a user) is naturally realized.
(3) According to the scheme, the video URL accessed by the CDN node and the actual terminal can be automatically found without any configuration, so that the complexity and the cost of system management and maintenance are greatly reduced.
The description and applications of the invention herein are illustrative and are not intended to limit the scope of the invention to the embodiments described above. Variations and modifications of the embodiments disclosed herein are possible, and alternative and equivalent various components of the embodiments will be apparent to those skilled in the art. It will be clear to those skilled in the art that the present invention may be embodied in other forms, structures, arrangements, proportions, and with other components, materials, and parts, without departing from the spirit or essential characteristics thereof. Other variations and modifications of the embodiments disclosed herein may be made without departing from the scope and spirit of the invention.

Claims (8)

1. The utility model provides an internet video CDN server quality monitoring system which characterized in that, monitoring system includes: a terminal QoS soft probe and a CDN quality monitoring center management platform;
the terminal QoS soft probe comprises a network packet capturing and protocol analyzing module, a CDN KPI statistical module and a KPI reporting communication module;
the network packet capturing and protocol analyzing module is used for capturing an IP data packet of a wired or wireless network port of the terminal, deeply analyzing a protocol of the data packet according to TCP/IP protocol specification, tracking and analyzing a protocol interaction and video stream downloading process of the terminal accessing the CDN server, and transmitting related protocol field information to the CDN KPI statistical module;
the CDN KPI statistical module is used for performing statistical analysis on a protocol field of a terminal accessing a CDN server and calculating each KPI parameter;
the KPI reporting communication module is used for sending the CDN KPI parameters of the sampling period to a CDN quality monitoring center management platform according to the set sampling period;
the CDN quality monitoring center management platform comprises a terminal KPI acquisition module and a CDN KPI gathering and counting module;
the terminal KPI acquisition module is used for carrying out protocol interaction with terminal QoS soft probes distributed at different positions of a network and acquiring CDN KPI parameters reported by the QoS soft probes;
the CDN KPI summarizing and counting module is used for carrying out statistical analysis on CDN KPI records reported by all terminals in a database, carrying out classifying and summarizing statistics according to CDN server IP addresses, and counting the overall performance KPI of each CDN server.
2. The internet video CDN server quality monitoring system of claim 1, wherein:
the KPI parameters calculated by the CDN KPI statistic module comprise:
IP address of CDN server: the IP address of the server of the video stream requested by the terminal;
number of HTTP requests: the number of video stream HTTP GET request messages sent by a terminal to a server;
number of HTTP successful responses: the server gives the number of successful responses to the video stream HTTP GET request sent by the terminal, wherein the unsuccessful responses include: no response and HTTP error response code return within the set time;
HTTP response latency: the time difference from the HTTP GET request message of the video stream initiated by the terminal to the first packet of the video stream is calculated.
3. The internet video CDN server quality monitoring system of claim 1, wherein:
the terminal QoS soft probe establishes a TCP connection with a CDN quality monitoring center management platform according to a set port when reporting KPI parameters each time, then packages the CDN KPI parameters into HTTP POST messages according to an XML format, sends the HTTP POST messages to the CDN quality monitoring center management platform, and removes the TCP connection after sending is finished; the CDN KPI parameters comprise an IP address of a CDN server, HTTP request number, HTTP successful response number and HTTP response time delay.
4. The internet video CDN server quality monitoring system of claim 1, wherein:
the specific process of the terminal KPI acquisition module comprises the following steps: monitoring a TCP connection request from a QoS soft probe at a set port; after receiving the HTTP POST message of the soft probe, parsing the XML data content therein, and extracting CDN KPI parameters included therein includes: IP address of CDN server, HTTP request number, HTTP success response number, HTTP response time delay; and then writing the CDN KPI parameters of the terminal into a database in a recording form.
5. The internet video CDN server quality monitoring system of claim 1, wherein:
the counting module for counting the total performance KPI of each CDN server by the CDN KPI gathering counting module comprises the following steps:
HTTP request success rate C: the calculation formula is A/B, wherein A is the total number of HTTP successful responses sent to all terminals by the CDN server; b is the total number of HTTP requests sent by all terminals to the CDN server;
average HTTP response latency D: calculating the average value of HTTP response time delay of the CDN server reported by all the terminals, wherein the unit is millisecond;
health degree H of the CDN server: the parameter value range is 0-100, and the higher the score is, the better the CDN server quality is; the calculation formula is H50C + 50E/100, where E is the latency score calculated from the average HTTP response latency D of the server, the calculation formula: e is 100-D/5; if E <0, E is 0.
6. A quality monitoring method for an Internet video CDN server is characterized by comprising the following steps:
step S1, the network packet capturing and protocol analyzing module captures the IP data packet of the wired or wireless network port of the terminal, deeply analyzes the protocol of the data packet according to the TCP/IP protocol standard, tracks and analyzes the protocol interaction and video stream downloading process of the terminal accessing the CDN server, and transmits the related protocol field information to the CDN KPI statistical module;
step S2, a CDN KPI statistical module performs statistical analysis on a protocol field of a terminal accessing a CDN server to calculate each KPI parameter;
step S3, the KPI reporting communication module sends the CDN KPI parameters of the sampling period to a CDN quality monitoring center management platform according to the set sampling period;
step S4, the terminal KPI acquisition module performs protocol interaction with terminal QoS soft probes distributed at different positions of the network, and acquires CDN KPI parameters reported by the QoS soft probes;
and step S5, the CDN KPI summarizing and counting module performs statistical analysis on CDN KPI records reported by all terminals in the database, performs classifying and summarizing statistics according to CDN server IP addresses, and counts the overall performance KPI of each CDN server.
7. The quality monitoring method according to claim 6, characterized in that:
in step S2, the following KPI parameters are calculated:
IP address of CDN server: the IP address of the server of the video stream requested by the terminal;
number of HTTP requests: the number of video stream HTTP GET request messages sent by a terminal to a server;
number of HTTP successful responses: the server gives the number of successful responses to the video stream HTTP GET request sent by the terminal, wherein the unsuccessful responses include: no response and HTTP error response code return within the set time;
HTTP response latency: the time difference from the HTTP GET request message of the video stream initiated by the terminal to the first packet of the video stream is calculated.
8. The quality monitoring method according to claim 6, characterized in that:
in step S5, counting the overall performance KPI of each CDN server, including:
HTTP request success rate C: the calculation formula is A/B, wherein A is the total number of HTTP successful responses sent to all terminals by the CDN server; b is the total number of HTTP requests sent by all terminals to the CDN server;
average HTTP response latency D: calculating the average value of HTTP response time delay of the CDN server reported by all the terminals, wherein the unit is millisecond;
health degree H of the CDN server: the parameter value range is 0-100, and the higher the score is, the better the CDN server quality is; the calculation formula is H50C + 50E/100, where E is the latency score calculated from the average HTTP response latency D of the server, the calculation formula: e is 100-D/5; if E <0, E is 0.
CN201610390550.8A 2016-06-03 2016-06-03 Internet video CDN server quality monitoring system and method Active CN107465526B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610390550.8A CN107465526B (en) 2016-06-03 2016-06-03 Internet video CDN server quality monitoring system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610390550.8A CN107465526B (en) 2016-06-03 2016-06-03 Internet video CDN server quality monitoring system and method

Publications (2)

Publication Number Publication Date
CN107465526A CN107465526A (en) 2017-12-12
CN107465526B true CN107465526B (en) 2020-05-15

Family

ID=60544901

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610390550.8A Active CN107465526B (en) 2016-06-03 2016-06-03 Internet video CDN server quality monitoring system and method

Country Status (1)

Country Link
CN (1) CN107465526B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108600051B (en) * 2018-04-28 2020-02-18 网宿科技股份有限公司 BGP Anycast cluster service quality detection method and detection equipment
CN112995648B (en) * 2019-12-13 2023-10-27 中国移动通信集团辽宁有限公司 Internet television full-flow fault diagnosis method and device and computing equipment
CN111371648A (en) * 2020-03-03 2020-07-03 北京百度网讯科技有限公司 Monitoring method and device for global fault of virtual gateway cluster
CN113691420A (en) * 2021-08-26 2021-11-23 北京基调网络股份有限公司 Method for monitoring CDN quality, electronic equipment, server and storage medium
CN113824954B (en) * 2021-11-23 2022-02-08 深圳市华曦达科技股份有限公司 OTT video quality monitoring method, device, equipment and storage medium
CN114466069A (en) * 2021-12-27 2022-05-10 天翼云科技有限公司 Data acquisition system
CN115002518B (en) * 2022-05-30 2024-03-22 咪咕视讯科技有限公司 Data monitoring method, device and computer readable storage medium
CN116579652A (en) * 2023-05-12 2023-08-11 上海天玑科技股份有限公司 IT service quality monitoring system and monitoring method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1575614A (en) * 2001-10-25 2005-02-02 诺基亚公司 Method and system for optimising the performance of a network
CN102547475A (en) * 2012-02-21 2012-07-04 德科仕通信(上海)有限公司 Method and system for improving quality of service alarming accuracy of Internet protocol (IP) video media stream
CN104994133A (en) * 2015-05-22 2015-10-21 华中科技大学 Mobile Web webpage access user experience perception evaluating method based on network KPI
CN105451036A (en) * 2014-09-18 2016-03-30 中国电信股份有限公司 Video quality monitoring method, device and CDN system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060084040A (en) * 2005-01-17 2006-07-21 삼성전자주식회사 Apparatus and method for dynamic qos management

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1575614A (en) * 2001-10-25 2005-02-02 诺基亚公司 Method and system for optimising the performance of a network
CN102547475A (en) * 2012-02-21 2012-07-04 德科仕通信(上海)有限公司 Method and system for improving quality of service alarming accuracy of Internet protocol (IP) video media stream
CN105451036A (en) * 2014-09-18 2016-03-30 中国电信股份有限公司 Video quality monitoring method, device and CDN system
CN104994133A (en) * 2015-05-22 2015-10-21 华中科技大学 Mobile Web webpage access user experience perception evaluating method based on network KPI

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
网络会议视频质量评估方法分析、改进及应用;孙鲁川;《中国优秀硕士学位论文全文数据库信息科技辑》;20160215;全文 *

Also Published As

Publication number Publication date
CN107465526A (en) 2017-12-12

Similar Documents

Publication Publication Date Title
CN107465526B (en) Internet video CDN server quality monitoring system and method
CN107465564B (en) VOD service quality monitoring system and method
CN102724564B (en) Determine the influence of mobile video Quality of experience and video code conversion
EP2661020B1 (en) Adaptive monitoring of telecommunications networks
CN108881147B (en) A kind of data processing method and device of view networking
WO2019223553A1 (en) Network traffic identification method and related device
WO2013097593A1 (en) Method, device and system for monitoring internet access service quality of mobile terminal
CN107277160A (en) A kind of content delivery network node switching method and device
CN105357075B (en) Flow monitoring system and method based on software defined network
WO2012055023A1 (en) System for monitoring a video network and methods for use therewith
CN101594552B (en) Testing method for IPTV service quality damage by network transmission
CN102202210B (en) Method for mobile phone to play real-time monitoring video and mobile phone to play real-time monitoring video
CN110121059A (en) Monitor video processing method, device and storage medium
CA3140213A1 (en) Process and apparatus for estimating real-time quality of experience
CN100466560C (en) Method, system, device for detecting service quality, and charging and fault detecting system
CN108881797A (en) A kind of data processing method and device of view networking
CN103166808A (en) Monitoring method, device and system for Internet protocol television (IPTV) service quality
CN108881817A (en) A kind of methods, devices and systems that data are synchronous
US20030014128A1 (en) System, method, and apparatus for measuring application performance management
CN103906111A (en) Problem determination method and device for general packet radio service network
CN103369403B (en) Set Top Box program request packet analysis system and analysis method
CN110572698B (en) Method, device, equipment and medium for counting inspection and monitoring playing records
CN112383791A (en) Media data processing method and device, electronic equipment and storage medium
CN108880925B (en) Method and system for monitoring flow
CN100399741C (en) Apparatus for analyzing the packet data on mobile communication network and method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant