CN103856789B - The system and method that OTT quality of services are ensured is realized based on user behavior analysis - Google Patents
The system and method that OTT quality of services are ensured is realized based on user behavior analysis Download PDFInfo
- Publication number
- CN103856789B CN103856789B CN201410092349.2A CN201410092349A CN103856789B CN 103856789 B CN103856789 B CN 103856789B CN 201410092349 A CN201410092349 A CN 201410092349A CN 103856789 B CN103856789 B CN 103856789B
- Authority
- CN
- China
- Prior art keywords
- module
- monitoring
- analysis
- quality
- ott
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The present invention relates to a kind of system and method that the guarantee of OTT quality of services is realized based on user behavior analysis, including film source quality-monitoring module；Content delivery network node monitoring modular, to carry out testing to platform clectronic program guide and program by pseudo-terminal in each content delivery network node；Terminal monitoring module；Fault locating analysis module, when terminal monitoring module is alarmed, to be positioned according to the monitoring state of film source quality-monitoring module and content delivery network node monitoring modular to failure.The system and method that OTT quality of services are ensured is realized based on user behavior analysis using this kind, monitoring OTT business is distributed to the operation conditions of the links such as user terminal sight from film source production, Broadcast Control, CDN content in real time, it is quick to find and orientation problem, General Promotion Consumer's Experience, ensure the long-run development of OTT core business, to realize that enterprise operation target provides strong support means, with wider application.
Description
Technical field
Led the present invention relates to video service quality safeguards technique field, more particularly to OTT video service qualities safeguards technique
Domain, specifically refers to a kind of system and method that the guarantee of OTT quality of services is realized based on user behavior analysis.
Background technology
OTT（Over The Top, refer to various videos and data service business based on open the Internet）TV is a kind of
Integrate the multiple technologies such as internet, multimedia, communication, the brand-new business of a variety of interactive services is provided to domestic consumer.
As a kind of digital service, OTT television services will certainly be competed with conventional cable television and IPTV.Because people get used to
The relatively low expenses standard of cable television and unbroken service availability, therefore how to ensure that OTT user experience qualities can be reached
Or just turn into one of successful key element of OTT TVs more than cable television.
At present, complained when the Service assurance work for OTT TVs is mainly encountered problems by user, operation maintenance personnel is entered
Row malfunction elimination is realized.Effective survey tool is lacked to the viewing experience of terminal user, OTT video quality problems are lacked
Preventative management and maintenance, OTT video traffics are increased the network pressure problem brought can not anticipation etc., be current OTT
The problem of being run into the Service assurance course of work.
OTT video traffics deliver media data using standard HTTP between Web server and client, and HTTP
It is carried on TCP, is to be reliably connected the characteristics of TCP, Lossless transport can be retransmitted after packet loss, shaking and be delayed can be objective
The download buffering at family end is digested, and generally client will not perceive.The video playback of only buffering area is complete and without timely
When downloading to new video segment, just occur that picture is waited and buffered.At present, international norm there is no to enter OTT quality of services
The complete definition of row, ITU（International Telecommunication Union, International Telecommunication Union）Etc. normal structure
Existing measurement standard is primarily directed to damage the application scenarios of transmission, and HTTP ABR are not directed to also（Adaptive Bit
Rate, is adapted to transmission speed）The promulgated standard of this OTT Internet business.
The content of the invention
The purpose of the present invention is that the shortcoming for overcoming above-mentioned prior art can realize monitoring OTT in real time there is provided one kind
Business is distributed to the operation conditions of the links such as user terminal sight from film source production, Broadcast Control, CDN content, quickly found and fixed
Position problem, General Promotion Consumer's Experience, with wider application OTT quality of services are realized based on user behavior analysis
The system and method for guarantee.
To achieve these goals, it is of the invention based on user behavior analysis realize OTT quality of services ensure system and
Method has following composition：
This realizes the system that OTT quality of services are ensured based on user behavior analysis, and it is mainly characterized by, described system bag
Include：
Film source quality-monitoring module, in product platform side to reaching the standard grade before piece source file detect；
Content delivery network node monitoring modular, in each content delivery network node by pseudo-terminal to platform
Electric program menu and program carry out testing；
Terminal monitoring module, to gather user using the rating parameter in OTT business procedures and according to described
Rating parameter calculates Consumer's Experience video quality score；
Fault locating analysis module, when described terminal monitoring module alarm, to be supervised according to described film source quality
The monitoring state for surveying module and content delivery network node monitoring modular is positioned to failure.
It is preferred that described system also includes：
Expertise library module, to according to described film source quality-monitoring module, terminal monitoring module and fault location
Analysis module warning message analysis fault type and user viewing experience information and when fault severity level exceed system
Operation maintenance personnel is notified during preset value.
More preferably, described expertise library module includes：
Expertise rule parsing device, to according to described film source quality-monitoring module, terminal monitoring module and failure
The warning message analysis fault type of positioning analysis module；
User's perception analysis device, to according to described film source quality-monitoring module, terminal monitoring module and fault location
The warning message of analysis module analyzes the viewing experience information of user；
Failure severity evaluator, to be analyzed failure severity and worked as fault severity level more than systemic presupposition
Operation maintenance personnel is notified during value.
The invention further relates to a kind of side for realizing the guarantee of OTT quality of services based on user behavior analysis by described system
Method, it is characterised in that described method comprises the following steps：
（1）Piece source file of the described film source quality-monitoring module before product platform side is to reaching the standard grade is detected；
（2）Described content delivery network node monitoring modular passes through pseudo-terminal pair in each content delivery network node
Platform clectronic program guide and program carry out testing；
（3）Rating parameter of the described terminal monitoring module collection user in using OTT business procedures and according to described
Rating parameter calculate Consumer's Experience video quality score；
（4）When described terminal monitoring module alarm, described fault locating analysis module is according to described film source matter
The monitoring state of amount monitoring modular and content delivery network node monitoring modular is positioned to failure.
It is preferred that the rating parameter described in described basis calculates Consumer's Experience video quality score, it is specially：
The ratio and program that duration and playing duration are buffered during being played according to program initial buffer duration, program delay again
Rush the frequency and calculate Consumer's Experience video quality score.
It is preferred that described fault locating analysis module is according to described film source quality-monitoring module and content distributing network
The monitoring state of node monitors module is positioned to failure, is comprised the following steps：
（41）Whether the described set top box of described fault locating analysis module detection normally runs, if it is, continuing
Step（42）, otherwise determine abort situation in described set top box；
（42）Described fault locating analysis module judges that the alarm moment is front and rear in preset time range, described content
Whether the monitoring state of distribution network node monitors module is faulty, if it is, continuing step（43）, otherwise continue step
（44）；
（43）Described fault locating analysis module is according to the monitoring shape of described content delivery network node monitoring modular
State and Consumer's Experience video quality score carry out regional comprehensive analysis to described content delivery network node service ability；
（44）Described fault locating analysis module judges whether Broadcast Control platform normally runs, if it is not, then continuing step
（45）；
（45）The interactive information that described fault locating analysis module is asked according to customer service analyzes the event of playing platform
Hinder link.
It is preferred that described system also includes expertise library module, described step（3）With（4）Between, also including with
Lower step：
（31）Described expertise library module is according to described film source quality-monitoring module, terminal monitoring module and failure
Positioning analysis module warning message analysis fault type and user viewing experience information and when fault severity level exceedes
Operation maintenance personnel is notified during systemic presupposition value.
More preferably, described expert knowledge library is tight including expertise rule parsing device, user's perception analysis device and failure
Severe evaluator, described expertise library module is according to described film source quality-monitoring module, terminal monitoring module and failure
Positioning analysis module warning message analysis fault type and user viewing experience information and when fault severity level exceedes
Operation maintenance personnel is notified during systemic presupposition value, is comprised the following steps：
（311）Described expertise rule parsing device receives warning message and described expert is judged by cluster analysis
It whether there is the described corresponding fault type of warning message in knowledge base, if it is, continuing step（312）, otherwise, continue
Step（313）；
（312）Described expertise rule parsing device knowledge based storehouse rule of similarity is carried out described in fuzzy matching determination
The corresponding fault type of warning message, then proceedes to step（314）；
（313）Described expertise rule parsing device creates new fault type according to described warning message, then
Continue step（314）；
（314）Described user's perception analysis device tidies up the parameter evaluation failure pair according to described fault type and user
The influence that user causes；
（315）Described failure severity evaluator failure severity is analyzed and work as fault severity level exceed be
Operation maintenance personnel is notified during system preset value.
Employ in the invention and the system and method that OTT quality of services are ensured is realized based on user behavior analysis, have
Following beneficial effect：
OTT quality of services based on user behavior analysis ensure that invention helps OTT business operation maintenance personnel to monitor OTT industry in real time
Business is distributed to the operation conditions of the links such as user terminal sight from film source production, Broadcast Control, CDN content, quickly finds and positions
Problem, General Promotion Consumer's Experience ensures the long-run development of OTT core business, to realize that enterprise operation target provides strong branch
Support means, with wider application.
Its advantage is mainly reflected in the following aspects：
1st, active O＆M, finds and handling failure prior to user, lifts Consumer's Experience；
2nd, Real-time Alarm, helps operation maintenance personnel quick response emphasis failure；
3rd, the service ability to CDN node is effectively assessed, and is easy to entire content to push the planning of network；
4th, terminal monitoring reflects the actual experience of OTT user；
5th, full process and full network, realizes integrated management；Accurate intelligence, realizes that operation is excellent.
Brief description of the drawings
Fig. 1 is the structural representation that the system that OTT quality of services are ensured is realized based on user behavior analysis of the invention.
Fig. 2 is OTT quality of service measurement model schematic diagrames of the invention.
Fig. 3 is the video flowing QoE of present invention parameter model.
Fig. 4 is the flow chart of the expertise library module intellectual analysis of the present invention.
Fig. 5 is the end-to-end monitoring schematic diagram of source of the invention to terminal.
Embodiment
In order to more clearly describe the technology contents of the present invention, carried out with reference to specific embodiment further
Description.
The present invention is expanded the business scenario under Lossless transport, according to OTT based on the testing standard for damaging transmission
The transmission feature of video traffic, based on user behavior, by the soft probe technique of terminal, on the master of real influence OTT Consumer's Experiences
Problem is wanted, such as buffering latencies, wait number of times, video code rate reduction carry out comprehensive analysis, evaluated.
The present invention sets up a set of OTT video service qualities guarantee system, including OTT quality of services（QoS, Quality
Of Service, service quality）And Consumer's Experience（QoE, Quality Of Experience, Quality of experience）E measurement technology, prison
Index system, OTT method for diagnosing faults opinion, OTT testing tools and end-to-end QoS monitoring system etc. are surveyed, soft probe is utilized
Technology is acquired to OTT terminal user's viewing-datas, analyzed, using testing technology to CDN（Content
DistributionNetwork, content distributing network）Node is monitored, so as to help user directly effectively to understand terminal
The problem of rating quality of user, quick positioning effects Consumer's Experience, so as to improve the business satisfaction of terminal user.
The present invention sets up a set of OTT video service qualities guarantee system, including OTT quality of services（QoS）And user's body
Test（QoE）E measurement technology, monitored data analysis, OTT method for diagnosing faults opinion, OTT testing tools and end-to-end QoS prison
Examining system etc., including following several key contents.
First, OTT quality of services measurement model is as shown in Figure 2.
Analyzed by Internet packet capturing, and combine it is user watched during the index such as buffering situation, comprehensively counted according to model
Calculate MOS（Mean Opinion Score, mean opinion score）Score, embodies the viewing experience of terminal user.MOS scores are as follows
Table：
2nd, OTT quality of services measurement basic index
One）Basic index
1st, QoS Testing index：
-- program buffers duration first；
-- the buffering ratio in program buffering number of times, the program buffering frequency, program playing process；
--EPG（Electronic Program Guide, electric program menu）Request number of times, the frequency of failure；
-- EPG request responses average delay, maximum delay；
-- program ID；
-- program downloads time started and duration；
-- program total duration；
-- program download progress；
-- the CDN node of request；
-- program speed of download（Average, maximum, minimum）；
-- request program fragment total degree and the frequency of failure；
-- program code check, code check switching；
2nd, network index：
-- the time of TCP foundation connections, TCP re-transmissions, TCP are out of order；
3rd, user behavior index：
-- user's open and close machine time；
-- user's online hours；
-- user watches programme information（Program code, request time, watch duration, coding parameter, code check etc.）
4th, terminal device operating index：
-- CPU usage；
-- memory usage；
-- disk space utilization rate；
Two）Consumer's Experience video quality score
Consumer's Experience video quality score（MOS, Mean Opinion Score, mean opinion score）It is reflection human eye master
See the MOS scorings for evaluating measurement.
For narrowly, MOS is calculated, main and following three relating to parameters in OTT video monitorings：
1）Program initial buffer duration
2）Program buffers duration and the ratio of playing duration during playing
3）Program buffers the frequency again
Broad sense is got on very well, and in order to correctly simulate the situation of program buffering, we are spliced according to packet is caught, and are put into
In local buffering, operation to buffering area when simulation normal video is played, by the model of Producer-consumer problem draw it is above-mentioned in terms of
Calculate MOS three parameters.
Carry out packet capturing, flow-mergence, data splicing, it is simulated cushioned during need following a few class parameters：
1）Network index class：Including average bandwidth, maximum bandwidth, packet loss number of times, number of retransmissions etc., network delay
2）Resource Properties class：Resource name, code check including request, code check rise and fall number of times etc.
3）User behavior class：Time shift, F.F. including user, pausing operation.
Therefore MOS calculates main according to above parameter, is drawn by certain data model and algorithm.
3rd, CDN（Content Delivery Network, i.e. content distributing network）Monitoring
Periodicity active testing is carried out to CDN node by video analysis equipment.Video analysis equipment can pass through Broadcast Control
The interface that platform is provided obtains the Token of certification.Contents for Monitoring includes EPG services and the order program service that POP points are provided.
Testing strategy, testing task can configure.
4th, intelligent expert storehouse
The warning message of terminal/CDN/ Broadcast Control platforms is mainly collected life by expertise library module according to knowledge base
Go out user into failure and intellectual analysis truly to perceive, not only draw failure cause, phenomenon of the failure, and decide whether according to severity
Notify attendant etc..
It is preliminary to report in the warning message input expertise rule parsing device that OTT terminals/CDN/ Broadcast Control platforms are reported
Alert information is carried out after cluster analysis, fuzzy matching is carried out using knowledge base rule of similarity, so as to obtain affiliated fault type of alarming.
By the fault type and the incoming user's perception analysis device of warning message, the analyzer is by failure and alarm
Video parameter input video information analyser, thus obtain the alarm failure to the user watched experience sense caused by.
User's perception analysis device experiences failure and user intelligence in the evaluation mechanism of the incoming intelligent trouble severity of result
The influence that the failure is caused to user can be evaluated, and decides whether to notify operation maintenance personnel.
Operation maintenance personnel confirms after failure and menace level notice is received and handles the failure.
5th, Efficient fault location algorithm
Failure effect analysis (FEA) is built upon on the basis of warning information, resource information and customer information synthesis, and failure is entered
Row temporal correlation, resource dependencies, the analysis of client's correlation.
Fault location strategy is main to carry out accident analysis positioning from 3 levels：OTT end sides, CDN side, Broadcast Control is put down
Platform side.
The monitoring threshold parameter that fault location is set according to operating personnel, when OTT terminal monitoring report and alarms, first
Detection set-top-box system situation, such as CPU, internal memory etc., if there is no problem, then in inquiry alarm t surrounding time section, terminal company
The CDN node and alarm, the performance data of Broadcast Control platform connect, further determines whether it is that CDN node or Broadcast Control platform are caused
The problem of.
If CDN node problem, then in the association analysis period, the receipts of the related OTT terminal users of the node are accessed
Optionally, with to the regional comprehensive analysis of CDN node service ability progress.
If the problem of Broadcast Control platform, the interactive information that the customer service recorded by Broadcast Control platform is asked enters one
Step analysis is which link in Broadcast Control platform goes wrong.
Fault location result can intuitively embody on the service link of OTT terminal users, help operation maintenance personnel quickly to send out
Existing root sex chromosome mosaicism.
Video flowing QoE parameter model
It is foundation objective indicator for the quality evaluation of video flowing, and assigns different weights, with reference to the true of people's observation
The obtained QoE indexs of experience.Video flowing QoE parameter model covers all levels of OSI seven layer models, as shown in Figure 3.
Under OTT video service quality guarantee systems, the monitoring of OTT business is mainly considered end from source to terminal to
End monitoring, schematic diagram such as Fig. 5.
First, film source quality-monitoring
Build film source skill in product platform side and examine system, to reaching the standard grade before piece source file detect.
2nd, CDN node is monitored
Platform side guarantee video file of reaching the standard grade meets content standard requirement, and the service ability of content distributing network is used terminal
The viewing experience at family also plays key effect.Video analysis equipment is disposed in CDN node, by pseudo-terminal to platform EPG
Testing is carried out with program, the service availability and service promptness of CDN node is reflected.
3rd, terminal monitoring
Gathered by terminal monitoring module and report relevant parameter, reflect user during using OTT video traffics
Viewing experience.Terminal monitoring emphasis is directed to Consumer's Experience and quality of service.
4th, fault locating analysis
The Real-time Alarm reported by terminal monitoring module, can be by inquiring about the peaceful stage piece source of same period CDN testings
The result of detection, helps user to carry out fault location.
5th, statistical analysis
The data reported for film source, CDN platforms, terminal monitoring module, system carries out comprehensive statistical analysis.
As shown in figure 1, the present invention's realizes that the system that OTT quality of services are ensured includes based on user behavior analysis：
Film source quality-monitoring module, in product platform side to reaching the standard grade before piece source file detect；
Content delivery network node monitoring modular, in each content delivery network node by pseudo-terminal to platform
Electric program menu and program carry out testing；
Terminal monitoring module, to gather user using the rating parameter in OTT business procedures and according to described
Rating parameter calculates Consumer's Experience video quality score；
Fault locating analysis module, when described terminal monitoring module alarm, to be supervised according to described film source quality
The monitoring state for surveying module and content delivery network node monitoring modular is positioned to failure；
Expertise library module, to according to described film source quality-monitoring module, terminal monitoring module and fault location
Analysis module warning message analysis fault type and user viewing experience information and when fault severity level exceed system
Operation maintenance personnel is notified during preset value；
Described expertise library module includes：
Expertise rule parsing device, to according to described film source quality-monitoring module, terminal monitoring module and failure
The warning message analysis fault type of positioning analysis module；
User's perception analysis device, to according to described film source quality-monitoring module, terminal monitoring module and fault location
The warning message of analysis module analyzes the viewing experience information of user；
Failure severity evaluator, to be analyzed failure severity and worked as fault severity level more than systemic presupposition
Operation maintenance personnel is notified during value.
The present invention's realizes that the method that OTT quality of services are ensured comprises the following steps based on user behavior analysis：
（1）Piece source file of the described film source quality-monitoring module before product platform side is to reaching the standard grade is detected；
（2）Described content delivery network node monitoring modular passes through pseudo-terminal pair in each content delivery network node
Platform clectronic program guide and program carry out testing；
（3）Rating parameter of the described terminal monitoring module collection user in using OTT business procedures and according to program
Initial buffer duration, program buffer duration during playing and the ratio and program of playing duration buffer frequency calculating user's body again
Test video quality score；
（31）Described expertise library module is according to described film source quality-monitoring module, terminal monitoring module and failure
Positioning analysis module warning message analysis fault type and user viewing experience information and when fault severity level exceedes
Operation maintenance personnel is notified during systemic presupposition value；
（4）When described terminal monitoring module alarm, described fault locating analysis module is according to described film source matter
The monitoring state of amount monitoring modular and content delivery network node monitoring modular is positioned to failure；Specifically include following five
Sub-step：
（41）Whether the described set top box of described fault locating analysis module detection normally runs, if it is, continuing
Step（42）, otherwise determine abort situation in described set top box；
（42）Described fault locating analysis module judges that the alarm moment is front and rear in preset time range, described content
Whether the monitoring state of distribution network node monitors module is faulty, if it is, continuing step（43）, otherwise continue step
（44）；
（43）Described fault locating analysis module is according to the monitoring shape of described content delivery network node monitoring modular
State and Consumer's Experience video quality score carry out regional comprehensive analysis to described content delivery network node service ability；
（44）Described fault locating analysis module judges whether Broadcast Control platform normally runs, if it is not, then continuing step
（45）；
（45）The interactive information that described fault locating analysis module is asked according to customer service analyzes the event of playing platform
Hinder link.
As shown in figure 4, described expertise library module is according to described film source quality-monitoring module, terminal monitoring module
With the warning message analysis fault type of fault locating analysis module and the viewing experience information of user and when the serious journey of failure
Degree notifies operation maintenance personnel when exceeding systemic presupposition value, comprises the following steps：
（311）Described expertise rule parsing device receives warning message and described expert is judged by cluster analysis
It whether there is the described corresponding fault type of warning message in knowledge base, if it is, continuing step（312）, otherwise, continue
Step（313）；
（312）Described expertise rule parsing device knowledge based storehouse rule of similarity is carried out described in fuzzy matching determination
The corresponding fault type of warning message, then proceedes to step（314）；
（313）Described expertise rule parsing device creates new fault type according to described warning message, then
Continue step（314）；
（314）Described user's perception analysis device tidies up the parameter evaluation failure pair according to described fault type and user
The influence that user causes；
（315）Described failure severity evaluator failure severity is analyzed and work as fault severity level exceed be
Operation maintenance personnel is notified during system preset value.
Employ in the invention and the system and method that OTT quality of services are ensured is realized based on user behavior analysis, have
Following beneficial effect：
OTT quality of services based on user behavior analysis ensure that invention helps OTT business operation maintenance personnel to monitor OTT industry in real time
Business is distributed to the operation conditions of the links such as user terminal sight from film source production, Broadcast Control, CDN content, quickly finds and positions
Problem, General Promotion Consumer's Experience ensures the long-run development of OTT core business, to realize that enterprise operation target provides strong branch
Support means, with wider application.
Its advantage is mainly reflected in the following aspects：
1st, active O＆M, finds and handling failure prior to user, lifts Consumer's Experience；
2nd, Real-time Alarm, helps operation maintenance personnel quick response emphasis failure；
3rd, the service ability to CDN node is effectively assessed, and is easy to entire content to push the planning of network；
4th, terminal monitoring reflects the actual experience of OTT user；
5th, full process and full network, realizes integrated management；Accurate intelligence, realizes that operation is excellent.
In this description, the present invention is described with reference to its specific embodiment.But it is clear that can still make
Various modifications and alterations are without departing from the spirit and scope of the present invention.Therefore, specification and drawings are considered as illustrative
And it is nonrestrictive.
Claims (7)
1. a kind of realize the system that OTT quality of services are ensured based on user behavior analysis, it is characterised in that described system bag
Include：
Film source quality-monitoring module, in product platform side to reaching the standard grade before piece source file detect；
Content delivery network node monitoring modular, in each content delivery network node by pseudo-terminal to platform clectronic
Program guide and program carry out testing；
Terminal monitoring module, to gather user using the rating parameter in OTT business procedures and according to described rating
Parameter calculates Consumer's Experience video quality score；
Fault locating analysis module, to when described terminal monitoring module alarm, according to described film source quality-monitoring mould
The monitoring state of block and content delivery network node monitoring modular is positioned to failure；
Realize that the processing that OTT quality of services are ensured is operated by described system, comprise the following steps：
(1) piece source file of the film source quality-monitoring module before product platform side is to reaching the standard grade described in is detected；
(2) content delivery network node monitoring modular described in is in each content delivery network node by pseudo-terminal to platform
Electric program menu and program carry out testing；
(3) the terminal monitoring module collection user described in is using the rating parameter in OTT business procedures and according to described receipts
Consumer's Experience video quality score is calculated depending on parameter；
(4) when described terminal monitoring module alarm, described fault locating analysis module is supervised according to described film source quality
The monitoring state for surveying module and content delivery network node monitoring modular is positioned to failure；
Wherein, described fault locating analysis module is supervised according to described film source quality-monitoring module and content delivery network node
The monitoring state for surveying module is positioned to failure, is comprised the following steps：
(41) whether the fault locating analysis module detection set top box described in normally runs, if it is, continue step (42), it is no
Then determine abort situation in described set top box；
(42) the fault locating analysis module described in judges that the alarm moment is front and rear in preset time range, described content distribution
Whether the monitoring state of network node monitoring modular is faulty, if it is, continuing step (43), otherwise continues step (44)；
(43) fault locating analysis module described according to the monitoring state of described content delivery network node monitoring modular and
Consumer's Experience video quality score carries out regional comprehensive analysis to described content delivery network node service ability；
(44) the fault locating analysis module described in judges whether Broadcast Control platform normally runs, if it is not, then continuing step (45)；
(45) interactive information that the fault locating analysis module described in is asked according to customer service analyzes the failure ring of playing platform
Section.
2. according to claim 1 realize the system that OTT quality of services are ensured based on user behavior analysis, its feature exists
In described system also includes：
Expertise library module, to according to described film source quality-monitoring module, terminal monitoring module and fault locating analysis
Module warning message analysis fault type and user viewing experience information and when fault severity level exceed systemic presupposition
Operation maintenance personnel is notified during value.
3. according to claim 2 realize the system that OTT quality of services are ensured based on user behavior analysis, its feature exists
In described expertise library module includes：
Expertise rule parsing device, to according to described film source quality-monitoring module, terminal monitoring module and fault location
The warning message analysis fault type of analysis module；
User's perception analysis device, to according to described film source quality-monitoring module, terminal monitoring module and fault locating analysis
The warning message of module analyzes the viewing experience information of user；
Failure severity evaluator, to be analyzed failure severity and when fault severity level exceedes systemic presupposition value
Notify operation maintenance personnel.
4. a kind of system by any one of claims 1 to 3 realizes that OTT quality of services are protected based on user behavior analysis
The method of barrier, it is characterised in that described method comprises the following steps：
(1) piece source file of the film source quality-monitoring module before product platform side is to reaching the standard grade described in is detected；
(2) content delivery network node monitoring modular described in is in each content delivery network node by pseudo-terminal to platform
Electric program menu and program carry out testing；
(3) the terminal monitoring module collection user described in is using the rating parameter in OTT business procedures and according to described receipts
Consumer's Experience video quality score is calculated depending on parameter；
(4) when described terminal monitoring module alarm, described fault locating analysis module is supervised according to described film source quality
The monitoring state for surveying module and content delivery network node monitoring modular is positioned to failure；
Described fault locating analysis module monitors mould according to described film source quality-monitoring module and content delivery network node
The monitoring state of block is positioned to failure, is comprised the following steps：
(41) whether the fault locating analysis module detection set top box described in normally runs, if it is, continue step (42), it is no
Then determine abort situation in described set top box；
(42) the fault locating analysis module described in judges that the alarm moment is front and rear in preset time range, described content distribution
Whether the monitoring state of network node monitoring modular is faulty, if it is, continuing step (43), otherwise continues step (44)；
(43) fault locating analysis module described according to the monitoring state of described content delivery network node monitoring modular and
Consumer's Experience video quality score carries out regional comprehensive analysis to described content delivery network node service ability；
(44) the fault locating analysis module described in judges whether Broadcast Control platform normally runs, if it is not, then continuing step (45)；
(45) interactive information that the fault locating analysis module described in is asked according to customer service analyzes the failure ring of playing platform
Section.
5. according to claim 4 realize the method that OTT quality of services are ensured based on user behavior analysis, its feature exists
In the rating parameter described in described basis calculates Consumer's Experience video quality score, is specially：
The ratio and program that duration and playing duration are buffered during being played according to program initial buffer duration, program buffer frequency again
Secondary calculating Consumer's Experience video quality score.
6. according to claim 4 realize the method that OTT quality of services are ensured based on user behavior analysis, its feature exists
In described system also includes expertise library module, further comprising the steps of between described step (3) and (4)：
(31) the expertise library module described in is according to described film source quality-monitoring module, terminal monitoring module and fault location
Analysis module warning message analysis fault type and user viewing experience information and when fault severity level exceed system
Operation maintenance personnel is notified during preset value.
7. according to claim 6 realize the method that OTT quality of services are ensured based on user behavior analysis, its feature exists
In described expert knowledge library includes expertise rule parsing device, user's perception analysis device and failure severity evaluator, institute
The expertise library module stated is according to described film source quality-monitoring module, terminal monitoring module and fault locating analysis module
Warning message is analyzed the viewing experience information of fault type and user and led to when fault severity level exceedes systemic presupposition value
Know operation maintenance personnel, comprise the following steps：
(311) the expertise rule parsing device described in receives warning message and described expertise is judged by cluster analysis
It whether there is the described corresponding fault type of warning message in storehouse, if it is, continuing step (312), otherwise, continue step
(313)；
(312) the expertise rule parsing device knowledge based storehouse rule of similarity described in carries out fuzzy matching and determines described alarm
The corresponding fault type of information, then proceedes to step (314)；
(313) the expertise rule parsing device described in creates new fault type according to described warning message, then proceedes to
Step (314)；
(314) user's perception analysis device described in tidies up the parameter evaluation failure to user according to described fault type and user
The influence caused；
(315) the failure severity evaluator described in failure severity is analyzed and work as fault severity level more than system it is pre-
If notifying operation maintenance personnel during value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410092349.2A CN103856789B (en) | 2014-03-13 | 2014-03-13 | The system and method that OTT quality of services are ensured is realized based on user behavior analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410092349.2A CN103856789B (en) | 2014-03-13 | 2014-03-13 | The system and method that OTT quality of services are ensured is realized based on user behavior analysis |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103856789A CN103856789A (en) | 2014-06-11 |
| CN103856789B true CN103856789B (en) | 2017-07-14 |
Family
ID=50863929
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410092349.2A Active CN103856789B (en) | 2014-03-13 | 2014-03-13 | The system and method that OTT quality of services are ensured is realized based on user behavior analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103856789B (en) |
Families Citing this family (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105848174B (en) * | 2015-01-16 | 2019-10-29 | 中国移动通信集团浙江有限公司 | A kind of method and apparatus of detection user online perception |
| CN105898427B (en) * | 2016-03-29 | 2019-07-26 | 天脉聚源(北京)传媒科技有限公司 | A kind of method and apparatus that set-top box login positions extremely |
| CN105827447A (en) * | 2016-03-31 | 2016-08-03 | 乐视控股（北京）有限公司 | Service alarm method and apparatus |
| CN107509121B (en) * | 2016-06-14 | 2020-06-02 | 华为技术有限公司 | Method and device for determining video quality and method and device for positioning network fault |
| CN105978910A (en) * | 2016-07-14 | 2016-09-28 | 中国联合网络通信集团有限公司 | Video service quality index generating method, device and system |
| TWI625623B (en) * | 2016-09-30 | 2018-06-01 | Chunghwa Telecom Co Ltd | Digital service component quality information assembly and correlation analysis method |
| CN108243446B (en) * | 2016-12-27 | 2021-07-13 | 中国移动通信集团浙江有限公司 | Network communication problem judgment processing method and device |
| CN106603340A (en) * | 2016-12-28 | 2017-04-26 | 成都网丁科技有限公司 | Active dial testing method and system of CDN quality |
| CN107087159B (en) * | 2017-04-18 | 2018-12-28 | 天津市德力电子仪器有限公司 | The assessment device and appraisal procedure of IPTV and OTT video quality |
| CN107231552A (en) * | 2017-05-09 | 2017-10-03 | 复旦大学 | A kind of mass monitoring system towards ultra high-definition video request program |
| CN108174286B (en) * | 2017-12-27 | 2021-02-09 | 北京奇艺世纪科技有限公司 | Video code stream processing method and device |
| CN110087101B (en) * | 2018-01-25 | 2022-01-21 | 北京市博汇科技股份有限公司 | Interactive video quality monitoring method and device |
| CN108876098A (en) * | 2018-04-28 | 2018-11-23 | 北京奇艺世纪科技有限公司 | Determine the method and device of user quality |
| CN108933694B (en) * | 2018-06-09 | 2021-11-09 | 西安电子科技大学 | Data center network fault node diagnosis method and system based on dial testing data |
| CN110896544B (en) * | 2018-09-13 | 2023-04-25 | 中国移动通信集团山东有限公司 | Fault delimiting method and device |
| CN110944232B (en) * | 2018-09-21 | 2021-11-19 | 中国移动通信有限公司研究院 | Method and device for monitoring cognitive behaviors and set top box |
| CN111918103B (en) * | 2019-05-08 | 2022-06-14 | 中国移动通信集团福建有限公司 | Internet television service fault determination method and equipment and internet television service system |
| CN110213572A (en) * | 2019-06-13 | 2019-09-06 | 上海佰贝科技发展股份有限公司 | A kind of filtering false alarm method in broadcast link |
| CN112104470A (en) * | 2019-06-18 | 2020-12-18 | 中国移动通信有限公司研究院 | Network equipment fault positioning method and digital home service analysis platform |
| CN112995648B (en) * | 2019-12-13 | 2023-10-27 | 中国移动通信集团辽宁有限公司 | Internet television full-flow fault diagnosis method and device and computing equipment |
| CN111586475B (en) * | 2020-05-27 | 2022-05-06 | 飞思达技术（北京）有限公司 | IPTV and OTT live broadcast audio and video quality and perception evaluation system |
| CN114244691A (en) * | 2020-09-09 | 2022-03-25 | 中国移动通信有限公司研究院 | Video service fault positioning method and device and electronic equipment |
| CN113630285A (en) * | 2020-11-11 | 2021-11-09 | 中国移动通信有限公司研究院 | Broadband network quality diagnosis method, device and system |
| CN114584760A (en) * | 2022-03-01 | 2022-06-03 | 湖南快乐阳光互动娱乐传媒有限公司 | Media asset dial testing method and related equipment |
| CN115002518B (en) * | 2022-05-30 | 2024-03-22 | 咪咕视讯科技有限公司 | Data monitoring method, device and computer readable storage medium |
| CN115834940A (en) * | 2022-11-14 | 2023-03-21 | 浪潮通信信息系统有限公司 | IPTV/OTT end-to-end data reverse acquisition analysis method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102143389A (en) * | 2011-04-22 | 2011-08-03 | 赛特斯网络科技(南京)有限责任公司 | Quality assurance (QA) system and method of internet protocol television (IPTV) services |
| CN103036707A (en) * | 2012-11-27 | 2013-04-10 | 赛特斯网络科技(南京)有限责任公司 | Portable diagnostic device of internet protocol television (IPTV) business service quality and diagnostic method of IPTV business service quality |
| CN103236948A (en) * | 2013-04-24 | 2013-08-07 | 中国电信股份有限公司重庆分公司 | Telecommunication network alarm method and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130326551A1 (en) * | 2012-05-30 | 2013-12-05 | Debdeep CHATTERJEE | Wireless multimedia quality of experience reporting |
-
2014
- 2014-03-13 CN CN201410092349.2A patent/CN103856789B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102143389A (en) * | 2011-04-22 | 2011-08-03 | 赛特斯网络科技(南京)有限责任公司 | Quality assurance (QA) system and method of internet protocol television (IPTV) services |
| CN103036707A (en) * | 2012-11-27 | 2013-04-10 | 赛特斯网络科技(南京)有限责任公司 | Portable diagnostic device of internet protocol television (IPTV) business service quality and diagnostic method of IPTV business service quality |
| CN103236948A (en) * | 2013-04-24 | 2013-08-07 | 中国电信股份有限公司重庆分公司 | Telecommunication network alarm method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103856789A (en) | 2014-06-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103856789B (en) | The system and method that OTT quality of services are ensured is realized based on user behavior analysis | |
| US10841358B2 (en) | System and method for determining quality of a media stream | |
| Duanmu et al. | A quality-of-experience index for streaming video | |
| JP5051252B2 (en) | Network failure detection system | |
| CN107277160A (en) | A kind of content delivery network node switching method and device | |
| US8537683B2 (en) | Method for estimating the quality of experience of a user in respect of audio and/or video contents distributed through telecommunications networks | |
| CN103813160B (en) | Video quality method for supervising and device | |
| CN110943874B (en) | Fault detection method, device and readable medium for home broadband network | |
| CN112584192B (en) | Network quality monitoring method and device and server | |
| EP2741439B1 (en) | Network failure detecting method and monitoring center | |
| CN107743228A (en) | Video quality detection method, monitoring device and storage medium | |
| CN112583642B (en) | Abnormality detection method, abnormality detection model, electronic device, and computer-readable storage medium | |
| CN107231552A (en) | A kind of mass monitoring system towards ultra high-definition video request program | |
| CN103974139A (en) | Method and device for detecting network faults of terminal and system | |
| US20110090346A1 (en) | Remote video device monitoring | |
| Dinaki et al. | Deep learning-based fault localization in video networks using only client-side QoE | |
| Shaikh et al. | Modeling and analysis of web usage and experience based on link-level measurements | |
| CN110838949B (en) | Network traffic log recording method and device | |
| CN110198230A (en) | Monitoring method, device, storage medium and the electronic device of application | |
| CN108668123A (en) | A kind of acquisition methods and network element device of video tastes evaluation result | |
| CN106789209A (en) | Abnormality eliminating method and device | |
| CN114071232B (en) | Audio and video quality visualization method and device, equipment, medium and product thereof | |
| JP5379078B2 (en) | User experience quality monitoring apparatus, method, and information communication system | |
| CN113382232A (en) | Method, device and system for monitoring audio and video quality and electronic equipment | |
| US7366160B2 (en) | Method of determining service trends |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: BEIJING MEIQI HUAYUE COMMUNICATION TECHNOLOGY CO., Free format text: FORMER OWNER: CERTUS INFORMATION TECHNOLOGY CO., LTD. Effective date: 20140808 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: 210042 NANJING, JIANGSU PROVINCE TO: 100052 XUANWU, BEIJING |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20140808 Address after: 100052, Beijing, Xuanwu, No. 10, 1015 square Avenue, central office building, north wing, room 10 Applicant after: BEIJING MEIQI HUAYUE COMMUNICATION TECHNOLOGY CO., LTD. Address before: 210042 Xuanwu District, Xuanwu District, Jiangsu, Nanjing, No. 699-22, building 18 Applicant before: CERTUSNET CORP. |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160314 Address after: 100086 Beijing city Haidian District Zhongguancun academy road section Information Center No. 2 B block 8 layer Applicant after: BEIJING CERTUSNET INFORMATION TECHNOLOGY CO., LTD. Address before: 100052, Beijing, Xuanwu, No. 10, 1015 square Avenue, central office building, north wing, room 10 Applicant before: BEIJING MEIQI HUAYUE COMMUNICATION TECHNOLOGY CO., LTD. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |