CN108200471A - A kind of construction method for the standard data set for evaluating and testing encrypted video QoE - Google Patents
A kind of construction method for the standard data set for evaluating and testing encrypted video QoE Download PDFInfo
- Publication number
- CN108200471A CN108200471A CN201810016344.XA CN201810016344A CN108200471A CN 108200471 A CN108200471 A CN 108200471A CN 201810016344 A CN201810016344 A CN 201810016344A CN 108200471 A CN108200471 A CN 108200471A
- Authority
- CN
- China
- Prior art keywords
- video
- terminal
- data
- network
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/4508—Management of client data or end-user data
- H04N21/4516—Management of client data or end-user data involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N21/4756—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
- H04N21/64738—Monitoring network characteristics, e.g. bandwidth, congestion level
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Computer Security & Cryptography (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a kind of construction methods for the standard test data set for evaluating and testing encrypted video QoE, it is characterized in building universal data collection platform, coordinated by terminal applies and HTTP server, video network data, video QoE parameters and user MOS scorings during HTTP server single-point can acquire mobile terminal viewing video simultaneously, realize standard data set structure.The data acquisition modes being combined due to the present invention using distributed feedback drive test terminal with VPN centralizations and the standard data set construction method based on data flow, therefore the present invention can easily support the data of crowdsourcing model to acquire, and suitable for the encryption based on TCP and udp protocol and non-encrypted video traffic, the true comprehensive and completeness of the data set of structure is good, so as to overcome the shortcomings of available data collection construction method.
Description
Technical field
The invention belongs to mobile communication network technology fields, and in particular to mobile network-oriented operator/equipment vendor carries out
The construction method of the standard data set of encrypted video QoE evaluation and tests.
Background technology
Provide the starting point that good experience and guarantee are carrier network optimization, Mobile Network Operator/equipment to the user
Quotient increasingly pays close attention to the assessment of mobile video quality of service.In recent years, popularizing with 3G/4G networks, mobile network video obtains
Swift and violent development is arrived.It, will to flow caused by mobile video business in 2021 according to the statistical forecast in 2016 of Cisco of the U.S.
Account for more than 75% mobile flow.The mobile video business of mainstream is based on HTTP self adaptation streams (HTTP Adaptive at present
Stream, HAS).But with attention of the people to privacy of user, more and more content suppliers start to its video content into
Row encrypted transmission.Therefore, the comprehensive data set of support mobile video evaluation the quality is obtained, has become mobile network's fortune
The problem of seeking quotient/equipment vendor's urgent need to resolve.
Objective Video quality of service, user experience should at least be included by supporting the data set of mobile video evaluation the quality
(Quality of Experience, QoE) quality and network data.Objective quality of service refers to the objective of video traffic
Quality index, the common initial buffer including video, interim card, clarity and fluency.Video traffic QoE refers to video industry
The subjective perception experience of business, the five-grade marking system subjectivity mean opinion score (the Mean Opinion generally proposed at present using ITU-T
Score, MOS), by the way that QoE is analyzed from difference to being quantified as 1~5 point well.For example, the U.S. " Mobile in 2014
" the Prometheus that Computing Systems and Applications " meetings are included:toward quality-of-
Experience estimation for mobile apps from passive network measurements " combine
Terminal testing and core net actively measure, and user experience parameter (QoE Metrics) are obtained from end side, at the beginning of mainly including video
Begin buffering and interim card, and obtaining IP/TCP stream rank statistics network quality (Quality of Service, QoS) from core net joins
Number uses the technique study qos parameter of machine learning and the relationship of QoE parameters.In addition to this, also many other research
It person or exploitation metadata acquisition tool or constructs on the basis of obtaining data with content supplier/network operator's cooperation
Experimental data set has carried out similar research and has achieved certain achievement in research.For example, it is embodied in Europe in 2015
" the YoMoApp of " European Conference on Networks and Communications ":A tool for
Analyzing QoE of You Tube HTTP adaptive streaming in mobile networks ", the tool
Be only capable of terminal acquire QoE parameters, mainly include video initial buffer, interim card, it is impossible to obtain video traffic network data and
User MOS.Dutch periodical " Computer Communications " " the Network-based video included in 2017
Freeze detection and prediction in HTTP adaptive streaming ", under non-encrypted scene from
The content delivery network service device of content supplier obtains video playing daily record, passes through decompiling official terminal in the case where encrypting scene
Video playing daily record is obtained using (Application, APP), mainly includes the segment information of video and interim card information.But they
At present all there are one it is common the problem of：Experimental data set acquisition still has difficulty, the particularly feelings in video-encryption transmission
Under condition, the complete experimental data set of terminal video QoE parameters, network data and user MOS can not be obtained simultaneously.
Invention content
The present invention proposes a kind of construction method for the standard data set for evaluating and testing encrypted video QoE, builds universal data collection
Platform is coordinated by terminal APP and HTTP server, can acquire mobile terminal viewing video process simultaneously on HTTP server
In video network data, video QoE parameters and user MOS scoring, realize standard data set structure, so as to overcome existing reality
Test the deficiency of data set construction method.
The construction method of the standard data set of present invention evaluation and test encrypted video QoE, by way of mobile terminal drive test, is adopted
Video, user and network data structure standard data set under set network in mobile video traffic watching process, feature
It is：It is mutually tied by distributed feedback drive test terminal and the centralized data acquisitions of VPN (Virtual Private Network)
It closes, data acquisition platform can only acquire video, user and the network data needed for structure data set in HTTP server side；HTTP
Server uses IP-based data acquisition modes to be suitable for the encryption of various IP/TCP and IP/UDP agreements and non-encrypted shifting
Dynamic data service；Concrete operation step is：
(1) mobile terminal accesses data acquisition platform by way of VPN agencies, opens terminal APP selection videos and carries out
Viewing；
(2) terminal APP is obtained includes terminal brand and model, operating system, Termination ID, network used in viewing video
Simultaneously video playing daily record is recorded in end message including operator, network access mode, IP address of terminal and signal strength values；
Wherein network operator includes mobile, unicom and telecommunications, and network access mode includes 3G, 4G and WIFI, and IP address of terminal is sees
The IP address of terminal when seeing video, signal strength values are quantified as 0~4 from weak to strong according to practical received signal strength；
(3) video information is obtained by terminal APP and video playing daily record is recorded, video information includes video ID, regards
The playable duration of frequency title and video；
(4) the user's operation behavior in video display process is recorded by terminal APP and broadcasting daily record, Yong Hucao is recorded
Make behavior to include suspending, redirect forward, redirect backward and stop to play；
(5) pass through the QoE parameters of terminal APP record mobile terminal network videos to broadcasting daily record；The QoE parameter masters of video
Will be mobile video business objective quality index, the first time slack including video prolongs, the interim card information of video, video resolution and
Video actual play duration；The first time slack of wherein video, which prolongs, to be referred to when playing passed through since user be played to clicking
Between, interim card information include video cardton at the time of and interim card duration；
(6) MOS that user is recorded by terminal APP scores, and journal file then is uploaded to HTTP server；Video is broadcast
Terminal APP prompts user to score when discharging into, experience of the user in watching process, by video tastes from difference to favorable comment
It is divided into 1~5；
(7) terminal APP provides automatic record screen function, and after the license of user, terminal APP can be to video display process
It realizes record screen, user is prompted to upload to HTTP service after completion to be played；
(8) it the network data during HTTP server crawl video-see and is associated with the terminal daily record of upload realization；
When user selects one video of viewing, terminal APP initiates " selection video " message to server, and server is according to movement at this time
The IP address crawl network packet of terminal；When video playing is completed, terminal APP initiates " finishing playing " to server and disappears
Breath, at this time server stop as the mobile terminal packet capturing, and by the network data file of preservation and the terminal daily record received into
Row association；
(9) data analytic construction standard data set：The HAS videos carried first according to differing transmission protocols are from HTTP service
Different qos parameters is extracted in the network data of device crawl, including：Under being extracted to the HAS video networks data carried based on TCP
Row real time rate, packet loss and round-trip delay (Round Trip Time, RTT) parameter, to the network data that is carried based on UDP only
Extract downstream rate parameter；Then the synchronization message of HTTP server is reported to according to terminal APP timings, by terminal daily record with
Qos parameter realizes time synchronization；End message, video information, user's operation behavior, video QoE parameters, user will finally be included
MOS scores and the standard data set of network QoS parameter saves as file or deposit database.
Present invention evaluation and test is suitable for the construction method of the standard data set of encrypted video QoE, distributed due to taking
The data acquisition modes that feedback drive test terminal is combined with VPN centralizations, the architecture design of data acquisition platform support crowd
The data acquisition for the crowdsourcing model (Crowdsourcing) that multi-user tests simultaneously；Data acquisition is efficiently convenient, watches video mistake
In journey terminal APP record automatically screen, recording played state and prompting user score to form journal file and be automatically uploaded to HTTP clothes
Business device in HTTP server single-point acquiring can obtain and related network data, video QoE parameters and MOS score automatically；Data
Dimensional information is comprehensive, and other than network data, video QoE parameters and MOS score, data set further includes end message, video letter
Breath, user's operation behavior and record screen file；Collecting method autgmentability is strong, the data set construction method tool based on data flow
There is versatility, the structure of the standard exercise data set under video QoE evaluation and tests is encrypted in mobile network-oriented operator/equipment vendor
Method is suitable for encryption and non-encrypted video traffic based on TCP and udp protocol.The method have the advantages that：
(1) compared to the common single-point/multi-point data acquisition of traditional mobile video business, since data of the present invention acquisition is flat
Platform is combined by terminal APP and HTTP server, only can obtain video network data, terminal simultaneously in HTTP server single-point
Information, video information, QoE parameters, user's operation behavior, MOS score datas and record screen file, data acquisition are convenient and true
Comprehensively.
(2) present invention develops the independent Android and IOS mobile terminals for being suitable for mainstream and supporting HAS video websites
APP.For the video website of open programming interface, terminal APP directly realizes video playing by interface；For being programmed without open
The website of interface, APP realize video playing by the address of video that web crawlers obtains.Pass through both modes, terminal APP
Realize the support to more major video website.
(3) authentic and valid QoE parameters can just be obtained by simple interactive operation and user MOS scores.It is broadcast in video
Terminal APP records the broadcast state of video and is saved in journal file automatically during putting, and video broadcasting condition includes video QoE
Parameter and user's operation behavior.At the end of video playing, terminal APP automatically prompting users score to the video of viewing, then will
The video playing journal file of formation is reported to HTTP server.
(4) the record screen file support of terminal APP is repeatedly scored having watched video, and then obtains more accurate use
Family MOS scores.
(5) present invention develops the HTTP server based on C++, can be respectively the video that is played of each access terminal from
Dynamic crawl network data, and the video playing journal file and record screen file that report with terminal are realized and are associated with.Simultaneously go back multiple access,
It is mostly concurrent, it supports to carry out extensive data acquisition by way of Crowdsourcing.
(6) HTTP server carries out data acquisition, this IP-based data acquisition modes according to IP address of mobile terminal
It can be widely applicable for the encryption of various IP/TCP and IP/UDP agreements and non-encrypted mobile data services.
Description of the drawings
Fig. 1 is the network topology schematic diagram of the data acquisition platform of the embodiment of the present invention 1.
Fig. 2 is that the data acquisition platform terminal APP of the embodiment of the present invention 1 and HTTP server cooperative work principle are illustrated
Figure.
Fig. 3 is 2 data resolving schematic diagram of the embodiment of the present invention.
Fig. 4 is the time synchronization principle schematic in 2 data resolving of the embodiment of the present invention.
Specific embodiment
The construction method that present invention evaluation and test is suitable for the standard data set of evaluation and test encrypted video QoE is mainly acquired comprising data
Platform and data parsing, are further specifically introduced below by drawings and examples.
Embodiment 1：
Present embodiments provide structure side of the network-oriented operator evaluation and test suitable for the standard data set of encrypted video QoE
The universal data collection platform of method and the data acquisition based on data acquisition platform, Fig. 1 are that the data of the present embodiment are adopted
Collect the network topology schematic diagram of platform.As shown in Figure 1, mobile terminal can access major video website by two ways：(a)
By way of VPN agencies, using mobile terminal A1 by VPN proxy server A3, using switch A 5 and HTTP service
Device A7, which is realized, accesses major video website；(b) by way of local area network wireless routing, pass through no circuit using mobile terminal A2
By A4, realized using switch A 5 and HTTP server A7 and access major video website.It watches during video, is taken in HTTP
Network data, terminal video broadcast state and user's MOS score datas are actively acquired on the network interface card 1 of business device A7.The data are adopted
Collect platform to include with lower module：
Data acquisition LAN A8 as shown in Figure 1 provides access and the reality by way of network share for mobile terminal
Now to the access of major video website, mainly by vpn server A3, wireless routing A4, switch A 5, Windows server As 6
It is formed with HTTP server A7.Data acquisition LAN A8 can be configured to arbitrary Class C IP address, is configured as in Fig. 1
192.168.137.0/24 the network segment.Wherein vpn server A3 is the double netcard vpn server built based on Linux, switch A 5
For gigabit L2 interchangers, domain and Dynamic Host Configuration Protocol server of the Windows server As 6 for LAN, HTTP server A7 is double netcard
Windows servers.Public network IP is configured in the network interface card 0 of vpn server A3, and VPN accesses, 1 configuration office of network interface card are provided for mobile terminal
Net IP in domain.LAN IP is configured in the network interface card 1 of HTTP server A7, and as the gateway of LAN, and public network IP is configured in network interface card 0, can
To access major video website.By on vpn server A3 configuration strategy route, the data of network interface card 0 can pass through 1 turn of network interface card
The network interface card 1 of HTTP server A7 is dealt into, then by way of sharing network with HTTP server A7 network interface cards 0, HTTP server A7
Network interface card 1 can access major video website, thereby realize and access major video website by way of VPN agencies (a)；
Mobile terminal A2 is directly connected to wireless routing A4, you can realizes that (b) accesses major video by way of local area network wireless routing
Website.Data acquisition LAN A8 can be supported more in this way with expanded configuration more vpn server A3 and HTTP server A7
VPN user's access and higher network bandwidth be provided access major video website, be applicable to larger scale data acquisition.
Fig. 2 is the data acquisition platform terminal APP of the present embodiment and HTTP server cooperative work principle schematic.Such as figure
The mobile terminal A1 or A2 of data acquisition platform shown in 2 and the principle of HTTP server A7 cooperative works：Mobile terminal APP
Comprising Android and ios release, the APP of Android versions is developed based on Java, and the APP of ios release is developed based on Swift.
HTTP server is the client/server based on Microsoft Foundation class libraries (Microsoft Foundation Classes, MFC)
The HTTP server of (Client/Server, C/S) pattern, using completing port technology (I/O Completion Port,
IOCP), can meet the needs of multi-mobile-terminal, multi-connection is concurrent.Start HTTP server, monitor terminal APP connections first
Ask C1, while terminal connection VPN or LAN WIFIB1.When terminal APP initiates the connection B2, while start synchronizing thread timing
It sends synchronizing information B10 and sends end message B3, HTTP server record terminal IP C2, and receive end message at this time
C3.Then user selects video source B4 and to send video information B5, and HTTP server is according to the terminal IP and terminal of reception at this time
Information starts packet capturing thread C4 crawls address and is the network packet C6 of IP, and receive video information C5.Then terminal APP
Video enters broadcast state B6, and completion to be played or user terminate terminal APP promptings user's scoring B7 after playing.
Terminal APP records video broadcasting condition, user's scoring, video information, end message to regarding automatically in whole process
Frequency plays daily record, and terminal APP uploads daily record B8 after treating user's scoring, and accordingly HTTP server receives APP daily records C7 and protects
It is stored to local.If user continues to watch, user continues to select video source B4, otherwise step after repeating terminates B9 and closes
Close synchronizing thread and terminal APP.It should be noted that treat that daily record uploads later no matter user's selection continues to watch video or knot
Beam, HTTP server can terminate packet capturing thread C8, and the network packet captured is saved as file and and video playing
Daily record is associated with C8, finally obtains in network data in a watching process, video playing daily record and video display process
Record screen file can obtain the standard data set C9 of evaluation and test encrypted video QoE using the parsing of further data.
Due to the IOCP technologies of use, HTTP server is still during being interacted with terminal APP for above-mentioned HTTP server
The connection request of other terminal APP can be so received simultaneously, i.e. HTTP server supports multiple terminals, how concurrent connection request, branch
It holds and extensive data acquisition is carried out by way of crowdsourcing.It watches during video, HTTP server is each for each terminal
Video acquires network data respectively, can be accurately by the broadcast state of each video and its network data pair by synchronizing information
It should get up.Due to HTTP server according to IP address acquire network data, so data acquisition platform be widely applicable for it is various
Encryption and non-encrypted mobile data services based on IP/TCP and IP/UDP agreements.
Embodiment 2：
Present embodiments provide the number of the construction method of the standard data set of network-oriented operator evaluation and test encrypted video QoE
Standard data set is built according to parsing.Fig. 3 is the data resolving schematic diagram of the present embodiment 2.As shown in Figure 3, in embodiment 1
On the basis of obtaining network data and terminal plays daily record, network data is parsed to obtain qos parameter and with playing daily record reality
Now synchronous structure standard test data set.
Network data D2 is the network data based on TCP/UDP agreements obtained by the data acquisition platform of Fig. 1, is preserved
File for PCAP forms.PCAP file formats are a kind of network packet storage format that Wireshark is supported, comprising primary
All-network data during video-see.Video playing daily record D1 is that terminal APP is recorded and uploaded automatically in embodiment 1
Daily record, your video broadcasting condition, user's scoring, video information, end message.
Data parsing parses network QoS parameter D3 first from PCAP files, the synchronizing information then initiated by terminal
Video playing daily record D1 and qos parameter D3 times are synchronized.TCP network QoS parameters D3 is time series, including lower scanning frequency
Rate, downlink packet loss and round-trip delay, UDP only include downstream rate time series.Statistical interval Δ t may be configured as in embodiment
0.1st, 0.5 or 1 second.Downstream rate (rate), packet loss (loss) and round-trip delay (rtt) statistical method wherein in the time
It is as follows：
V is the downlink data amount in the Δ t times, and lostPkt and N are downlink packet loss and total downlink data packet in the Δ t times
Quantity, rttiIt is i-th of downlink data packet in the time from being issued to the time delay being identified.
Since mobile terminal time and HTTP server time are there may be deviation, so needing to be initiated according to terminal same
Message is walked further by video playing daily record and above-mentioned time series synchronization, Fig. 4 is given in the present embodiment data resolving
Time synchronization principle schematic.In Fig. 4, terminal time is represented with ti, i=1,2...n；Ti, i=1,2...n represent HTTP
Server time；Synchronization message i, i=1,2...n represent the synchronization message that terminal APP timings are initiated to HTTP server；Black
Triangle represents the broadcast state of terminal APP video players, including the use for redirecting forward, redirect, suspend and stop backward playing
The QoE parameters of family operation behavior and initial buffer and video cardton.As shown in Figure 4：Terminal APP terminal time t1,
T3, t4 and tn have initiated to have sent synchronization message 1, synchronization message 2, synchronization message 3, synchronization message n, and HTTP is in server time
T1, T3, T4 and Tn receive corresponding synchronization message.User has carried out " redirecting forward " operation after synchronization message 1, according to
Synchronization message 1 " should can forward redirect " playing status synchronism as HTTP server time T2, be expressed as：T2=t2+ (T1-
t1)；T5 the and t6 moment has recorded an interim card information of player：Interim card, t6 moment video playing knots occur for t5 moment video
Beam interim card starts to play, and t5 can use method same as described above synchronous for HTTP service respectively with t6 according to synchronization message 3
Device time T5 and T6；Other video broadcasting condition synchronous method are consistent with the above.The synchronous method is thought in synchronization message twice
Between, propagation delay time of the message from terminal APP to HTTP server is constant.
Qos parameter D3 and realization qos parameter D3 and the time synchronization of video playing daily record are obtained by parsing network data,
The standard test data set suitable for encrypted video QoE can be built.Standard test data set includes end message/video information
D4, user's operation behavior D5, MOS scoring D6, QoE parameter D7 and network QoS parameter D3；For the network QoS based on udp protocol
Parameter D3 is downlink network rate, and additional network RTT is further included for the standard test data set qos parameter D3 based on TCP
And packet loss.
Claims (1)
1. a kind of construction method for the standard data set for evaluating and testing encrypted video QoE, by way of mobile terminal drive test, acquires nothing
Video, user and network data structure standard data set under gauze network in mobile video traffic watching process, it is characterised in that：
It is combined by distributed feedback drive test terminal with the acquisition of VPN centralizations data, data acquisition platform is only in HTTP server
Side can acquire video, user and the network data needed for structure data set；HTTP server uses IP-based data acquisition side
Formula is to be suitable for the encryption of various IP/TCP and IP/UDP agreements and non-encrypted mobile data services；Concrete operation step is：
(1) mobile terminal accesses data acquisition platform by way of VPN agencies, opens terminal APP selection videos and is watched；
(2) terminal APP is obtained includes terminal brand and model, operating system, Termination ID, network operation used in viewing video
Simultaneously video playing daily record is recorded in end message including quotient, network access mode, IP address of terminal and signal strength values；Wherein
Network operator includes mobile, unicom and telecommunications, and network access mode includes 3G, 4G and WIFI, and IP address of terminal is regarded for viewing
The IP address of terminal during frequency, signal strength values are quantified as 0~4 from weak to strong according to practical received signal strength；
(3) video information is obtained by terminal APP and video playing daily record is recorded, video information includes video ID, video name
Claim the playable duration with video；
(4) the user's operation behavior in video display process is recorded by terminal APP and broadcasting daily record is recorded, user's operation row
It is to include suspending, redirect forward, redirect backward and stop to play；
(5) pass through the QoE parameters of terminal APP record mobile terminal network videos to broadcasting daily record；The QoE parameters of video are mainly
The objective quality index of mobile video business, the first time slack including video prolongs, interim card information, video resolution and the video of video
Actual play duration；The first time slack of wherein video, which prolongs to refer to user is played to since click, to be played elapsed time, card
At the time of information includes video cardton and interim card duration；
(6) MOS that user is recorded by terminal APP scores, and journal file then is uploaded to HTTP server；Video playing is complete
Into when terminal APP prompting user score, video tastes are divided by experience of the user in watching process from difference to favorable comment
1~5；
(7) terminal APP provides automatic record screen function, and after the license of user, terminal APP can realize video display process
Record screen prompts user to upload to HTTP service after completion to be played；
(8) it the network data during HTTP server crawl video-see and is associated with the terminal daily record of upload realization；When with
During selection one video of viewing of family, terminal APP initiates " selection video " message to server, and server is according to mobile terminal at this time
IP address crawl network packet；When video playing is completed, terminal APP initiates " finishing playing " message to server, this
When server stop as the mobile terminal packet capturing, and the network data file of preservation is closed with the terminal daily record received
Connection；
(9) data analytic construction standard data set：The HAS videos carried first according to differing transmission protocols are grabbed from HTTP server
Different qos parameters is extracted in the network data taken, including：It is real to the HAS video networks data extraction downlink carried based on TCP
When rate, packet loss and round trip time parameter, downstream rate parameter is only extracted to the network data carried based on UDP；Then basis
Terminal APP timings are reported to the synchronization message of HTTP server, and terminal daily record and qos parameter are realized time synchronization；Finally will
Include the standard of end message, video information, user's operation behavior, video QoE parameters, user MOS scorings and network QoS parameter
Data set saves as file or deposit database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810016344.XA CN108200471B (en) | 2018-01-08 | 2018-01-08 | A kind of construction method of standard data set that evaluating and testing encrypted video QoE |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810016344.XA CN108200471B (en) | 2018-01-08 | 2018-01-08 | A kind of construction method of standard data set that evaluating and testing encrypted video QoE |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108200471A true CN108200471A (en) | 2018-06-22 |
| CN108200471B CN108200471B (en) | 2019-08-16 |
Family
ID=62588596
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810016344.XA Expired - Fee Related CN108200471B (en) | 2018-01-08 | 2018-01-08 | A kind of construction method of standard data set that evaluating and testing encrypted video QoE |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108200471B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109347726A (en) * | 2018-11-06 | 2019-02-15 | 西安海润通信技术有限公司 | A kind of surfing Internet with cell phone network aware quality assessment method based on wechat public platform |
| CN112887795A (en) * | 2021-01-26 | 2021-06-01 | 脸萌有限公司 | Video playing method, device, equipment and medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102685790A (en) * | 2012-05-22 | 2012-09-19 | 北京东方文骏软件科技有限责任公司 | Method for evaluating QoE (Quality of Experience) of mobile streaming media service perception experience by simulating user behaviors |
| CN102868666A (en) * | 2011-07-07 | 2013-01-09 | 北京东方文骏软件科技有限责任公司 | Implementation method of streaming media quality monitoring report based on user experience interaction |
| CN104023225A (en) * | 2014-05-28 | 2014-09-03 | 北京邮电大学 | No-reference video quality evaluation method based on space-time domain natural scene statistics characteristics |
| CN104349220A (en) * | 2014-11-25 | 2015-02-11 | 复旦大学 | Service quality monitoring system for intelligent television terminal |
| CN105843876A (en) * | 2016-03-18 | 2016-08-10 | 合网络技术（北京）有限公司 | Multimedia resource quality assessment method and apparatus |
| CN106254153A (en) * | 2016-09-19 | 2016-12-21 | 腾讯科技（深圳）有限公司 | A kind of Network Abnormal monitoring method and apparatus |
| CN106470431A (en) * | 2015-08-14 | 2017-03-01 | 中国联合网络通信集团有限公司 | A kind of method and device obtaining user's perception speed |
| CN106850298A (en) * | 2017-02-08 | 2017-06-13 | 中国联合网络通信集团有限公司 | IPTV service quality monitoring method, terminal and system |
| CN106998322A (en) * | 2017-02-20 | 2017-08-01 | 南京邮电大学 | A kind of stream sorting technique of the Mean Opinion Score characteristics of mean of use video traffic |
| CN107071399A (en) * | 2017-04-26 | 2017-08-18 | 华为技术有限公司 | The method for evaluating quality and device of a kind of encrypted video stream |
| CN107404646A (en) * | 2016-05-20 | 2017-11-28 | 华为技术有限公司 | The method, apparatus and headend of video quality assessment |
-
2018
- 2018-01-08 CN CN201810016344.XA patent/CN108200471B/en not_active Expired - Fee Related
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102868666A (en) * | 2011-07-07 | 2013-01-09 | 北京东方文骏软件科技有限责任公司 | Implementation method of streaming media quality monitoring report based on user experience interaction |
| CN102685790A (en) * | 2012-05-22 | 2012-09-19 | 北京东方文骏软件科技有限责任公司 | Method for evaluating QoE (Quality of Experience) of mobile streaming media service perception experience by simulating user behaviors |
| CN104023225A (en) * | 2014-05-28 | 2014-09-03 | 北京邮电大学 | No-reference video quality evaluation method based on space-time domain natural scene statistics characteristics |
| CN104349220A (en) * | 2014-11-25 | 2015-02-11 | 复旦大学 | Service quality monitoring system for intelligent television terminal |
| CN106470431A (en) * | 2015-08-14 | 2017-03-01 | 中国联合网络通信集团有限公司 | A kind of method and device obtaining user's perception speed |
| CN105843876A (en) * | 2016-03-18 | 2016-08-10 | 合网络技术（北京）有限公司 | Multimedia resource quality assessment method and apparatus |
| CN107404646A (en) * | 2016-05-20 | 2017-11-28 | 华为技术有限公司 | The method, apparatus and headend of video quality assessment |
| CN106254153A (en) * | 2016-09-19 | 2016-12-21 | 腾讯科技（深圳）有限公司 | A kind of Network Abnormal monitoring method and apparatus |
| CN106850298A (en) * | 2017-02-08 | 2017-06-13 | 中国联合网络通信集团有限公司 | IPTV service quality monitoring method, terminal and system |
| CN106998322A (en) * | 2017-02-20 | 2017-08-01 | 南京邮电大学 | A kind of stream sorting technique of the Mean Opinion Score characteristics of mean of use video traffic |
| CN107071399A (en) * | 2017-04-26 | 2017-08-18 | 华为技术有限公司 | The method for evaluating quality and device of a kind of encrypted video stream |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109347726A (en) * | 2018-11-06 | 2019-02-15 | 西安海润通信技术有限公司 | A kind of surfing Internet with cell phone network aware quality assessment method based on wechat public platform |
| CN109347726B (en) * | 2018-11-06 | 2021-02-09 | 西安海润通信技术有限公司 | Mobile phone internet network perception quality evaluation method based on WeChat public number |
| CN112887795A (en) * | 2021-01-26 | 2021-06-01 | 脸萌有限公司 | Video playing method, device, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108200471B (en) | 2019-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10841358B2 (en) | System and method for determining quality of a media stream | |
| Bronzino et al. | Inferring streaming video quality from encrypted traffic: Practical models and deployment experience | |
| CN104115448B (en) | The method and apparatus of monitoring network transmission characteristic | |
| US8897144B2 (en) | Quality of user experience testing for video transmissions | |
| CN105024872B (en) | The method and device of applied in network performance test | |
| Casas et al. | Monitoring YouTube QoE: Is your mobile network delivering the right experience to your customers? | |
| CN109640113A (en) | A kind of processing method and proxy server of dilatory video data | |
| Yeganeh et al. | Delivery quality score model for Internet video | |
| CN108200471B (en) | A kind of construction method of standard data set that evaluating and testing encrypted video QoE | |
| CN108235149A (en) | A kind of method and device for optimizing video playing fluency | |
| KR20200116504A (en) | Data processing methods, servers and data collection devices | |
| Robitza et al. | Measuring YouTube QoE with ITU-T P. 1203 under constrained bandwidth conditions | |
| US11522939B2 (en) | Over-the-top media service testing and QoE issues isolation | |
| Baena et al. | Video Streaming and Cloud Gaming services over 4G and 5G: a complete network and service metrics dataset | |
| Wu et al. | Resolution identification of encrypted video streaming based on http/2 features | |
| Varvello et al. | Performance characterization of videoconferencing in the wild | |
| CN107659856A (en) | The acquisition method of mobile video business experience qualitative data collection based on user feedback | |
| Lyu et al. | Network Anatomy and Real-Time Measurement of Nvidia GeForce NOW Cloud Gaming | |
| Wehner et al. | Beauty is in the eye of the smartphone holder a data driven analysis of youtube mobile qoe | |
| CN106899843A (en) | A kind of video service quality appraisal procedure and device | |
| Göring et al. | A framework for QoE analysis of encrypted video streams | |
| Bartolec et al. | Impact of user playback interactions on in-network estimation of video streaming performance | |
| Bhargava et al. | Comparative evaluation of user perceived quality assessment of design strategies for HTTP-based adaptive streaming | |
| Lopes et al. | A multi-layer probing approach for video over 5G in vehicular scenarios | |
| Wehner et al. | Quality that matters: Qoe monitoring in education service provider (esp) networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190816 Termination date: 20220108 |