CN102868666B - Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience - Google Patents

Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience Download PDF

Info

Publication number
CN102868666B
CN102868666B CN201110189377.2A CN201110189377A CN102868666B CN 102868666 B CN102868666 B CN 102868666B CN 201110189377 A CN201110189377 A CN 201110189377A CN 102868666 B CN102868666 B CN 102868666B
Authority
CN
China
Prior art keywords
quality
server
client
streaming media
report
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201110189377.2A
Other languages
Chinese (zh)
Other versions
CN102868666A (en
Inventor
杜海清
刘勇
徐静涛
王凤纯
陈丽珊
许克辉
孟欣欣
胡文
李湘平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING ORIENT SOFT Corp
Beijing University of Posts and Telecommunications
Original Assignee
BEIJING ORIENT SOFT Corp
Beijing University of Posts and Telecommunications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING ORIENT SOFT Corp, Beijing University of Posts and Telecommunications filed Critical BEIJING ORIENT SOFT Corp
Priority to CN201110189377.2A priority Critical patent/CN102868666B/en
Publication of CN102868666A publication Critical patent/CN102868666A/en
Application granted granted Critical
Publication of CN102868666B publication Critical patent/CN102868666B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

A kind of implementation method of the stream media quality Surveillance mutual based on Consumer's Experience, the Quality of experience QoE interaction protocol of self-defining transmitted in both directions and network of relation environmental parameter thereof and service feature parameter are first set, the transmission situation of monitoring server Streaming Media, the reception situation of client monitors Streaming Media also evaluates its user experience quality, generation S-C report and C-S report are again via Internet Transmission respectively, realize the real-time, interactive of stream media quality Surveillance between clients and servers, thus Real-Time Monitoring is realized to the streaming media service quality transmitted between the two.The present invention is according to existing network technical foundation, more extensively draws the newest fruits of current multiple stream media quality monitoring, monitoring technique, carries out complex optimum and proposes.Its operating procedure is simple, and the bandwidth resources taken are few, and difficulty in computation is low, existing network of also need not changing or upgrade, and realizes easily, significant to the operation and management of Streaming Media in existing network, has good popularizing application prospect.

Description

Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience
Technical field
The present invention relates to a kind of implementation method of the stream media quality Surveillance mutual based on Consumer's Experience, belong to multimedia communication technology field.
Background technology
Streaming Media be a kind of make audio frequency, video and other multimedia elements on Internet and wireless network with real-time, carry out without the need to downloading the mode waited for the technology play.Stream media technology can provide continual audio and video data streams to user, meets the demand that user views and admires dynamic audiovisual online.
Along with the fast development of computer network, and the developing rapidly of the wireless network such as G mobile communication 3G (3rd-generation) and WLAN WLAN (Wireless Local Area Network), the application of streaming media service is more and more extensive.The key areas applied in cable network is IPTV IPTV (Interactive Personal TV), and is mainly mobile flow medium in mobile network field.
But, in existing network, when streaming media service is especially provided on frequency spectrum resource wireless network at full stretch, network delay, the network adverse circumstances such as congested often make the transmission of multi-medium data bag produce time delay, packet loss, shake or the situation such as out of order, thus the quality of service of Streaming Media is worsened, cause adverse effect to Consumer's Experience.For Virtual network operator and service provider, need to adopt effectively, accurately stream media quality evaluation and test scheme monitor its service transmission performance, and then optimized network performance, improve service quality.
But, the actual use of current stream media quality evaluating method and streaming media and control protocol is all undesirable, do not react quality of service truly, also fail streaming media business realizing and evaluate and test in real time and monitor, its main cause is that client and server fail to carry out information interaction in time: on the one hand, client can not know network environment conditions in time, let alone the impact that grasp network environment causes user experience quality; On the other hand, streaming media server can not know the user experience quality of client in real time, exactly, to adjust network parameter in time, this is the two large problems existed in current streaming media service quality monitoring.
Introduce the prior art overview about mobile flow medium quality report below:
(1) network parameter is utilized, directly at network side predicted flows media quality.Such as, document " Researchon Monitoring Quality of 3G Streaming Media Service " [C] (publishing in " InternationalConference on Communication Systems; Networks and Applications " 2010), utilizes the parameter streamed media quality such as the number of dropped packets of network terminal, packet loss, packet delay, packet jitter to evaluate and test.Document " No-Reference Quality Assessment for Networked Video via Primary Analysis ofBit Stream " [J] (publishing in " IEEE Transactions on circuits and video technology " 2010), consider coding side quantization step, frame per second and the isoparametric impact of network terminal packet loss, and be weighted in time domain, finally realize the objective evaluation to video flow quality.IETF RFC4445 also proposes a kind of method measuring IPTV transmission quality: MDI (Media Delivery Index), also only uses two kinds of network parameter: DF (DelayFactor) and MLR (Media Loss Rate) to measure.
(2) utilize the form of report, the professional ability of client is reported streaming media server.Such as, Chinese invention patent application " a kind of method of reporting ability and associated processing device " (application number 200810056281.7) describes a kind of report method, but the method is only limitted to the professional ability of client mark to be reported to server, does not have interactivity; And the judgement of the professional ability of client is not be perceived as standard with user, the judged result of this ability can only provide reference for server adjusts network state, can not as complete foundation.Chinese invention patent application " method and apparatus for reporting streaming media quality cross reference to related applications " (application number 200780048832.9) describes the method for another kind of cross reference reporting streaming media quality, the method mainly lays particular emphasis on the method for report, does not relate to content and the obtain manner thereof of report.A kind of TV service management method, system and Service Quality Management node that Chinese invention patent application " TV service management method and system, Service Quality Management node " (application number 201010174116.9) relates to, the defect that IPTV service index cannot be measured automatically can be overcome, but the parameter that IPTV terminal reports only has audience ratings, request success rate, packet loss, frame loss rate and shake etc., the transmission not relating to audio frequency and video business itself and the Quality of experience viewed and admired.
(3) in traditional RTP/RTCP/RTSP protocol family, what play control action to service transmission quality is rtcp protocol, and rtcp protocol utilizes network parameter to judge and evaluation assignment quality, and adjusts the parameters such as the network bandwidth with this.But rtcp protocol does not carry out supervision and analysis to the business experience quality of user, therefore can not reflect the streaming media service quality of client completely truly.
As seen from the above analysis, independently carry out on the basis of Streaming Media Quality of experience evaluation in client, overall merit is implemented in conjunction with network parameter, and by client relevant parameter real-time report to the method for streaming media server, so far all yet there are no pertinent literature both at home and abroad to deliver, meanwhile, current existing agreement judges at the quality of service based on Consumer's Experience and also has many deficiencies in control.
Summary of the invention
In view of this, the object of this invention is to provide a kind of implementation method of the stream media quality Surveillance mutual based on Consumer's Experience.The present invention be directed to the stream media quality monitoring demand occurred at present, and take into full account the enforceable technical foundation of existing network, more extensively draw the newest fruits of current multiple stream media quality monitoring, monitoring technique, carry out complex optimum and propose.Compared with existing various quality monitoring technology scheme, the inventive method is on existing network technology basis, make full use of disposed in network relevant advanced person, mature technology, by user experience quality and the relevant parameter of Quality of experience QoE (Quality of Experience) the protocol transmission Streaming Media of self-defining transmitted in both directions, realize real-time, interactive between a client and a server, solve the two large problems in above-mentioned streaming media service quality monitoring well.
In order to achieve the above object, the present invention proposes a kind of implementation method of the stream media quality Surveillance mutual based on Consumer's Experience, it is characterized in that: the Quality of experience QoE interaction protocol of self-defining transmitted in both directions and network of relation environmental parameter (Network Environment Parameters) thereof and service feature parameter (Service Performance Parameters) are first set, the transmission situation of monitoring server Streaming Media, the reception situation of client monitors Streaming Media also evaluates its user experience quality, respectively to the S-C of client, generation server reports that (Server-Client Report) and client are reported (Client-Server Report) to the C-S of server, again via Internet Transmission, realize the real-time, interactive of stream media quality Surveillance between clients and servers, thus Real-Time Monitoring is realized to the streaming media service quality transmitted between the two, described method comprises following operative step:
(1) the QoE interaction protocol of self-defining transmitted in both directions is set, and the network environment parameters defined wherein and service feature parameter, the QoE interaction protocol of this transmitted in both directions specifies: network environment parameters is carried in the S-C report of server to client end, and client carries service feature parameter to the C-S report of server;
(2) server test, record and statistics network environmental parameter, and generate S-C report according to QoE agreement regulation, then send to client; This step comprises following content of operation:
(21) server test and record multimedia coding type, multimedia file length and transmitting time stamp, statistical server is given out a contract for a project several P simultaneously sendwith transmission byte number B send, and calculate the network environment parameters comprising transmission rate and two-way time delay according to the following equation; Wherein,
Transmission rate in formula, B " sendand B' sendbe respectively server at T " server, sendwith T ' server, sendtwo transmission byte numbers do not added up in the same time;
Two-way time delay T rD=T server, recv-T server, send, in formula, T server, recvand T server, sendbe respectively the time that server receives and sends test pack;
(22) the above-mentioned network environment parameters of the streaming media service obtained writes in the corresponding field of QoE protocol massages by server, generates S-C report, and sends to client by network;
(3) stream media information that client test, record and statistics receive, and utilize S-C to report the service feature parameter calculating this Streaming Media, meanwhile, evaluate the user experience quality of this streaming media service; Then generate C-S report according to QoE agreement regulation, then send to server;
(4) server a pair QoE protocol massages corresponding stored that step (2) and (3) are generated respectively, for the user experience quality of subsequent analysis Streaming Media and the relation of network environment, for later stage monitoring flow media business quality provides foundation.
The present invention is based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience, utilize QoE interaction protocol and the relevant parameter of self-defining transmitted in both directions, enable streaming media clients obtain in time business transmission time network environment parameters, analyzing wiredly affects with the transmission of radio network conditions streaming media business, and the streaming media service quality evaluating method combining setting obtains the Quality of experience of service-user.Streaming media server by the real-time, interactive with client, is understood again, learn the Quality of experience of client user's streaming media business, to adjust network condition or streaming media service parameter in good time, improves the service quality of business.
From the angle of Virtual network operator, the bandwidth resources that the inventive method takies are little, can directly apply to existing network, need not carry out extra change and upgrading to existing network; From the angle of network client, the transmission that the transmission that QoE reports alternately can't affect Streaming Media is play, and is conducive to evaluation and the lifting of quality of service on the contrary.
Moreover the operating procedure of the inventive method is simple, and difficulty in computation is low, easily realizes, and the actual operation and management of streaming media business is significant, in the application promoting streaming media service quality, has good popularizing application prospect and value.
Accompanying drawing explanation
Fig. 1 is the flow chart that the present invention is based on the mutual Streaming Media monitoring quality method for reporting of Consumer's Experience.
Fig. 2 is QoE protocol realization schematic diagram of the present invention.
Fig. 3 is S-C report structure schematic diagram of the present invention.
Fig. 4 is C-S report structure schematic diagram of the present invention.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with drawings and Examples, the present invention is described in further detail.
The present invention is a kind of method of the stream media quality Surveillance mutual based on Consumer's Experience: first arrange the Quality of experience QoE interaction protocol of self-defining transmitted in both directions and network of relation environmental parameter thereof and service feature parameter, the transmission situation of monitoring server Streaming Media, the reception situation of client monitors Streaming Media also evaluates its user experience quality, respectively generation server is reported to the S-C of client and client is reported to the C-S of server, again via Internet Transmission, realize the real-time, interactive of stream media quality Surveillance between clients and servers, thus Real-Time Monitoring is realized to the streaming media service quality transmitted between the two.
See Fig. 1, introduce each concrete operation step of the inventive method:
Step 1, the QoE interaction protocol of self-defining transmitted in both directions is set, and the network environment parameters defined wherein and service feature parameter, the QoE interaction protocol of this transmitted in both directions specifies: network environment parameters is carried in the S-C report of server to client end, and client carries service feature parameter to the C-S report of server.
The QoE interaction protocol transmission situation in a network of the self-defining transmitted in both directions of the present invention, as shown in Figure 2, requires that the structure of S-C report and the C-S report sent server and client side is composed as follows respectively:
The S-C report of server to client end is made up of header and data block, and wherein, header comprises:
Protocol version (Protocol Version): the version number of current QoE agreement, field length: 8bit, the version number in the embodiment of the present invention is 1;
Type of data packet (Packet Type): the type of current report: 1 is S-C report, 2 is C-S report, field length: 8bit;
Data packet length (Packet Length): the data packet length of current report, unit: byte, field length: 16bit;
Data block is used for carrying following one or more network environment parameters:
Multimedia coding type (Code Type): the encoding format information of audio frequency and/or video data, namely the compress technique of setting is adopted, the file transform of certain audio frequency and video form is become the mode of another kind of audio frequency and video formatted file, field length: 16bit; G.711 the conventional type of coding of voice data has, G.723, the conventional type of coding of video data has MPEG-2, H.263, H.264;
Multimedia file length (Length): the length of audio frequency and/or video file, unit: second, field length: 16bit;
Transmitting time stamp (Send Timestamp): the clock information sending current flow media data packet, field length: 32bit;
Server is given out a contract for a project and is counted (Packets Sent): server adds up to be sent to the flow media data packet number of client, field length: 32bit;
Send byte number (Bytes Sent): server adds up the Streaming Media byte number being sent to client, field length: 32bit;
Transmission rate (Send Rate): server sends the mean bit rate of streaming media service data, unit: bps; Field length: 32bit;
Two-way time delay (Roundtrip Delay): Streaming Media test pack is sent to client from server, then the transmission time of return service device, unit: second, precision is microsecond; Field length: 32bit;
Server Extension field (Expand): for spare fields during later protocol extension, field length: 256bit;
Client is made up of to the C-S report of server header and data block, wherein, the protocol version that header comprises, the field bit of type of data packet, length is long all to be reported identical with S-C with connotation, repeats no more; Data block is used for carrying following one or more service feature parameter:
Receiver packet number (Packets Received): client adds up the flow media data packet number received, field length: 32bit;
Receive byte number (Bytes Received): client adds up the Streaming Media byte number received, field length: 32bit;
Packet loss (Packets Loss Rate): number of dropped packets and server are given out a contract for a project the ratio of number, wherein number of dropped packets is that server is given out a contract for a project the difference of number and receiver packet number, field length: 8bit;
Shake (Jitter): the difference of two flow media data packet relative transport times, the i.e. difference of the time of reception stamp of two flow media data packet and the difference of transmitting time stamp, unit: second, precision is microsecond; Field length: 24bit;
Time of reception stamp (Receive Timestamp): the clock information receiving current flow media data packet, field length: 32bit;
Receiving velocity (Receive Rate): the mean bit rate of receiving stream media business datum, unit: bps, field length: 32bit;
Audio quality QoA (Quality of Audio): utilize the E-Model algorithm improved based on shake expansion to evaluate audio quality in client, field length: 32bit;
Video quality QoV (Quality of Video): the patent of invention utilizing China Patent No. 201110021600.2: based on the modification method of the no-reference video quality method for objectively evaluating of key frame images quality weighting in client evaluates video quality, field length: 32bit;
The audio frequency and video time difference (Time Difference): a pair video packets originally synchronous in same flow media file and audio pack arrive the difference of the timestamp of client, for weighing the synchronism of audio frequency and video, unit: second, precision is microsecond; Field length: 32bit;
Connect the stand-by period (Time Waiting): the delay time presenting business from customer service request to client, unit: second, precision is microsecond; Field length: 32bit;
Client-side extensions field (Expand): for spare fields during later protocol extension, field length: 256bit.
Step 2, server test, record and statistics network environmental parameter, and generate S-C report according to QoE agreement regulation, then send to client.This step 2 comprises following content of operation:
(21) server test, record multimedia coding type, multimedia file length and transmitting time stamp, statistical server is given out a contract for a project several P simultaneously sendwith transmission byte number B send, and calculate the network environment parameters comprising transmission rate and two-way time delay according to the following equation, wherein,
Transmission rate in formula, B " sendwith B ' sendbe respectively server at T " server, sendwith T ' server, sendtwo transmission byte numbers do not added up in the same time;
Two-way time delay T rD=T server, recv-T server, send, in formula, T server, recvand T server, sendbe respectively the time that server receives and sends test pack;
(22) the above-mentioned network environment parameters of the streaming media service obtained writes in the corresponding field of QoE protocol massages by server, generates S-C report, and sends to client by network.
Step 3, the stream media information that client test, record and statistics receive, and utilize S-C to report the service feature parameter calculating this Streaming Media, meanwhile, evaluate the user experience quality of this streaming media service; Then generate C-S report according to QoE agreement regulation, then send to server.
This step 3 comprises following content of operation:
(31) client test, record time of reception are stabbed and are connected the stand-by period, add up receiver packet number P simultaneously recvwith reception byte number B recv, and utilize the calculating of S-C report information to comprise packet loss, shake, receiving velocity and the service feature parameter of audio frequency and video time difference according to the following equation, wherein,
Packet loss R loss = P loss P send , In formula, P loss=P send-P recv;
Shake J = | ( T client , recv m - T server , send m ) - ( T client , recv n - T server , send n ) | , In formula, natural number subscript m, n are respectively the sequence number of two the different pieces of information bags sending Streaming Media;
Receiving velocity in formula, B " recvand B' recvbe respectively T " client, recvwith T ' client, recvtwo reception byte numbers do not added up in the same time;
The audio frequency and video time difference client receives the moment of a pair video packets originally synchronous in same flow media file with the moment of audio pack difference, in formula, natural number subscript k is the packet sequence number in files in stream media;
(32) audio frequency of client streaming media business and/or the user experience quality of video are evaluated; Wherein,
Audio quality evaluation method, adopts the E-Model algorithm revised based on shake expansion: QoA=93.2-I d-I e-I j, namely introduce shake factor I jthe impact of shake on voice quality is described: in formula, I dand I efor in former E-Model algorithm respectively because of the voice quality impairments factor that transmitting voice signal time delay and packet loss cause, I jfor the effect of jitter factor that expansion revises and increase newly, and I j=I jd+ I jl; In formula,
I jdthe effect of jitter factor because network transfer delay causes: I jd=a 1× J+a 2× (J-a 3) × f (J-a 3), in formula, parameter a 1, a 2be respectively the empirical parameter of reflection network performance, embodiment be according in former E-Model algorithm to the various parameters of the quality impairments factor that propagation delay time causes: echo loudness, background noise, loudness evaluation and test value and calculating: a 1=0.029, a 2=0.194; Parameter a 3for describing the threshold value of the shake order of severity by two-way time delay, its numerical value depends on packet loss R loss: work as R lossduring≤i, work as R lossduring > i, a 3=0; In formula, i is the threshold value of packet loss, establishes i=5% herein; Function f is step function, and its mathematic(al) representation is: J≤a 3, f (J-a 3)=0, J > a 3, f (J-a 3)=1; This formula represents: if shake J is greater than a 3, can cause voice quality and have a strong impact on;
I jlthe effect of jitter factor because buffer overflow causes: in formula, b is the coefficient choosing different numerical value according to different audio coder, because embodiment uses G.723.1.B-6.3 encoder, therefore b=10.3; T is the byte capacity of buffering area, the T=1MB in this embodiment; C is the proportionality coefficient taking buffering area under this audio coding mode, c=10.81%; R recvfor receiving velocity;
Method for evaluating video quality, utilize China Patent No.: the patent application of 201110021600.2: the no-reference video quality method for objectively evaluating based on the weighting of key frame images quality is evaluated, and utilize S-C to report and packet loss, shake and/or receiving velocity correction evaluation result.Suppose that the video quality score using original patent application method is qov, recycling packet loss R lossrevise, i.e. QoV=qov × (1+d × R loss).The video of embodiment of the present invention test is Foreman sequence (totalframes is 250 frames), this video resolution is conventional standard image format QCIF (Quarter Common Intermediate Format, in H.323 protocol family, the size defining the standard acquisition resolution of video capture device is 176 × 144 pixels), belong to prospect, background all to move and video type relatively slowly of moving, setting parameter d=10.
In this step, audio quality evaluation method and method for evaluating video quality all adopt 5 points of evaluation qualities processed good and bad, wherein 5 points best, 1 point is the poorest.
(33) above-mentioned parameter obtained writes in the corresponding field of QoE protocol massages by client, generates C-S report, then is sent to server by network.
Step 4, a pair QoE protocol massages corresponding stored that step 2 and 3 generate by server respectively, for the user experience quality of subsequent analysis Streaming Media and the relation of network environment, for later stage monitoring flow media business quality provides foundation.This step 4 comprises following content of operation:
(41) the S-C report that it generated in step 2 of server and the C-S report that receives in step 3, as a pair QoE protocol massages corresponding stored in database;
(42) relation of fuzzy evaluation Algorithm Analysis Streaming Media user experience quality and network environment is utilized, for later stage monitoring mobile flow medium service quality provides foundation: the various evaluation indexes first determining to comprise network environment parameters and service feature parameter, and the criterion of each evaluation index; The weight of each evaluation index is determined again respectively, rationally to quantize the correlative factor of evaluation object by analytic hierarchy process (AHP); Finally construct fuzzy membership function, use fuzzy mathematics method to carry out categorised decision, obtain the relation of Streaming Media user experience quality and network environment.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment made, equivalent replacement, improvement etc., all should be included within the scope of protection of the invention.

Claims (5)

1. the implementation method based on the mutual stream media quality Surveillance of Consumer's Experience, it is characterized in that: first the Quality of experience QoE interaction protocol of self-defining transmitted in both directions and network of relation environmental parameter thereof and service feature parameter are set, the transmission situation of monitoring server Streaming Media, generation server is reported to the S-C of client; The reception situation of client monitors Streaming Media also evaluates its user experience quality, generates client and reports to the C-S of server; Described S-C report and C-S report, via Internet Transmission, realize the real-time, interactive of stream media quality Surveillance between clients and servers, thus realize Real-Time Monitoring to the streaming media service quality transmitted between the two; Described method comprises following operative step:
(1) the QoE interaction protocol of self-defining transmitted in both directions is set, and the network environment parameters defined wherein and service feature parameter, the QoE interaction protocol of this transmitted in both directions specifies: network environment parameters is carried in the S-C report of server to client end, and client carries service feature parameter to the C-S report of server;
(2) server test, record and statistics network environmental parameter, and generate S-C report according to QoE agreement regulation, then send to client; This step comprises following content of operation:
(21) server test and record multimedia coding type, multimedia file length and transmitting time stamp, statistical server is given out a contract for a project several P simultaneously sendwith transmission byte number B send, and calculate the network environment parameters comprising transmission rate and two-way time delay according to the following equation; Wherein,
Transmission rate in formula, B " sendwith B ' sendbe respectively server at T " server, sendwith T ' server, sendtwo transmission byte numbers do not added up in the same time;
Two-way time delay T rD=T server, recv-T server, send, in formula, T server, recvand T server, sendbe respectively the time that server receives and sends test pack;
(22) the above-mentioned network environment parameters of the streaming media service obtained writes in the corresponding field of QoE protocol massages by server, generates S-C report, and sends to client by network;
(3) stream media information that client test, record and statistics receive, and utilize S-C to report the service feature parameter calculating this Streaming Media, meanwhile, evaluate the user experience quality of this streaming media service; Then generate C-S report according to QoE agreement regulation, then send to server;
(4) server a pair QoE protocol massages corresponding stored that step (2) and (3) are generated respectively, for the user experience quality of subsequent analysis Streaming Media and the relation of network environment, for later stage monitoring flow media business quality provides foundation.
2. method according to claim 1, is characterized in that: the QoE interaction protocol regulation of described self-defining transmitted in both directions:
(11) the S-C report of server to client end is made up of header and data block, wherein, header comprises: protocol version (Protocol Version), type of data packet (Packet Type) and length (PacketLength) thereof; Data block is used for carrying following one or more network environment parameters:
Multimedia coding type (Code Type): the encoding format information of audio frequency and/or video data, namely adopts the compress technique of setting, becomes the mode of another kind of audio frequency and video formatted file by the file transform of certain audio frequency and video form; G.711 the conventional type of coding of voice data has, G.723, the conventional type of coding of video data has MPEG-2, H.263, H.264;
Multimedia file length (Length): the length of audio frequency and/or video file;
Transmitting time stamp (Send Timestamp): the clock information sending current flow media data packet;
Server is given out a contract for a project and is counted (Packets Sent): server adds up to be sent to the flow media data packet number of client;
Send byte number (Bytes Sent): server adds up the Streaming Media byte number being sent to client;
Transmission rate (Send Rate): server sends the mean bit rate of streaming media service data;
Two-way time delay (Roundtrip Delay): Streaming Media test pack is sent to client from server, then the transmission time of return service device;
Server Extension field (Expand): for spare fields during later protocol extension;
(12) client is made up of to the C-S report of server header and data block, and wherein, header comprises: protocol version, type of data packet and length thereof; Data block is used for carrying following one or more service feature parameter:
Receiver packet number (Packets Received): client adds up the flow media data packet number received;
Receive byte number (Bytes Received): client adds up the Streaming Media byte number received;
Packet loss (Packets Loss Rate): number of dropped packets and server are given out a contract for a project the ratio of number, wherein number of dropped packets is that server is given out a contract for a project the difference of number and receiver packet number;
Time of reception stamp (Receive Timestamp): the clock information receiving current flow media data packet;
Shake (Jitter): the difference of two flow media data packet relative transport times, the i.e. difference of the time of reception stamp of two flow media data packet and the difference of transmitting time stamp;
Receiving velocity (Receive Rate): the mean bit rate of receiving stream media business datum;
Audio quality QoA (Quality of Audio): utilize the E-Model algorithm revised based on shake expansion to evaluate audio quality in client;
Video quality QoV (Quality of Video): the patent of invention utilizing China Patent No. 201110021600.2: based on the modification method of the no-reference video quality method for objectively evaluating of key frame images quality weighting in client evaluates video quality;
The audio frequency and video time difference (Time Difference): in same flow media file, a pair synchronous video packets and audio pack arrive the difference of the timestamp of client originally, for weighing the synchronism of audio frequency and video;
Connect the stand-by period (Time Waiting): the delay time presenting business from customer service request to client;
Client-side extensions field (Expand): for spare fields during later protocol extension.
3. method according to claim 2, is characterized in that: described step (3) comprises following content of operation:
(31) client test, record time of reception are stabbed and are connected the stand-by period, add up receiver packet number P simultaneously recvwith reception byte number B recv, and utilize the calculating of S-C report information to comprise packet loss, shake, receiving velocity and the service feature parameter of audio frequency and video time difference according to the following equation, wherein,
Packet loss in formula, P loss=P send-P recv;
Shake in formula, natural number subscript m, n are respectively the sequence number of two the different pieces of information bags sending Streaming Media;
Receiving velocity in formula, B' r' ecvand B' recvbe respectively client at T c" lient, recvand T c' lient, recvtwo reception byte numbers do not added up in the same time;
The audio frequency and video time difference client receives the moment of a pair video packets originally synchronous in same flow media file with the moment of audio pack difference, in formula, natural number subscript k is the packet sequence number in files in stream media;
(32) audio frequency of client streaming media business and/or the user experience quality of video are evaluated; Wherein,
Audio quality evaluation method, adopts the E-Model algorithm revised based on shake expansion: QoA=93.2-I d-I e-I j, namely introduce shake factor I jthe impact of shake on voice quality is described: in formula, I dand I efor in former E-Model algorithm respectively because of the voice quality impairments factor that transmitting voice signal time delay and packet loss cause, I jfor the effect of jitter factor that expansion revises and increase newly, and I j=I jd+ I jl; Wherein,
I jdthe effect of jitter factor because network transfer delay causes: I jd=a 1× J+a 2× (J-a 3) × f (J-a 3), in formula, parameter a 1, a 2be respectively the empirical parameter of reflection network performance, parameter a 3for describing the threshold value of the shake order of severity by two-way time delay, its numerical value depends on packet loss R loss: work as R lossduring≤i, work as R lossduring > i, a 3=0; In formula, i is the threshold value of packet loss; Function f is step function, and its mathematic(al) representation is: J≤a 3, f (J-a 3)=0, J > a 3, f (J-a 3)=1; This formula represents: if shake J is greater than a 3, can cause voice quality and have a strong impact on;
I jlthe effect of jitter factor because buffer overflow causes: in formula, b is the coefficient choosing different numerical value according to different audio coder, and T is the byte capacity of buffering area, and c is the proportionality coefficient taking buffering area under different audio coding mode, R recvfor receiving velocity;
Method for evaluating video quality, utilize China Patent No.: the patent of invention of 201110021600.2: the no-reference video quality method for objectively evaluating based on the weighting of key frame images quality is evaluated, and utilize S-C to report and packet loss, shake and/or receiving velocity correction evaluation result;
(33) above-mentioned parameter obtained writes in the corresponding field of QoE protocol massages by client, generates C-S report, then is sent to server by network.
4. method according to claim 3, is characterized in that: in described step (32), and audio quality evaluation method and method for evaluating video quality all adopt 5 points of evaluation qualities processed good and bad, wherein 5 points best, 1 point is the poorest.
5. method according to claim 1, is characterized in that: described step (4) comprises following content of operation:
(41) the S-C report that it generated in step (2) of server and the C-S report that receives in step (3), as a pair QoE protocol massages corresponding stored in database;
(42) relation of fuzzy evaluation Algorithm Analysis Streaming Media user experience quality and network environment is utilized, for later stage monitoring mobile flow medium service quality provides foundation: the various evaluation indexes first determining to comprise network environment parameters and service feature parameter, and the criterion of each evaluation index; The weight of each evaluation index is determined again respectively, rationally to quantize the correlative factor of evaluation object by analytic hierarchy process (AHP); Finally construct fuzzy membership function, use fuzzy mathematics method to carry out categorised decision, obtain the relation of Streaming Media user experience quality and network environment.
CN201110189377.2A 2011-07-07 2011-07-07 Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience Expired - Fee Related CN102868666B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110189377.2A CN102868666B (en) 2011-07-07 2011-07-07 Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110189377.2A CN102868666B (en) 2011-07-07 2011-07-07 Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience

Publications (2)

Publication Number Publication Date
CN102868666A CN102868666A (en) 2013-01-09
CN102868666B true CN102868666B (en) 2015-09-23

Family

ID=47447264

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110189377.2A Expired - Fee Related CN102868666B (en) 2011-07-07 2011-07-07 Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience

Country Status (1)

Country Link
CN (1) CN102868666B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106332164A (en) * 2016-09-29 2017-01-11 北京航空航天大学 Evaluation method for transmission performance of vehicle self-organizing network data
CN106792146A (en) * 2016-09-22 2017-05-31 南京邮电大学 The method for objectively evaluating of the Consumer's Experience of data-driven in a kind of video traffic

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9191704B2 (en) * 2013-03-14 2015-11-17 The Nielsen Company (Us), Llc Methods and systems for reducing crediting errors due to spillover using audio codes and/or signatures
CN103269459A (en) * 2013-05-22 2013-08-28 中国科学院声学研究所 Monitoring system directing at user experience quality of stream media service
CN103475896A (en) * 2013-07-24 2013-12-25 同济大学 Interactive video and audio experience-quality assessment platform and method based on Qos
CN104683998A (en) * 2013-12-02 2015-06-03 中兴通讯股份有限公司 Method and device for processing business quality
CN103795589B (en) * 2013-12-26 2017-09-19 国家新闻出版广电总局广播科学研究院 Broadcast television transmissions distribute network channel damage measure method
CN104796443B (en) * 2014-01-17 2019-12-20 中兴通讯股份有限公司 QoE (quality of experience) correction method and server for mobile streaming media user
CN104243441A (en) * 2014-04-09 2014-12-24 深圳深讯和科技有限公司 Method and system for controlling streaming media service quality
CN106330757B (en) 2015-06-30 2020-04-21 腾讯科技(深圳)有限公司 Flow control method and device
KR101915469B1 (en) * 2016-11-29 2018-11-06 에스케이텔레콤 주식회사 Method for providing of streamming service and apparatus for the same
CN110996097B (en) 2017-05-08 2021-10-01 华为技术有限公司 VR multimedia experience quality determination method and device
CN107181644B (en) * 2017-06-16 2019-09-27 北京小度信息科技有限公司 Method and apparatus for monitoring the network performance of network application
CN107659856A (en) * 2017-07-04 2018-02-02 中国科学技术大学 The acquisition method of mobile video business experience qualitative data collection based on user feedback
CN108200471B (en) * 2018-01-08 2019-08-16 中国科学技术大学 A kind of construction method of standard data set that evaluating and testing encrypted video QoE
CN111800388A (en) * 2020-06-09 2020-10-20 盐城网之易传媒有限公司 Media information processing method and media information processing device
CN112367294A (en) * 2020-10-13 2021-02-12 成都精灵云科技有限公司 Network communication method between multiple hosts adapting to edge computing architecture
CN112910720B (en) * 2021-05-06 2021-08-03 成都云智天下科技股份有限公司 Intelligent network scheduling method and system based on user experience quantitative index
CN115515161A (en) * 2021-06-23 2022-12-23 华为技术有限公司 Data transmission method and communication device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1839597A (en) * 2003-08-21 2006-09-27 维迪亚特企业公司 Quality of experience (QOE) measurement for wireless communication networks
CN101425935A (en) * 2007-11-01 2009-05-06 中兴通讯股份有限公司 VoIP service customer experience quality test and monitoring method and system
CN101573941A (en) * 2006-12-29 2009-11-04 艾利森电话股份有限公司 Method and apparatus for reporting streaming media quality cross reference to related applications

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1839597A (en) * 2003-08-21 2006-09-27 维迪亚特企业公司 Quality of experience (QOE) measurement for wireless communication networks
CN101573941A (en) * 2006-12-29 2009-11-04 艾利森电话股份有限公司 Method and apparatus for reporting streaming media quality cross reference to related applications
CN101425935A (en) * 2007-11-01 2009-05-06 中兴通讯股份有限公司 VoIP service customer experience quality test and monitoring method and system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106792146A (en) * 2016-09-22 2017-05-31 南京邮电大学 The method for objectively evaluating of the Consumer's Experience of data-driven in a kind of video traffic
CN106332164A (en) * 2016-09-29 2017-01-11 北京航空航天大学 Evaluation method for transmission performance of vehicle self-organizing network data
CN106332164B (en) * 2016-09-29 2019-07-05 北京航空航天大学 A kind of vehicle self-organizing network data transmission performance assessment method

Also Published As

Publication number Publication date
CN102868666A (en) 2013-01-09

Similar Documents

Publication Publication Date Title
CN102868666B (en) Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience
AU2007313931B2 (en) Dynamic modification of video properties
CN101523916B (en) A method of determining video quality
Khan et al. QoE prediction model and its application in video quality adaptation over UMTS networks
KR101464456B1 (en) Video data quality assessment method and device
CN102802089B (en) Shifting video code rate regulation method based on experience qualitative forecast
CN1839597B (en) Quality-of-experience (QOE) measurement for wireless communication networks
CN101594552B (en) Testing method for IPTV service quality damage by network transmission
CN101951331B (en) Digital household network multimedia sharing system and sharing method thereof
CN102710374B (en) Speed control method in wireless streaming media transmission
WO2013159502A1 (en) Video quality evaluation method and device
CN105100675A (en) Terminal video communication quality adjusting method and system
WO2010003338A1 (en) Method, device and system for evaluating quality of video code stream
CN107105224A (en) Method, device and system that a kind of quality of experience of video is assessed
MXPA04005740A (en) System and method for modifying a video stream based on a client or network environment.
CN102256183A (en) Mobile-communication-network-based audio and video signal real-time transmission method
EP3020188B1 (en) Endpoint information for network vqm
CN114339445B (en) Real-time video stream self-adaptive coordination system and method
EP2613541B1 (en) Server device, video image quality measurement system, video image quality measurement method and program
Sagatov et al. Influence of distortions of key frames on video transfer in wireless networks
Yuan Video data wireless transmission method based on cross-layer bitrate adaptation and error control
JP2010063004A (en) Video data transmission apparatus, video distribution system, video quality evaluation method and program
Daryanto et al. Performance Analysis of Adaptive Transcoder Multimedia Streaming In Ad hoc Network
Yang et al. Design of video transmission and quality evaluation system based on NS-2
Singh et al. A Framework for Evaluation of Video Quality of Service in Wireless Networks

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150923

Termination date: 20160707

CF01 Termination of patent right due to non-payment of annual fee