WO2016134564A1 - 一种用户感知评估方法及装置 - Google Patents

一种用户感知评估方法及装置 Download PDF

Info

Publication number
WO2016134564A1
WO2016134564A1 PCT/CN2015/078884 CN2015078884W WO2016134564A1 WO 2016134564 A1 WO2016134564 A1 WO 2016134564A1 CN 2015078884 W CN2015078884 W CN 2015078884W WO 2016134564 A1 WO2016134564 A1 WO 2016134564A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
evaluation
indicator
user
module
Prior art date
Application number
PCT/CN2015/078884
Other languages
English (en)
French (fr)
Inventor
高志森
洪友春
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2016134564A1 publication Critical patent/WO2016134564A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks

Definitions

  • This paper relates to mobile internet technology, especially a user perception evaluation method and device.
  • the global mobile Internet business is developing rapidly, and many regions have entered the era of the fourth-generation mobile communication (4G) network.
  • 4G fourth-generation mobile communication
  • users mainly use voice telephony; since the 3G/4G era, a large amount of traffic transmitted in the network is video traffic.
  • 2G mobile communication
  • 3G/4G era a large amount of traffic transmitted in the network is video traffic.
  • users The requirements are also getting higher and higher. In this way, higher requirements are placed on the network quality of operators and the system quality of content providers.
  • the user experience-centered evaluation method based on user experience has become a popular technology in the Internet. This method of using the actual perceived results of end users as the core of evaluation can better reflect customer satisfaction.
  • the QOE Quality of Experience
  • the QOE is the end-to-end concept of the user. It refers to the user's subjective experience of the service and the overall performance of the system as perceived from the user's perspective.
  • the user perception assessment method is used to evaluate the service quality, which can more accurately reflect the quality of the carrier network and thus discover network problems.
  • the existing user video perceptual evaluation technology is only evaluated from the aspects of access performance, video download rate, etc., using the establishment delay indicator and the download rate indicator.
  • the establishment delay indicator is the duration of the TCP link establishment of the video service
  • the download rate indicator is the download traffic of the service unit time.
  • the user perception evaluation method indicates that the common indicators, such as the establishment of the delay indicator and the download rate indicator, are used for the perceptual evaluation, and it is difficult to accurately perceive the overall performance of the system, and cannot accurately reflect the perceived effect of the video service.
  • Embodiments of the present invention provide a user perception evaluation method and apparatus, which can more accurately perceive To the overall performance of the system, so as to better reflect the perceived effect of the video business.
  • a user perception evaluation method including:
  • the video perception evaluation result is obtained by using the calculated video indicator and the determined video indicator evaluation criteria.
  • the method further includes: performing weighting adjustment on the video indicator.
  • the weighting adjustment of the video indicator comprises: performing weighting adjustment according to video content characteristics in the data.
  • the video service information includes video service flow information and video parameters.
  • the identifying the video service information from the obtained data includes:
  • Obtaining common indicators of the video service further analyzing the video data, saving the video file header content, and decoding the video parameters from the video file header content; wherein the video parameters include at least a video encoding rate, and/or a video Format, and/or video duration, and/or video frame rate.
  • the determining the video indicator evaluation criterion comprises: selecting a preset video indicator evaluation criterion corresponding to the type according to the type of the identified terminal.
  • the video indicator evaluation criterion is an evaluation criterion for ranking a plurality of video indicators.
  • the video indicator evaluation criterion is a video fluency rating standard.
  • the calculating the video indicator comprises: performing the evolution calculation on the network video indicator to obtain the video indicator according to the identified terminal type, the video content, and the video parameter.
  • the video indicator includes at least a video actual frame rate, and/or a play efficiency, and/or a play delay rate.
  • the obtaining the video perceptual evaluation result includes:
  • the calculated video indicator is queried in the determined video indicator evaluation criterion, and the evaluation level of the video indicator is obtained as a real perception evaluation result of the video attribute of the user; and multiple video attribute indicators are separately performed Evaluation, the evaluation level of the plurality of attribute indicators of the obtained video is respectively used as the actual perceptual evaluation result of the user's multiple attributes of the video.
  • a user perception evaluation device includes an acquisition module, an identification module, a determination module, a calculation module, and an evaluation module;
  • the obtaining module is configured to acquire data generated by a user on the Internet
  • the identification module is configured to identify terminal information and video service information from the obtained data
  • the determining module is configured to determine a video indicator evaluation criterion according to the identified terminal information
  • the calculating module is configured to calculate a video indicator according to the identified terminal information and video service information
  • the evaluation module is configured to obtain a video perception evaluation result by using the calculated video indicator and the determined video indicator evaluation criterion.
  • the apparatus further includes a weighting module configured to perform weighting adjustment on the video indicator output by the computing module.
  • the video service information includes video service flow information and video parameters.
  • the identifying module is configured to: identify a data stream of the video service according to the obtained data generated by the user on the Internet, thereby acquiring the video service flow information;
  • Obtaining common indicators of the video service further analyzing the video data, saving the video file header content, and decoding the video parameters from the video file header content; wherein the video parameters include at least a video encoding rate, and/or a video Format, and/or video duration, and/or video frame rate.
  • the calculating module is configured to: perform the evolution calculation on the network video indicator to obtain the video indicator according to the identified terminal type, the video content, and the video parameter.
  • the video indicator includes a video actual frame rate, and/or a playback efficiency, and/or a play delay. Rate.
  • the evaluating module is configured to: obtain the evaluation level of the multiple attribute indicators of the video as the user's true perception of the multiple attributes of the video according to the calculated multiple video indicator and the determined multiple video indicator evaluation criteria. evaluation result.
  • a computer readable storage medium storing program instructions that, when executed, implement the methods described above.
  • the technical solution provided by the embodiment of the present invention evolves a new video indicator according to the type of the user terminal, the difference of the video content, and the actual video network indicator, thereby evaluating the user's video perception effect, which fully reflects the user difference and the video content difference.
  • the overall performance of the system is accurately perceived, which better reflects the perceived effect of the video service.
  • FIG. 1 is a flowchart of a method for user perception evaluation according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a structure of a user perception evaluation apparatus according to an embodiment of the present invention.
  • FIG. 1 is a flowchart of a method for user perception evaluation according to an embodiment of the present invention. As shown in FIG. 1 , the method includes:
  • Step 100 Acquire data generated by the user on the Internet.
  • Step 101 Identify terminal information and video service information from the obtained data.
  • the type of the terminal used by the user may be identified from the feature information carried by the obtained data generated by the user, and the terminal type library may be queried by using the terminal type to obtain more detailed terminal information, such as an Apple mobile phone or a mobile phone. Model, screen size of this model phone, etc.
  • the UA field of the HyperText Transfer Protocol (HTTP) carries terminal type information to identify the terminal type.
  • the video service information includes video service flow information and video parameters. among them,
  • IP address According to the obtained IP address, host name, feature word, Uniform Resource Locator (ULR) classification and other information in the data generated by the user, the video industry can be identified.
  • Data flow in order to obtain video business flow information such as video specific business topics, such as Youku video, Youku football video, children's animation, etc.;
  • Obtain common indicators of the video service such as download rate, download size, etc.
  • then further analyze the video data save the video file header content, and decode the video detailed parameters from the video file header content, including but not limited to the video encoding rate, And/or video parameters such as video format, and/or video duration, and/or video frame rate.
  • Step 102 Determine a video indicator evaluation criterion according to the identified terminal information, and calculate a video indicator according to the identified terminal information and video service information.
  • the video index evaluation standard is determined, and the video index evaluation standard suitable for the type may be selected according to the type of the terminal.
  • the video fluency index rating standard is set in advance, and different fluent rating standards are given according to the terminal is a mobile phone and a computer. Assumption: When the mobile phone watches the video, the normal frame rate is 12 frames/second, and the mobile phone can be viewed smoothly. The 12 frames/second is the smooth standard of the mobile phone; when the mobile phone watches the intense picture, such as a football match, the frame rate is 24 frames/second, which is relatively clear.
  • 24 frames / sec is the standard of mobile phone violent picture; 40 frames / sec is the highest perceived effect of watching video on mobile phones, greater than this frame rate has little effect on video fluency perception.
  • the frame rate is 24 frames per second, which is the standard of smoothness. This is the frame rate of ordinary movies. 24 frames per second is the standard for computer fluency.
  • 30 frames / sec is the standard of computer intense picture; 60 frames / sec is the highest perceived effect of computer viewing video, greater than this frame rate has little effect on video fluency perception.
  • This evaluation standard can be further refined into evaluation criteria for various types of terminals, such as the evaluation criteria for 3-inch Samsung mobile phones, the evaluation standard for 4-inch IPhone mobile phones, and the evaluation standard for 42-inch color TVs. Large, higher quality video requirements, etc.
  • the video index evaluation standard may also use other characteristics of the video as the rating standard, and may also distinguish different rating standards according to the terminal type.
  • the method of the present invention is not limited to the video fluency rating standard of the above example.
  • the calculated video indicator in this step includes: combining the identified terminal type, video content, and view Frequency parameter and other information, evolving network video indicators such as video coding rate, video actual download rate, video frame rate, download duration, video duration, etc. to obtain new video indicators, such as video actual frame rate, and/or playback efficiency And/or play video metrics such as delay rates.
  • evolving network video indicators such as video coding rate, video actual download rate, video frame rate, download duration, video duration, etc. to obtain new video indicators, such as video actual frame rate, and/or playback efficiency And/or play video metrics such as delay rates.
  • the actual frame rate of the video in this step (video actual download rate / video encoding rate) ⁇ video nominal frame rate; if the actual video frame rate > video rated frame rate, then adjust the actual video frame rate to be equal to the video rated frame rate .
  • the pre-set video fluency indicator evaluation standard is a computer viscous video metric index evaluation standard, wherein a frame rate of 24 frames/second is a smooth standard.
  • the video encoding rate is 1152kpbs
  • the video frame rate is 30 frames/second
  • the actual video download rate is 700kpbs.
  • the calculated actual frame rate of the video is less than 24 frames/second compared to the computer video smooth rating standard. Therefore, the video viewing may be considered to be unsmooth.
  • the playback efficiency in this step can be calculated based on the video coding rate. When the calculated playback efficiency is less than 1, it indicates that there is a delay in the video.
  • the playback delay rate in this step can be calculated based on the duration of the video.
  • the playback delay rate is positive, indicating a delay in the video.
  • Step 103 Obtain a video perception evaluation result by using the calculated video indicator and the determined video indicator evaluation criterion.
  • the calculated video indicator is queried in the determined video indicator evaluation standard, and the evaluation level of the video indicator is obtained; the obtained evaluation level of the video indicator is the user's true perceptual evaluation result of the video attribute;
  • Each video attribute indicator is evaluated to obtain the evaluation level of each attribute indicator of the video, that is, the user's true perceptual evaluation result of each attribute of the video.
  • the actual frame rate of the user calculated according to step 101 and step 102 is 18.2 frames/second.
  • the playback delay rate calculated according to step 101 and step 102 is +11.1%; assuming that the extension rate indicator evaluation criterion is selected, the playback delay rate is a positive number, and the larger the value, the more severe the delay; then, the video time
  • the result of the sexy evaluation is that there is a delay.
  • the evaluation level of the multiple attributes of the video can be obtained, that is, the true perceptual evaluation result of the multiple attributes of the video.
  • the weighted scoring method may also be used to convert multiple indicator levels into scores, and different indicators are assigned different weights, and a plurality of indicators are integrated to obtain an overall video perceptual evaluation score, that is, the overall evaluation result of the corresponding video.
  • the sound attribute indicator of the video can select an appropriate sound effect evaluation standard according to the user characteristics (such as the characteristics of the terminal audio device), and combine the sound effect parameter and the actual sound effect data in the video file to obtain the actual sound effect index, according to the actual sound effect index and the sound effect. Evaluate the criteria and obtain a realistic perception of the user's audio performance.
  • the method of the embodiment of the present invention further includes: performing weighting adjustment on the video indicator according to the video content, the format information, and the like. among them,
  • Adjusted video actual frame rate actual video frame rate before adjustment ⁇ weighting factor
  • the actual frame rate can be adjusted by using the weighting factor of 0.8. If the recognized video theme is an animated cartoon, then the animation itself has low requirements for picture continuity, and the actual frame rate can be adjusted using a weighting factor of 1.4. According to this method, for example, watching an animation, assuming that the actual frame rate is 18.2 frames/second, after the weight adjustment, the adjusted actual frame rate is 25.48 frames/second, which is a smooth level; another example: watching a certain football on a computer terminal In the game, the actual frame rate is 18.2 frames/second. After the weight adjustment, the adjusted actual frame rate is 14.56. Frames/seconds are not smooth.
  • the method of the present invention is not limited to performing weighting coefficient adjustment according to video content characteristics, and may also be adjusted according to other characteristics of video content, such as video format, high definition video, and plain video.
  • the method for optimizing the video perceptual evaluation based on the terminal type, video content, and video parameters is only an example.
  • the actual application is not limited to these types of allocation methods.
  • the general idea is based on the type of user terminal, the difference in viewing video content, and the actual video network index. To evolve new video metrics to assess user video perception. Such a method fully reflects the difference in user content and video content, and more accurately perceives the overall performance of the system, thereby better reflecting the perceived effect of the video service.
  • the method includes at least an acquisition module, an identification module, a determination module, a calculation module, and an evaluation module.
  • the acquisition module is set to obtain data generated by the user on the Internet.
  • the identification module is configured to identify terminal information and video service information from the obtained data.
  • the determining module is configured to determine a video indicator evaluation criterion according to the identified terminal information.
  • the calculation module is configured to calculate a video indicator according to the identified terminal information and the video service information.
  • the evaluation module is configured to obtain the video perception evaluation result by using the calculated video indicator and the determined video indicator evaluation standard.
  • the apparatus of the embodiment of the present invention further includes a weighting module configured to perform weighting adjustment on the video indicator.
  • the video service information includes video service flow information and video parameters.
  • the identification module is configured to: identify a data stream of the video service according to the obtained data generated by the user online, thereby acquiring video service flow information;
  • Obtaining common indicators of the video service further analyzing the video data, saving the video file header content, and decoding the video parameters from the video file header content; wherein the video parameters include a video encoding rate, and/or a video format, and/or Video duration, and/or video frame rate, etc.
  • the calculation module is configured to: combine the identified terminal type, video content, and video parameters, and perform evolution calculation on the network video indicator to obtain a video indicator.
  • the video indicator includes the actual frame rate of the video, and/or the playback efficiency, and/or the playback delay rate.
  • the evaluation module is configured to: according to the calculated video indicators and the determined evaluation criteria of each video indicator, obtain the evaluation level of each attribute indicator of the video, that is, the user's true perceptual evaluation result of the video attributes.
  • the evaluation module is further configured to convert a plurality of indicator levels into scores by using a weighted scoring method, assign different weights to the plurality of indicators, and integrate a plurality of indicators to obtain an overall video perceptual evaluation score, that is, the overall evaluation result of the corresponding video.
  • all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.
  • the devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.
  • each device/function module/functional unit in the above embodiment When each device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium.
  • the above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.
  • the technical solution provided by the embodiment of the present invention evolves a new video indicator according to the type of the user terminal, the difference of the video content, and the actual video network indicator, thereby evaluating the user's video perception effect, which fully reflects the user difference and the video content difference.
  • the overall performance of the system is accurately perceived, which better reflects the perceived effect of the video service.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

一种用户感知评估方法及装置，包括获取用户上网产生的数据；从获得的数据中识别出终端信息和视频业务信息；根据识别出的终端信息确定视频指标评估标准，根据识别出的终端信息和视频业务信息计算视频指标；利用计算出的视频指标和确定的视频指标评估标准，获取视频感知评估结果。

Description

一种用户感知评估方法及装置 技术领域
本文涉及移动互联网技术，尤指一种用户感知评估方法及装置。
背景技术
全球的移动互联网业务发展迅速，很多地区已经步入第四代移动通信(4G)网络时代，同时，随着使用高速移动互联网用户的激增，使用业务也出现了变化。第二代移动通信(2G)时代，用户主要使用语音电话；而3G/4G时代以来网络中传输的大量流量都是视频流量，随着越来越多用户喜欢使用移动互联网来观看视频内容，用户的要求也越来越高，这样以来，对运营商的网络质量、内容提供商的系统质量等提出了更高要求。
以用户体验为中心的用户感知评估方法成为互联网的热门技术，这种以终端用户的实际感知结果为评价核心的方法，更能体现客户的满意程度。用户的体验质量(QOE，Quality of Experience)是用户端到端的概念，是指用户对业务的主观体验，是从用户的角度感觉到的系统的整体性能。
对3G/4G时代的网络核心流量如视频业务，使用用户感知评估方法进行业务质量评估，可以更准确反映运营商网络质量、从而发现网络问题等。现有的用户视频感知评价技术仅仅是从接入性能、视频下载速率等方面，使用建立时延指标、下载速率指标等进行评估。其中，建立时延指标是视频业务的TCP链接建立的时长，下载速率指标是业务单位时间内的下载流量。
相关技术的用户视频感知评价方法中，没有考虑实际用户视频内容差异性,不同内容、不同视频格式对网络质量要求的差异性,用户终端的差异等因素。也就是说，用户感知评估方法指示通过通用指标如建立时延指标、下载速率指标来进行感知评价，很难精确感知到系统的整体性能，也不能精确体现视频业务的感知效果。
发明内容
本发明实施例提供一种用户感知评估方法及装置，能够更加精确地感知 到系统的整体性能，从而更好地体现视频业务的感知效果。
一种用户感知评估方法，包括：
获取用户上网产生的数据；
从获得的数据中识别出终端信息和视频业务信息；
根据识别出的终端信息确定视频指标评估标准，根据识别出的终端信息和视频业务信息计算视频指标；
利用计算出的视频指标和确定的视频指标评估标准，获取视频感知评估结果。
可选地，所述识别出的终端信息和视频业务信息计算视频指标之后，所述获取视频感知评估结果之前，该方法还包括：对所述视频指标进行加权调整。
可选地，所述对视频指标进行加权调整包括：根据所述数据中的视频内容特性进行加权调整。
可选地，所述视频业务信息包括视频业务流信息和视频参数。
可选地，所述从获得的数据中识别出视频业务信息包括：
根据所述获得的用户上网产生的数据识别出视频业务的数据流，从而获取所述视频业务流信息；
获取视频业务的常用指标；再深入分析视频数据，保存视频文件头部内容，从视频文件头部内容中解码出所述视频参数；其中，所述视频参数至少包括视频编码率、和/或视频格式、和/或视频时长、和/或视频帧率。
可选地，所述确定视频指标评估标准包括：根据所述识别出的终端的类型，选择该类型对应的预先设置的视频指标评估标准。
可选地，所述视频指标评估标准为针对多项视频指标进行等级评判的评估标准。
可选地，所述视频指标评估标准为视频流畅性评级标准。
可选地，所述计算视频指标包括：结合所述识别出的终端类型、视频内容以及视频参数，对网络视频指标进行演进计算获取所述视频指标。
可选地，所述视频指标至少包括视频实际帧率、和/或播放效率、和/或播放延期率。
可选地，所述获取视频感知评估结果包括：
将所述计算出的视频指标在所述确定出的视频指标评估标准中进行查询，获取该视频指标的评价等级作为用户对该项视频属性的真实感知评估结果；对多项视频属性指标分别进行评估，获取视频的多项属性指标的评价等级分别作为用户对视频多项属性的真实感知评估结果。
一种用户感知评估装置，包括获取模块、识别模块、确定模块、计算模块和评估模块；其中，
所述获取模块，设置为获取用户上网产生的数据；
所述识别模块，设置为从获得的数据中识别出终端信息和视频业务信息；
所述确定模块，设置为根据识别出的终端信息确定视频指标评估标准；
所述计算模块，设置为根据识别出的终端信息和视频业务信息计算视频指标；
所述评估模块，设置为利用计算出的视频指标和确定的视频指标评估标准，获取视频感知评估结果。
可选地，该装置还包括加权模块，设置为对所述计算模块输出的视频指标进行加权调整。
可选地，所述视频业务信息包括视频业务流信息和视频参数。
可选地，所述识别模块时设置为：根据所述获得的用户上网产生的数据识别出视频业务的数据流，从而获取所述视频业务流信息；
获取视频业务的常用指标；再深入分析视频数据，保存视频文件头部内容，从视频文件头部内容中解码出所述视频参数；其中，所述视频参数至少包括视频编码率、和/或视频格式、和/或视频时长、和/或视频帧率。
可选地，所述计算模块是设置为：结合所述识别出的终端类型、视频内容和视频参数，对网络视频指标进行演进计算获取所述视频指标。
可选地，所述视频指标包括视频实际帧率、和/或播放效率、和/或播放延 期率。
可选地，所述评估模块是设置为：根据计算出的多项视频指标和确定的多项视频指标评估标准，获取视频的多项属性指标的评价等级作为用户对视频多项属性的真实感知评估结果。
一种计算机可读存储介质，存储有程序指令，当该程序指令被执行时可实现上面所述的方法。
本发明实施例提供的技术方案根据用户终端类型、观看视频内容差异、结合实际视频网络指标来演进新的视频指标，从而来评估用户视频感知效果，由于充分体现了用户差异、视频内容差异，更加精确地感知到了系统的整体性能，从而更好地体现了视频业务的感知效果。
附图概述
图1为本发明实施例的用户感知评估方法的流程图；
图2为本发明实施例的用户感知评估装置的组成结构示意图。
本发明的实施方式
下文中将结合附图对本发明的实施例进行详细说明。需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互任意组合。
图1为本发明实施例的用户感知评估方法的流程图，如图1所示，包括：
步骤100：获取用户上网产生的数据。
步骤101：从获得的数据中识别出终端信息和视频业务信息。
本步骤中，可以从获得的用户上网产生的数据携带的特征信息中识别出用户所使用终端的类型，并可以使用终端类型查询终端类型库从而得出更加详细的终端信息，比如苹果手机、手机型号、该型号手机屏幕大小等。比如，超文本传输协议(HyperText Transfer Protocol，HTTP)的UA字段会携带终端类型信息，从而识别出终端类型。本步骤中，视频业务信息包括视频业务流信息和视频参数。其中，
根据获得的用户上网产生的数据中的IP地址、主机名、特征词、统一资源定位符(Uniform Resource Locator，ULR)分类等信息，可以识别出视频业 务的数据流，从而获取视频业务流信息如视频具体业务主题，比如优酷视频、优酷足球视频、少儿动画等；
获取视频业务的常用指标如下载速率，下载大小等，然后，再深入分析视频数据，保存视频文件头部内容，从视频文件头部内容中解码出视频详细参数，包括但不限于视频编码率、和/或视频格式、和/或视频时长、和/或视频帧率等视频参数。
本发明实施例提供的用户感知评估方法中，可以获取更加详细的视频参数，以便更加精确地感知到系统的整体性能，从而更好地体现视频业务的感知效果。
步骤102：根据识别出的终端信息确定视频指标评估标准，根据识别出的终端信息和视频业务信息计算视频指标。
本步骤中的确定视频指标评估标准，可以根据终端的类型，选择合适该类型的视频指标评估标准。比如，针对视频流畅性指标的评价，预先设置视频流畅性指标评级标准，根据终端是手机和电脑，给出不同的流畅评级标准。假设：手机观看视频时，正常帧率为12帧/秒就可以观看流畅，12帧/秒是手机流畅标准；手机观看激烈画面如足球比赛等时要求帧率为24帧/秒才比较清晰，24帧/秒是手机激烈画面流畅标准；40帧/秒是手机观看视频最高感知效果，大于这个帧率对视频流畅性感知影响不大。电脑观看视频时，帧率为24帧/秒是流畅标准，这也是普通电影的帧率，24帧/秒是电脑流畅标准；电脑观看激烈画面如足球比赛等时要求30帧/秒才比较清晰，30帧/秒是电脑激烈画面流畅标准；60帧/秒是电脑观看视频最高感知效果，大于这个帧率对视频流畅性感知影响不大。这个评价标准还可以更加细化为多种类型终端的评价标准，比如分别针对3寸三星手机评价标准、4寸IPhone手机评价标准、42寸彩电的评价标准(现在很多网络视频电视机尺寸都很大，对视频质量要求更高)等。
需要说明的是，视频指标评估标准也可以以视频的其他特性为评级标准，也可以根据终端类型区分不同评级标准，本发明方法并不限制于上述举例的视频流畅性评级标准。
本步骤中的计算视频指标包括：结合识别出的终端类型、视频内容、视 频参数等信息，对网络视频指标如视频编码率、视频实际下载速率、视频额定帧率、下载时长、视频时长等进行演进计算获取新的视频指标，如视频实际帧率、和/或播放效率、和/或播放延期率等视频指标。
视频编码率基本等于额定要求的播放速率A，在播放速率A下有视频额定帧率B。假设视频实际下载速率是C，那么，视频实际帧率D＝(C/A)×B。如果视频实际帧率D大于视频额定帧率B，那么，必须调整视频实际帧率D使其等于视频额定帧率B。也就是说：
本步骤中的视频实际帧率＝(视频实际下载速率/视频编码率)×视频额定帧率；假如，视频实际帧率>视频额定帧率,那么将视频实际帧率调整为等于视频额定帧率。
举个例子，假设用户使用电脑观看视频，预先设置的视频流畅性指标评估标准为电脑观看视频流畅性指标评估标准，其中，帧率为24帧/秒是流畅标准。假设电脑观看某个视频，要求视频编码率为1152kpbs，视频额定帧率是30帧/秒，视频实际下载速率是700kpbs，那么，根据上述视频实际帧率的计算公式，视频实际帧率是(700/1152)×30＝18.2帧/秒。计算出的视频实际帧率与电脑视频流畅评级标准相比，小于24帧/秒，因此，可以认为该视频观看属于不流畅。
本步骤中的播放效率可以根据视频编码率计算得到。在计算出的播放效率小于1时，说明视频会存在延迟。
播放效率＝视频实际下载速率/视频编码率；比如：某视频额定播放速率为1152kpbs，视频实际下载速率为700kbps，则播放效率700/11152＝60.7％，小于1，说明视频会延迟卡顿。
本步骤中的播放延期率可以根据视频的时长计算得到。播放延期率为正数，说明视频会存在延迟。
播放延期率＝(下载时长-视频时长)/视频时长；比如：某视频时长是1800s，实际下载时长是2000s，播放延期率(2000-1800)/1800＝+11.1％，是正数，说明视频会延迟卡顿。
步骤103：利用计算出的视频指标和确定的视频指标评估标准，获取视频感知评估结果。
本步骤中，将计算出的视频指标在确定的视频指标评估标准中进行查询，获取该视频指标的评价等级；获得的该视频指标的评价等级就是用户对该项视频属性的真实感知评估结果；对每项视频属性指标都进行评估，获取视频的每项属性指标的评价等级，即用户对视频每项属性的真实感知评估结果。
举个例子，比如：用户使用手机终端观看普通视频，根据步骤101、步骤102计算得到用户实际帧率为18.2帧/秒。假设选择手机视频流畅性指标评估标准，范围在12帧/秒-24帧/秒之间属于流畅等级；那么，步骤103得出的视频的流畅性感知评估结果是流畅。再如：根据播放延期率，根据步骤101、步骤102计算得到的播放延期率是+11.1％；假设选择延期率指标评估标准，播放延期率是正数、数值越大延迟越严重；那么，视频时间性感知评估结果是存在延迟。相同方法，可以获取视频多项属性的评估等级，即视频多项属性的真实感知评估结果。
可选地，还可以使用加权打分的方法将多项指标等级转换为分数，对多项指标分别分配不同权重，综合多项指标获取一个整体的视频感知评估分数，即对应视频整体评估结果。使用相同方法，可以类似获取视频每项属性指标的评估结果。例如，视频的音效属性指标，可以根据用户特性(例如终端音频设备特性)选择合适的音效指标评价标准，再结合视频文件中音效参数、实际音效数据，获取实际音效指标，根据实际音效指标和音效评估标准，获取用户对视频音效属性的真实感知评估结果。
可选地，步骤102之后，步骤103之前，本发明实施例的方法还包括：根据视频内容、格式信息等，对视频指标进行加权调整。其中，
调整后的视频实际帧率＝调整前的视频实际帧率×加权系数；
假如识别出的视频主题是足球比赛视频，那么由于足球比赛画面激烈，帧率要求更高才能不出现马赛克等情况，因此，可以使用加权系数为0.8对实际帧率进行调整。假如识别出的视频主题是动画片，那么动画片本身对画面连续性要求低，可以使用加权系数为1.4对实际帧率进行调整。根据这个方法，比如：观看某动画片，假设实际帧率是18.2帧/秒，进行加权调整后，调整后的实际帧率是25.48帧/秒，属于流畅等级；再如：电脑终端观看某足球比赛，实际帧率是18.2帧/秒，进行加权调整后，调整后的实际帧率是14.56 帧/秒，则属于不流畅等级。
需要说明的是，本发明方法并不限于根据视频内容特性进行加权系数调整，也可以根据视频内容其他特性如视频格式，高清视频和普清视频等进行调整。
上面关于根据终端类型、视频内容、视频参数优化视频感知评估的方法只是举例，实际运用中不限于这几种分配方式，总的思路是根据用户终端类型、观看视频内容差异、结合实际视频网络指标来演进新的视频指标，从而来评估用户视频感知效果。这样的方法因为充分体现了用户差异、视频内容差异，更加精确地感知到了系统的整体性能，从而更好地体现了视频业务的感知效果。
图2为本发明实施例用户感知评估装置的组成结构示意图，如图2所示，至少包括获取模块、识别模块、确定模块、计算模块和评估模块；其中，
获取模块，设置为获取用户上网产生的数据。
识别模块，设置为从获得的数据中识别出终端信息和视频业务信息。
确定模块，设置为根据识别出的终端信息确定视频指标评估标准。
计算模块，设置为根据识别出的终端信息和视频业务信息计算视频指标。
评估模块，设置为利用计算出的视频指标和确定的视频指标评估标准，获取视频感知评估结果。
本发明实施例的装置还包括加权模块，设置为对视频指标进行加权调整。
其中，视频业务信息包括视频业务流信息和视频参数。识别模块是设置为：根据获得的用户上网产生的数据识别出视频业务的数据流，从而获取视频业务流信息；
获取视频业务的常用指标；再深入分析视频数据，保存视频文件头部内容，从视频文件头部内容中解码出所视频参数；其中，视频参数包括视频编码率、和/或视频格式、和/或视频时长、和/或视频帧率等。
计算模块是设置为：结合识别出的终端类型、视频内容、视频参数，对网络视频指标进行演进计算获取视频指标。
其中，视频指标包括视频实际帧率、和/或播放效率、和/或播放延期率等。
评估模块是设置为：根据计算出的各项视频指标和确定的各项视频指标评估标准，获取视频的各项属性指标的评价等级，即用户对视频各项属性的真实感知评估结果。
评估模块还设置为，使用加权打分的方法将多项指标等级转换为分数，对多项指标分别分配不同权重，综合多项指标获取一个整体的视频感知评估分数，即对应视频整体评估结果。
本领域普通技术人员可以理解上述实施例的全部或部分步骤可以使用计算机程序流程来实现，所述计算机程序可以存储于一计算机可读存储介质中，所述计算机程序在相应的硬件平台上(如系统、设备、装置、器件等)执行，在执行时，包括方法实施例的步骤之一或其组合。
可选地，上述实施例的全部或部分步骤也可以使用集成电路来实现，这些步骤可以被分别制作成一个个集成电路模块，或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。
上述实施例中的各装置/功能模块/功能单元可以采用通用的计算装置来实现，它们可以集中在单个的计算装置上，也可以分布在多个计算装置所组成的网络上。
上述实施例中的各装置/功能模块/功能单元以软件功能模块的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。上述提到的计算机可读取存储介质可以是只读存储器，磁盘或光盘等。
工业实用性
本发明实施例提供的技术方案根据用户终端类型、观看视频内容差异、结合实际视频网络指标来演进新的视频指标，从而来评估用户视频感知效果，由于充分体现了用户差异、视频内容差异，更加精确地感知到了系统的整体性能，从而更好地体现了视频业务的感知效果。

Claims (19)

  1. 一种用户感知评估方法，包括：
    获取用户上网产生的数据；
    从获得的数据中识别出终端信息和视频业务信息；
    根据识别出的终端信息确定视频指标评估标准，根据识别出的终端信息和视频业务信息计算视频指标；
    利用计算出的视频指标和确定的视频指标评估标准，获取视频感知评估结果。
  2. 根据权利要求1所述的用户感知评估方法，所述识别出的终端信息和视频业务信息计算视频指标之后，所述获取视频感知评估结果之前，该方法还包括：对所述视频指标进行加权调整。
  3. 根据权利要求2所述的用户感知评估方法，其中，所述对视频指标进行加权调整包括：根据所述数据中的视频内容特性进行加权调整。
  4. 根据权利要求1或2所述的用户感知评估方法，其中，所述视频业务信息包括视频业务流信息和视频参数。
  5. 根据权利要求4所述的用户感知评估方法，其中，所述从获得的数据中识别出视频业务信息包括：
    根据所述获得的用户上网产生的数据识别出视频业务的数据流，从而获取所述视频业务流信息；
    获取视频业务的常用指标；再深入分析视频数据，保存视频文件头部内容，从视频文件头部内容中解码出所述视频参数；其中，所述视频参数至少包括视频编码率、和/或视频格式、和/或视频时长、和/或视频帧率。
  6. 根据权利要求1或2所述的用户感知评估方法，其中，所述确定视频指标评估标准包括：根据所述识别出的终端的类型，选择该类型对应的预先设置的视频指标评估标准。
  7. 根据权利要求6所述的用户感知评估方法，其中，所述视频指标评估标准为针对多项视频指标进行等级评判的评估标准。
  8. 根据权利要求7所述的用户感知评估方法，其中，所述视频指标评估标准为视频流畅性评级标准。
  9. 根据权利要求1或2所述的用户感知评估方法，其中，所述计算视频指标包括：结合所述识别出的终端类型、视频内容以及视频参数，对网络视频指标进行演进计算获取所述视频指标。
  10. 根据权利要求9所述的用户感知评估方法，其中，所述视频指标至少包括视频实际帧率、和/或播放效率、和/或播放延期率。
  11. 根据权利要求1或2所述的用户感知评估方法，其中，所述获取视频感知评估结果包括：
    将所述计算出的视频指标在所述确定出的视频指标评估标准中进行查询，获取该视频指标的评价等级作为用户对该项视频属性的真实感知评估结果；对多项视频属性指标分别进行评估，获取视频的多项属性指标的评价等级分别作为用户对视频多项属性的真实感知评估结果。
  12. 一种用户感知评估装置，包括获取模块、识别模块、确定模块、计算模块和评估模块；其中，
    所述获取模块，设置为获取用户上网产生的数据；
    所述识别模块，设置为从获得的数据中识别出终端信息和视频业务信息；
    所述确定模块，设置为根据识别出的终端信息确定视频指标评估标准；
    所述计算模块，设置为根据识别出的终端信息和视频业务信息计算视频指标；
    所述评估模块，设置为利用计算出的视频指标和确定的视频指标评估标准，获取视频感知评估结果。
  13. 根据权利要求12所述的用户感知评估装置，该装置还包括加权模块，设置为对所述计算模块输出的视频指标进行加权调整。
  14. 根据权利要求12或13所述的用户感知评估装置，其中，所述视频业务信息包括视频业务流信息和视频参数。
  15. 根据权利要求14所述的用户感知评估装置，其中，所述识别模块时 设置为：根据所述获得的用户上网产生的数据识别出视频业务的数据流，从而获取所述视频业务流信息；
    获取视频业务的常用指标；再深入分析视频数据，保存视频文件头部内容，从视频文件头部内容中解码出所述视频参数；其中，所述视频参数至少包括视频编码率、和/或视频格式、和/或视频时长、和/或视频帧率。
  16. 根据权利要求12或13所述的用户感知评估装置，其中，所述计算模块是设置为：结合所述识别出的终端类型、视频内容和视频参数，对网络视频指标进行演进计算获取所述视频指标。
  17. 根据权利要求16所述的用户感知评估装置，其中，所述视频指标包括视频实际帧率、和/或播放效率、和/或播放延期率。
  18. 根据权利要求12或13所述的用户感知评估装置，其中，所述评估模块是设置为：根据计算出的多项视频指标和确定的多项视频指标评估标准，获取视频的多项属性指标的评价等级作为用户对视频多项属性的真实感知评估结果。
  19. 一种计算机可读存储介质，存储有程序指令，当该程序指令被执行时可实现权利要求1-11任一项所述的方法。
PCT/CN2015/078884 2015-02-28 2015-05-13 一种用户感知评估方法及装置 WO2016134564A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510091429.0 2015-02-28
CN201510091429.0A CN105991364B (zh) 2015-02-28 2015-02-28 一种用户感知评估方法及装置

Publications (1)

Publication Number Publication Date
WO2016134564A1 true WO2016134564A1 (zh) 2016-09-01

Family

ID=56787801

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/078884 WO2016134564A1 (zh) 2015-02-28 2015-05-13 一种用户感知评估方法及装置

Country Status (2)

Country Link
CN (1) CN105991364B (zh)
WO (1) WO2016134564A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112398706A (zh) * 2019-08-19 2021-02-23 中国移动通信集团广西有限公司 数据评估标准确定方法、装置及存储介质、电子设备
WO2021115255A1 (zh) * 2019-12-09 2021-06-17 华为技术有限公司 一种评测vr体验临场感的方法、装置及系统
CN117939189A (zh) * 2024-03-21 2024-04-26 中国信息通信研究院 一种面向不良视频加密流量数据的质量属性评价方法和系统

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106791805B (zh) * 2016-12-06 2018-08-10 中国联合网络通信集团有限公司 一种视频业务评估的方法及装置
CN108270738B (zh) * 2016-12-30 2021-11-19 北京华为数字技术有限公司 一种视频处理方法及网络设备
CN107046480A (zh) * 2017-04-17 2017-08-15 广东经纬天地科技股份有限公司 一种用户感知评估方法及装置
CN110365970A (zh) * 2019-07-10 2019-10-22 广州瀚信通信科技股份有限公司 一种基于监督学习评估终端VoLTE视频通话感知方法
CN112529048B (zh) * 2020-11-23 2022-12-06 浙江大学 一种基于感知体验的产品展示视频辅助设计方法和装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102685717A (zh) * 2012-05-08 2012-09-19 中国联合网络通信集团有限公司 网络业务质量参数识别方法及装置
WO2013044997A1 (en) * 2011-09-28 2013-04-04 Telefonica, S.A. A method to measure quality of experience of a video service
CN103152599A (zh) * 2013-02-01 2013-06-12 浙江大学 基于有序回归的移动视频业务用户体验质量评估方法
US20130293725A1 (en) * 2012-05-07 2013-11-07 Futurewei Technologies, Inc. No-Reference Video/Image Quality Measurement with Compressed Domain Features
CN103945214A (zh) * 2013-01-23 2014-07-23 中兴通讯股份有限公司 终端侧时间域视频质量评价方法及装置
CN104023232A (zh) * 2014-06-27 2014-09-03 北京邮电大学 基于层次分析和多元线性回归的移动视频质量评估方法

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102711162A (zh) * 2012-07-03 2012-10-03 北京博识创智科技发展有限公司 一种移动互联网中网络质量监测和用户体验优化的方法
US8855625B2 (en) * 2012-12-10 2014-10-07 At&T Mobility Ii Llc Dynamic steering of traffic across radio access networks
CN104378220A (zh) * 2013-08-14 2015-02-25 中兴通讯股份有限公司 评价用户体验质量的方法及装置、用户终端、网络服务器

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013044997A1 (en) * 2011-09-28 2013-04-04 Telefonica, S.A. A method to measure quality of experience of a video service
US20130293725A1 (en) * 2012-05-07 2013-11-07 Futurewei Technologies, Inc. No-Reference Video/Image Quality Measurement with Compressed Domain Features
CN102685717A (zh) * 2012-05-08 2012-09-19 中国联合网络通信集团有限公司 网络业务质量参数识别方法及装置
CN103945214A (zh) * 2013-01-23 2014-07-23 中兴通讯股份有限公司 终端侧时间域视频质量评价方法及装置
CN103152599A (zh) * 2013-02-01 2013-06-12 浙江大学 基于有序回归的移动视频业务用户体验质量评估方法
CN104023232A (zh) * 2014-06-27 2014-09-03 北京邮电大学 基于层次分析和多元线性回归的移动视频质量评估方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112398706A (zh) * 2019-08-19 2021-02-23 中国移动通信集团广西有限公司 数据评估标准确定方法、装置及存储介质、电子设备
WO2021115255A1 (zh) * 2019-12-09 2021-06-17 华为技术有限公司 一种评测vr体验临场感的方法、装置及系统
CN117939189A (zh) * 2024-03-21 2024-04-26 中国信息通信研究院 一种面向不良视频加密流量数据的质量属性评价方法和系统
CN117939189B (zh) * 2024-03-21 2024-06-11 中国信息通信研究院 一种面向不良视频加密流量数据的质量属性评价方法和系统

Also Published As

Publication number Publication date
CN105991364A (zh) 2016-10-05
CN105991364B (zh) 2020-07-17

Similar Documents

Publication Publication Date Title
WO2016134564A1 (zh) 一种用户感知评估方法及装置
Ghadiyaram et al. A subjective and objective study of stalling events in mobile streaming videos
Hoßfeld et al. Assessing effect sizes of influence factors towards a QoE model for HTTP adaptive streaming
US10305947B2 (en) Pre-buffering audio streams
CN110769270B (zh) 直播互动的方法及装置、电子设备、存储介质
Ghadiyaram et al. Study of the effects of stalling events on the quality of experience of mobile streaming videos
JP4486130B2 (ja) 映像コミュニケーション品質推定装置、方法、およびプログラム
Staelens et al. Subjective quality assessment of longer duration video sequences delivered over HTTP adaptive streaming to tablet devices
Rodríguez et al. Video quality metric for streaming service using DASH standard
Rodríguez et al. Video quality assessment in video streaming services considering user preference for video content
CN113068052B (zh) 确定直播间刷量的方法、直播方法以及数据处理方法
US9544346B1 (en) Systems and methods for selecting a node for media streaming
Tavakoli et al. Perceptual quality of HTTP adaptive streaming strategies: Cross-experimental analysis of multi-laboratory and crowdsourced subjective studies
US20220165035A1 (en) Latency indicator for extended reality applications
Tavakoli et al. Quality of experience of adaptive video streaming: Investigation in service parameters and subjective quality assessment methodology
CN104040953A (zh) 视频传输的用户体验质量测试
US20230156068A1 (en) System and method for managing video streaming quality of experience
CN110996097A (zh) Vr多媒体的体验质量确定方法及装置
de Fez et al. New objective QoE models for evaluating ABR algorithms in DASH
Chen et al. Multimedia quality of experience (QoE): current status and future requirements
Søgaard et al. On subjective quality assessment of adaptive video streaming via crowdsourcing and laboratory based experiments
Zhang et al. Qoecenter: A visual platform for qoe evaluation of streaming video services
CN114945097B (zh) 视频流处理方法及装置
Ning et al. A novel QoS-based QoE evaluation method for streaming video service
Stensen Evaluating QoS and QoE Dimensions in Adaptive Video Streaming

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15883002

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15883002

Country of ref document: EP

Kind code of ref document: A1