WO2012010046A1 - Method and system for testing video encoding performance - Google Patents

Method and system for testing video encoding performance Download PDF

Info

Publication number
WO2012010046A1
WO2012010046A1 PCT/CN2011/076606 CN2011076606W WO2012010046A1 WO 2012010046 A1 WO2012010046 A1 WO 2012010046A1 CN 2011076606 W CN2011076606 W CN 2011076606W WO 2012010046 A1 WO2012010046 A1 WO 2012010046A1
Authority
WO
WIPO (PCT)
Prior art keywords
test
bit rate
score
module
encoder
Prior art date
Application number
PCT/CN2011/076606
Other languages
French (fr)
Chinese (zh)
Inventor
舒倩
Original Assignee
深圳市融创天下科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市融创天下科技股份有限公司 filed Critical 深圳市融创天下科技股份有限公司
Publication of WO2012010046A1 publication Critical patent/WO2012010046A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/004Diagnosis, testing or measuring for television systems or their details for digital television systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output

Definitions

  • the present invention relates to the field of video coding technologies, and in particular, to a video coding performance testing method and system.
  • the pros and cons of a video coding technique mainly depends on video compression performance and adaptability to network transmission.
  • the video compression performance of the coding technology determines the quality of the video image after its compression processing, and the adaptability to the network transmission determines whether the compressed video code stream can be stably transmitted in the network, and the code stream is received. Whether the terminal will often get into the buffer.
  • the test of video quality in general, can be divided into two methods: subjective quality test and objective quality test.
  • the current mainstream objective quality test method is the utilization distortion performance to measure the compression performance of the encoder.
  • the rate distortion data can objectively measure the distortion of the encoded image relative to the original image, the defect is that the distortion cannot be discriminated. The value of the image effect.
  • the subjective test is based on the evaluation of the visual effect of the personnel, so as to analyze the ability of the encoder to preserve the details, is an important means to measure the video quality. Subjective tests usually collect a large number of samples and remove the subjective errors of the testers by statistical methods.
  • the rate fluctuation characteristic measures the adaptability of the video encoder to network transmission, which is especially important for mobile channels. Mobile channels have resource-limited, error-prone characteristics. The code stream output by the encoder, if the fluctuation characteristics are obvious, will cause the terminal player to frequently become buffered.
  • the conventional test method only provides performance evaluation of the quality of the coding technology video test, not simultaneously Investigate the network transmission performance of coding technology.
  • it is necessary to comprehensively evaluate the coding technology at the comprehensive level of the above two performances, it will be in a difficult situation, which is not conducive to comprehensive evaluation of video coding technology.
  • the purpose of the embodiments of the present invention is to provide a video coding performance testing method, which aims to solve the problem of the performance evaluation of the video quality of the coding technology in the prior art test method, and does not simultaneously consider the problem of the network transmission performance of the coding technology.
  • the method of the embodiment of the present invention is implemented by the method for testing a video coding performance, and the method includes the following steps:
  • test score value constructs a condition rate distortion graph according to the maximum window bit rate and the test score value, and obtain the video coding performance of the encoder.
  • Another object of the embodiments of the present invention is to provide a video coding performance testing system, where the system includes:
  • a maximum window acquisition module configured to obtain a maximum window bit rate
  • a scoring module configured to obtain a test score value
  • an evaluation module configured to obtain a video compression performance of different coding technologies and adapt to network transmission according to a condition rate distortion graph constructed according to the maximum window bit rate and the test score value Sexuality ⁇
  • the condition rate distortion performance proposed by the present invention uses a test score to measure the compression performance of an encoder on a video test quality, and on the other hand replaces a conventional average bit rate with a maximum window bit rate, Shows the transmission performance of the encoder.
  • the condition rate distortion graph constructed according to the maximum window bit rate and the test score value as the abscissa and the ordinate, the video compression performance and the adaptability to the network transmission of different coding techniques can be obtained, and the same test source can also be obtained.
  • the maximum window bit rate of the encoder is compared, the network transmission performance of the encoder is obtained, the test score is compared, and the compression performance of the encoder in the image test quality is obtained.
  • FIG. 1 is a flow chart of a preferred embodiment of a video encoding performance testing method of the present invention
  • FIG. 2 is a test interface and a test object explanatory diagram of a preferred embodiment of the video encoding performance testing method of the present invention
  • FIG. 3 is a condition rate distortion curve diagram of a first preferred embodiment of the video coding performance testing method of the present invention, which is configured to obtain a maximum window bit rate and a test score value of different code streams by different encoders for the same test video source;
  • FIG. 5 is a schematic structural diagram of a preferred embodiment of a video encoding performance testing method according to the present invention
  • FIG. 6 is a schematic structural diagram of a maximum window acquiring module of a preferred embodiment of the video encoding performance testing method of the present invention
  • Figure 7 is a block diagram showing the structure of a data filtering module of a preferred embodiment of the video encoding performance testing method of the present invention.
  • the embodiment of the present invention firstly establishes a condition rate distortion graph with a maximum window bit rate as an abscissa to test a score value as an ordinate, and then, according to the graph, can obtain video compression performance and network transmission of different coding techniques.
  • the adaptability that is, the higher the curve, the better the performance of the corresponding coding technique; on the other hand, the comparison of single-item performance can be obtained: By comparing the maximum window bit rate of the encoder under the same coding parameters of the same test-chip source, the encoder is obtained. Network transmission performance; Compare the value of the test score to obtain the compression performance of the encoder in the quality of the image test.
  • FIG. 1 is a flow chart of a preferred embodiment of a video coding performance testing method of the present invention. The method includes the following steps:
  • step 5102 determining, according to the code stream and the decoding sequence, whether a relative error between an actual output bit rate of the to-be-tested encoder and a target bit rate is within a specific range, if yes, proceeding to step S104, otherwise proceeding to step S103;
  • the proposed condition rate distortion performance uses the test score to measure the compression performance of the encoder on the quality of the video test, and on the other hand replaces the conventional average bit rate with the maximum window bit rate, indicating the transmission performance of the encoder.
  • the relative error between the actual output bit rate and the target bit rate of all encoders is required to be within a certain range, that is, :
  • step S103 modifying the target bit rate, proceeding to step S101;
  • the client In the actual streaming media transmission, the client has a certain buffer duration (time window), that is, whether the client is buffered, depending on whether the maximum bit rate in the time window exceeds the actual transmission bandwidth.
  • time window the buffer duration
  • the embodiment of the present invention proposes to measure the performance of the code rate fluctuation based on the time window in the actual transmission, and refers to the maximum average bit rate in the time window, which is called the maximum window bit rate MWBR.
  • the maximum window bit rate is calculated as follows:
  • A Determine the time window according to the client buffer duration in the actual transmission
  • Obtaining the test score value may be the following method, but is not limited thereto, and the method includes the following steps: S1051, performing a simulation test;
  • the first step Introduce the purpose of the test, requirements, how to evaluate how to use the test object as an implicit reference;
  • Step 2 Simulate the test using the test source, evaluate all types of damaged images, familiar with the score Process, stable score;
  • test conditions mainly include display equipment and settings, test sequence, observer selection, etc.
  • the following conditions will be introduced for the compression performance requirements of the test encoder at low bit rate on PC and mobile phones.
  • Test film source selection considerations 1 complexity determines the spatial complexity and time complexity from the Y component of the test patch source
  • test source For specific tests, you can select the number of test source according to your needs. Generally, there is one B, C, and D.
  • test sequence parameters SI and TI The complexity and amount of motion of the scene are given by the test sequence parameters SI and TI, respectively.
  • G"i,J) -2 0 2 ® x(i,J-1) x(i,J) x(i,J + l)
  • the tester performs a test score on the test subject.
  • the lossy compression rating is adopted. If it is a high-definition test, you need to modify the corresponding rating file settings.
  • Test subjects participating in the simultaneous test scores (ie, decoded sequences output by different codecs) during PC testing can be increased according to the purpose of the comparison, that is, not limited to the above two scoring objects; Limited by the size of the mobile phone display, using a single excitation source;
  • Test objects that need to participate in the test are displayed and scored at the same time if objective conditions permit; if the test object is too many to be displayed at one time or considering the position of the test video source to the test, the test object can be tested. Overlapping display, that is, by displaying the scored object and its rating as a reference object for the next round of testing;
  • Randomness The position of the image processed by the same encoder is not fixed, that is, the test object appearing at position 1 can come from different encoders.
  • test scoring process is as follows: Play the test object, after the play, start scoring; after the score, you can play back and modify the original score, but only for this test source;
  • S1052 Conduct a formal test to obtain a test score
  • the tester performs the test, in which the test film source and the simulation evaluation test in the formal test are different;
  • Simultaneous scoring Because the tester's score has strong randomness, when comparing the coding performance of the evaluation encoder, if the score alone loses the comparative significance of the score (ie, it cannot be compared horizontally), it is allowed under objective conditions.
  • the test object In the case of the test object that is required to participate in the test, the test object is simultaneously displayed and scored; if the test object is too many to be displayed at one time or considering the influence of the position of the test object on the test, the test object may be overlapped, that is, By showing the scored test subject and its rating as a reference for the next round of testing;
  • the coverage of the source of the test piece The coverage of the time and space complexity is high, that is, the representative test source is selected;
  • the arrangement of the test objects satisfies: randomness (so that the tester cannot obtain the regularity of the test object arrangement, the score is more objective), equivalence (eliminating the visual positional influence), and repeatability (the test object acquires the same amount of statistical data) );
  • the processing method is as follows:
  • test data of each tester was linearly normalized, and the test score of the original range [-3, 3] was converted into the test score of [0, 1] to eliminate individual differences.
  • ⁇ ⁇ (x y - min (x y )) /( ⁇ ( ⁇ ⁇ ) - min (x y ))
  • I is the number of ratings required for each tester, ⁇ the number of participants who participated in the test;
  • test data is filtered, and the five test data at the initial stage of the test are discarded. If there are many test combinations, the first three test data are discarded.
  • Q x, y) is the covariance
  • ⁇ ⁇ , ⁇ is the corresponding standard deviation
  • x 1 the average of all tester scores when the i-th test combination (ie, the combination of algorithm, bit rate, test sequence) The average of the corresponding test scores under i test conditions; the score of the current tester y when the i-th test combination
  • n the total number of test algorithms X the total number of test sequences.
  • D Denormalization, converts the average score of the range [0, 1] into a score of [-3, 3], and re-corresponds to the score meaning.
  • S106 Construct a condition rate distortion graph according to the maximum window bit rate and the test score value, and obtain video coding performance of the encoder.
  • the maximum window bit rate MWBR is plotted on the abscissa, and the conditional rate distortion graph is plotted with the test score value as the ordinate.
  • the network transmission performance and video compression quality corresponding to different coding techniques are compared according to the graph.
  • the maximum window bit rate is a measure of the network transmission adaptability of the coding technique; the test score value measures the quality of the video.
  • the first preferred embodiment of the video coding performance testing method of the present invention constructs a conditional rate distortion curve for the same test chip source, which is obtained by different encoder encoding to obtain the maximum window bit rate and test score value of different code streams.
  • Figure; Two of the dashed lines are the conditional rate distortion curves of the two encoders, and the solid line is the single-item performance comparison auxiliary line.
  • Each point in the figure is a data point corresponding to different coding parameters of different test piece sources. Taking the encoder 1 as an example, it tests a total of four test film sources. From left to right, the texture is simple, the motion is severe, the texture is complex, the motion is slow, the texture is complex, the motion is slow, and the texture is simple and slow.
  • the corresponding curve of the encoder 1 is higher than the curve corresponding to the encoder 2, that is, the encoder 1 is superior to the encoder 2 in the comprehensive performance of image test quality and network transmission;
  • the network transmission performance is compared: In the scenario where the texture is simple and slow, the transmission performance of the encoder network is compared as an example. The description is as follows: The maximum window bit rate of the encoder 1 is smaller than the encoder. 2 maximum window bit rate, that is, under this scenario and encoding parameters, the encoder 1 has better network transmission performance than the encoder 2; as shown in FIG. 4 is a second preferred embodiment of the video encoding performance testing method of the present invention. For the same test chip source, the condition rate distortion curve constructed by the maximum window bit rate and the test score value of different code streams obtained by different encoder encodings;
  • Two of the dashed lines are the conditional rate distortion curves for the two encoders, and the solid line is the single-item performance comparison auxiliary line.
  • Each point in the figure is a data point corresponding to different coding parameters of different test scenarios.
  • Image quality performance comparison under the same coding parameters of the same scene In the scenario where the texture is slow and the motion is slow, the image test quality performance ratio is taken as an example. The description is as follows: The score of the encoder 1 is higher than that of the encoder 2 That is, the video test quality of the encoder 1 is superior to the encoder 2 in this test scenario.
  • the condition rate distortion performance proposed by the embodiment of the present invention uses the test score value to measure the compression performance of the encoder on the video test quality, and on the other hand replaces the conventional average bit rate with the maximum window bit rate, indicating the transmission of the encoder. performance.
  • the condition rate distortion graph constructed according to the maximum window bit rate and the test score value as the abscissa and the ordinate, the video compression performance and the adaptability to the network transmission of different coding techniques can be obtained, and the same test source can also be obtained.
  • compare the maximum window bit rate of the encoder obtain the network transmission performance of the encoder, compare the scores, obtain the code The compression performance of the coder on the quality of the image test.
  • the system includes a codec module, an average rate decision module, a maximum window acquisition module, a scoring module, and an evaluation module.
  • a codec module configured to code and decode the same test video source, and obtain the coded code stream and the decoding sequence
  • an average code rate determining module configured to determine, according to the code stream, an actual output bit rate and target of the encoder to be tested Whether the relative error of the bit rate is within a certain range, wherein the specific range is:
  • bitrate t 3lg et ⁇ bitrate actual to take the absolute value of bitmte l alg et ⁇ bitrate actual .
  • a target bit rate modification module configured to modify the target bit rate such that a relative error between the re-coded actual output bit rate and the target bit rate is within the specific range
  • the maximum window acquisition module is used to obtain the maximum average bit rate in the time window (ie, the maximum window bit rate is BR);
  • a scoring module configured to obtain a score of the test object; the simulation test module, the formal test module, and the test score data processing module; the simulation test module is used to introduce the test purpose, requirements, how to score, familiar with the scoring process, and stable score;
  • the formal test module is used for formal testing to obtain a rating
  • the test score data processing module is configured to process data processing of the test, including the following modules (as shown in FIG. 7):
  • Normalization module for linear normalization of test data for each tester, original The score of the range [-3, 3] is converted into a score of [0, 1] to eliminate individual differences;
  • the data screening module includes a test data validity determination module for screening effective test data during the test; tester data a validity determination module for determining the validity of the tester's score, that is, for determining the validity of the tester's score according to the Pearson correlation analysis, the Spearman rank correlation analysis, and the determination threshold; the score mean calculation module, Calculate the average score of valid testers;
  • the inverse normalization module is used to convert the average score of the range [0, 1] into a score of [-3, 3], and the score is again corresponding to the meaning of the score.
  • the evaluation module is configured to obtain the video compression performance and the adaptability to the network transmission of different coding technologies according to the maximum window bit rate and the test score value constructed on the abscissa and the ordinate, and is used to acquire different coding technologies.
  • Comparison of network transmission performance and video compression performance single performance (different performance curves of different encoders, the higher the curve position, the better the performance of the coding technology corresponding to the curve in the compression of image test quality and network transmission) Under the same conditions, the test score is compared. The higher the score, the better the quality of the video image corresponding to the coding technique.
  • the maximum window bit rate is compared. The smaller the value, the better the network transmission performance of the corresponding coding technology. .
  • Figure 6 is a block diagram showing the structure of a maximum window acquisition module of a preferred embodiment of the video coding performance testing method of the present invention.
  • the maximum window acquisition module includes a time window determination module, a data point acquisition module, an accidental factor elimination module, and a maximum window selection module.
  • the time window determining module is configured to determine a time window according to a client buffering time length of the actual transmission;
  • the data point acquiring module is configured to calculate an output average bit rate in each time window as a data point (ie, a window bit rate)
  • the accidental factor elimination module is configured to delete the window bit rate maximum value and eliminate the accident factor;
  • the maximum window selection module is configured to arrange the remaining window bit rate sequences in descending order, and take the average value of the at least one window bit rate as the maximum Window bit rate.
  • Condition rate distortion performance proposed by the embodiment of the present invention on the one hand, using a score to measure the encoder in video measurement
  • the compression performance on the quality is tested, and on the other hand the conventional average bit rate is replaced by the maximum window bit rate, indicating the transmission performance of the encoder.
  • the condition rate distortion graph constructed according to the maximum window bit rate and the test score value as the abscissa and the ordinate
  • the video compression performance of different coding techniques and the adaptability to network transmission can be obtained, and also in the same test scenario.
  • the maximum window bit rate of the encoder is compared, the network transmission performance of the encoder is obtained, the test score is compared, and the compression performance of the encoder in the image test quality is obtained.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

A method for testing video encoding performance is provided by the present invention. On the one hand, the compression performance of an encoder on video test quality is evaluated by using a test score value; and on the other hand, the conventional average bit rate is replaced by the maximum window bit rate to represent the transmission performance of the coder. According to a condition rate distortion curve graph constructed by using the maximum window bit rate and the test score value as a horizontal coordinate and a vertical coordinate, the video compression performance and the adaptability to network transmission of different kinds of encoding technology can be obtained. And the maximum window bit rate of the encoder is compared to obtain the network transmission performance of the encoder, and the test score is compared to obtain the compression performance of the encoder on image test quality under the conditions of the same test scene and the same coding parameter.

Description

一种视频编码性能测试方法及系统  Video coding performance test method and system
技术领域 Technical field
本发明涉及视频编码技术领域,尤其涉及一种视频编码性能测试方法及系 统。  The present invention relates to the field of video coding technologies, and in particular, to a video coding performance testing method and system.
背景技术 Background technique
一种视频编码技术的优劣主要取决于视频压缩性能和对网络传输的适应 性。编码技术的视频压缩性能决定了,经过其压缩处理以后的视频图像的质量, 而对网络传输的适应性则决定了,经过其压缩后的视频码流能否在网络中稳定 传输, 码流接收端是否会经常性的陷入缓冲。 对视频质量的测试, 大体上, 可分为主观质量测试和客观质量测试两种方 法。 目前的主流的客观质量测试方法, 就是利用率失真性能来衡量编码器的压 缩性能,虽然率失真数据能够客观地衡量编码后的图像相对于原始图像的失真 度, 缺陷是无法判别这些失真对重建图像效果的价值。 相同的率失真性能下, 有些编码器的失真度体现在丢弃高频信息,而有些编码器会主动丢弃对人眼不 敏感的区域信息。而主观测试则是建立在人员视觉效果评价的基础上, 以此分 析编码器对细节的保存能力, 是衡量视频质量的重要手段。主观测试通常会采 集大量样本, 通过统计方法去除测试人员的主观误差。 码率波动特性衡量视频编码器对网络传输的适应性, 这对移动信道尤其重 要。 移动信道具有资源受限, 易错 (error-prone ) 的特性。 编码器输出的码 流, 如果波动特征明显, 会导致终端播放器频繁陷入缓冲。 常规的测试方法,仅提供对编码技术视频测试质量的性能评价, 没有同时 考察编码技术的网络传输性能。当需要综合评价编码技术在上述两个性能的综 合水平上, 就会陷入困难的境地, 不利于对视频编码技术进行综合评价。 The pros and cons of a video coding technique mainly depends on video compression performance and adaptability to network transmission. The video compression performance of the coding technology determines the quality of the video image after its compression processing, and the adaptability to the network transmission determines whether the compressed video code stream can be stably transmitted in the network, and the code stream is received. Whether the terminal will often get into the buffer. The test of video quality, in general, can be divided into two methods: subjective quality test and objective quality test. The current mainstream objective quality test method is the utilization distortion performance to measure the compression performance of the encoder. Although the rate distortion data can objectively measure the distortion of the encoded image relative to the original image, the defect is that the distortion cannot be discriminated. The value of the image effect. Under the same rate-distortion performance, some encoders are distorted in discarding high-frequency information, while some encoders actively discard area information that is insensitive to human eyes. The subjective test is based on the evaluation of the visual effect of the personnel, so as to analyze the ability of the encoder to preserve the details, is an important means to measure the video quality. Subjective tests usually collect a large number of samples and remove the subjective errors of the testers by statistical methods. The rate fluctuation characteristic measures the adaptability of the video encoder to network transmission, which is especially important for mobile channels. Mobile channels have resource-limited, error-prone characteristics. The code stream output by the encoder, if the fluctuation characteristics are obvious, will cause the terminal player to frequently become buffered. The conventional test method only provides performance evaluation of the quality of the coding technology video test, not simultaneously Investigate the network transmission performance of coding technology. When it is necessary to comprehensively evaluate the coding technology at the comprehensive level of the above two performances, it will be in a difficult situation, which is not conducive to comprehensive evaluation of video coding technology.
发明内容 Summary of the invention
本发明实施例的目的在于提出一种视频编码性能测试方法,旨在解决现有 技术测试方法中,仅提供对编码技术视频测试质量的性能评价, 没有同时考察 编码技术的网络传输性能的问题。  The purpose of the embodiments of the present invention is to provide a video coding performance testing method, which aims to solve the problem of the performance evaluation of the video quality of the coding technology in the prior art test method, and does not simultaneously consider the problem of the network transmission performance of the coding technology.
本发明实施例方法是这样实现的, 一种视频编码性能测试方法,所述方法 包括以下步骤:  The method of the embodiment of the present invention is implemented by the method for testing a video coding performance, and the method includes the following steps:
获取最大窗口比特率;  Get the maximum window bit rate;
获取测试评分值; 根据最大窗口比特率与测试评分值, 构建条件率失真曲线图, 获取编码器 的视频编码性能。  Obtain the test score value; construct a condition rate distortion graph according to the maximum window bit rate and the test score value, and obtain the video coding performance of the encoder.
本发明实施例的另一目的在于提出一种视频编码性能测试系统,所述系统 包括:  Another object of the embodiments of the present invention is to provide a video coding performance testing system, where the system includes:
最大窗口获取模块, 用于获取最大窗口比特率;  a maximum window acquisition module, configured to obtain a maximum window bit rate;
评分模块, 用于获取测试评分值; 评测模块, 用于根据所述最大窗口比特率和所述测试评分值构建的条件 率失真曲线图来获取不同编码技术的视频压缩性能和对网络传输的适应性 會 ^ 通过在相同最大窗口比特率下, 比较测试评分值, 获取编码器在图像测 试质量上的压缩性能, 和 /或通过在相同测试评分值下, 比较最大窗口比特 率, 获取编码器网络传输性能。  a scoring module, configured to obtain a test score value; an evaluation module, configured to obtain a video compression performance of different coding technologies and adapt to network transmission according to a condition rate distortion graph constructed according to the maximum window bit rate and the test score value Sexuality ^ Obtain the encoder's compression performance on the image test quality by comparing the test scores at the same maximum window bit rate, and/or obtain the encoder network by comparing the maximum window bit rate under the same test score value. Transmission performance.
本发明的有益效果: 本发明提出的条件率失真性能,一方面用测试评分衡量编码器在视频测试 质量上的压缩性能, 另一方面将常规的平均比特率替换为最大窗口比特率, 表 示编码器的传输性能。通过根据最大窗口比特率和测试评分值为横坐标和纵坐 标所构建的条件率失真曲线图,可获取不同编码技术的视频压缩性能和对网络 传输的适应性能, 也可通过在相同测试片源、相同编码参数的条件下, 比较编 码器最大窗口比特率, 获取编码器的网络传输性能, 比较测试评分, 获取编码 器在图像测试质量上的压缩性能。 Advantageous Effects of the Invention: The condition rate distortion performance proposed by the present invention, on the one hand, uses a test score to measure the compression performance of an encoder on a video test quality, and on the other hand replaces a conventional average bit rate with a maximum window bit rate, Shows the transmission performance of the encoder. By using the condition rate distortion graph constructed according to the maximum window bit rate and the test score value as the abscissa and the ordinate, the video compression performance and the adaptability to the network transmission of different coding techniques can be obtained, and the same test source can also be obtained. Under the condition of the same coding parameters, the maximum window bit rate of the encoder is compared, the network transmission performance of the encoder is obtained, the test score is compared, and the compression performance of the encoder in the image test quality is obtained.
附图说明 DRAWINGS
图 1是本发明的视频编码性能测试方法的优选实施例的流程图; 图 2 是本发明的视频编码性能测试方法的优选实施例的测试界面及测试 对象说明图表;  1 is a flow chart of a preferred embodiment of a video encoding performance testing method of the present invention; FIG. 2 is a test interface and a test object explanatory diagram of a preferred embodiment of the video encoding performance testing method of the present invention;
图 3 是本发明的视频编码性能测试方法的第一优选实施例的对同一测试 视频源,经过不同编码器编码获取不同码流的最大窗口比特率与测试评分值所 构建条件率失真曲线图;  3 is a condition rate distortion curve diagram of a first preferred embodiment of the video coding performance testing method of the present invention, which is configured to obtain a maximum window bit rate and a test score value of different code streams by different encoders for the same test video source;
图 4 是本发明的视频编码性能测试方法的第二优选实施例的对同一测试 视频源,经过不同编码器编码获取不同码流的最大窗口比特率与测试评分值所 构建条件率失真曲线图;  4 is a conditional rate distortion curve diagram of a maximum window bit rate and a test score value of different code streams obtained by different encoders for the same test video source according to a second preferred embodiment of the video coding performance testing method of the present invention;
图 5 是本发明的视频编码性能测试方法的优选实施例的结构示意图; 图 6是本发明的视频编码性能测试方法的优选实施例的最大窗口获取模块 的结构示意图;  5 is a schematic structural diagram of a preferred embodiment of a video encoding performance testing method according to the present invention; FIG. 6 is a schematic structural diagram of a maximum window acquiring module of a preferred embodiment of the video encoding performance testing method of the present invention;
图 7 是本发明的视频编码性能测试方法的优选实施例的数据筛选模块的 结构示意图。  Figure 7 is a block diagram showing the structure of a data filtering module of a preferred embodiment of the video encoding performance testing method of the present invention.
具体实施方式 为了使本发明的目的、技术方案及优点更加清楚明白, 以下结合附图和实 施例, 对本发明进行进一步详细说明, 为了便于说明, 仅示出了与本发明实施 例相关的部分。 应当理解, 此处所描写的具体实施例, 仅仅用于解释本发明, 并不用以限制本发明。 本发明实施例提出了一种视频编码性能测试方法,来综合评价编码技术的 视频测试质量上的压缩性能和网络传输性能。本发明实施例首先通过建立以最 大窗口比特率为横坐标, 以测试评分值为纵坐标的条件率失真曲线图,然后根 据曲线图,一方面可以获取不同编码技术的视频压缩性能和对网络传输的适应 性能, 即曲线越高对应的编码技术性能越好; 另一方面亦可以获取单项性能的 比较: 通过在相同测试片源相同编码参数下, 比较编码器最大窗口比特率, 获 取编码器的网络传输性能; 比较测试评分的值, 获取编码器在图像测试质量上 的压缩性能。 DETAILED DESCRIPTION OF THE EMBODIMENTS In order to make the objects, technical solutions and advantages of the present invention more clear, the following The present invention will be further described in detail, and for convenience of explanation, only parts related to the embodiments of the present invention are shown. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. The embodiment of the invention provides a video coding performance testing method to comprehensively evaluate the compression performance and network transmission performance of the video test quality of the coding technology. The embodiment of the present invention firstly establishes a condition rate distortion graph with a maximum window bit rate as an abscissa to test a score value as an ordinate, and then, according to the graph, can obtain video compression performance and network transmission of different coding techniques. The adaptability, that is, the higher the curve, the better the performance of the corresponding coding technique; on the other hand, the comparison of single-item performance can be obtained: By comparing the maximum window bit rate of the encoder under the same coding parameters of the same test-chip source, the encoder is obtained. Network transmission performance; Compare the value of the test score to obtain the compression performance of the encoder in the quality of the image test.
实施例一  Embodiment 1
图 1是本发明的视频编码性能测试方法的优选实施例的流程图。所述方法 包括以下步骤:  1 is a flow chart of a preferred embodiment of a video coding performance testing method of the present invention. The method includes the following steps:
5101、 获取待测编码器对同一测试片源进行编码后的码流和解码序列; 5101. Obtain a code stream and a decoding sequence that are coded by the encoder to be tested to encode the same test source.
5102 ,根据所述码流和解码序列判定所述待测编码器的实际输出比特率与目标 比特率的相对误差是否在特定范围内, 是则进入步骤 S104 , 否则进入步骤 S103; 本发明实施例提出的条件率失真性能,一方面用测试评分衡量编码器在视 频测试质量上的压缩性能,另一方面将常规的平均比特率替换为最大窗口比特 率,表示编码器的传输性能。考虑到编码的目标比特率与编码器的实际输出比 特率存在不一致的可能, 为了进行平等的性能测试, 要求所有的编码器实际输 出比特率与目标比特率的相对误差在特定范围之内, 即: 5102, determining, according to the code stream and the decoding sequence, whether a relative error between an actual output bit rate of the to-be-tested encoder and a target bit rate is within a specific range, if yes, proceeding to step S104, otherwise proceeding to step S103; The proposed condition rate distortion performance, on the one hand, uses the test score to measure the compression performance of the encoder on the quality of the video test, and on the other hand replaces the conventional average bit rate with the maximum window bit rate, indicating the transmission performance of the encoder. Considering that the target bit rate of the encoding is inconsistent with the actual output bit rate of the encoder, in order to perform equal performance testing, the relative error between the actual output bit rate and the target bit rate of all encoders is required to be within a certain range, that is, :
abs (bitrate t et - bitrate ac[ual ) I bitrate t et * 100 % < Thres 其中, Thres 为判定阈值, bitrate― nr为目标比特率, bitrate 为实际输出 比特率, Thres 为判定阈值, 其由所需达到的试验精度确定, abS ^ bitrate t 3lg et ~ bitrate , ) 为取 bitrate t mg et ~ bitrate , 的绝对值。 Abs (bitrate t et - bitrate ac[ual ) I bitrate t et * 100 % < Thres Where Thres is the decision threshold, bitrate- nr is the target bit rate, bitrate is the actual output bit rate, Thres is the decision threshold, which is determined by the required test accuracy, ab S ^ bitrate t 3lg et ~ bitrate , ) The absolute value of bitrate t mg et ~ bitrate ,.
满足此条件的才可以进入视频条件率失真性能的实质评价阶段。  Only when this condition is met can the substantive evaluation stage of the video condition rate distortion performance be entered.
S103 , 修改目标比特率, 进入步骤 S 101 ;  S103, modifying the target bit rate, proceeding to step S101;
S104: 获取最大窗口比特率; S104: Obtain a maximum window bit rate;
由于在实际的流媒体传输中, 客户端具有一定的缓冲时长 (时间窗), 即 客户端是否陷入缓冲, 取决于该时间窗口内最大比特率是否超过实际传输带 宽 。本发明实施例提出基于实际传输中的时间窗,进行码率波动性能的衡量, 并把时间窗口内最大平均比特率, 称为最大窗口比特率 MWBR。  In the actual streaming media transmission, the client has a certain buffer duration (time window), that is, whether the client is buffered, depending on whether the maximum bit rate in the time window exceeds the actual transmission bandwidth. The embodiment of the present invention proposes to measure the performance of the code rate fluctuation based on the time window in the actual transmission, and refers to the maximum average bit rate in the time window, which is called the maximum window bit rate MWBR.
最大窗口比特率计算方法如下:  The maximum window bit rate is calculated as follows:
A: 根据实际传输中的客户端缓冲时长, 确定时间窗;  A: Determine the time window according to the client buffer duration in the actual transmission;
B: 计算每个时间窗内的输出平均比特率作为一个数据点 (即一个窗口比 特率值);  B: Calculate the average bit rate of the output in each time window as a data point (ie, a window bit rate value);
C: 删除窗口比特率最大值, 消除偶然因数;  C: Delete the maximum bit rate of the window, eliminating the accidental factor;
D: 将剩余窗口比特率序列降序排列, 取前至少一个窗口比特率的平均值 作为最大窗口比特率;  D: arranging the remaining window bit rate sequences in descending order, taking the average of the at least one window bit rate as the maximum window bit rate;
S105 : 获取测试评分值; S105: obtaining a test score value;
获取测试评分值可用如下方法, 但不仅限于此, 所述方法包括以下步骤: S1051 , 进行模拟测试;  Obtaining the test score value may be the following method, but is not limited thereto, and the method includes the following steps: S1051, performing a simulation test;
第一步: 介绍测试目的、 要求、 如何评价即如何利用测试对象作为隐 性参考;  The first step: Introduce the purpose of the test, requirements, how to evaluate how to use the test object as an implicit reference;
第二步: 利用测试片源进行模拟测试, 评价各类所损图像, 熟悉评分 流程, 稳定评分; Step 2: Simulate the test using the test source, evaluate all types of damaged images, familiar with the score Process, stable score;
测试条件主要包括显示设备与设置、 测试序列、 观测人员的选择等, 下面将针对 PC、 手机上测试编码器在低码率下的压缩性能的要求介绍相应 的条件。  The test conditions mainly include display equipment and settings, test sequence, observer selection, etc. The following conditions will be introduced for the compression performance requirements of the test encoder at low bit rate on PC and mobile phones.
Figure imgf000008_0001
其他测试条件如下:
Figure imgf000008_0001
Other test conditions are as follows:
( 1 ) 对测试片源信息覆盖度选择。  (1) Select the coverage of the test piece source information.
测试片源选择考虑: ①复杂度由测试片源 Y分量确定空间复杂度、 时间复杂度 Test film source selection considerations: 1 complexity determines the spatial complexity and time complexity from the Y component of the test patch source
②场景: 由时间、 空间复杂度信息分布选定典型场景(至少涵盖以下 四种情况)  2 Scene: Select a typical scene from the time and space complexity information distribution (at least the following four cases)
A、 简单场景运动少即 SI小 TI小  A, simple scene movement is less SI small TI small
B、 简单场景运动多即 SI小 TI大  B, simple scene movement is much SI small TI big
C、 复杂场景运动少即 SI大 TI小  C, the movement of complex scenes is small, SI is large, TI is small.
D、 复杂场景运动多即 SI大 TI大  D, complex scene movement is much SI, TI big
具体测试时, 可根据需要选择测试片源的数量, 一般要求 、 B、 C、 D 各有一个。  For specific tests, you can select the number of test source according to your needs. Generally, there is one B, C, and D.
而场景的复杂度与运动量分别由测试序列参量 SI与 TI给出。  The complexity and amount of motion of the scene are given by the test sequence parameters SI and TI, respectively.
Sobel滤波  Sobel filtering
首先对原始图像进行垂直及水平滤波  First, vertical and horizontal filtering of the original image
— _1 -2 1— — x(i-l,j-l) x(i-lj) x(i_l,j + l)  — _1 -2 1— — x(i-l,j-l) x(i-lj) x(i_l,j + l)
Gv(i,j) = 0 0 0 ® x(i,j-l) x(i,j) x(i,j + l) G v (i,j) = 0 0 0 ® x(i,jl) x(i,j) x(i,j + l)
1 2 1 x(i + l,j + l) x(i + l,j) x(i + l,j + l)  1 2 1 x(i + l,j + l) x(i + l,j) x(i + l,j + l)
— - 1 0 Γ — x(i- 1,J- 1) x(i- 1,J) x(i- 1,J + 1)  — - 1 0 Γ — x(i- 1,J-1) x(i- 1,J) x(i- 1,J + 1)
G"i,J) = -2 0 2 ® x(i,J- 1) x(i,J) x(i,J + l)  G"i,J) = -2 0 2 ® x(i,J-1) x(i,J) x(i,J + l)
— -1 0 1 — x(i + l,J + l) x(i + 1, j) x(i + 1, J + 1)  — -1 0 1 — x(i + l,J + l) x(i + 1, j) x(i + 1, J + 1)
然后, 计算 Sobel滤波的最终输出值  Then, calculate the final output value of the Sobel filter
y(i,j) = VGv 2(i,j)+Gh 2(i,j) y(i,j) = VG v 2 (i,j)+G h 2 (i,j)
计算空间信息度 SI  Calculate spatial information SI
SI = Maxtime{stdspace[sobel[Fn]} SI = Max time {std space [sobel[F n ]}
其中, Fn为第 n帧测试图像 Where F n is the nth frame test image
计算时间信息度 TI  Calculate time information TI
TI = MaXtime{stdspace[Fn (i, j) - (i, j)] } TI = M aXtime {std space [F n (i, j) - (i, j)] }
(2) 选择测试人员 至少 15人; 视力、 色彩信息观察力正常; 选择非专业人士, 即工作不 能直接与图像质量有关; 按一定的条件 (如职业、 年龄、 性别等) 涵盖一 定的范围。 (2) Select testers At least 15 people; visual and color information observation is normal; choose non-professionals, that is, work cannot be directly related to image quality; cover certain ranges according to certain conditions (such as occupation, age, gender, etc.).
( 3 ) 测试人员对测试对象进行测试评分,  (3) The tester performs a test score on the test subject.
评分档次设置:  Rating grade settings:
Figure imgf000010_0001
Figure imgf000010_0001
①鉴于本方案测试主体为编码器低码率下压缩性能, 采用有损压缩评 分档次。 若为高清测试则需修改相应的评分档设置 1 In view of the fact that the test subject of this scheme is the compression performance of the encoder at a low bit rate, the lossy compression rating is adopted. If it is a high-definition test, you need to modify the corresponding rating file settings.
②测试评分 x e『_33], 考虑数据的分布性, 评分 X可以是半分档, 即允 许最小区分度为 0. 5; 2; The test score xe 『 _ 3 , 3 ], considering the distribution of the data, the score X may be a half-segment, that is, the minimum discrimination is allowed to be 0.5.
① PC 测试时参与同时测试评分的测试对象 (即经过不同编解码器输 出的解码序列), 可依据所需比较的目的自行增加, 即不局限于上述的一次 两个评分对象; 手机测试时, 受限于手机显示屏大小, 采用单激励源; 1 Test subjects participating in the simultaneous test scores (ie, decoded sequences output by different codecs) during PC testing can be increased according to the purpose of the comparison, that is, not limited to the above two scoring objects; Limited by the size of the mobile phone display, using a single excitation source;
②由于人的评分具有很强的随机性, 在进行比较测试时, 若单独评分 会失去评分的比较意义, 即无法横向比较; 所以在进行比较测试时, 建议 在客观条件允许的情况下将所需参与测试的测试对象同时显示并评分; 如 测试对象太多无法一次显示或是考虑到测试视频源所处的位置对测试的影 口向, 可将测试对象交叠显示, 即通过显示已评分对象和其评分作为下轮测 试的参考对象; 2Because people's scores are highly random, when comparing tests, if the scores alone lose the meaning of the scores, they cannot be compared horizontally; therefore, when conducting comparative tests, it is recommended. Test objects that need to participate in the test are displayed and scored at the same time if objective conditions permit; if the test object is too many to be displayed at one time or considering the position of the test video source to the test, the test object can be tested. Overlapping display, that is, by displaying the scored object and its rating as a reference object for the next round of testing;
③参与评分测试对象为编解码后解码序列  3 Participation in the scoring test object is the decoded sequence after encoding and decoding
测试视频源排列要求 (当同时显示比较对象时)  Test video source alignment requirements (when comparing objects are displayed at the same time)
随机性: 同一编码器处理的图像测试时出现的位置不固定, 即位置 1 出现的测试对象可来自于不同的编码器。  Randomness: The position of the image processed by the same encoder is not fixed, that is, the test object appearing at position 1 can come from different encoders.
重复性: 在整个测试过程中, 同一测试对象将在位置 1、 位置 2都出 现 1次。 消除视觉上位置影响。  Repeatability: The same test object will appear in position 1 and position 2 once during the entire test. Eliminate visual positional effects.
对等性: 测试对象 (不同编码器) 的测试结果数量一致  Equivalence: The number of test results of test objects (different encoders) is consistent
测试评分过程为: 播放测试对象, 播放完后, 开始打分; 评分后可以 进行回放修改原始的打分, 但仅限于此测试片源; 片断间不能回放。  The test scoring process is as follows: Play the test object, after the play, start scoring; after the score, you can play back and modify the original score, but only for this test source;
S1052 : 进行正式测试, 获取测试评分;  S1052: Conduct a formal test to obtain a test score;
测试人员进行测试, 其中正式测试中的测试片源和模拟评价测试时不相 同;  The tester performs the test, in which the test film source and the simulation evaluation test in the formal test are different;
在进行正式测试时, 必须注意以下问题:  When conducting a formal test, you must be aware of the following issues:
同时评分性: 由于测试人员的评分具有很强的随机性,在对待评测编码器 的编码性能进行比较测试时, 若单独评分会失去评分的比较意义(即无法横向 比较), 所以在客观条件允许的情况下将所需参与测试的测试对象同时显示并 评分;若所述测试对象太多无法一次显示或是考虑到测试对象所处的位置对测 试的影响, 可将测试对象交叠显示, 即通过显示已评分测试对象和其评分作为 下轮测试的参考对象; 测试片源息的覆盖度: 时间、 空间复杂度的覆盖度要高, 即选取具有代表 意义的测试片源; Simultaneous scoring: Because the tester's score has strong randomness, when comparing the coding performance of the evaluation encoder, if the score alone loses the comparative significance of the score (ie, it cannot be compared horizontally), it is allowed under objective conditions. In the case of the test object that is required to participate in the test, the test object is simultaneously displayed and scored; if the test object is too many to be displayed at one time or considering the influence of the position of the test object on the test, the test object may be overlapped, that is, By showing the scored test subject and its rating as a reference for the next round of testing; The coverage of the source of the test piece: The coverage of the time and space complexity is high, that is, the representative test source is selected;
测试对象的排列满足: 随机性(使得测试人员无法获取测试对象排列的规 律性, 评分更为客观)、 对等性(消除视觉上的位置影响)、 重复性(测试对象 获取相同数量的统计数据);  The arrangement of the test objects satisfies: randomness (so that the tester cannot obtain the regularity of the test object arrangement, the score is more objective), equivalence (eliminating the visual positional influence), and repeatability (the test object acquires the same amount of statistical data) );
S1053 : 测试数据处理;  S1053: test data processing;
测试原始数据由于主观的原因,存在不可用性。须对测试原始数据进行相 应的统计处理, 消除测试人员的误差, 从而使得测试结果更为合理, 所述处理 方法如下:  Testing raw data for unavailability due to subjective reasons. It is necessary to perform corresponding statistical processing on the test raw data to eliminate the error of the tester, thereby making the test result more reasonable. The processing method is as follows:
A: 测试数据归一化处理  A: Test data normalization
将每个测试人员的测试数据作线性归一化处理, 将原始范围 [-3, 3] 的测 试评分转换成 [0, 1]的测试评分, 消除个体差异,  The test data of each tester was linearly normalized, and the test score of the original range [-3, 3] was converted into the test score of [0, 1] to eliminate individual differences.
χϋ = (xy - min (xy )) /(ηι (χϋ ) - min (xy )) χ ϋ = (x y - min (x y )) /(ηι (χ ϋ ) - min (x y ))
其中 ί = 1,2,···,Ι, j = l,2,..J . I为每个测试人员所需进行的评分次数, 〗为参 加测试的人数; Where ί = 1, 2 ,···,Ι, j = l,2,..J . I is the number of ratings required for each tester, 〖the number of participants who participated in the test;
B: 进行有效测试数据筛选;  B: Perform effective test data screening;
bl, 有效测试数据筛选  Bl, effective test data screening
有模拟测试时, 进行有效测试数据筛选, 丢弃测试初期的 5个测试数 据; 如果测试组合较多, 则丢弃前 3个测试数据。  When there is a simulation test, the effective test data is filtered, and the five test data at the initial stage of the test are discarded. If there are many test combinations, the first three test data are discarded.
b2, 正式测试中测试人员评分数据有效性判定;  B2, the validity of the tester's score data in the formal test;
计算当前测试人员 y的评分与所有测试人员平均评分的相关系数 Calculate the correlation coefficient between the current tester's score and the average score of all testers
Tly (x' y)、 T2y (x' y), 其中 x为所有测试人员的平均评分变量, y为一个测试人 员的评分变量。 计算方法如下: ① Pearson相关性分析 T ly (x' y), T 2y (x' y), where x is the average scoring variable for all testers and y is the scoring variable for one tester. The calculation method is as follows: 1 Pearson correlation analysis
其中 Q x,y)为协方差, σχ、 ^为相应的标准差; x1 : 第 i种测试组合时, 所有测试人员评分的均值 (即在算法、 比特率、 测试序列组合成的第 i种测试 条件下相应测试评分的平均); 第 i种测试组合时, 当前测试人员 y的评分; n: 测试算法总数 X测试序列总数。 Where Q x, y) is the covariance, σ χ , ^ is the corresponding standard deviation; x 1 : the average of all tester scores when the i-th test combination (ie, the combination of algorithm, bit rate, test sequence) The average of the corresponding test scores under i test conditions; the score of the current tester y when the i-th test combination; n: the total number of test algorithms X the total number of test sequences.
② Spearman等级相关性分析 计算相关系数1 "^x'y) 2 Spearman rank correlation analysis calculates the correlation coefficient 1 "^ x ' y )
6 * (rank(xi ) - rank(yi ))2
Figure imgf000013_0001
6 * (rank(x i ) - rank(y i )) 2
Figure imgf000013_0001
③确定判定阈值 3 determine the decision threshold
如果 mean(min(riyr2y)) - std(min(riyr 2y))>0'85, 则 Thres = 0.85 If the mean (min (r i y, r 2 y)) - std (min (r i y, r 2y))> 0 '85, then Thres = 0.85
否贝 |j Thres = mean(min(rly , r2y )) - std(min(rly , r2y )) No Bay|j Thres = mean(min(r ly , r 2y )) - std(min(r ly , r 2y ))
④判定测试人员评分数据的有效性 4 determine the validity of the tester's score data
如果 min(rly'r2y)> Thres, 则当前测试人员 y的评分数据有效 否则 当前测试人员 y的评分数据无效 If mi n (r ly 'r 2y )> Thres, the current tester y's score data is valid or the current tester y's score data is invalid.
C: 基于有效评分数据计算统计变量: 所有有效测试人员评分均值;  C: Calculate statistical variables based on valid score data: Mean scores of all valid testers;
所有测试人员评分均值  Mean score for all testers
― 1 N  ― 1 N
丄、 i=l 测试人员 i, 在比特率 j, 测试序列 k, 算法 r时所作的评分 丄, i=l Tester i, score at bit rate j, test sequence k, algorithm r
D: 反归一化, 将范围 [0, 1]的平均得分转换成 [-3, 3]的评分, 将得分与 评分含义再度对应。  D: Denormalization, converts the average score of the range [0, 1] into a score of [-3, 3], and re-corresponds to the score meaning.
S106: 根据最大窗口比特率与测试评分值, 构建条件率失真曲线图, 获取编码 器的视频编码性能。 以最大窗口比特率 MWBR为横坐标, 以测试评分值为纵坐标绘制条件率失 真曲线图,根据曲线图来比较不同编码技术对应的网路传输性能和视频压缩质 S106: Construct a condition rate distortion graph according to the maximum window bit rate and the test score value, and obtain video coding performance of the encoder. The maximum window bit rate MWBR is plotted on the abscissa, and the conditional rate distortion graph is plotted with the test score value as the ordinate. The network transmission performance and video compression quality corresponding to different coding techniques are compared according to the graph.
最大窗口比特率一衡量编码技术的网络传输适应性;测试评分值衡量视频 的质量 The maximum window bit rate is a measure of the network transmission adaptability of the coding technique; the test score value measures the quality of the video.
1 ) 不同编码器的对应不同的性能曲线, 曲线位置越高, 表示该曲线对应 的编码技术在图像测试质量的压缩及网络传输上的综合性能就越好; 1) Different performance curves of different encoders, the higher the curve position, the better the performance of the coding technology corresponding to the curve in the compression of image test quality and network transmission;
2 ) 相同条件下, 比较评分, 分数越高, 对应编码技术的视频图像测试质 量越好; 2) Under the same conditions, the score is compared, and the higher the score, the better the quality of the video image corresponding to the coding technique;
3 ) 相同条件下, 比较最大窗口比特率, 值越小, 对应编码技术的网络传 输性能越好; 3) Under the same conditions, compare the maximum window bit rate, the smaller the value, the better the network transmission performance of the corresponding coding technology;
如图 3 所示是本发明的视频编码性能测试方法的第一优选实施例对同一 测试片源,经过不同编码器编码获取不同码流的最大窗口比特率与测试评分值 所构建条件率失真曲线图; 其中两条虚线是两个编码器的条件率失真曲线, 实线是单项性能对比辅 助线。 图中每个点为不同测试片源不同编码参数对应的数据点。 以编码器 1为例说明, 其共测试了四个测试片源, 从左到右依次为紋理简 单运动剧烈、紋理复杂运动剧烈、紋理复杂运动缓慢、紋理简单运动缓慢场景; 综合性能评价: As shown in FIG. 3, the first preferred embodiment of the video coding performance testing method of the present invention constructs a conditional rate distortion curve for the same test chip source, which is obtained by different encoder encoding to obtain the maximum window bit rate and test score value of different code streams. Figure; Two of the dashed lines are the conditional rate distortion curves of the two encoders, and the solid line is the single-item performance comparison auxiliary line. Each point in the figure is a data point corresponding to different coding parameters of different test piece sources. Taking the encoder 1 as an example, it tests a total of four test film sources. From left to right, the texture is simple, the motion is severe, the texture is complex, the motion is slow, the texture is complex, the motion is slow, and the texture is simple and slow. Comprehensive performance evaluation:
编码器 1对应的曲线高于编码器 2对应的曲线,即在图像测试质量与网络 传输性的综合性能上, 编码器 1优于编码器 2;  The corresponding curve of the encoder 1 is higher than the curve corresponding to the encoder 2, that is, the encoder 1 is superior to the encoder 2 in the comprehensive performance of image test quality and network transmission;
单项性能比较: 相同测试片源相同编码参数下, 网络传输性能比较: 以 在紋理简单运动缓慢的场景下, 编码器网络传输性能比较为例, 说明如下: 编码器 1最大窗口比特率小于编码器 2最大窗口比特率, 即在此场景和编码 参数下, 编码器 1比编码器 2具有更好的网络传输性能; 如图 4所示是本发明的视频编码性能测试方法的第二优选实施例对同一 测试片源,经过不同编码器编码获取不同码流的最大窗口比特率与测试评分值 所构建条件率失真曲线图;  Single-item performance comparison: Under the same coding parameters of the same test-slice source, the network transmission performance is compared: In the scenario where the texture is simple and slow, the transmission performance of the encoder network is compared as an example. The description is as follows: The maximum window bit rate of the encoder 1 is smaller than the encoder. 2 maximum window bit rate, that is, under this scenario and encoding parameters, the encoder 1 has better network transmission performance than the encoder 2; as shown in FIG. 4 is a second preferred embodiment of the video encoding performance testing method of the present invention. For the same test chip source, the condition rate distortion curve constructed by the maximum window bit rate and the test score value of different code streams obtained by different encoder encodings;
其中两条虚线是两个编码器的条件率失真曲线, 实线是单项性能对比辅 助线。 图中每个点为不同测试场景不同编码参数对应的数据点。  Two of the dashed lines are the conditional rate distortion curves for the two encoders, and the solid line is the single-item performance comparison auxiliary line. Each point in the figure is a data point corresponding to different coding parameters of different test scenarios.
单项性能比较: 相同场景相同编码参数下, 图像测试质量性能比较: 以 在紋理简单运动缓慢的场景下, 图像测试质量性能比为例, 说明如下: 编 码器 1的评分高于编码器 2的评分, 即在此测试场景下编码器 1的视频测试 质量优于编码器 2。  Single-item performance comparison: Image quality performance comparison under the same coding parameters of the same scene: In the scenario where the texture is slow and the motion is slow, the image test quality performance ratio is taken as an example. The description is as follows: The score of the encoder 1 is higher than that of the encoder 2 That is, the video test quality of the encoder 1 is superior to the encoder 2 in this test scenario.
本发明实施例提出的条件率失真性能,一方面用测试评分值衡量编码器在 视频测试质量上的压缩性能,另一方面将常规的平均比特率替换为最大窗口比 特率, 表示编码器的传输性能。通过根据最大窗口比特率、 测试评分值为横坐 标和纵坐标所构建的条件率失真曲线图,可获取不同编码技术的视频压缩性能 和对网络传输的适应性能,也可通过在相同测试片源、相同编码参数的条件下, 比较编码器最大窗口比特率, 获取编码器的网络传输性能, 比较评分, 获取编 码器在图像测试质量上的压缩性能。 实施例二 The condition rate distortion performance proposed by the embodiment of the present invention uses the test score value to measure the compression performance of the encoder on the video test quality, and on the other hand replaces the conventional average bit rate with the maximum window bit rate, indicating the transmission of the encoder. performance. By using the condition rate distortion graph constructed according to the maximum window bit rate and the test score value as the abscissa and the ordinate, the video compression performance and the adaptability to the network transmission of different coding techniques can be obtained, and the same test source can also be obtained. Under the condition of the same coding parameters, compare the maximum window bit rate of the encoder, obtain the network transmission performance of the encoder, compare the scores, obtain the code The compression performance of the coder on the quality of the image test. Embodiment 2
图 5 是本发明的视频编码性能测试方法的优选实施例的结构示意图, 所述系统包括, 编解码模块, 平均码率判定模块, 最大窗口获取模块、 评分模 块以及评测模块。  5 is a schematic structural diagram of a preferred embodiment of a video coding performance testing method according to the present invention. The system includes a codec module, an average rate decision module, a maximum window acquisition module, a scoring module, and an evaluation module.
编解码模块,用于对同一测试视频源进行编解码并获取编码后的码流与解 码序列; 平均码率判定模块,用于根据所述码流判定待测编码器的实际输出比特率 与目标比特率的相对误差是否在特定范围内, 其中所述特定范围为:  a codec module, configured to code and decode the same test video source, and obtain the coded code stream and the decoding sequence; and an average code rate determining module, configured to determine, according to the code stream, an actual output bit rate and target of the encoder to be tested Whether the relative error of the bit rate is within a certain range, wherein the specific range is:
abs (bitrate t 3Ig et — bitrate ac[ual ) I bitrate t 3Ig et * 100 % < Thres 其中, Thres 为判定阈值, bitrate―„,为目标比特率, bitrate 为实际输出 比特率, Thres 为判定阈值, 其由所需达到的试验精度确定, absAbs (bitrate t 3Ig et — bitrate ac[ual ) I bitrate t 3Ig et * 100 % < Thres where Thres is the decision threshold, bitrate „, is the target bit rate, bitrate is the actual output bit rate, and Thres is the decision threshold. It is determined by the required test accuracy, abs
^ bitrate t 3lg et ~ bitrate actual ) 为取 bitmte l alg et ~ bitrate actual 的绝对值。 ^ bitrate t 3lg et ~ bitrate actual ) to take the absolute value of bitmte l alg et ~ bitrate actual .
目标比特率修改模块,用于修改所述目标比特率以使重新编解码后的所述 实际输出比特率与所述目标比特率的相对误差在所述特定范围内;  a target bit rate modification module, configured to modify the target bit rate such that a relative error between the re-coded actual output bit rate and the target bit rate is within the specific range;
最大窗口获取模块,用于求取时间窗口内最大平均比特率(即最大窗口比 特率丽 BR) ;  The maximum window acquisition module is used to obtain the maximum average bit rate in the time window (ie, the maximum window bit rate is BR);
评分模块, 用于获取测试对象的评分; 其包括模拟测试模块、 正式测试模 块、 测试评分数据处理模块; 所述模拟测试模块用于介绍测试目的、 要求, 如何评分、 熟悉评分流程, 稳定评分;  a scoring module, configured to obtain a score of the test object; the simulation test module, the formal test module, and the test score data processing module; the simulation test module is used to introduce the test purpose, requirements, how to score, familiar with the scoring process, and stable score;
所述正式测试模块用于正式测试获取评分;  The formal test module is used for formal testing to obtain a rating;
所述测试评分数据处理模块用于处理测试的数据处理,其中包括以下模块 (如图 7所示):  The test score data processing module is configured to process data processing of the test, including the following modules (as shown in FIG. 7):
归一化模块,用于将每个测试人员的测试数据作线性归一化处理, 将原始 范围 [-3, 3] 的评分转换成 [0, 1]的评分, 消除个体差异; 数据筛选模块,包括测试数据有效性判定模块,用于对测试过程中有效测 试数据的筛选; 测试人员数据有效性判定模块,用于对测试人员评分有效性的 判定, 即用于根据 Pearson相关性分析、 Spearman等级相关性分析、 判定阈 值对测试人员的评分进行有效性判定; 评分均值计算模块, 用于计算有效测试人员评分均值; Normalization module for linear normalization of test data for each tester, original The score of the range [-3, 3] is converted into a score of [0, 1] to eliminate individual differences; the data screening module includes a test data validity determination module for screening effective test data during the test; tester data a validity determination module for determining the validity of the tester's score, that is, for determining the validity of the tester's score according to the Pearson correlation analysis, the Spearman rank correlation analysis, and the determination threshold; the score mean calculation module, Calculate the average score of valid testers;
反归一化模块, 用于将范围 [0, 1]的平均得分转换成 [-3, 3]的评分, 将 得分与评分含义再度对应。  The inverse normalization module is used to convert the average score of the range [0, 1] into a score of [-3, 3], and the score is again corresponding to the meaning of the score.
评测模块, 用于根据最大窗口比特率、测试评分值为横坐标和纵坐标构建 的条件率失真曲线图来获取不同编码技术的视频压缩性能和对网络传输的适 应性能,并用于获取不同编码技术网络传输性能和视频压缩性能单项性能的比 较(不同编码器的对应不同的性能曲线, 曲线位置越高, 表示该曲线对应的编 码技术在图像测试质量的压缩及网络传输上的综合性能就越好; 在相同条件 下, 比较测试评分, 分数越高, 对应编码技术的视频图像测试质量越好; 在相 同条件下,比较最大窗口比特率,值越小,对应编码技术的网络传输性能越好)。  The evaluation module is configured to obtain the video compression performance and the adaptability to the network transmission of different coding technologies according to the maximum window bit rate and the test score value constructed on the abscissa and the ordinate, and is used to acquire different coding technologies. Comparison of network transmission performance and video compression performance single performance (different performance curves of different encoders, the higher the curve position, the better the performance of the coding technology corresponding to the curve in the compression of image test quality and network transmission) Under the same conditions, the test score is compared. The higher the score, the better the quality of the video image corresponding to the coding technique. Under the same conditions, the maximum window bit rate is compared. The smaller the value, the better the network transmission performance of the corresponding coding technology. .
图 6 是本发明的视频编码性能测试方法的优选实施例的最大窗口获 取模块的结构示意图。  Figure 6 is a block diagram showing the structure of a maximum window acquisition module of a preferred embodiment of the video coding performance testing method of the present invention.
其中, 最大窗口获取模块包括时间窗确定模块、 数据点获取模块、 偶然因 素消除模块以及最大窗口选定模块。所述时间窗确定模块用于根据实际传输的 客户端缓冲时长, 确定时间窗; 所述数据点获取模块用于计算每个时间窗内的 输出平均比特率作为一个数据点 (即一个窗口比特率值); 所述偶然因素消除 模块用于删除窗口比特率最大值, 消除偶然因数; 最大窗口选定模块用于将剩 余窗口比特率序列降序排列,取前至少一个窗口比特率的平均值作为最大窗口 比特率。 本发明实施例提出的条件率失真性能,一方面用评分衡量编码器在视频测 试质量上的压缩性能, 另一方面将常规的平均比特率替换为最大窗口比特率, 表示编码器的传输性能。通过根据最大窗口比特率、测试评分值为横坐标和纵 坐标所构建的条件率失真曲线图,可获取不同编码技术的视频压缩性能和对网 络传输的适应性能, 也可通过在相同测试场景、相同编码参数的条件下, 比较 编码器最大窗口比特率, 获取编码器的网络传输性能, 比较测试评分, 获取编 码器在图像测试测试质量上的压缩性能。 The maximum window acquisition module includes a time window determination module, a data point acquisition module, an accidental factor elimination module, and a maximum window selection module. The time window determining module is configured to determine a time window according to a client buffering time length of the actual transmission; the data point acquiring module is configured to calculate an output average bit rate in each time window as a data point (ie, a window bit rate) The accidental factor elimination module is configured to delete the window bit rate maximum value and eliminate the accident factor; the maximum window selection module is configured to arrange the remaining window bit rate sequences in descending order, and take the average value of the at least one window bit rate as the maximum Window bit rate. Condition rate distortion performance proposed by the embodiment of the present invention, on the one hand, using a score to measure the encoder in video measurement The compression performance on the quality is tested, and on the other hand the conventional average bit rate is replaced by the maximum window bit rate, indicating the transmission performance of the encoder. By using the condition rate distortion graph constructed according to the maximum window bit rate and the test score value as the abscissa and the ordinate, the video compression performance of different coding techniques and the adaptability to network transmission can be obtained, and also in the same test scenario, Under the condition of the same coding parameters, the maximum window bit rate of the encoder is compared, the network transmission performance of the encoder is obtained, the test score is compared, and the compression performance of the encoder in the image test quality is obtained.
以上所述仅为本发明的较佳实施例而已, 并不用以限制本发明, 凡在本发 明的精神和原则之内所作的任何修改、等同替换和改进等, 均应包含在本发明 的保护范围之内。  The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. Within the scope.

Claims

权 利 要 求 Rights request
1、 一种视频编码性能测试方法, 其特征在于,所述方法包括以下步骤: 获取最大窗口比特率; A video coding performance test method, characterized in that the method comprises the following steps: obtaining a maximum window bit rate;
获取测试评分值; 根据所述最大窗口比特率与所述测试评分值, 构建条件率失真曲线图, 获 取编码器的视频编码性能。  Obtaining a test score value; constructing a condition rate distortion graph according to the maximum window bit rate and the test score value, and obtaining a video coding performance of the encoder.
2、 如权利要求 1所述视频编码性能测试方法, 其特征在于,步骤"获取最 大窗口比特率"之前还包括步骤: 判定待评测编码器的实际输出比特率与目标比特率的相对误差在特定范 围内。  2. The video encoding performance testing method according to claim 1, wherein the step of: "acquiring the maximum window bit rate" further comprises the steps of: determining that the relative error between the actual output bit rate of the encoder to be evaluated and the target bit rate is specific Within the scope.
3、 如权利要求 1所述视频编码性能测试方法, 其特征在于,步骤"判定待 评测编码器的实际输出比特率与目标比特率的相对误差在特定范围内 "之 前还包括步骤: 所述待评测编码器对同一测试视频源进行编解码,获取编码后的码流和解 码序列。  3. The video encoding performance testing method according to claim 1, wherein the step further comprises the step of: determining that the relative error between the actual output bit rate of the encoder to be evaluated and the target bit rate is within a specific range. The evaluation encoder encodes and decodes the same test video source to obtain the encoded code stream and the decoding sequence.
4、 如权利要求 2或 3所述的一种视频编码性能测试方法, 其特征在于, 所述特定范围为:  4. A video coding performance testing method according to claim 2 or 3, wherein the specific range is:
abs (bitrate t 3Ig et — bitrate actual ) / bitrate t 3Ig et * 100 % < Thres 其中, Thres 为判定阈值, bitrate―„,为目标比特率, bitrate 为实际输出 比特率, Thres 为判定阈值, abs ( toraie t ^ et ~ bitrate actual )为取 bitmte - bitmte actual 的绝对值。 Abs (bitrate t 3Ig et — bitrate actual ) / bitrate t 3Ig et * 100 % < Thres where Thres is the decision threshold, bitrate „, is the target bit rate, bitrate is the actual output bit rate, Thres is the decision threshold, abs ( Toraie t ^ et ~ bitrate actual ) is the absolute value of bitmte - bitmte actual .
5、 如权利要求 1所述的视频编码性能测试方法, 其特征在于, 所述求取 最大窗口比特率的方法包括: 根据实际传输中的客户端缓冲时长, 确定时间窗; 5. The video encoding performance testing method according to claim 1, wherein said obtaining is performed. The method for maximizing the window bit rate includes: determining a time window according to a client buffering duration in an actual transmission;
计算每个时间窗内的输出平均比特率作为窗口比特率值;  Calculating an output average bit rate within each time window as a window bit rate value;
删除窗口比特率最大值;  Delete the maximum bit rate of the window;
将剩余窗口比特率序列降序排列,取前至少一个窗口比特率的平均值作为 最大窗口比特率。  The remaining window bit rate sequences are arranged in descending order, and the average of the at least one window bit rate is taken as the maximum window bit rate.
6、 如权利要求 1所述的视频编码性能测试方法, 其特征在于, 所述步骤 "根据所述最大窗口比特率与所述测试评分值, 构建条件率失真曲线图, 获取 编码器的视频编码性能"包括: 根据所述条件率失真曲线图, 获取不同编码技术的视频压缩性能和对网 络传输的适应性能; 通过在相同最大窗口比特率下, 比较测试评分值, 获取 编码器在图像测试质量上的压缩性能, 和 /或通过在相同测试评分值下, 比 较最大窗口比特率, 获取编码器网络传输性能。  The video encoding performance testing method according to claim 1, wherein the step of: constructing a condition rate distortion graph according to the maximum window bit rate and the test score value, and acquiring a video encoding of the encoder "Performance" includes: obtaining video compression performance and adaptability to network transmission according to the conditional rate distortion graph; obtaining the quality of the image in the image by comparing the test score values at the same maximum window bit rate The compression performance on the filter, and/or the encoder network transmission performance is obtained by comparing the maximum window bit rate under the same test score value.
7、 如权利要求 1所述的视频编码性能测试方法, 其特征在于, 所述步骤 "获取测试评分值"包括:  7. The video coding performance test method according to claim 1, wherein the step of "acquiring a test score value" comprises:
进行模拟测试熟悉评分流程;  Perform a simulation test to familiarize yourself with the scoring process;
进行正式测试获取评分;  Conduct a formal test to obtain a rating;
测试评分处理。  Test score processing.
8、 若权利要求 7所述的视频编码性能测试方法, 其特征在于, 所述步骤 "测试评分处理"包括:  8. The video coding performance test method according to claim 7, wherein the step of "test scoring processing" comprises:
测试数据归一化处理;  Test data normalization;
进行有效测试数据筛选;  Conduct effective test data screening;
基于有效测试数据计算所有有效测试人员评分均值; 测试数据反归一化处理。 Calculate the mean of all valid testers based on valid test data; The test data is inverse normalized.
9、 若权利要求 8所述的视频编码性能测试方法, 其特征在于, 所述步骤 "进行有效测试数据筛选"包括:  9. The video coding performance test method according to claim 8, wherein the step of "improving effective test data screening" includes:
筛选测试过程中的有效测试数据;  Screening valid test data during the test;
判定测试人员评分的有效性。  Determine the validity of the tester's score.
10、若权利要求 9所述的视频编码性能测试方法, 其特征在于, 所述步骤 "判定测试人员评分的有效性"包括:  10. The video coding performance test method according to claim 9, wherein the step of "determining the validity of the tester's score" includes:
Pearson相关性分析; Spearman等级相关性分析;  Pearson correlation analysis; Spearman rank correlation analysis;
确定判定阈值;  Determining a decision threshold;
判定测试人员评分数据的有效性。  Determine the validity of the tester's score data.
11、 一种视频编码性能测试系统, 其特征在于, 所述系统包括: 最大窗口获取模块, 用于获取最大窗口比特率;  A video coding performance test system, the system comprising: a maximum window acquisition module, configured to obtain a maximum window bit rate;
评分模块, 用于获取测试评分值; 评测模块, 用于根据所述最大窗口比特率和所述测试评分值构建的条件 率失真曲线图来获取不同编码技术的视频压缩性能和对网络传输的适应性 會 ^ 通过在相同最大窗口比特率下, 比较测试评分值, 获取编码器在图像测 试质量上的压缩性能, 和 /或通过在相同测试评分值下, 比较最大窗口比特 率, 获取编码器网络传输性能。  a scoring module, configured to obtain a test score value; an evaluation module, configured to obtain a video compression performance of different coding technologies and adapt to network transmission according to a condition rate distortion graph constructed according to the maximum window bit rate and the test score value Sexuality ^ Obtain the encoder's compression performance on the image test quality by comparing the test scores at the same maximum window bit rate, and/or obtain the encoder network by comparing the maximum window bit rate under the same test score value. Transmission performance.
12、 如权利要求 11所述视频编码性能测试系统, 其特征在于, 所述系统 还包括:  12. The video coding performance testing system of claim 11, wherein the system further comprises:
平均码率判定模块, 与所述最大窗口获取模块相连, 用于判定待评测编码 器的实际输出比特率与目标比特率的相对误差是否在特定范围内;  An average rate determining module is connected to the maximum window obtaining module, and configured to determine whether a relative error between an actual output bit rate of the to-be-evaluated encoder and a target bit rate is within a specific range;
目标比特率修改模块, 与所述平均码率判定模块相连,用于修改所述目标 比特率以使重新编解码后输出的所述实际输出比特率与所述目标比特率的 对误差在所述特定范围内。 a target bit rate modification module, coupled to the average bit rate decision module, for modifying the target The bit rate is such that the error of the actual output bit rate output after re-encoding and the target bit rate is within the specific range.
13、 如权利要求 11所述视频编码性能测试系统, 其特征在于, 所述系 还包括:  13. The video coding performance testing system of claim 11, wherein the system further comprises:
编解码模块, 与所述平均码率判定模块和所述目标比特率修改模块相连 用于对同一片源进行编解码并获取编码后的码流与解码序列。  The codec module is connected to the average rate decision module and the target bit rate modification module for encoding and decoding the same source and obtaining the encoded code stream and the decoding sequence.
14、 如权利要求 11所述视频编码性能测试系统, 其特征在于, 所述最大 窗口获取模块包括:  The video coding performance test system of claim 11, wherein the maximum window acquisition module comprises:
时间窗确定模块, 用于根据实际传输的客户端缓冲时长, 确定时间窗; 数据点获取模块,用于计算每个时间窗内的输出平均比特率作为窗口比特 率值;  a time window determining module, configured to determine a time window according to a client buffering duration of the actual transmission; a data point obtaining module, configured to calculate an output average bit rate in each time window as a window bit rate value;
偶然因素消除模块, 用于删除窗口比特率最大值;  An accidental factor elimination module for deleting a window bit rate maximum;
最大窗口选定模块,用于将剩余窗口比特率序列降序排列, 取前至少一个 窗口比特率的平均值作为最大窗口比特率。  The maximum window selection module is configured to sort the remaining window bit rate sequences in descending order, and take the average of the at least one window bit rate as the maximum window bit rate.
15、 如权利要求 12所述视频编码性能测试系统, 其特征在于, 所述特定 范围为: 15. The video coding performance testing system of claim 12, wherein the specific range is:
abs (bitrate t aig et - bitrate actual ) / bitrate t aig et * 100 % < Thres 其中, Thres 为判定阈值, bitrate― ot为目标比特率, 为实际输出 比特率, Thres 为判定阈值, abs ( toraie t mg et - bitrate actual )为取 bitmte et _ bitrate actl 的绝对值。 Abs (bitrate t aig et - bitrate actual ) / bitrate t aig et * 100 % < Thres where Thres is the decision threshold, bitrate ot is the target bit rate, is the actual output bit rate, Thres is the decision threshold, abs (to raie t mg et - bitrate actual ) is the absolute value of bitmte et _ bitrate actl .
16、 如权利要求 12所述视频编码性能测试系统, 其特征在于, 所述评 模块包括:  The video coding performance testing system according to claim 12, wherein the evaluation module comprises:
模拟测试模块, 用于进行模拟测试, 熟悉评分流程, 稳定评分; 测试评分数据处理模块,用于基于有效测试评分数据计算所有有效测试人 员评分均值, 获取最终的评分。 Simulation test module, used for simulation test, familiar with the scoring process, stable score; A test score data processing module is configured to calculate an average of all valid tester scores based on valid test score data to obtain a final score.
17、 如权利要求 16所述视频编码性能测试系统, 其特征在于, 所述测试 评分数据处理模块包括:  17. The video coding performance testing system of claim 16, wherein the test score data processing module comprises:
归一化模块,用于将每个测试人员的测试数据作线性归一化处理, 将原始 范围 [-3, 3] 的评分转换成 [0, 1]的评分; 数据筛选模块,包括测试数据有效性判定模块,用于筛选测试过程中的有 效测试数据,测试人员数据有效性判定模块,用于判定测试人员评分的有效性; 评分均值计算模块, 用于计算有效测试人员评分均值;  A normalization module for linearly normalizing the test data of each tester, converting the score of the original range [-3, 3] into a score of [0, 1]; the data screening module, including the test data a validity determination module for screening valid test data during the test, a tester data validity determination module for determining the validity of the tester's score, and a score mean calculation module for calculating an average score of the effective tester;
反归一化模块, 用于将范围 [0, 1]的平均得分转换成 [-3, 3]的评分。  An anti-normalization module that converts the average score of the range [0, 1] into a score of [-3, 3].
18、 如权利要求 17所述视频编码性能测试系统, 其特征在于, 所述对测 试人员评分有效性的判定具体为: 18. The video coding performance testing system of claim 17, wherein the determining the validity of the tester score is:
根据 Pearson相关性分析、 Spearman等级相关性分析、 判定阈值对测试 人员的评分进行有效性判定。  The validity of the tester's score was determined based on Pearson correlation analysis, Spearman rank correlation analysis, and decision threshold.
PCT/CN2011/076606 2010-07-21 2011-06-30 Method and system for testing video encoding performance WO2012010046A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010233014.X 2010-07-21
CN 201010233014 CN101895787B (en) 2010-07-21 2010-07-21 Method and system for subjectively evaluating video coding performance

Publications (1)

Publication Number Publication Date
WO2012010046A1 true WO2012010046A1 (en) 2012-01-26

Family

ID=43104826

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/076606 WO2012010046A1 (en) 2010-07-21 2011-06-30 Method and system for testing video encoding performance

Country Status (2)

Country Link
CN (1) CN101895787B (en)
WO (1) WO2012010046A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2549755B1 (en) 2010-03-18 2017-09-27 Panasonic Intellectual Property Corporation of America Data processing device and data processing method
CN101895787B (en) * 2010-07-21 2012-09-12 深圳市融创天下科技股份有限公司 Method and system for subjectively evaluating video coding performance
CN105828069B (en) * 2016-04-06 2019-01-18 上海交通大学 A kind of encoder self-adapting regulation method based on subjective quality assessment
CN111953966B (en) * 2020-08-11 2022-06-28 广州市百果园信息技术有限公司 Method, device, server and storage medium for testing codes

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101150903A (en) * 2007-10-31 2008-03-26 深圳市和而泰电子科技有限公司 A LED drive circuit and its control method
CN101523916A (en) * 2006-10-19 2009-09-02 艾利森电话股份有限公司 A method of determining video quality
CN101151904B (en) * 2006-05-09 2010-06-16 日本电信电话株式会社 Video quality estimating device, method, and program
CN101895788A (en) * 2010-07-21 2010-11-24 深圳市融创天下科技发展有限公司 Method and system for objectively evaluating video coding performance
CN101895787A (en) * 2010-07-21 2010-11-24 深圳市融创天下科技发展有限公司 Method and system for subjectively evaluating video coding performance

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4490483B2 (en) * 2006-05-09 2010-06-23 日本電信電話株式会社 Video quality estimation apparatus, method, and program
JP4817246B2 (en) * 2006-07-31 2011-11-16 Kddi株式会社 Objective video quality evaluation system
CN101616315A (en) * 2008-06-25 2009-12-30 华为技术有限公司 A kind of method for evaluating video quality, device and system
CN101715146B (en) * 2008-10-08 2011-09-07 中国移动通信集团公司 Method and system for evaluating quality of compressed video

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101151904B (en) * 2006-05-09 2010-06-16 日本电信电话株式会社 Video quality estimating device, method, and program
CN101523916A (en) * 2006-10-19 2009-09-02 艾利森电话股份有限公司 A method of determining video quality
CN101150903A (en) * 2007-10-31 2008-03-26 深圳市和而泰电子科技有限公司 A LED drive circuit and its control method
CN101895788A (en) * 2010-07-21 2010-11-24 深圳市融创天下科技发展有限公司 Method and system for objectively evaluating video coding performance
CN101895787A (en) * 2010-07-21 2010-11-24 深圳市融创天下科技发展有限公司 Method and system for subjectively evaluating video coding performance

Also Published As

Publication number Publication date
CN101895787A (en) 2010-11-24
CN101895787B (en) 2012-09-12

Similar Documents

Publication Publication Date Title
Zhang et al. Subjective and objective quality assessment of panoramic videos in virtual reality environments
Turaga et al. No reference PSNR estimation for compressed pictures
CN102143388B (en) Device and method for estimating quality of experience (QoE) for internet protocol television (IPTV) user
CN106412572B (en) A kind of video flowing coding quality evaluation method based on kinetic characteristic
CN107027023A (en) VoIP based on neutral net is without reference video communication quality method for objectively evaluating
CN105100789A (en) Method for evaluating video quality
Keimel et al. No-reference video quality metric for HDTV based on H. 264/AVC bitstream features
WO2008008150A3 (en) Methods and apparatus for enhanced performance in a multi-pass video encoder
CN103414915A (en) Quality evaluation method and device for uploaded videos of websites
CN104661021A (en) Quality assessment method and device for video streaming
WO2012010046A1 (en) Method and system for testing video encoding performance
CN101478691A (en) Non-reference evaluation method for Motion Jpeg2000 video objective quality
CN109286812A (en) A kind of HEVC video quality estimation method
WO2012010041A1 (en) Method and system for evaluating video coding performance
CN107292866B (en) Image quality objective evaluation method based on relative gradient
Bhat et al. Combining video quality metrics to select perceptually accurate resolution in a wide quality range: A case study
Turaga et al. No reference PSNR estimation for compressed pictures
CN111355949B (en) Method for constructing audio and video multimedia database and evaluating subjective quality of multimedia
Singam et al. An error concealment based on translations of generalized neural networks
US6603505B1 (en) Device for objectively evaluating the quality of a digital transmitted picture
Martínez-Rach et al. Quality assessment metrics vs. PSNR under packet lossscenarios in manet wireless networks
Alvarez et al. A flexible QoE framework for video streaming services
Kipli et al. Full reference image quality metrics and their performance
Xia et al. GAN-based image compression with improved RDO process
Martínez-Rach et al. On the performance of video quality assessment metrics under different compression and packet loss scenarios

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11809234

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 07/06/2013)

122 Ep: pct application non-entry in european phase

Ref document number: 11809234

Country of ref document: EP

Kind code of ref document: A1