CN108271020A - A kind of panoramic video quality evaluating method of view-based access control model attention model - Google Patents
A kind of panoramic video quality evaluating method of view-based access control model attention model Download PDFInfo
- Publication number
- CN108271020A CN108271020A CN201810372074.6A CN201810372074A CN108271020A CN 108271020 A CN108271020 A CN 108271020A CN 201810372074 A CN201810372074 A CN 201810372074A CN 108271020 A CN108271020 A CN 108271020A
- Authority
- CN
- China
- Prior art keywords
- video
- distortion
- panoramic video
- latitude
- panoramic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The present invention relates to a kind of panoramic video quality evaluating methods of view-based access control model attention model, by carrying out band division to original video, coding distortion is introduced to different bands respectively, generation distortion video, then subjective quality marking is carried out to distortion video, visual attention model is constructed according to the latitude of subjective quality scores and distortion band, the total quality evaluation index of panoramic video is obtained after weighting.The present invention solves attention distribution problem when user watches panoramic video, improves the accuracy of panoramic video quality evaluation.
Description
Technical field
The present invention relates to computer digit technical field of video image processing more particularly to a kind of view-based access control model attention moulds
The panoramic video quality evaluating method of type.
Background technology
Existing most of algorithms are all only applicable to the quality evaluation of ordinary video, and the quality evaluation of panoramic video is related to
Foot is very few, and with the rapid development of virtual reality technology, the quality evaluation of the panoramic video of strong applicability is only development trend.
Invention content
Insufficient for the above-mentioned prior art, the present invention provides a kind of panoramic video quality of view-based access control model attention model and comments
Valency method mainly solves attention distribution problem when user watches panoramic video, realizes and panoramic video quality is precisely predicted
Purpose.
To achieve the above object, the technical scheme is that：A kind of panoramic video matter of view-based access control model attention model
Evaluation method is measured, is included the following steps：
Step S1：The correspondence for entering encoder anterior-posterior projection by analyzing original video and converting, base is carried out to original video
It is divided in the band of latitude, ensures that band has equal arc length；
Step S2：Coding distortion is introduced to different bands respectively, generation distortion video collectively constitutes aphorama with original video
Frequency database；
Step S3：Subjective assessment is carried out to distortion video, the subjective quality scores of distortion video are obtained, according to subjective quality
The latitude structure distortion sensitivity model of score and distortion band；
Step S4：Build the visual attention model based on latitude；
Step S5：Visual attention model based on latitude is weighting on Y-PSNR, obtains the whole matter of panoramic video
Measure evaluation index.
Further, 9 bands are divided into the step S1, to original video, latitude value is respectively+90 ,+70 ,+
50、+30、+10、-10、-30、-50、-70、-90。
Further, the step S2 is specially：Using damaging video encoder with several quantization parameter values to original
Video is compressed, and quantization parameter value is distributed to different bands under equal matrix projection, coding distortion is introduced in band,
Video is distorted with generation, panoramic video database is collectively constituted with original video.
Further, sensitivity model is distorted in the step S3 is：
Wherein, DsTo be distorted sensitivity, DMOS is the practical subjective quality point that the full marks of subjective quality scores subtract distortion video
Number gained difference, Δ Q are the average quantiser step size being distorted in band.
Further, the step S4 is specially：
60% training sample is randomly choosed in panoramic video database and other 40% samples are surveyed using the method that reserves
Examination, it is as follows to obtain the visual attention model based on latitude：
Wherein,For the weight matrix form of visual attention model,For fitting parameter,It represents original to regard
The resolution ratio of frequency, j are pixel in distortion video frame（i,j）Ordinate value.
Further, the step S5 is specifically included：
It is as follows to calculate 360 degree of mean square error MSE：
It is as follows to calculate Y-PSNR PSNR：
Wherein,WithIt is the pixel value of the frame of original video and distortion video respectively,It is video frame
Maximum possible brightness degree, PSNR values are bigger, and the total quality for representing panoramic video is better.
Compared with prior art, the present invention has advantageous effect：Solve attention distribution when user watches panoramic video
Problem realizes the accurate prediction and evaluation to panoramic video quality.
Description of the drawings
Fig. 1 is a kind of flow diagram of the panoramic video quality evaluating method of view-based access control model attention model of the present invention；
Fig. 2 is the band dividing condition schematic diagram of original video in one embodiment of the invention；
Fig. 3 is the relation schematic diagram of subjective quality scores and latitude value in one embodiment of the invention；
Fig. 4 is the schematic diagram that sensitivity model is distorted in one embodiment of the invention.
Specific embodiment
The present invention will be further described with reference to the accompanying drawings and embodiments.
As shown in Figure 1, a kind of panoramic video quality evaluating method of view-based access control model attention model, includes the following steps：
Step S1：The correspondence for entering encoder anterior-posterior projection by analyzing original video and converting, base is carried out to original video
It is divided in the band of latitude, ensures that band has equal arc length；
Step S2：Coding distortion is introduced to different bands respectively, generation distortion video collectively constitutes aphorama with original video
Frequency database；
Step S3：Subjective assessment is carried out to distortion video, the subjective quality scores of distortion video are obtained, according to subjective quality
The latitude structure distortion sensitivity model of score and distortion band；
Step S4：Build the visual attention model based on latitude；
Step S5：Visual attention model based on latitude is weighting on Y-PSNR, obtains the whole matter of panoramic video
Measure evaluation index.
In the present embodiment, as shown in Fig. 2, being divided into 9 bands to original video, latitude value be respectively+90 ,+70 ,+
50、+30、+10、-10、-30、-50、-70、-90。
Based on HEVC with three quantization parameters（QP）35,40 and 45 pairs of videos of value compress, will under equal matrix projection
These QP values distribute to 9 different bands.Fig. 2 shows the latitude variation of 9 different frequency ranges.It is introduced in these bands
Coding distortion to generate some distortion videos, while keeps wherein almost complete overall objective distortion.Track is dropped to keep away
Exempt from the influence of acoustic information.The original video of 5 different contents is chosen, therefore, a total of 5 original series and 135 are impaired
Sequence（5 sequence × 3 QP × 9 band）, finally establish the database of 140 panoramic video.
Subjective assessment is carried out to distortion video, for panoramic video random display on same screen, experimenter will
Original video as reference gives a mark to remaining distortion video according to 0-5 points.The subjective quality of panoramic video point in database
Number is represented by the Mean Opinion Score number of 23 experimenters.As shown in figure 3, for average subjective quality scores and the latitude of distortion
The relationship of value.
Being distorted sensitivity model is：
Wherein, DsTo be distorted sensitivity, DMOS is that the full marks 5 of subjective quality scores divide the practical subjective quality for subtracting distortion video
Difference obtained by score, Δ Q are the average quantiser step size being distorted in band.Distortion sensitivity model based on latitude, it can be true
Determine the average quality of panoramic video.This distortion sensitivity table is shown as the objective distortion of different zones to whole subjective matter by us
The influence of amount.
Distortion sensitivity model by its maximum value in all latitudes as shown in figure 4, be normalized, definition latitude
The sensitivity spent for 0 is 1, other latitudes between 0~1.It is observed that for different QP, above-mentioned trend is basic
It is similar, therefore the influence of QP can be eliminated.This has given full expression to influence of the latitude to perceptual distortion, helps to establish based on latitude
Visual attention model, it follows that formula speculate it close to cos functions, then by fitting, obtain vision attention
Power model.60% training sample is randomly choosed in panoramic video database and other 40% samples are carried out using the method that reserves
Test, above-mentioned processing have carried out five times, and it is as follows to obtain the visual attention model based on latitude：
Wherein,For the weight matrix form of visual attention model,For fitting parameter,It represents original to regard
The resolution ratio of frequency, j are pixel in distortion video frame（i,j）Ordinate value.Each pixel in frameIt can be calculated as
With the corresponding value of weight matrix.In the present embodiment, the average value of parameter a obtained from each training group is 0.4618.
Final quality evaluation algorithm is built by the weighting of visual attention model, the vision based on distortion sensitivity
Attention model can be used for local quality index is weighted to generate total quality index.By the vision attention based on latitude
Power model-weight is in Y-PSNR（PSNR）On to obtain the whole measurement standard of panoramic video, calculate 360 degree of mean square errors
Poor MSE is as follows：
It is as follows to calculate Y-PSNR PSNR：
Wherein,WithIt is the pixel value of the frame of original video and distortion video respectively,It is video frame
Maximum possible brightness degree, PSNR values are bigger, and the total quality for representing panoramic video is better.
Inventive method is verified：
We verify inventive algorithm by calculating the related coefficient between subjective quality scores and the mass value of algorithm acquisition
Performance, wherein related coefficient include Pearson's linearly dependent coefficient（Pearson Linear Correlation
Coefficient, PLCC）, Spearman rank correlation coefficient（Spearman Rank-order Correlation
Coefficient, SRCC）And Ken Deer rank related coefficients（Kendall Rank-order Correlation
Coefficient, KRCC）, for the value of related coefficient closer to 1, the accuracy of representative model is higher.Experimental result is as shown in table 1.
Table 1
The foregoing is only a preferred embodiment of the present invention, but protection scope of the present invention be not limited thereto, it is any
Those familiar with the art in the technical scope disclosed by the present invention, according to the technique and scheme of the present invention and its invents
Design is subject to equivalent substitution or change, should be covered by the protection scope of the present invention.
Claims (6)
1. a kind of panoramic video quality evaluating method of view-based access control model attention model, which is characterized in that include the following steps：
Step S1：The correspondence for entering encoder anterior-posterior projection by analyzing original video and converting, base is carried out to original video
It is divided in the band of latitude, ensures that band has equal arc length；
Step S2：Coding distortion is introduced to different bands respectively, generation distortion video collectively constitutes aphorama with original video
Frequency database；
Step S3：Subjective assessment is carried out to distortion video, the subjective quality scores of distortion video are obtained, according to subjective quality
The latitude structure distortion sensitivity model of score and distortion band；
Step S4：Build the visual attention model based on latitude；
Step S5：Visual attention model based on latitude is weighting on Y-PSNR, obtains the whole matter of panoramic video
Measure evaluation index.
2. panoramic video quality evaluating method according to claim 1, which is characterized in that in the step S1, to original
Video is divided into 9 bands, and latitude value is respectively+90 ,+70 ,+50 ,+30 ,+10, -10, -30, -50, -70, -90.
3. panoramic video quality evaluating method according to claim 1, which is characterized in that the step S2 is specially：Make
Original video is compressed with several quantization parameter values with video encoder is damaged, by quantization parameter under equal matrix projection
Value distributes to different bands, and coding distortion is introduced in band, and to generate distortion video, panorama is collectively constituted with original video
Video database.
4. panoramic video quality evaluating method according to claim 1, which is characterized in that be distorted in the step S3 sensitive
Spending model is：
Wherein, DsTo be distorted sensitivity, DMOS is the practical subjective quality scores that the full marks of subjective quality scores subtract distortion video
Gained difference, Δ Q are the average quantiser step size being distorted in band.
5. panoramic video quality evaluating method according to claim 1, the step S4 are specially：
60% training sample is randomly choosed in panoramic video database and other 40% samples are surveyed using the method that reserves
Examination, it is as follows to obtain the visual attention model based on latitude：
Wherein,For the weight matrix form of visual attention model,For fitting parameter,It represents original to regard
The resolution ratio of frequency, j are pixel in distortion video frame（i,j）Ordinate value.
6. panoramic video quality evaluating method according to claim 5, which is characterized in that the step S5 is specifically included：
It is as follows to calculate 360 degree of mean square error MSE：
It is as follows to calculate Y-PSNR PSNR：
Wherein,WithIt is the pixel value of the frame of original video and distortion video respectively,It is video frame
Maximum possible brightness degree, PSNR values are bigger, and the total quality for representing panoramic video is better.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810372074.6A CN108271020B (en) | 2018-04-24 | 2018-04-24 | A kind of panoramic video quality evaluating method of view-based access control model attention model |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810372074.6A CN108271020B (en) | 2018-04-24 | 2018-04-24 | A kind of panoramic video quality evaluating method of view-based access control model attention model |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108271020A true CN108271020A (en) | 2018-07-10 |
| CN108271020B CN108271020B (en) | 2019-08-09 |
Family
ID=62777740
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810372074.6A Active CN108271020B (en) | 2018-04-24 | 2018-04-24 | A kind of panoramic video quality evaluating method of view-based access control model attention model |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108271020B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110930370A (en) * | 2019-11-04 | 2020-03-27 | 北京工业大学 | Panoramic image quality evaluation method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106657980A (en) * | 2016-10-21 | 2017-05-10 | 乐视控股（北京）有限公司 | Testing method and apparatus for the quality of panorama video |
| CN107347153A (en) * | 2016-10-20 | 2017-11-14 | 中国科学技术大学 | The quality evaluating method of longitude and latitude figure panoramic video |
| CN107454418A (en) * | 2017-03-03 | 2017-12-08 | 叠境数字科技（上海）有限公司 | 360 degree of panorama video code methods based on motion attention model |
| CN107483920A (en) * | 2017-08-11 | 2017-12-15 | 北京理工大学 | A kind of panoramic video appraisal procedure and system based on multi-layer quality factor |
| US20180033176A1 (en) * | 2016-07-28 | 2018-02-01 | Cyberlink Corp. | Systems and methods for rendering effects in 360 video |
-
2018
- 2018-04-24 CN CN201810372074.6A patent/CN108271020B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180033176A1 (en) * | 2016-07-28 | 2018-02-01 | Cyberlink Corp. | Systems and methods for rendering effects in 360 video |
| CN107347153A (en) * | 2016-10-20 | 2017-11-14 | 中国科学技术大学 | The quality evaluating method of longitude and latitude figure panoramic video |
| CN106657980A (en) * | 2016-10-21 | 2017-05-10 | 乐视控股（北京）有限公司 | Testing method and apparatus for the quality of panorama video |
| CN107454418A (en) * | 2017-03-03 | 2017-12-08 | 叠境数字科技（上海）有限公司 | 360 degree of panorama video code methods based on motion attention model |
| CN107483920A (en) * | 2017-08-11 | 2017-12-15 | 北京理工大学 | A kind of panoramic video appraisal procedure and system based on multi-layer quality factor |
Non-Patent Citations (2)
| Title |
|---|
| MAI XU ET AL: "A SUBJECTIVE VISUAL QUALITY ASSESSMENT METHOD OF PANORAMIC VIDEOS", 《PROCEEDINGS OF THE IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME) 2017》 * |
| YUHANG SONG ET AL: "Modeling Attention in Panoramic Video:A Deep Reinforcement Learning Approach", 《JOURNAL OF LATEX CLASS FILES》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110930370A (en) * | 2019-11-04 | 2020-03-27 | 北京工业大学 | Panoramic image quality evaluation method |
| CN110930370B (en) * | 2019-11-04 | 2023-03-31 | 北京工业大学 | Panoramic image quality evaluation method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108271020B (en) | 2019-08-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100731358B1 (en) | Method and system for measuring the video quality | |
| Hassan et al. | Structural similarity measure for color images | |
| CN104658002B (en) | Non-reference image objective quality evaluation method | |
| TW201814596A (en) | Using image analysis algorithms for providing training data to neural networks | |
| CN106709958A (en) | Gray scale gradient and color histogram-based image quality evaluation method | |
| CN109191460B (en) | Quality evaluation method for tone mapping image | |
| CN104021545A (en) | Full-reference color image quality evaluation method based on visual saliency | |
| CN106408561A (en) | Texture feature-based image quality evaluating method without reference | |
| CN106548472A (en) | Non-reference picture quality appraisement method based on Walsh Hadamard transform | |
| CN102572499B (en) | Based on the non-reference picture quality appraisement method of wavelet transformation multi-resolution prediction | |
| CN104572538A (en) | K-PLS regression model based traditional Chinese medicine tongue image color correction method | |
| CN111582071A (en) | SF6 instrument image reading method based on HRNet network model | |
| JP2000078618A (en) | Evaluation method for video picture quality | |
| CN113470562A (en) | OLED screen sub-pixel brightness extraction method based on imaging brightness meter | |
| Jiang et al. | Tone-mapped image quality assessment for electronics displays by combining luminance partition and colorfulness index | |
| CN107945154A (en) | Color image quality evaluation method based on quaternary number discrete cosine transform | |
| CN111724316A (en) | Method and apparatus for processing high dynamic range images | |
| CN109685772A (en) | It is a kind of based on registration distortion indicate without referring to stereo image quality appraisal procedure | |
| CN108271020B (en) | A kind of panoramic video quality evaluating method of view-based access control model attention model | |
| CN107018410A (en) | A kind of non-reference picture quality appraisement method based on pre- attention mechanism and spatial dependence | |
| CN113222902B (en) | No-reference image quality evaluation method and system | |
| Bondžulić et al. | Picture-wise just noticeable difference prediction model for JPEG image quality assessment | |
| CN107203991A (en) | A kind of half reference image quality appraisement method based on spectrum residual error | |
| CN116363094A (en) | Super-resolution reconstruction image quality evaluation method | |
| Narwaria et al. | An objective method for High Dynamic Range source content selection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |