CN101833766A - Stereo image objective quality evaluation algorithm based on GSSIM - Google Patents
Stereo image objective quality evaluation algorithm based on GSSIM Download PDFInfo
- Publication number
- CN101833766A CN101833766A CN 201010169050 CN201010169050A CN101833766A CN 101833766 A CN101833766 A CN 101833766A CN 201010169050 CN201010169050 CN 201010169050 CN 201010169050 A CN201010169050 A CN 201010169050A CN 101833766 A CN101833766 A CN 101833766A
- Authority
- CN
- China
- Prior art keywords
- image
- sigma
- prime
- value
- absolute difference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention belongs to the image processing field and relates to a stereo image quality evaluation method based on GSSIM. The method includes the steps: (1) for left image and right image, gradient structure similarity values are respectively solved, the average of the two values is solved, so as to obtain stereo image quality evaluation value QE; (2) the following method is adopted to carrying out image stereoscopic perception objective evaluation: absolute difference image of the original image and processed image is calculated, Mu1 and Mu2 of the absolute difference image are solved; Sobel operator is used for solving the gradient amplitude image of the absolute difference image; filtering is carried out on the absolute difference image of the original image, and original image binocular parallax distribution situation is calculated; Dl(x, y), Dcg(x, y) and Dsg(x, y) values at binocular parallax position are solved; DSSIM value at the binocular parallax position is calculated; and image gradient structure similarity namely image stereoscopic perception objective evaluation value DE is calculated. The invention can be well applied to stereo image quality evaluation, and correlation of objective evaluation result and subjective evaluation result is strong.
Description
Technical field
The invention belongs to image processing field, relate to a kind of three-dimensional image objective quality evaluation algorithm.
Background technology
The quality assessment of stereoscopic image is a very difficult job, and existing plane picture evaluating objective quality algorithm concerns with decoded picture quality before can only estimating same viewpoint coding usually.There is the high correlation of human eye standard parallax in stereo-picture between adjacent viewpoint, if two adjacent viewpoint picture quality separately is all than higher, parallax composition minimizing even anti-phase between viewpoint, the stereoscopic sensation that human eye can be enjoyed will be had a greatly reduced quality, so existing plane picture evaluating objective quality algorithm can not replace the three-dimensional image objective quality evaluation algorithm.If a kind of compressed encoding causes relief heavy losses even causes beholder's kopiopia, be not suitable for the application of stereo-picture.Therefore, the necessary objective evaluation standard of setting up a stereo-picture.
Gradient-structure similarity (GSSIM) evaluation method is a kind of plane picture method for evaluating objective quality, discover that human eye is the most responsive and payes attention to for edge of image and texture structure information, the structural information of edge and texture probably is the most important parts of picture structure information in other words, and gradient can be reacted the edge of image texture information preferably, so adopt the gradient-structure similarity also can carry out the stereo image quality evaluation.This method is as follows:
The extraction of gradient information: determine that by the calculating of gradient image edge information is the most common and effective and efficient manner.Adopt the Sobel operator that image is carried out the calculating of gradient, as shown in Figure 1.
Each pixel x for image X
I, j(i, j represent horizontal ordinate value) can pass through Sobel operator definitions its " gradient information vector "; V
I, j={ dx
I, j, dy
I, jWherein, dx
I, jAnd dy
I, jHorizontal edge operator H and vertical edge operator v by Fig. 1 draws respectively, easy for algorithm, and the gradient magnitude that defines image pixel approx is:
Amp
i,j=|dx
i,j|+|dy
i,j|
Accordingly, the gradient direction of each pixel is defined as:
Utilize the structural similarity (GSSIM) of the amplitude information proposition of image:, can obtain the gradient magnitude of each pixel of image, thereby obtain and image X and corresponding gradient image X ' of Y and Y ' with the gradient magnitude of Sobel operator and image pixel based on gradient.Therefore, sub-piece gradient contrast relatively may be defined as:
σ is a standard deviation, C
2For adjusting parameter.
The texture ratio of sub-piece gradient may be defined as:
C
3For adjusting parameter.
Structural similarity (GSSIM) may be defined as:
GSSIM(x,y)=[1(x,y)]
α[c
g(x,y)]
β[s
g(x,y)]
γ
α, beta, gamma are the weight exponential quantity.
For the comparison of the similarity of entire image, can draw by the similarity scoring of average each height piece:
Summary of the invention
The objective of the invention is to overcome the above-mentioned deficiency of prior art, propose a kind of three-dimensional image objective quality evaluation method.The present invention introduces gradient-structure similarity (GSSIM) evaluation method in the three-dimensional image objective quality evaluation, carries out image quality evaluation (QE) and stereoscopic sensation evaluation (DE) by stereoscopic image, finishes the judge of stereoscopic image quality.The present invention adopts following technical scheme:
A kind of stereo image quality evaluation method based on GSSIM comprises the following steps:
(1) for left image and right image, utilize gradient-structure similarity GSSIM algorithm respectively, ask for gradient-structure similarity value, ask for the average of two values again, obtain stereo image quality evaluation of estimate QE;
(2) adopt following method to carry out image stereo perception objective evaluation:
The first step: the viewpoint of original image to (L1, R1) and the viewpoint of handling the back image to (L2 R2) carries out the phase reducing respectively, draws absolute difference image X1 and X2;
In second step, carry out luminance test, by the following μ that obtains absolute difference image X1 and X2 of formula
1, μ
2:
In the 3rd step, obtain gradient magnitude image M 1 and the M2 of absolute difference image X1 and X2 with the Sobel operator, and obtain image M 1 and M2 brightness average μ
1 ', μ
2 ', again by the following standard deviation sigma of obtaining of formula
1 ', σ
2 ', and covariance sigma
1 ' 2 ':
The 4th step, the absolute difference image X1 of original image is carried out filtering, threshold value decision operation, calculate former figure binocular parallax distribution situation;
In the 5th step, use μ
1, μ
2, σ
1 ', σ
2 'With σ
1 ' 2 ', in conjunction with the former figure parallax distribution situation that calculates, obtain the binocular parallax place Dl (x, y), Dcg (x, y) with Dsg (x, y) value, computing formula is as follows:
The 6th step, by formula DSSIM (x, y)=[Dl (x, y)]
α[Dc
g(x, y)]
β[Ds
g(x, y)]
γ(3-34) calculate the DSSIM value at binocular parallax place, α wherein, the beta, gamma value all is 1;
In the 7th step, by the DSSIM value, utilize the image gradient structural similarity DMSSIM of column count binocular parallax place under the formula, i.e. image stereo perception objective evaluation value DE:
In the 8th step, the stereoscopic image quality is estimated: the QE value is big more, and picture quality is good more, and the DE value is big more, and stereoscopic sensation is good more.
The three-dimensional image objective quality evaluation method that uses the present invention to propose, can carry out quality evaluation from picture quality and two aspect stereoscopic image of stereoscopic sensation, experimental results demonstrate that this algorithm can perform well in the quality assessment of stereo-picture, objective evaluation result and subjective assessment results relevance are very strong, and effectively stereoscopic image is made evaluation.
Description of drawings
Fig. 1 Sobel operator (a) is vertical edge operator V, (b) is horizontal edge operator H.
Fig. 2 stereo perception objective evaluation of the present invention flow process
Fig. 2 stereo perception objective evaluation flow process.
Embodiment
The index of stereoscopic image objective evaluation proposed by the invention is divided into two parts: one is the image evaluating objective quality, and one is the stereoscopic sensation objective evaluation.
1, image evaluating objective quality (quality evaluation:QE)
Continue to use gradient-structure similarity (GSSIM) evaluation method for the image evaluating objective quality.
Three-dimensional image objective quality evaluation value of the present invention be left image GMSSIM value and right image GMSSIM value average promptly: QE=1-(GMSSIM
A left side+ GMSSIM
Right)/2
2, image stereo perception objective evaluation (3D sense evaluation:DE)
Image stereo perception objective evaluation algorithm of the present invention is continued to use the evaluating of GSSIM algorithm, and viewpoint organically is combined in the evaluating absolute difference figure.Stereo perception objective evaluation flow process such as Fig. 2:
At first, original viewpoint to (L1, R1) and handle backsight point to (L2 R2) carries out the phase reducing respectively, draws absolute difference image X1 and X2;
X1=|L1-R1|
X2=|L2-R2|
In second step, carry out luminance test, by the following μ that obtains absolute difference image X1 and X2 of formula
1, μ
2
In the 3rd step, obtain gradient magnitude image M 1 and the M2 of absolute difference image X1 and X2 with the Sobel operator, and obtain image M 1 and M2 brightness average μ
1 ', μ
2 ', again by the following standard deviation sigma of obtaining of formula
1 ', σ
2 ', and covariance sigma 1 ' 2 '.
The 4th step, the absolute difference image X1 of original image is carried out filtering, threshold value decision operation, remove faint noise and low amplitude value composition, reach to reduce and disturb purpose, the former figure binocular parallax distribution situation that calculates then.Because the existence of psychological stereoscopic vision, the people can feel that the scope of parallax of small magnitude is very little, and most of having been covered is so in this step, remove the influence of small magnitude parallax by the threshold value judgement.
In the 5th step, use μ
1, μ
2, σ
1 ', σ
2 'With σ
1 ' 2 ', in conjunction with the former figure parallax distribution situation that calculates, (x, y), (x, y) (x, y) value, computing formula be (3-31), (3-32) and (3-33) to Dcg with Dsg to obtain the Dl of binocular parallax place (being made as D).
In the 6th step, (x, y), (x, y) (x, y) each value calculate the DSSIM value at binocular parallax place to Dcg by formula (3-34) with Dsg according to the Dl at binocular parallax place.
DSSIM(x,y)=[Dl(x,y)]
α[Dc
g(x,y)]
β[Ds
g(x,y)]
γ
α wherein, the beta, gamma value all is 1.
In the 7th step,, utilize the image gradient structural similarity DMSSIM of column count binocular parallax place under the formula, i.e. image stereo perception objective evaluation value---DE by DSSIM.
Sum up:
When the QE value was 0.9-1, picture quality was fine;
When the QE value was 0.8-0.9, picture quality was better;
When the QE value is 0.55-0.8, picture quality one;
The QE value is 0.55 when following, and picture quality is very poor.
When the DE value was 0.85-1, stereoscopic sensation was fine;
When the DE value was 0.7-0.85, stereoscopic sensation was better;
When the DE value is 0.45-0.7, stereoscopic sensation one;
The DE value is 0.45 when following, and stereoscopic sensation is very poor.
The present invention is best to double vision point stereo image quality evaluation effect; If multi-viewpoint stereo image can be divided into a plurality of double vision point stereo-pictures and estimate.
Claims (1)
1. the stereo image quality evaluation method based on GSSIM comprises the following steps:
(1) for left image and right image, utilize gradient-structure similarity GSSIM algorithm respectively, ask for gradient-structure similarity value, ask for the average of two values again, obtain stereo image quality evaluation of estimate QE;
(2) adopt following method to carry out image stereo perception objective evaluation:
The first step: the viewpoint of original image to (L1, R1) and the viewpoint of handling the back image to (L2 R2) carries out the phase reducing respectively, draws absolute difference image X1 and X2;
In second step, carry out luminance test, by the following μ that obtains absolute difference image X1 and X2 of formula
1, μ
2:
In the 3rd step, obtain gradient magnitude image M 1 and the M2 of absolute difference image X1 and X2 with the Sobel operator, and obtain image M 1 and M2 brightness average μ
1 ', μ
2 ', again by the following standard deviation sigma of obtaining of formula
1 ', σ
2 ', and covariance sigma
1 ' 2 ':
The 4th step, the absolute difference image X1 of original image is carried out filtering, threshold value decision operation, calculate former figure binocular parallax distribution situation;
In the 5th step, use μ
1, μ
2, σ
1 ', σ
2 'With σ
1 ' 2 ', in conjunction with the former figure parallax distribution situation that calculates, obtain the binocular parallax place D1 (x, y), Dcg (x, y) with Dsg (x, y) value, computing formula is as follows:
The 6th step, by formula DSSIM (x, y)=[D1 (x, y)]
α[Dc
g(x, y)]
β[Ds
g(x, y)]
γ(3-34) calculate the DSSIM value at binocular parallax place, α wherein, the beta, gamma value all is 1;
In the 7th step, by the DSSIM value, utilize the image gradient structural similarity DMSSIM of column count binocular parallax place under the formula, i.e. image stereo perception objective evaluation value DE:
In the 8th step, the stereoscopic image quality is estimated: the QE value is big more, and picture quality is good more, and the DE value is big more, and stereoscopic sensation is good more.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 201010169050 CN101833766A (en) | 2010-05-11 | 2010-05-11 | Stereo image objective quality evaluation algorithm based on GSSIM |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 201010169050 CN101833766A (en) | 2010-05-11 | 2010-05-11 | Stereo image objective quality evaluation algorithm based on GSSIM |
Publications (1)
Publication Number | Publication Date |
---|---|
CN101833766A true CN101833766A (en) | 2010-09-15 |
Family
ID=42717827
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 201010169050 Pending CN101833766A (en) | 2010-05-11 | 2010-05-11 | Stereo image objective quality evaluation algorithm based on GSSIM |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101833766A (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101976444A (en) * | 2010-11-11 | 2011-02-16 | 浙江大学 | Pixel type based objective assessment method of image quality by utilizing structural similarity |
CN102708567A (en) * | 2012-05-11 | 2012-10-03 | 宁波大学 | Visual perception-based three-dimensional image quality objective evaluation method |
CN102708568A (en) * | 2012-05-11 | 2012-10-03 | 宁波大学 | Stereoscopic image objective quality evaluation method on basis of structural distortion |
CN102930528A (en) * | 2012-09-24 | 2013-02-13 | 宁波大学 | Method for objectively evaluating quality of three-dimensional image based on three-dimensional structural similarity |
CN103136748A (en) * | 2013-01-21 | 2013-06-05 | 宁波大学 | Stereo-image quality objective evaluation method based on characteristic image |
CN104112272A (en) * | 2014-07-04 | 2014-10-22 | 上海交通大学 | Semi-reference image quality assessment method based on structure reduced model |
CN104159104A (en) * | 2014-08-29 | 2014-11-19 | 电子科技大学 | Full-reference video quality evaluation method based on multi-stage gradient similarity |
CN105931257A (en) * | 2016-06-12 | 2016-09-07 | 西安电子科技大学 | SAR image quality evaluation method based on texture feature and structural similarity |
CN106530282A (en) * | 2016-10-20 | 2017-03-22 | 天津大学 | Spatial feature-based non-reference three-dimensional image quality objective assessment method |
CN106709958A (en) * | 2016-12-03 | 2017-05-24 | 浙江大学 | Gray scale gradient and color histogram-based image quality evaluation method |
CN107292866A (en) * | 2017-05-17 | 2017-10-24 | 浙江科技学院 | A kind of method for objectively evaluating image quality based on relative gradient |
CN108022241A (en) * | 2017-12-26 | 2018-05-11 | 东华大学 | A kind of coherence enhancing quality evaluating method towards underwater picture collection |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000278710A (en) * | 1999-03-26 | 2000-10-06 | Ricoh Co Ltd | Device for evaluating binocular stereoscopic vision picture |
JP2000276595A (en) * | 1999-03-25 | 2000-10-06 | Ricoh Co Ltd | Device and method for evaluating binocular stereoscopic image, and recording medium |
US7561732B1 (en) * | 2005-02-04 | 2009-07-14 | Hrl Laboratories, Llc | Method and apparatus for three-dimensional shape estimation using constrained disparity propagation |
CN101610425A (en) * | 2009-07-29 | 2009-12-23 | 清华大学 | A kind of method and apparatus of evaluating stereo image quality |
-
2010
- 2010-05-11 CN CN 201010169050 patent/CN101833766A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000276595A (en) * | 1999-03-25 | 2000-10-06 | Ricoh Co Ltd | Device and method for evaluating binocular stereoscopic image, and recording medium |
JP2000278710A (en) * | 1999-03-26 | 2000-10-06 | Ricoh Co Ltd | Device for evaluating binocular stereoscopic vision picture |
US7561732B1 (en) * | 2005-02-04 | 2009-07-14 | Hrl Laboratories, Llc | Method and apparatus for three-dimensional shape estimation using constrained disparity propagation |
CN101610425A (en) * | 2009-07-29 | 2009-12-23 | 清华大学 | A kind of method and apparatus of evaluating stereo image quality |
Non-Patent Citations (4)
Title |
---|
《3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video》 20090605 Jiachen Yang 等 Objective Quality Assessment Method of Stereo Images 第3节第1段,第3.1节,公式2 1 , 2 * |
《IEEE International Conference on Acoustics,Speech and Signal Processing,2009.ICCASSP 2009.》 20090526 Malpica,W.S等 Range image quality assessment by Structural Similarity 第1149-1150页第2节,公式4-6 1 , 2 * |
《天津大学学报》 20081231 杨嘉琛 等 基于PSNR立体图像质量客观评价方法 第1450页第3节,图2 1 第41卷, 第12期 2 * |
《电子学报》 20070731 杨春玲 等 基于梯度信息的图像质量评判方法的研究 第1314页右栏倒数第2段,第1314-1315页第3.1,3.2节,公式3-8 1 第35卷, 第7期 2 * |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101976444B (en) * | 2010-11-11 | 2012-02-08 | 浙江大学 | Pixel type based objective assessment method of image quality by utilizing structural similarity |
CN101976444A (en) * | 2010-11-11 | 2011-02-16 | 浙江大学 | Pixel type based objective assessment method of image quality by utilizing structural similarity |
CN102708567B (en) * | 2012-05-11 | 2014-12-10 | 宁波大学 | Visual perception-based three-dimensional image quality objective evaluation method |
CN102708567A (en) * | 2012-05-11 | 2012-10-03 | 宁波大学 | Visual perception-based three-dimensional image quality objective evaluation method |
CN102708568A (en) * | 2012-05-11 | 2012-10-03 | 宁波大学 | Stereoscopic image objective quality evaluation method on basis of structural distortion |
CN102708568B (en) * | 2012-05-11 | 2014-11-05 | 宁波大学 | Stereoscopic image objective quality evaluation method on basis of structural distortion |
CN102930528A (en) * | 2012-09-24 | 2013-02-13 | 宁波大学 | Method for objectively evaluating quality of three-dimensional image based on three-dimensional structural similarity |
CN102930528B (en) * | 2012-09-24 | 2015-10-28 | 宁波大学 | A kind of objective evaluation method for quality of stereo images based on three-dimensional structure similarity |
CN103136748A (en) * | 2013-01-21 | 2013-06-05 | 宁波大学 | Stereo-image quality objective evaluation method based on characteristic image |
CN103136748B (en) * | 2013-01-21 | 2015-10-28 | 宁波大学 | The objective evaluation method for quality of stereo images of a kind of feature based figure |
CN104112272A (en) * | 2014-07-04 | 2014-10-22 | 上海交通大学 | Semi-reference image quality assessment method based on structure reduced model |
CN104159104A (en) * | 2014-08-29 | 2014-11-19 | 电子科技大学 | Full-reference video quality evaluation method based on multi-stage gradient similarity |
CN105931257A (en) * | 2016-06-12 | 2016-09-07 | 西安电子科技大学 | SAR image quality evaluation method based on texture feature and structural similarity |
CN105931257B (en) * | 2016-06-12 | 2018-08-31 | 西安电子科技大学 | SAR image method for evaluating quality based on textural characteristics and structural similarity |
CN106530282A (en) * | 2016-10-20 | 2017-03-22 | 天津大学 | Spatial feature-based non-reference three-dimensional image quality objective assessment method |
CN106530282B (en) * | 2016-10-20 | 2019-06-14 | 天津大学 | Based on spatial feature without reference objective evaluation method for quality of stereo images |
CN106709958A (en) * | 2016-12-03 | 2017-05-24 | 浙江大学 | Gray scale gradient and color histogram-based image quality evaluation method |
CN107292866A (en) * | 2017-05-17 | 2017-10-24 | 浙江科技学院 | A kind of method for objectively evaluating image quality based on relative gradient |
CN107292866B (en) * | 2017-05-17 | 2020-04-17 | 浙江科技学院 | Image quality objective evaluation method based on relative gradient |
CN108022241A (en) * | 2017-12-26 | 2018-05-11 | 东华大学 | A kind of coherence enhancing quality evaluating method towards underwater picture collection |
CN108022241B (en) * | 2017-12-26 | 2021-05-04 | 东华大学 | Consistency enhancement quality evaluation method for underwater image set |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101833766A (en) | Stereo image objective quality evaluation algorithm based on GSSIM | |
Maalouf et al. | CYCLOP: A stereo color image quality assessment metric | |
CN101567964B (en) | Method for preprocessing noise reduction and block effect removal in low bit-rate video application | |
CN102708567B (en) | Visual perception-based three-dimensional image quality objective evaluation method | |
CN101872479B (en) | Three-dimensional image objective quality evaluation method | |
CN102404594B (en) | 2D-to-3D conversion method based on image edge information | |
CN103986925B (en) | based on the stereoscopic video visual comfort evaluation method of luminance compensation | |
CN104394403B (en) | A kind of stereoscopic video quality method for objectively evaluating towards compression artefacts | |
CN110246111B (en) | No-reference stereoscopic image quality evaluation method based on fusion image and enhanced image | |
CN105654142B (en) | Based on natural scene statistics without reference stereo image quality evaluation method | |
CN103136748B (en) | The objective evaluation method for quality of stereo images of a kind of feature based figure | |
CN102521825B (en) | Three-dimensional image quality objective evaluation method based on zero watermark | |
US9565417B2 (en) | Image processing method, image processing device, and electronic device | |
CN102750706B (en) | Depth significance-based stereopicture just noticeable difference (JND) model building method | |
CN102982535A (en) | Stereo image quality evaluation method based on peak signal to noise ratio (PSNR) and structural similarity (SSIM) | |
CN103780895B (en) | A kind of three-dimensional video quality evaluation method | |
CN104469355B (en) | Based on the prediction of notable adaptive euphoropsia and the euphoropsia Enhancement Method of nonlinear mapping | |
CN104144339B (en) | A kind of matter based on Human Perception is fallen with reference to objective evaluation method for quality of stereo images | |
CN106682599A (en) | Stereo image visual saliency extraction method based on sparse representation | |
CN103186898B (en) | Based on the image quality characterization method of image information human eye perceptible degree | |
CN104243977A (en) | Three-dimensional image quality evaluation method based on ocular dominance theory and parallax compensation | |
CN104952052A (en) | Method for enhancing EMCCD image | |
Farid et al. | Blind depth quality assessment using histogram shape analysis | |
CN105915886B (en) | A kind of depth map reasoning algorithm based on video compress domain | |
CN108924542A (en) | Based on conspicuousness and sparsity without reference three-dimensional video quality evaluation method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C12 | Rejection of a patent application after its publication | ||
RJ01 | Rejection of invention patent application after publication |
Open date: 20100915 |