CN106993183A - Comfortable brightness quantitative approach based on stereo-picture marking area - Google Patents
Comfortable brightness quantitative approach based on stereo-picture marking area Download PDFInfo
- Publication number
- CN106993183A CN106993183A CN201710192486.7A CN201710192486A CN106993183A CN 106993183 A CN106993183 A CN 106993183A CN 201710192486 A CN201710192486 A CN 201710192486A CN 106993183 A CN106993183 A CN 106993183A
- Authority
- CN
- China
- Prior art keywords
- stereo
- brightness
- picture
- notable
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention belongs to image processing field, to combine influence of the vision noticing mechanism quantitative study luminance factor to three-dimensional image-watching comfort level, the comfortable brightness matching figure and disparity map of notable stereo-picture are obtained, new foundation is provided for the making of stereo-picture.The technical solution adopted by the present invention is that the comfortable brightness quantitative approach based on stereo-picture marking area, step is as follows：1) significantly stereo-picture is obtained；2) subjective experiment：Notable stereo-picture is subjected to brightness classification conversion and subjective experiment is carried out, specifically, two borders of the stereo-picture comfortably with uncomfortable brightness are first found out with the classification of big step-length；Then with small step-length by the middle of two brightness borders brightness value refine, find out again small step-length comfortably with uncomfortable brightness border；Progress repeatedly refinement and experiment, is finally reached the minimum brightness resolution ratio of human eye, finds out comfortable and uncomfortable brightness brightness value.Present invention is mainly applied to image procossing occasion.
Description
Technical field
The invention belongs to image processing field, it is related to the Elements research that influence stereo-picture watches comfort level, especially relates to
And a kind of comfortable brightness Quantitative research method based on stereo-picture marking area.
Background technology
Stereoscopic imaging technology is fast-developing in recent years, however, viewing stereoscopic image/video can cause beholder's head for a long time
Bitterly, the discomfort such as visual fatigue.The whether comfortable viewing experience and physiological health for being related to beholder of stereoscopic image content, into
One of being badly in need of solving for stereo display technique of the task[1]。
The factor of influence stereo-picture viewing comfort level has a lot, such as brightness, colourity, contrast and parallax[2-6].It is domestic
Outer many experts and scholars are studied the various factors for influenceing stereo-picture comfort level.Frank et al. passes through experimental system
Ground have studied influence of the factors such as brightness, colourity, contrast, parallax to image comfort level, draws and is reached when left and right view is mismatched
The uncomfortable of viewing can be caused when to a certain extent[2].Cheolkon et al. is based on mankind's depth perception, has probed into stereo-picture
Influence of the parallax size of middle obvious object to image comfort level, test result indicates that, the image when parallax of obvious object is larger
With very strong third dimension, but the big parallax of obvious object also brings along uncomfortable experience[3].Li little Fang points out stereogram
Brightness and color distortion as left and right view cross conference and cause beholder's visual fatigue[4].Document[7-9]Using the side of quantitative study
Method, colourity, brightness, the comfort standard of contrast from the angle quantitative study of stereo-picture entire image.
Typically, since observation of the human visual system to image is from bottom to top, it is impossible to while by view picture figure
Content is observed simultaneously, but only focuses on most attractive place in image.Therefore, stereo-picture marking area is comfortable bright
Degree scope can reflect the overall comfortable situation of stereo-picture.
The content of the invention
To overcome the deficiencies in the prior art, it is contemplated that with reference to vision noticing mechanism quantitative study luminance factor to solid
The influence of image-watching comfort level, obtains the comfortable brightness matching figure and disparity map of notable stereo-picture, is the system of stereo-picture
Make to provide new foundation.The technical solution adopted by the present invention is, the comfortable brightness quantitative approach based on stereo-picture marking area,
Step is as follows：
1) significantly stereo-picture is obtained：Notable stereogram is finally obtained by stereo image parallax figure and plane notable figure
Picture；
2) subjective experiment：Notable stereo-picture is subjected to brightness classification conversion and subjective experiment is carried out, specifically, first with big
Two borders of the stereo-picture comfortably with uncomfortable brightness are found out in step-length classification；Then with small step-length by the middle of two brightness borders
Brightness value refinement, find out again small step-length comfortably with uncomfortable brightness border；Repeatedly refinement and experiment are carried out, is finally reached
The minimum brightness resolution ratio of human eye, finds out comfortable and uncomfortable brightness brightness value.
Plane notable figure is calculated by brightness, colourity, contrast and the spatial frequency of image in itself, specifically using base
Right viewpoint plane notable figure is obtained in the vision significance algorithm GBVS of collection of illustrative plates, SM is designated asR(x, y), (x, y) represents that right viewpoint is put down
The pixel coordinate of face notable figure；Use Fast Stereo Matching Algorithm to obtain the disparity map on the basis of right viewpoint, be designated as dR(x,
y)；
By SMR(x, y) and dR(x, y) weighted sum obtains three-dimensional notable figure, such as formula (1)：
S (x, y)=ω1dR(x,y)+ω2SMR(x,y) (1)
Wherein ω1、ω2For coefficient, and ω1+ω2=1；
Obtained three-dimensional notable figure is 0-255 gray level images, and the gray value size of pixel represents the picture of this in original image
The saliency value of pixel is scattered, it is necessary to pixel in three-dimensional notable figure S (x, y) obtained by the saliency value of vegetarian refreshments, three-dimensional notable figure
Carry out significantly with non-significant pixel classifications, using maximum between-cluster variance method determine solid notable figure S (x, y) threshold value T, pass through
The threshold value obtains the three-dimensional notable figure of binaryzation, i.e. mask images MR(x, y), such as formula (2)：
For a bit (x, y) of three-dimensional notable figure S (x, y), if the value of the pixel is more than threshold value T, the pixel is returned
It is on the contrary then be non-significant region for marking area, finally by mask images MR(x, y) is multiplied with original visual point image to be obtained significantly
Stereogram.
Using approximatioss step by step, step-length is approached into series and is divided into 3, three-dimensional brightness of image carried out using three-level step-length linear
Conversion.
Further specifically, stereo-picture is handled using MATLAB in subjective experiment, process step is as follows：
A. source stereo-picture is chosen, three-dimensional notable figure is obtained and finally gives mask images；
B. stereo-picture is subjected to color notation conversion space, YUV color spaces is transformed into by rgb space, image are extracted bright
Y is spent, the mask images in a determine the notable and non-significant part of image, and marking area is corresponding in the stereo-picture of source
Pixel, non-significant part is covered with gray scale for 128 image；
C. the progress linear transformation of first order step-length is pressed to the signal portion of left and right viewpoint in notable stereoscopic gray scale image, each got
To 9 width one-levels or so gray scale view, the notable stereoscopic gray scale image of 81 width can be obtained after combination of two；
D. subjective scoring is carried out, invalid scoring is removed, statistics scoring is chosenStereoscopic gray scale image；
E. the minimum and maximum gray value of satisfactory left and right gray scale view after one-level grey scale change is recorded respectively
n2l max、n2l min、n2r max、n2r min；
H. the progress linear transformation of third level step-length is pressed to the signal portion of left and right view in notable stereoscopic gray scale image, each got
To 10 width images, combination of two can obtain 100 three level stereo images altogether, and repetitive process d carries out subjective experiment；
I. the minimum and maximum gray value of satisfactory left and right gray scale view after three-level grey scale change is recorded respectively
n3l max、n3l min、n3r max、n3r min。
The features of the present invention and beneficial effect are：
Document[7]Influence of the quantitative study luminance factor to visual comfort in the case where not accounting for vision significance,
Curve such as Figure 11 is shown in solid.Dotted line in Figure 11 represents result of the present invention.As can be seen that the brightness range that actual situation line is surrounded
Basically identical, the comfort level of view picture stereo-picture can be represented by illustrating the comfort level of marking area, consistent with theory.Two results
Except that the present invention minimum brightness not since 0 ing because when brightness be 0 or too low when, now image be it is completely black or
Brightness is too low, does not see the particular content shown by image, and the comfortable score of the image of measurement is too low.Result of the present invention is more accorded with
Close the visual experience of human eye.
Brief description of the drawings：
The acquisition methods of the notable stereo-pictures of Fig. 1.
The notable stereograms of Fig. 2 extract figure.
Fig. 3 eye trackers test notable thermal map.
The notable stereo-pictures of Fig. 4.In figure,
Fig. 5 brightness of image three-level step-lengths are approached.
The width source stereo-pictures of Fig. 64.
The comfortable brightness matching figure of tetra- groups of stereo-pictures of Fig. 7.
The comfortable luminance difference figure of tetra- groups of stereo-pictures of Fig. 8.
The comfortable brightness matching figure of Fig. 9 stereo-pictures.
The comfortable luminance difference figure of Figure 10 stereo-pictures.
Figure 11 this paper experimental results and document [7] comparative result figure.
Embodiment
It is contemplated that the influence with reference to vision noticing mechanism quantitative study luminance factor to three-dimensional image-watching comfort level.
The mode being combined by using disparity map and plane image saliency map obtains notable stereo-picture；Then using it is improved step by step
Approximatioss carries out subjective experiment, and experimental data is fitted by least square method, the comfortable bright of notable stereo-picture is obtained
Degree matching figure and disparity map, new foundation is provided for the making of stereo-picture.
Vision noticing mechanism quantitative study luminance factor is combined to three-dimensional image-watching comfort level the invention provides one kind
Method.The present invention proposes a kind of stereo-picture marking area extraction algorithm, and it is subjective finally to obtain notable stereo-picture progress
Experiment, carries out subjective experiment using improved approximatioss step by step, experimental data is fitted by least square method, shown
Write the comfortable brightness matching figure and disparity map of stereo-picture.
Basic step is as follows：
1) significantly stereo-picture is obtained.Visual salient region is obtained by algorithm, and obtains notable stereo-picture；
2) subjective experiment.Notable stereo-picture is subjected to brightness classification conversion and subjective experiment is carried out；
Detailed analysis will be carried out to each step below：
The acquisition of 1 notable stereo-picture
According to the stereoscopic vision attention characteristic of human eye, observer can be more paid close attention to the content of marking area in image[14],
It is therefore possible to use the comfort level of significantly stereo-picture reflects the comfort level situation of view picture stereo-picture.Stereo-picture is regarded
Poor characteristic and image space frequency can all influence visual comfort[15].Therefore, stereo image parallax figure and plane notable figure are passed through
Finally obtain notable stereo-picture.Fig. 1 provides the acquisition methods of notable stereo-picture.
The factors such as brightness, colourity, contrast and spatial frequency of the plane notable figure by image in itself are calculated.This hair
Bright use GBVS algorithms[16]Right viewpoint plane notable figure is obtained, SM is designated asR(x,y).Using Fast Stereo Matching Algorithm[17]Obtain
Disparity map on the basis of right viewpoint, is designated as dR(x,y)。
By SMR(x, y) and dR(x, y) weighted sum obtains three-dimensional notable figure, such as formula (1)：
S (x, y)=ω1dR(x,y)+ω2SMR(x,y) (1)
Wherein ω1+ω2=1, the present invention in ω1=ω2=0.5[18]。
Obtained three-dimensional notable figure is 0-255 gray level images, and the gray value size of pixel represents the picture of this in original image
The saliency value of pixel is disperseed obtained by the saliency value of vegetarian refreshments, three-dimensional notable figure, for pixel in more specific determination stereo-picture
Point whether be significant point, it is necessary to pixel in three-dimensional notable figure S (x, y) is carried out significantly with non-significant pixel classifications.Using most
Variance Method determines solid notable figure S (x, y) threshold value T between major class, the three-dimensional notable figure of binaryzation is obtained by the threshold value, i.e.,
Mask images MR(x,y)[15], such as formula (2)：
For a bit (x, y) of three-dimensional notable figure S (x, y), if the value of the pixel is more than threshold value T, the pixel is returned
It is on the contrary then be non-significant region for marking area.Finally by mask images MR(x, y) is multiplied with original visual point image to be obtained significantly
Stereogram.In order to verify whether gained significantly stereo-picture is true value, and the present invention is using eye tracker to the notable of source stereo-picture
Region carries out subjective measurement.Calibration experiments and reference measurement are first carried out before experiment every time, when sight of the subject to calibration datum mark
Survey when error is less than 1 degree and tested.Presented at random per pictures and the time is presented for 5s.Fig. 3 is the figure that eye tracker is measured
As the thermal map of area-of-interest.
The different gray scales marked in Fig. 3 represent that the degree of subject's concern is different：Seen for subject in the region of white marking
See that the time is most long, be also part the most significant；Grey mark part represents more important, and subject is in an experiment to this part
It is more interested；Dark signs part represents that significance level is relatively low, but subject is also carried out to dark signs part in an experiment
Concern；Unmarked part represents that subject pays close attention to little or no concern within the experimental stage to this part, represents non-significant
Region.
Discovery, algorithm proposed by the present invention are contrasted by the three-dimensional notable figure that Fig. 3 eye trackers are tested to notable thermal map and Fig. 2
The three-dimensional marking area of acquisition and the result of subjective experiment are basically identical, show that this method can be good at extracting stereo-picture
Marking area, and have very strong uniformity with the conclusion of subjective experiment.
2 subjective experiments
The gradation of image grade that human vision can be differentiated is about 26, so to the gray level image that tonal gradation is 256, the mankind
The vision minimum brightness that average energy is differentiated in this tonal gradation is 4[13].If being that step-length is entered to stereo-picture or so viewpoint with 4
The processing that row brightness strengthens and reduced, can respectively be obtained after the left and right view after 128 width brightness change, left and right view combination of two
Stereoscopic gray scale image, which can be obtained, 16384 width, and stereo-picture is excessive, carries out subjective experiment bothersome laborious.
Therefore the present invention uses approximatioss step by step from coarse to fine[7]Data processing is carried out, the central idea of this method is first
Two borders of the stereo-picture comfortably with uncomfortable brightness are found out with the classification of big step-length；Then with small step-length by two brightness borders
Middle brightness value refinement, find out again small step-length comfortably with uncomfortable brightness border；Repeatedly refinement and experiment are carried out, finally
The minimum brightness resolution ratio of human eye is reached, comfortable and uncomfortable brightness brightness value is found out.
Using approximatioss step by step, step-length is approached into series and is divided into 3[7].Line is entered to three-dimensional brightness of image using three-level step-length
Property conversion.
Experiment handles stereo-picture using MATLAB2014b, and process step is as follows：
A. source stereo-picture is chosen, three-dimensional notable figure is obtained and finally gives mask images.
B. stereo-picture is subjected to color notation conversion space, YUV color spaces is transformed into by rgb space, image are extracted bright
Spend Y.Mask images in a determine the notable and non-significant part of image.Marking area is corresponding in the stereo-picture of source
Pixel, non-significant part is covered with gray scale for 128 image, as shown in Figure 4：
C. the signal portion of left and right viewpoint in notable stereoscopic gray scale image is carried out by first order step-length by Fig. 5 (1) linear
Conversion, respectively obtains that the notable stereoscopic gray scale image of 81 width can be obtained after 9 width one-levels or so gray scale view, combination of two.
D. subjective scoring is carried out, invalid scoring is removed, statistics scoring is chosenStereoscopic gray scale image.
E. the minimum and maximum gray value of satisfactory left and right gray scale view after one-level grey scale change is recorded respectively
n2l max、n2l min、n2r max、n2r min。
H. Fig. 5 (3) is linearly become to the signal portion of left and right view in notable stereoscopic gray scale image by third level step-length
Change, respectively obtain 10 width images, combination of two can obtain 100 three level stereo images altogether, and repetitive process d carries out subjective experiment.
I. the minimum and maximum gray value of satisfactory left and right gray scale view after three-level grey scale change is recorded respectively
n3l max、n3l min、n3r max、n3r min。
The stereoscopic image data storehouse that experiment is provided from advanced science and technology institutes of South Korea is used as stereo-picture sample data
Set[10].The image library includes polytype image (mankind, trees, building etc.), is 1920x1080 by 120 pairs of resolution ratio
Stereo-picture composition, including 62 pairs of indoor scenes and 58 width outdoor scenes.The present invention chooses its four width source stereo-picture
Pingpang, Camera, Kid and Pipe scheme as experiment, as shown in Figure 6.The third dimension of this 4 width stereo-picture is strong, has very
Good visual comfort.Three-dimensional display uses 22 inches of polarization type 3D three-dimensional displays of AOC (AOC) company, and eye tracker is moral
The iView X RED of SMI companies of state.
The normal subject of binocular vision physiology totally 22 people, the wherein people of male 12, the people of women 10 are chosen in experiment；There is the three-dimensional back of the body
8 people of scape, 14 people without stereo background, and subject's dominant eye is all right eye.
To avoid the subjective evaluation result of stray light subject, experiment need to be carried out in darkroom[5].For 22 inches
Full HD display, viewing distance should be the three times distance of screen height[11]。
Subjective assessment is the important evidence for testing quantitative study.Before experiment, the method for first introducing subject experimental evaluation
And grading system, the comfort level 10 width stereo-pictures training subject different with scene is then chosen, enables subject correct
Understanding judge, every time test be no more than 30 minutes[12].Test is using double stimulating methods, in experiment, if same subject is to same
When one stereo-picture provides the scoring for differing 2 grades or the above, this score value is considered as invalid scoring.It is vertical according to ITU-R BT.1438
Criterion is recommended in the subjective assessment of body image, and the easypro appropriateness of stereo-picture is divided into 5 grades, as shown in table 1.Subject is allowed to provide half
The score value divided, the effective grade average of the good stereo-picture of comfort level[11]。
The stereo-picture comfort level subjective assessment grade of table 1
With reference to technical scheme process in detail：
First, the acquisition of notable stereo-picture
According to the stereoscopic vision attention characteristic of human eye, observer can be more paid close attention to the content of marking area in image.Cause
This, can reflect the comfort level situation of view picture stereo-picture using the comfort level of notable stereo-picture.The parallax of stereo-picture
Characteristic and image space frequency can all influence visual comfort.Therefore, it is final by stereo image parallax figure and plane notable figure
Obtain notable stereo-picture.
In order to verify whether gained significantly stereo-picture is true value, and the present invention is using eye tracker to the notable of source stereo-picture
Region carries out subjective measurement.It is consistent with subjective value to the marking area obtained by verification algorithm, test result indicates that the present invention is calculated
The three-dimensional marking area and the result of subjective experiment that method is obtained are basically identical, show that this method can be good at extracting stereo-picture
Marking area, and have very strong uniformity with the conclusion of subjective experiment.
2nd, subjective experiment
The present invention uses approximatioss step by step from coarse to fine[7]Data processing is carried out, the central idea of this method is first with big
Two borders of the stereo-picture comfortably with uncomfortable brightness are found out in step-length classification；Then with small step-length by the middle of two brightness borders
Brightness value refinement, find out again small step-length comfortably with uncomfortable brightness border；Repeatedly refinement and experiment are carried out, is finally reached
The minimum brightness resolution ratio of human eye, finds out comfortable and uncomfortable brightness brightness value.
281 width stereoscopic gray scale images are obtained using three-level step-length approximatioss, it is vertical much smaller than what the method for limits in theory was obtained
Body gray level image quantity, greatly reduces the quantity of experiment, and can obtain good experimental result.
3rd, analysis of experimental data
Experimental data is handled using least square sectional linear fitting[19], its basic thought is by surveyed number
Approached according to the straight line with segmentation to obtain corresponding mathematical modeling, and the fitting of straightway still uses least square method.Fortune
4 groups of experimental datas are handled with least square method, 4 width different brightness matching figure and luminance difference figure is obtained, such as Fig. 7-
Figure 10.
Fig. 7 is the comfortable brightness matching figure of four groups of stereo-pictures, and abscissa is the mean flow rate of left view point marking area, indulges and sits
It is designated as the average brightness value of right viewpoint marking area.Region representation of segmented linear encirclement or so view marking area is flat in figure
Equal brightness.In this scope, comfort level is good after stereo-picture imaging.Fig. 8 is the comfortable luminance difference figure of four groups of stereo-pictures, table
Show when stereo-picture comfort level is good, the difference range of right viewpoint marking area brightness and left view point marking area brightness, water
Flat axle
(crossing longitudinal axis zero point horizontal line) represents that left and right viewpoint marking area brightness is identical.Represent that right viewpoint shows above trunnion axis
Write region bigger than the brightness of left view point marking area, represent right viewpoint marking area than left view point marking area brightness below trunnion axis
It is low.
In order that the solution of the present invention has universality, to four groups of comfortable brightness matchings of stereo-picture shown in Fig. 7, Fig. 8
The experimental data of figure and disparity map is averaged, and respectively obtains the comfortable brightness matching figure of stereo-picture and disparity map, such as Fig. 9, figure
Shown in 10.Fig. 9 and Figure 10 cathetus enclosing regions are divided into R1、R2、R3、R4Four parts：
a.R1、R2、R3、R4Scored for stereo-picture four partsBrightness zone of comfort, when the notable area of left and right viewpoint
The mean flow rate in domain is in this scope, and binocular image can be good at fusion, with good viewing comfortableness；Surrounded in straight line
Outside region, because the brightness of left and right viewpoint marking area has big difference, eyes can not be merged well, be watched uncomfortable.
B. in R1Region, brightness is too low.People has certain threshold value when watching image for crossing the patience of low-light level, when
When brightness of image is less than threshold value, beholder feels obvious discomfort in viewing.The minimum brightness threshold value of left eye is 35.3, right
The luminance threshold of eye is 44.3.And it is also smaller in the luminance difference that low brightness area eyes can be merged.
C. with the increase of left and right viewpoint marking area brightness, the fusion limit of eyes gradually increases, in R2Region, with
The increase of left eye brightness, right eye can compare R for the fusion limit of dark image1When it is low, this be due to left view point more become clear,
Even if right viewpoint be not it is very bright can also be fused into the suitable image of brightness in the brain, it is and comfortable with good viewing
Degree.
D. in region R3, the brightness continuation increase of image, the susceptibility that people changes to brightness is compared with R2Weaken, so in the area
Domain or so view fusion limit difference continues to increase.
E. as brightness increases to certain limit, the stimulation of high brightness can make one not feeling well.As left view point brightness increases
Plus, the luminance adaptation scope of right viewpoint is gradually reduced, and is finally retracted to a high-high brightness extreme value.
Fig. 9 diagonal is asymmetric, and Figure 10 trunnion axis is also asymmetric.This be primarily due to people perceive things when or so
Eye difference.Trunnion axis first half area is less than the area of lower half in Figure 10, because it is dominant eye that subject, which is right eye,
Dominant eye has inhibitory action to auxiliary eye, therefore the brightness of right view is too many not above left view, but right viewpoint brightness can be than a left side
Viewpoint is much lower, and this phenomenon becomes apparent afterwards to a certain extent in brightness of image increase.
3rd, result verification
Document [7] shadow of quantitative study luminance factor to visual comfort in the case where not accounting for vision significance
Ring, curve such as Figure 11 is shown in solid.Dotted line in Figure 11 represents result of the present invention.As can be seen that the brightness that actual situation line is surrounded
Scope is basically identical, illustrates the comfort level of marking area and can represent the comfort level of view picture stereo-picture, consistent with theory.Two
As a result except that the minimum brightness of the present invention is not since 0, because when brightness is 0 or too low, now image is complete
Black or brightness is too low, does not see the particular content shown by image, and the comfortable score of the image of measurement is too low.Result of the present invention is more
Plus meet the visual experience of human eye.
Bibliography
[1]Lambooij M,IJsselsteijn W,Heynderickx I.Stereoscopic displays and
visual comfort:a review[J].Einhoven Uni-versity of Technology Einhoven
University of Technology Philips Research,SPIE Newsroom2April,2007.
[2]Kooi,Frank L.,and Alexander Toet."Visual comfort of binocular and
3D displays."Displays 25.2(2004):99-108.
[3]Jung C,Wang S.Visual comfort assessment in stereoscopic 3D images
using salient object disparity[J].Electronics Letters,2014,51(6):482-484.
[4]Li Xiao-fang,WANG Qiong-hua,LI DA-hai,et al.Research on relation
between the range of binocular par-allax and cisual fatigue in 3D display
based on lenticulation lens[J].Chinese Journal of Liquid Crystals and Dis-
plays,2008,04:464-467.
Li little Fang, Wang Qionghua, Li great Hai, Wang Aihong, Deng Huan auto-stereoscopic displays watch visual fatigue [J] liquid crystal with showing
Show, 2008,04:464-467.
[5]Seuntiens P.Visual experience of 3D TV[J].Doctor doc-toral thesis,
Eindhoven University of Technology,2006.
[6]Kooi F L,Toet A.Visual comfort of binocular and 3D dis-plays[J]
.Displays,2004,25(2):99-108.
[7]ZANG Yan-jun,Li-Su-mei,Wei jin-jin,et al.Measurement of the range
of the brightness parameter influencing the comfort of stereoscopic images
[J].Electronic Measure-ment Technology,2012,35(2):59-64.
The brightness range of the beautiful influences stereo-picture comfort level of Zang Yanjun, Li Sumei, Wei Jinjin, Liu Wen determines [J] electronics
E measurement technology, 2012,02:59-64.
[8]LIU Chang,Li-Su-mei,ZHU Dan,ZANG Yan-jun.Quanti-tative research of
the hue parameter influence on the visual comfort of stereoscopic images[J]
.Journal of Optoelec-tronics Laser,2014,01:178-185.
Quantitative study [J] the light of Liu Chang, Li Sumei, Zhu Dan, Zang Yan army colourities to three-dimensional image vision comfort degree
Electronics laser, 2014,01:178-185.
[9]Li Su-mei,FU Bei-Bei,ZANG Yan-jun,et al.Measure-ment of the range
of saturation parameter influencing the comfort of stereoscopic images[J]
.Journal of Tianjin Uni-versity,2012,45(8):669-676.
Measure [J] the Tianjin of the saturation degree scope of the such as Li Sumei, Fu Beibei, Zang Yanjun influence stereo-picture comfort levels is big
Learn journal, 2012,45 (8):669-676.
[10]IVY Lab stereoscopic image database[OL].[2013-03-12].http://
ivylab.kaist.ac.kr/demo/3DVCA/3DVCA.htm.
[11]Rec.ITU-R BT.1438.Subjective assessment of stereosc-opic
television pictures[S].2000,1-14.
[12]The State Administration of Radio Film and Television.GB/T7401-
1987,Method of subjective assessment of qual-ity of color TV pictures[S]
.Beijing:China Standards Press,1987,36-38.
State Administration of Radio, Film and Television .GB/T7401-1087, colour TV picture quality subjective evaluation method [S] Beijing：
China Standards Press, 1987,36-38.
[13]Tian Jiehua,Gu Xiaodong,Wang Yuanyuan.Low bit rate image
compression using human visual characteristics[J].Chinese Journal of
scientific instrument,2010,11:2515-2520.
Tian Jiehua, Gu Xiaodong, Wang Yuanyuan utilize low bit rate Wavelet Image Compression [J] instrument instrument of human-eye visual characteristic
Table journal, 2010,11:2515-2520.
[14]Wang Fei.Visual saliency detection based on context and
background[D].Dalian University of Technology,2013.
Wang Fei are based on context and the vision significance of background detection [D] Dalian University of Technology, 2013.
[15]Jiang Qiuping,Shao Feng,Yu Mei,et al.An Objective Stereoscopic
Image Visual Comfort Assessment Metric Based on Visual Important Regions[J]
.Chinese Journal of electronics and information technology,2014,(04):875-881.
Jiang Qiuping, Shao Feng, Jiang Gangyi, Yu Mei, Peng Zong lift the stereo image vision comfort level visitor of view-based access control model important areas
See evaluation method [J] electronics and information journal, 2014, (04):875-881.
[16]Harel,Jonathan,Christof Koch,and Pietro Perona."Graph-based
visual saliency."Advances in neural infor-mation processing systems.2006.
[17]Rhemann C,Hosni A,Bleyer M,et al.Fast cost-volume filtering for
visual correspondence and beyond[C].Computer Vision and Pattern Recognition
(CVPR),2011IEEE Conference on.IEEE,2011:3017-3024.
[18]Wang J,Da Silva M P,Le Callet P,et al.Computational model of
stereoscopic 3D visual saliency[J].IEEE Trans-actions on Image Processing,
2013,22(6):2151-2165.
[19]Xie Youbao.Least square piecewise linear fitting[J].modern
electric power,1992,01:19-25.
Thank friendly treasured Sectional Line Fitting by means of Least Sequence Method [J] modern electrics, 1992,01:19-25.
Claims (4)
1. a kind of comfortable brightness quantitative approach based on stereo-picture marking area, it is characterized in that, step is as follows：
1) significantly stereo-picture is obtained：Notable stereo-picture is finally obtained by stereo image parallax figure and plane notable figure；
2) subjective experiment：Notable stereo-picture is subjected to brightness classification conversion and subjective experiment is carried out, specifically, first with big step-length
Two borders of the stereo-picture comfortably with uncomfortable brightness are found out in classification；Then will be bright in the middle of two brightness borders with small step-length
Angle value refine, find out again small step-length comfortably with uncomfortable brightness border；Repeatedly refinement and experiment are carried out, human eye is finally reached
Minimum brightness resolution ratio, find out comfortable with uncomfortable brightness brightness value.
2. the comfortable brightness quantitative approach as claimed in claim 1 based on stereo-picture marking area, it is characterized in that, plane shows
Work figure is calculated by brightness, colourity, contrast and the spatial frequency of image in itself, specific to be shown using the vision based on collection of illustrative plates
Work property algorithm GBVS obtains right viewpoint plane notable figure, is designated as SMR(x, y), (x, y) represents the pixel of right viewpoint plane notable figure
Coordinate；Use Fast Stereo Matching Algorithm to obtain the disparity map on the basis of right viewpoint, be designated as dR(x,y)；
By SMR(x, y) and dR(x, y) weighted sum obtains three-dimensional notable figure, such as formula (1)：
S (x, y)=ω1dR(x,y)+ω2SMR(x,y) (1)
Wherein ω1、ω2For coefficient, and ω1+ω2=1；
Obtained three-dimensional notable figure is 0-255 gray level images, and the gray value size of pixel represents the pixel of this in original image
Saliency value, the saliency value of pixel is scattered, it is necessary to be carried out to pixel in three-dimensional notable figure S (x, y) obtained by three-dimensional notable figure
Significantly with non-significant pixel classifications, solid notable figure S (x, y) threshold value T is determined using maximum between-cluster variance method, passes through the threshold
It is worth to the three-dimensional notable figure of binaryzation, i.e. mask images MR(x, y), such as formula (2)：
For a bit (x, y) of three-dimensional notable figure S (x, y), if the value of the pixel is more than threshold value T, the pixel is classified as showing
Write region, it is on the contrary then be non-significant region, finally by mask images MR(x, y) is multiplied with original visual point image obtains notable solid
Figure.
3. the comfortable brightness quantitative approach based on stereo-picture marking area as claimed in claim 1, it is characterized in that, using by
Level approximatioss, approaches series by step-length and is divided into 3, and linear transformation is carried out to three-dimensional brightness of image using three-level step-length.
4. the comfortable brightness quantitative approach as claimed in claim 1 based on stereo-picture marking area, it is characterized in that, further
Specifically, stereo-picture is handled using MATLAB in subjective experiment, process step is as follows：
A. source stereo-picture is chosen, three-dimensional notable figure is obtained and finally gives mask images；
B. stereo-picture is subjected to color notation conversion space, YUV color spaces is transformed into by rgb space, extract brightness of image Y,
Mask images in a determine the notable and non-significant part of image, and marking area is corresponding pixel in the stereo-picture of source,
Non-significant part is covered with gray scale for 128 image；
C. the progress linear transformation of first order step-length is pressed to the signal portion of left and right viewpoint in notable stereoscopic gray scale image, respectively obtains 9
The notable stereoscopic gray scale image of 81 width can be obtained after width one-level or so gray scale view, combination of two；
D. subjective scoring is carried out, invalid scoring is removed, statistics scoring is chosenStereoscopic gray scale image；
E. the minimum and maximum gray value n2 of satisfactory left and right gray scale view after one-level grey scale change is recorded respectivelylmax、
n2lmin、n2rmax、n2rmin；
H. the progress linear transformation of third level step-length is pressed to the signal portion of left and right view in notable stereoscopic gray scale image, respectively obtains 10
Width image, combination of two can obtain 100 three level stereo images altogether, and repetitive process d carries out subjective experiment；
I. the minimum and maximum gray value n3 of satisfactory left and right gray scale view after three-level grey scale change is recorded respectivelylmax、
n3lmin、n3rmax、n3rmin。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710192486.7A CN106993183A (en) | 2017-03-28 | 2017-03-28 | Comfortable brightness quantitative approach based on stereo-picture marking area |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710192486.7A CN106993183A (en) | 2017-03-28 | 2017-03-28 | Comfortable brightness quantitative approach based on stereo-picture marking area |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106993183A true CN106993183A (en) | 2017-07-28 |
Family
ID=59412290
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710192486.7A Pending CN106993183A (en) | 2017-03-28 | 2017-03-28 | Comfortable brightness quantitative approach based on stereo-picture marking area |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106993183A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107564044A (en) * | 2017-07-14 | 2018-01-09 | 天津大学 | The Stereo Matching Algorithm of adaptive weighting polymerization based on parallax information |
| CN107680076A (en) * | 2017-08-23 | 2018-02-09 | 天津大学 | Stereo-picture comfort level contrast range measuring method based on salient region |
| CN114972124A (en) * | 2022-07-29 | 2022-08-30 | 自然资源部第三地理信息制图院 | Remote sensing image brightness self-adaptive equalization method and system |
| CN117975907A (en) * | 2024-04-01 | 2024-05-03 | 昇显微电子(苏州)股份有限公司 | Method and device for improving low-brightness Demura effect |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102497565A (en) * | 2011-12-05 | 2012-06-13 | 天津大学 | Method for measuring brightness range influencing comfort degree of stereoscopic image |
| CN102595187A (en) * | 2012-02-27 | 2012-07-18 | 天津大学 | Method for testing chromaticity range capable of influencing stereo image comfort level |
| CN103096122A (en) * | 2013-01-24 | 2013-05-08 | 上海交通大学 | Stereoscopic vision comfort level evaluation method based on motion features inside area of interest |
| CN103139598A (en) * | 2013-03-14 | 2013-06-05 | 天津大学 | Measuring method of normalization contrast ranges affecting comfort levels of three-dimensional pictures |
| CN103347196A (en) * | 2013-06-27 | 2013-10-09 | 宁波大学 | Method for evaluating stereo image vision comfort level based on machine learning |
| CN103581661A (en) * | 2013-10-28 | 2014-02-12 | 宁波大学 | Method for evaluating visual comfort degree of three-dimensional image |
-
2017
- 2017-03-28 CN CN201710192486.7A patent/CN106993183A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102497565A (en) * | 2011-12-05 | 2012-06-13 | 天津大学 | Method for measuring brightness range influencing comfort degree of stereoscopic image |
| CN102595187A (en) * | 2012-02-27 | 2012-07-18 | 天津大学 | Method for testing chromaticity range capable of influencing stereo image comfort level |
| CN103096122A (en) * | 2013-01-24 | 2013-05-08 | 上海交通大学 | Stereoscopic vision comfort level evaluation method based on motion features inside area of interest |
| CN103139598A (en) * | 2013-03-14 | 2013-06-05 | 天津大学 | Measuring method of normalization contrast ranges affecting comfort levels of three-dimensional pictures |
| CN103347196A (en) * | 2013-06-27 | 2013-10-09 | 宁波大学 | Method for evaluating stereo image vision comfort level based on machine learning |
| CN103581661A (en) * | 2013-10-28 | 2014-02-12 | 宁波大学 | Method for evaluating visual comfort degree of three-dimensional image |
Non-Patent Citations (1)
| Title |
|---|
| CHEOLKON JUNG 等: "Visual comfort assessment for stereoscopic 3D images based on salient discomfort regions", 《2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP)》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107564044A (en) * | 2017-07-14 | 2018-01-09 | 天津大学 | The Stereo Matching Algorithm of adaptive weighting polymerization based on parallax information |
| CN107564044B (en) * | 2017-07-14 | 2020-08-14 | 天津大学 | Stereo matching method based on parallax information and adaptive weight aggregation |
| CN107680076A (en) * | 2017-08-23 | 2018-02-09 | 天津大学 | Stereo-picture comfort level contrast range measuring method based on salient region |
| CN114972124A (en) * | 2022-07-29 | 2022-08-30 | 自然资源部第三地理信息制图院 | Remote sensing image brightness self-adaptive equalization method and system |
| CN117975907A (en) * | 2024-04-01 | 2024-05-03 | 昇显微电子(苏州)股份有限公司 | Method and device for improving low-brightness Demura effect |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105959684B (en) | Stereo image quality evaluation method based on binocular fusion | |
| Hadizadeh et al. | Eye-tracking database for a set of standard video sequences | |
| CN102881010B (en) | Method for evaluating perception sharpness of fused image based on human visual characteristics | |
| CN106993183A (en) | Comfortable brightness quantitative approach based on stereo-picture marking area | |
| Choi et al. | Visual fatigue modeling and analysis for stereoscopic video | |
| CN109754377A (en) | A kind of more exposure image fusion methods | |
| CN102497565B (en) | Method for measuring brightness range influencing comfort degree of stereoscopic image | |
| CN103780895B (en) | A kind of three-dimensional video quality evaluation method | |
| CN107194927A (en) | The measuring method of stereo-picture comfort level chromaticity range based on salient region | |
| CN108449596A (en) | A kind of 3D stereo image quality appraisal procedures of fusion aesthetics and comfort level | |
| CN104509087A (en) | Binocular visual experience enrichment system | |
| Huang et al. | Light field image quality assessment: An overview | |
| CN103139598B (en) | Measuring method of normalization contrast ranges affecting comfort levels of three-dimensional pictures | |
| CN111292279A (en) | Polarization image visualization method based on color image fusion | |
| CN107680076A (en) | Stereo-picture comfort level contrast range measuring method based on salient region | |
| Hachicha et al. | Combining depth information and local edge detection for stereo image enhancement | |
| Chen et al. | Visual comfort modeling for disparity in 3D contents based on Weber–Fechner's Law | |
| Kim et al. | Quality assessment of perceptual crosstalk on two-view auto-stereoscopic displays | |
| CN110728630A (en) | Internet image processing method based on augmented reality and augmented reality glasses | |
| CN105208369B (en) | Method for enhancing visual comfort of stereoscopic image | |
| Seitner et al. | Trifocal system for high-quality inter-camera mapping and virtual view synthesis | |
| CN106028025B (en) | A kind of 3D video comfort degree evaluation methods for influx and regulation uniformity | |
| CN110060291B (en) | Three-dimensional apparent distance resolving method considering human factors | |
| CN109151432B (en) | A kind of stereo-picture color and depth edit methods | |
| Sun et al. | Visual discomfort factor analysis and modeling for worldwide stereoscopic 3D maps |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170728 |