CN107155105B - A kind of three-dimensional video-frequency Comfort Evaluation method and device - Google Patents
A kind of three-dimensional video-frequency Comfort Evaluation method and device Download PDFInfo
- Publication number
- CN107155105B CN107155105B CN201710203858.1A CN201710203858A CN107155105B CN 107155105 B CN107155105 B CN 107155105B CN 201710203858 A CN201710203858 A CN 201710203858A CN 107155105 B CN107155105 B CN 107155105B
- Authority
- CN
- China
- Prior art keywords
- frequency range
- video frame
- frame
- stereopsis frequency
- parallax
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/144—Processing image signals for flicker reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Image Analysis (AREA)
- Controls And Circuits For Display Device (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Studio Devices (AREA)
Abstract
This application discloses a kind of three-dimensional video-frequency Comfort Evaluation method and devices.This method comprises: obtaining the video frame of stereopsis frequency range；Extract the Spatial characteristic and time domain specification of the video frame of the stereopsis frequency range；According to the Spatial characteristic and time domain specification of the video frame of the stereopsis frequency range, the viewing comfort level of the stereopsis frequency range is determined.It can be achieved to evaluate the comfort level of three-dimensional video-frequency using the present invention.
Description
Technical field
The present invention relates to the video technique of the communications field more particularly to a kind of three-dimensional video-frequency Comfort Evaluation method and dresses
It sets.
Background technique
Usually there are two video channels for three-dimensional video-frequency, can make right and left eyes that two width be respectively seen using anaglyph spectacles different
Picture, the point (on the screen) and Binocular vison congruence accumulation (before or after screen) for making eye focus not in one plane, thus
Generate the 3D picture with certain depth of field.When this 3D display technology based on binocular parallax principle and people normally watch object,
The physiological status for focusing and converging on a point is different, therefore will lead to visual fatigue for a long time.
The comfort of three-dimensional video-frequency is one of the main problem for influencing three-dimensional video-frequency development, improves three-dimensional video-frequency viewing and relaxes
The premise of appropriateness is to evaluate the comfort level of three-dimensional video-frequency.
Summary of the invention
The embodiment of the invention provides a kind of three-dimensional video-frequency Comfort Evaluation method and devices, to realize to stereopsis
The comfort level of frequency is evaluated.
In a first aspect, a kind of three-dimensional video-frequency Comfort Evaluation method is provided, this method comprises:
Obtain the video frame of stereopsis frequency range；
Estimate the parallax of the video frame of the stereopsis frequency range；
The weight for determining each pixel in the video frame of the stereopsis frequency range, by the position of the pixel with maximum weight
Set the visual focus position for being determined as the video frame of the stereopsis frequency range；
The video frame of the stereopsis frequency range is determined according to the visual focus position of the video frame of the stereopsis frequency range
Visible area；
According to the parallax of the video frame of the stereopsis frequency range and the visible area of the video frame of the stereopsis frequency range
The Spatial characteristic and time domain specification of the video frame of the stereopsis frequency range are extracted in domain；
According to the Spatial characteristic and time domain specification of the video frame of the stereopsis frequency range, the stereopsis frequency range is determined
Watch comfort level；
The weight of the pixel is calculated using following formula:
W=γ * | mv |+η * | dispcrossed|+λ*|δd|
Wherein, W is the weight for the pixel that coordinate is (x, y), and γ, η and λ are weighted value；It indicates
The coordinate is the plane motion vector of the pixel of (x, y), dxAnd dyThe respectively described coordinate is the horizontal position of the pixel of (x, y)
Shifting and vertical displacement, the dxAnd dyIt is the picture of (x, y) in video frame and the coordinate where the pixel that the coordinate is (x, y)
Search obtains in the adjacent video frames of video frame where plain；dispcrossedFor crossed disparity value；δ d is the three-dimensional video-frequency
The difference of the mean parallax of the match block of the video frame and its adjacent video frames of section.
Second aspect provides a kind of three-dimensional video-frequency Comfort Evaluation device, comprising:
Module is obtained, for obtaining the video frame of stereopsis frequency range；
Extraction module, the parallax of the video frame for estimating the stereopsis frequency range；Determine the view of the stereopsis frequency range
The position for the pixel for having maximum weight is determined as the video frame of the stereopsis frequency range by the weight of each pixel in frequency frame
Visual focus position；The stereopsis frequency range is determined according to the visual focus position of the video frame of the stereopsis frequency range
The visible area of video frame；According to the parallax of the video frame of the stereopsis frequency range and the video frame of the stereopsis frequency range
Visible area, extract the Spatial characteristic and time domain specification of the video frame of the stereopsis frequency range；
The airspace of evaluation module, the video frame of the stereopsis frequency range for being extracted according to the extraction module is special
Property and time domain specification, determine the viewing comfort level of the stereopsis frequency range.
The extraction module calculates the weight of the pixel using following formula:
W=γ * | mv |+η * | dispcrossed|+λ*|δd|
Wherein, W is the weight for the pixel that coordinate is (x, y), and γ, η and λ are weighted value；It indicates
The coordinate is the plane motion vector of the pixel of (x, y), dxAnd dyThe respectively described coordinate is the horizontal displacement of (x, y) pixel
And vertical displacement, the dxAnd dyIt is the pixel of (x, y) in video frame and the coordinate where the pixel that the coordinate is (x, y)
Search obtains in the adjacent video frames of the video frame at place；dispcrossedFor crossed disparity value；δ d is the stereopsis frequency range
Video frame and its adjacent video frames match block mean parallax difference.
In the above embodiment of the present invention, by detecting the Spatial characteristic and time domain specification of video frame in stereopsis frequency range,
And the viewing comfort level of entire stereopsis frequency range is evaluated according to the Spatial characteristic of video frame and time domain specification.The present invention
The three-dimensional video-frequency Comfort Evaluation scheme that embodiment proposes considers disparity space distribution (i.e. Spatial characteristic) and Annual distribution
The influence of (i.e. time domain specification) to three-dimensional video-frequency comfort level, and influence of the poor frame of comfort level to global comfort can be protruded,
So as to more objectively evaluate three-dimensional video-frequency comfort level.
Detailed description of the invention
Fig. 1 is three-dimensional video-frequency Comfort Evaluation flow diagram provided in an embodiment of the present invention；
Fig. 2 is that single frames frequency domain characteristic provided in an embodiment of the present invention and time domain specification extract flow diagram；
Fig. 3 is the single frames frequency domain characteristic and time domain specification provided in an embodiment of the present invention of being based on to three-dimensional video-frequency section comfort level
The flow diagram evaluated；
Fig. 4 be another embodiment of the present invention provides based on single frames frequency domain characteristic and time domain specification to three-dimensional video-frequency Duan Shu
The flow diagram that appropriateness is evaluated；
Fig. 5 is three-dimensional video-frequency Comfort Evaluation schematic device provided in an embodiment of the present invention；
Fig. 6 be another embodiment of the present invention provides three-dimensional video-frequency Comfort Evaluation schematic device.
Specific embodiment
The embodiment of the present invention obtains the disparity map for the video frame that stereopsis frequency range includes first, then extracts video frame
Spatial characteristic and time domain specification obtain the comfort level of whole section by Comfort Evaluation model.What the embodiment of the present invention proposed relaxes
Appropriate evaluation method, it is contemplated that influence of the variation of object time domain parallax size and frequency to three-dimensional video-frequency comfort level.It sees
For crowd during watching video, influence of the second-rate segment often to whole viewing experience is bigger, and the prior art is unable to body
Reveal the influence of poor frames or poor segment, and the appraisal procedure that the embodiment of the present invention proposes, it is poor comfort level can be protruded
The influence of frame.
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with attached drawing to the present invention make into
It is described in detail to one step, it is clear that the described embodiments are only some of the embodiments of the present invention, rather than whole implementation
Example.Based on the embodiments of the present invention, obtained by those of ordinary skill in the art without making creative efforts
All other embodiment, shall fall within the protection scope of the present invention.
It is three-dimensional video-frequency Comfort Evaluation flow diagram provided in an embodiment of the present invention referring to Fig. 1, as shown, should
Process can include:
Step 101: obtaining the video frame of stereopsis frequency range to be evaluated.
Step 102: extracting the Spatial characteristic and time domain specification of the video frame of the stereopsis frequency range.
Step 103: according to the Spatial characteristic and time domain specification of the video frame of the stereopsis frequency range, determining the three-dimensional video-frequency
The viewing comfort level of section.
It in step 102, may be accomplished by: for each video frame of stereopsis frequency range, executing following behaviour
Make: estimating the parallax of the video frame, the visual focus position of the video frame is determined according to the parallax of the video frame and motion information
It sets, the visible area of the video frame is determined according to the visual focus position of the video frame, according to the parallax of the video frame and be somebody's turn to do
The visible area of video frame.Step 102 is illustrated in order to clearer, Fig. 2 shows one kind of step 102 in Fig. 1 can
Implementation is selected, the process can include:
Step 201: initialization i value, i.e. setting i=1.
Step 202: the parallax of the i-th frame of estimation.
In general, each frame of three-dimensional video-frequency includes left-eye image and eye image, referred to as stereo pairs.In video frame
The parallax of one pixel refers to the distance between a matched pixel of stereo image pair, and usual crossed disparity is negative, non-crossing
Parallax is positive.There are many Disparity estimations of three-dimensional video-frequency, and optional Stereo Matching Algorithm of the embodiment of the present invention carries out parallax
Estimation, for example dense disparity map is obtained using the Stereo Matching Algorithm based on color segmentation.It is obtained by Stereo Matching Algorithm
It after parallax, can be filtered with further progress, to remove the Mismatching point in disparity map, the disparity map made is smooth, connects
It is continuous, accurate.When it is implemented, median filtering removal abnormal point can be used.
During obtaining dense disparity map using the Stereo Matching Algorithm based on color segmentation, it usually needs definition
Search window carries out Stereo matching (searching for matched pixel) according to the search window of definition.For example, being with current pixel
Benchmark searches for 32 pixels (search range is 32 at this time, and the range of parallax is -32~32) respectively to the left and to the right, i.e., at this
Search and the matched pixel of current pixel in search range.It, can be with according to the difference of video-frequency band content in the embodiment of the present invention
Adjust the size of search window.The size of search window in addition to related with the resolution ratio of video, also with the whole parallax of video frame
Size is related.If search window is too small, will lead to partial pixel can not find matched pixel；If window is too big, the probability of error hiding
It will increase, obtained disparity map accuracy is lower.To avoid the above problem, the size of search window can be with the parallax of video frame
Amplitude is close.
When using Stereo Matching Algorithm estimating disparity based on color segmentation, it is possible to some pixels cannot get parallax, than
Such as, when there is the problems such as blocking, partial pixel cannot obtain parallax.To solve this problem, in the embodiment of the present invention, into
During row Stereo matching, if certain pixel does not find matching pixel, the parallax of the pixel can be may be configured as experience
Value, shows not find matched pixel, for example, still by taking above-mentioned search range is 32 as an example, if not searched for current pixel
Matched pixel then sets search range for the parallax of the current pixel and adds one, that is, is set as 33.
Step 203: according to the parallax and motion information of the i-th frame, determining the visual focus position of the i-th frame.
In the step, the weight of each pixel in the i-th frame can first determine that, by the position of the pixel with maximum weight
It is determined as the visual focus position of the i-th frame.Further, multiple if having the pixel of maximum weight to have in the i-th frame, it can incite somebody to action
In multiple pixel with maximum weight, the position of the nearest pixel of the image center location of the i-th frame of distance is determined as i-th
The visual focus position of frame.
Due to movement (such as plane motion and/or movement of depth direction) more violent in video and biggish friendship
Fork parallax easily cause spectators' note that therefore the embodiment of the present invention calculate pixel weight when, can be according in video frame
Plane motion (including horizontal movement and vertical movement), the movement of depth direction and crossed disparity with pixel are calculated.
Wherein, crossed disparity refers to image objects in front of screen.
Specifically, the weight of pixel in the i-th frame can be calculated according to the following formula:
W=γ * | mv |+η * | dispcrossed|+λ*|δd|………………………………[1]
Wherein, W is the weight for the pixel that coordinate is (x, y), and γ, η and λ are weighted value, and the sum of γ, η and λ can be with values
It is 1, optionally, γ=0.2, η=0.4, λ=0.4；Mv indicates plane motion vector, and the size of mv shows the play of plane motion
Strong degree,Indicates coordinate is the plane motion vector of the pixel of (x, y), dxAnd dyRespectively the i-th frame
Interior coordinate is the horizontal displacement and vertical displacement of (x, y) pixel, the dxAnd dyIn the adjacent video frames of the i-th frame and the i-th frame
Search obtains in (adjacent video frames of i-th frame are, for example, the (i-1)-th frame or i+1 frame), for example, by comparing in the i-th frame
Coordinate is the pixel of (x, y) and the coordinate with the pixel of the pixel matching in the (i-1)-th frame, can obtain the d of the pixelxWith
dy；dispcrossedFor crossed disparity value, for each pixel, the only disp when its parallax is crossed disparitycrossedJust have
Value, if the parallax of pixel be it is non-crossing, by dispcrossedValue is 0；δ d is the adjacent video frames of the i-th frame and the i-th frame
The difference of the mean parallax of the match block of (adjacent video frames of i-th frame are, for example, the (i-1)-th frame or i+1 frame), δ d's is big
The small speed for showing depth direction movement.
Step 204: the visible area of the video frame is determined according to the visual focus position of the i-th frame.
In the step, after determining the visual focus position of video frame i, can according to human eye differentiate the ken and viewing away from
From determining image visual region.In the embodiment of the present invention, the area centered on focus, in 15 ° of angulars field of view can be optionally taken
Domain is visible area.For example, the resolution ratio of a stereopsis frequency range is 640*480, a video frame in the stereopsis frequency range
Visible area may be in 350*262 pixel coverage.
Step 205: according to the parallax of the i-th frame and the visible area of the video frame, extract the i-th frame Spatial characteristic and
Time domain specification.
In the embodiment of the present invention, the Spatial characteristic of a video frame may include one of following parameter or any combination: the view
The reference parallax (the reference parallax of the i-th frame is expressed as minDisp below) of frequency frame, with reference to the percentage (following presentation of parallax
For P (minDisp)), frame effect severity, whether meet " lower close remote " space layout.Wherein:
The reference parallax minDisp of video frame, can be the minimum pixel parallax value in the visible area of video frame.Into
One step, it is contemplated that the phenomenon that there may be error hidings in Stereo matching, the parallax for sometimes having some pixels are extremely big
Or it is abnormal small, but these pixels are all often discrete, negligible amounts some pixels.But in fact, for same
For object, the pixel parallax of adjacent area all should be same or similar, therefore just recognize when the negligible amounts of pixel parallax
Matching for these pixels is inaccurate, therefore can be after the pixel for excluding these parallaxes exception, according to remaining pixel
Parallax selects minimum parallax, the reference parallax as the video frame.For example, can be removed in the visible area of the video frame
Minimum value in the parallax of other pixels other than noise pixel is determined as the reference parallax of the video frame；Wherein, for
Each parallax value of noise pixel, corresponding pixel (i.e. with the pixel of the parallax value) quantity is lower than setting pixel number
Measure threshold value.This way it is possible to avoid selection of some noises to reference parallax, and then improve the accuracy of comfort level assessment.
With reference to the percentage P (minDisp) of parallax, refer in the visible area of video frame, parallax value is with reference to parallax
minDispiNumber of pixels and valid pixel number ratio, wherein the parallax absolute value of valid pixel be less than search model
It encloses.During Stereo matching, the phenomenon that failure there are some pixel matchings, the parallax of the pixel is arranged to one really at this time
Fixed empirical value indicates that the pixel matching fails, for example, before described search range when being 32, by the pixel that it fails to match
Parallax value be set as 33.Due to the size of search window limit effective disparity range be [- 32,32], therefore parallax [-
32,32] pixel in is the pixel of successful match, i.e. valid pixel, and pixel of the parallax not in [- 32,32] is as invalid
Pixel, i.e. error hiding pixel, for example the pixel that parallax is 33 is error hiding pixel.
Frame effect refers to for a video frame, if the object for being located at screen edge (images in screen edge
Object) parallax be crossed disparity (i.e. image objects in screen in front of), and a part of object has exceeded screen ranges,
Then there are frame effect (frame-effect) for the video frame, this can make spectators generate extremely uncomfortable feeling in viewing.
" lower nearly remote (bottom-up) ", refers to that the object of the corresponding screen bottom end of a video frame (images in screen
The object of curtain bottom end) perceived depth is close from spectators, screen top object (imaging in the object on screen top) perception is deep
It spends remote from spectators.The video frame for meeting the space layout of " lower close remote " does not easily lead to visual fatigue.
When it is implemented, viewing comfort degree factor disp can be useddistribution(it can be described as the first viewing comfort level
Impact factor) it indicates the severity of frame effect and whether meets " lower close remote " space layout.With reference to parallax, ginseng
Examine the percentage and disp of parallaxdistributionReflect the space distribution situation of parallax in video frame.
Below by taking the i-th frame as an example, the reference parallax minDisp, the percentage P with reference to parallax that illustrate video frame
(minDisp) and dispdistributionCalculation method.
For the i-th frame, determine it with reference to parallax minDispiMethod may is that in the visible area of the i-th frame own
In the parallax of pixel, value of the minimum value as the reference parallax of the i-th frame is chosen.Another optional implementation may is that
Determine the corresponding parallax set of the i-th frame, which is combined into the pixel parallax set in institute i frame visible area, and therein every
The corresponding pixel quantity of a parallax value is all larger than the given threshold；Minimum parallax value in the parallax set is determined as i-th
The minDisp of framei.For example, taking minimum parallax in the statistical window of N*N (N is pixel quantity), there is this most to neglect for judgement
Whether the pixel quantity of difference is greater than threshold value 0.875*N*N, if more than then regarding the minimum parallax as the reference of the i-th frame
Difference；If being less than, chooses the minimum value in remaining parallax in addition to the minimum parallax again in the statistical window, judge have
Have whether the pixel quantity of the minimum value is greater than threshold value 0.875*N*N, if more than then using the minimum parallax as the ginseng of the i-th frame
Parallax is examined, otherwise excludes the minimum value referring to aforesaid way, one minimum value of reselection in remaining parallax, and referring to upper
The mode of stating is judged and is handled.
, can be in the visible area by calculating the i-th frame with reference to the percentage P (minDisp) of parallax for the i-th frame, parallax
To refer to parallax minDispiNumber of pixels and the ratio of valid pixel number obtain.
It, can be by the corresponding screen edge a certain range of the i-th frame of detection, if there are being less than for concentration for the i-th frame
The crossed disparity of parallax value is set, to determine the i-th frame with the presence or absence of frame effect.For example, for the i-th frame, it can be in screen edge
In a certain range, whether the number for the crossed disparity for being less than setting parallax thresholding T by the search window detection of N*N is greater than threshold
Value 0.75*N*N, if it is greater, then judging the i-th frame, there are frame effects, and otherwise judging the i-th frame, there is no frame effects.Its
In, lower bound of the value requirement less than " comfort zone " of thresholding T, and point of the range of " comfort zone " and video
The series of factors such as resolution, human eye interpupillary distance, viewing distance are related, therefore the value of thresholding T is not a fixed value, selectable value
Also related to the resolution ratio of video." comfort zone " refers to: when parallax is less than a certain range, human eye will not generate vision
Under fatigue, such as current video resolution ratio " comfort zone " be -5pixels, 8 pixels], then the value of thresholding T should
Less than -5.For example, the video frame for being 640*480 for resolution ratio, in the range of screen edge 5%, if 20*20's
Detect that the number of the crossed disparity less than -5 is greater than 300 in window, then judging the video frame, there are frame effects.
For the i-th frame, the i-th frame can be divided into according to a certain percentage to three regions, by comparing effective in three regions
The size relation of the mean parallax of pixel come judge whether the i-th frame meets " lower close remote " space layout.For example, for i-th
I-th frame image can be divided into three regions according to the picture altitude of Q%, 1-Q% (0 < Q < 100) by frame, by comparing three
The size relation of the mean parallax of valid pixel judges whether to meet " lower close remote " in a region.For example, by the i-th frame image
Be divided into three regions in short transverse, from top to bottom the height ratio in each region are as follows: 0~20%, 20%~80%,
80%~1, the mean parallax of each region valid pixel is calculated separately, if topdisp<middledisp<bottomdisp, then
Judge that the i-th frame meets the space layout of " lower close remote ".Wherein topdisp、middledisp、bottomdispRespectively represent three
The mean parallax value of valid pixel in region.It is of course also possible to which the i-th frame is divided into two regions or more according to a certain percentage
Judge according to mentioned above principle by comparing the size relation of the mean parallax of valid pixel in each region in three regions
Whether the i-th frame meets the space layout of " lower close remote ".
As described above, whether the embodiment of the present invention according to the severity of frame effect and can meet " lower close remote "
Space layout determines disparity space layout to the impact factor disp of comfort leveldistribution。 dispdistributionValue is high,
Show parallax distribution preferably, is not easy that viewer is made to generate visual fatigue, dispdistributionValue is low, show parallax distribution compared with
Difference is easy that viewer is made to generate visual fatigue.In the specific implementation, dispdistributionValue range may be configured as [0,
It 1], can be by disp in video frame there is no frame effect and in the case where closely upper remote space layout under meetingdistributionTake compared with
Big value, for example, can in the range of [0.9,1] value.There are frame effect and lower closely upper remote space cloth is unsatisfactory in video frame
It, can be by disp in the case where officedistributionValue is smaller.
The embodiment of the present invention gives a kind of following dispdistributionThe optinal plan of value:
If only meeting the spatial distribution of " lower close remote ", dispdistribution=0.8；
If only meeting and frame effect, disp being not presentdistribution=0.9；
If meeting optimal layout, that is, there is no frame effect and the spatial distributions of satisfaction " lower close remote ", then
dispdistribution=1；
Frame effect and it is unsatisfactory for the spatial distribution of " lower close remote " if it exists, then dispdistribution=0.7.
It can be seen that dispdistributionIn closely upper remote space layout under video frame is there is no frame effect and satisfaction
The first value is taken, second value is taken in closely upper remote space layout under video frame is there are frame effect but satisfaction, is not present in video frame
It frame effect but is unsatisfactory for taking third value when lower closely upper remote space layout, there are frame effect and be unsatisfactory for lower close in video frame
The 4th value is taken when upper remote space layout, wherein the first value, second value, third value and the 4th value are preset value, and the first value is small
In the 4th value, third value is between the first value and second value and unequal with the first value and second value.Optionally, the first value,
The value range of second value, third value and the 4th value are as follows: greater than zero and less than or equal to 1.According to dispdistributionValue is from small
To big sequence, the viewing Comfort Evaluation score value being calculated also according to sequentially increasing from small to large, (comment by viewing comfort level
Valence score value is higher, shows that viewing comfort level is higher)
The time domain specification of one video frame may include change of the parallax in the visible area of the video frame in depth direction
Change.When it is implemented, viewing comfort degree factor Ⅴ can be usedd(can be described as the second viewing comfort degree factor) indicates
The influence of parallax in visible area in the variation of depth direction.
Variation (V of the parallax in depth directiond) influence factor there are two, one is the change in time domain with reference to parallax
Change (V1), the other is with reference to parallax occur frequency time domain variation (V2), Vd=f (V1,V2).In the embodiment of the present invention,
Can according to the reference parallax of a video frame the frequency that the reference parallax of the variation of time domain and/or the video frame occurs when
The viewing comfort degree factor Ⅴ of the video frame is calculated in the variation in domaind。
For the i-th frame, a kind of variation (V of simple metric parallax in depth directiond) function are as follows:
Wherein, V1 iIndicate variation of the reference parallax in time domain of the i-th frame；Indicate what the reference parallax of the i-th frame occurred
Variation of the frequency in time domain；γ and μ is weighted value, for example ,+μ=1 γ, optionally, γ and μ take 0.5.It can be according to V1 iWithThe significance level of influence adjusts the value of γ and μ.A kind of extreme way is γ=1, μ=0, only consider at this time parallax when
The influence of domain variation.Or μ=1, γ=0 only consider the influence of variation of the frequency occurred with reference to parallax in time domain at this time.
For the V of the i-th frame1 i, the embodiment of the invention provides two kinds of optional calculation methods:
Method 1: stereopsis frequency range is segmented, and the reference parallax of the video frame in same video-frequency band is monotonically changed and changes
Speed is identical, calculates the V of the i-th frame according to the following formula1 i:
V1 i=(displast-dispfirst)/(Np-1)…………………………………[3]
Wherein, dispfirstAnd displastThe first frame of the affiliated video-frequency band of respectively the i-th frame and the reference view of last frame
Difference, Np are the video frame quantity of the affiliated video-frequency band of the i-th frame.
Method 2: the V of the i-th frame is calculated according to the following formula1 i:
V1 i=minDispi-minDispi-1……………………………………[4]
Wherein, minDispiAnd minDispi-1The reference parallax of respectively the i-th frame and the (i-1)-th frame.
For the i-th frameIt can calculate according to the following formula:
Wherein, P (minDispi) and P (minDispi-1) be respectively the i-th frame and the (i-1)-th frame reference parallax percentage
Than.
Step 206: being incremented by i value, i.e. setting i=i+1, and judge whether the i value after being incremented by is more than the stereopsis frequency range
Number of video frames N be transferred to step 202 if being judged as NO, otherwise terminate this process.
It can be seen that by the above process due to movement more violent in video frame (such as plane motion and/or depth
Spend the movement in direction) and biggish crossed disparity easily cause spectators' note that therefore the embodiment of the present invention is in calculating pixel
It, can be according to the plane motion (including horizontal movement and vertical movement) of matched pixel in video frame, the fortune of depth direction when weight
Dynamic and crossed disparity is calculated, and is chosen the pixel of wherein maximum weight as visual focus, is determined according to the visual focus
Visible area, the visible area are usually the interested region of spectators, so as to see for the interested region of spectators
See Comfort Evaluation.
In three-dimensional video-frequency playing process, human eye can not accurately identify the comfort level of each video frame, for video comfort
The reflection of degree be based on video-frequency band, rather than be based on video frame.Therefore, it in the step 103 of Fig. 1, needs to assess video-frequency band
Comfort level.
Fig. 3 shows a kind of optional implementation method of step 103 in Fig. 1, as shown, this method may include following step
It is rapid:
Step 301: calculating the viewing comfort level of each video frame of stereopsis frequency range.The comfort level of one video frame
It is codetermined by time domain specification and Spatial characteristic.
In the specific implementation, the comfort level model of a video frame can be (below by taking the i-th frame as an example):
Wherein,For the viewing comfort level of the i-th frame, Spatial_frame_vciFor the i-th frame Spatial characteristic determine
The viewing comfort level of i-th frame, Temperal_frame_vciViewing for the i-th frame of the time domain specification decision of the i-th frame is comfortable
Degree, α and β are weighted value.
Wherein, dispdistribution iFor the disp of the i-th framedistributionThe factor, minDispiIt is regarded for the reference of the i-th frame
Difference, P (minDispi) be the i-th frame reference parallax percentage, b1 is model parameter；For the V of the i-th framedThe factor；B2 is
Model parameter, the value and V of b21 iAnd minDispiSymbol it is related.B1 and b2 is training during being fitted subjective data
Model parameter out, value can be determined according to hands-on result.
Optionally, if made when to the subjective evaluation of video-see comfort level using 5 points, minimum 1 point of highest 5 is divided,
Then the parameter c1 value in above-mentioned formula 7 and formula 8 is 4.Due to video-see comfort level subjective evaluation when using 5
Divide system, it is that 4 certifiable minimum values are 1 and maximum value is 5 by c1 value that minimum 1 point of highest 5, which is divided,.Similarly, if it is other points
System, such as 11 point system or hundred-mark system, then can adjust accordingly the value of the model parameter in formula 7 and formula 8.
Table 1 shows one group of optional model parameter value.
1 model parameter of table
Step 302: according to the visual focus position of each video frame of the stereopsis frequency range, to the three-dimensional video-frequency
Duan Jinhang subsegment divides, and each subsegment contains at least one video frame, the visual focus position transfer of the video frame of each subsegment
Then amount calculates the viewing comfort level of each subsegment no more than setting transfer amount threshold value.
In the step, segmentation is according to being amount of translation size of the focus in spatial position, if the sky of the focus of continuous multiple frames
Between position it is close, then the continuous multiple frames are divided into a subsegment.For example, if the spatial focal point position of adjacent video frames turns
The adjacent video frames are then divided into a subsegment, the adjacent video frames are otherwise divided into difference by shifting amount δ p less than 5
Subsegment.Wherein,dxAnd dyRespectively represent the horizontal and vertical displacement of focus transfer.
When it is implemented, calculating the specific formula for calculation of the viewing comfort level of each subsegment may is that
Wherein,For the level of comfort of k-th of subsegment, NFFor the number of video frame in k-th of subsegment, P1For joint ginseng
Number, for set numerical value, such as can selected value be 7.P1Can value be integer greater than 1.P1The selection of selectable value can be according to existing
Test section and the training of corresponding subjective comfort score value obtain, by the way that reasonable value is arranged, subjective score and objective can be made
The correlation highest of score value.
Optionally, if made when to the subjective evaluation of video-see comfort level using 5 points, minimum 1 point of highest 5 is divided,
Then the parameter c2 value in above-mentioned formula 9 and formula 10 be 5, i.e., value be subjective evaluation best result.Similarly, if it is it
He divides system, such as 11 point system or hundred-mark system, then can adjust accordingly to the value of the model parameter in formula 7 and formula 8.
Step 303: the viewing comfort level of the stereopsis frequency range is calculated according to the viewing comfort level of each subsegment.
When it is implemented, specific formula for calculation may is that
Wherein, Q is the viewing comfort level of the stereopsis frequency range, NSFor the number of subsegment in the video-frequency band, P2For when
Domain combined parameters, be setting value, such as can selected value be 3.P2Can value be integer greater than 1.P2The selection of selectable value can
It is obtained according to existing test section and the training of corresponding subjective comfort score value, by the way that reasonable value is arranged, subjective point can be made
The correlation highest of value and objective score value.
Fig. 4 shows the optional implementation method of another kind of step 103 in Fig. 1, in this method, watches Comfort Evaluation mould
The characterisitic parameter extracted in type is the statistical parameter of section, does not need the comfort level and subsegment that individually calculate each video frame
Comfort level.As shown, this method can comprise the following steps that
Step 401: according to the Spatial characteristic of each video frame of stereopsis frequency range, calculating the sky of the stereopsis frequency range
Domain characteristic.
The Spatial characteristic of the stereopsis frequency range may include one of following parameter or any combination: the stereopsis frequency range
With reference to parallax, the viewing comfort degree factor of the stereopsis frequency range
When it is implemented, the reference parallax of stereopsis frequency range can be calculated in the following way: calculating the stereopsis
The weighted average of the reference parallax of all video frames in frequency range.Specific formula for calculation may is that
Wherein,For the weighted average of the reference parallax of all video frames in the stereopsis frequency range, N is
The number of video frame, minDisp in the stereopsis frequency rangeiFor the reference parallax of the i-th frame, P (minDispi) be the i-th frame ginseng
Examine the percentage of parallax.
When it is implemented, the viewing comfort degree factor of stereopsis frequency rangeIt can calculate in the following way
It obtains: calculating the viewing comfort degree factor disp of all video frames in the stereopsis frequency rangedistributionAverage value.
Specific formula for calculation may is that
Wherein,For the viewing comfort degree factor of all video frames in the stereopsis frequency range
dispdistributionAverage value, dispdistribution iFor the viewing comfort degree factor disp of the i-th framedistribution；
Step 402: according to the time domain specification of each video frame of the stereopsis frequency range, calculating the stereopsis frequency range
Time domain specification.
The time domain specification of the stereopsis frequency range may include the viewing comfort degree factor of the stereopsis frequency rangeInstitute
State the viewing comfort degree factor Ⅴ of stereopsis frequency ranged, it can specifically be calculated by the following formula:
Wherein,For the viewing comfort degree factor Ⅴ of the stereopsis frequency ranged,For in the stereopsis frequency range
The viewing comfort degree factor Ⅴ of i-th framed, PiFor setting value, PiValue according to V1 iAnd minDispiSymbol determine,
That is, PiValue and V1 iAnd minDispiSymbol it is related, a kind of desirable value are as follows:
Work as V1 iWith minDispiWhen contrary sign, Pi=0.8；
Work as V1 iWith minDispiWhen jack per line, Pi=1；
Pass through PiDifferent motion direction can be distinguished to the Different Effects of viewing comfort level.Work as V1 iWith minDispiWhen jack per line,
Object is moved to the direction far from screen, and comfort level in this case is excessively poor, PiDesirable the larger value, such as above-mentioned Pi=1；
Work as V1 iWith minDispiWhen contrary sign, object is moved to the direction close to screen, and comfort level in this case is preferable, PiIt is desirable
Smaller value, such as above-mentioned Pi=0.8.
Step 403: according to the calculated parameter in step 401~402, calculating the viewing comfort level of the stereopsis frequency range.
Specific formula for calculation may is that
VC=α * Spatial_vc+ β * Temperal_vc ... ... ... ... ... ... [14]
Wherein, VC is the viewing comfort level of the stereopsis frequency range, and α and β are weighted value, optionally, alpha+beta=1；B1 is
Model parameter.One group of available model parameter are as follows: α=0.8, β=0.2, b1=0.04.The selection of the selectable value of b1 can basis
Existing test section and the training of corresponding subjective comfort score value obtain, and when taking the value, subjective score is related to objective score value
Property highest.
Optionally, if made when to the subjective evaluation of video-see comfort level using 5 points, minimum 1 point of highest 5 is divided,
Then the parameter c3 value in above-mentioned formula 15 and formula 16 be 4, i.e., value be subjective evaluation best result.Similarly, if it is it
He divides system, such as 11 point system or hundred-mark system, then can adjust accordingly to the value of the model parameter in formula 15 and formula 16.
It can be seen that the embodiment of the present invention by detection human eye vision focal position by the above process, regarded according to human eye
Angular region determines visible area, is relaxed using influx in visible area with the severity metrics three-dimensional video-frequency viewing to conflict is adjusted
Appropriateness.Influx is by analysis three-dimensional video-frequency space-time function distribution situation and time domain parallax with the severity to conflict is adjusted
Distribution situation measurement.The appraisal procedure that the embodiment of the present invention proposes has fully considered disparity space distribution and Annual distribution pair
The influence of three-dimensional video-frequency comfort level, and influence of the poor frame of comfort level to global comfort can be protruded.
In conclusion the assessment of three-dimensional video-frequency comfort level is to improve the precondition of three-dimensional video-frequency viewing comfort level, it is to influence
One of the key technology of three-dimensional video-frequency development.The three-dimensional video-frequency comfort level that the embodiment of the present invention proposes objectively evaluates scheme, meter
It is low to calculate complexity, high reliablity can be widely applied and assess and monitor with three-dimensional video-frequency comfort level.The program and existing program
Influence compared to the Spatial characteristic and time domain specification for having fully considered three-dimensional video-frequency to three-dimensional video-frequency comfort level, and consider
Human visual system and viewer watching habits cover the main influence factor for influencing viewing comfort level, to make solid
Video-see Comfort Evaluation is more objective and accurate.
Based on the same technical idea, the embodiment of the invention also provides a kind of three-dimensional video-frequency evaluating apparatus.
It is the structural schematic diagram of three-dimensional video-frequency evaluating apparatus provided in an embodiment of the present invention referring to Fig. 5.
Module 501 is obtained, for obtaining the video frame of stereopsis frequency range；
Extraction module 502, the Spatial characteristic of the video frame for extracting the stereopsis frequency range that the acquisition module is got
And time domain specification；
Evaluation module 503, the airspace of the video frame of the stereopsis frequency range for being extracted according to the extraction module
Characteristic and time domain specification determine the viewing comfort level of the stereopsis frequency range.
In conjunction with above-mentioned apparatus, in the first possible implementation, extraction module 502 is specifically used for: estimation is described vertical
The parallax of the video frame of stereoscopic frequency range, according to the parallax of the video frame of the stereopsis frequency range and motion information determination
The visual focus position of the video frame of stereopsis frequency range, the visual focus position according to the video frame of the stereopsis frequency range are true
The visible area of the video frame of the fixed stereopsis frequency range, and according to the parallax of the video frame of the stereopsis frequency range and
The Spatial characteristic and time domain of the video frame of the stereopsis frequency range are extracted in the visible area of the video frame of the stereopsis frequency range
Characteristic.
In conjunction with the first possible implementation of above-mentioned apparatus, in the second possible implementation, extraction module
502 can determine the weight of each pixel in the video frame of the stereopsis frequency range, and the position of the pixel with maximum weight is true
It is set to the visual focus position of the video frame of the stereopsis frequency range.
In conjunction with second of possible implementation of above-mentioned apparatus, in the third possible implementation, extraction module
502 can be used the weight that formula (1) calculates the pixel, the expression formula of formula (1) and the same institute of the meaning of relevant parameter
It states, is not repeated herein.
In conjunction with second of above-mentioned apparatus or the third possible implementation, in the fourth possible implementation,
Extraction module 502 is specifically used for:, will if it is multiple that there is the pixel of maximum weight to have in the video frame of the stereopsis frequency range
In the multiple pixel with maximum weight, the image center location of the video frame apart from the stereopsis frequency range is nearest
The position of pixel is determined as the visual focus position of the video frame of the stereopsis frequency range.
In conjunction with the first any one possible realization side into the 4th kind of possible implementation of above-mentioned apparatus
Formula, in a fifth possible implementation, the Spatial characteristic include one of following parameter or any combination: with reference to parallax,
Percentage, the first viewing comfort degree factor with reference to parallax；
Extraction module 502 is specifically used for: determining the corresponding parallax set of the video frame of the stereopsis frequency range, the view
Difference set is combined into the pixel parallax set in the video frame visible area of the stereopsis frequency range, and each parallax value pair therein
The pixel quantity answered is all larger than the given threshold；Minimum parallax value in the parallax set is determined as the stereopsis
The reference parallax of the video frame of frequency range；
In the visible area for calculating the video frame of the stereopsis frequency range, parallax is the number of the pixel with reference to parallax
The ratio of the number of mesh and valid pixel obtains the percentage of the reference parallax of the video frame of the stereopsis frequency range, described to have
The parallax absolute value that effect pixel refers to is less than the pixel of search range；
According to the video frame of the stereopsis frequency range with the presence or absence of remote space cloth closely upper under frame effect and whether meet
Office determines the first viewing comfort degree factor of the video frame of the stereopsis frequency range, the first viewing comfort degree
The factor takes the first value in closely upper remote space layout under the video frame of the stereopsis frequency range is not present frame effect and meets,
The stereopsis frequency range video frame is there are frame effect but when closely upper remote space layout under meeting takes second value, described
The video frame of stereopsis frequency range takes third value there is no frame effect but when being unsatisfactory for lower closely upper remote space layout, described vertical
The video frame of stereoscopic frequency range takes the 4th value there are frame effect and when being unsatisfactory for lower closely upper remote space layout, wherein the first value,
Second value, third value and the 4th value are preset value, and the first value, less than the 4th value, third value is between the first value and second value
And it is unequal with the first value and second value；The frame effect refers to for a video frame, if imaging in screen side
The parallax of the object of edge is crossed disparity, and a part of the object has exceeded screen ranges, then there is frame effect；Institute
State it is lower it is close on far refer to that the perceived depth of the corresponding object for imaging in screen bottom end of a video frame is close from spectators, image in
The perceived depth of the object on screen top is remote from spectators.
In conjunction with the first any one possible realization side into the 5th kind of possible implementation of above-mentioned apparatus
Formula, in a sixth possible implementation, the time domain specification include the second viewing comfort degree factor；
Extraction module 502 is specifically used for: according to the reference parallax of the video frame of the stereopsis frequency range time domain change
Change and/or the frequency of the reference parallax of the video frame of stereopsis frequency range appearance is in the variation of time domain, is calculated described
The second viewing comfort degree factor of the video frame of stereopsis frequency range, the second viewing comfort degree factor value
Size indicates the degree that the reference parallax of video frame changes in depth direction.
In conjunction with the 6th kind of possible implementation of above-mentioned apparatus, in the 7th kind of possible implementation, extraction module
502 are specifically used for: the stereopsis frequency range being carried out subsegment division, the reference parallax dullness of the video frame in same subsegment becomes
Change and pace of change is identical, change of the reference parallax in time domain of the video frame of the stereopsis frequency range is calculated according to formula (3)
Change, variation of the frequency occurred according to the reference parallax that formula (5) calculate the video frame of the stereopsis frequency range in time domain, root
The second viewing comfort degree factor of the video frame of the stereopsis frequency range is calculated according to formula (2).Formula (3), formula (2)
As described above with the expression formula of formula (5) and the meaning of relevant parameter, it is not repeated herein.
In conjunction with the 6th kind of possible implementation of above-mentioned apparatus, in the 8th kind of possible implementation, extraction module
502 can calculate variation of the reference parallax in time domain of the video frame of the stereopsis frequency range according to formula (4), according to formula (5)
Variation of the frequency in time domain for calculating the reference parallax appearance of the video frame of the stereopsis frequency range, calculates institute according to formula (2)
State the second viewing comfort degree factor of the video frame of stereopsis frequency range.The expression of formula (4), formula (5) and formula (2)
Formula and the meaning of relevant parameter as described above, are not repeated herein.
It can in conjunction with any one of the first of above-mentioned apparatus or above-mentioned apparatus into the 8th kind of possible implementation
The implementation of energy, in the 9th kind of possible implementation, evaluation module 503 is specifically used for:
According to the Spatial characteristic and time domain specification of each video frame of the stereopsis frequency range, calculate separately described every
The viewing comfort level of one video frame；
According to the visual focus position of each video frame of the stereopsis frequency range, the stereopsis frequency range is carried out
Subsegment divides, and the visual focus position transfer amount of the video frame of each subsegment is no more than setting transfer amount threshold value；According to every height
The viewing comfort level of each video frame, calculates separately the viewing comfort level of each subsegment in section；
The viewing comfort level of the stereopsis frequency range is calculated according to the viewing comfort level of each subsegment.
In conjunction with the 9th kind of possible implementation of above-mentioned apparatus, in the tenth kind of possible implementation, evaluation module
503 can calculate the viewing comfort level of the video frame of the stereopsis frequency range according to formula (6), formula (7) and formula (8).Formula
(4), the meaning of the expression formula and relevant parameter of formula (5) and formula (2) as described above, is not repeated herein.Calculating process
In be related to the reference parallax of the video frame of stereopsis frequency range, stereopsis frequency range video frame reference parallax percentage,
The calculation method of the parameters such as the first viewing comfort degree factor, the second viewing comfort degree factor, as described above, herein
It is not repeated.
In conjunction with the 9th kind of above-mentioned apparatus or the tenth kind of possible implementation, in a kind of the tenth possible implementation
In, evaluation module 503 is specifically used for: the viewing comfort level of institute's stereopsis frequency range is calculated according to formula (9).Formula (9) expression
Formula and the meaning of relevant parameter as described above, are not repeated herein.
In conjunction with the 9th kind of above-mentioned apparatus any one possible realization side into a kind of the tenth possible implementation
Formula, in the 12nd kind of possible implementation, evaluation module 503 can calculate the stereopsis frequency range according to formula (10)
Watch comfort level.Formula (10) expression formula and the meaning of relevant parameter as described above, are not repeated herein.
In conjunction with any one of the first of above-mentioned apparatus or above-mentioned apparatus into the 12nd kind of possible implementation
Possible implementation, in the 13rd kind of possible implementation, evaluation module 503 can be according to the stereopsis frequency range
The Spatial characteristic of video frame calculates the Spatial characteristic of the stereopsis frequency range, according to the video frame of the stereopsis frequency range when
Domain characteristic calculates the time domain specification of the stereopsis frequency range, according to the Spatial characteristic and time domain specification of the stereopsis frequency range,
Calculate the viewing comfort level of the stereopsis frequency range.
It is described in the 14th kind of possible implementation in conjunction with the 13rd kind of possible implementation of above-mentioned apparatus
The Spatial characteristic of the video frame of stereopsis frequency range includes one of following parameter or any combination: the video of the stereopsis frequency range
The reference parallax of frame, with reference to the percentage of parallax and the first viewing comfort degree factor, the circular of these parameters
As described above, it is not repeated herein.Correspondingly, evaluation module 503 can calculate institute in the stereopsis frequency range according to formula (11)
There is the weighted average of the reference parallax of video frame, calculates all video frames in the stereopsis frequency range according to formula (12)
The average value of the first viewing comfort degree factor.Formula (11) and formula (12) expression formula and the meaning of relevant parameter are same
It is preceding described, it is not repeated herein.
In conjunction with the 13rd kind or the 14th kind of possible implementation of above-mentioned apparatus, in the 15th kind of possible realization
In mode, the time domain specification of the video frame of the stereopsis frequency range includes: the second viewing of the video frame of the stereopsis frequency range
The comfort degree factor (circular as described above, is not repeated herein), evaluation module 503 can be according to formula (13)
Calculate the second viewing comfort degree factor of the stereopsis frequency range.The meaning of formula (13) expression formula and relevant parameter
As described above, it is not repeated herein.
In conjunction with above-mentioned apparatus the 13rd kind to the 15th kind possible implementation in any one possible realization
Mode, in the 16th kind of possible implementation, evaluation module 503 can be according to formula (14), formula (15) and formula (16)
Calculate the viewing comfort level of the stereopsis frequency range.Formula (14), formula (15) and formula (16) expression formula and relevant parameter
Meaning as described above, be not repeated herein.
Based on the same technical idea, the embodiment of the invention also provides a kind of three-dimensional video-frequency evaluating apparatus.
It is the structural schematic diagram of three-dimensional video-frequency evaluating apparatus provided in an embodiment of the present invention referring to Fig. 6.The device can wrap
It includes: transceiver 601, memory 602 and processor 603.Memory 602 is for storing application program, algorithmic rule, calculating ginseng
The information such as number, may further be used to the intermediate result generated in 603 treatment process of storage processor.
Transceiver 601, for obtaining the video frame of stereopsis frequency range；
Processor 603, for extract the video frame of stereopsis frequency range that the acquisition module is got Spatial characteristic and
Time domain specification；The Spatial characteristic and time domain specification of the video frame for the stereopsis frequency range extracted according to the extraction module,
Determine the viewing comfort level of the stereopsis frequency range.
In conjunction with above-mentioned apparatus, in the first possible implementation, processor 603 is specifically used for: estimating the solid
The parallax of the video frame of video-frequency band determines described vertical according to the parallax of the video frame of the stereopsis frequency range and motion information
The visual focus position of the video frame of stereoscopic frequency range is determined according to the visual focus position of the video frame of the stereopsis frequency range
The visible area of the video frame of the stereopsis frequency range, and parallax and institute according to the video frame of the stereopsis frequency range
The visible area for stating the video frame of stereopsis frequency range, Spatial characteristic and the time domain for extracting the video frame of the stereopsis frequency range are special
Property.
In conjunction with the first possible implementation of above-mentioned apparatus, in the second possible implementation, processor
603 can determine the weight of each pixel in the video frame of the stereopsis frequency range, and the position of the pixel with maximum weight is true
It is set to the visual focus position of the video frame of the stereopsis frequency range.
In conjunction with second of possible implementation of above-mentioned apparatus, in the third possible implementation, processor
603 can be used the weight that formula (1) calculates the pixel, the expression formula of formula (1) and the same institute of the meaning of relevant parameter
It states, is not repeated herein.
In conjunction with second of above-mentioned apparatus or the third possible implementation, in the fourth possible implementation,
Processor 603 is specifically used for: if it is multiple that there is the pixel of maximum weight to have in the video frame of the stereopsis frequency range, by institute
It states in multiple pixels with maximum weight, the nearest picture of the image center location of the video frame apart from the stereopsis frequency range
The position of element, is determined as the visual focus position of the video frame of the stereopsis frequency range.
In conjunction with the first any one possible realization side into the 4th kind of possible implementation of above-mentioned apparatus
Formula, in a fifth possible implementation, the Spatial characteristic include one of following parameter or any combination: with reference to parallax,
Percentage, the first viewing comfort degree factor with reference to parallax；
Processor 603 is specifically used for: determining the corresponding parallax set of the video frame of the stereopsis frequency range, the parallax
Collect the pixel parallax set being combined into the video frame visible area of the stereopsis frequency range, and each parallax value therein is corresponding
Pixel quantity be all larger than the given threshold；Minimum parallax value in the parallax set is determined as the three-dimensional video-frequency
The reference parallax of the video frame of section；
In the visible area for calculating the video frame of the stereopsis frequency range, parallax is the number of the pixel with reference to parallax
The ratio of the number of mesh and valid pixel obtains the percentage of the reference parallax of the video frame of the stereopsis frequency range, described to have
The parallax absolute value that effect pixel refers to is less than the pixel of search range；
According to the video frame of the stereopsis frequency range with the presence or absence of remote space cloth closely upper under frame effect and whether meet
Office determines the first viewing comfort degree factor of the video frame of the stereopsis frequency range, the first viewing comfort degree
The factor takes the first value in closely upper remote space layout under the video frame of the stereopsis frequency range is not present frame effect and meets,
The stereopsis frequency range video frame is there are frame effect but when closely upper remote space layout under meeting takes second value, described
The video frame of stereopsis frequency range takes third value there is no frame effect but when being unsatisfactory for lower closely upper remote space layout, described vertical
The video frame of stereoscopic frequency range takes the 4th value there are frame effect and when being unsatisfactory for lower closely upper remote space layout, wherein the first value,
Second value, third value and the 4th value are preset value, and the first value, less than the 4th value, third value is between the first value and second value
And it is unequal with the first value and second value；The frame effect refers to for a video frame, if imaging in screen side
The parallax of the object of edge is crossed disparity, and a part of the object has exceeded screen ranges, then there is frame effect；Institute
State it is lower it is close on far refer to that the perceived depth of the corresponding object for imaging in screen bottom end of a video frame is close from spectators, image in
The perceived depth of the object on screen top is remote from spectators.
In conjunction with the first any one possible realization side into the 5th kind of possible implementation of above-mentioned apparatus
Formula, in a sixth possible implementation, the time domain specification include the second viewing comfort degree factor；
Processor 603 is specifically used for: according to the reference parallax of the video frame of the stereopsis frequency range time domain variation,
And/or the solid is calculated in the variation of time domain in the frequency that the reference parallax of the video frame of the stereopsis frequency range occurs
The second viewing comfort degree factor of the video frame of video-frequency band, the size of the second viewing comfort degree factor value
Indicate the degree that the reference parallax of video frame changes in depth direction.
In conjunction with the 6th kind of possible implementation of above-mentioned apparatus, in the 7th kind of possible implementation, processor
603 are specifically used for: the stereopsis frequency range being carried out subsegment division, the reference parallax dullness of the video frame in same subsegment becomes
Change and pace of change is identical, change of the reference parallax in time domain of the video frame of the stereopsis frequency range is calculated according to formula (3)
Change, variation of the frequency occurred according to the reference parallax that formula (5) calculate the video frame of the stereopsis frequency range in time domain, root
The second viewing comfort degree factor of the video frame of the stereopsis frequency range is calculated according to formula (2).Formula (3), formula (2)
As described above with the expression formula of formula (5) and the meaning of relevant parameter, it is not repeated herein.
In conjunction with the 6th kind of possible implementation of above-mentioned apparatus, in the 8th kind of possible implementation, processor
603 can calculate variation of the reference parallax in time domain of the video frame of the stereopsis frequency range according to formula (4), according to formula (5)
Variation of the frequency in time domain for calculating the reference parallax appearance of the video frame of the stereopsis frequency range, calculates institute according to formula (2)
State the second viewing comfort degree factor of the video frame of stereopsis frequency range.The expression of formula (4), formula (5) and formula (2)
Formula and the meaning of relevant parameter as described above, are not repeated herein.
It can in conjunction with any one of the first of above-mentioned apparatus or above-mentioned apparatus into the 8th kind of possible implementation
The implementation of energy, in the 9th kind of possible implementation, processor 603 is specifically used for:
According to the Spatial characteristic and time domain specification of each video frame of the stereopsis frequency range, calculate separately described every
The viewing comfort level of one video frame；
According to the visual focus position of each video frame of the stereopsis frequency range, the stereopsis frequency range is carried out
Subsegment divides, and the visual focus position transfer amount of the video frame of each subsegment is no more than setting transfer amount threshold value；According to every height
The viewing comfort level of each video frame, calculates separately the viewing comfort level of each subsegment in section；
The viewing comfort level of the stereopsis frequency range is calculated according to the viewing comfort level of each subsegment.
In conjunction with the 9th kind of possible implementation of above-mentioned apparatus, in the tenth kind of possible implementation, processor
603 can calculate the viewing comfort level of the video frame of the stereopsis frequency range according to formula (6), formula (7) and formula (8).Formula
(4), the meaning of the expression formula and relevant parameter of formula (5) and formula (2) as described above, is not repeated herein.Calculating process
In be related to the reference parallax of the video frame of stereopsis frequency range, stereopsis frequency range video frame reference parallax percentage,
The calculation method of the parameters such as the first viewing comfort degree factor, the second viewing comfort degree factor, as described above, herein
It is not repeated.
In conjunction with the 9th kind of above-mentioned apparatus or the tenth kind of possible implementation, in a kind of the tenth possible implementation
In, processor 603 is specifically used for: the viewing comfort level of institute's stereopsis frequency range is calculated according to formula (9).Formula (9) expression formula
And the meaning of relevant parameter is as described above, is not repeated herein.
In conjunction with the 9th kind of above-mentioned apparatus any one possible realization side into a kind of the tenth possible implementation
Formula, in the 12nd kind of possible implementation, processor 603 can calculate the sight of the stereopsis frequency range according to formula (10)
See comfort level.Formula (10) expression formula and the meaning of relevant parameter as described above, are not repeated herein.
In conjunction with any one of the first of above-mentioned apparatus or above-mentioned apparatus into the 12nd kind of possible implementation
Possible implementation, in the 13rd kind of possible implementation, processor 603 can be according to the view of the stereopsis frequency range
The Spatial characteristic of frequency frame calculates the Spatial characteristic of the stereopsis frequency range, according to the time domain of the video frame of the stereopsis frequency range
Characteristic calculates the time domain specification of the stereopsis frequency range, according to the Spatial characteristic and time domain specification of the stereopsis frequency range, meter
Calculate the viewing comfort level of the stereopsis frequency range.
It is described in the 14th kind of possible implementation in conjunction with the 13rd kind of possible implementation of above-mentioned apparatus
The Spatial characteristic of the video frame of stereopsis frequency range includes one of following parameter or any combination: the video of the stereopsis frequency range
The reference parallax of frame, with reference to the percentage of parallax and the first viewing comfort degree factor, the circular of these parameters
As described above, it is not repeated herein.Own correspondingly, processor 603 can calculate in the stereopsis frequency range according to formula (11)
The weighted average of the reference parallax of video frame calculates the of all video frames in the stereopsis frequency range according to formula (12)
The average value of the one viewing comfort degree factor.Formula (11) and formula (12) expression formula and the meaning of relevant parameter are the same
It is described, it is not repeated herein.
In conjunction with the 13rd kind or the 14th kind of possible implementation of above-mentioned apparatus, in the 15th kind of possible realization
In mode, the time domain specification of the video frame of the stereopsis frequency range includes: the second viewing of the video frame of the stereopsis frequency range
The comfort degree factor (circular as described above, is not repeated herein), processor 603 can be counted according to formula (13)
Calculate the second viewing comfort degree factor of the stereopsis frequency range.Formula (13) expression formula and the meaning of relevant parameter are same
It is preceding described, it is not repeated herein.
In conjunction with above-mentioned apparatus the 13rd kind to the 15th kind possible implementation in any one possible realization
Mode, in the 16th kind of possible implementation, processor 603 can be counted according to formula (14), formula (15) and formula (16)
Calculate the viewing comfort level of the stereopsis frequency range.Formula (14), formula (15) and formula (16) expression formula and relevant parameter
Meaning as described above, is not repeated herein.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that can be realized by computer program instructions each in flowchart and/or the block diagram
The combination of process and/or box in process and/or box and flowchart and/or the block diagram.It can provide these computers
Processing of the program instruction to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices
Device, so that can be achieved in flow chart by the instruction that the computer or the processor of other programmable data processing devices execute
One process or multiple processes and/or block diagrams one box or multiple boxes in specify function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that instruction stored in the computer readable memory generation includes
The manufacture of command device, the command device are realized in one box of one or more flows of the flowchart and/or block diagram
Or the function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that
Series of operation steps are executed on computer or other programmable devices to generate computer implemented processing, thus calculating
The instruction that is executed on machine or other programmable devices provide for realizing in a process of flow chart or multiple processes and/or
The step of function of being specified in one box or multiple boxes of block diagram.
Although alternative embodiment of the invention has been described, once a person skilled in the art knows basic wounds
The property made concept, then additional changes and modifications may be made to these embodiments.It is wrapped so the following claims are intended to be interpreted as
It includes alternative embodiment and falls into all change and modification of the scope of the invention.
Obviously, various changes and modifications can be made to the invention without departing from of the invention by those skilled in the art
Spirit and scope.In this way, if these modifications and changes of the present invention belongs to the model of the claims in the present invention and its equivalent technologies
Within enclosing, then the present invention is also intended to include these modifications and variations.
Claims (26)
1. a kind of three-dimensional video-frequency Comfort Evaluation method characterized by comprising
Obtain the video frame of stereopsis frequency range；
Estimate the parallax of the video frame of the stereopsis frequency range；
The weight for determining each pixel in the video frame of the stereopsis frequency range determines the position of the pixel with maximum weight
For the visual focus position of the video frame of the stereopsis frequency range；
The visual of the video frame of the stereopsis frequency range is determined according to the visual focus position of the video frame of the stereopsis frequency range
Region；
According to the parallax of the video frame of the stereopsis frequency range and the visible area of the video frame of the stereopsis frequency range, extract
The Spatial characteristic and time domain specification of the video frame of the stereopsis frequency range；
According to the Spatial characteristic and time domain specification of the video frame of the stereopsis frequency range, determine that the viewing of the stereopsis frequency range is relaxed
Appropriateness；
The weight of the pixel is calculated using following formula:
W=γ * | mv |+η * | dispcrossed|+λ*|δd|
Wherein, W is the weight for the pixel that coordinate is (x, y), and γ, η and λ are weighted value；Indicate the seat
It is designated as the plane motion vector of the pixel of (x, y), dxAnd dyThe respectively described coordinate is the horizontal displacement of the pixel of (x, y) and hangs down
Straight displacement, the dxAnd dyWhere video frame and the coordinate where the pixel that the coordinate is (x, y) are the pixel of (x, y)
Video frame adjacent video frames in search obtain；dispcrossedFor crossed disparity value；δ d is the video of the stereopsis frequency range
The difference of the mean parallax of the match block of frame and its adjacent video frames.
2. the method as described in claim 1, which is characterized in that if having maximum weight in the video frame of the stereopsis frequency range
Pixel have it is multiple, then by the multiple pixel with maximum weight, the figure of the video frame apart from the stereopsis frequency range
The position of the nearest pixel in inconocenter position is determined as the visual focus position of the video frame of the stereopsis frequency range.
3. method according to claim 1 or 2, which is characterized in that the Spatial characteristic includes one of following parameter or any
Combination: with reference to parallax, with reference to the percentage of parallax and the first viewing comfort degree factor；
The visible area of the video frame of the parallax and stereopsis frequency range of the video frame according to the stereopsis frequency range,
Extract the Spatial characteristic of the video frame of the stereopsis frequency range, comprising:
Determine the corresponding parallax set of the video frame of the stereopsis frequency range, the parallax collection is combined into the view of the stereopsis frequency range
Pixel parallax set in frequency frame visible area, and the corresponding pixel quantity of each parallax value therein is all larger than given threshold；
Minimum parallax value in the parallax set is determined as to the reference parallax of the video frame of the stereopsis frequency range；
In the visible area for calculating the video frame of the stereopsis frequency range, parallax be the pixel with reference to parallax number with have
The ratio for imitating the number of pixel, obtains the percentage of the reference parallax of the video frame of the stereopsis frequency range, the valid pixel
The parallax absolute value referred to is less than the pixel of search range；
According to the video frame of the stereopsis frequency range with the presence or absence of remote space layout closely upper under frame effect and whether meet, really
The first viewing comfort degree factor of the video frame of the fixed stereopsis frequency range, the first viewing comfort degree factor exist
The video frame of the stereopsis frequency range takes the first value when closely upper remote space layout is not present under frame effect and satisfaction, described vertical
The video frame of stereoscopic frequency range takes second value when closely going up remote space layout there are frame effect but under meeting, in the stereopsis frequency range
Video frame take third value there is no frame effect but when being unsatisfactory for lower closely upper remote space layout, in the view of the stereopsis frequency range
Frequency frame takes the 4th value there are frame effect and when being unsatisfactory for lower closely upper remote space layout, wherein the first value, second value, third value
Be preset value with the 4th value, and the first value is less than the 4th value, third value between the first value and second value and with the first value and the
Two-value is unequal；The frame effect refers to for a video frame, if the parallax for imaging in the object of screen edge is
Crossed disparity, and a part of the object has exceeded screen ranges, then there is frame effect；It is described it is lower it is close on far refer to one
The perception of the perceived depth of the corresponding object for imaging in screen bottom end of video frame object close from spectators, imaging in screen top
Depth is remote from spectators.
4. method according to claim 1 or 2, which is characterized in that the time domain specification includes the second viewing comfort degree
The factor；
The visible area of the video frame of the parallax and stereopsis frequency range of the video frame according to the stereopsis frequency range,
Extract the time domain specification of the video frame of the stereopsis frequency range, comprising:
According to the reference parallax of the video frame of the stereopsis frequency range time domain variation and/or the stereopsis frequency range
Video frame reference parallax occur frequency in the variation of time domain, the second of the video frame of the stereopsis frequency range is calculated
The comfort degree factor is watched, the size of the second viewing comfort degree factor value indicates that the reference parallax of video frame exists
The degree of depth direction variation.
5. method as claimed in claim 4, which is characterized in that existed according to the reference parallax of the video frame of the stereopsis frequency range
The frequency that the reference parallax of the video frame of the variation of time domain and/or the stereopsis frequency range occurs is calculated in the variation of time domain
To the second viewing comfort degree factor of the video frame of the stereopsis frequency range, comprising:
The stereopsis frequency range is subjected to subsegment division, the reference parallax of the video frame in same subsegment is monotonically changed and variation speed
It spends identical, calculates variation of the reference parallax in time domain of the video frame of the stereopsis frequency range according to the following formula:
V1 i=(displast-dispfirst)/(Np-1)
Variation of the frequency in time domain of the reference parallax appearance of the video frame of the stereopsis frequency range is calculated according to the following formula:
The second viewing comfort degree factor of the video frame of the stereopsis frequency range is calculated according to the following formula:
Wherein, V1 iIndicate variation of the reference parallax of the i-th frame in time domain, dispfirstAnd displastSon belonging to respectively the i-th frame
The first frame of section and the reference parallax of last frame, Np are the video frame quantity of the affiliated subsegment of the i-th frame；Indicate the ginseng of the i-th frame
Examine variation of the frequency of parallax appearance in time domain, P (minDispi) and P (minDispi-1) it is respectively the i-th frame and the (i-1)-th frame
With reference to the percentage of parallax；The comfort degree factor is watched for the second of the i-th frame, γ and μ are weighted value；I-th frame is
Any video frame in the stereopsis frequency range.
6. method as claimed in claim 4, which is characterized in that existed according to the reference parallax of the video frame of the stereopsis frequency range
The frequency that the reference parallax of the video frame of the variation of time domain and/or the stereopsis frequency range occurs is calculated in the variation of time domain
To the second viewing comfort degree factor of the video frame of the stereopsis frequency range, comprising:
Variation of the reference parallax in time domain of the video frame of the stereopsis frequency range is calculated according to the following formula:
V1 i=minDispi-minDispi-1
Variation of the frequency in time domain of the reference parallax appearance of the video frame of the stereopsis frequency range is calculated according to the following formula:
The second viewing comfort degree factor of the video frame of the stereopsis frequency range is calculated according to the following formula:
Wherein, V1 iIndicate variation of the reference parallax of the i-th frame in time domain, minDispiAnd minDispi-1Respectively the i-th frame and
The reference parallax of i-1 frame；Indicate variation of the frequency of the reference parallax appearance of the i-th frame in time domain, P (minDispi) and P
(minDispi-1) be respectively the i-th frame and the (i-1)-th frame reference parallax percentage；Second for the i-th frame watches comfort level shadow
The factor is rung, γ and μ are weighted value；I-th frame is any video frame in the stereopsis frequency range.
7. the method as described in any one of claim 1,2,6, which is characterized in that the view according to the stereopsis frequency range
The Spatial characteristic and time domain specification of frequency frame determine the viewing comfort level of the stereopsis frequency range, comprising:
According to the Spatial characteristic and time domain specification of each video frame of the stereopsis frequency range, each described view is calculated separately
The viewing comfort level of frequency frame；
According to the visual focus position of each video frame of the stereopsis frequency range, subsegment is carried out to the stereopsis frequency range and is drawn
Point, the visual focus position transfer amount of the video frame of each subsegment is no more than setting transfer amount threshold value；According to every in each subsegment
The viewing comfort level of a video frame calculates separately the viewing comfort level of each subsegment；
The viewing comfort level of the stereopsis frequency range is calculated according to the viewing comfort level of each subsegment.
8. the method for claim 7, which is characterized in that according to the airspace of each video frame of the stereopsis frequency range
Characteristic and time domain specification calculate separately the viewing comfort level of each video frame, comprising:
The viewing comfort level of the video frame of the stereopsis frequency range is calculated according to the following formula:
Wherein,For the viewing comfort level of the i-th frame, Spatial_frame_vciThe i-th frame determined for the Spatial characteristic of the i-th frame
Viewing comfort level, Temperal_frame_vciFor the viewing comfort level for the i-th frame that the time domain specification of the i-th frame determines, α and β
For weighted value；dispdistribution iFirst for the i-th frame watches the comfort degree factor, minDispiIt is regarded for the reference of the i-th frame
Difference, P (minDispi) be the i-th frame reference parallax percentage；Second for the i-th frame watches the comfort degree factor；b1,
B2 and c1 is model parameter, and described b1, b2 and c1 are setting value；I-th frame is any video in the stereopsis frequency range
Frame；
The reference parallax of the video frame of the stereopsis frequency range obtains in the following manner: determining the video of the stereopsis frequency range
The corresponding parallax set of frame, the parallax collection are combined into the pixel parallax collection in the video frame visible area of the stereopsis frequency range
It closes, and the corresponding pixel quantity of each parallax value therein is all larger than given threshold；By the minimum parallax in the parallax set
Value is determined as the reference parallax of the video frame of the stereopsis frequency range；
The percentage of the reference parallax of the video frame of the stereopsis frequency range are as follows: the visible area of the video frame of the stereopsis frequency range
In domain, parallax is the video frame of the stereopsis frequency range with reference to the number of pixels of parallax and the ratio of valid pixel number；
The first of the video frame of the stereopsis frequency range watches the comfort degree factor according to the video frame of the stereopsis frequency range
It is determined with the presence or absence of remote space layout closely upper under frame effect and whether meet；The frame effect, which refers to, regards one
Frequency frame, if the parallax for imaging in the object of screen edge is crossed disparity, and a part of the object has exceeded screen model
It encloses, then there is frame effect；It is described it is lower it is close on far refer to the perception of the corresponding object for imaging in screen bottom end of a video frame
The perceived depth for the object that depth is close from spectators, images in screen top is remote from spectators；
The second of the video frame of the stereopsis frequency range watches the comfort degree factor according to the video frame of the stereopsis frequency range
The frequency that occurs in the reference parallax of the variation of time domain and/or the video frame of the stereopsis frequency range of reference parallax in time domain
Variation determine that the size of the second viewing comfort degree factor value indicates the reference parallax of video frame in depth side
To the degree of variation.
9. the method for claim 7, which is characterized in that calculate the stereopsis according to the viewing comfort level of each subsegment
The viewing comfort level of frequency range, comprising:
The viewing comfort level of the stereopsis frequency range is calculated according to the following formula:
Wherein, Q is the viewing comfort level of the stereopsis frequency range,For the comfortable journey of k-th of subsegment in the stereopsis frequency range
Degree, NSFor the number of subsegment in the stereopsis frequency range, P2It is setting value with c2.
10. the method as described in any one of claim 1,2,6, which is characterized in that described according to the stereopsis frequency range
The Spatial characteristic and time domain specification of video frame determine the viewing comfort level of the stereopsis frequency range, comprising:
According to the Spatial characteristic of the video frame of the stereopsis frequency range, the Spatial characteristic of the stereopsis frequency range is calculated；
According to the time domain specification of the video frame of the stereopsis frequency range, the time domain specification of the stereopsis frequency range is calculated；
According to the Spatial characteristic and time domain specification of the stereopsis frequency range, the viewing comfort level of the stereopsis frequency range is calculated.
11. method as claimed in claim 10, which is characterized in that the Spatial characteristic of the video frame of the stereopsis frequency range includes
One of following parameter or any combination: the reference parallax of the video frame of the stereopsis frequency range, with reference to the percentage of parallax and
The one viewing comfort degree factor；
In the visible area of the video frame of the stereopsis frequency range, the parallax value for meeting the pixel of the following conditions is the stereopsis
The reference parallax of the video frame of frequency range: described with reference to the corresponding picture of parallax in the visible area of the video frame of the stereopsis frequency range
Element quantity be greater than setting pixel quantity threshold value, and it is described with reference to parallax be parallax set in minimum parallax value；The parallax
Collect the pixel parallax set being combined into the video frame visible area of the stereopsis frequency range, and each parallax value therein is corresponding
Pixel quantity is all larger than given threshold；
The percentage of the reference parallax of the video frame of the stereopsis frequency range are as follows: the visible area of the video frame of the stereopsis frequency range
In domain, parallax is the number of pixels of the reference parallax of the video frame of the stereopsis frequency range and the ratio of valid pixel number；
The first of the video frame of the stereopsis frequency range watches the comfort degree factor according to the video frame of the stereopsis frequency range
It is determined with the presence or absence of remote space layout closely upper under frame effect and whether meet；The frame effect, which refers to, regards one
Frequency frame, if the parallax for imaging in the object of screen edge is crossed disparity, and a part of the object has exceeded screen model
It encloses, then there is frame effect；It is described it is lower it is close on far refer to the perception of the corresponding object for imaging in screen bottom end of a video frame
The perceived depth for the object that depth is close from spectators, images in screen top is remote from spectators；
The Spatial characteristic of the video frame according to the stereopsis frequency range calculates the Spatial characteristic of the stereopsis frequency range, packet
It includes:
The weighted average of the reference parallax of all video frames in the stereopsis frequency range is calculated according to the following formula:
Wherein,For the weighted average of the reference parallax of all video frames in the stereopsis frequency range, N is described
The number of video frame, minDisp in stereopsis frequency rangeiFor the reference parallax of the i-th frame, P (minDispi) regarded for the reference of the i-th frame
The percentage of difference, i-th frame are any video frame in the stereopsis frequency range；
Being averaged for the first viewing comfort degree factor of all video frames in the stereopsis frequency range is calculated according to the following formula
Value:
Wherein,The flat of the comfort degree factor is watched for first of all video frames in the stereopsis frequency range
Mean value, dispdistribution iThe comfort degree factor is watched for the first of the i-th frame, N is video frame in the stereopsis frequency range
Number, i-th frame are any video frame in the stereopsis frequency range.
12. method as claimed in claim 10, which is characterized in that the time domain specification packet of the video frame of the stereopsis frequency range
It includes:
The second viewing comfort degree factor of the video frame of the stereopsis frequency range, the of the video frame of the stereopsis frequency range
Variation and/or institute of the two viewing comfort degree factors according to the reference parallax of the video frame of the stereopsis frequency range in time domain
It states the frequency that the reference parallax of the video frame of stereopsis frequency range occurs to determine in the variation of time domain, the second viewing comfort level
The size of impact factor numerical value indicates the degree that the reference parallax of video frame changes in depth direction；
The time domain specification of the video frame according to the stereopsis frequency range calculates the time domain specification of the stereopsis frequency range, packet
It includes:
The second viewing comfort degree factor of the stereopsis frequency range is calculated according to the following formula:
Wherein,Second for the stereopsis frequency range watches the comfort degree factor,It is in the stereopsis frequency range i-th
The second viewing comfort degree factor of frame, PiFor setting value, PiValue according to V1 iAnd minDispiSymbol determine that N is
The number of video frame in the stereopsis frequency range, i-th frame are any video frame in the stereopsis frequency range.
13. method as claimed in claim 10, which is characterized in that the viewing comfort level of the stereopsis frequency range is using following public
Formula calculates:
VC=α * Spatial_vc+ β * Temperal_vc
Wherein, VC is the viewing comfort level of the stereopsis frequency range, and α and β are weighted value；B1, c3 are setting value；Spatial_vc
For the viewing comfort level for the stereopsis frequency range that Spatial characteristic determines, Temperal_vc is the described vertical of time domain specification decision
The viewing comfort level of stereoscopic frequency range；For the first viewing comfort level of all video frames in the stereopsis frequency range
The average value of impact factor,For the weighted average of the reference parallax of all video frames in the stereopsis frequency range
Value,Second for the stereopsis frequency range watches the comfort degree factor.
14. a kind of three-dimensional video-frequency Comfort Evaluation device characterized by comprising
Module is obtained, for obtaining the video frame of stereopsis frequency range；
Extraction module, the parallax of the video frame for estimating the stereopsis frequency range；Determine the video frame of the stereopsis frequency range
The position for the pixel for having maximum weight is determined as the vision of the video frame of the stereopsis frequency range by the weight of interior each pixel
Focal position；The video frame of the stereopsis frequency range is determined according to the visual focus position of the video frame of the stereopsis frequency range
Visible area；According to the parallax of the video frame of the stereopsis frequency range and the visible area of the video frame of the stereopsis frequency range
The Spatial characteristic and time domain specification of the video frame of the stereopsis frequency range are extracted in domain；
Evaluation module, the Spatial characteristic of the video frame of the stereopsis frequency range for being extracted according to the extraction module and when
Domain characteristic determines the viewing comfort level of the stereopsis frequency range；
The extraction module calculates the weight of the pixel using following formula:
W=γ * | mv |+η * | dispcrossed|+λ*|δd|
Wherein, W is the weight for the pixel that coordinate is (x, y), and γ, η and λ are weighted value；Indicate the seat
It is designated as the plane motion vector of the pixel of (x, y), dxAnd dyThe respectively described coordinate is the horizontal displacement of (x, y) pixel and vertical
Displacement, the dxAnd dyWhere video frame and the coordinate where the pixel that the coordinate is (x, y) are the pixel of (x, y)
Search obtains in the adjacent video frames of video frame；dispcrossedFor crossed disparity value；δ d is the video frame of the stereopsis frequency range
And its difference of the mean parallax of the match block of adjacent video frames.
15. device as claimed in claim 14, which is characterized in that the extraction module is specifically used for, if the three-dimensional video-frequency
There is the pixel of maximum weight to have multiple in the video frame of section, then by the multiple pixel with maximum weight, apart from institute
The position for stating the nearest pixel of image center location of the video frame of stereopsis frequency range, is determined as the video of the stereopsis frequency range
The visual focus position of frame.
16. the device as described in any one of claims 14 or 15, which is characterized in that the Spatial characteristic includes following parameter
One of or any combination: with reference to parallax, with reference to parallax percentage, first viewing the comfort degree factor；
The extraction module is specifically used for, and determines the corresponding parallax set of the video frame of the stereopsis frequency range, the parallax collection
The pixel parallax set being combined into the video frame visible area of the stereopsis frequency range, and the corresponding picture of each parallax value therein
Prime number amount is all larger than given threshold；Minimum parallax value in the parallax set is determined as to the video frame of the stereopsis frequency range
Reference parallax；
In the visible area for calculating the video frame of the stereopsis frequency range, parallax be the pixel with reference to parallax number with have
The ratio for imitating the number of pixel, obtains the percentage of the reference parallax of the video frame of the stereopsis frequency range, the valid pixel
The parallax absolute value referred to is less than the pixel of search range；
According to the video frame of the stereopsis frequency range with the presence or absence of remote space layout closely upper under frame effect and whether meet, really
The first viewing comfort degree factor of the video frame of the fixed stereopsis frequency range, the first viewing comfort degree factor exist
The video frame of the stereopsis frequency range takes the first value when closely upper remote space layout is not present under frame effect and satisfaction, described vertical
The video frame of stereoscopic frequency range takes second value when closely going up remote space layout there are frame effect but under meeting, in the stereopsis frequency range
Video frame take third value there is no frame effect but when being unsatisfactory for lower closely upper remote space layout, in the view of the stereopsis frequency range
Frequency frame takes the 4th value there are frame effect and when being unsatisfactory for lower closely upper remote space layout, wherein the first value, second value, third value
Be preset value with the 4th value, and the first value is less than the 4th value, third value between the first value and second value and with the first value and the
Two-value is unequal；The frame effect refers to for a video frame, if the parallax for imaging in the object of screen edge is
Crossed disparity, and a part of the object has exceeded screen ranges, then there is frame effect；It is described it is lower it is close on far refer to one
The perception of the perceived depth of the corresponding object for imaging in screen bottom end of video frame object close from spectators, imaging in screen top
Depth is remote from spectators.
17. the device as described in any one of claims 14 or 15, which is characterized in that the time domain specification includes the second viewing
The comfort degree factor；
The extraction module is specifically used for, according to the reference parallax of the video frame of the stereopsis frequency range time domain variation, and/
Or the three-dimensional video-frequency is calculated in the variation of time domain in the frequency that the reference parallax of the video frame of the stereopsis frequency range occurs
The second viewing comfort degree factor of the video frame of section, the size of the second viewing comfort degree factor value indicate view
The degree that the reference parallax of frequency frame changes in depth direction.
18. device as claimed in claim 17, which is characterized in that the extraction module is specifically used for, by the three-dimensional video-frequency
Duan Jinhang subsegment divides, and the reference parallax of the video frame in same subsegment is monotonically changed and pace of change is identical, according to following public affairs
Formula calculates variation of the reference parallax in time domain of the video frame of the stereopsis frequency range:
V1 i=(displast-dispfirst)/(Np-1)
Variation of the frequency in time domain of the reference parallax appearance of the video frame of the stereopsis frequency range is calculated according to the following formula:
The second viewing comfort degree factor of the video frame of the stereopsis frequency range is calculated according to the following formula:
Wherein, V1 iIndicate variation of the reference parallax of the i-th frame in time domain, dispfirstAnd displastSon belonging to respectively the i-th frame
The first frame of section and the reference parallax of last frame, Np are the video frame quantity of the affiliated subsegment of the i-th frame；Indicate the ginseng of the i-th frame
Examine variation of the frequency of parallax appearance in time domain, P (minDispi) and P (minDispi-1) it is respectively the i-th frame and the (i-1)-th frame
With reference to the percentage of parallax；The comfort degree factor is watched for the second of the i-th frame, γ and μ are weighted value；I-th frame is
Any video frame in the stereopsis frequency range.
19. device as claimed in claim 17, which is characterized in that the extraction module is specifically used for, and counts according to the following formula
Calculate variation of the reference parallax in time domain of the video frame of the stereopsis frequency range:
V1 i=minDispi-minDispi-1
Variation of the frequency in time domain of the reference parallax appearance of the video frame of the stereopsis frequency range is calculated according to the following formula:
The second viewing comfort degree factor of the video frame of the stereopsis frequency range is calculated according to the following formula:
Wherein, V1 iIndicate variation of the reference parallax of the i-th frame in time domain, minDispiAnd minDispi-1Respectively the i-th frame and
The reference parallax of i-1 frame；Indicate variation of the frequency of the reference parallax appearance of the i-th frame in time domain, P (minDispi) and P
(minDispi-1) be respectively the i-th frame and the (i-1)-th frame reference parallax percentage；Second for the i-th frame watches comfort level shadow
The factor is rung, γ and μ are weighted value, and i-th frame is any video frame in the stereopsis frequency range.
20. the device as described in any one of claim 14,15,19, which is characterized in that the evaluation module is specifically used for:
According to the Spatial characteristic and time domain specification of each video frame of the stereopsis frequency range, each described view is calculated separately
The viewing comfort level of frequency frame；
According to the visual focus position of each video frame of the stereopsis frequency range, subsegment is carried out to the stereopsis frequency range and is drawn
Point, the visual focus position transfer amount of the video frame of each subsegment is no more than setting transfer amount threshold value；According to every in each subsegment
The viewing comfort level of a video frame calculates separately the viewing comfort level of each subsegment；
The viewing comfort level of the stereopsis frequency range is calculated according to the viewing comfort level of each subsegment.
21. device as claimed in claim 20, which is characterized in that the evaluation module is specifically used for, and counts according to the following formula
Calculate the viewing comfort level of the video frame of the stereopsis frequency range:
Wherein,For the viewing comfort level of the i-th frame, Spatial_frame_vciThe i-th frame determined for the Spatial characteristic of the i-th frame
Viewing comfort level, Temperal_frame_vciFor the viewing comfort level for the i-th frame that the time domain specification of the i-th frame determines, α and β
For weighted value；dispdistribution iFirst for the i-th frame watches the comfort degree factor, minDispiIt is regarded for the reference of the i-th frame
Difference, P (minDispi) be the i-th frame reference parallax percentage；Second for the i-th frame watches the comfort degree factor；b1,
B2 and c1 is model parameter, and described b1, b2 and c1 are setting value, and i-th frame is any video in the stereopsis frequency range
Frame；
The reference parallax of the video frame of the stereopsis frequency range obtains in the following manner: determining the video of the stereopsis frequency range
The corresponding parallax set of frame, the parallax collection are combined into the pixel parallax collection in the video frame visible area of the stereopsis frequency range
It closes, and the corresponding pixel quantity of each parallax value therein is all larger than given threshold；By the minimum parallax in the parallax set
Value is determined as the reference parallax of the video frame of the stereopsis frequency range；
The percentage of the reference parallax of the video frame of the stereopsis frequency range are as follows: the visible area of the video frame of the stereopsis frequency range
In domain, parallax is the video frame of the stereopsis frequency range with reference to the number of pixels of parallax and the ratio of valid pixel number；
The first of the video frame of the stereopsis frequency range watches the comfort degree factor according to the video frame of the stereopsis frequency range
It is determined with the presence or absence of remote space layout closely upper under frame effect and whether meet；The frame effect, which refers to, regards one
Frequency frame, if the parallax for imaging in the object of screen edge is crossed disparity, and a part of the object has exceeded screen model
It encloses, then there is frame effect；It is described it is lower it is close on far refer to the perception of the corresponding object for imaging in screen bottom end of a video frame
The perceived depth for the object that depth is close from spectators, images in screen top is remote from spectators；
The second of the video frame of the stereopsis frequency range watches the comfort degree factor according to the video frame of the stereopsis frequency range
The frequency that occurs in the reference parallax of the variation of time domain and/or the video frame of the stereopsis frequency range of reference parallax in time domain
Variation determine that the size of the second viewing comfort degree factor value indicates the reference parallax of video frame in depth side
To the degree of variation.
22. device as claimed in claim 20, which is characterized in that the evaluation module is specifically used for, and counts according to the following formula
Calculate the viewing comfort level of the stereopsis frequency range:
Wherein, Q is the viewing comfort level of the stereopsis frequency range,For the comfortable journey of k-th of subsegment in the stereopsis frequency range
Degree, NSFor the number of subsegment in the stereopsis frequency range, P2It is setting value with c2.
23. the device as described in any one of claim 14,15,19, which is characterized in that the evaluation module is specifically used for:
According to the Spatial characteristic of the video frame of the stereopsis frequency range, the Spatial characteristic of the stereopsis frequency range is calculated；
According to the time domain specification of the video frame of the stereopsis frequency range, the time domain specification of the stereopsis frequency range is calculated；
According to the Spatial characteristic and time domain specification of the stereopsis frequency range, the viewing comfort level of the stereopsis frequency range is calculated.
24. device as claimed in claim 23, which is characterized in that the Spatial characteristic of the video frame of the stereopsis frequency range includes
One of following parameter or any combination: the reference parallax of the video frame of the stereopsis frequency range, with reference to the percentage of parallax and
The one viewing comfort degree factor；
In the visible area of the video frame of the stereopsis frequency range, the parallax value for meeting the pixel of the following conditions is the stereopsis
The reference parallax of the video frame of frequency range: described with reference to the corresponding picture of parallax in the visible area of the video frame of the stereopsis frequency range
Element quantity be greater than setting pixel quantity threshold value, and it is described with reference to parallax be parallax set in minimum parallax value；The parallax
Collect the pixel parallax set being combined into the video frame visible area of the stereopsis frequency range, and each parallax value therein is corresponding
Pixel quantity is all larger than given threshold；
The percentage of the reference parallax of the video frame of the stereopsis frequency range are as follows: the visible area of the video frame of the stereopsis frequency range
In domain, parallax is the number of pixels of the reference parallax of the video frame of the stereopsis frequency range and the ratio of valid pixel number；
The first of the video frame of the stereopsis frequency range watches the comfort degree factor according to the video frame of the stereopsis frequency range
It is determined with the presence or absence of remote space layout closely upper under frame effect and whether meet；The frame effect, which refers to, regards one
Frequency frame, if the parallax for imaging in the object of screen edge is crossed disparity, and a part of the object has exceeded screen model
It encloses, then there is frame effect；It is described it is lower it is close on far refer to the perception of the corresponding object for imaging in screen bottom end of a video frame
The perceived depth for the object that depth is close from spectators, images in screen top is remote from spectators；
The evaluation module is specifically used for, and calculates the reference parallax of all video frames in the stereopsis frequency range according to the following formula
Weighted average:
Wherein,For the weighted average of the reference parallax of all video frames in the stereopsis frequency range, N is described
The number of video frame, minDisp in stereopsis frequency rangeiFor the reference parallax of the i-th frame, P (minDispi) regarded for the reference of the i-th frame
The percentage of difference, i-th frame are any video frame in the stereopsis frequency range；
Being averaged for the first viewing comfort degree factor of all video frames in the stereopsis frequency range is calculated according to the following formula
Value:
Wherein,The flat of the comfort degree factor is watched for first of all video frames in the stereopsis frequency range
Mean value, dispdistribution iThe comfort degree factor is watched for the first of the i-th frame, N is video frame in the stereopsis frequency range
Number, i-th frame are any video frame in the stereopsis frequency range.
25. device as claimed in claim 23, which is characterized in that the time domain specification packet of the video frame of the stereopsis frequency range
It includes:
The second viewing comfort degree factor of the video frame of the stereopsis frequency range, the of the video frame of the stereopsis frequency range
Variation and/or institute of the two viewing comfort degree factors according to the reference parallax of the video frame of the stereopsis frequency range in time domain
It states the frequency that the reference parallax of the video frame of stereopsis frequency range occurs to determine in the variation of time domain, the second viewing comfort level
The size of impact factor numerical value indicates the degree that the reference parallax of video frame changes in depth direction；
The evaluation module is specifically used for, calculate according to the following formula the stereopsis frequency range second viewing comfort degree because
Son:
Wherein,Second for the stereopsis frequency range watches the comfort degree factor,It is in the stereopsis frequency range i-th
The second viewing comfort degree factor of frame, PiFor setting value, PiValue according to V1 iAnd minDispiSymbol determine that N is
The number of video frame in the stereopsis frequency range, i-th frame are any video frame in the stereopsis frequency range.
26. device as claimed in claim 23, which is characterized in that the evaluation module is specifically used for, and counts according to the following formula
Calculate the viewing comfort level of the stereopsis frequency range:
VC=α * Spatial_vc+ β * Temperal_vc
Wherein, VC is the viewing comfort level of the stereopsis frequency range, and α and β are weighted value；B1, c3 are setting value；Spatial_vc
For the viewing comfort level for the stereopsis frequency range that Spatial characteristic determines, Temperal_vc is the described vertical of time domain specification decision
The viewing comfort level of stereoscopic frequency range；For the first viewing comfort level of all video frames in the stereopsis frequency range
The average value of impact factor,For the weighted average of the reference parallax of all video frames in the stereopsis frequency range
Value,Second for the stereopsis frequency range watches the comfort degree factor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710203858.1A CN107155105B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710203858.1A CN107155105B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
| CN201310740605.XA CN104754322B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310740605.XA Division CN104754322B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107155105A CN107155105A (en) | 2017-09-12 |
| CN107155105B true CN107155105B (en) | 2019-03-01 |
Family
ID=53477473
Family Applications (5)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710203858.1A Active CN107155105B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
| CN201710203860.9A Active CN107181940B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
| CN201710204296.2A Active CN106973288B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
| CN201710203859.6A Active CN107155106B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
| CN201310740605.XA Active CN104754322B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
Family Applications After (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710203860.9A Active CN107181940B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
| CN201710204296.2A Active CN106973288B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
| CN201710203859.6A Active CN107155106B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
| CN201310740605.XA Active CN104754322B (en) | 2013-12-27 | 2013-12-27 | A kind of three-dimensional video-frequency Comfort Evaluation method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (5) | CN107155105B (en) |
| WO (1) | WO2015096461A1 (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106341677B (en) * | 2015-07-07 | 2018-04-20 | 中国科学院深圳先进技术研究院 | Virtual view method for evaluating video quality |
| CN105335992B (en) * | 2015-10-15 | 2020-02-04 | 北京邮电大学 | Three-dimensional animation scene frame scoring model determination method and device |
| CN106028025B (en) * | 2016-05-11 | 2017-11-21 | 吉林大学 | A kind of 3D video comfort degree evaluation methods for influx and regulation uniformity |
| CN106210710B (en) * | 2016-07-25 | 2018-01-30 | 宁波大学 | A kind of stereo image vision comfort level evaluation method based on multi-scale dictionary |
| CN106851246B (en) * | 2017-02-06 | 2019-08-23 | 京东方科技集团股份有限公司 | Method and apparatus for determining the visual fatigue degree of 3-D image or video |
| CN109429051B (en) * | 2017-07-12 | 2020-08-18 | 天津大学 | Non-reference stereo video quality objective evaluation method based on multi-view feature learning |
| CN107909565A (en) * | 2017-10-29 | 2018-04-13 | 天津大学 | Stereo-picture Comfort Evaluation method based on convolutional neural networks |
| CN109905694B (en) * | 2017-12-08 | 2020-09-08 | 中移（杭州）信息技术有限公司 | Quality evaluation method, device and equipment for stereoscopic video |
| CN109089111B (en) * | 2018-10-22 | 2020-05-26 | Oppo广东移动通信有限公司 | Method and system for evaluating comfort level of stereoscopic video and terminal equipment |
| CN110691236B (en) * | 2019-09-18 | 2021-05-07 | 宁波大学 | Panoramic video quality evaluation method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582063A (en) * | 2008-05-13 | 2009-11-18 | 华为技术有限公司 | Video service system, video service device and extraction method for key frame thereof |
| KR20110139020A (en) * | 2010-06-22 | 2011-12-28 | 연세대학교 산학협력단 | Fatigue evaluation method and apparatus for 3d video based on depth map |
| CN103096122A (en) * | 2013-01-24 | 2013-05-08 | 上海交通大学 | Stereoscopic vision comfort level evaluation method based on motion features inside area of interest |
| CN103210652A (en) * | 2010-11-12 | 2013-07-17 | 索尼公司 | 3d video image encoding apparatus, decoding apparatus and method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101682208B1 (en) * | 2010-10-22 | 2016-12-02 | 삼성전자주식회사 | Display apparatus and method |
| KR101960844B1 (en) * | 2011-11-01 | 2019-03-22 | 삼성전자주식회사 | Image processing apparatus and method |
| CN103096125B (en) * | 2013-02-22 | 2015-03-04 | 吉林大学 | Stereoscopic video visual comfort evaluation method based on region segmentation |
| CN103595990B (en) * | 2013-10-30 | 2015-05-20 | 清华大学 | Method for obtaining binocular stereoscopic video comfort level of motion perception |
-
2013
- 2013-12-27 CN CN201710203858.1A patent/CN107155105B/en active Active
- 2013-12-27 CN CN201710203860.9A patent/CN107181940B/en active Active
- 2013-12-27 CN CN201710204296.2A patent/CN106973288B/en active Active
- 2013-12-27 CN CN201710203859.6A patent/CN107155106B/en active Active
- 2013-12-27 CN CN201310740605.XA patent/CN104754322B/en active Active
-
2014
- 2014-07-11 WO PCT/CN2014/082079 patent/WO2015096461A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582063A (en) * | 2008-05-13 | 2009-11-18 | 华为技术有限公司 | Video service system, video service device and extraction method for key frame thereof |
| KR20110139020A (en) * | 2010-06-22 | 2011-12-28 | 연세대학교 산학협력단 | Fatigue evaluation method and apparatus for 3d video based on depth map |
| CN103210652A (en) * | 2010-11-12 | 2013-07-17 | 索尼公司 | 3d video image encoding apparatus, decoding apparatus and method |
| CN103096122A (en) * | 2013-01-24 | 2013-05-08 | 上海交通大学 | Stereoscopic vision comfort level evaluation method based on motion features inside area of interest |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106973288A (en) | 2017-07-21 |
| CN107155106B (en) | 2019-03-01 |
| CN107181940B (en) | 2019-05-03 |
| CN107181940A (en) | 2017-09-19 |
| CN104754322A (en) | 2015-07-01 |
| CN106973288B (en) | 2019-08-13 |
| CN107155105A (en) | 2017-09-12 |
| WO2015096461A1 (en) | 2015-07-02 |
| CN104754322B (en) | 2018-01-23 |
| CN107155106A (en) | 2017-09-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107155105B (en) | A kind of three-dimensional video-frequency Comfort Evaluation method and device | |
| Mittal et al. | Algorithmic assessment of 3D quality of experience for images and videos | |
| CN103096125B (en) | Stereoscopic video visual comfort evaluation method based on region segmentation | |
| Nojiri et al. | Measurement of parallax distribution and its application to the analysis of visual comfort for stereoscopic HDTV | |
| CN103986925B (en) | based on the stereoscopic video visual comfort evaluation method of luminance compensation | |
| Urvoy et al. | NAMA3DS1-COSPAD1: Subjective video quality assessment database on coding conditions introducing freely available high quality 3D stereoscopic sequences | |
| US10110872B2 (en) | Method and device for correcting distortion errors due to accommodation effect in stereoscopic display | |
| CN108449596A (en) | A kind of 3D stereo image quality appraisal procedures of fusion aesthetics and comfort level | |
| Wang et al. | Perceptual quality of asymmetrically distorted stereoscopic images: the role of image distortion types | |
| CN104509087A (en) | Binocular visual experience enrichment system | |
| Chen et al. | Study of subject agreement on stereoscopic video quality | |
| Kim et al. | Depth map quality metric for three-dimensional video | |
| Barkowsky et al. | Is visual fatigue changing the perceived depth accuracy on an autostereoscopic display? | |
| Xing et al. | Estimating quality of experience on stereoscopic images | |
| Xing et al. | An objective metric for assessing quality of experience on stereoscopic images | |
| KR101889952B1 (en) | Stereo matiching method and device based on confidence metric | |
| Cho et al. | The measurement of eyestrain caused from diverse binocular disparities, viewing time and display sizes in watching stereoscopic 3D content | |
| Chen et al. | Full-reference quality assessment of stereoscopic images by modeling binocular rivalry | |
| CN110060291B (en) | Three-dimensional apparent distance resolving method considering human factors | |
| Cho et al. | An Analysis of Visual Discomfort Caused by Watching Stereoscopic 3D Content in Terms of Depth, Viewing Time and Display Size. | |
| CN112367512B (en) | RDK stereoscopic vision detection system and use method thereof | |
| Bokov et al. | Toward fully automatic channel-mismatch detection and discomfort prediction for S3D video | |
| Jung et al. | Visualizing the perceived discomfort of stereoscopic video | |
| CN110944166B (en) | Objective evaluation method for stereoscopic image visual satisfaction | |
| Wang et al. | Study of center-bias in the viewing of stereoscopic image and a framework for extending 2D visual attention models to 3D |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |