CN107155105A - A kind of three-dimensional video-frequency Comfort Evaluation method and device - Google Patents

A kind of three-dimensional video-frequency Comfort Evaluation method and device Download PDF

Info

Publication number
CN107155105A
CN107155105A CN201710203858.1A CN201710203858A CN107155105A CN 107155105 A CN107155105 A CN 107155105A CN 201710203858 A CN201710203858 A CN 201710203858A CN 107155105 A CN107155105 A CN 107155105A
Authority
CN
China
Prior art keywords
frame
video
frequency range
stereopsis frequency
parallax
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710203858.1A
Other languages
Chinese (zh)
Other versions
CN107155105B (en
Inventor
杨付正
孙李娜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201710203858.1A priority Critical patent/CN107155105B/en
Publication of CN107155105A publication Critical patent/CN107155105A/en
Application granted granted Critical
Publication of CN107155105B publication Critical patent/CN107155105B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/144—Processing image signals for flicker reduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H04N2013/0081—Depth or disparity estimation from stereoscopic image signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Image Analysis (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Studio Devices (AREA)

Abstract

This application discloses a kind of three-dimensional video-frequency Comfort Evaluation method and device.This method includes：Obtain the frame of video of stereopsis frequency range；Extract the Spatial characteristic and time domain specification of the frame of video of the stereopsis frequency range；According to the Spatial characteristic and time domain specification of the frame of video of the stereopsis frequency range, the viewing comfort level of the stereopsis frequency range is determined.It can be achieved to evaluate the comfort level of three-dimensional video-frequency using the present invention.

Description

A kind of three-dimensional video-frequency Comfort Evaluation method and device
Technical field
The present invention relates to the video technique of the communications field, more particularly to a kind of three-dimensional video-frequency Comfort Evaluation method and dress Put.
Background technology
Three-dimensional video-frequency generally has two video channels, can make right and left eyes that two width are respectively seen using anaglyph spectacles different Picture, makes the point (on screen) of eye focus and Binocular vison congruence accumulation (before or after screen) not in one plane, so that Produce the 3D pictures with certain depth of field.When this 3D Display Techniques based on binocular parallax principle normally watch object with people, The physiological status for focusing on and converging on a point is different, therefore can cause visual fatigue for a long time.
The comfortableness of three-dimensional video-frequency is to influence one of subject matter of three-dimensional video-frequency development, improves three-dimensional video-frequency viewing and relaxes The premise of appropriateness is to evaluate the comfort level of three-dimensional video-frequency.
The content of the invention
The embodiments of the invention provide a kind of three-dimensional video-frequency Comfort Evaluation method and device, to realize to stereopsis The comfort level of frequency is evaluated.
First aspect includes there is provided a kind of three-dimensional video-frequency Comfort Evaluation method, this method：
Obtain the frame of video of stereopsis frequency range；
Estimate the parallax of the frame of video of the stereopsis frequency range；
The weights of each pixel in the frame of video of the stereopsis frequency range are determined, by the position of the pixel with maximum weights Put the visual focus position for the frame of video for being defined as the stereopsis frequency range；
The frame of video of the stereopsis frequency range is determined according to the visual focus position of the frame of video of the stereopsis frequency range Viewing area；
According to the parallax of the frame of video of the stereopsis frequency range and the visible area of the frame of video of the stereopsis frequency range Domain, extracts the Spatial characteristic and time domain specification of the frame of video of the stereopsis frequency range；
According to the Spatial characteristic and time domain specification of the frame of video of the stereopsis frequency range, the stereopsis frequency range is determined Watch comfort level；
The weights of the pixel are calculated using equation below：
W=γ * | mv |+η * | dispcrossed|+λ*|δd|
Wherein, W is the weights for the pixel that coordinate is (x, y), and γ, η and λ are weighted value；Represent The coordinate is the plane motion vector of the pixel of (x, y), dxAnd dyRespectively described coordinate is the horizontal position of the pixel of (x, y) Move and vertical displacement, the dxAnd dyFrame of video and the picture that the coordinate is (x, y) where the pixel that the coordinate is (x, y) The adjacent video frame in search of frame of video where element is obtained；dispcrossedFor crossed disparity value；δ d are the three-dimensional video-frequency The difference of the mean parallax of the frame of video of section and its match block of adjacent video frames.
Second aspect there is provided a kind of three-dimensional video-frequency Comfort Evaluation device, including：
Acquisition module, the frame of video for obtaining stereopsis frequency range；
Extraction module, the parallax of the frame of video for estimating the stereopsis frequency range；Determine regarding for the stereopsis frequency range The weights of each pixel of frequency frame in, the position of the pixel with maximum weights are defined as the frame of video of the stereopsis frequency range Visual focus position；The stereopsis frequency range is determined according to the visual focus position of the frame of video of the stereopsis frequency range The viewing area of frame of video；According to the parallax of the frame of video of the stereopsis frequency range and the frame of video of the stereopsis frequency range Viewing area, extract the Spatial characteristic and time domain specification of the frame of video of the stereopsis frequency range；
Evaluation module, the spatial domain for the frame of video for the stereopsis frequency range extracted according to the extraction module is special Property and time domain specification, determine the viewing comfort level of the stereopsis frequency range.
The extraction module calculates the weights of the pixel using equation below：
W=γ * | mv |+η * | dispcrossed|+λ*|δd|
Wherein, W is the weights for the pixel that coordinate is (x, y), and γ, η and λ are weighted value；Represent The coordinate is the plane motion vector of the pixel of (x, y), dxAnd dyRespectively described coordinate is the horizontal displacement of (x, y) pixel And vertical displacement, the dxAnd dyFrame of video and the pixel that the coordinate is (x, y) where the pixel that the coordinate is (x, y) The adjacent video frame in search of the frame of video at place is obtained；dispcrossedFor crossed disparity value；δ d are the stereopsis frequency range Frame of video and its adjacent video frames match block mean parallax difference.
In the above embodiment of the present invention, by detecting the Spatial characteristic and time domain specification of frame of video in stereopsis frequency range, And the viewing comfort level of whole stereopsis frequency range is evaluated according to the Spatial characteristic and time domain specification of frame of video.The present invention The three-dimensional video-frequency Comfort Evaluation scheme that embodiment is proposed considers disparity space distribution (i.e. Spatial characteristic) and Annual distribution The influence of (i.e. time domain specification) to three-dimensional video-frequency comfort level, and can protrude influence of the poor frame of comfort level to global comfort, So as to more objectively evaluate three-dimensional video-frequency comfort level.
Brief description of the drawings
Fig. 1 is three-dimensional video-frequency Comfort Evaluation schematic flow sheet provided in an embodiment of the present invention；
Fig. 2 is that single frames frequency domain characteristic provided in an embodiment of the present invention and time domain specification extract schematic flow sheet；
Fig. 3 is single frames frequency domain characteristic and the time domain specification provided in an embodiment of the present invention of being based on to three-dimensional video-frequency section comfort level The schematic flow sheet evaluated；
Fig. 4 for another embodiment of the present invention provide based on single frames frequency domain characteristic and time domain specification to three-dimensional video-frequency Duan Shu The schematic flow sheet that appropriateness is evaluated；
Fig. 5 is three-dimensional video-frequency Comfort Evaluation schematic device provided in an embodiment of the present invention；
The three-dimensional video-frequency Comfort Evaluation schematic device that Fig. 6 provides for another embodiment of the present invention.
Embodiment
The embodiment of the present invention obtains the disparity map for the frame of video that stereopsis frequency range is included first, then extracts frame of video Spatial characteristic and time domain specification, the comfort level of whole section is obtained by Comfort Evaluation model.What the embodiment of the present invention was proposed relaxes Appropriate evaluation method, it is contemplated that influence of the change of object time domain parallax size and frequency to three-dimensional video-frequency comfort level.See It is many during viewing video, the influence of second-rate fragment often to overall viewing experience is bigger, and prior art is unable to body Reveal the influence of poor frames or poor fragment, and the appraisal procedure that the embodiment of the present invention is proposed, comfort level can be protruded poor The influence of frame.
In order that the object, technical solutions and advantages of the present invention are clearer, below in conjunction with accompanying drawing the present invention is made into One step it is described in detail, it is clear that described embodiment is only embodiment of the invention a part of, rather than whole implementation Example.Based on the embodiment in the present invention, what those of ordinary skill in the art were obtained under the premise of creative work is not made All other embodiment, belongs to the scope of protection of the invention.
It is three-dimensional video-frequency Comfort Evaluation schematic flow sheet provided in an embodiment of the present invention referring to Fig. 1, as illustrated, should Flow may include：
Step 101：Obtain the frame of video of stereopsis frequency range to be evaluated.
Step 102：Extract the Spatial characteristic and time domain specification of the frame of video of the stereopsis frequency range.
Step 103：According to the Spatial characteristic and time domain specification of the frame of video of the stereopsis frequency range, the three-dimensional video-frequency is determined The viewing comfort level of section.
In step 102, it may be accomplished by：For each frame of video of stereopsis frequency range, following grasp is performed Make：Estimate the parallax of the frame of video, the visual focus position of the frame of video is determined according to the parallax and movable information of the frame of video Put, the viewing area of the frame of video determined according to the visual focus position of the frame of video, according to the parallax of the frame of video and should The viewing area of frame of video.Step 102 is illustrated in order to clearer, Fig. 2 shows that one kind of step 102 in Fig. 1 can Implementation is selected, the flow may include：
Step 201：I values are initialized, that is, i=1 is set.
Step 202：Estimate the parallax of the i-th frame.
Generally, each frame of three-dimensional video-frequency includes left-eye image and eye image, referred to as stereo pairs.In frame of video The parallax of one pixel refers to the distance between the pixel of a stereo image pair matching, and usual crossed disparity is negative, non-crossing Parallax is just.The Disparity estimation of three-dimensional video-frequency has a variety of, and optional Stereo Matching Algorithm of the embodiment of the present invention carries out parallax Estimation, such as obtain dense disparity map using the Stereo Matching Algorithm based on color segmentation.Obtained by Stereo Matching Algorithm After parallax, can also further be filtered, to remove the Mismatching point in disparity map, so as to get disparity map it is smooth, even It is continuous, accurate.When it is implemented, medium filtering can be used to remove abnormity point.
During dense disparity map is obtained using the Stereo Matching Algorithm based on color segmentation, it usually needs definition Search window, Stereo matching (pixel for searching for matching) is carried out according to the search window of definition.Such as, using current pixel as Benchmark search for respectively to the left and to the right 32 pixels (now hunting zone is 32, the scope of parallax for -32~32), i.e., at this The pixel matched with current pixel is searched in hunting zone., can be with according to the difference of video-frequency band content in the embodiment of the present invention Adjust the size of search window.The size of search window is except, overall parallax also with frame of video relevant with the resolution ratio of video Size is related.If search window is too small, partial pixel can be caused to can not find matched pixel；If window is too big, the probability of error hiding It can increase, the obtained disparity map degree of accuracy is relatively low.To avoid above mentioned problem, the big I and the parallax of frame of video of search window Amplitude is close.
During using Stereo Matching Algorithm estimating disparity based on color segmentation, it is possible to which some pixels cannot get parallax, than Such as, when there are problems that, partial pixel can not obtain parallax.To solve in the problem, the embodiment of the present invention, entering During row Stereo matching, if certain pixel does not find matching pixel, the parallax of the pixel can be may be configured as experience Value, shows not find the pixel of matching, such as, exemplified by being still 32 by above-mentioned hunting zone, if not searching for current pixel The pixel of matching, then be set to hunting zone by the parallax of the current pixel and plus one, that is, be set to 33.
Step 203：According to the parallax and movable information of the i-th frame, the visual focus position of the i-th frame is determined.
In the step, the weights of each pixel of the i-th frame in are can first determine that, by the position of the pixel with maximum weights It is defined as the visual focus position of the i-th frame.Further, can be by if the pixel that the i-th frame in has maximum weights has multiple In the plurality of pixel with maximum weights, the position of the nearest pixel of the image center location of the frame of distance i-th is defined as i-th The visual focus position of frame.
Due to motion (motion of such as plane motion and/or depth direction) more violent in video and larger friendship Fork parallax easily causes the attention of spectators, therefore the embodiment of the present invention is when calculating the weights of pixel, can be according in frame of video Plane motion (including horizontal movement and vertical movement), the motion of depth direction and crossed disparity with pixel are calculated. Wherein, crossed disparity refers to image objects in front of screen.
Specifically, the weights of the i-th frame in pixel can be calculated according to below equation：
W=γ * | mv |+η * | dispcrossed|+λ*|δd|………………………………[1]
Wherein, W is the weights for the pixel that coordinate is (x, y), and γ, η and λ are weighted value, and γ, η and λ sum can be with values For 1, optionally, γ=0.2, η=0.4, λ=0.4；Mv represents plane motion vector, and mv size shows the play of plane motion Strong degree,Denotation coordination is the plane motion vector of the pixel of (x, y), dxAnd dyRespectively the i-th frame Interior coordinate is the horizontal displacement and vertical displacement of (x, y) pixel, the dxAnd dyIn the adjacent video frames of the i-th frame and the i-th frame Search is obtained in (adjacent video frames of i-th frame are, for example, the i-th -1 frame or i+1 frame), such as, by comparing in the i-th frame Coordinate of the coordinate for the pixel of (x, y) and with the pixel of the pixel matching in the i-th -1 frame, can obtain the d of the pixelxWith dy；dispcrossedFor crossed disparity value, for each pixel, the disp only when its parallax is crossed disparitycrossedJust have Value, if the parallax of pixel is non-crossing, by dispcrossedValue is 0；δ d are the adjacent video frames of the i-th frame and the i-th frame The difference of the mean parallax of the match block of (adjacent video frames of i-th frame are, for example, the i-th -1 frame or i+1 frame), δ d's is big The small speed for showing depth direction motion.
Step 204：The viewing area of the frame of video is determined according to the visual focus position of the i-th frame.
In the step, after frame of video i visual focus position is determined, can according to human eye differentiate the ken and viewing away from From determination image visual region.In the embodiment of the present invention, can optionally take centered on focus, the area in 15 ° of angulars field of view Domain is viewing area.Such as, the resolution ratio of a stereopsis frequency range is a frame of video in 640*480, the stereopsis frequency range Viewing area may be in 350*262 pixel coverages.
Step 205：According to the parallax of the i-th frame and the viewing area of the frame of video, extract the i-th frame Spatial characteristic and Time domain specification.
In the embodiment of the present invention, the Spatial characteristic of a frame of video may include one of following parameter or any combination：This is regarded The reference parallax (the reference parallax of the i-th frame is expressed as minDisp below) of frequency frame, with reference to the percentage (following presentation of parallax For P (minDisp)), the order of severity of frame effect, whether meet " lower near remote " space layout.Wherein：
The reference parallax minDisp of frame of video, can be the minimum pixel parallax value in the viewing area of frame of video.Enter One step, it is contemplated that the phenomenon of error hiding is there may be in Stereo matching, the parallax for sometimes having some pixels is extremely big Or it is abnormal small, but these pixels are all often some discrete, negligible amounts pixels.But in fact, for same For object, the pixel parallax of adjacent area all should be same or like, therefore just recognize during the negligible amounts of pixel parallax It is inaccurate for the matching of these pixels, therefore can be after the abnormal pixel of these parallaxes is excluded, according to remaining pixel Parallax selects minimum parallax, is used as the reference parallax of the frame of video.Such as, it can be removed in the viewing area of the frame of video Minimum value in the parallax of other pixels beyond noise pixel, is defined as the reference parallax of the frame of video；Wherein, for Each parallax value of noise pixel, its corresponding pixel (i.e. the pixel with the parallax value) quantity is less than setting pixel count Measure threshold value.This way it is possible to avoid some noises are to the selection with reference to parallax, and then improve the accuracy that comfort level is assessed.
With reference to the percentage P (minDisp) of parallax, refer in the viewing area of frame of video, parallax value is to refer to parallax minDispiNumber of pixels and valid pixel number ratio, wherein, the parallax absolute value of valid pixel is less than search model Enclose.During Stereo matching, there is the phenomenon of some pixel matchings failure, now the parallax of the pixel is arranged to one really Fixed empirical value indicates that the pixel matching fails, such as before described hunting zone when being 32, by the pixel that it fails to match Parallax value be set to 33.Effective disparity range size limit for [- 32,32] due to search window, thus parallax [- 32,32] pixel in is the pixel that the match is successful, i.e. valid pixel, and pixel of the parallax not in [- 32,32] is as invalid Pixel, i.e. error hiding pixel, such as parallax are error hiding pixel for 33 pixel.
Frame effect, refers to, for a frame of video, (screen edge be imaged in if located in the object of screen edge Object) parallax be crossed disparity (i.e. image objects in screen front), and object a part beyond screen ranges, Then there is frame effect (frame-effect) in the frame of video, and this can make spectators produce extremely uncomfortable sensation in viewing.
" lower nearly remote (bottom-up) ", refers to that the object of the corresponding screen bottom of a frame of video (images in screen The object of curtain bottom) perceived depth is near from spectators, screen top object (object for imaging in screen top) perception is deep Spend remote from spectators.The frame of video for meeting the space layout of " lower near remote " is not easily caused visual fatigue.
When it is implemented, viewing comfort degree factor disp can be useddistribution(it can be described as the first viewing comfort level Factor of influence) represent the order of severity of frame effect and whether meet " lower near remote " space layout.With reference to parallax, ginseng Examine the percentage of parallax, and dispdistributionReflect the space distribution situation of parallax in frame of video.
Below by taking the i-th frame as an example, illustrate the reference parallax minDisp of frame of video, the percentage P with reference to parallax , and disp (minDisp)distributionComputational methods.
For the i-th frame, determine that it refers to parallax minDispiMethod can be：Own in the viewing area of the i-th frame In the parallax of pixel, minimum value is chosen as the value of the reference parallax of the i-th frame.Another optional implementation can be： The corresponding parallax set of the i-th frame is determined, the parallax collection is combined into the pixel parallax set in institute i frames viewing area, and therein every The corresponding pixel quantity of individual parallax value is all higher than the given threshold；Minimum parallax value in the parallax set is defined as i-th The minDisp of framei.Such as, in the statistical window of N*N (N is pixel quantity), minimum parallax is taken, judges that there is this most to neglect Whether the pixel quantity of difference is more than threshold value 0.875*N*N, if being more than, the reference of minimum parallax as i-th frame is regarded Difference；If being less than, the minimum value in remaining parallax in addition to the minimum parallax is chosen again in the statistical window, judge tool Have the minimum value pixel quantity whether be more than threshold value 0.875*N*N, if being more than, using the minimum parallax as the i-th frame ginseng Parallax is examined, otherwise the minimum value is excluded with reference to aforesaid way, one minimum value of reselection in remaining parallax, and with reference to upper The mode of stating is judged and handled.
For the i-th frame, with reference to parallax percentage P (minDisp) can be by calculating the i-th frame viewing area in, parallax To refer to parallax minDispiNumber of pixels and the ratio of valid pixel number be worth to.
, can be by detecting in the corresponding screen edge certain limit of the i-th frame, if there is being less than for concentration for the i-th frame The crossed disparity of parallax value is set, to determine that the i-th frame whether there is frame effect.Such as, can be in screen edge for the i-th frame In certain limit, whether the number for being less than setting parallax thresholding T crossed disparity by N*N search window detection is more than threshold Value 0.75*N*N, if it is greater, then judging that the i-th frame has frame effect, otherwise judges that frame effect is not present in the i-th frame.Its In, thresholding T value requirement is less than " comfort zone " lower bound, and " comfort zone " scope and point of video The series of factors such as resolution, human eye interpupillary distance, viewing distance are related, therefore thresholding T value is not a fixed value, selectable value Also it is related to the resolution ratio of video." comfort zone " refer to：When parallax is less than certain limit, human eye will not produce vision Under fatigue, such as current video resolution ratio " comfort zone " be -5pixels, 8 pixels], then thresholding T value should Less than -5.Such as, for the frame of video that resolution ratio is 640*480, in the range of screen edge 5%, if 20*20's The number that the crossed disparity less than -5 is detected in window is more than 300, then judges that the frame of video has frame effect.
For the i-th frame, the i-th frame can be divided into three regions according to a certain percentage, by comparing in three regions effectively The magnitude relationship of the mean parallax of pixel come judge whether the i-th frame meets " lower near remote " space layout.Such as, for i-th Frame, according to Q%, 1-Q% (0 ＜ Q ＜ 100) picture altitude can be divided into three regions, by comparing three by the i-th two field picture The magnitude relationship of the mean parallax of valid pixel judges whether to meet " lower near remote " in individual region.For example, by the i-th two field picture Three regions are divided into short transverse, the height ratio in each region is from top to bottom：0~20%, 20%~80%, 80%~1, the mean parallax of each region valid pixel is calculated respectively, if topdisp<middledisp<bottomdisp, then Judge that the i-th frame meets the space layout of " lower near remote ".Wherein topdisp、middledisp、bottomdispThree are represented respectively The mean parallax value of valid pixel in region.It is of course also possible to which the i-th frame is divided into two regions or many according to a certain percentage In three regions, according to mentioned above principle, judged by comparing the magnitude relationship of the mean parallax of valid pixel in regional Whether the i-th frame meets the space layout of " lower near remote ".
As described above, whether the embodiment of the present invention according to the order of severity of frame effect and can meet " lower near remote " Space layout, determines factor of influence disp of the disparity space layout to comfort leveldistribution。 dispdistributionValue is high, Show that parallax distribution is preferable, be difficult to make beholder produce visual fatigue, dispdistributionValue is low, show parallax distribution compared with Difference, easily makes beholder produce visual fatigue.In the specific implementation, dispdistributionSpan may be configured as [0, 1], can be by disp near under frame effect is not present in frame of video and meets in the case of remote space layoutdistributionTake compared with Big value, such as can in the range of [0.9,1] value.Frame of video exist frame effect and be unsatisfactory for it is lower it is near remote space cloth , can be by disp in the case of officedistributionValue is smaller.
The embodiment of the present invention gives a kind of following dispdistributionThe alternative of value：
If only meeting the spatial distribution of " lower near remote ", dispdistribution=0.8；
If only meeting and frame effect, disp being not presentdistribution=0.9；
If meeting optimal layout, i.e. in the absence of frame effect and meet the spatial distribution of " lower near remote ", then dispdistribution=1；
If there is frame effect and be unsatisfactory for the spatial distribution of " lower near remote ", dispdistribution=0.7.
As can be seen that dispdistributionNear under frame effect is not present in frame of video and meets during remote space layout The first value is taken, second value is taken during remote space layout near under frame of video has frame effect but meets, is not present in frame of video Frame effect but it is unsatisfactory for taking the 3rd value during lower closely upper remote space layout, there is frame effect in frame of video and be unsatisfactory for lower near The 4th value is taken during upper remote space layout, wherein, the first value, second value, the 3rd value and the 4th value are preset value, and the first value is small In the 4th value, the 3rd value is between the first value and second value and unequal with the first value and second value.Optionally, first value, The span of second value, the 3rd value and the 4th value is：More than zero and less than or equal to 1.According to dispdistributionValue is from small To big order, calculate obtained viewing Comfort Evaluation score value and also (watch comfort level to comment according to sequentially increasing from small to large Valency score value is higher, shows that viewing comfort level is higher)
The time domain specification of one frame of video may include change of the parallax in the viewing area of the frame of video in depth direction Change.When it is implemented, viewing comfort degree factor Ⅴ can be usedd(can be described as the second viewing comfort degree factor) represents The influence of parallax in viewing area in the change of depth direction.
Change (V of the parallax in depth directiond) influence factor have two, one is the change in time domain with reference to parallax Change (V1), another is change (V of the frequency in time domain for referring to parallax appearance2), Vd=f (V1,V2).In the embodiment of the present invention, Can according to the reference parallax of a frame of video time domain change, and/or the frame of video the frequency that occurs of reference parallax when The change in domain, calculates the viewing comfort degree factor Ⅴ for obtaining the frame of videod。
For the i-th frame, a kind of change (V of simple metric parallax in depth directiond) function be：
Wherein, V1 iRepresent change of the reference parallax in time domain of the i-th frame；Represent the reference parallax appearance of the i-th frame Change of the frequency in time domain；γ and μ is weighted value, such as, γ+μ=1, optionally, γ and μ take 0.5.Can be according to V1 iWithThe significance level of influence, adjusts γ and μ value.A kind of extreme way is γ=1, μ=0, now only consider parallax when The influence of domain change.Or μ=1, γ=0, influence of the frequency that now only consideration reference parallax occurs in the change of time domain.
For the V of the i-th frame1 i, the embodiments of the invention provide two kinds of optional computational methods：
Method 1：Stereopsis frequency range is segmented, the reference parallax of the frame of video in same video-frequency band is monotonically changed and changed Speed is identical, and the V of the i-th frame is calculated according to below equation1 i：
V1 i=(displast-dispfirst)/(Np-1)…………………………………[3]
Wherein, dispfirstAnd displastThe reference of the first frame and last frame of the affiliated video-frequency band of respectively the i-th frame is regarded Difference, Np is the frame of video quantity of the affiliated video-frequency band of the i-th frame.
Method 2：The V of the i-th frame is calculated according to below equation1 i：
V1 i=minDispi-minDispi-1……………………………………[4]
Wherein, minDispiAnd minDispi-1The reference parallax of respectively the i-th frame and the i-th -1 frame.
For the i-th frameIt can be calculated according to below equation：
Wherein, P (minDispi) and P (minDispi-1) be respectively the i-th frame and the i-th -1 frame reference parallax percentage Than.
Step 206：It is incremented by i values, that is, i=i+1 is set, and judges whether the i values after being incremented by exceed the stereopsis frequency range Number of video frames N, if being judged as NO, be transferred to step 202, otherwise terminate this flow.
It is can be seen that by above flow due to motion (such as plane motion and/or depth more violent in frame of video Spend the motion in direction) and larger crossed disparity easily cause the attention of spectators, therefore the embodiment of the present invention is in calculating pixel , can be according to the plane motion (including horizontal movement and vertical movement) of matched pixel in frame of video, the fortune of depth direction during weights Dynamic and crossed disparity is calculated, and is chosen the pixel of wherein maximum weight as visual focus, is determined according to the visual focus Viewing area, the viewing area is usually spectators region interested, so as to be seen for spectators region interested See Comfort Evaluation.
In three-dimensional video-frequency playing process, human eye can not accurately identify the comfort level of each frame of video, for video comfort The reflection of degree is based on video-frequency band, rather than based on frame of video.Therefore, it is necessary to assess video-frequency band in Fig. 1 step 103 Comfort level.
Fig. 3 shows a kind of optional implementation method of step 103 in Fig. 1, as illustrated, this method may include following step Suddenly：
Step 301：Calculate the viewing comfort level of each frame of video of stereopsis frequency range.The comfort level of one frame of video Together decided on by time domain specification and Spatial characteristic.
In the specific implementation, the comfort level model of a frame of video can be (below by taking the i-th frame as an example)：
Wherein,For the viewing comfort level of the i-th frame, Spatial_frame_vciFor the i-th frame Spatial characteristic determine The viewing comfort level of i-th frame, Temperal_frame_vciThe viewing of the i-th frame determined for the time domain specification of the i-th frame is comfortable Degree, α and β are weighted value.
Wherein, dispdistribution iFor the disp of the i-th framedistributionThe factor, minDispiReference for the i-th frame is regarded Difference, P (minDispi) for the i-th frame reference parallax percentage, b1 is model parameter；For the V of the i-th framedThe factor；B2 is Model parameter, b2 value and V1 iAnd minDispiSymbol it is relevant.B1 and b2 are trained during subjective data is fitted Model parameter out, its value can be determined according to hands-on result.
Optionally, if using 5 points of systems during to the subjective evaluation of video-see comfort level, minimum 5 points of 1 point of highest, Then the parameter c1 values in above-mentioned formula 7 and formula 8 are 4.Due to video-see comfort level subjective evaluation when use 5 Point system, c1 values are that 4 can ensure that minimum value is 1 and maximum is 5 by minimum 5 points of 1 point of highest.Similarly, if other points System, such as 11 point system or hundred-mark system can then be adjusted accordingly to the value of the model parameter in formula 7 and formula 8.
Table 1 shows one group of optional model parameter value.
The model parameter of table 1
Step 302：According to the visual focus position of each frame of video of the stereopsis frequency range, to the three-dimensional video-frequency Duan Jinhang subsegments are divided, and each subsegment comprises at least a frame of video, the visual focus position transfer of the frame of video of each subsegment Amount is not more than setting transfer amount threshold value, then calculates the viewing comfort level of each subsegment.
In the step, segmentation is according to being amount of translation size of the focus in locus, if the sky of the focus of continuous multiple frames Between position it is close, then the continuous multiple frames are divided into a subsegment.Such as, if the spatial focal point position of adjacent video frames turns Shifting amount δ p are less than 5, then the adjacent video frames are divided into a subsegment, the adjacent video frames otherwise are divided into difference Subsegment.Wherein,dxAnd dyThe horizontal and vertical displacement of focus transfer is represented respectively.
When it is implemented, calculating the specific formula for calculation of the viewing comfort level of each subsegment can be：
Wherein,For the level of comfort of k-th of subsegment, NFFor the number of frame of video in k-th of subsegment, P1For joint ginseng Number, for setting numerical value, such as can selected value be 7.P1Can value be integer more than 1.P1The selection of selectable value can be according to existing Test section and corresponding subjective comfort score value training obtain, by setting reasonable value, subjective score can be made and objective The correlation highest of score value.
Optionally, if using 5 points of systems during to the subjective evaluation of video-see comfort level, minimum 5 points of 1 point of highest, Then the parameter c2 values in above-mentioned formula 9 and formula 10 are the best result that 5, i.e. value are subjective evaluation.Similarly, if its He divides system, such as 11 point system or hundred-mark system, then the value of the model parameter in formula 7 and formula 8 can be adjusted accordingly.
Step 303：The viewing comfort level of the stereopsis frequency range is calculated according to the viewing comfort level of each subsegment.
When it is implemented, specific formula for calculation can be：
Wherein, Q is the viewing comfort level of the stereopsis frequency range, NSFor the number of subsegment in the video-frequency band, P2For when Domain combined parameters, are setting value, such as can selected value be 3.P2Can value be integer more than 1.P2The selection of selectable value can Obtained according to existing test section and the training of corresponding subjective comfort score value, by setting reasonable value, subjective point can be made The correlation highest of value and objective score value.
Fig. 4 is shown in another optional implementation method of step 103 in Fig. 1, this method, watches Comfort Evaluation mould The characterisitic parameter extracted in type is the statistical parameter of section, it is not necessary to individually calculate the comfort level and subsegment of each frame of video Comfort level.As illustrated, this method may include following steps：
Step 401：According to the Spatial characteristic of each frame of video of stereopsis frequency range, the sky of the stereopsis frequency range is calculated Domain characteristic.
The Spatial characteristic of the stereopsis frequency range may include one of following parameter or any combination：The stereopsis frequency range With reference to parallax, the viewing comfort degree factor of the stereopsis frequency range
When it is implemented, the reference parallax of stereopsis frequency range can in the following way be calculated and obtained：Calculate the stereopsis The weighted average of the reference parallax of all frame of video in frequency range.Specific formula for calculation can be：
Wherein,For the weighted average of the reference parallax of all frame of video in the stereopsis frequency range, N is The number of frame of video, minDisp in the stereopsis frequency rangeiFor the reference parallax of the i-th frame, P (minDispi) be the i-th frame ginseng Examine the percentage of parallax.
When it is implemented, the viewing comfort degree factor of stereopsis frequency rangeIt can calculate in the following way Obtain：Calculate the viewing comfort degree factor disp of all frame of video in the stereopsis frequency rangedistributionAverage value. Specific formula for calculation can be：
Wherein,For the viewing comfort degree factor of all frame of video in the stereopsis frequency range dispdistributionAverage value, dispdistribution iFor the viewing comfort degree factor disp of the i-th framedistribution；
Step 402：According to the time domain specification of each frame of video of the stereopsis frequency range, the stereopsis frequency range is calculated Time domain specification.
The time domain specification of the stereopsis frequency range may include the viewing comfort degree factor of the stereopsis frequency rangeInstitute State the viewing comfort degree factor Ⅴ of stereopsis frequency ranged, can specifically be calculated by below equation：
Wherein,For the viewing comfort degree factor Ⅴ of the stereopsis frequency ranged,For in the stereopsis frequency range The viewing comfort degree factor Ⅴ of i-th framed, PiFor setting value, PiValue according to V1 iAnd minDispiSymbol determine, That is, PiValue and V1 iAnd minDispiSymbol it is relevant, a kind of desirable value is：
Work as V1 iWith minDispiDuring contrary sign, Pi=0.8；
Work as V1 iWith minDispiDuring jack per line, Pi=1；
Pass through PiDifferent Effects of the different motion direction to viewing comfort level can be distinguished.Work as V1 iWith minDispiDuring jack per line, Object is moved to the direction away from screen, and comfort level in this case is excessively poor, PiDesirable higher value, than such as above-mentioned Pi=1； Work as V1 iWith minDispiDuring contrary sign, object is moved to the direction close to screen, and comfort level in this case is preferable, PiIt is desirable Smaller value, than such as above-mentioned Pi=0.8.
Step 403：The parameter calculated according to step 401~402, calculates the viewing comfort level of the stereopsis frequency range.
Specific formula for calculation can be：
VC=α * Spatial_vc+ β * Temperal_vc ... ... ... ... ... ... [14]
Wherein, VC is the viewing comfort level of the stereopsis frequency range, and α and β are weighted value, optionally, alpha+beta=1；B1 is Model parameter.One group of available model parameter is：α=0.8, β=0.2, b1=0.04.The selection of b1 selectable value can basis Existing test section and the training of corresponding subjective comfort score value are obtained, and when taking the value, subjective score is related to objective score value Property highest.
Optionally, if using 5 points of systems during to the subjective evaluation of video-see comfort level, minimum 5 points of 1 point of highest, Then the parameter c3 values in above-mentioned formula 15 and formula 16 are the best result that 4, i.e. value are subjective evaluation.Similarly, if its He divides system, such as 11 point system or hundred-mark system, then the value of the model parameter in formula 15 and formula 16 can be adjusted accordingly.
The embodiment of the present invention can be seen that by detecting human eye vision focal position by above flow, regarded according to human eye Angular region determines viewing area, and the severity metrics three-dimensional video-frequency conflicted using influx in viewing area with adjusting, which is watched, to relax Appropriateness.Influx is by analyzing three-dimensional video-frequency space-time function distribution situation and time domain parallax with adjusting the order of severity conflicted Distribution situation measurement.The appraisal procedure that the embodiment of the present invention is proposed has taken into full account disparity space distribution and Annual distribution pair The influence of three-dimensional video-frequency comfort level, and influence of the poor frame of comfort level to global comfort can be protruded.
In summary, it is to improve the precondition that three-dimensional video-frequency watches comfort level that three-dimensional video-frequency comfort level, which is assessed, is influence One of key technology of three-dimensional video-frequency development.The objective evaluation scheme for the three-dimensional video-frequency comfort level that the embodiment of the present invention is proposed, meter Calculate complexity low, reliability is high, can be extensively using assessing and monitor with three-dimensional video-frequency comfort level.The program and existing program Compared to having taken into full account the influence of the Spatial characteristic and time domain specification of three-dimensional video-frequency to three-dimensional video-frequency comfort level, and it take into account Human visual system and viewer watching habits, cover the main influence factor of influence viewing comfort level, so that three-dimensional Video-see Comfort Evaluation is more objective and accurate.
Based on identical technical concept, the embodiment of the present invention additionally provides a kind of three-dimensional video-frequency evaluating apparatus.
It is the structural representation of three-dimensional video-frequency evaluating apparatus provided in an embodiment of the present invention referring to Fig. 5.
Acquisition module 501, the frame of video for obtaining stereopsis frequency range；
Extraction module 502, the Spatial characteristic of the frame of video for extracting the stereopsis frequency range that the acquisition module is got And time domain specification；
Evaluation module 503, for the spatial domain for the frame of video of the stereopsis frequency range extracted according to the extraction module Characteristic and time domain specification, determine the viewing comfort level of the stereopsis frequency range.
With reference to said apparatus, in the first possible implementation, extraction module 502 specifically for：Estimation is described vertical The parallax of the frame of video of stereoscopic frequency range, according to being determined the parallax of the frame of video of the stereopsis frequency range and movable information The visual focus position of the frame of video of stereopsis frequency range, it is true according to the visual focus position of the frame of video of the stereopsis frequency range The viewing area of the frame of video of the fixed stereopsis frequency range, and parallax according to the frame of video of the stereopsis frequency range and The viewing area of the frame of video of the stereopsis frequency range, extracts the Spatial characteristic and time domain of the frame of video of the stereopsis frequency range Characteristic.
With reference to the first possible implementation of said apparatus, in second of possible implementation, extraction module 502 can determine that the weights of each pixel in the frame of video of the stereopsis frequency range, and the position of the pixel with maximum weights is true It is set to the visual focus position of the frame of video of the stereopsis frequency range.
With reference to second of possible implementation of said apparatus, in the third possible implementation, extraction module 502 can calculate the weights of the pixel, the expression formula of formula (1) and the same institute of the implication of relevant parameter using formula (1) State, be not repeated herein.
With reference to second of said apparatus or the third possible implementation, in the 4th kind of possible implementation, Extraction module 502 specifically for：, will if the pixel in the frame of video of the stereopsis frequency range with maximum weights has multiple In the multiple pixel with maximum weights, nearest apart from the image center location of the frame of video of the stereopsis frequency range The position of pixel, is defined as the visual focus position of the frame of video of the stereopsis frequency range.
With reference to the first any one possible realization side into the 4th kind of possible implementation of said apparatus Formula, in the 5th kind of possible implementation, the Spatial characteristic includes one of following parameter or any combination：With reference to parallax, Percentage, the first viewing comfort degree factor with reference to parallax；
Extraction module 502 specifically for：The corresponding parallax set of frame of video of the stereopsis frequency range is determined, it is described to regard Difference set is combined into the pixel parallax set in the frame of video viewing area of the stereopsis frequency range, and each parallax value pair therein The pixel quantity answered is all higher than the given threshold；Minimum parallax value in the parallax set is defined as the stereopsis The reference parallax of the frame of video of frequency range；
In the viewing area for the frame of video for calculating the stereopsis frequency range, parallax is the number of the pixel of the reference parallax The ratio of the number of mesh and valid pixel, obtains the percentage of the reference parallax of the frame of video of the stereopsis frequency range, described to have The parallax absolute value that effect pixel refers to is less than the pixel of hunting zone；
According to the frame of video of the stereopsis frequency range is with the presence or absence of frame effect and whether meets down closely upper remote space cloth Office, determines the first viewing comfort degree factor of the frame of video of the stereopsis frequency range, the first viewing comfort degree The factor takes the first value near under frame effect is not present in the frame of video of the stereopsis frequency range and meets during remote space layout, Second value is taken during remote space layout frame of video in the stereopsis frequency range is near under there is frame effect but meeting, described The frame of video of stereopsis frequency range is not present frame effect but is unsatisfactory for taking the 3rd value during lower closely upper remote space layout, described vertical There is frame effect and be unsatisfactory for taking the 4th value during lower closely upper remote space layout in the frame of video of stereoscopic frequency range, wherein, the first value, Second value, the 3rd value and the 4th value are preset value, and the first value is less than the 4th value, and the 3rd value is between the first value and second value And it is unequal with the first value and second value；The frame effect refers to for a frame of video, if imaging in screen side The parallax of the object of edge be crossed disparity, and the object a part beyond screen ranges, then there is frame effect；Institute State it is lower it is near on far refer to the corresponding object for imaging in screen bottom of a frame of video perceived depth it is near from spectators, image in The perceived depth of the object on screen top is remote from spectators.
With reference to the first any one possible realization side into the 5th kind of possible implementation of said apparatus Formula, in the 6th kind of possible implementation, the time domain specification includes the second viewing comfort degree factor；
Extraction module 502 specifically for：According to the reference parallax of the frame of video of the stereopsis frequency range time domain change Change, and/or the frame of video of the stereopsis frequency range the frequency that occurs of reference parallax in the change of time domain, calculating obtains described The second viewing comfort degree factor of the frame of video of stereopsis frequency range, the second viewing comfort degree factor value Size represents the degree that the reference parallax of frame of video changes in depth direction.
With reference to the 6th kind of possible implementation of said apparatus, in the 7th kind of possible implementation, extraction module 502 specifically for：The reference parallax dullness that the stereopsis frequency range is carried out into the frame of video in subsegment division, same subsegment becomes Change and pace of change be identical, calculated according to formula (3) the stereopsis frequency range frame of video reference parallax time domain change Change, the frequency of reference parallax appearance of the frame of video of the stereopsis frequency range is calculated according to formula (5) in the change of time domain, root The second viewing comfort degree factor of the frame of video of the stereopsis frequency range is calculated according to formula (2).Formula (3), formula (2) It is the same as those described above, is not repeated herein with the expression formula of formula (5) and the implication of relevant parameter.
With reference to the 6th kind of possible implementation of said apparatus, in the 8th kind of possible implementation, extraction module 502 can calculate change of the reference parallax in time domain of the frame of video of the stereopsis frequency range according to formula (4), according to formula (5) The frequency of reference parallax appearance of the frame of video of the stereopsis frequency range is calculated in the change of time domain, institute is calculated according to formula (2) State the second viewing comfort degree factor of the frame of video of stereopsis frequency range.The expression of formula (4), formula (5) and formula (2) Formula and the implication of relevant parameter are the same as those described above, and are not repeated herein.
Can with reference to the first any one into the 8th kind of possible implementation of said apparatus or said apparatus Can implementation, in the 9th kind of possible implementation, evaluation module 503 specifically for：
According to the Spatial characteristic and time domain specification of each frame of video of the stereopsis frequency range, calculate described every respectively The viewing comfort level of one frame of video；
According to the visual focus position of each frame of video of the stereopsis frequency range, the stereopsis frequency range is carried out Subsegment is divided, and the visual focus position transfer amount of the frame of video of each subsegment is not more than setting transfer amount threshold value；According to every height The viewing comfort level of each frame of video, calculates the viewing comfort level of each subsegment respectively in section；
The viewing comfort level of the stereopsis frequency range is calculated according to the viewing comfort level of each subsegment.
With reference to the 9th kind of possible implementation of said apparatus, in the tenth kind of possible implementation, evaluation module 503 can calculate the viewing comfort level of the frame of video of the stereopsis frequency range according to formula (6), formula (7) and formula (8).Formula (4), the implication of the expression formula and relevant parameter of formula (5) and formula (2) is the same as those described above, and is not repeated herein.Calculating process In be related to the reference parallax of the frame of video of stereopsis frequency range, the percentage of the reference parallax of the frame of video of stereopsis frequency range, The computational methods of the parameters such as the first viewing comfort degree factor, the second viewing comfort degree factor, are the same as those described above, herein It is not repeated.
With reference to the 9th kind of said apparatus or the tenth kind of possible implementation, in a kind of the tenth possible implementation In, evaluation module 503 specifically for：The viewing comfort level of institute's stereopsis frequency range is calculated according to formula (9).Formula (9) is expressed Formula and the implication of relevant parameter are the same as those described above, and are not repeated herein.
With reference to the 9th kind of any one possible realization side into a kind of the tenth possible implementation of said apparatus Formula, in the 12nd kind of possible implementation, evaluation module 503 can calculate the stereopsis frequency range according to formula (10) Watch comfort level.Formula (10) expression formula and the implication of relevant parameter are the same as those described above, and are not repeated herein.
With reference to the first any one into the 12nd kind of possible implementation of said apparatus or said apparatus Possible implementation, in the 13rd kind of possible implementation, evaluation module 503 can be according to the stereopsis frequency range The Spatial characteristic of frame of video, calculates the Spatial characteristic of the stereopsis frequency range, according to the frame of video of the stereopsis frequency range when Domain characteristic, calculates the time domain specification of the stereopsis frequency range, according to the Spatial characteristic and time domain specification of the stereopsis frequency range, Calculate the viewing comfort level of the stereopsis frequency range.
It is described in the 14th kind of possible implementation with reference to the 13rd kind of possible implementation of said apparatus The Spatial characteristic of the frame of video of stereopsis frequency range includes one of following parameter or any combination：The video of the stereopsis frequency range The reference parallax of frame, with reference to the percentage of parallax and the first viewing comfort degree factor, the circular of these parameters It is the same as those described above, is not repeated herein.Accordingly, evaluation module 503 can calculate institute in the stereopsis frequency range according to formula (11) There is the weighted average of the reference parallax of frame of video, all frame of video in the stereopsis frequency range are calculated according to formula (12) The average value of the first viewing comfort degree factor.Formula (11) and formula (12) expression formula and the implication of relevant parameter are same It is preceding described, it is not repeated herein.
With reference to the 13rd kind or the 14th kind of possible implementation of said apparatus, in the 15th kind of possible realization In mode, the time domain specification of the frame of video of the stereopsis frequency range includes：Second viewing of the frame of video of the stereopsis frequency range The comfort degree factor (circular is the same as those described above, and is not repeated herein), evaluation module 503 can be according to formula (13) Calculate the second viewing comfort degree factor of the stereopsis frequency range.The implication of formula (13) expression formula and relevant parameter It is the same as those described above, is not repeated herein.
With reference to said apparatus the 13rd kind to the 15th kind possible implementation in any one it is possible realize Mode, in the 16th kind of possible implementation, evaluation module 503 can be according to formula (14), formula (15) and formula (16) Calculate the viewing comfort level of the stereopsis frequency range.Formula (14), formula (15) and formula (16) expression formula and relevant parameter Implication be the same as those described above, be not repeated herein.
Based on identical technical concept, the embodiment of the present invention additionally provides a kind of three-dimensional video-frequency evaluating apparatus.
It is the structural representation of three-dimensional video-frequency evaluating apparatus provided in an embodiment of the present invention referring to Fig. 6.The device can be wrapped Include：Transceiver 601, memory 602 and processor 603.Memory 602 is used to store application program, algorithmic rule, calculates ginseng The information such as number, may further be used to store the intermediate result produced in the processing procedure of processor 603.
Transceiver 601, the frame of video for obtaining stereopsis frequency range；
Processor 603, for extract the stereopsis frequency range that the acquisition module is got frame of video Spatial characteristic and Time domain specification；The Spatial characteristic and time domain specification of the frame of video for the stereopsis frequency range extracted according to the extraction module, Determine the viewing comfort level of the stereopsis frequency range.
With reference to said apparatus, in the first possible implementation, processor 603 specifically for：Estimate the solid The parallax of the frame of video of video-frequency band, is determined described vertical according to the parallax and movable information of the frame of video of the stereopsis frequency range The visual focus position of the frame of video of stereoscopic frequency range, is determined according to the visual focus position of the frame of video of the stereopsis frequency range The viewing area of the frame of video of the stereopsis frequency range, and the parallax according to the frame of video of the stereopsis frequency range and institute The viewing area of the frame of video of stereopsis frequency range is stated, the Spatial characteristic and time domain for extracting the frame of video of the stereopsis frequency range are special Property.
With reference to the first possible implementation of said apparatus, in second of possible implementation, processor 603 can determine that the weights of each pixel in the frame of video of the stereopsis frequency range, and the position of the pixel with maximum weights is true It is set to the visual focus position of the frame of video of the stereopsis frequency range.
With reference to second of possible implementation of said apparatus, in the third possible implementation, processor 603 can calculate the weights of the pixel, the expression formula of formula (1) and the same institute of the implication of relevant parameter using formula (1) State, be not repeated herein.
With reference to second of said apparatus or the third possible implementation, in the 4th kind of possible implementation, Processor 603 specifically for：If the pixel in the frame of video of the stereopsis frequency range with maximum weights has multiple, by institute State in multiple pixels with maximum weights, the picture nearest apart from the image center location of the frame of video of the stereopsis frequency range The position of element, is defined as the visual focus position of the frame of video of the stereopsis frequency range.
With reference to the first any one possible realization side into the 4th kind of possible implementation of said apparatus Formula, in the 5th kind of possible implementation, the Spatial characteristic includes one of following parameter or any combination：With reference to parallax, Percentage, the first viewing comfort degree factor with reference to parallax；
Processor 603 specifically for：Determine the corresponding parallax set of frame of video of the stereopsis frequency range, the parallax Collection is combined into the pixel parallax set in the frame of video viewing area of the stereopsis frequency range, and each parallax value correspondence therein Pixel quantity be all higher than the given threshold；Minimum parallax value in the parallax set is defined as the three-dimensional video-frequency The reference parallax of the frame of video of section；
In the viewing area for the frame of video for calculating the stereopsis frequency range, parallax is the number of the pixel of the reference parallax The ratio of the number of mesh and valid pixel, obtains the percentage of the reference parallax of the frame of video of the stereopsis frequency range, described to have The parallax absolute value that effect pixel refers to is less than the pixel of hunting zone；
According to the frame of video of the stereopsis frequency range is with the presence or absence of frame effect and whether meets down closely upper remote space cloth Office, determines the first viewing comfort degree factor of the frame of video of the stereopsis frequency range, the first viewing comfort degree The factor takes the first value near under frame effect is not present in the frame of video of the stereopsis frequency range and meets during remote space layout, Second value is taken during remote space layout frame of video in the stereopsis frequency range is near under there is frame effect but meeting, described The frame of video of stereopsis frequency range is not present frame effect but is unsatisfactory for taking the 3rd value during lower closely upper remote space layout, described vertical There is frame effect and be unsatisfactory for taking the 4th value during lower closely upper remote space layout in the frame of video of stereoscopic frequency range, wherein, the first value, Second value, the 3rd value and the 4th value are preset value, and the first value is less than the 4th value, and the 3rd value is between the first value and second value And it is unequal with the first value and second value；The frame effect refers to for a frame of video, if imaging in screen side The parallax of the object of edge be crossed disparity, and the object a part beyond screen ranges, then there is frame effect；Institute State it is lower it is near on far refer to the corresponding object for imaging in screen bottom of a frame of video perceived depth it is near from spectators, image in The perceived depth of the object on screen top is remote from spectators.
With reference to the first any one possible realization side into the 5th kind of possible implementation of said apparatus Formula, in the 6th kind of possible implementation, the time domain specification includes the second viewing comfort degree factor；
Processor 603 specifically for：According to the reference parallax of the frame of video of the stereopsis frequency range time domain change, And/or the frequency that the reference parallax of the frame of video of the stereopsis frequency range occurs calculates in the change of time domain and obtains the solid The second viewing comfort degree factor of the frame of video of video-frequency band, the size of the second viewing comfort degree factor value Represent the degree that the reference parallax of frame of video changes in depth direction.
With reference to the 6th kind of possible implementation of said apparatus, in the 7th kind of possible implementation, processor 603 specifically for：The reference parallax dullness that the stereopsis frequency range is carried out into the frame of video in subsegment division, same subsegment becomes Change and pace of change be identical, calculated according to formula (3) the stereopsis frequency range frame of video reference parallax time domain change Change, the frequency of reference parallax appearance of the frame of video of the stereopsis frequency range is calculated according to formula (5) in the change of time domain, root The second viewing comfort degree factor of the frame of video of the stereopsis frequency range is calculated according to formula (2).Formula (3), formula (2) It is the same as those described above, is not repeated herein with the expression formula of formula (5) and the implication of relevant parameter.
With reference to the 6th kind of possible implementation of said apparatus, in the 8th kind of possible implementation, processor 603 can calculate change of the reference parallax in time domain of the frame of video of the stereopsis frequency range according to formula (4), according to formula (5) The frequency of reference parallax appearance of the frame of video of the stereopsis frequency range is calculated in the change of time domain, institute is calculated according to formula (2) State the second viewing comfort degree factor of the frame of video of stereopsis frequency range.The expression of formula (4), formula (5) and formula (2) Formula and the implication of relevant parameter are the same as those described above, and are not repeated herein.
Can with reference to the first any one into the 8th kind of possible implementation of said apparatus or said apparatus Can implementation, in the 9th kind of possible implementation, processor 603 specifically for：
According to the Spatial characteristic and time domain specification of each frame of video of the stereopsis frequency range, calculate described every respectively The viewing comfort level of one frame of video；
According to the visual focus position of each frame of video of the stereopsis frequency range, the stereopsis frequency range is carried out Subsegment is divided, and the visual focus position transfer amount of the frame of video of each subsegment is not more than setting transfer amount threshold value；According to every height The viewing comfort level of each frame of video, calculates the viewing comfort level of each subsegment respectively in section；
The viewing comfort level of the stereopsis frequency range is calculated according to the viewing comfort level of each subsegment.
With reference to the 9th kind of possible implementation of said apparatus, in the tenth kind of possible implementation, processor 603 can calculate the viewing comfort level of the frame of video of the stereopsis frequency range according to formula (6), formula (7) and formula (8).Formula (4), the implication of the expression formula and relevant parameter of formula (5) and formula (2) is the same as those described above, and is not repeated herein.Calculating process In be related to the reference parallax of the frame of video of stereopsis frequency range, the percentage of the reference parallax of the frame of video of stereopsis frequency range, The computational methods of the parameters such as the first viewing comfort degree factor, the second viewing comfort degree factor, are the same as those described above, herein It is not repeated.
With reference to the 9th kind of said apparatus or the tenth kind of possible implementation, in a kind of the tenth possible implementation In, processor 603 specifically for：The viewing comfort level of institute's stereopsis frequency range is calculated according to formula (9).Formula (9) expression formula And the implication of relevant parameter is the same as those described above, and is not repeated herein.
With reference to the 9th kind of any one possible realization side into a kind of the tenth possible implementation of said apparatus Formula, in the 12nd kind of possible implementation, processor 603 can calculate the sight of the stereopsis frequency range according to formula (10) See comfort level.Formula (10) expression formula and the implication of relevant parameter are the same as those described above, and are not repeated herein.
With reference to the first any one into the 12nd kind of possible implementation of said apparatus or said apparatus Possible implementation, in the 13rd kind of possible implementation, processor 603 can regarding according to the stereopsis frequency range The Spatial characteristic of frequency frame, calculates the Spatial characteristic of the stereopsis frequency range, according to the time domain of the frame of video of the stereopsis frequency range Characteristic, calculates the time domain specification of the stereopsis frequency range, according to the Spatial characteristic and time domain specification of the stereopsis frequency range, meter Calculate the viewing comfort level of the stereopsis frequency range.
It is described in the 14th kind of possible implementation with reference to the 13rd kind of possible implementation of said apparatus The Spatial characteristic of the frame of video of stereopsis frequency range includes one of following parameter or any combination：The video of the stereopsis frequency range The reference parallax of frame, with reference to the percentage of parallax and the first viewing comfort degree factor, the circular of these parameters It is the same as those described above, is not repeated herein.Accordingly, processor 603 can be calculated in the stereopsis frequency range according to formula (11) and owned The weighted average of the reference parallax of frame of video, the of all frame of video in the stereopsis frequency range is calculated according to formula (12) The average value of the one viewing comfort degree factor.Formula (11) and formula (12) expression formula and the implication of relevant parameter are the same It is described, it is not repeated herein.
With reference to the 13rd kind or the 14th kind of possible implementation of said apparatus, in the 15th kind of possible realization In mode, the time domain specification of the frame of video of the stereopsis frequency range includes：Second viewing of the frame of video of the stereopsis frequency range The comfort degree factor (circular is the same as those described above, and is not repeated herein), processor 603 can be counted according to formula (13) Calculate the second viewing comfort degree factor of the stereopsis frequency range.Formula (13) expression formula and the implication of relevant parameter are same It is preceding described, it is not repeated herein.
With reference to said apparatus the 13rd kind to the 15th kind possible implementation in any one it is possible realize Mode, in the 16th kind of possible implementation, processor 603 can be counted according to formula (14), formula (15) and formula (16) Calculate the viewing comfort level of the stereopsis frequency range.Formula (14), formula (15) and formula (16) expression formula and relevant parameter Implication is the same as those described above, and is not repeated herein.
The present invention is the flow with reference to method according to embodiments of the present invention, equipment (system) and computer program product Figure and/or block diagram are described.It should be understood that can be by each in computer program instructions implementation process figure and/or block diagram Flow and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computers can be provided Processing of the programmed instruction to all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices Device so that be can be achieved by the instruction of the computer or the computing device of other programmable data processing devices in flow chart A flow or one square frame of multiple flows and/or block diagram or multiple square frames in the function specified.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which is produced, to be included The manufacture of command device, the command device is realized in one flow of flow chart or multiple flows and/or one square frame of block diagram Or the function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that Series of operation steps is performed on computer or other programmable devices to produce computer implemented processing, so as to calculate The instruction performed on machine or other programmable devices provide be used to realize in a flow of flow chart or multiple flows and/or The step of function of being specified in one square frame of block diagram or multiple square frames.
Although having been described for the alternative embodiment of the present invention, those skilled in the art once know basic wound The property made concept, then can make other change and modification to these embodiments.So, appended claims are intended to be construed to bag Include alternative embodiment and fall into having altered and changing for the scope of the invention.
Obviously, those skilled in the art can carry out various changes and modification without departing from the present invention's to the present invention Spirit and scope.So, if these modifications and variations of the present invention belong to the model of the claims in the present invention and its equivalent technologies Within enclosing, then the present invention is also intended to comprising including these changes and modification.

Claims (28)

1. a kind of three-dimensional video-frequency Comfort Evaluation method, it is characterised in that including：
Obtain the frame of video of stereopsis frequency range；
Estimate the parallax of the frame of video of the stereopsis frequency range；
The weights of each pixel in the frame of video of the stereopsis frequency range are determined, the position of the pixel with maximum weights is determined For the visual focus position of the frame of video of the stereopsis frequency range；
Determined according to the visual focus position of the frame of video of the stereopsis frequency range stereopsis frequency range frame of video it is visual Region；
According to the parallax of the frame of video of the stereopsis frequency range and the viewing area of the frame of video of the stereopsis frequency range, extract The Spatial characteristic and time domain specification of the frame of video of the stereopsis frequency range；
According to the Spatial characteristic and time domain specification of the frame of video of the stereopsis frequency range, determine that the viewing of the stereopsis frequency range is relaxed Appropriateness；
The weights of the pixel are calculated using equation below：
W=γ * | mv |+η * | dispcrossed|+λ*|δd|
Wherein, W is the weights for the pixel that coordinate is (x, y), and γ, η and λ are weighted value；Represent described to sit It is designated as the plane motion vector of the pixel of (x, y), dxAnd dyRespectively described coordinate is the horizontal displacement of the pixel of (x, y) and hung down Straight displacement, the dxAnd dyWhere frame of video where the pixel that the coordinate is (x, y) and the pixel that the coordinate is (x, y) Frame of video adjacent video frame in search obtain；dispcrossedFor crossed disparity value；δ d are the video of the stereopsis frequency range The difference of the mean parallax of the match block of frame and its adjacent video frames.
2. the method as described in claim 1, it is characterised in that if having maximum weights in the frame of video of the stereopsis frequency range Pixel have multiple, then by the multiple pixel with maximum weights, apart from the figure of the frame of video of the stereopsis frequency range The position of the nearest pixel in inconocenter position, is defined as the visual focus position of the frame of video of the stereopsis frequency range.
3. method as claimed in claim 1 or 2, it is characterised in that the Spatial characteristic includes one of following parameter or any Combination：Percentage and the first viewing comfort degree factor with reference to parallax, with reference to parallax；
The viewing area of the parallax of the frame of video according to the stereopsis frequency range and the frame of video of the stereopsis frequency range, The Spatial characteristic of the frame of video of the stereopsis frequency range is extracted, including：
The corresponding parallax set of frame of video of the stereopsis frequency range is determined, the parallax collection is combined into regarding for the stereopsis frequency range Pixel parallax set in frequency frame viewing area, and the corresponding pixel quantity of each parallax value therein is all higher than given threshold； Minimum parallax value in the parallax set is defined as to the reference parallax of the frame of video of the stereopsis frequency range；
In the viewing area for the frame of video for calculating the stereopsis frequency range, parallax is the number of the pixel of the reference parallax with having The ratio of the number of pixel is imitated, the percentage of the reference parallax of the frame of video of the stereopsis frequency range, the valid pixel is obtained The parallax absolute value referred to is less than the pixel of hunting zone；
According to the frame of video of the stereopsis frequency range is with the presence or absence of frame effect and whether meets down closely upper remote space layout, really The first viewing comfort degree factor of the frame of video of the fixed stereopsis frequency range, the first viewing comfort degree factor exists The frame of video of the stereopsis frequency range takes the first value when closely upper remote space layout is not present under frame effect and satisfaction, described vertical The frame of video of stereoscopic frequency range takes second value when closely going up remote space layout under there is frame effect but meeting, in the stereopsis frequency range Frame of video frame effect is not present but is unsatisfactory for taking the 3rd value during lower closely upper remote space layout, in regarding for the stereopsis frequency range There is frame effect and be unsatisfactory for taking the 4th value during lower closely upper remote space layout in frequency frame, wherein, the first value, second value, the 3rd value Be preset value with the 4th value, and the first value is less than the 4th value, the 3rd value between the first value and second value and with the first value and the Two-value is unequal；The frame effect refers to for a frame of video, if the parallax for imaging in the object of screen edge is Crossed disparity, and the object a part beyond screen ranges, then there is frame effect；It is described it is lower it is near on far refer to one The perceived depth of the corresponding object for imaging in screen bottom of frame of video is near from spectators, image in the perception of the object on screen top Depth is remote from spectators.
4. method as claimed in claim 1 or 2, it is characterised in that the time domain specification includes the second viewing comfort degree The factor；
The viewing area of the parallax of the frame of video according to the stereopsis frequency range and the frame of video of the stereopsis frequency range, The time domain specification of the frame of video of the stereopsis frequency range is extracted, including：
According to the reference parallax of the frame of video of the stereopsis frequency range in the change of time domain, and/or the stereopsis frequency range Frame of video reference parallax occur frequency time domain change, calculate obtain the stereopsis frequency range frame of video second The comfort degree factor is watched, the size of the second viewing comfort degree factor value represents that the reference parallax of frame of video exists The degree of depth direction change.
5. method as claimed in claim 4, it is characterised in that existed according to the reference parallax of the frame of video of the stereopsis frequency range The change of time domain, and/or the stereopsis frequency range frame of video reference parallax occur frequency in the change of time domain, calculate To the second viewing comfort degree factor of the frame of video of the stereopsis frequency range, including：
The reference parallax that the stereopsis frequency range is carried out into the frame of video in subsegment division, same subsegment is monotonically changed and change speed Degree is identical, calculated according to below equation the stereopsis frequency range frame of video reference parallax time domain change：
V1 i=(displast-dispfirst)/(Np-1)
The change of frequency that the reference parallax of the frame of video of the stereopsis frequency range occurs in time domain is calculated according to below equation：
The second viewing comfort degree factor of the frame of video of the stereopsis frequency range is calculated according to below equation：
Wherein, V1 iRepresent the reference parallax of the i-th frame in the change of time domain, dispfirstAnd displastIt is sub belonging to respectively the i-th frame First frame of section and the reference parallax of last frame, Np are the frame of video quantity of the affiliated subsegment of the i-th frame；Represent the ginseng of the i-th frame The frequency of parallax appearance is examined in the change of time domain, P (min Dispi) and P (min Dispi-1) it is respectively the i-th frame and the i-th -1 frame Reference parallax percentage；The comfort degree factor is watched for the second of the i-th frame, γ and μ are weighted value；I-th frame For any frame of video in the stereopsis frequency range.
6. method as claimed in claim 4, it is characterised in that existed according to the reference parallax of the frame of video of the stereopsis frequency range The change of time domain, and/or the stereopsis frequency range frame of video reference parallax occur frequency in the change of time domain, calculate To the second viewing comfort degree factor of the frame of video of the stereopsis frequency range, including：
Calculated according to below equation the stereopsis frequency range frame of video reference parallax time domain change：
V1 i=min Dispi-min Dispi-1
The change of frequency that the reference parallax of the frame of video of the stereopsis frequency range occurs in time domain is calculated according to below equation：
The second viewing comfort degree factor of the frame of video of the stereopsis frequency range is calculated according to below equation：
Wherein, V1 iRepresent change of the reference parallax in time domain of the i-th frame, min DispiWith min Dispi-1Respectively the i-th frame and The reference parallax of i-th -1 frame；Represent the frequency of reference parallax appearance of the i-th frame in the change of time domain, P (min Dispi) and P (min Dispi-1) be respectively the i-th frame and the i-th -1 frame reference parallax percentage；Second for the i-th frame watches comfort level Factor of influence, γ and μ are weighted value；I-th frame is any frame of video in the stereopsis frequency range.
7. the method as any one of claim 1,2,5,6, it is characterised in that described according to the stereopsis frequency range The Spatial characteristic and time domain specification of frame of video, determine the viewing comfort level of the stereopsis frequency range, including：
According to the Spatial characteristic and time domain specification of each frame of video of the stereopsis frequency range, each is regarded described in calculating respectively The viewing comfort level of frequency frame；
According to the visual focus position of each frame of video of the stereopsis frequency range, subsegment is carried out to the stereopsis frequency range and drawn Point, the visual focus position transfer amount of the frame of video of each subsegment is not more than setting transfer amount threshold value；According to every in each subsegment The viewing comfort level of individual frame of video, calculates the viewing comfort level of each subsegment respectively；
The viewing comfort level of the stereopsis frequency range is calculated according to the viewing comfort level of each subsegment.
8. method as claimed in claim 7, it is characterised in that according to the spatial domain of each frame of video of the stereopsis frequency range Characteristic and time domain specification, calculate the viewing comfort level of each frame of video respectively, including：
The viewing comfort level of the frame of video of the stereopsis frequency range is calculated according to below equation：
Wherein,For the viewing comfort level of the i-th frame, Spatial_frame_vciThe i-th frame determined for the Spatial characteristic of the i-th frame Viewing comfort level, Temperal_frame_vciThe viewing comfort level of the i-th frame determined for the time domain specification of the i-th frame, α and β For weighted value；dispdistribution iFirst for the i-th frame watches the comfort degree factor, min DispiReference for the i-th frame is regarded Difference, P (min Dispi) for the i-th frame reference parallax percentage；Second for the i-th frame watches the comfort degree factor； B1, b2 and c1 are model parameter, and described b1, b2 and c1 are setting value；I-th frame is arbitrarily regarding in the stereopsis frequency range Frequency frame；
The reference parallax of the frame of video of the stereopsis frequency range is obtained in the following manner：Determine the video of the stereopsis frequency range The corresponding parallax set of frame, the parallax collection is combined into the pixel parallax collection in the frame of video viewing area of the stereopsis frequency range Close, and the corresponding pixel quantity of each parallax value therein is all higher than given threshold；By the minimum parallax in the parallax set Value is defined as the reference parallax of the frame of video of the stereopsis frequency range；
The percentage of the reference parallax of the frame of video of the stereopsis frequency range is：The visible area of the frame of video of the stereopsis frequency range In domain, parallax refers to the number of pixels of parallax and the ratio of valid pixel number for the frame of video of the stereopsis frequency range；
The first of the frame of video of the stereopsis frequency range watches frame of video of the comfort degree factor according to the stereopsis frequency range With the presence or absence of frame effect and whether meet down closely upper remote space layout and determine；The frame effect refers to regard for one Frequency frame, if image in the object of screen edge parallax be crossed disparity, and the object a part beyond screen model Enclose, then there is frame effect；It is described it is lower it is near on far refer to the perception of the corresponding object for imaging in screen bottom of a frame of video The perceived depth for the object that depth is near from spectators, image in screen top is remote from spectators；
The second of the frame of video of the stereopsis frequency range watches frame of video of the comfort degree factor according to the stereopsis frequency range Reference parallax time domain change, and/or the stereopsis frequency range frame of video reference parallax occur frequency in time domain Change determine that the size of the second viewing comfort degree factor value represents the reference parallax of frame of video in depth side To the degree of change.
9. method as claimed in claim 7, it is characterised in that according to the viewing comfort level of each frame of video in each subsegment, The viewing comfort level of each subsegment is calculated respectively, including：
The viewing comfort level of the subsegment of the stereopsis frequency range is calculated according to below equation：
Wherein,For the level of comfort of k-th of subsegment,For the viewing comfort level of the i-th frame in k-th of subsegment, NFFor The number of frame of video, P in k-th of subsegment1It is setting numerical value with c2, k-th of subsegment is in the stereopsis frequency range Any one subsegment.
10. method as described in any of claims 7, it is characterised in that calculated according to the viewing comfort level of each subsegment The viewing comfort level of the stereopsis frequency range, including：
The viewing comfort level of the stereopsis frequency range is calculated according to below equation：
Wherein, Q is the viewing comfort level of the stereopsis frequency range,For the comfortable journey of k-th of subsegment in the stereopsis frequency range Degree, NSFor the number of subsegment in the stereopsis frequency range, P2It is setting value with c2.
11. the method as any one of claim 1,2,5,6, it is characterised in that described according to the stereopsis frequency range Frame of video Spatial characteristic and time domain specification, determine the viewing comfort level of the stereopsis frequency range, including：
According to the Spatial characteristic of the frame of video of the stereopsis frequency range, the Spatial characteristic of the stereopsis frequency range is calculated；
According to the time domain specification of the frame of video of the stereopsis frequency range, the time domain specification of the stereopsis frequency range is calculated；
According to the Spatial characteristic and time domain specification of the stereopsis frequency range, the viewing comfort level of the stereopsis frequency range is calculated.
12. method as claimed in claim 11, it is characterised in that the Spatial characteristic of the frame of video of the stereopsis frequency range includes One of following parameter or any combination：The reference parallax of the frame of video of the stereopsis frequency range, with reference to the percentage of parallax and The one viewing comfort degree factor；
In the viewing area of the frame of video of the stereopsis frequency range, the parallax value for meeting the pixel of following condition is the stereopsis The reference parallax of the frame of video of frequency range：The corresponding picture of the reference parallax in the viewing area of the frame of video of the stereopsis frequency range The quantity of element is more than setting pixel quantity threshold value, and the reference parallax is the minimum parallax value in parallax set；The parallax Collection is combined into the pixel parallax set in the frame of video viewing area of the stereopsis frequency range, and each parallax value therein is corresponding Pixel quantity is all higher than the given threshold；
The percentage of the reference parallax of the frame of video of the stereopsis frequency range is：The visible area of the frame of video of the stereopsis frequency range In domain, parallax is the number of pixels of the reference parallax of the frame of video of the stereopsis frequency range and the ratio of valid pixel number；
The first of the frame of video of the stereopsis frequency range watches frame of video of the comfort degree factor according to the stereopsis frequency range With the presence or absence of frame effect and whether meet down closely upper remote space layout and determine；The frame effect refers to regard for one Frequency frame, if image in the object of screen edge parallax be crossed disparity, and the object a part beyond screen model Enclose, then there is frame effect；It is described it is lower it is near on far refer to the perception of the corresponding object for imaging in screen bottom of a frame of video The perceived depth for the object that depth is near from spectators, image in screen top is remote from spectators；
The Spatial characteristic of the frame of video according to the stereopsis frequency range, calculates the Spatial characteristic of the stereopsis frequency range, bag Include：
The weighted average of the reference parallax of all frame of video in the stereopsis frequency range is calculated according to below equation：
Wherein,For the weighted average of the reference parallax of all frame of video in the stereopsis frequency range, N is described vertical The number of frame of video in stereoscopic frequency range, min DispiFor the reference parallax of the i-th frame, P (min Dispi) regarded for the reference of the i-th frame The percentage of difference, i-th frame is any frame of video in the stereopsis frequency range；
Calculate all frame of video in the stereopsis frequency range according to below equation first watches being averaged for the comfort degree factor Value：
Wherein,The flat of the comfort degree factor is watched for first of all frame of video in the stereopsis frequency range Average, dispdistribution iThe comfort degree factor is watched for the first of the i-th frame, N is frame of video in the stereopsis frequency range Number, i-th frame is any frame of video in the stereopsis frequency range.
13. method as claimed in claim 11, it is characterised in that the time domain specification bag of the frame of video of the stereopsis frequency range Include：
The second viewing comfort degree factor of the frame of video of the stereopsis frequency range, the of the frame of video of the stereopsis frequency range The two viewing comfort degree factors are according to the reference parallax of the frame of video of the stereopsis frequency range in the change of time domain, and/or institute The frequency for stating the reference parallax appearance of the frame of video of stereopsis frequency range determines that described second watches comfort level in the change of time domain The size of factor of influence numerical value represents the degree that the reference parallax of frame of video changes in depth direction；
The time domain specification of the frame of video according to the stereopsis frequency range, calculates the time domain specification of the stereopsis frequency range, bag Include：
The second viewing comfort degree factor of the stereopsis frequency range is calculated according to below equation：
Wherein,Second for the stereopsis frequency range watches the comfort degree factor,For in the stereopsis frequency range i-th The second viewing comfort level impression factor of frame, PiFor setting value, PiValue according to V1 iWith min DispiSymbol determine, N For the number of frame of video in the stereopsis frequency range, i-th frame is any frame of video in the stereopsis frequency range.
14. method as described in any of claims 11, it is characterised in that the viewing comfort level of the stereopsis frequency range is adopted Calculated with equation below：
VC=α * Spatial_vc+ β * Temperal_vc
Wherein, VC is the viewing comfort level of the stereopsis frequency range, and α and β are weighted value；B1, c3 are setting value；Spatial_ Frame_vc is the viewing comfort level for the stereopsis frequency range that Spatial characteristic is determined, Temperal_frame_vc is that time domain is special Property determine the stereopsis frequency range viewing comfort level；For all frame of video in the stereopsis frequency range The average value of the first viewing comfort level impression factor,For the reference parallax of all frame of video in the stereopsis frequency range Weighted average,Second for the stereopsis frequency range watches the comfort degree factor.
15. a kind of three-dimensional video-frequency Comfort Evaluation device, it is characterised in that including：
Acquisition module, the frame of video for obtaining stereopsis frequency range；
Extraction module, the parallax of the frame of video for estimating the stereopsis frequency range；Determine the frame of video of the stereopsis frequency range The weights of interior each pixel, the position of the pixel with maximum weights are defined as the vision of the frame of video of the stereopsis frequency range Focal position；The frame of video of the stereopsis frequency range is determined according to the visual focus position of the frame of video of the stereopsis frequency range Viewing area；According to the parallax of the frame of video of the stereopsis frequency range and the visible area of the frame of video of the stereopsis frequency range Domain, extracts the Spatial characteristic and time domain specification of the frame of video of the stereopsis frequency range；
Evaluation module, for the Spatial characteristic of the frame of video of the stereopsis frequency range that is extracted according to the extraction module and when Domain characteristic, determines the viewing comfort level of the stereopsis frequency range.
The extraction module calculates the weights of the pixel using equation below：
W=γ * | mv |+η * | dispcrossed|+λ*|δd|
Wherein, W is the weights for the pixel that coordinate is (x, y), and γ, η and λ are weighted value；Represent described to sit It is designated as the plane motion vector of the pixel of (x, y), dxAnd dyRespectively described coordinate is the horizontal displacement of (x, y) pixel and vertical Displacement, the dxAnd dyWhere frame of video where the pixel that the coordinate is (x, y) and the pixel that the coordinate is (x, y) The adjacent video frame in search of frame of video is obtained；dispcrossedFor crossed disparity value；δ d are the frame of video of the stereopsis frequency range And its difference of the mean parallax of the match block of adjacent video frames.
16. device as claimed in claim 15, it is characterised in that the extraction module is specifically for if the three-dimensional video-frequency The pixel for having maximum weights in the frame of video of section has multiple, then by the multiple pixel with maximum weights, apart from institute The position of the nearest pixel of image center location of the frame of video of stereopsis frequency range is stated, is defined as the video of the stereopsis frequency range The visual focus position of frame.
17. the device as any one of claim 15 or 16, it is characterised in that the Spatial characteristic includes following parameter One of or any combination：Percentage, the first viewing comfort degree factor with reference to parallax, with reference to parallax；
The extraction module is specifically for determining the corresponding parallax set of frame of video of the stereopsis frequency range, the parallax collection It is combined into the pixel parallax set in the frame of video viewing area of the stereopsis frequency range, and the corresponding picture of each parallax value therein Prime number amount is all higher than the given threshold；Minimum parallax value in the parallax set is defined as regarding for the stereopsis frequency range The reference parallax of frequency frame；
In the viewing area for the frame of video for calculating the stereopsis frequency range, parallax is the number of the pixel of the reference parallax with having The ratio of the number of pixel is imitated, the percentage of the reference parallax of the frame of video of the stereopsis frequency range, the valid pixel is obtained The parallax absolute value referred to is less than the pixel of hunting zone；
According to the frame of video of the stereopsis frequency range is with the presence or absence of frame effect and whether meets down closely upper remote space layout, really The first viewing comfort degree factor of the frame of video of the fixed stereopsis frequency range, the first viewing comfort degree factor exists The frame of video of the stereopsis frequency range takes the first value when closely upper remote space layout is not present under frame effect and satisfaction, described vertical The frame of video of stereoscopic frequency range takes second value when closely going up remote space layout under there is frame effect but meeting, in the stereopsis frequency range Frame of video frame effect is not present but is unsatisfactory for taking the 3rd value during lower closely upper remote space layout, in regarding for the stereopsis frequency range There is frame effect and be unsatisfactory for taking the 4th value during lower closely upper remote space layout in frequency frame, wherein, the first value, second value, the 3rd value Be preset value with the 4th value, and the first value is less than the 4th value, the 3rd value between the first value and second value and with the first value and the Two-value is unequal；The frame effect refers to for a frame of video, if the parallax for imaging in the object of screen edge is Crossed disparity, and the object a part beyond screen ranges, then there is frame effect；It is described it is lower it is near on far refer to one The perceived depth of the corresponding object for imaging in screen bottom of frame of video is near from spectators, image in the perception of the object on screen top Depth is remote from spectators.
18. the device as any one of claim 15 or 16, it is characterised in that the time domain specification includes the second viewing The comfort degree factor；
The extraction module specifically for, according to the reference parallax of the frame of video of the stereopsis frequency range time domain change, and/ Or the frequency that the reference parallax of the frame of video of the stereopsis frequency range occurs calculates in the change of time domain and obtains the three-dimensional video-frequency The second viewing comfort degree factor of the frame of video of section, the size of the second viewing comfort degree factor value represents to regard The degree that the reference parallax of frequency frame changes in depth direction.
19. device as claimed in claim 18, it is characterised in that the extraction module is specifically for by the three-dimensional video-frequency Duan Jinhang subsegments are divided, and the reference parallax of the frame of video in same subsegment is monotonically changed and pace of change is identical, according to following public affairs Formula calculates change of the reference parallax in time domain of the frame of video of the stereopsis frequency range：
V1 i=(displast-dispfirst)/(Np-1)
The change of frequency that the reference parallax of the frame of video of the stereopsis frequency range occurs in time domain is calculated according to below equation：
The second viewing comfort degree factor of the frame of video of the stereopsis frequency range is calculated according to below equation：
Wherein, V1 iRepresent the reference parallax of the i-th frame in the change of time domain, dispfirstAnd displastIt is sub belonging to respectively the i-th frame First frame of section and the reference parallax of last frame, Np are the frame of video quantity of the affiliated subsegment of the i-th frame；Represent the ginseng of the i-th frame The frequency of parallax appearance is examined in the change of time domain, P (min Dispi) and P (min Dispi-1) it is respectively the i-th frame and the i-th -1 frame Reference parallax percentage；The comfort degree factor is watched for the second of the i-th frame, γ and μ are weighted value；I-th frame For any frame of video in the stereopsis frequency range.
20. device as claimed in claim 18, it is characterised in that the extraction module is specifically for according to below equation meter Calculate the stereopsis frequency range frame of video reference parallax time domain change：
V1 i=minDispi-minDispi-1
The change of frequency that the reference parallax of the frame of video of the stereopsis frequency range occurs in time domain is calculated according to below equation：
The second viewing comfort degree factor of the frame of video of the stereopsis frequency range is calculated according to below equation：
Wherein, V1 iRepresent change of the reference parallax in time domain of the i-th frame, min DispiWith min Dispi-1Respectively the i-th frame and The reference parallax of i-th -1 frame；Represent the frequency of reference parallax appearance of the i-th frame in the change of time domain, P (min Dispi) and P (min Dispi-1) be respectively the i-th frame and the i-th -1 frame reference parallax percentage；Second for the i-th frame watches comfort level Factor of influence, γ and μ are weighted value, and i-th frame is any frame of video in the stereopsis frequency range.
21. the device as any one of claim 15,16,19,20, it is characterised in that the evaluation module is specifically used In：
According to the Spatial characteristic and time domain specification of each frame of video of the stereopsis frequency range, each is regarded described in calculating respectively The viewing comfort level of frequency frame；
According to the visual focus position of each frame of video of the stereopsis frequency range, subsegment is carried out to the stereopsis frequency range and drawn Point, the visual focus position transfer amount of the frame of video of each subsegment is not more than setting transfer amount threshold value；According to every in each subsegment The viewing comfort level of individual frame of video, calculates the viewing comfort level of each subsegment respectively；
The viewing comfort level of the stereopsis frequency range is calculated according to the viewing comfort level of each subsegment.
22. device as claimed in claim 21, it is characterised in that the evaluation module is specifically for according to below equation meter Calculate the viewing comfort level of the frame of video of the stereopsis frequency range：
Wherein,For the viewing comfort level of the i-th frame, Spatial_frame_vciThe i-th frame determined for the Spatial characteristic of the i-th frame Viewing comfort level, Temperal_frame_vciThe viewing comfort level of the i-th frame determined for the time domain specification of the i-th frame, α and β For weighted value；dispdistribution iFirst for the i-th frame watches the comfort degree factor, min DispiReference for the i-th frame is regarded Difference, P (min Dispi) for the i-th frame reference parallax percentage；Second for the i-th frame watches the comfort degree factor； B1, b2 and c1 are model parameter, and described b1, b2 and c1 are setting value, and i-th frame is arbitrarily regarding in the stereopsis frequency range Frequency frame；
The reference parallax of the frame of video of the stereopsis frequency range is obtained in the following manner：Determine the video of the stereopsis frequency range The corresponding parallax set of frame, the parallax collection is combined into the pixel parallax collection in the frame of video viewing area of the stereopsis frequency range Close, and the corresponding pixel quantity of each parallax value therein is all higher than the given threshold；By the minimum in the parallax set Parallax value is defined as the reference parallax of the frame of video of the stereopsis frequency range；
The percentage of the reference parallax of the frame of video of the stereopsis frequency range is：The visible area of the frame of video of the stereopsis frequency range In domain, parallax refers to the number of pixels of parallax and the ratio of valid pixel number for the frame of video of the stereopsis frequency range；
The first of the frame of video of the stereopsis frequency range watches frame of video of the comfort degree factor according to the stereopsis frequency range With the presence or absence of frame effect and whether meet down closely upper remote space layout and determine；The frame effect refers to regard for one Frequency frame, if image in the object of screen edge parallax be crossed disparity, and the object a part beyond screen model Enclose, then there is frame effect；It is described it is lower it is near on far refer to the perception of the corresponding object for imaging in screen bottom of a frame of video The perceived depth for the object that depth is near from spectators, image in screen top is remote from spectators；
The second of the frame of video of the stereopsis frequency range watches frame of video of the comfort degree factor according to the stereopsis frequency range Reference parallax time domain change, and/or the stereopsis frequency range frame of video reference parallax occur frequency in time domain Change determine that the size of the second viewing comfort degree factor value represents the reference parallax of frame of video in depth side To the degree of change.
23. device as claimed in claim 21, it is characterised in that the evaluation module is specifically for according to below equation meter Calculate the viewing comfort level of institute's stereopsis frequency range：
Wherein,For the level of comfort of k-th of subsegment,For the viewing comfort level of the i-th frame in k-th of subsegment, NFFor The number of frame of video, P in k-th of subsegment1It is setting numerical value with c2, k-th of subsegment is in the stereopsis frequency range Any one subsegment.
24. device as claimed in claim 21, it is characterised in that the evaluation module is specifically for according to below equation meter Calculate the viewing comfort level of the stereopsis frequency range：
Wherein, Q is the viewing comfort level of the stereopsis frequency range,For the comfortable journey of k-th of subsegment in the stereopsis frequency range Degree, NSFor the number of subsegment in the stereopsis frequency range, P2It is setting value with c2.
25. the device as any one of claim 15,16,19,20, it is characterised in that the evaluation module is specifically used In：According to the Spatial characteristic of the frame of video of the stereopsis frequency range, the Spatial characteristic of the stereopsis frequency range is calculated；
According to the time domain specification of the frame of video of the stereopsis frequency range, the time domain specification of the stereopsis frequency range is calculated；
According to the Spatial characteristic and time domain specification of the stereopsis frequency range, the viewing comfort level of the stereopsis frequency range is calculated.
26. device as claimed in claim 25, it is characterised in that the Spatial characteristic of the frame of video of the stereopsis frequency range includes One of following parameter or any combination：The reference parallax of the frame of video of the stereopsis frequency range, with reference to the percentage of parallax and The one viewing comfort degree factor；
In the viewing area of the frame of video of the stereopsis frequency range, the parallax value for meeting the pixel of following condition is the stereopsis The reference parallax of the frame of video of frequency range：The corresponding picture of the reference parallax in the viewing area of the frame of video of the stereopsis frequency range The quantity of element is more than setting pixel quantity threshold value, and the reference parallax is the minimum parallax value in parallax set；The parallax Collection is combined into the pixel parallax set in the frame of video viewing area of the stereopsis frequency range, and each parallax value therein is corresponding Pixel quantity is all higher than the given threshold；
The percentage of the reference parallax of the frame of video of the stereopsis frequency range is：The visible area of the frame of video of the stereopsis frequency range In domain, parallax is the number of pixels of the reference parallax of the frame of video of the stereopsis frequency range and the ratio of valid pixel number；
The first of the frame of video of the stereopsis frequency range watches frame of video of the comfort degree factor according to the stereopsis frequency range With the presence or absence of frame effect and whether meet down closely upper remote space layout and determine；The frame effect refers to regard for one Frequency frame, if image in the object of screen edge parallax be crossed disparity, and the object a part beyond screen model Enclose, then there is frame effect；It is described it is lower it is near on far refer to the perception of the corresponding object for imaging in screen bottom of a frame of video The perceived depth for the object that depth is near from spectators, image in screen top is remote from spectators；
The evaluation module is specifically for calculating the reference parallax of all frame of video in the stereopsis frequency range according to below equation Weighted average：
Wherein,For the weighted average of the reference parallax of all frame of video in the stereopsis frequency range, N is described vertical The number of frame of video in stereoscopic frequency range, min DispiFor the reference parallax of the i-th frame, P (min Dispi) regarded for the reference of the i-th frame The percentage of difference, i-th frame is any frame of video in the stereopsis frequency range；
Calculate all frame of video in the stereopsis frequency range according to below equation first watches being averaged for the comfort degree factor Value：
Wherein,The flat of the comfort degree factor is watched for first of all frame of video in the stereopsis frequency range Average, dispdistribution iThe comfort degree factor is watched for the first of the i-th frame, N is frame of video in the stereopsis frequency range Number, i-th frame is any frame of video in the stereopsis frequency range.
27. device as claimed in claim 25, it is characterised in that the time domain specification bag of the frame of video of the stereopsis frequency range Include：
The second viewing comfort degree factor of the frame of video of the stereopsis frequency range, the of the frame of video of the stereopsis frequency range The two viewing comfort degree factors are according to the reference parallax of the frame of video of the stereopsis frequency range in the change of time domain, and/or institute The frequency for stating the reference parallax appearance of the frame of video of stereopsis frequency range determines that described second watches comfort level in the change of time domain The size of factor of influence numerical value represents the degree that the reference parallax of frame of video changes in depth direction；
The evaluation module specifically for, according to below equation calculate the second viewing comfort degree of the stereopsis frequency range because Son：
Wherein,Second for the stereopsis frequency range watches the comfort degree factor,For in the stereopsis frequency range i-th The second viewing comfort degree factor of frame, PiFor setting value, PiValue according to V1 iWith min DispiSymbol determine, N For the number of frame of video in the stereopsis frequency range, i-th frame is any frame of video in the stereopsis frequency range.
28. device as claimed in claim 25, it is characterised in that the evaluation module is specifically for according to below equation meter Calculate the viewing comfort level of the stereopsis frequency range：
VC=α * Spatial_vc+ β * Temperal_vc
Wherein, VC is the viewing comfort level of the stereopsis frequency range, and α and β are weighted value；B1, c3 are setting value；Spatial_ Frame_vc is the viewing comfort level for the stereopsis frequency range that Spatial characteristic is determined, Temperal_frame_vc is that time domain is special Property determine the stereopsis frequency range viewing comfort level；For all frame of video in the stereopsis frequency range The average value of the first viewing comfort degree factor,For the reference parallax of all frame of video in the stereopsis frequency range Weighted average,Second for the stereopsis frequency range watches the comfort degree factor.
CN201710203858.1A 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device Active CN107155105B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710203858.1A CN107155105B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710203858.1A CN107155105B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device
CN201310740605.XA CN104754322B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201310740605.XA Division CN104754322B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device

Publications (2)

Publication Number Publication Date
CN107155105A true CN107155105A (en) 2017-09-12
CN107155105B CN107155105B (en) 2019-03-01

Family

ID=53477473

Family Applications (5)

Application Number Title Priority Date Filing Date
CN201710203858.1A Active CN107155105B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device
CN201710203860.9A Active CN107181940B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device
CN201710204296.2A Active CN106973288B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device
CN201710203859.6A Active CN107155106B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device
CN201310740605.XA Active CN104754322B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device

Family Applications After (4)

Application Number Title Priority Date Filing Date
CN201710203860.9A Active CN107181940B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device
CN201710204296.2A Active CN106973288B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device
CN201710203859.6A Active CN107155106B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device
CN201310740605.XA Active CN104754322B (en) 2013-12-27 2013-12-27 A kind of three-dimensional video-frequency Comfort Evaluation method and device

Country Status (2)

Country Link
CN (5) CN107155105B (en)
WO (1) WO2015096461A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106341677B (en) * 2015-07-07 2018-04-20 中国科学院深圳先进技术研究院 Virtual view method for evaluating video quality
CN105335992B (en) * 2015-10-15 2020-02-04 北京邮电大学 Three-dimensional animation scene frame scoring model determination method and device
CN106028025B (en) * 2016-05-11 2017-11-21 吉林大学 A kind of 3D video comfort degree evaluation methods for influx and regulation uniformity
CN106210710B (en) * 2016-07-25 2018-01-30 宁波大学 A kind of stereo image vision comfort level evaluation method based on multi-scale dictionary
CN106851246B (en) * 2017-02-06 2019-08-23 京东方科技集团股份有限公司 Method and apparatus for determining the visual fatigue degree of 3-D image or video
CN109429051B (en) * 2017-07-12 2020-08-18 天津大学 Non-reference stereo video quality objective evaluation method based on multi-view feature learning
CN107909565A (en) * 2017-10-29 2018-04-13 天津大学 Stereo-picture Comfort Evaluation method based on convolutional neural networks
CN109905694B (en) * 2017-12-08 2020-09-08 中移（杭州）信息技术有限公司 Quality evaluation method, device and equipment for stereoscopic video
CN109089111B (en) * 2018-10-22 2020-05-26 Oppo广东移动通信有限公司 Method and system for evaluating comfort level of stereoscopic video and terminal equipment
CN110691236B (en) * 2019-09-18 2021-05-07 宁波大学 Panoramic video quality evaluation method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101582063A (en) * 2008-05-13 2009-11-18 华为技术有限公司 Video service system, video service device and extraction method for key frame thereof
KR20110139020A (en) * 2010-06-22 2011-12-28 연세대학교 산학협력단 Fatigue evaluation method and apparatus for 3d video based on depth map
US20120098823A1 (en) * 2010-10-22 2012-04-26 Samsung Electronics Co., Ltd. Display apparatus and method
CN103096122A (en) * 2013-01-24 2013-05-08 上海交通大学 Stereoscopic vision comfort level evaluation method based on motion features inside area of interest
CN103210652A (en) * 2010-11-12 2013-07-17 索尼公司 3d video image encoding apparatus, decoding apparatus and method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101960844B1 (en) * 2011-11-01 2019-03-22 삼성전자주식회사 Image processing apparatus and method
CN103096125B (en) * 2013-02-22 2015-03-04 吉林大学 Stereoscopic video visual comfort evaluation method based on region segmentation
CN103595990B (en) * 2013-10-30 2015-05-20 清华大学 Method for obtaining binocular stereoscopic video comfort level of motion perception

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101582063A (en) * 2008-05-13 2009-11-18 华为技术有限公司 Video service system, video service device and extraction method for key frame thereof
KR20110139020A (en) * 2010-06-22 2011-12-28 연세대학교 산학협력단 Fatigue evaluation method and apparatus for 3d video based on depth map
US20120098823A1 (en) * 2010-10-22 2012-04-26 Samsung Electronics Co., Ltd. Display apparatus and method
CN103210652A (en) * 2010-11-12 2013-07-17 索尼公司 3d video image encoding apparatus, decoding apparatus and method
CN103096122A (en) * 2013-01-24 2013-05-08 上海交通大学 Stereoscopic vision comfort level evaluation method based on motion features inside area of interest

Also Published As

Publication number Publication date
CN106973288A (en) 2017-07-21
CN107155106B (en) 2019-03-01
CN107181940B (en) 2019-05-03
CN107181940A (en) 2017-09-19
CN104754322A (en) 2015-07-01
CN106973288B (en) 2019-08-13
WO2015096461A1 (en) 2015-07-02
CN104754322B (en) 2018-01-23
CN107155106A (en) 2017-09-12
CN107155105B (en) 2019-03-01

Similar Documents

Publication Publication Date Title
CN107155105B (en) A kind of three-dimensional video-frequency Comfort Evaluation method and device
Nojiri et al. Measurement of parallax distribution and its application to the analysis of visual comfort for stereoscopic HDTV
CN103096125B (en) Stereoscopic video visual comfort evaluation method based on region segmentation
Mittal et al. Algorithmic assessment of 3D quality of experience for images and videos
CN103986925B (en) based on the stereoscopic video visual comfort evaluation method of luminance compensation
Xing et al. Assessment of stereoscopic crosstalk perception
Jung et al. Visual importance-and discomfort region-selective low-pass filtering for reducing visual discomfort in stereoscopic displays
CN107578403A (en) The stereo image quality evaluation method of binocular view fusion is instructed based on gradient information
US10110872B2 (en) Method and device for correcting distortion errors due to accommodation effect in stereoscopic display
CN108449596A (en) A kind of 3D stereo image quality appraisal procedures of fusion aesthetics and comfort level
Cho et al. An Assessment of Visual Discomfort Caused by Motion-in-Depth in Stereoscopic 3D Video.
Xing et al. Estimating quality of experience on stereoscopic images
Barkowsky et al. Is visual fatigue changing the perceived depth accuracy on an autostereoscopic display?
Cho et al. Subjective evaluation of visual discomfort caused from stereoscopic 3D video using perceptual importance map
JP2002245451A (en) Stereoscopic image evaluating device
Cho et al. The measurement of eyestrain caused from diverse binocular disparities, viewing time and display sizes in watching stereoscopic 3D content
CN110060291B (en) Three-dimensional apparent distance resolving method considering human factors
Cho et al. An Analysis of Visual Discomfort Caused by Watching Stereoscopic 3D Content in Terms of Depth, Viewing Time and Display Size.
Bokov et al. Toward fully automatic channel-mismatch detection and discomfort prediction for S3D video
Jung et al. Visualizing the perceived discomfort of stereoscopic video
Fornalczyk et al. Stereoscopic image perception quality factors
Wang et al. Study of center-bias in the viewing of stereoscopic image and a framework for extending 2D visual attention models to 3D
Xing et al. Subjective crosstalk assessment methodology for auto-stereoscopic displays
Rogalska et al. A problem of assessing visual comfort in virtual reality applications
Toyosawa et al. Measurement of perceived stereoscopic sensation through disparity metrics and compositions

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant